2024-04-25T09:47:42.835 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T09:47:42.835 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036 --name neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi --owner scheduled_neesingh@teuthology --verbose --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} -- /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/orig.config.yaml 2024-04-25T09:47:42.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:47:42.985 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7673036' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: a3b7a189d278a9762c1acb7de36790ef0ed7b448 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1124 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: a3b7a189d278a9762c1acb7de36790ef0ed7b448 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC3USzfx5rXSjewwpUrL5A8DI/BwpjY+3kUUdTQ7mdAcos5fZ+/x769Z7Ig9gkCxhm17Ye1jewNy/vsZQN+CRc= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwg8crrdr2nOdlWm1OcdEH1WRGAOSXsOpRLL+AO8YIkfr/8gfoedwkFXGXplPA212UgpSXjLCihb9wyuSvv950= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_09:36:50 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T09:47:42.986 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa; will attempt to use it 2024-04-25T09:47:42.986 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa/tasks 2024-04-25T09:47:42.986 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T09:47:42.988 INFO:teuthology.task.internal:Checking packages... 2024-04-25T09:47:43.013 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T09:47:43.013 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T09:47:43.013 INFO:teuthology.packaging:ref: None 2024-04-25T09:47:43.013 INFO:teuthology.packaging:tag: None 2024-04-25T09:47:43.014 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T09:47:43.014 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:47:43.014 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T09:47:43.157 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:47:43.160 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T09:47:43.167 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T09:47:43.167 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T09:47:43.231 INFO:teuthology.task.internal:Saving configuration 2024-04-25T09:47:43.246 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T09:47:43.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T09:47:43.283 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:42:00.183432', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMvcg8fl6ovMBLaFHkHHSOL09uaOrlfQnU1jlYSzIAdy'} 2024-04-25T09:47:43.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 09:42:00.184509', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPldIaipEmI60K50TCE7Ku6TryMFBC8VqUC7yfg6x7GT'} 2024-04-25T09:47:43.304 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T09:47:43.310 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T09:47:43.310 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T09:47:43.310 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T09:47:43.395 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8380dbb0d0>, signals=[15]) 2024-04-25T09:47:43.395 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T09:47:43.431 INFO:teuthology.task.internal:Opening connections... 2024-04-25T09:47:43.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T09:47:43.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:47:43.517 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T09:47:43.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:47:43.597 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T09:47:43.604 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-04-25T09:47:43.610 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-04-25T09:47:43.610 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="Ubuntu" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="22.04" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_CODENAME=jammy 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:ID=ubuntu 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE=debian 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T09:47:43.659 INFO:teuthology.orchestra.run.smithi018.stdout:UBUNTU_CODENAME=jammy 2024-04-25T09:47:43.660 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-04-25T09:47:43.682 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-04-25T09:47:43.688 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-04-25T09:47:43.688 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-04-25T09:47:43.733 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Ubuntu" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="22.04" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_CODENAME=jammy 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:ID=ubuntu 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE=debian 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T09:47:43.734 INFO:teuthology.orchestra.run.smithi167.stdout:UBUNTU_CODENAME=jammy 2024-04-25T09:47:43.735 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-04-25T09:47:43.756 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T09:47:43.765 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T09:47:43.790 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T09:47:43.790 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:47:43.793 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-04-25T09:47:43.797 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T09:47:43.815 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T09:47:43.815 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:47:43.840 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-04-25T09:47:43.847 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T09:47:43.904 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T09:47:43.918 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T09:47:43.918 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T09:47:43.918 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T09:47:43.919 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:47:43.919 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T09:47:43.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:43.924 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T09:47:43.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:47:43.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T09:47:44.112 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:47:44.112 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T09:47:44.112 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-25T09:47:44.118 INFO:teuthology.orchestra.run.smithi018.stdout:5.15.0-56-generic 2024-04-25T09:47:44.118 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:47:44.119 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T09:47:44.119 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T09:47:44.119 DEBUG:teuthology.orchestra.run.smithi018:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T09:47:44.120 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:47:44.120 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T09:47:44.120 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-04-25T09:47:44.126 INFO:teuthology.orchestra.run.smithi167.stdout:5.15.0-56-generic 2024-04-25T09:47:44.126 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:47:44.126 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T09:47:44.126 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-25T09:47:44.127 DEBUG:teuthology.orchestra.run.smithi167:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T09:47:44.186 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T09:47:44.187 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: git config --global init.defaultBranch 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: 2024-04-25T09:47:44.322 INFO:teuthology.orchestra.run.smithi167.stderr:hint: git branch -m 2024-04-25T09:47:44.323 INFO:teuthology.orchestra.run.smithi167.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T09:47:44.325 DEBUG:teuthology.orchestra.run.smithi167:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T09:47:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T09:47:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T09:47:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: git config --global init.defaultBranch 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:hint: git branch -m 2024-04-25T09:47:44.332 INFO:teuthology.orchestra.run.smithi018.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T09:47:44.335 DEBUG:teuthology.orchestra.run.smithi018:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T09:47:44.392 DEBUG:teuthology.orchestra.run.smithi167:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T09:47:44.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T09:47:44.445 DEBUG:teuthology.orchestra.run.smithi167:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T09:47:44.464 DEBUG:teuthology.orchestra.run.smithi018:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T09:49:23.162 INFO:teuthology.orchestra.run.smithi018.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T09:49:23.162 INFO:teuthology.orchestra.run.smithi018.stderr: * [new branch] main -> origin/main 2024-04-25T09:49:23.196 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T09:49:23.196 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T09:49:23.196 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T09:49:23.196 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T09:49:23.197 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T09:49:23.197 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T09:49:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T09:49:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T09:49:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T09:49:23.198 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T09:49:23.199 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T09:49:23.200 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T09:49:23.201 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T09:49:23.202 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T09:49:23.202 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T09:49:23.202 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T09:49:23.203 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T09:49:23.203 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T09:49:23.203 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T09:49:23.203 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T09:49:23.204 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T09:49:23.204 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T09:49:23.204 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T09:49:23.204 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T09:49:23.204 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T09:49:23.205 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T09:49:23.205 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T09:49:23.205 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T09:49:23.205 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T09:49:23.206 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T09:49:23.206 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T09:49:23.206 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T09:49:23.206 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T09:49:23.207 INFO:teuthology.orchestra.run.smithi018.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T09:49:26.858 INFO:teuthology.orchestra.run.smithi167.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T09:49:26.861 INFO:teuthology.orchestra.run.smithi167.stderr: * [new branch] main -> origin/main 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T09:49:26.894 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T09:49:26.895 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T09:49:26.895 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T09:49:26.895 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T09:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T09:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T09:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T09:49:26.898 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T09:49:26.899 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T09:49:26.900 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T09:49:26.902 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T09:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T09:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T09:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T09:49:26.903 INFO:teuthology.orchestra.run.smithi167.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T09:49:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:Updating files: 44% (1495/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 58% (1977/3381) Updating files: 59% (1995/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 68% (2330/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 82% (2781/3381) Updating files: 83% (2807/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T09:49:27.732 INFO:teuthology.orchestra.run.smithi018.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T09:49:27.755 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T09:49:27.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:49:27.933 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:49:27.933 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T09:49:27.936 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi018.front.sepia.ceph.com to complete... 2024-04-25T09:49:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25 09:49:29 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T09:49:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:FINISHED --2024-04-25 09:49:29-- 2024-04-25T09:49:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:Total wall clock time: 1.7s 2024-04-25T09:49:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:Downloaded: 1 files, 43M in 1.6s (27.5 MB/s) 2024-04-25T09:49:29.647 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T09:49:29.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T09:49:29.896 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T09:49:31.179 INFO:teuthology.orchestra.run.smithi167.stderr:Updating files: 44% (1509/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2001/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2810/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T09:49:31.184 INFO:teuthology.orchestra.run.smithi167.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T09:49:31.205 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T09:49:31.205 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T09:49:31.364 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:49:31.365 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T09:49:31.367 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi167.front.sepia.ceph.com to complete... 2024-04-25T09:49:31.875 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T09:49:31.879 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T09:49:32.002 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T09:49:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25 09:49:33 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T09:49:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:FINISHED --2024-04-25 09:49:33-- 2024-04-25T09:49:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:Total wall clock time: 1.7s 2024-04-25T09:49:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:Downloaded: 1 files, 43M in 1.6s (27.3 MB/s) 2024-04-25T09:49:33.094 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T09:49:33.094 DEBUG:teuthology.orchestra.run.smithi167:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T09:49:33.372 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T09:49:35.312 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T09:49:35.422 INFO:teuthology.orchestra.run.smithi018.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:35.450 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T09:49:35.455 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T09:49:35.626 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T09:49:40.159 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T09:49:40.271 INFO:teuthology.orchestra.run.smithi167.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:56.658 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2024-04-25T09:49:56.679 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T09:49:56.714 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-04-25T09:49:56.990 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:57.013 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:57.271 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T09:49:57.281 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T09:49:57.356 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T09:49:57.361 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T09:49:57.506 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T09:49:57.506 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T09:49:57.507 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T09:49:57.545 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-04-25T09:49:57.719 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T09:49:57.727 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T09:49:57.727 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T09:49:57.727 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:57.741 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:57.742 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:57.761 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T09:49:57.762 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T09:49:57.763 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T09:49:57.766 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T09:49:57.767 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T09:49:57.768 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T09:49:57.779 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T09:49:57.780 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T09:49:57.781 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T09:49:57.782 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T09:49:57.783 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T09:49:57.784 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T09:49:57.785 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T09:49:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T09:49:57.787 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T09:49:57.788 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T09:49:57.789 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T09:49:57.790 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T09:49:57.842 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T09:49:57.843 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T09:49:57.844 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T09:49:57.845 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T09:49:57.846 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T09:49:57.847 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T09:49:57.848 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T09:49:57.849 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T09:49:57.850 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T09:49:57.851 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T09:49:57.852 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T09:49:57.853 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T09:49:57.854 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T09:49:57.855 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T09:49:57.856 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T09:49:57.857 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T09:49:57.858 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T09:49:57.859 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T09:49:57.860 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T09:49:57.861 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T09:49:57.862 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T09:49:57.863 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T09:49:57.864 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T09:49:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T09:49:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T09:49:57.867 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T09:49:57.868 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T09:49:57.869 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T09:49:57.870 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T09:49:57.871 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T09:49:57.872 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T09:49:57.873 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T09:49:57.874 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T09:49:57.875 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T09:49:57.876 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T09:49:57.877 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T09:49:57.878 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T09:49:57.879 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T09:49:57.880 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T09:49:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T09:49:57.882 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T09:49:57.883 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T09:49:57.884 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T09:49:57.885 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T09:49:57.886 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T09:49:57.887 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T09:49:57.888 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T09:49:57.889 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T09:49:57.890 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T09:49:57.891 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T09:49:57.892 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T09:49:57.892 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T09:49:57.955 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T09:49:57.955 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T09:49:57.955 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T09:49:57.955 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T09:49:57.956 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T09:49:57.957 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T09:49:57.958 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T09:49:57.959 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T09:49:57.960 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T09:49:57.961 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T09:49:57.962 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T09:49:57.963 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T09:49:57.964 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T09:49:57.965 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T09:49:57.966 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T09:49:57.967 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T09:49:57.968 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T09:49:57.968 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T09:49:57.968 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T09:49:57.970 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T09:49:57.971 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T09:49:57.972 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T09:49:57.973 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T09:49:57.974 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T09:49:57.975 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T09:49:57.976 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T09:49:57.977 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T09:49:57.978 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T09:49:57.979 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T09:49:57.980 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T09:49:57.981 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T09:49:57.982 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T09:49:57.983 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T09:49:57.984 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T09:49:57.985 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T09:49:57.986 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T09:49:57.987 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T09:49:57.988 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T09:49:57.989 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T09:49:57.990 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T09:49:57.991 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T09:49:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T09:49:57.993 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T09:49:57.994 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T09:49:57.995 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T09:49:57.996 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T09:49:57.997 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T09:49:57.998 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T09:49:57.999 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T09:49:58.000 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T09:49:58.001 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T09:49:58.002 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T09:49:58.003 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T09:49:58.004 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T09:49:58.005 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T09:49:58.006 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T09:49:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T09:49:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T09:49:58.009 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T09:49:58.010 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T09:49:58.011 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T09:49:58.012 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T09:49:58.013 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T09:49:58.014 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T09:49:58.015 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T09:49:58.016 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T09:49:58.017 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T09:49:58.061 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T09:49:58.062 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T09:49:58.063 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T09:49:58.064 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T09:49:58.065 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T09:49:58.066 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T09:49:58.067 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T09:49:58.068 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T09:49:58.069 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T09:49:58.070 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T09:49:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T09:49:58.072 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T09:49:58.073 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T09:49:58.074 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T09:49:58.075 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T09:49:58.076 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T09:49:58.077 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T09:49:58.078 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T09:49:58.079 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T09:49:58.080 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T09:49:58.081 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T09:49:58.082 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T09:49:58.083 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T09:49:58.084 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T09:49:58.085 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T09:49:58.086 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T09:49:58.087 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T09:49:58.088 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T09:49:58.089 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T09:49:58.090 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T09:49:58.091 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T09:49:58.092 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T09:49:58.093 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T09:49:58.094 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T09:49:58.095 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T09:49:58.096 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T09:49:58.097 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T09:49:58.098 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T09:49:58.099 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T09:49:58.100 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T09:49:58.101 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T09:49:58.102 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T09:49:58.103 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T09:49:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T09:49:58.105 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T09:49:58.105 INFO:teuthology.orchestra.run.smithi018.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:49:58.105 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T09:49:58.105 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T09:49:58.110 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:58.110 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:58.110 DEBUG:teuthology.orchestra.run.smithi018:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T09:49:58.116 INFO:teuthology.orchestra.run.smithi018.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:49:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:49:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:49:58.117 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T09:49:58.117 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:58.117 DEBUG:teuthology.orchestra.run.smithi018:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T09:49:58.161 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi018.front.sepia.ceph.com to complete... 2024-04-25T09:49:58.571 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub' 2024-04-25T09:49:58.572 INFO:teuthology.orchestra.run.smithi018.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T09:49:58.577 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-04-25T09:49:58.762 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:58.768 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:49:59.015 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T09:49:59.020 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T09:49:59.061 INFO:teuthology.orchestra.run.smithi018.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T09:49:59.065 INFO:teuthology.orchestra.run.smithi018.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T09:49:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T09:49:59.177 INFO:teuthology.orchestra.run.smithi018.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T09:49:59.178 INFO:teuthology.orchestra.run.smithi018.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T09:49:59.197 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-04-25T09:50:03.130 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2024-04-25T09:50:03.154 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T09:50:03.182 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-04-25T09:50:03.579 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:03.599 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:03.971 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T09:50:03.979 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T09:50:04.043 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T09:50:04.048 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T09:50:04.205 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T09:50:04.206 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T09:50:04.206 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T09:50:04.250 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-04-25T09:50:04.440 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T09:50:04.448 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T09:50:04.448 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T09:50:04.448 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.466 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.467 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.489 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T09:50:04.489 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T09:50:04.490 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T09:50:04.493 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T09:50:04.493 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T09:50:04.494 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T09:50:04.495 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T09:50:04.496 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T09:50:04.496 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T09:50:04.496 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T09:50:04.511 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T09:50:04.511 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T09:50:04.512 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T09:50:04.513 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T09:50:04.514 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T09:50:04.515 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T09:50:04.516 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T09:50:04.517 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T09:50:04.518 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T09:50:04.519 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T09:50:04.520 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T09:50:04.521 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T09:50:04.522 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T09:50:04.523 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T09:50:04.523 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T09:50:04.523 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T09:50:04.523 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T09:50:04.523 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T09:50:04.578 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T09:50:04.579 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T09:50:04.580 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T09:50:04.581 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T09:50:04.582 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T09:50:04.583 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T09:50:04.584 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T09:50:04.585 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T09:50:04.586 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T09:50:04.587 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T09:50:04.588 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T09:50:04.589 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T09:50:04.590 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T09:50:04.591 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T09:50:04.592 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T09:50:04.593 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T09:50:04.594 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T09:50:04.595 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T09:50:04.596 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T09:50:04.597 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T09:50:04.598 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T09:50:04.599 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T09:50:04.600 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T09:50:04.601 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T09:50:04.602 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T09:50:04.603 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T09:50:04.604 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T09:50:04.605 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T09:50:04.606 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T09:50:04.607 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T09:50:04.608 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T09:50:04.609 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T09:50:04.610 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T09:50:04.611 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T09:50:04.612 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T09:50:04.613 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T09:50:04.614 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T09:50:04.615 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T09:50:04.616 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T09:50:04.617 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T09:50:04.618 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T09:50:04.619 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T09:50:04.620 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T09:50:04.621 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T09:50:04.622 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T09:50:04.623 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T09:50:04.624 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T09:50:04.625 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T09:50:04.626 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T09:50:04.627 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T09:50:04.628 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T09:50:04.673 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T09:50:04.673 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T09:50:04.673 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T09:50:04.673 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T09:50:04.673 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T09:50:04.674 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T09:50:04.675 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T09:50:04.676 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T09:50:04.677 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T09:50:04.678 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T09:50:04.679 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T09:50:04.680 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T09:50:04.681 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T09:50:04.682 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T09:50:04.683 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T09:50:04.684 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T09:50:04.685 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T09:50:04.686 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T09:50:04.687 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T09:50:04.688 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T09:50:04.689 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T09:50:04.690 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T09:50:04.691 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T09:50:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T09:50:04.693 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T09:50:04.694 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T09:50:04.695 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T09:50:04.696 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T09:50:04.697 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T09:50:04.698 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T09:50:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T09:50:04.700 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T09:50:04.701 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T09:50:04.702 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T09:50:04.703 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T09:50:04.704 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T09:50:04.705 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T09:50:04.706 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T09:50:04.707 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T09:50:04.708 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T09:50:04.709 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T09:50:04.710 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T09:50:04.711 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T09:50:04.712 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T09:50:04.713 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T09:50:04.714 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T09:50:04.757 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T09:50:04.757 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T09:50:04.758 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T09:50:04.759 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T09:50:04.760 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T09:50:04.761 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T09:50:04.762 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T09:50:04.763 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T09:50:04.764 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T09:50:04.765 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T09:50:04.766 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T09:50:04.767 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T09:50:04.768 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T09:50:04.769 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T09:50:04.770 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T09:50:04.771 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T09:50:04.772 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T09:50:04.773 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T09:50:04.774 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T09:50:04.775 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T09:50:04.776 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T09:50:04.777 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T09:50:04.778 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T09:50:04.779 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T09:50:04.780 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T09:50:04.781 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T09:50:04.782 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T09:50:04.783 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T09:50:04.784 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T09:50:04.785 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T09:50:04.786 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T09:50:04.787 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T09:50:04.788 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T09:50:04.789 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T09:50:04.790 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T09:50:04.791 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T09:50:04.792 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T09:50:04.793 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T09:50:04.794 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T09:50:04.795 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T09:50:04.796 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T09:50:04.797 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T09:50:04.798 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T09:50:04.799 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T09:50:04.800 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T09:50:04.801 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T09:50:04.802 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T09:50:04.802 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T09:50:04.802 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T09:50:04.839 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T09:50:04.840 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T09:50:04.841 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T09:50:04.842 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T09:50:04.843 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T09:50:04.844 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T09:50:04.845 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T09:50:04.846 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T09:50:04.847 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T09:50:04.848 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T09:50:04.849 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T09:50:04.850 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T09:50:04.851 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T09:50:04.852 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T09:50:04.853 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T09:50:04.854 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T09:50:04.855 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T09:50:04.856 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T09:50:04.857 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T09:50:04.858 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T09:50:04.859 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T09:50:04.860 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T09:50:04.861 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T09:50:04.862 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T09:50:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T09:50:04.864 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T09:50:04.865 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T09:50:04.866 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T09:50:04.867 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T09:50:04.868 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T09:50:04.869 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T09:50:04.870 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T09:50:04.871 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T09:50:04.872 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T09:50:04.873 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T09:50:04.874 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T09:50:04.875 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T09:50:04.880 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.880 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.880 DEBUG:teuthology.orchestra.run.smithi167:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T09:50:04.887 INFO:teuthology.orchestra.run.smithi167.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:50:04.887 INFO:teuthology.orchestra.run.smithi167.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:50:04.888 INFO:teuthology.orchestra.run.smithi167.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T09:50:04.888 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T09:50:04.888 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:04.888 DEBUG:teuthology.orchestra.run.smithi167:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T09:50:04.931 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi167.front.sepia.ceph.com to complete... 2024-04-25T09:50:05.385 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub' 2024-04-25T09:50:05.386 INFO:teuthology.orchestra.run.smithi167.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T09:50:05.401 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-04-25T09:50:05.675 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:05.681 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T09:50:06.047 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T09:50:06.053 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T09:50:06.096 INFO:teuthology.orchestra.run.smithi167.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T09:50:06.101 INFO:teuthology.orchestra.run.smithi167.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T09:50:06.247 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T09:50:06.247 INFO:teuthology.orchestra.run.smithi167.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T09:50:06.247 INFO:teuthology.orchestra.run.smithi167.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T09:50:06.264 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-04-25T09:50:30.406 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T09:50:30.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-25T09:50:30.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:50:37.379 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T09:50:37.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:50:37.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:11.903 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-25T09:51:20.910 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:51:20.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:30.418 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T09:51:39.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-25T09:51:39.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-25T09:51:39.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:47.345 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-25T09:51:48.217 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-25T09:51:48.217 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T09:51:48.217 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-04-25T09:51:48.225 INFO:teuthology.orchestra.run.smithi018.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T09:51:48.225 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T09:51:48.225 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T09:51:48.225 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T09:51:49.228 DEBUG:teuthology.parallel:result is None 2024-04-25T09:51:51.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:51:51.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:51:52.314 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-04-25T09:52:07.315 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:52:07.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:52:07.516 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-25T09:52:08.231 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:52:08.231 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T09:52:08.231 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-04-25T09:52:08.282 INFO:teuthology.orchestra.run.smithi167.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T09:52:08.282 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T09:52:08.283 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T09:52:08.283 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T09:52:09.284 DEBUG:teuthology.parallel:result is None 2024-04-25T09:52:09.284 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T09:52:09.292 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T09:52:09.292 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:52:09.296 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T09:52:09.305 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T09:52:09.315 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T09:52:09.358 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T09:52:09.358 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:52:09.361 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T09:52:09.382 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T09:52:09.399 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T09:52:09.399 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:52:09.418 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T09:52:09.484 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:52:09.504 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:52:09.540 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:52:09.561 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T09:52:09.564 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T09:52:09.572 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T09:52:09.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:52:09.575 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T09:52:09.596 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T09:52:09.610 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T09:52:09.610 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:52:09.643 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T09:52:09.651 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:52:09.700 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:52:09.752 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T09:52:09.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:52:09.837 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T09:52:09.846 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T09:52:09.899 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T09:52:09.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T09:52:09.975 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-04-25T09:52:09.978 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-04-25T09:52:10.097 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T09:52:10.105 INFO:teuthology.task.internal:Starting timer... 2024-04-25T09:52:10.105 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T09:52:10.168 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T09:52:10.201 DEBUG:teuthology.task.selinux:Excluding smithi018: OS 'ubuntu' does not support SELinux 2024-04-25T09:52:10.201 DEBUG:teuthology.task.selinux:Excluding smithi167: OS 'ubuntu' does not support SELinux 2024-04-25T09:52:10.201 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T09:52:10.201 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T09:52:10.202 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T09:52:10.202 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T09:52:10.244 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T09:52:10.261 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T09:52:10.263 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T09:59:53.323 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-04-25T09:59:53.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-25T09:59:53.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:59:53.411 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-04-25T09:59:53.533 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-04-25T09:59:53.533 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:59:53.534 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T09:59:53.613 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-04-25T09:59:53.737 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-04-25T09:59:53.738 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T09:59:53.748 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T09:59:53.748 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:59:53.749 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:59:53.752 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T09:59:53.752 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Command line: ntpd -gq 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: ---------------------------------------------------- 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: corporation. Support and training for ntp-4 are 2024-04-25T09:59:53.790 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: available at https://www.nwtime.org/support 2024-04-25T09:59:53.791 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: ---------------------------------------------------- 2024-04-25T09:59:53.791 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: proto: precision = 0.044 usec (-24) 2024-04-25T09:59:53.791 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: basedate set to 2022-02-04 2024-04-25T09:59:53.791 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: gps base set to 2022-02-06 (week 2196) 2024-04-25T09:59:53.792 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:59:53.792 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:59:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:59:53.792 INFO:teuthology.orchestra.run.smithi018.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:59:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T09:59:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T09:59:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T09:59:53.793 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen normally on 3 ens1f0 172.21.15.18:123 2024-04-25T09:59:53.794 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen normally on 4 lo [::1]:123 2024-04-25T09:59:53.794 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1362%3]:123 2024-04-25T09:59:53.794 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 09:59:53 ntpd[17110]: Listening on routing socket on fd #22 for interface updates 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Command line: ntpd -gq 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: ---------------------------------------------------- 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: corporation. Support and training for ntp-4 are 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: available at https://www.nwtime.org/support 2024-04-25T09:59:53.816 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: ---------------------------------------------------- 2024-04-25T09:59:53.817 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: proto: precision = 0.043 usec (-24) 2024-04-25T09:59:53.817 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: basedate set to 2022-02-04 2024-04-25T09:59:53.817 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: gps base set to 2022-02-06 (week 2196) 2024-04-25T09:59:53.817 INFO:teuthology.orchestra.run.smithi167.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:59:53.818 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T09:59:53.818 INFO:teuthology.orchestra.run.smithi167.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:59:53.819 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T09:59:53.819 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T09:59:53.819 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T09:59:53.819 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T09:59:53.820 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen normally on 3 enp3s0f1 172.21.15.167:123 2024-04-25T09:59:53.820 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen normally on 4 lo [::1]:123 2024-04-25T09:59:53.820 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7309%5]:123 2024-04-25T09:59:53.820 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 09:59:53 ntpd[17200]: Listening on routing socket on fd #22 for interface updates 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:54.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:54 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:54.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:54.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:54.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:54.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:54.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:54.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:54 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:56.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:56.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:56 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:56.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:56.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:56 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:57 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:57.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:57.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:57 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:58.793 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:58 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:58.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:58 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 09:59:59 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T09:59:59.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:59.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:59.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T09:59:59.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T09:59:59.816 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T09:59:59.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 09:59:59 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.793 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:00:00.793 INFO:teuthology.orchestra.run.smithi018.stdout:25 Apr 10:00:00 ntpd[17110]: ntpd: time slew -0.001948 s 2024-04-25T10:00:00.793 INFO:teuthology.orchestra.run.smithi018.stdout:ntpd: time slew -0.001948s 2024-04-25T10:00:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:00:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T10:00:00.794 INFO:teuthology.orchestra.run.smithi018.stderr:25 Apr 10:00:00 ntpd[17110]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T10:00:00.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.817 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stdout:25 Apr 10:00:00 ntpd[17200]: ntpd: time slew -0.000734 s 2024-04-25T10:00:00.818 INFO:teuthology.orchestra.run.smithi167.stdout:ntpd: time slew -0.000734s 2024-04-25T10:00:00.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T10:00:00.819 INFO:teuthology.orchestra.run.smithi167.stderr:25 Apr 10:00:00 ntpd[17200]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T10:00:00.890 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:00:00.891 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-04-25T10:00:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.891 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.930 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:00:00.930 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-04-25T10:00:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.931 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T10:00:00.932 INFO:teuthology.run_tasks:Running task install... 2024-04-25T10:00:00.941 DEBUG:teuthology.task.install:project ceph 2024-04-25T10:00:00.942 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T10:00:00.942 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T10:00:00.942 INFO:teuthology.task.install:Using flavor: default 2024-04-25T10:00:00.948 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T10:00:00.948 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T10:00:00.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-key list | grep Ceph 2024-04-25T10:00:00.949 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-key list | grep Ceph 2024-04-25T10:00:01.056 INFO:teuthology.orchestra.run.smithi018.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T10:00:01.076 INFO:teuthology.orchestra.run.smithi167.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T10:00:01.108 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T10:00:01.108 INFO:teuthology.orchestra.run.smithi018.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T10:00:01.110 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T10:00:01.110 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T10:00:01.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T10:00:01.126 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T10:00:01.126 INFO:teuthology.orchestra.run.smithi167.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T10:00:01.127 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T10:00:01.127 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T10:00:01.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T10:00:01.258 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T10:00:01.258 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:00:01.266 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T10:00:01.267 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:00:01.382 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:00:01.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T10:00:01.397 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:00:01.397 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T10:00:01.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo apt-get update 2024-04-25T10:00:01.417 DEBUG:teuthology.orchestra.run.smithi167:> sudo apt-get update 2024-04-25T10:00:01.655 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T10:00:01.662 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T10:00:01.676 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T10:00:01.679 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T10:00:01.686 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T10:00:01.704 INFO:teuthology.orchestra.run.smithi018.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T10:00:01.711 INFO:teuthology.orchestra.run.smithi167.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T10:00:01.714 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T10:00:01.728 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T10:00:01.734 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T10:00:01.735 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T10:00:01.739 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T10:00:01.745 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T10:00:01.763 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T10:00:01.764 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T10:00:01.769 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T10:00:03.062 INFO:teuthology.orchestra.run.smithi018.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T10:00:03.300 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 28.9 kB in 2s (17.3 kB/s) 2024-04-25T10:00:04.316 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-25T10:00:04.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:00:04.407 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-25T10:00:04.585 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-25T10:00:04.586 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-25T10:00:04.768 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:00:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:00:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:00:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:00:04.768 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:00:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:00:04.769 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:00:04.769 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-04-25T10:00:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T10:00:04.769 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T10:00:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T10:00:04.772 INFO:teuthology.orchestra.run.smithi018.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T10:00:04.773 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-04-25T10:00:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T10:00:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T10:00:04.773 INFO:teuthology.orchestra.run.smithi018.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout:Recommended packages: 2024-04-25T10:00:04.774 INFO:teuthology.orchestra.run.smithi018.stdout: btrfs-tools 2024-04-25T10:00:04.928 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T10:00:04.929 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T10:00:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T10:00:04.930 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T10:00:04.931 INFO:teuthology.orchestra.run.smithi018.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T10:00:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T10:00:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T10:00:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T10:00:04.932 INFO:teuthology.orchestra.run.smithi018.stdout: socat unzip xmlstarlet zip 2024-04-25T10:00:05.088 INFO:teuthology.orchestra.run.smithi018.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T10:00:05.089 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 176 MB of archives. 2024-04-25T10:00:05.089 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T10:00:05.089 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T10:00:05.310 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T10:00:05.408 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T10:00:05.430 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T10:00:05.442 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T10:00:05.443 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T10:00:05.450 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T10:00:05.451 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T10:00:05.462 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T10:00:05.679 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T10:00:05.680 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T10:00:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T10:00:06.506 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T10:00:06.542 INFO:teuthology.orchestra.run.smithi167.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T10:00:06.665 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T10:00:06.672 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T10:00:06.692 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T10:00:06.726 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T10:00:06.769 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 28.9 kB in 5s (5,626 B/s) 2024-04-25T10:00:06.932 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T10:00:07.684 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T10:00:07.685 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T10:00:07.705 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T10:00:07.731 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T10:00:07.751 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-04-25T10:00:07.766 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:00:07.777 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T10:00:07.802 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T10:00:07.806 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T10:00:07.818 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T10:00:07.842 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-04-25T10:00:07.867 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T10:00:07.870 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T10:00:08.015 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-04-25T10:00:08.016 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-04-25T10:00:08.067 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T10:00:08.155 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T10:00:08.156 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T10:00:08.160 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T10:00:08.176 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T10:00:08.194 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:00:08.194 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:00:08.194 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:00:08.194 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T10:00:08.195 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T10:00:08.196 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T10:00:08.197 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T10:00:08.198 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T10:00:08.198 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T10:00:08.198 INFO:teuthology.orchestra.run.smithi167.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout:Recommended packages: 2024-04-25T10:00:08.199 INFO:teuthology.orchestra.run.smithi167.stdout: btrfs-tools 2024-04-25T10:00:08.230 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T10:00:08.344 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T10:00:08.345 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T10:00:08.346 INFO:teuthology.orchestra.run.smithi167.stdout: socat unzip xmlstarlet zip 2024-04-25T10:00:08.431 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T10:00:08.442 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T10:00:08.477 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T10:00:08.486 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T10:00:08.706 INFO:teuthology.orchestra.run.smithi167.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T10:00:08.706 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 176 MB of archives. 2024-04-25T10:00:08.706 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T10:00:08.706 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T10:00:09.244 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T10:00:09.426 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T10:00:09.817 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T10:00:09.852 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T10:00:09.872 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T10:00:09.887 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T10:00:09.891 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T10:00:09.902 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T10:00:09.902 INFO:teuthology.orchestra.run.smithi018.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T10:00:09.925 INFO:teuthology.orchestra.run.smithi018.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T10:00:09.944 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T10:00:09.945 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T10:00:09.956 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T10:00:09.958 INFO:teuthology.orchestra.run.smithi018.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T10:00:09.962 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T10:00:09.981 INFO:teuthology.orchestra.run.smithi018.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T10:00:09.988 INFO:teuthology.orchestra.run.smithi018.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T10:00:09.989 INFO:teuthology.orchestra.run.smithi018.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T10:00:10.013 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T10:00:10.107 INFO:teuthology.orchestra.run.smithi018.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T10:00:10.108 INFO:teuthology.orchestra.run.smithi018.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T10:00:10.110 INFO:teuthology.orchestra.run.smithi018.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T10:00:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T10:00:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T10:00:10.111 INFO:teuthology.orchestra.run.smithi018.stdout:Get:55 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T10:00:10.288 INFO:teuthology.orchestra.run.smithi018.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T10:00:10.436 INFO:teuthology.orchestra.run.smithi018.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T10:00:10.468 INFO:teuthology.orchestra.run.smithi018.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T10:00:10.566 INFO:teuthology.orchestra.run.smithi018.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T10:00:10.606 INFO:teuthology.orchestra.run.smithi018.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T10:00:10.632 INFO:teuthology.orchestra.run.smithi018.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T10:00:10.667 INFO:teuthology.orchestra.run.smithi018.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T10:00:10.693 INFO:teuthology.orchestra.run.smithi018.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T10:00:10.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T10:00:10.737 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T10:00:10.756 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T10:00:10.983 INFO:teuthology.orchestra.run.smithi018.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T10:00:11.004 INFO:teuthology.orchestra.run.smithi018.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T10:00:11.059 INFO:teuthology.orchestra.run.smithi018.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T10:00:11.082 INFO:teuthology.orchestra.run.smithi018.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T10:00:11.314 INFO:teuthology.orchestra.run.smithi018.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T10:00:11.400 INFO:teuthology.orchestra.run.smithi018.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T10:00:11.417 INFO:teuthology.orchestra.run.smithi018.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T10:00:11.598 INFO:teuthology.orchestra.run.smithi018.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T10:00:11.650 INFO:teuthology.orchestra.run.smithi018.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T10:00:11.664 INFO:teuthology.orchestra.run.smithi018.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T10:00:11.715 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T10:00:11.833 INFO:teuthology.orchestra.run.smithi018.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T10:00:11.834 INFO:teuthology.orchestra.run.smithi018.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T10:00:11.838 INFO:teuthology.orchestra.run.smithi018.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T10:00:11.843 INFO:teuthology.orchestra.run.smithi018.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T10:00:11.856 INFO:teuthology.orchestra.run.smithi018.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T10:00:11.895 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T10:00:11.903 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T10:00:11.909 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T10:00:11.962 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T10:00:12.049 INFO:teuthology.orchestra.run.smithi018.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T10:00:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T10:00:12.314 INFO:teuthology.orchestra.run.smithi018.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T10:00:12.453 INFO:teuthology.orchestra.run.smithi018.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T10:00:12.496 INFO:teuthology.orchestra.run.smithi018.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T10:00:12.626 INFO:teuthology.orchestra.run.smithi018.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T10:00:12.634 INFO:teuthology.orchestra.run.smithi018.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T10:00:12.645 INFO:teuthology.orchestra.run.smithi018.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T10:00:12.757 INFO:teuthology.orchestra.run.smithi018.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T10:00:13.112 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T10:00:13.113 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T10:00:13.114 INFO:teuthology.orchestra.run.smithi018.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T10:00:13.115 INFO:teuthology.orchestra.run.smithi018.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T10:00:13.117 INFO:teuthology.orchestra.run.smithi018.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T10:00:13.151 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T10:00:13.271 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T10:00:13.282 INFO:teuthology.orchestra.run.smithi018.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T10:00:13.301 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T10:00:13.307 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T10:00:13.378 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T10:00:13.625 INFO:teuthology.orchestra.run.smithi018.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T10:00:13.675 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T10:00:13.675 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T10:00:14.219 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T10:00:14.240 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T10:00:14.252 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T10:00:14.301 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T10:00:14.325 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T10:00:14.329 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T10:00:14.341 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T10:00:14.388 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T10:00:14.391 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T10:00:14.399 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T10:00:14.402 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T10:00:14.403 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T10:00:14.410 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T10:00:14.413 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T10:00:14.415 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T10:00:14.416 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T10:00:14.416 INFO:teuthology.orchestra.run.smithi167.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T10:00:14.433 INFO:teuthology.orchestra.run.smithi167.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T10:00:14.436 INFO:teuthology.orchestra.run.smithi167.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T10:00:14.438 INFO:teuthology.orchestra.run.smithi167.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T10:00:14.439 INFO:teuthology.orchestra.run.smithi167.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T10:00:14.439 INFO:teuthology.orchestra.run.smithi167.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T10:00:14.453 INFO:teuthology.orchestra.run.smithi167.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T10:00:14.453 INFO:teuthology.orchestra.run.smithi167.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T10:00:14.454 INFO:teuthology.orchestra.run.smithi167.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T10:00:14.454 INFO:teuthology.orchestra.run.smithi167.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T10:00:14.455 INFO:teuthology.orchestra.run.smithi167.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T10:00:14.473 INFO:teuthology.orchestra.run.smithi167.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T10:00:14.473 INFO:teuthology.orchestra.run.smithi167.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T10:00:14.476 INFO:teuthology.orchestra.run.smithi167.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T10:00:14.477 INFO:teuthology.orchestra.run.smithi167.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T10:00:14.478 INFO:teuthology.orchestra.run.smithi167.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T10:00:14.493 INFO:teuthology.orchestra.run.smithi167.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T10:00:14.494 INFO:teuthology.orchestra.run.smithi167.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T10:00:14.494 INFO:teuthology.orchestra.run.smithi167.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T10:00:14.495 INFO:teuthology.orchestra.run.smithi167.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T10:00:14.496 INFO:teuthology.orchestra.run.smithi167.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T10:00:14.512 INFO:teuthology.orchestra.run.smithi167.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T10:00:14.513 INFO:teuthology.orchestra.run.smithi167.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T10:00:14.518 INFO:teuthology.orchestra.run.smithi167.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T10:00:14.518 INFO:teuthology.orchestra.run.smithi167.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T10:00:14.519 INFO:teuthology.orchestra.run.smithi167.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T10:00:14.534 INFO:teuthology.orchestra.run.smithi167.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T10:00:14.535 INFO:teuthology.orchestra.run.smithi167.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T10:00:14.537 INFO:teuthology.orchestra.run.smithi167.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T10:00:14.538 INFO:teuthology.orchestra.run.smithi167.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T10:00:14.539 INFO:teuthology.orchestra.run.smithi167.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T10:00:14.553 INFO:teuthology.orchestra.run.smithi167.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T10:00:14.556 INFO:teuthology.orchestra.run.smithi167.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T10:00:14.557 INFO:teuthology.orchestra.run.smithi167.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T10:00:14.558 INFO:teuthology.orchestra.run.smithi167.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T10:00:14.560 INFO:teuthology.orchestra.run.smithi167.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T10:00:14.613 INFO:teuthology.orchestra.run.smithi167.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T10:00:14.614 INFO:teuthology.orchestra.run.smithi167.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T10:00:14.615 INFO:teuthology.orchestra.run.smithi167.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T10:00:14.616 INFO:teuthology.orchestra.run.smithi167.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T10:00:14.617 INFO:teuthology.orchestra.run.smithi167.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T10:00:14.639 INFO:teuthology.orchestra.run.smithi167.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T10:00:14.641 INFO:teuthology.orchestra.run.smithi167.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T10:00:14.642 INFO:teuthology.orchestra.run.smithi167.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T10:00:14.661 INFO:teuthology.orchestra.run.smithi167.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T10:00:14.661 INFO:teuthology.orchestra.run.smithi167.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T10:00:14.662 INFO:teuthology.orchestra.run.smithi167.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T10:00:14.663 INFO:teuthology.orchestra.run.smithi167.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T10:00:14.663 INFO:teuthology.orchestra.run.smithi167.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T10:00:14.664 INFO:teuthology.orchestra.run.smithi167.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T10:00:14.672 INFO:teuthology.orchestra.run.smithi167.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T10:00:14.673 INFO:teuthology.orchestra.run.smithi167.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T10:00:14.677 INFO:teuthology.orchestra.run.smithi167.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T10:00:14.691 INFO:teuthology.orchestra.run.smithi167.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T10:00:14.693 INFO:teuthology.orchestra.run.smithi167.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T10:00:14.694 INFO:teuthology.orchestra.run.smithi167.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T10:00:14.699 INFO:teuthology.orchestra.run.smithi167.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T10:00:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T10:00:14.702 INFO:teuthology.orchestra.run.smithi167.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T10:00:14.703 INFO:teuthology.orchestra.run.smithi167.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T10:00:14.712 INFO:teuthology.orchestra.run.smithi167.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T10:00:14.718 INFO:teuthology.orchestra.run.smithi167.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T10:00:14.719 INFO:teuthology.orchestra.run.smithi167.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T10:00:14.732 INFO:teuthology.orchestra.run.smithi018.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T10:00:14.732 INFO:teuthology.orchestra.run.smithi167.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T10:00:14.733 INFO:teuthology.orchestra.run.smithi167.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T10:00:14.734 INFO:teuthology.orchestra.run.smithi167.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T10:00:14.735 INFO:teuthology.orchestra.run.smithi167.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T10:00:14.737 INFO:teuthology.orchestra.run.smithi167.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T10:00:14.738 INFO:teuthology.orchestra.run.smithi167.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T10:00:14.745 INFO:teuthology.orchestra.run.smithi167.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T10:00:14.752 INFO:teuthology.orchestra.run.smithi167.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T10:00:14.753 INFO:teuthology.orchestra.run.smithi167.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T10:00:14.755 INFO:teuthology.orchestra.run.smithi167.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T10:00:14.772 INFO:teuthology.orchestra.run.smithi167.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T10:00:14.781 INFO:teuthology.orchestra.run.smithi018.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T10:00:14.786 INFO:teuthology.orchestra.run.smithi018.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T10:00:15.097 INFO:teuthology.orchestra.run.smithi018.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T10:00:15.098 INFO:teuthology.orchestra.run.smithi018.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T10:00:15.105 INFO:teuthology.orchestra.run.smithi018.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T10:00:15.109 INFO:teuthology.orchestra.run.smithi018.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T10:00:15.112 INFO:teuthology.orchestra.run.smithi018.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T10:00:15.117 INFO:teuthology.orchestra.run.smithi018.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T10:00:15.283 INFO:teuthology.orchestra.run.smithi018.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T10:00:15.439 INFO:teuthology.orchestra.run.smithi167.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T10:00:15.440 INFO:teuthology.orchestra.run.smithi167.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T10:00:15.442 INFO:teuthology.orchestra.run.smithi167.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T10:00:15.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T10:00:15.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T10:00:15.444 INFO:teuthology.orchestra.run.smithi167.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T10:00:15.497 INFO:teuthology.orchestra.run.smithi018.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T10:00:15.888 INFO:teuthology.orchestra.run.smithi167.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T10:00:15.901 INFO:teuthology.orchestra.run.smithi018.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T10:00:15.961 INFO:teuthology.orchestra.run.smithi018.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T10:00:15.994 INFO:teuthology.orchestra.run.smithi018.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T10:00:16.003 INFO:teuthology.orchestra.run.smithi018.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T10:00:16.065 INFO:teuthology.orchestra.run.smithi018.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T10:00:16.100 INFO:teuthology.orchestra.run.smithi018.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T10:00:16.100 INFO:teuthology.orchestra.run.smithi018.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T10:00:16.106 INFO:teuthology.orchestra.run.smithi018.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T10:00:16.110 INFO:teuthology.orchestra.run.smithi018.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T10:00:16.356 INFO:teuthology.orchestra.run.smithi018.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T10:00:16.590 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 176 MB in 8s (23.4 MB/s) 2024-04-25T10:00:16.614 INFO:teuthology.orchestra.run.smithi018.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T10:00:16.762 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T10:00:16.827 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T10:00:16.831 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T10:00:16.886 INFO:teuthology.orchestra.run.smithi018.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T10:00:16.886 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T10:00:16.888 INFO:teuthology.orchestra.run.smithi018.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T10:00:16.904 INFO:teuthology.orchestra.run.smithi018.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T10:00:16.910 INFO:teuthology.orchestra.run.smithi018.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T10:00:16.950 INFO:teuthology.orchestra.run.smithi018.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T10:00:16.964 INFO:teuthology.orchestra.run.smithi018.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T10:00:17.116 INFO:teuthology.orchestra.run.smithi018.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T10:00:17.117 INFO:teuthology.orchestra.run.smithi018.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T10:00:17.118 INFO:teuthology.orchestra.run.smithi018.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T10:00:17.139 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T10:00:17.152 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T10:00:17.197 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:00:17.320 INFO:teuthology.orchestra.run.smithi018.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T10:00:17.508 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T10:00:17.522 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T10:00:17.566 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T10:00:17.585 INFO:teuthology.orchestra.run.smithi018.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T10:00:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T10:00:17.951 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T10:00:18.028 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:00:18.298 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T10:00:18.314 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T10:00:18.349 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:00:18.677 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T10:00:18.691 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T10:00:18.717 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 176 MB in 13s (13.5 MB/s) 2024-04-25T10:00:18.735 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:00:18.842 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T10:00:18.911 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T10:00:18.915 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T10:00:18.990 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T10:00:19.197 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T10:00:19.211 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:19.263 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:19.293 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T10:00:19.307 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T10:00:19.352 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:00:19.650 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T10:00:19.662 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T10:00:19.665 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:19.677 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T10:00:19.708 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:19.721 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T10:00:20.070 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T10:00:20.085 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:20.128 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:20.165 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T10:00:20.181 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T10:00:20.266 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:00:20.457 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T10:00:20.472 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T10:00:20.506 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:00:20.611 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T10:00:20.626 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T10:00:20.669 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:00:20.793 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librados2. 2024-04-25T10:00:20.808 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:20.867 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:21.030 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T10:00:21.045 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T10:00:21.088 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:00:21.429 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librbd1. 2024-04-25T10:00:21.444 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:21.458 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T10:00:21.473 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:21.487 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:21.524 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:21.907 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T10:00:21.921 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:21.965 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:21.978 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T10:00:21.993 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:22.036 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:22.251 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rados. 2024-04-25T10:00:22.266 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:22.301 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:22.381 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T10:00:22.396 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T10:00:22.439 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:00:22.603 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T10:00:22.618 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:22.664 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:22.742 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T10:00:22.758 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T10:00:22.792 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:00:22.941 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T10:00:22.956 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:22.991 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:23.162 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librados2. 2024-04-25T10:00:23.177 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:23.220 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:23.261 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T10:00:23.275 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:23.319 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:23.647 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T10:00:23.655 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librbd1. 2024-04-25T10:00:23.662 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T10:00:23.671 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:23.705 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T10:00:23.714 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:23.991 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T10:00:24.006 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:24.049 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:24.108 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T10:00:24.124 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:24.158 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:24.402 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T10:00:24.417 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T10:00:24.427 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rados. 2024-04-25T10:00:24.443 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:24.452 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:00:24.494 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:24.696 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T10:00:24.711 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T10:00:24.746 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:00:24.813 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T10:00:24.828 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:24.871 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:25.066 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T10:00:25.081 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T10:00:25.107 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T10:00:25.122 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:25.124 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:00:25.165 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:25.461 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua5.1. 2024-04-25T10:00:25.476 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T10:00:25.476 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T10:00:25.492 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:25.520 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:00:25.543 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:25.822 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-any. 2024-04-25T10:00:25.837 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T10:00:25.862 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T10:00:25.872 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T10:00:25.878 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T10:00:25.912 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T10:00:26.150 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package zip. 2024-04-25T10:00:26.156 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T10:00:26.165 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T10:00:26.172 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:26.208 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T10:00:26.214 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:26.520 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package unzip. 2024-04-25T10:00:26.526 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T10:00:26.534 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T10:00:26.541 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T10:00:26.578 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:00:26.584 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:00:26.854 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T10:00:26.869 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T10:00:26.911 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:00:26.982 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package luarocks. 2024-04-25T10:00:26.997 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T10:00:27.065 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:00:27.223 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T10:00:27.238 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T10:00:27.281 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:00:27.439 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package librgw2. 2024-04-25T10:00:27.453 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:27.489 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:27.617 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua5.1. 2024-04-25T10:00:27.633 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T10:00:27.676 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:00:27.967 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T10:00:27.970 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-any. 2024-04-25T10:00:27.981 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:27.986 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T10:00:28.021 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T10:00:28.025 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package zip. 2024-04-25T10:00:28.238 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T10:00:28.306 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T10:00:28.386 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T10:00:28.401 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T10:00:28.445 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:00:28.617 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package unzip. 2024-04-25T10:00:28.633 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T10:00:28.675 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:00:28.747 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T10:00:28.762 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:28.806 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:29.054 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package luarocks. 2024-04-25T10:00:29.070 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T10:00:29.112 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:00:29.201 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-common. 2024-04-25T10:00:29.216 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:29.251 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:29.495 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package librgw2. 2024-04-25T10:00:29.509 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:29.586 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:30.064 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T10:00:30.079 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:30.122 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:30.331 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-base. 2024-04-25T10:00:30.346 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:30.398 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:30.450 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T10:00:30.465 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T10:00:30.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:00:30.803 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T10:00:30.818 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:30.861 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:30.977 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T10:00:30.991 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T10:00:31.035 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:00:31.289 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-common. 2024-04-25T10:00:31.304 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:31.347 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:31.371 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T10:00:31.385 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T10:00:31.429 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:00:31.749 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T10:00:31.763 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T10:00:31.958 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:00:32.227 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T10:00:32.242 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T10:00:32.285 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:00:32.369 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-base. 2024-04-25T10:00:32.384 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:32.429 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:32.588 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T10:00:32.603 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T10:00:32.646 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:00:32.932 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T10:00:32.932 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T10:00:32.947 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T10:00:32.948 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T10:00:32.990 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:00:32.991 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T10:00:33.293 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T10:00:33.294 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-portend. 2024-04-25T10:00:33.308 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T10:00:33.309 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T10:00:33.344 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T10:00:33.351 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:00:33.605 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T10:00:33.622 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T10:00:33.663 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T10:00:33.704 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T10:00:33.719 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T10:00:33.762 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:00:33.974 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T10:00:33.990 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T10:00:34.033 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:00:34.040 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T10:00:34.055 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T10:00:34.090 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:00:34.353 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T10:00:34.359 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T10:00:34.368 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T10:00:34.375 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T10:00:34.411 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T10:00:34.417 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:00:34.722 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T10:00:34.737 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T10:00:34.737 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T10:00:34.752 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T10:00:34.781 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T10:00:34.795 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T10:00:35.100 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T10:00:35.115 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T10:00:35.132 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-portend. 2024-04-25T10:00:35.147 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T10:00:35.158 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:00:35.190 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T10:00:35.451 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T10:00:35.466 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T10:00:35.478 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-mako. 2024-04-25T10:00:35.494 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T10:00:35.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T10:00:35.528 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:00:35.796 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T10:00:35.811 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T10:00:35.831 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T10:00:35.846 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T10:00:35.853 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:00:35.881 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:00:36.176 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T10:00:36.182 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T10:00:36.190 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T10:00:36.197 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T10:00:36.231 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T10:00:36.267 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:00:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T10:00:36.492 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T10:00:36.534 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T10:00:36.570 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webob. 2024-04-25T10:00:36.585 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T10:00:36.628 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:00:36.973 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T10:00:36.988 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T10:00:37.034 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:00:37.351 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T10:00:37.368 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T10:00:37.401 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:00:37.671 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-paste. 2024-04-25T10:00:37.686 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T10:00:37.729 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:00:37.738 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T10:00:37.754 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T10:00:37.796 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:00:38.023 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T10:00:38.038 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T10:00:38.081 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:00:38.099 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-mako. 2024-04-25T10:00:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T10:00:38.157 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:00:38.401 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T10:00:38.417 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T10:00:38.468 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:00:38.485 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T10:00:38.500 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T10:00:38.552 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:00:38.771 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T10:00:38.786 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T10:00:38.788 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T10:00:38.803 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T10:00:38.829 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T10:00:38.846 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:00:39.149 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T10:00:39.164 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T10:00:39.165 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webob. 2024-04-25T10:00:39.181 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T10:00:39.206 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:00:39.223 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:00:39.587 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T10:00:39.593 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T10:00:39.601 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T10:00:39.608 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T10:00:39.645 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T10:00:39.654 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:00:39.946 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T10:00:39.961 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T10:00:39.974 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-idna. 2024-04-25T10:00:39.988 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T10:00:40.004 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:00:40.031 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T10:00:40.307 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-paste. 2024-04-25T10:00:40.309 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T10:00:40.322 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T10:00:40.324 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T10:00:40.367 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:00:40.382 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:00:40.654 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests. 2024-04-25T10:00:40.659 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T10:00:40.669 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T10:00:40.674 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T10:00:40.703 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:00:40.718 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:00:40.973 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T10:00:40.988 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T10:00:41.021 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T10:00:41.031 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:00:41.036 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T10:00:41.079 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:00:41.335 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T10:00:41.350 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:41.365 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T10:00:41.381 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T10:00:41.401 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:41.423 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T10:00:41.668 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T10:00:41.683 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T10:00:41.734 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:00:41.772 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T10:00:41.787 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:41.822 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:42.064 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T10:00:42.079 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T10:00:42.108 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T10:00:42.114 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T10:00:42.124 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T10:00:42.167 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:00:42.417 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-idna. 2024-04-25T10:00:42.432 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T10:00:42.475 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T10:00:42.486 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T10:00:42.501 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T10:00:42.778 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T10:00:42.793 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T10:00:42.836 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:00:43.120 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T10:00:43.181 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests. 2024-04-25T10:00:43.196 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T10:00:43.239 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:00:43.533 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T10:00:43.549 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T10:00:43.581 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T10:00:43.592 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:00:43.596 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:43.639 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:43.861 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T10:00:43.877 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:43.920 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:44.026 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T10:00:44.041 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:44.084 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:44.291 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T10:00:44.306 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:44.374 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:44.663 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T10:00:44.677 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:44.677 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T10:00:44.692 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T10:00:44.720 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:44.735 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:00:45.021 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T10:00:45.037 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T10:00:45.079 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T10:00:45.382 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T10:00:45.398 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:45.432 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:45.474 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph. 2024-04-25T10:00:45.488 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:45.524 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:45.768 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T10:00:45.783 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:45.818 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:45.835 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T10:00:45.850 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:45.893 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:46.237 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T10:00:46.253 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:46.296 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:46.422 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T10:00:46.437 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:46.480 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:46.699 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephadm. 2024-04-25T10:00:46.714 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:46.765 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:47.068 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T10:00:47.083 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T10:00:47.126 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T10:00:47.216 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph. 2024-04-25T10:00:47.231 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:47.274 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:47.544 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T10:00:47.558 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:47.593 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:47.595 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T10:00:47.611 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:00:47.645 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:00:47.957 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T10:00:47.972 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:48.015 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:48.401 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephadm. 2024-04-25T10:00:48.417 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:00:48.468 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:48.692 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-babel. 2024-04-25T10:00:48.706 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:00:48.737 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T10:00:48.753 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T10:00:48.758 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:00:48.795 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T10:00:49.070 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T10:00:49.082 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T10:00:49.084 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T10:00:49.097 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:00:49.128 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:00:49.140 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:00:49.473 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T10:00:49.487 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:49.531 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:49.893 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T10:00:49.908 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T10:00:49.951 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T10:00:50.103 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-babel. 2024-04-25T10:00:50.117 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T10:00:50.153 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:00:50.254 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-routes. 2024-04-25T10:00:50.265 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T10:00:50.303 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:00:50.473 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T10:00:50.487 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T10:00:50.522 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:00:50.657 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T10:00:50.674 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:50.715 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:50.842 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T10:00:50.857 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:50.901 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:51.135 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T10:00:51.148 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T10:00:51.185 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:00:51.237 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T10:00:51.299 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T10:00:51.300 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T10:00:51.598 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-routes. 2024-04-25T10:00:51.613 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T10:00:51.657 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:00:51.713 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T10:00:51.726 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T10:00:51.763 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:00:51.993 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T10:00:52.008 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:52.051 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:52.125 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T10:00:52.140 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T10:00:52.261 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:00:52.488 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T10:00:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T10:00:52.546 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:00:52.563 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T10:00:52.577 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T10:00:52.621 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:00:53.283 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T10:00:53.300 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T10:00:53.306 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T10:00:53.320 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:53.342 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:00:53.364 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:53.703 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T10:00:53.718 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T10:00:53.831 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:00:54.133 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T10:00:54.149 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T10:00:54.191 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:00:54.359 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T10:00:54.374 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T10:00:54.417 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T10:00:54.720 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T10:00:54.734 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T10:00:54.778 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:00:54.884 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T10:00:54.899 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:54.942 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:55.124 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T10:00:55.138 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T10:00:55.173 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:00:55.485 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T10:00:55.499 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T10:00:55.534 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T10:00:55.855 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T10:00:55.869 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T10:00:55.946 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T10:00:55.948 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T10:00:55.961 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T10:00:56.003 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T10:00:56.241 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T10:00:56.256 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T10:00:56.291 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:00:56.332 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T10:00:56.348 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T10:00:56.390 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:00:56.602 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T10:00:56.617 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T10:00:56.660 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T10:00:56.660 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T10:00:56.676 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T10:00:56.710 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:00:56.971 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T10:00:56.987 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T10:00:57.005 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T10:00:57.020 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T10:00:57.021 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T10:00:57.064 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:00:57.333 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T10:00:57.349 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T10:00:57.392 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T10:00:57.728 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T10:00:57.744 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T10:00:57.752 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T10:00:57.766 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:57.786 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:00:57.802 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:58.147 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T10:00:58.160 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T10:00:58.181 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T10:00:58.197 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T10:00:58.205 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:00:58.239 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T10:00:58.541 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T10:00:58.555 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:00:58.559 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T10:00:58.575 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T10:00:58.599 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:00:58.618 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:00:58.836 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package jq. 2024-04-25T10:00:58.849 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:00:58.894 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T10:00:59.180 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package socat. 2024-04-25T10:00:59.194 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T10:00:59.238 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:00:59.339 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T10:00:59.349 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:00:59.389 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:00:59.541 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T10:00:59.556 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T10:00:59.599 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:00:59.642 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T10:00:59.654 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T10:00:59.692 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:00:59.947 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-test. 2024-04-25T10:00:59.961 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:00.005 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:00.012 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T10:01:00.023 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:01:00.061 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:01:00.307 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package jq. 2024-04-25T10:01:00.320 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T10:01:00.365 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T10:01:00.584 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package socat. 2024-04-25T10:01:00.599 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T10:01:00.642 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:01:00.945 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T10:01:00.958 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T10:01:00.995 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:01:01.324 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-test. 2024-04-25T10:01:01.337 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:01.374 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:01.918 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T10:01:01.928 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:01.960 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:02.356 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T10:01:02.366 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:02.406 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:02.709 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T10:01:02.718 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T10:01:02.759 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T10:01:03.082 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T10:01:03.092 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:03.312 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T10:01:03.325 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:03.370 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:03.395 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:03.648 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T10:01:03.657 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:03.697 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:03.749 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T10:01:03.762 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:03.799 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:03.916 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T10:01:03.925 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:03.966 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:04.094 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T10:01:04.110 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T10:01:04.152 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T10:01:04.277 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T10:01:04.287 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T10:01:04.361 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:01:04.413 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T10:01:04.427 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:04.462 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:04.649 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T10:01:04.659 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T10:01:04.674 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T10:01:04.688 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T10:01:04.699 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:01:04.723 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:04.976 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T10:01:04.990 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:05.034 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:05.061 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T10:01:05.071 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T10:01:05.119 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:01:05.362 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T10:01:05.376 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T10:01:05.420 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:01:05.558 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pkg-config. 2024-04-25T10:01:05.570 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T10:01:05.608 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:01:05.758 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T10:01:05.772 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T10:01:05.816 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:01:05.861 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T10:01:05.871 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T10:01:05.919 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:01:06.162 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T10:01:06.176 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T10:01:06.220 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:01:06.331 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T10:01:06.342 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T10:01:06.406 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T10:01:06.625 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pkg-config. 2024-04-25T10:01:06.639 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T10:01:06.667 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T10:01:06.680 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T10:01:06.683 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:01:06.717 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T10:01:06.945 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T10:01:06.959 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T10:01:07.004 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:01:07.021 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T10:01:07.032 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T10:01:07.070 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:01:07.399 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T10:01:07.413 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T10:01:07.456 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T10:01:07.457 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T10:01:07.470 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T10:01:07.514 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T10:01:07.760 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-py. 2024-04-25T10:01:07.772 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T10:01:07.810 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T10:01:07.817 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T10:01:07.831 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T10:01:07.883 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T10:01:08.105 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T10:01:08.117 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T10:01:08.155 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:01:08.170 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T10:01:08.184 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T10:01:08.220 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:01:08.642 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T10:01:08.653 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T10:01:08.692 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:01:08.849 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T10:01:08.863 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T10:01:08.906 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T10:01:08.970 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-toml. 2024-04-25T10:01:08.982 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T10:01:09.028 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T10:01:09.226 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-py. 2024-04-25T10:01:09.234 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T10:01:09.276 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T10:01:09.331 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T10:01:09.344 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T10:01:09.381 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:01:09.587 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T10:01:09.596 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T10:01:09.637 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:01:09.768 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T10:01:09.781 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T10:01:09.818 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:01:10.104 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T10:01:10.116 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T10:01:10.117 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T10:01:10.125 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T10:01:10.154 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:01:10.166 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:01:10.452 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-toml. 2024-04-25T10:01:10.464 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T10:01:10.502 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T10:01:10.739 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T10:01:10.748 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T10:01:10.788 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:01:10.900 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package radosgw. 2024-04-25T10:01:10.911 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:10.950 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:11.093 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T10:01:11.102 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T10:01:11.133 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:01:11.395 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T10:01:11.404 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T10:01:11.445 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:01:11.519 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T10:01:11.531 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:11.603 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:11.878 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T10:01:12.125 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package radosgw. 2024-04-25T10:01:12.132 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:12.150 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:01:12.174 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:12.292 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:01:12.542 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T10:01:12.802 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T10:01:12.811 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T10:01:12.851 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:12.959 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T10:01:13.159 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T10:01:13.415 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T10:01:13.541 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T10:01:13.574 INFO:teuthology.orchestra.run.smithi167.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T10:01:13.613 INFO:teuthology.orchestra.run.smithi167.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T10:01:13.652 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:13.786 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T10:01:14.180 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user cephadm....done 2024-04-25T10:01:14.243 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T10:01:14.334 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:01:14.602 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:01:14.899 INFO:teuthology.orchestra.run.smithi018.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T10:01:14.903 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:01:14.941 INFO:teuthology.orchestra.run.smithi018.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T10:01:14.976 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:15.038 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:01:15.289 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T10:01:15.487 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user cephadm....done 2024-04-25T10:01:15.565 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:01:15.649 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T10:01:15.716 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T10:01:15.967 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T10:01:16.034 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:01:16.226 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T10:01:16.344 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T10:01:16.403 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T10:01:16.612 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T10:01:16.671 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T10:01:16.888 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T10:01:16.956 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T10:01:17.014 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T10:01:17.240 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:01:17.332 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T10:01:17.500 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:01:17.709 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T10:01:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:01:17.977 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T10:01:18.036 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:01:18.253 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T10:01:18.304 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:18.538 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T10:01:18.589 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:01:18.815 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T10:01:19.023 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:01:19.149 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T10:01:19.149 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T10:01:19.425 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:01:19.442 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T10:01:19.551 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:01:19.693 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:19.794 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:01:19.953 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T10:01:20.078 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T10:01:20.184 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T10:01:20.204 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T10:01:20.241 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T10:01:20.305 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:01:20.432 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T10:01:20.506 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T10:01:20.631 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T10:01:20.808 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:01:20.899 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T10:01:20.952 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T10:01:21.218 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:01:21.289 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T10:01:21.321 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T10:01:21.386 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T10:01:21.469 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:01:21.512 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T10:01:21.796 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T10:01:21.888 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T10:01:21.922 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:01:21.989 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T10:01:22.249 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T10:01:22.517 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T10:01:22.641 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:01:22.834 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T10:01:22.909 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:01:22.944 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T10:01:23.051 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:01:23.152 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:01:23.454 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T10:01:23.662 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T10:01:23.872 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T10:01:23.922 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T10:01:24.048 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T10:01:24.131 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:01:24.174 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T10:01:24.483 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T10:01:24.524 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:01:24.826 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T10:01:24.893 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T10:01:25.135 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:01:25.152 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T10:01:25.479 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:01:25.546 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T10:01:25.738 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:01:25.847 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T10:01:25.864 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:26.165 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T10:01:26.174 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T10:01:26.516 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:01:26.533 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T10:01:26.801 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T10:01:26.927 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:27.228 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T10:01:27.554 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T10:01:27.748 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:01:28.016 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:28.175 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T10:01:28.435 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:01:28.553 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:01:28.687 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:01:28.844 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T10:01:28.989 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:01:29.079 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:29.213 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T10:01:29.256 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T10:01:29.491 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T10:01:29.516 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:29.617 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T10:01:29.642 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:01:29.768 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T10:01:29.944 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:01:30.070 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T10:01:30.211 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T10:01:30.321 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T10:01:30.487 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T10:01:30.589 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:30.698 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T10:01:30.764 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:01:31.023 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T10:01:31.025 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T10:01:31.293 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T10:01:31.299 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:01:31.425 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T10:01:31.560 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T10:01:31.685 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:01:31.786 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:01:31.811 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T10:01:32.063 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T10:01:32.087 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:01:32.330 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T10:01:32.405 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:01:32.439 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T10:01:32.681 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:01:32.741 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T10:01:32.807 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:01:32.867 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T10:01:32.933 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:01:33.013 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T10:01:33.177 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T10:01:33.277 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:01:33.378 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:01:33.478 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T10:01:33.737 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T10:01:33.779 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:01:33.863 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T10:01:33.989 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T10:01:34.047 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T10:01:34.078 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T10:01:34.173 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T10:01:34.316 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T10:01:34.432 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:34.442 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T10:01:34.558 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:01:34.852 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T10:01:34.868 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:01:35.111 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T10:01:35.161 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:01:35.212 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T10:01:35.446 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T10:01:35.463 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T10:01:35.589 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T10:01:35.649 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T10:01:35.924 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T10:01:35.925 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T10:01:36.201 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:01:36.242 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T10:01:36.453 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:01:36.552 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T10:01:36.754 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T10:01:36.847 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T10:01:37.031 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T10:01:37.140 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:01:37.307 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T10:01:37.501 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:01:37.584 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T10:01:37.610 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:37.711 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:37.846 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:01:37.993 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T10:01:38.182 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:38.270 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T10:01:38.308 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:38.459 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T10:01:38.623 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T10:01:38.748 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:38.761 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:38.874 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:38.912 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:39.026 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T10:01:39.038 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:01:39.247 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:01:39.653 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:39.754 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:39.855 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T10:01:39.889 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.024 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.140 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.166 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.266 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.292 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.409 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:40.410 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:01:40.631 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:01:40.631 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T10:01:41.277 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.394 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.495 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.622 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.689 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.722 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T10:01:41.815 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:41.941 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:42.067 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:42.185 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:42.303 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:42.864 INFO:teuthology.orchestra.run.smithi167.stdout:Adding group ceph....done 2024-04-25T10:01:43.068 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.169 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.240 INFO:teuthology.orchestra.run.smithi167.stdout:Adding system user ceph....done 2024-04-25T10:01:43.278 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.402 INFO:teuthology.orchestra.run.smithi167.stdout:Setting system user ceph properties....done 2024-04-25T10:01:43.404 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.424 INFO:teuthology.orchestra.run.smithi167.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T10:01:43.530 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.566 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T10:01:43.658 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:43.985 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T10:01:44.210 INFO:teuthology.orchestra.run.smithi018.stdout:Adding group ceph....done 2024-04-25T10:01:44.569 INFO:teuthology.orchestra.run.smithi018.stdout:Adding system user ceph....done 2024-04-25T10:01:44.679 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:44.739 INFO:teuthology.orchestra.run.smithi018.stdout:Setting system user ceph properties....done 2024-04-25T10:01:44.756 INFO:teuthology.orchestra.run.smithi018.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T10:01:44.889 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:01:44.889 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:01:44.909 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T10:01:45.315 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T10:01:45.506 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:45.657 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:46.041 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:46.213 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:01:46.214 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:01:46.275 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:01:46.275 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T10:01:46.858 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:46.994 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:47.102 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:47.196 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T10:01:47.613 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:01:47.613 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T10:01:47.885 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:48.108 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:01:48.108 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:01:48.263 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:48.621 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T10:01:48.762 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:48.974 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:01:48.974 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:01:49.282 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:49.519 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:01:49.520 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T10:01:49.697 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:50.027 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:01:50.027 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:01:50.126 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:50.346 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:01:50.346 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T10:01:50.633 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:50.792 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:50.927 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:50.960 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:51.136 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:01:51.136 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:01:51.269 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:01:51.270 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T10:01:51.786 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:51.920 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:51.931 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:52.046 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:52.057 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:52.200 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:52.214 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:52.440 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:01:52.441 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T10:01:52.561 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:01:52.663 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:01:52.839 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:01:53.066 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:53.208 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:53.334 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:53.485 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T10:01:53.846 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:01:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:01:53.999 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:01:54.099 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:01:54.732 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:01:54.737 DEBUG:teuthology.orchestra.run.smithi167:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T10:01:54.811 INFO:teuthology.orchestra.run.smithi167.stdout:Reading package lists... 2024-04-25T10:01:54.992 INFO:teuthology.orchestra.run.smithi167.stdout:Building dependency tree... 2024-04-25T10:01:54.993 INFO:teuthology.orchestra.run.smithi167.stdout:Reading state information... 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:01:55.165 INFO:teuthology.orchestra.run.smithi167.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi167.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:01:55.166 INFO:teuthology.orchestra.run.smithi167.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout:The following additional packages will be installed: 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T10:01:55.167 INFO:teuthology.orchestra.run.smithi167.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi167.stdout:Suggested packages: 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T10:01:55.168 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T10:01:55.222 INFO:teuthology.orchestra.run.smithi167.stdout:The following NEW packages will be installed: 2024-04-25T10:01:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T10:01:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T10:01:55.223 INFO:teuthology.orchestra.run.smithi167.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T10:01:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T10:01:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T10:01:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T10:01:55.224 INFO:teuthology.orchestra.run.smithi167.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:01:55.225 INFO:teuthology.orchestra.run.smithi167.stdout:The following packages will be upgraded: 2024-04-25T10:01:55.225 INFO:teuthology.orchestra.run.smithi167.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T10:01:55.318 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:01:55.442 INFO:teuthology.orchestra.run.smithi167.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T10:01:55.442 INFO:teuthology.orchestra.run.smithi167.stdout:Need to get 55.7 MB of archives. 2024-04-25T10:01:55.443 INFO:teuthology.orchestra.run.smithi167.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T10:01:55.443 INFO:teuthology.orchestra.run.smithi167.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T10:01:56.042 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:01:56.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T10:01:56.123 INFO:teuthology.orchestra.run.smithi167.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T10:01:56.124 INFO:teuthology.orchestra.run.smithi018.stdout:Reading package lists... 2024-04-25T10:01:56.155 INFO:teuthology.orchestra.run.smithi167.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T10:01:56.302 INFO:teuthology.orchestra.run.smithi167.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T10:01:56.303 INFO:teuthology.orchestra.run.smithi167.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T10:01:56.303 INFO:teuthology.orchestra.run.smithi018.stdout:Building dependency tree... 2024-04-25T10:01:56.303 INFO:teuthology.orchestra.run.smithi018.stdout:Reading state information... 2024-04-25T10:01:56.303 INFO:teuthology.orchestra.run.smithi167.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T10:01:56.327 INFO:teuthology.orchestra.run.smithi167.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T10:01:56.328 INFO:teuthology.orchestra.run.smithi167.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T10:01:56.334 INFO:teuthology.orchestra.run.smithi167.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T10:01:56.336 INFO:teuthology.orchestra.run.smithi167.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T10:01:56.337 INFO:teuthology.orchestra.run.smithi167.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T10:01:56.480 INFO:teuthology.orchestra.run.smithi018.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T10:01:56.480 INFO:teuthology.orchestra.run.smithi018.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T10:01:56.481 INFO:teuthology.orchestra.run.smithi018.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stdout:The following additional packages will be installed: 2024-04-25T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T10:01:56.482 INFO:teuthology.orchestra.run.smithi018.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:01:56.483 INFO:teuthology.orchestra.run.smithi018.stdout:Suggested packages: 2024-04-25T10:01:56.484 INFO:teuthology.orchestra.run.smithi018.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T10:01:56.484 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T10:01:56.484 INFO:teuthology.orchestra.run.smithi018.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T10:01:56.503 INFO:teuthology.orchestra.run.smithi167.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T10:01:56.540 INFO:teuthology.orchestra.run.smithi018.stdout:The following NEW packages will be installed: 2024-04-25T10:01:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T10:01:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T10:01:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T10:01:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T10:01:56.541 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T10:01:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T10:01:56.542 INFO:teuthology.orchestra.run.smithi018.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T10:01:56.546 INFO:teuthology.orchestra.run.smithi018.stdout:The following packages will be upgraded: 2024-04-25T10:01:56.546 INFO:teuthology.orchestra.run.smithi018.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T10:01:56.782 INFO:teuthology.orchestra.run.smithi018.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T10:01:56.782 INFO:teuthology.orchestra.run.smithi018.stdout:Need to get 55.7 MB of archives. 2024-04-25T10:01:56.782 INFO:teuthology.orchestra.run.smithi018.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T10:01:56.782 INFO:teuthology.orchestra.run.smithi018.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T10:01:56.784 INFO:teuthology.orchestra.run.smithi167.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T10:01:56.794 INFO:teuthology.orchestra.run.smithi167.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T10:01:56.800 INFO:teuthology.orchestra.run.smithi167.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T10:01:56.893 INFO:teuthology.orchestra.run.smithi167.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T10:01:57.616 INFO:teuthology.orchestra.run.smithi018.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T10:01:57.653 INFO:teuthology.orchestra.run.smithi018.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T10:01:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T10:01:57.865 INFO:teuthology.orchestra.run.smithi018.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T10:01:57.866 INFO:teuthology.orchestra.run.smithi018.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T10:01:57.870 INFO:teuthology.orchestra.run.smithi167.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T10:01:57.872 INFO:teuthology.orchestra.run.smithi167.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T10:01:57.872 INFO:teuthology.orchestra.run.smithi167.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T10:01:57.898 INFO:teuthology.orchestra.run.smithi167.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T10:01:57.898 INFO:teuthology.orchestra.run.smithi167.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T10:01:57.903 INFO:teuthology.orchestra.run.smithi167.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T10:01:57.915 INFO:teuthology.orchestra.run.smithi018.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T10:01:57.917 INFO:teuthology.orchestra.run.smithi018.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T10:01:57.932 INFO:teuthology.orchestra.run.smithi018.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T10:01:57.935 INFO:teuthology.orchestra.run.smithi018.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T10:01:57.936 INFO:teuthology.orchestra.run.smithi018.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T10:01:58.081 INFO:teuthology.orchestra.run.smithi167.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T10:01:58.104 INFO:teuthology.orchestra.run.smithi018.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T10:01:58.399 INFO:teuthology.orchestra.run.smithi018.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T10:01:58.414 INFO:teuthology.orchestra.run.smithi018.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T10:01:58.419 INFO:teuthology.orchestra.run.smithi018.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T10:01:58.504 INFO:teuthology.orchestra.run.smithi018.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T10:01:58.759 INFO:teuthology.orchestra.run.smithi167.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T10:01:58.759 INFO:teuthology.orchestra.run.smithi167.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T10:01:58.954 INFO:teuthology.orchestra.run.smithi167.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T10:01:58.955 INFO:teuthology.orchestra.run.smithi167.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T10:01:58.998 INFO:teuthology.orchestra.run.smithi167.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T10:01:59.061 INFO:teuthology.orchestra.run.smithi167.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T10:01:59.067 INFO:teuthology.orchestra.run.smithi167.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T10:01:59.068 INFO:teuthology.orchestra.run.smithi167.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T10:01:59.069 INFO:teuthology.orchestra.run.smithi167.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T10:01:59.069 INFO:teuthology.orchestra.run.smithi167.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T10:01:59.280 INFO:teuthology.orchestra.run.smithi167.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T10:01:59.504 INFO:teuthology.orchestra.run.smithi018.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T10:01:59.506 INFO:teuthology.orchestra.run.smithi018.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T10:01:59.506 INFO:teuthology.orchestra.run.smithi018.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T10:01:59.509 INFO:teuthology.orchestra.run.smithi018.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T10:01:59.509 INFO:teuthology.orchestra.run.smithi018.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T10:01:59.513 INFO:teuthology.orchestra.run.smithi018.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T10:01:59.699 INFO:teuthology.orchestra.run.smithi167.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T10:01:59.700 INFO:teuthology.orchestra.run.smithi018.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T10:02:00.349 INFO:teuthology.orchestra.run.smithi018.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T10:02:00.350 INFO:teuthology.orchestra.run.smithi018.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T10:02:00.448 INFO:teuthology.orchestra.run.smithi167.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T10:02:00.448 INFO:teuthology.orchestra.run.smithi167.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T10:02:00.448 INFO:teuthology.orchestra.run.smithi167.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T10:02:00.448 INFO:teuthology.orchestra.run.smithi167.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T10:02:00.449 INFO:teuthology.orchestra.run.smithi167.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T10:02:00.449 INFO:teuthology.orchestra.run.smithi167.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T10:02:00.482 INFO:teuthology.orchestra.run.smithi167.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T10:02:00.483 INFO:teuthology.orchestra.run.smithi167.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T10:02:00.549 INFO:teuthology.orchestra.run.smithi018.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T10:02:00.549 INFO:teuthology.orchestra.run.smithi018.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T10:02:00.596 INFO:teuthology.orchestra.run.smithi018.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T10:02:00.660 INFO:teuthology.orchestra.run.smithi018.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T10:02:00.668 INFO:teuthology.orchestra.run.smithi018.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T10:02:00.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T10:02:00.669 INFO:teuthology.orchestra.run.smithi018.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T10:02:00.670 INFO:teuthology.orchestra.run.smithi018.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T10:02:00.857 INFO:teuthology.orchestra.run.smithi167.stdout:Preconfiguring packages ... 2024-04-25T10:02:00.871 INFO:teuthology.orchestra.run.smithi018.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T10:02:01.024 INFO:teuthology.orchestra.run.smithi167.stdout:Fetched 55.7 MB in 5s (10.6 MB/s) 2024-04-25T10:02:01.293 INFO:teuthology.orchestra.run.smithi018.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T10:02:01.319 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T10:02:01.322 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:01.466 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:02.058 INFO:teuthology.orchestra.run.smithi018.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T10:02:02.058 INFO:teuthology.orchestra.run.smithi018.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T10:02:02.058 INFO:teuthology.orchestra.run.smithi018.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T10:02:02.058 INFO:teuthology.orchestra.run.smithi018.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T10:02:02.059 INFO:teuthology.orchestra.run.smithi018.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T10:02:02.059 INFO:teuthology.orchestra.run.smithi018.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T10:02:02.074 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:02.087 INFO:teuthology.orchestra.run.smithi018.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T10:02:02.087 INFO:teuthology.orchestra.run.smithi018.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T10:02:02.482 INFO:teuthology.orchestra.run.smithi018.stdout:Preconfiguring packages ... 2024-04-25T10:02:02.635 INFO:teuthology.orchestra.run.smithi018.stdout:Fetched 55.7 MB in 6s (10.1 MB/s) 2024-04-25T10:02:02.883 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T10:02:02.886 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:03.025 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:03.187 INFO:teuthology.orchestra.run.smithi167.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T10:02:03.447 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package flex. 2024-04-25T10:02:03.515 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T10:02:03.519 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:03.562 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T10:02:03.651 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:04.065 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:02:04.268 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T10:02:04.692 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:04.763 INFO:teuthology.orchestra.run.smithi018.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T10:02:05.030 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package flex. 2024-04-25T10:02:05.104 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T10:02:05.108 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:05.154 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T10:02:05.206 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T10:02:05.210 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:05.336 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:05.757 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:05.841 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:02:05.884 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:06.019 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T10:02:06.200 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:06.419 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:06.594 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package bison. 2024-04-25T10:02:06.670 INFO:teuthology.orchestra.run.smithi167.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T10:02:06.674 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T10:02:06.721 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:02:06.927 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T10:02:06.930 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:07.035 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:07.130 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T10:02:07.145 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T10:02:07.188 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:02:07.432 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T10:02:07.509 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package dump. 2024-04-25T10:02:07.523 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T10:02:07.558 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T10:02:07.559 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T10:02:07.829 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package indent. 2024-04-25T10:02:07.845 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:07.883 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:07.887 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:02:08.149 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T10:02:08.164 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T10:02:08.207 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:02:08.267 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package bison. 2024-04-25T10:02:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T10:02:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T10:02:08.395 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:02:08.545 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T10:02:08.560 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T10:02:08.602 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:02:08.787 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T10:02:08.803 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T10:02:08.830 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T10:02:08.845 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:02:08.846 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T10:02:08.888 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:02:09.141 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package dump. 2024-04-25T10:02:09.157 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T10:02:09.226 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T10:02:09.232 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T10:02:09.242 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:09.284 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:09.512 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package indent. 2024-04-25T10:02:09.527 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:09.562 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T10:02:09.569 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:02:09.578 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:09.637 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:09.830 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T10:02:09.846 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T10:02:09.883 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T10:02:09.888 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:02:09.898 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T10:02:09.941 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T10:02:10.176 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T10:02:10.192 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T10:02:10.234 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:02:10.252 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T10:02:10.268 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T10:02:10.311 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:02:10.904 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T10:02:10.920 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T10:02:10.963 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:02:11.300 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T10:02:11.316 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:11.358 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:11.620 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T10:02:11.636 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T10:02:11.678 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:11.697 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T10:02:11.713 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:02:11.756 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:11.939 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T10:02:11.955 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T10:02:11.997 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T10:02:12.000 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T10:02:12.016 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:02:12.075 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:12.326 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T10:02:12.341 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T10:02:12.384 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:02:12.403 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T10:02:12.419 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:02:12.478 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:12.789 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T10:02:12.805 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T10:02:12.856 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:02:13.169 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T10:02:13.183 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:02:13.226 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:02:13.554 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T10:02:13.570 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:13.612 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:13.687 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T10:02:13.703 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:02:13.753 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:13.949 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T10:02:13.965 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:14.006 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T10:02:14.007 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:14.022 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T10:02:14.064 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:14.293 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T10:02:14.309 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:14.351 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:14.384 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T10:02:14.400 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:02:14.442 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:14.604 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T10:02:14.620 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:02:14.654 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:14.795 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T10:02:14.811 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T10:02:14.845 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:02:15.157 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T10:02:15.172 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:02:15.215 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:02:15.301 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T10:02:15.316 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T10:02:15.359 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:02:15.560 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T10:02:15.576 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:15.618 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:15.721 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package modemmanager. 2024-04-25T10:02:15.736 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:02:15.770 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:16.081 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T10:02:16.097 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:16.139 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:16.378 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager. 2024-04-25T10:02:16.394 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:02:16.442 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T10:02:16.444 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:02:16.458 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:16.500 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:16.712 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T10:02:16.728 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T10:02:16.761 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:17.028 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package ppp. 2024-04-25T10:02:17.043 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T10:02:17.240 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T10:02:17.255 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T10:02:17.298 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:02:17.420 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:02:17.660 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package modemmanager. 2024-04-25T10:02:17.676 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T10:02:17.718 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T10:02:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T10:02:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T10:02:18.085 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T10:02:18.100 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T10:02:18.143 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T10:02:18.350 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager. 2024-04-25T10:02:18.367 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T10:02:18.417 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:02:18.430 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T10:02:18.444 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T10:02:18.488 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T10:02:18.826 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T10:02:18.840 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:18.875 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:19.060 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package ppp. 2024-04-25T10:02:19.076 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T10:02:19.380 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T10:02:19.395 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T10:02:19.421 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:02:19.456 INFO:teuthology.orchestra.run.smithi167.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T10:02:19.487 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-common (238) ... 2024-04-25T10:02:19.747 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T10:02:19.762 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T10:02:19.805 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T10:02:20.075 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T10:02:20.090 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T10:02:20.125 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T10:02:20.361 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T10:02:20.376 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T10:02:20.379 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T10:02:20.396 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:20.420 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T10:02:20.440 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:20.706 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T10:02:20.721 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:20.764 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:21.361 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T10:02:21.376 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T10:02:21.438 INFO:teuthology.orchestra.run.smithi018.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T10:02:21.468 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-common (238) ... 2024-04-25T10:02:21.491 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql. 2024-04-25T10:02:21.506 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T10:02:21.549 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql (14+238) ... 2024-04-25T10:02:21.768 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T10:02:21.783 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T10:02:21.843 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T10:02:21.918 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T10:02:21.933 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T10:02:21.979 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:22.079 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T10:02:22.094 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T10:02:22.137 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T10:02:22.456 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T10:02:22.471 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T10:02:22.515 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:02:22.793 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package tcl. 2024-04-25T10:02:22.807 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T10:02:22.880 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T10:02:23.004 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql. 2024-04-25T10:02:23.019 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T10:02:23.054 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql (14+238) ... 2024-04-25T10:02:23.170 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T10:02:23.185 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T10:02:23.229 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:02:23.297 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T10:02:23.312 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T10:02:23.356 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T10:02:23.575 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T10:02:23.590 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T10:02:23.599 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T10:02:23.615 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T10:02:23.634 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T10:02:23.658 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T10:02:24.002 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T10:02:24.019 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T10:02:24.020 INFO:teuthology.orchestra.run.smithi167.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T10:02:24.035 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T10:02:24.060 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:02:24.078 INFO:teuthology.orchestra.run.smithi167.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:02:24.313 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package tcl. 2024-04-25T10:02:24.329 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T10:02:24.346 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T10:02:24.367 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T10:02:24.551 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T10:02:24.678 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:02:24.690 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T10:02:24.707 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T10:02:24.748 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:02:24.804 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:24.971 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:02:25.081 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:02:25.111 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T10:02:25.128 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T10:02:25.169 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T10:02:25.555 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:25.564 INFO:teuthology.orchestra.run.smithi018.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T10:02:25.580 INFO:teuthology.orchestra.run.smithi018.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T10:02:25.630 INFO:teuthology.orchestra.run.smithi018.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:02:25.917 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T10:02:26.470 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T10:02:26.526 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T10:02:26.571 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T10:02:26.621 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:02:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:26.823 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T10:02:26.949 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T10:02:26.999 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:02:26.999 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:02:27.075 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:27.700 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:27.826 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:02:27.977 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:28.102 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T10:02:28.124 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T10:02:28.222 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T10:02:28.229 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:02:28.346 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:28.456 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:02:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:02:28.557 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T10:02:28.573 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:02:29.246 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:02:29.308 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T10:02:29.372 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T10:02:29.434 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T10:02:29.458 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T10:02:29.532 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:29.568 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T10:02:29.674 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:02:29.694 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T10:02:29.801 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T10:02:29.820 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T10:02:29.926 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T10:02:29.946 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:30.064 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T10:02:30.078 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:02:30.165 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T10:02:30.167 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T10:02:30.238 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:02:30.355 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:02:30.507 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:02:30.635 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:30.761 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T10:02:30.820 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T10:02:30.929 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T10:02:30.946 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T10:02:31.041 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T10:02:31.081 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:02:31.105 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:31.206 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T10:02:31.307 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T10:02:31.417 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T10:02:31.542 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T10:02:31.641 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T10:02:31.658 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:31.658 INFO:teuthology.orchestra.run.smithi167.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T10:02:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:which means they are currently configured by ifupdown: 2024-04-25T10:02:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:- enp3s0f1 2024-04-25T10:02:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T10:02:31.659 INFO:teuthology.orchestra.run.smithi167.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T10:02:31.659 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:31.711 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T10:02:31.792 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T10:02:31.862 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T10:02:32.038 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T10:02:32.164 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:32.199 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T10:02:32.265 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T10:02:32.400 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T10:02:32.517 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T10:02:32.629 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:which means they are currently configured by ifupdown: 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:- ens1f0 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T10:02:33.130 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:33.269 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T10:02:33.357 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:33.492 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:33.627 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T10:02:33.739 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T10:02:33.752 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-common (238) ... 2024-04-25T10:02:34.184 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T10:02:34.800 INFO:teuthology.orchestra.run.smithi167.stdout:Adding user postgres to group ssl-cert 2024-04-25T10:02:34.966 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T10:02:35.044 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:35.044 INFO:teuthology.orchestra.run.smithi167.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T10:02:35.218 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T10:02:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T10:02:35.297 INFO:teuthology.orchestra.run.smithi167.stdout:Removing obsolete dictionary files: 2024-04-25T10:02:35.487 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T10:02:35.723 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-common (238) ... 2024-04-25T10:02:36.033 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T10:02:36.521 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:36.806 INFO:teuthology.orchestra.run.smithi018.stdout:Adding user postgres to group ssl-cert 2024-04-25T10:02:36.854 INFO:teuthology.orchestra.run.smithi167.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T10:02:36.877 INFO:teuthology.orchestra.run.smithi167.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:This user must also own the server process. 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T10:02:36.932 INFO:teuthology.orchestra.run.smithi167.stdout:The default text search configuration will be set to "english". 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:Data page checksums are disabled. 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:creating subdirectories ... ok 2024-04-25T10:02:36.933 INFO:teuthology.orchestra.run.smithi167.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T10:02:36.957 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default max_connections ... 100 2024-04-25T10:02:36.991 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default shared_buffers ... 128MB 2024-04-25T10:02:37.005 INFO:teuthology.orchestra.run.smithi167.stdout:selecting default time zone ... Etc/UTC 2024-04-25T10:02:37.006 INFO:teuthology.orchestra.run.smithi167.stdout:creating configuration files ... ok 2024-04-25T10:02:37.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:37.058 INFO:teuthology.orchestra.run.smithi018.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T10:02:37.169 INFO:teuthology.orchestra.run.smithi167.stdout:running bootstrap script ... ok 2024-04-25T10:02:37.339 INFO:teuthology.orchestra.run.smithi018.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T10:02:37.339 INFO:teuthology.orchestra.run.smithi018.stdout:Removing obsolete dictionary files: 2024-04-25T10:02:37.773 INFO:teuthology.orchestra.run.smithi167.stdout:performing post-bootstrap initialization ... ok 2024-04-25T10:02:38.132 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T10:02:38.376 INFO:teuthology.orchestra.run.smithi167.stdout:syncing data to disk ... ok 2024-04-25T10:02:38.751 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T10:02:38.903 INFO:teuthology.orchestra.run.smithi167.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T10:02:39.102 INFO:teuthology.orchestra.run.smithi018.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T10:02:39.123 INFO:teuthology.orchestra.run.smithi018.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout:This user must also own the server process. 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T10:02:39.179 INFO:teuthology.orchestra.run.smithi018.stdout:The default text search configuration will be set to "english". 2024-04-25T10:02:39.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:39.180 INFO:teuthology.orchestra.run.smithi018.stdout:Data page checksums are disabled. 2024-04-25T10:02:39.180 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:39.180 INFO:teuthology.orchestra.run.smithi018.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T10:02:39.181 INFO:teuthology.orchestra.run.smithi018.stdout:creating subdirectories ... ok 2024-04-25T10:02:39.181 INFO:teuthology.orchestra.run.smithi018.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T10:02:39.204 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default max_connections ... 100 2024-04-25T10:02:39.239 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default shared_buffers ... 128MB 2024-04-25T10:02:39.253 INFO:teuthology.orchestra.run.smithi018.stdout:selecting default time zone ... Etc/UTC 2024-04-25T10:02:39.254 INFO:teuthology.orchestra.run.smithi018.stdout:creating configuration files ... ok 2024-04-25T10:02:39.428 INFO:teuthology.orchestra.run.smithi018.stdout:running bootstrap script ... ok 2024-04-25T10:02:40.071 INFO:teuthology.orchestra.run.smithi018.stdout:performing post-bootstrap initialization ... ok 2024-04-25T10:02:40.630 INFO:teuthology.orchestra.run.smithi018.stdout:syncing data to disk ... ok 2024-04-25T10:02:41.185 INFO:teuthology.orchestra.run.smithi018.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T10:02:41.862 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:41.988 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T10:02:42.105 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up postgresql (14+238) ... 2024-04-25T10:02:42.206 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:42.332 INFO:teuthology.orchestra.run.smithi167.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:42.626 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:02:42.627 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:02:43.418 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:02:43.536 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T10:02:43.837 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:02:43.989 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:02:44.474 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:44.600 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T10:02:44.735 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up postgresql (14+238) ... 2024-04-25T10:02:44.861 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T10:02:44.986 INFO:teuthology.orchestra.run.smithi018.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T10:02:45.279 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:02:45.279 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T10:02:45.542 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T10:02:45.642 INFO:teuthology.orchestra.run.smithi167.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:02:46.080 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T10:02:46.164 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T10:02:46.194 INFO:teuthology.orchestra.run.smithi167.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:02:46.202 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:46.500 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T10:02:46.651 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T10:02:47.894 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T10:02:47.994 INFO:teuthology.orchestra.run.smithi018.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T10:02:48.525 INFO:teuthology.orchestra.run.smithi018.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T10:02:48.533 DEBUG:teuthology.parallel:result is None 2024-04-25T10:02:48.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T10:02:48.677 DEBUG:teuthology.orchestra.run.smithi018:> dpkg-query -W -f '${Version}' ceph 2024-04-25T10:02:48.700 INFO:teuthology.orchestra.run.smithi018.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:02:48.701 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:02:48.701 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T10:02:48.703 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T10:02:49.015 DEBUG:teuthology.orchestra.run.smithi167:> dpkg-query -W -f '${Version}' ceph 2024-04-25T10:02:49.039 INFO:teuthology.orchestra.run.smithi167.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:02:49.039 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T10:02:49.039 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T10:02:49.041 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T10:02:49.042 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:49.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:02:49.062 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:49.062 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T10:02:49.103 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T10:02:49.103 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:49.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:02:49.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:02:49.187 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:49.187 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T10:02:49.208 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T10:02:49.271 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T10:02:49.271 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:49.271 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:02:49.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:02:49.351 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:49.351 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T10:02:49.372 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T10:02:49.434 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T10:02:49.434 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:49.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:02:49.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:02:49.518 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:49.519 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T10:02:49.539 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T10:02:49.606 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T10:02:49.699 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T10:02:49.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-04-25T10:02:49.702 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /var/log/ceph 2024-04-25T10:02:49.722 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T10:02:49.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:02:49.763 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T10:02:49.786 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T10:02:49.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:02:49.822 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T10:02:49.861 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T10:02:49.861 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T10:02:49.862 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T10:02:49.862 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:49.862 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:02:49.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:49.983 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:49.983 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T10:02:49.991 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T10:02:50.092 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T10:02:50.092 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T10:02:50.092 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7673036', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': 'a3b7a189d278a9762c1acb7de36790ef0ed7b448'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1124, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_a3b7a189d278a9762c1acb7de36790ef0ed7b448/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': 'a3b7a189d278a9762c1acb7de36790ef0ed7b448', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIC3USzfx5rXSjewwpUrL5A8DI/BwpjY+3kUUdTQ7mdAcos5fZ+/x769Z7Ig9gkCxhm17Ye1jewNy/vsZQN+CRc=', 'smithi167.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIwg8crrdr2nOdlWm1OcdEH1WRGAOSXsOpRLL+AO8YIkfr/8gfoedwkFXGXplPA212UgpSXjLCihb9wyuSvv950='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_09:36:50', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T10:02:50.093 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:02:50.096 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T10:02:50.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:02:50.147 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T10:02:50.169 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:50.170 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:02:50.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:02:50.216 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-25 09:56:22.183706024 +0000 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-25 09:56:21.911708450 +0000 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-25 09:56:21.911708450 +0000 2024-04-25T10:02:50.272 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-25 09:56:21.911708450 +0000 2024-04-25T10:02:50.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:02:50.333 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-25T10:02:50.333 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-25T10:02:50.333 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000237068 s, 2.2 MB/s 2024-04-25T10:02:50.335 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:02:50.390 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-04-25T10:02:50.444 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:02:50.444 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:50.444 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 913 Links: 1 2024-04-25T10:02:50.444 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:50.445 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-25 09:56:22.495703241 +0000 2024-04-25T10:02:50.445 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-25 09:56:22.491703276 +0000 2024-04-25T10:02:50.445 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-25 09:56:22.491703276 +0000 2024-04-25T10:02:50.445 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-25 09:56:22.491703276 +0000 2024-04-25T10:02:50.445 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:02:50.505 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-25T10:02:50.506 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-25T10:02:50.506 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000233645 s, 2.2 MB/s 2024-04-25T10:02:50.507 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:02:50.566 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-25 09:56:23.307695997 +0000 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-25 09:56:23.043698352 +0000 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-25 09:56:23.043698352 +0000 2024-04-25T10:02:50.616 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-25 09:56:23.043698352 +0000 2024-04-25T10:02:50.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:02:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-25T10:02:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-25T10:02:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000230836 s, 2.2 MB/s 2024-04-25T10:02:50.679 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:02:50.729 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 6h/6d Inode: 948 Links: 1 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-04-25 09:56:23.879690894 +0000 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-04-25 09:56:23.603693357 +0000 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-04-25 09:56:23.603693357 +0000 2024-04-25T10:02:50.780 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-04-25 09:56:23.603693357 +0000 2024-04-25T10:02:50.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:02:50.841 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-04-25T10:02:50.841 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-04-25T10:02:50.842 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000231393 s, 2.2 MB/s 2024-04-25T10:02:50.843 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:02:50.894 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:50.894 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:50.894 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T10:02:50.903 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T10:02:50.903 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-04-25T10:02:50.958 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 890 Links: 1 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 09:56:18.971314290 +0000 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 09:56:18.715316576 +0000 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 09:56:18.715316576 +0000 2024-04-25T10:02:50.959 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 09:56:18.715316576 +0000 2024-04-25T10:02:50.959 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T10:02:51.020 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T10:02:51.020 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T10:02:51.020 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000418345 s, 1.2 MB/s 2024-04-25T10:02:51.022 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T10:02:51.080 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 906 Links: 1 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 09:56:19.511309466 +0000 2024-04-25T10:02:51.134 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 09:56:19.247311824 +0000 2024-04-25T10:02:51.135 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 09:56:19.247311824 +0000 2024-04-25T10:02:51.135 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 09:56:19.247311824 +0000 2024-04-25T10:02:51.135 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T10:02:51.196 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T10:02:51.196 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T10:02:51.196 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000384159 s, 1.3 MB/s 2024-04-25T10:02:51.198 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T10:02:51.252 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-04-25T10:02:51.306 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 924 Links: 1 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 09:56:20.035304786 +0000 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 09:56:19.783307037 +0000 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 09:56:19.783307037 +0000 2024-04-25T10:02:51.307 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 09:56:19.783307037 +0000 2024-04-25T10:02:51.307 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T10:02:51.372 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T10:02:51.372 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T10:02:51.372 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000384182 s, 1.3 MB/s 2024-04-25T10:02:51.374 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T10:02:51.432 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 6h/6d Inode: 942 Links: 1 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-04-25 09:56:20.635299425 +0000 2024-04-25T10:02:51.482 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-04-25 09:56:20.343302034 +0000 2024-04-25T10:02:51.483 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-04-25 09:56:20.343302034 +0000 2024-04-25T10:02:51.483 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-04-25 09:56:20.343302034 +0000 2024-04-25T10:02:51.483 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T10:02:51.543 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-04-25T10:02:51.544 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-04-25T10:02:51.544 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000394924 s, 1.3 MB/s 2024-04-25T10:02:51.546 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T10:02:51.600 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:51.600 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:02:51.600 INFO:tasks.ceph:Generating config... 2024-04-25T10:02:51.601 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T10:02:51.601 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T10:02:51.602 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T10:02:51.602 INFO:tasks.ceph:[client] pid file = 2024-04-25T10:02:51.602 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T10:02:51.602 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T10:02:51.602 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T10:02:51.602 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T10:02:51.603 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T10:02:51.604 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T10:02:51.604 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T10:02:51.604 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T10:02:51.604 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T10:02:51.604 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T10:02:51.604 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T10:02:51.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T10:02:51.651 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T10:02:51.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T10:02:51.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:02:51.783 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.167'), ('mon.c', '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]')] 2024-04-25T10:02:51.783 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T10:02:51.784 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:51.784 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:02:51.832 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.167 --addv c '[v2:172.21.15.167:3301,v1:172.21.15.167:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:51.924 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:51.924 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsid a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-04-25T10:02:51.920192+0000 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-04-25T10:02:51.920192+0000 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] mon.c 2024-04-25T10:02:51.925 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T10:02:51.928 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T10:02:51.936 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a742dcf2-a420-4fc2-9137-18bf23968324... 2024-04-25T10:02:51.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:02:51.982 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-25T10:02:52.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-25T10:02:52.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-25T10:02:52.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:02:52.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:02:52.030 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:02:52.031 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-25T10:02:52.032 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:02:52.033 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T10:02:52.034 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.035 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T10:02:52.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:02:52.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:02:52.039 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:02:52.040 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.041 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:02:52.042 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T10:02:52.043 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:02:52.044 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:02:52.046 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T10:02:52.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T10:02:52.149 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T10:02:52.149 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:52.150 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T10:02:52.163 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:52.163 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T10:02:52.212 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:02:52.212 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:52.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:02:52.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:02:52.287 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:02:52.287 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:52.335 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:02:52.335 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:52.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T10:02:52.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T10:02:52.370 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:02:52.370 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:52.426 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T10:02:52.426 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T10:02:52.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:02:52.483 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T10:02:52.488 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:02:52.546 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T10:02:52.564 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T10:02:52.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:02:52.621 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T10:02:52.626 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T10:02:52.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:02:52.747 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T10:02:52.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T10:02:52.771 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:02:52.831 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T10:02:52.836 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T10:02:52.856 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:02:52.956 INFO:teuthology.orchestra.run.smithi167.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T10:02:52.961 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T10:02:52.981 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T10:02:52.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T10:02:53.023 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T10:02:53.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T10:02:53.125 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T10:02:53.142 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T10:02:53.183 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T10:02:53.200 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T10:02:53.287 INFO:teuthology.orchestra.run.smithi167.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T10:02:53.304 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T10:02:53.304 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi167.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T10:02:53.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T10:02:53.324 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:53.324 INFO:tasks.ceph:role: osd.0 2024-04-25T10:02:53.324 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:02:53.324 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:02:53.386 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:02:53.387 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:02:53.414 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-25T10:02:53.414 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-25T10:02:53.414 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T10:02:53.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T10:02:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:02:53.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:02:53.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T10:02:53.611 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:53.611 INFO:tasks.ceph:role: osd.1 2024-04-25T10:02:53.611 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:02:53.611 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:02:53.671 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:02:53.695 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-25T10:02:53.698 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-25T10:02:53.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T10:02:53.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T10:02:53.823 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:02:53.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:02:53.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T10:02:53.887 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:53.887 INFO:tasks.ceph:role: osd.2 2024-04-25T10:02:53.887 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:02:53.887 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:02:53.946 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:02:53.947 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:02:53.970 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-25T10:02:53.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-25T10:02:53.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T10:02:54.040 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T10:02:54.099 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:02:54.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:02:54.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T10:02:54.162 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T10:02:54.162 INFO:tasks.ceph:role: osd.3 2024-04-25T10:02:54.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:02:54.163 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:02:54.226 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:02:54.226 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:02:54.226 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:02:54.227 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:02:54.250 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-04-25T10:02:54.253 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-04-25T10:02:54.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T10:02:54.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T10:02:54.383 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:02:54.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:02:54.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:54.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.494+0000 7fa02e70b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T10:02:54.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.494+0000 7fa02e70b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T10:02:54.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.494+0000 7fa02e70b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:02:54.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.494+0000 7fa02e70b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:02:54.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.494+0000 7fa02e70b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T10:02:54.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:54.498+0000 7fa02e70b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T10:02:57.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T10:02:57.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:02:57.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.650+0000 7f98e0e807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T10:02:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.650+0000 7f98e0e807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T10:02:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.650+0000 7f98e0e807c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:02:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.650+0000 7f98e0e807c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:02:57.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.650+0000 7f98e0e807c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T10:02:57.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:02:57.654+0000 7f98e0e807c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T10:03:00.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T10:03:00.723 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.810+0000 7fae5da5e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T10:03:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.810+0000 7fae5da5e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T10:03:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.810+0000 7fae5da5e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:03:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.814+0000 7fae5da5e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:03:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.814+0000 7fae5da5e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T10:03:00.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:00.814+0000 7fae5da5e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T10:03:03.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T10:03:03.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:03.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.970+0000 7f358085e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T10:03:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.970+0000 7f358085e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T10:03:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.970+0000 7f358085e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:03:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.970+0000 7f358085e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:03:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.970+0000 7f358085e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T10:03:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:03.974+0000 7f358085e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T10:03:06.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T10:03:07.013 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T10:03:07.035 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:03:07.035 INFO:tasks.ceph:role: osd.4 2024-04-25T10:03:07.035 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:03:07.035 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:03:07.106 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:03:07.107 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:03:07.107 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:03:07.507 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T10:03:07.510 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T10:03:07.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T10:03:07.617 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T10:03:07.634 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:03:07.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:03:07.635 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T10:03:07.697 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:03:07.697 INFO:tasks.ceph:role: osd.5 2024-04-25T10:03:07.697 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:03:07.698 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T10:03:07.769 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:03:07.769 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:03:07.769 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:03:07.769 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:03:07.770 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:03:08.178 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T10:03:08.181 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T10:03:08.182 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T10:03:08.315 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T10:03:08.332 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:03:08.333 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:03:08.333 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T10:03:08.398 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:03:08.398 INFO:tasks.ceph:role: osd.6 2024-04-25T10:03:08.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:03:08.398 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:03:08.469 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:03:08.883 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T10:03:08.886 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T10:03:08.886 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T10:03:09.014 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T10:03:09.031 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:03:09.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:03:09.032 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T10:03:09.095 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T10:03:09.095 INFO:tasks.ceph:role: osd.7 2024-04-25T10:03:09.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:03:09.095 DEBUG:teuthology.orchestra.run.smithi167:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout: = sunit=0 swidth=0 blks 2024-04-25T10:03:09.166 INFO:teuthology.orchestra.run.smithi167.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T10:03:09.167 INFO:teuthology.orchestra.run.smithi167.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T10:03:09.167 INFO:teuthology.orchestra.run.smithi167.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T10:03:09.167 INFO:teuthology.orchestra.run.smithi167.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T10:03:09.531 INFO:teuthology.orchestra.run.smithi167.stdout:Discarding blocks...Done. 2024-04-25T10:03:09.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi167.front.sepia.ceph.com -o noatime 2024-04-25T10:03:09.534 DEBUG:teuthology.orchestra.run.smithi167:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T10:03:09.613 DEBUG:teuthology.orchestra.run.smithi167:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T10:03:09.674 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T10:03:09.675 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:03:09.676 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:09.798 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.790+0000 7f366e6247c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T10:03:09.802 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.798+0000 7f366e6247c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T10:03:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.798+0000 7f366e6247c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:03:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.798+0000 7f366e6247c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:03:09.803 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.798+0000 7f366e6247c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T10:03:09.807 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:09.802+0000 7f366e6247c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T10:03:12.848 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T10:03:12.870 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.958+0000 7f36732d07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T10:03:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.962+0000 7f36732d07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T10:03:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.962+0000 7f36732d07c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:03:12.966 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.962+0000 7f36732d07c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:03:12.967 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.962+0000 7f36732d07c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T10:03:12.968 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:12.962+0000 7f36732d07c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T10:03:15.987 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T10:03:16.007 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:16.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.094+0000 7f79715967c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T10:03:16.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.094+0000 7f79715967c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T10:03:16.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.094+0000 7f79715967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:03:16.101 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.094+0000 7f79715967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:03:16.102 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.094+0000 7f79715967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T10:03:16.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:16.098+0000 7f79715967c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T10:03:19.144 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T10:03:19.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:19.265 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.258+0000 7fce1a7c67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T10:03:19.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.258+0000 7fce1a7c67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T10:03:19.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.258+0000 7fce1a7c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:03:19.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.258+0000 7fce1a7c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:03:19.266 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.258+0000 7fce1a7c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T10:03:19.268 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:19.262+0000 7fce1a7c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T10:03:20.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:20.097 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:22.309 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T10:03:22.331 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T10:03:22.331 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T10:03:22.353 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T10:03:22.417 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T10:03:22.485 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T10:03:22.553 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T10:03:22.617 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.617 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T10:03:22.685 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:22.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T10:03:22.753 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:22.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T10:03:22.774 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:22.774 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T10:03:22.842 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:22.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T10:03:22.906 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:22.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T10:03:22.974 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:22.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T10:03:23.039 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:23.039 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T10:03:23.102 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:23.102 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T10:03:23.162 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:23.162 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T10:03:23.171 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:23.171 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T10:03:23.220 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:23.220 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T10:03:23.229 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:23.229 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T10:03:23.283 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T10:03:23.283 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:03:23.288 DEBUG:teuthology.orchestra.run.smithi167:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T10:03:23.330 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-04-25T10:03:23.330 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA== 2024-04-25T10:03:23.330 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ== 2024-04-25T10:03:23.331 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:03:23.332 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2024-04-25T10:03:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA== 2024-04-25T10:03:23.333 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-04-25T10:03:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g== 2024-04-25T10:03:23.333 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2024-04-25T10:03:23.333 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew== 2024-04-25T10:03:23.344 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.y] 2024-04-25T10:03:23.344 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA== 2024-04-25T10:03:23.344 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:03:23.344 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.0] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.1] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.2] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.3] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr.x] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ== 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:03:23.345 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.4] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.5] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.6] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[osd.7] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[client.0] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout:[client.2] 2024-04-25T10:03:23.346 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA== 2024-04-25T10:03:23.347 INFO:teuthology.orchestra.run.smithi167.stdout:[client.1] 2024-04-25T10:03:23.347 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g== 2024-04-25T10:03:23.347 INFO:teuthology.orchestra.run.smithi167.stdout:[client.3] 2024-04-25T10:03:23.347 INFO:teuthology.orchestra.run.smithi167.stdout: key = AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew== 2024-04-25T10:03:23.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:03:23.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:03:23.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.449 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.507 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.510 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.569 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.626 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.682 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:03:23.795 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T10:03:23.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.911 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T10:03:23.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:23.970 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.026 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.082 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.138 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T10:03:24.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.195 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.251 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.254 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.314 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.372 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T10:03:24.428 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T10:03:24.429 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T10:03:24.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:03:24.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T10:03:24.584 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T10:03:24.603 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:03:24.713 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T10:03:24.732 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T10:03:24.793 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T10:03:24.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T10:03:24.919 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:24.922 DEBUG:teuthology.orchestra.run.smithi167:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T10:03:24.974 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T10:03:24.974 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T10:03:24.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T10:03:24.977 INFO:tasks.ceph.mon.a:Started 2024-04-25T10:03:24.977 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T10:03:24.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T10:03:25.021 INFO:tasks.ceph.mon.b:Started 2024-04-25T10:03:25.021 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T10:03:25.021 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T10:03:25.024 INFO:tasks.ceph.mon.c:Started 2024-04-25T10:03:25.024 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T10:03:25.024 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T10:03:25.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T10:03:25.027 INFO:tasks.ceph.mgr.y:Started 2024-04-25T10:03:25.028 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T10:03:25.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T10:03:25.031 INFO:tasks.ceph.mgr.x:Started 2024-04-25T10:03:25.031 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T10:03:25.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T10:03:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.165+0000 7fb82da00640 1 Processor -- start 2024-04-25T10:03:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.165+0000 7fb82da00640 1 -- start start 2024-04-25T10:03:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb82da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb82da00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280d02a0 con 0x7fb8280cd370 2024-04-25T10:03:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb82da00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8280cc350 con 0x7fb82815b910 2024-04-25T10:03:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb82da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280cc630 con 0x7fb8280cf3c0 2024-04-25T10:03:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb82815b910 0x7fb8280cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:55536/0 (socket says 172.21.15.18:55536) 2024-04-25T10:03:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 learned_addr learned my addr 172.21.15.18:0/1916223839 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.373+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.373+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:03:25.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:25.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.777+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:25.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.777+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:25.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:25.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:25.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:03:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:26.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:26.581+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:26.581+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:26.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:26.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb8280cce30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb8280cce30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 >> v1:172.21.15.167:6789/0 conn(0x7fb82815b910 legacy=0x7fb8280cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 >> v1:172.21.15.18:6789/0 conn(0x7fb8280cd370 legacy=0x7fb828099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:28.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8280cc630 con 0x7fb8080061d0 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb808008d40 con 0x7fb808003720 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:28.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.373+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:28.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:28.777+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T10:03:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:29.581+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T10:03:30.548 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:30.545+0000 7f0d43a4d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:03:30.650 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:30.641+0000 7f4b370d3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T10:03:31.044 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:31.041+0000 7f0d43a4d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 msgr2=0x7fb808008690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb8080061d0 0x7fb808008690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb827400640 1 -- 172.21.15.18:0/1916223839 reap_dead start 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb808009130 0x7fb80800b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8280cc630 con 0x7fb808009130 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb808008d40 con 0x7fb808003720 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb81fe00640 1 -- 172.21.15.18:0/1916223839 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80800bc20 con 0x7fb8280cf3c0 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.18:3300/0 conn(0x7fb808009130 0x7fb80800b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb827400640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb808008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826000640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb808008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826000640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 msgr2=0x7fb808008610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 msgr2=0x7fb808005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.169+0000 7fb826a00640 1 -- 172.21.15.18:0/1916223839 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280cc910 con 0x7fb808009130 2024-04-25T10:03:31.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb826a00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808009130 0x7fb80800b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8080036b0 tx=0x7fb81801cfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586bcb03380cdacf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:31.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb825600640 1 -- 172.21.15.18:0/1916223839 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180ab070 con 0x7fb808009130 2024-04-25T10:03:31.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb825600640 1 -- 172.21.15.18:0/1916223839 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8180af400 con 0x7fb808009130 2024-04-25T10:03:31.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb825600640 1 -- 172.21.15.18:0/1916223839 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8180af830 con 0x7fb808009130 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- 172.21.15.18:0/1916223839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808009130 msgr2=0x7fb80800b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808009130 0x7fb80800b560 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb8080036b0 tx=0x7fb81801cfe0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- 172.21.15.18:0/1916223839 shutdown_connections 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 --2- 172.21.15.18:0/1916223839 >> v2:172.21.15.167:3300/0 conn(0x7fb808003720 0x7fb808005b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8280cf3c0 0x7fb808008610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 --2- 172.21.15.18:0/1916223839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb808009130 0x7fb80800b560 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- 172.21.15.18:0/1916223839 >> 172.21.15.18:0/1916223839 conn(0x7fb8280b3200 msgr2=0x7fb8280b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:31.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- 172.21.15.18:0/1916223839 shutdown_connections 2024-04-25T10:03:31.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- 172.21.15.18:0/1916223839 wait complete. 2024-04-25T10:03:31.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 Processor -- start 2024-04-25T10:03:31.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.173+0000 7fb82da00640 1 -- start start 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb808009130 0x7fb8280b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82815be70 con 0x7fb8280cf3c0 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82815bcf0 con 0x7fb808009130 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8280cce30 con 0x7fb808003720 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51050/0 (socket says 172.21.15.18:51050) 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 -- 172.21.15.18:0/2144439623 learned_addr learned my addr 172.21.15.18:0/2144439623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826a00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826000640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb808009130 0x7fb8280b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826a00640 1 -- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 msgr2=0x7fb8280b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T10:03:31.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826a00640 1 -- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 msgr2=0x7fb8280b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826a00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 -- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 msgr2=0x7fb8280b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb826a00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 -- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb808009130 msgr2=0x7fb8280b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb808009130 0x7fb8280b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 -- 172.21.15.18:0/2144439623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8280b5ce0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb827400640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8280cf950 tx=0x7fb82000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820005d60 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb820018070 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8280b5440 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82000d900 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8280b5a00 con 0x7fb8280cf3c0 2024-04-25T10:03:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fb82000daa0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb82001d4a0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.177+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8280745d0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.185+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fb8200070d0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.255 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:31.245+0000 7f4b370d3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T10:03:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.245+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb8280cbeb0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb81ea00640 1 -- 172.21.15.18:0/2144439623 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb8200072b0 con 0x7fb8280cf3c0 2024-04-25T10:03:31.258 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 msgr2=0x7fb828157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb8280cf950 tx=0x7fb82000fd40 comp rx=0 tx=0).stop 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 shutdown_connections 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8280cf3c0 0x7fb828157e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb808009130 0x7fb8280b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 --2- 172.21.15.18:0/2144439623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb808003720 0x7fb8280b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 >> 172.21.15.18:0/2144439623 conn(0x7fb8280b3200 msgr2=0x7fb8280c6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 shutdown_connections 2024-04-25T10:03:31.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:31.249+0000 7fb82da00640 1 -- 172.21.15.18:0/2144439623 wait complete. 2024-04-25T10:03:31.262 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:31.257+0000 7f0d43a4d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:03:31.279 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T10:03:31.279 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T10:03:31.279 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:31.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T10:03:31.299 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:31.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T10:03:31.359 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:31.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T10:03:31.418 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:03:31.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T10:03:31.479 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:31.479 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T10:03:31.499 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:31.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T10:03:31.558 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:31.558 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T10:03:31.570 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:31.561+0000 7f4b370d3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T10:03:31.619 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:03:31.619 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T10:03:31.682 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new ded92fa6-89b5-4a0f-94b2-eedcc08d53b4 0 2024-04-25T10:03:31.858 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.853+0000 7fd175200640 1 Processor -- start 2024-04-25T10:03:31.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.853+0000 7fd175200640 1 -- start start 2024-04-25T10:03:31.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd175200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd17015bcf0 0x7fd170099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.859 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd175200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700d02a0 con 0x7fd1700cf3c0 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd175200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1700cc350 con 0x7fd17015b910 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd175200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1700cc630 con 0x7fd17015bcf0 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16de00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd17015b910 0x7fd1700cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50616/0 (socket says 172.21.15.167:50616) 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16de00640 1 -- 172.21.15.167:0/2575323294 learned_addr learned my addr 172.21.15.167:0/2575323294 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16e800640 1 --2- 172.21.15.167:0/2575323294 >> v2:172.21.15.167:3300/0 conn(0x7fd17015bcf0 0x7fd170099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16e800640 1 -- 172.21.15.167:0/2575323294 >> v1:172.21.15.167:6789/0 conn(0x7fd17015b910 legacy=0x7fd1700cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.860 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16e800640 1 -- 172.21.15.167:0/2575323294 >> v1:172.21.15.18:6789/0 conn(0x7fd1700cf3c0 legacy=0x7fd1700cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.861 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16e800640 1 -- 172.21.15.167:0/2575323294 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700cc910 con 0x7fd17015bcf0 2024-04-25T10:03:31.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16e800640 1 --2- 172.21.15.167:0/2575323294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015bcf0 0x7fd170099a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd168009d90 tx=0x7fd16801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=376b71b3003e32e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:31.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.857+0000 7fd16d400640 1 -- 172.21.15.167:0/2575323294 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680b2070 con 0x7fd17015bcf0 2024-04-25T10:03:31.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd16d400640 1 -- 172.21.15.167:0/2575323294 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1680a5830 con 0x7fd17015bcf0 2024-04-25T10:03:31.863 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd16d400640 1 -- 172.21.15.167:0/2575323294 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1680a5c00 con 0x7fd17015bcf0 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- 172.21.15.167:0/2575323294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015bcf0 msgr2=0x7fd170099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 --2- 172.21.15.167:0/2575323294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015bcf0 0x7fd170099a60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd168009d90 tx=0x7fd16801c970 comp rx=0 tx=0).stop 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- 172.21.15.167:0/2575323294 shutdown_connections 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 --2- 172.21.15.167:0/2575323294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015bcf0 0x7fd170099a60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- 172.21.15.167:0/2575323294 >> 172.21.15.167:0/2575323294 conn(0x7fd1700b3200 msgr2=0x7fd1700b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:31.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- 172.21.15.167:0/2575323294 shutdown_connections 2024-04-25T10:03:31.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- 172.21.15.167:0/2575323294 wait complete. 2024-04-25T10:03:31.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 Processor -- start 2024-04-25T10:03:31.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- start start 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 0x7fd17014e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170169d40 con 0x7fd1700cf3c0 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd170169bc0 con 0x7fd17015b910 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd175200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd170169ec0 con 0x7fd17015bcf0 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd167e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd167e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59596/0 (socket says 172.21.15.167:59596) 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd16e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.861+0000 7fd167e00640 1 -- 172.21.15.167:0/1735239027 learned_addr learned my addr 172.21.15.167:0/1735239027 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16de00640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 0x7fd17014e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:31.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16e800640 1 -- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 msgr2=0x7fd170153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16e800640 1 -- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 msgr2=0x7fd170153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16e800640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16e800640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 -- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 msgr2=0x7fd170153ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 -- 172.21.15.167:0/1735239027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 msgr2=0x7fd17014e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 0x7fd17014e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 -- 172.21.15.167:0/1735239027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17014ee70 con 0x7fd17015b910 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd16de00640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 0x7fd17014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd167e00640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c430 tx=0x7fd15800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1580052d0 con 0x7fd17015b910 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd158005470 con 0x7fd17015b910 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd158007260 con 0x7fd17015b910 2024-04-25T10:03:31.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd17015a610 con 0x7fd17015b910 2024-04-25T10:03:31.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd17015abd0 con 0x7fd17015b910 2024-04-25T10:03:31.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd158007400 con 0x7fd17015b910 2024-04-25T10:03:31.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd158003ae0 con 0x7fd17015b910 2024-04-25T10:03:31.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.865+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1700745d0 con 0x7fd17015b910 2024-04-25T10:03:31.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.869+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd158003600 con 0x7fd17015b910 2024-04-25T10:03:31.884 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:31.881+0000 7f0d43a4d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:03:31.938 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.933+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ded92fa6-89b5-4a0f-94b2-eedcc08d53b4", "id": 0} v 0) v1 -- 0x7fd1700cdcd0 con 0x7fd17015b910 2024-04-25T10:03:31.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.937+0000 7fd166000640 1 -- 172.21.15.167:0/1735239027 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ded92fa6-89b5-4a0f-94b2-eedcc08d53b4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd158003d30 con 0x7fd17015b910 2024-04-25T10:03:31.943 INFO:teuthology.orchestra.run.smithi167.stdout:0 2024-04-25T10:03:31.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 msgr2=0x7fd170159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd15800c430 tx=0x7fd15800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 shutdown_connections 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd17015bcf0 0x7fd170153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd17015b910 0x7fd170159c30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 --2- 172.21.15.167:0/1735239027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1700cf3c0 0x7fd17014e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 >> 172.21.15.167:0/1735239027 conn(0x7fd1700b3200 msgr2=0x7fd1700736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 shutdown_connections 2024-04-25T10:03:31.945 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:31.941+0000 7fd175200640 1 -- 172.21.15.167:0/1735239027 wait complete. 2024-04-25T10:03:31.947 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:31.945+0000 7f0d43a4d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:03:31.962 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 37d53a35-01bd-4f95-97e5-6b0a283a06bf 1 2024-04-25T10:03:32.011 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.005+0000 7f0d43a4d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:03:32.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 Processor -- start 2024-04-25T10:03:32.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 -- start start 2024-04-25T10:03:32.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f489006fb00 0x7f489006fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 0x7f489006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900affe0 con 0x7f48900cc910 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4890070420 con 0x7f489015baa0 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4895c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900cd240 con 0x7f489006fb00 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f488ea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f489006fb00 0x7f489006fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f488ea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f489006fb00 0x7f489006fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59612/0 (socket says 172.21.15.167:59612) 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f488ea00640 1 -- 172.21.15.167:0/1973457958 learned_addr learned my addr 172.21.15.167:0/1973457958 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.093+0000 7f4887e00640 1 --2- 172.21.15.167:0/1973457958 >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 0x7f489006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488ea00640 1 -- 172.21.15.167:0/1973457958 >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 msgr2=0x7f489006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488ea00640 1 --2- 172.21.15.167:0/1973457958 >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 0x7f489006ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488ea00640 1 -- 172.21.15.167:0/1973457958 >> v1:172.21.15.167:6789/0 conn(0x7f48900cc910 legacy=0x7f489006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488ea00640 1 -- 172.21.15.167:0/1973457958 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900cd520 con 0x7f489006fb00 2024-04-25T10:03:32.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f4887e00640 1 --2- 172.21.15.167:0/1973457958 >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 0x7f489006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:32.102 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f0d43a4d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:03:32.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488ea00640 1 --2- 172.21.15.167:0/1973457958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f489006fee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48900b3300 tx=0x7f488001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e1ae44e769b9151 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488e000640 1 -- 172.21.15.167:0/1973457958 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800aa610 con 0x7f489006fb00 2024-04-25T10:03:32.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488e000640 1 -- 172.21.15.167:0/1973457958 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800af070 con 0x7f489006fb00 2024-04-25T10:03:32.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.097+0000 7f488e000640 1 -- 172.21.15.167:0/1973457958 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800aa9d0 con 0x7f489006fb00 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- 172.21.15.167:0/1973457958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 msgr2=0x7f489006fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- 172.21.15.167:0/1973457958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f489006fee0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48900b3300 tx=0x7f488001c4b0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- 172.21.15.167:0/1973457958 shutdown_connections 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- 172.21.15.167:0/1973457958 >> v2:172.21.15.18:3300/0 conn(0x7f489015baa0 0x7f489006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- 172.21.15.167:0/1973457958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f489006fee0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- 172.21.15.167:0/1973457958 >> 172.21.15.167:0/1973457958 conn(0x7f48900b2240 msgr2=0x7f48900b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- 172.21.15.167:0/1973457958 shutdown_connections 2024-04-25T10:03:32.104 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- 172.21.15.167:0/1973457958 wait complete. 2024-04-25T10:03:32.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 Processor -- start 2024-04-25T10:03:32.105 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- start start 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48900cc910 0x7f48901443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900ccfe0 con 0x7f48900cc910 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900cce60 con 0x7f489006fb00 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4895c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900b2f70 con 0x7f489015baa0 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59628/0 (socket says 172.21.15.167:59628) 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 -- 172.21.15.167:0/3611491351 learned_addr learned my addr 172.21.15.167:0/3611491351 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4887e00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48900cc910 0x7f48901443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.108 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488f400640 1 -- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 msgr2=0x7f489014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488f400640 1 -- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 msgr2=0x7f489014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488f400640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488f400640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 -- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 msgr2=0x7f489014fe20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 -- 172.21.15.167:0/3611491351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48900cc910 msgr2=0x7f48901443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48900cc910 0x7f48901443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 -- 172.21.15.167:0/3611491351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900ada20 con 0x7f489006fb00 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f488ea00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f488001a0e0 tx=0x7f488001acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.101+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800bd5f0 con 0x7f489006fb00 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48800bd790 con 0x7f489006fb00 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48900add00 con 0x7f489006fb00 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800bdb80 con 0x7f489006fb00 2024-04-25T10:03:32.109 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48900ae2c0 con 0x7f489006fb00 2024-04-25T10:03:32.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f48800b3780 con 0x7f489006fb00 2024-04-25T10:03:32.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f48800c78e0 con 0x7f489006fb00 2024-04-25T10:03:32.110 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.105+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900745d0 con 0x7f489006fb00 2024-04-25T10:03:32.113 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.109+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f48800c3060 con 0x7f489006fb00 2024-04-25T10:03:32.166 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.161+0000 7f0d43a4d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:03:32.179 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.173+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37d53a35-01bd-4f95-97e5-6b0a283a06bf", "id": 1} v 0) v1 -- 0x7f4890151f20 con 0x7f489006fb00 2024-04-25T10:03:32.183 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.177+0000 7f4886a00640 1 -- 172.21.15.167:0/3611491351 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37d53a35-01bd-4f95-97e5-6b0a283a06bf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48800a7070 con 0x7f489006fb00 2024-04-25T10:03:32.183 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 msgr2=0x7f48900aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f488001a0e0 tx=0x7f488001acf0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 shutdown_connections 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f489015baa0 0x7f489014fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48900cc910 0x7f48901443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 --2- 172.21.15.167:0/3611491351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f489006fb00 0x7f48900aeac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 >> 172.21.15.167:0/3611491351 conn(0x7f48900b2240 msgr2=0x7f4890159070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.185 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 shutdown_connections 2024-04-25T10:03:32.186 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.181+0000 7f4895c00640 1 -- 172.21.15.167:0/3611491351 wait complete. 2024-04-25T10:03:32.203 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 9a0cfc21-b322-437e-8aa8-7fbb11f154fd 2 2024-04-25T10:03:32.222 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.213+0000 7f4b370d3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T10:03:32.258 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.253+0000 7f0d43a4d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:03:32.287 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.277+0000 7f4b370d3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T10:03:32.321 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.317+0000 7f0d43a4d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:03:32.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.333+0000 7f2f48e00640 1 Processor -- start 2024-04-25T10:03:32.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.333+0000 7f2f48e00640 1 -- start start 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f48e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f4415dc00 0x7f2f440af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f48e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f48e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f440b30d0 con 0x7f2f440d0150 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f48e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f440cd860 con 0x7f2f4415dc00 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f48e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440ccf30 con 0x7f2f440c72a0 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f4415dc00 0x7f2f440af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f42800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2f4415dc00 0x7f2f440af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59634/0 (socket says 172.21.15.167:59634) 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 -- 172.21.15.167:0/3019006142 learned_addr learned my addr 172.21.15.167:0/3019006142 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f42800640 1 -- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f440c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f42800640 1 -- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f440c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f42800640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f42800640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 -- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f440c54b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 -- 172.21.15.167:0/3019006142 >> v1:172.21.15.18:6789/0 conn(0x7f2f440d0150 legacy=0x7f2f440c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f41e00640 1 -- 172.21.15.167:0/3019006142 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440cd210 con 0x7f2f4415dc00 2024-04-25T10:03:32.342 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.337+0000 7f2f40a00640 1 -- 172.21.15.167:0/3019006142 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406994748 0 0) 0x7f2f440b30d0 con 0x7f2f440d0150 2024-04-25T10:03:32.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f41e00640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4415dc00 0x7f2f440af770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009870 tx=0x7f2f3401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d71f3d3b2b81244 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f40a00640 1 -- 172.21.15.167:0/3019006142 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340b0070 con 0x7f2f4415dc00 2024-04-25T10:03:32.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f40a00640 1 -- 172.21.15.167:0/3019006142 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f340ab600 con 0x7f2f4415dc00 2024-04-25T10:03:32.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f40a00640 1 -- 172.21.15.167:0/3019006142 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340ab9d0 con 0x7f2f4415dc00 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4415dc00 msgr2=0x7f2f440af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4415dc00 0x7f2f440af770 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2f34009870 tx=0x7f2f3401c560 comp rx=0 tx=0).stop 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- 172.21.15.167:0/3019006142 shutdown_connections 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f440c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 --2- 172.21.15.167:0/3019006142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f4415dc00 0x7f2f440af770 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- 172.21.15.167:0/3019006142 >> 172.21.15.167:0/3019006142 conn(0x7f2f440b2240 msgr2=0x7f2f440b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.345 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- 172.21.15.167:0/3019006142 shutdown_connections 2024-04-25T10:03:32.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- 172.21.15.167:0/3019006142 wait complete. 2024-04-25T10:03:32.346 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 Processor -- start 2024-04-25T10:03:32.347 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.341+0000 7f2f48e00640 1 -- start start 2024-04-25T10:03:32.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.349 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 0x7f2f44140370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 0x7f2f44153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4416a640 con 0x7f2f4415dc00 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440cdf00 con 0x7f2f440d0150 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4416a7c0 con 0x7f2f440c72a0 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 0x7f2f44140370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39382/0 (socket says 172.21.15.167:39382) 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 -- 172.21.15.167:0/2793048169 learned_addr learned my addr 172.21.15.167:0/2793048169 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f42800640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 0x7f2f44153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 -- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f4414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 -- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f4414ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.350 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 -- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 msgr2=0x7f2f4414ff10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 -- 172.21.15.167:0/2793048169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 msgr2=0x7f2f44153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 0x7f2f44153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 -- 172.21.15.167:0/2793048169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f440b0060 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f42800640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 0x7f2f44153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f41400640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 0x7f2f44140370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c430 tx=0x7f2f3000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30017070 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30003600 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30003a30 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f440b0320 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f440b08e0 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2f3001a070 con 0x7f2f440d0150 2024-04-25T10:03:32.351 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2f3001c440 con 0x7f2f440d0150 2024-04-25T10:03:32.352 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.341+0000 7f4b370d3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T10:03:32.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.345+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f440745d0 con 0x7f2f440d0150 2024-04-25T10:03:32.352 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.349+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2f30021070 con 0x7f2f440d0150 2024-04-25T10:03:32.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.413+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9a0cfc21-b322-437e-8aa8-7fbb11f154fd", "id": 2} v 0) v1 -- 0x7f2f44066e50 con 0x7f2f440d0150 2024-04-25T10:03:32.422 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.417+0000 7f2f3a000640 1 -- 172.21.15.167:0/2793048169 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9a0cfc21-b322-437e-8aa8-7fbb11f154fd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f3001c740 con 0x7f2f440d0150 2024-04-25T10:03:32.422 INFO:teuthology.orchestra.run.smithi167.stdout:2 2024-04-25T10:03:32.423 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.417+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 msgr2=0x7f2f44140370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.417+0000 7f2f48e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 0x7f2f44140370 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c430 tx=0x7f2f3000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 shutdown_connections 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f4415dc00 0x7f2f44153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f440d0150 0x7f2f44140370 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 --2- 172.21.15.167:0/2793048169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f440c72a0 0x7f2f4414ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 >> 172.21.15.167:0/2793048169 conn(0x7f2f440b2240 msgr2=0x7f2f440b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 shutdown_connections 2024-04-25T10:03:32.424 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.421+0000 7f2f48e00640 1 -- 172.21.15.167:0/2793048169 wait complete. 2024-04-25T10:03:32.442 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new e415b1d8-f47a-475d-a5bc-11d1e79ea186 3 2024-04-25T10:03:32.444 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.437+0000 7f4b370d3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T10:03:32.497 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.493+0000 7f0d43a4d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:03:32.508 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.497+0000 7f4b370d3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T10:03:32.570 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:32.565+0000 7f0d43a4d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:03:32.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 Processor -- start 2024-04-25T10:03:32.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 -- start start 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f283c0703e0 0x7f283c070800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c070d40 con 0x7f283c0afd80 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c06ff50 con 0x7f283c0703e0 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2842000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b0160 con 0x7f283c0cf640 2024-04-25T10:03:32.579 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39390/0 (socket says 172.21.15.167:39390) 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 -- 172.21.15.167:0/591573647 learned_addr learned my addr 172.21.15.167:0/591573647 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 -- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 msgr2=0x7f283c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 -- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 msgr2=0x7f283c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283be00640 1 --2- 172.21.15.167:0/591573647 >> v2:172.21.15.18:3300/0 conn(0x7f283c0703e0 0x7f283c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f2833e00640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283aa00640 1 -- 172.21.15.167:0/591573647 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654137080 0 0) 0x7f283c070d40 con 0x7f283c0afd80 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283aa00640 1 -- 172.21.15.167:0/591573647 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2820003530 con 0x7f283c0afd80 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283be00640 1 -- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 msgr2=0x7f283c0cfac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283be00640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283be00640 1 -- 172.21.15.167:0/591573647 >> v1:172.21.15.167:6789/0 conn(0x7f283c0afd80 legacy=0x7f283c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.580 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.573+0000 7f283be00640 1 -- 172.21.15.167:0/591573647 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0cdaa0 con 0x7f283c0703e0 2024-04-25T10:03:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f283be00640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0703e0 0x7f283c070800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2834009d90 tx=0x7f283401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca48e0e24428074f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f283aa00640 1 -- 172.21.15.167:0/591573647 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340b2070 con 0x7f283c0703e0 2024-04-25T10:03:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f283aa00640 1 -- 172.21.15.167:0/591573647 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340a5a00 con 0x7f283c0703e0 2024-04-25T10:03:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f283aa00640 1 -- 172.21.15.167:0/591573647 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340a5dd0 con 0x7f283c0703e0 2024-04-25T10:03:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 -- 172.21.15.167:0/591573647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0703e0 msgr2=0x7f283c070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0703e0 0x7f283c070800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2834009d90 tx=0x7f283401c940 comp rx=0 tx=0).stop 2024-04-25T10:03:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 -- 172.21.15.167:0/591573647 shutdown_connections 2024-04-25T10:03:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0703e0 0x7f283c070800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 --2- 172.21.15.167:0/591573647 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0cf640 0x7f283c0cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 -- 172.21.15.167:0/591573647 >> 172.21.15.167:0/591573647 conn(0x7f283c0b2400 msgr2=0x7f283c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 -- 172.21.15.167:0/591573647 shutdown_connections 2024-04-25T10:03:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.577+0000 7f2842000640 1 -- 172.21.15.167:0/591573647 wait complete. 2024-04-25T10:03:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 Processor -- start 2024-04-25T10:03:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 -- start start 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0afd80 0x7f283c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 0x7f283c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0cd6f0 con 0x7f283c0afd80 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c15bfd0 con 0x7f283c0cf640 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b5850 con 0x7f283c0703e0 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 0x7f283c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39400/0 (socket says 172.21.15.167:39400) 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 -- 172.21.15.167:0/1213438523 learned_addr learned my addr 172.21.15.167:0/1213438523 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.588 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2833e00640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0afd80 0x7f283c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 -- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 msgr2=0x7f283c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 -- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 msgr2=0x7f283c0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283b400640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 -- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 msgr2=0x7f283c0b5310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 -- 172.21.15.167:0/1213438523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0afd80 msgr2=0x7f283c14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0afd80 0x7f283c14ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 -- 172.21.15.167:0/1213438523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c151380 con 0x7f283c0cf640 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f283be00640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 0x7f283c0b03d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f28340ac000 tx=0x7f28340196e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340b2050 con 0x7f283c0cf640 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28340b3040 con 0x7f283c0cf640 2024-04-25T10:03:32.589 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28340ad850 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.581+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c14b7c0 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.585+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c0b3d60 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.585+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f28340c0020 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.585+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f28340a5980 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.585+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c0745d0 con 0x7f283c0cf640 2024-04-25T10:03:32.590 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.585+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f283c14b7c0 con 0x7f283c0cf640 2024-04-25T10:03:32.601 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.593+0000 7f4b370d3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T10:03:32.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.653+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e415b1d8-f47a-475d-a5bc-11d1e79ea186", "id": 3} v 0) v1 -- 0x7f283c0b2190 con 0x7f283c0cf640 2024-04-25T10:03:32.661 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2833400640 1 -- 172.21.15.167:0/1213438523 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e415b1d8-f47a-475d-a5bc-11d1e79ea186", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2834016560 con 0x7f283c0cf640 2024-04-25T10:03:32.661 INFO:teuthology.orchestra.run.smithi167.stdout:3 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 msgr2=0x7f283c0b03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 0x7f283c0b03d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f28340ac000 tx=0x7f28340196e0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 shutdown_connections 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f283c0cf640 0x7f283c0b03d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c0afd80 0x7f283c14ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 --2- 172.21.15.167:0/1213438523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f283c0703e0 0x7f283c0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 >> 172.21.15.167:0/1213438523 conn(0x7f283c0b2400 msgr2=0x7f283c155270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.662 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 shutdown_connections 2024-04-25T10:03:32.663 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.657+0000 7f2842000640 1 -- 172.21.15.167:0/1213438523 wait complete. 2024-04-25T10:03:32.666 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.657+0000 7f4b370d3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T10:03:32.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 32851e3b-94b6-44ba-9111-dec866d36827 4 2024-04-25T10:03:32.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.809+0000 7efe6cc00640 1 Processor -- start 2024-04-25T10:03:32.815 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.809+0000 7efe6cc00640 1 -- start start 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe6cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe68159320 0x7efe6815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe6cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe6cc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6815fc00 con 0x7efe6815f440 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe6cc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6806ee50 con 0x7efe68159320 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe6cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6806d640 con 0x7efe6806e4a0 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39402/0 (socket says 172.21.15.167:39402) 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 -- 172.21.15.167:0/3351752418 learned_addr learned my addr 172.21.15.167:0/3351752418 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe65e00640 1 --2- 172.21.15.167:0/3351752418 >> v2:172.21.15.18:3300/0 conn(0x7efe68159320 0x7efe6815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 -- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 msgr2=0x7efe6806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 -- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 msgr2=0x7efe6806e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:32.817 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe66800640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe65e00640 1 -- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 msgr2=0x7efe6806e910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe65e00640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe65e00640 1 -- 172.21.15.167:0/3351752418 >> v1:172.21.15.18:6789/0 conn(0x7efe6815f440 legacy=0x7efe6806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe65e00640 1 -- 172.21.15.167:0/3351752418 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6815fee0 con 0x7efe68159320 2024-04-25T10:03:32.818 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.813+0000 7efe64a00640 1 -- 172.21.15.167:0/3351752418 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624487053 0 0) 0x7efe6815fc00 con 0x7efe6815f440 2024-04-25T10:03:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe65e00640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe68159320 0x7efe6815c9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe580097c0 tx=0x7efe5801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1462655ebe514106 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe64a00640 1 -- 172.21.15.167:0/3351752418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580b1070 con 0x7efe68159320 2024-04-25T10:03:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe64a00640 1 -- 172.21.15.167:0/3351752418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580a8050 con 0x7efe68159320 2024-04-25T10:03:32.820 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe64a00640 1 -- 172.21.15.167:0/3351752418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580ac860 con 0x7efe68159320 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- 172.21.15.167:0/3351752418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe68159320 msgr2=0x7efe6815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe68159320 0x7efe6815c9b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efe580097c0 tx=0x7efe5801c3e0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- 172.21.15.167:0/3351752418 shutdown_connections 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6806e4a0 0x7efe6806e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 --2- 172.21.15.167:0/3351752418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe68159320 0x7efe6815c9b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- 172.21.15.167:0/3351752418 >> 172.21.15.167:0/3351752418 conn(0x7efe68067080 msgr2=0x7efe6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.821 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- 172.21.15.167:0/3351752418 shutdown_connections 2024-04-25T10:03:32.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- 172.21.15.167:0/3351752418 wait complete. 2024-04-25T10:03:32.822 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 Processor -- start 2024-04-25T10:03:32.823 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.817+0000 7efe6cc00640 1 -- start start 2024-04-25T10:03:32.825 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6815f440 0x7efe680ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815f860 con 0x7efe6815f440 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68159700 con 0x7efe6806e4a0 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6815f9e0 con 0x7efe68159320 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59652/0 (socket says 172.21.15.167:59652) 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 -- 172.21.15.167:0/2549577963 learned_addr learned my addr 172.21.15.167:0/2549577963 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe66800640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6815f440 0x7efe680ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65400640 1 -- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 msgr2=0x7efe680cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65400640 1 -- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 msgr2=0x7efe680cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:32.826 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65400640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65400640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 -- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 msgr2=0x7efe680cc860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 -- 172.21.15.167:0/2549577963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6815f440 msgr2=0x7efe680ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6815f440 0x7efe680ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 -- 172.21.15.167:0/2549577963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68138f90 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe65e00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe580097c0 tx=0x7efe5801ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580bc070 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58004020 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580b1040 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe68139270 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe68157f90 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efe580039b0 con 0x7efe6806e4a0 2024-04-25T10:03:32.827 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efe580b7c00 con 0x7efe6806e4a0 2024-04-25T10:03:32.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.821+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe680745d0 con 0x7efe6806e4a0 2024-04-25T10:03:32.828 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.825+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efe58016090 con 0x7efe6806e4a0 2024-04-25T10:03:32.840 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.833+0000 7f4b370d3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T10:03:32.898 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.893+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "32851e3b-94b6-44ba-9111-dec866d36827", "id": 4} v 0) v1 -- 0x7efe68139790 con 0x7efe6806e4a0 2024-04-25T10:03:32.906 INFO:teuthology.orchestra.run.smithi167.stdout:4 2024-04-25T10:03:32.907 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.901+0000 7efe5e000640 1 -- 172.21.15.167:0/2549577963 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "32851e3b-94b6-44ba-9111-dec866d36827", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe58003d90 con 0x7efe6806e4a0 2024-04-25T10:03:32.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 msgr2=0x7efe68157a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:32.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7efe580097c0 tx=0x7efe5801ac20 comp rx=0 tx=0).stop 2024-04-25T10:03:32.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 shutdown_connections 2024-04-25T10:03:32.908 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6815f440 0x7efe680ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe68159320 0x7efe680cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 --2- 172.21.15.167:0/2549577963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe6806e4a0 0x7efe68157a50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:32.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 >> 172.21.15.167:0/2549577963 conn(0x7efe68067080 msgr2=0x7efe6815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:32.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 shutdown_connections 2024-04-25T10:03:32.909 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:32.905+0000 7efe6cc00640 1 -- 172.21.15.167:0/2549577963 wait complete. 2024-04-25T10:03:32.915 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:32.905+0000 7f4b370d3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T10:03:32.937 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new c36ec405-aedc-4bce-b127-bea820d45e0c 5 2024-04-25T10:03:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 Processor -- start 2024-04-25T10:03:33.086 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 -- start start 2024-04-25T10:03:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe280af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe280c72a0 0x7efe280c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe280b30d0 con 0x7efe2815dc00 2024-04-25T10:03:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe280cd860 con 0x7efe280c72a0 2024-04-25T10:03:33.089 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe280ccf30 con 0x7efe280d0150 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efe2815dc00 0x7efe280c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50646/0 (socket says 172.21.15.167:50646) 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27e00640 1 -- 172.21.15.167:0/48083367 learned_addr learned my addr 172.21.15.167:0/48083367 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27400640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe280af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27400640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 msgr2=0x7efe280af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27400640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 msgr2=0x7efe280af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27400640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe280af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> v2:172.21.15.18:3300/0 conn(0x7efe280c72a0 0x7efe280c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.081+0000 7efe27400640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe280af770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4020183520 0 0) 0x7efe280b30d0 con 0x7efe2815dc00 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe0c003530 con 0x7efe2815dc00 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 885205506 0 0) 0x7efe0c003530 con 0x7efe2815dc00 2024-04-25T10:03:33.090 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 msgr2=0x7efe280af770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe280af770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 >> v2:172.21.15.18:3300/0 conn(0x7efe280c72a0 msgr2=0x7efe280c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 --2- 172.21.15.167:0/48083367 >> v2:172.21.15.18:3300/0 conn(0x7efe280c72a0 0x7efe280c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe280cd210 con 0x7efe2815dc00 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7efe18001680 con 0x7efe2815dc00 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> v2:172.21.15.18:3300/0 conn(0x7efe280c72a0 0x7efe280c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 >> v1:172.21.15.167:6789/0 conn(0x7efe2815dc00 legacy=0x7efe280c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c0039c0 0x7efe0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe0c004d50 0x7efe0c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280cd860 con 0x7efe0c0039c0 2024-04-25T10:03:33.091 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280ccf30 con 0x7efe0c004d50 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0c00b9d0 con 0x7efe280d0150 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe27400640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe0c004d50 0x7efe0c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe27e00640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c0039c0 0x7efe0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 msgr2=0x7efe0c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe280d0150 0x7efe0c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c0039c0 msgr2=0x7efe0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c0039c0 0x7efe0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.092 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.085+0000 7efe2d200640 1 -- 172.21.15.167:0/48083367 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c003530 con 0x7efe0c004d50 2024-04-25T10:03:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2d200640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe0c004d50 0x7efe0c0051d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe2806cb40 tx=0x7efe2001ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8fc3f506d7c411 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.093 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200b2070 con 0x7efe0c004d50 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200a5950 con 0x7efe0c004d50 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe26a00640 1 -- 172.21.15.167:0/48083367 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20009de0 con 0x7efe0c004d50 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe0c004d50 msgr2=0x7efe0c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 --2- 172.21.15.167:0/48083367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe0c004d50 0x7efe0c0051d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efe2806cb40 tx=0x7efe2001ce20 comp rx=0 tx=0).stop 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2d200640 1 -- 172.21.15.167:0/48083367 reap_dead start 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- 172.21.15.167:0/48083367 shutdown_connections 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- 172.21.15.167:0/48083367 >> 172.21.15.167:0/48083367 conn(0x7efe280b2240 msgr2=0x7efe280b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- 172.21.15.167:0/48083367 shutdown_connections 2024-04-25T10:03:33.094 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- 172.21.15.167:0/48083367 wait complete. 2024-04-25T10:03:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 Processor -- start 2024-04-25T10:03:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- start start 2024-04-25T10:03:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c004d50 0x7efe28143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.097 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe28168630 con 0x7efe0c004d50 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280cdee0 con 0x7efe28143a80 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe281687b0 con 0x7efe2815e2d0 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe27400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe27400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59672/0 (socket says 172.21.15.167:59672) 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe27400640 1 -- 172.21.15.167:0/3227767534 learned_addr learned my addr 172.21.15.167:0/3227767534 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.089+0000 7efe2d200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27e00640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c004d50 0x7efe28143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2d200640 1 -- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 msgr2=0x7efe280b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2d200640 1 -- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 msgr2=0x7efe280b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2d200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2d200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.098 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 -- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 msgr2=0x7efe280b4410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 -- 172.21.15.167:0/3227767534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c004d50 msgr2=0x7efe28143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c004d50 0x7efe28143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 -- 172.21.15.167:0/3227767534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2815b4a0 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe27400640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe14011660 tx=0x7efe14011a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1400f040 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14004230 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14015690 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2815b780 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2815bd40 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7efe14015bc0 con 0x7efe28143a80 2024-04-25T10:03:33.099 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7efe1401dbf0 con 0x7efe28143a80 2024-04-25T10:03:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.093+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2806ccb0 con 0x7efe28143a80 2024-04-25T10:03:33.100 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.097+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7efe14019020 con 0x7efe28143a80 2024-04-25T10:03:33.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.165+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c36ec405-aedc-4bce-b127-bea820d45e0c", "id": 5} v 0) v1 -- 0x7efe280745d0 con 0x7efe28143a80 2024-04-25T10:03:33.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe1fe00640 1 -- 172.21.15.167:0/3227767534 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c36ec405-aedc-4bce-b127-bea820d45e0c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe1401d670 con 0x7efe28143a80 2024-04-25T10:03:33.173 INFO:teuthology.orchestra.run.smithi167.stdout:5 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 msgr2=0x7efe28159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7efe14011660 tx=0x7efe14011a60 comp rx=0 tx=0).stop 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 shutdown_connections 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe2815e2d0 0x7efe280b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe28143a80 0x7efe28159570 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 --2- 172.21.15.167:0/3227767534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe0c004d50 0x7efe28143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 >> 172.21.15.167:0/3227767534 conn(0x7efe280b2240 msgr2=0x7efe280b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 shutdown_connections 2024-04-25T10:03:33.174 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.169+0000 7efe2f200640 1 -- 172.21.15.167:0/3227767534 wait complete. 2024-04-25T10:03:33.191 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new ac562c5c-eae4-4f83-b74d-95012a53dac5 6 2024-04-25T10:03:33.247 INFO:tasks.ceph.mgr.x.smithi167.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T10:03:33.247 INFO:tasks.ceph.mgr.x.smithi167.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T10:03:33.247 INFO:tasks.ceph.mgr.x.smithi167.stderr: from numpy import show_config as show_numpy_config 2024-04-25T10:03:33.294 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:33.289+0000 7f0d43a4d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:03:33.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.321+0000 7fdf39c00640 1 Processor -- start 2024-04-25T10:03:33.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.321+0000 7fdf39c00640 1 -- start start 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf39c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdf340701d0 0x7fdf341616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf39c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdf340aec50 0x7fdf34161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf39c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf340af480 con 0x7fdf3415db00 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf39c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf340b4e80 con 0x7fdf340aec50 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf39c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3415dee0 con 0x7fdf340701d0 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fdf3415db00 0x7fdf340b2e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.167:50656/0 (socket says 172.21.15.167:50656) 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32a00640 1 -- 172.21.15.167:0/2347060052 learned_addr learned my addr 172.21.15.167:0/2347060052 (peer_addr_for_me v1:172.21.15.167:0/0) 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdf340701d0 0x7fdf341616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf33400640 1 --2- 172.21.15.167:0/2347060052 >> v2:172.21.15.18:3300/0 conn(0x7fdf340aec50 0x7fdf34161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32000640 1 -- 172.21.15.167:0/2347060052 >> v2:172.21.15.18:3300/0 conn(0x7fdf340aec50 msgr2=0x7fdf34161be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:33.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32000640 1 --2- 172.21.15.167:0/2347060052 >> v2:172.21.15.18:3300/0 conn(0x7fdf340aec50 0x7fdf34161be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32000640 1 -- 172.21.15.167:0/2347060052 >> v1:172.21.15.167:6789/0 conn(0x7fdf3415db00 legacy=0x7fdf340b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.325+0000 7fdf32000640 1 -- 172.21.15.167:0/2347060052 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf340af1a0 con 0x7fdf340701d0 2024-04-25T10:03:33.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf32000640 1 --2- 172.21.15.167:0/2347060052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf340701d0 0x7fdf341616a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf34161600 tx=0x7fdf2001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=914248ec687c7a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf31600640 1 -- 172.21.15.167:0/2347060052 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200ab650 con 0x7fdf340701d0 2024-04-25T10:03:33.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf31600640 1 -- 172.21.15.167:0/2347060052 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf200b0070 con 0x7fdf340701d0 2024-04-25T10:03:33.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf31600640 1 -- 172.21.15.167:0/2347060052 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf200aba10 con 0x7fdf340701d0 2024-04-25T10:03:33.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- 172.21.15.167:0/2347060052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf340701d0 msgr2=0x7fdf341616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 --2- 172.21.15.167:0/2347060052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf340701d0 0x7fdf341616a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fdf34161600 tx=0x7fdf2001c450 comp rx=0 tx=0).stop 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- 172.21.15.167:0/2347060052 shutdown_connections 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 --2- 172.21.15.167:0/2347060052 >> v2:172.21.15.18:3300/0 conn(0x7fdf340aec50 0x7fdf34161be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 --2- 172.21.15.167:0/2347060052 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf340701d0 0x7fdf341616a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- 172.21.15.167:0/2347060052 >> 172.21.15.167:0/2347060052 conn(0x7fdf340cc830 msgr2=0x7fdf340ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- 172.21.15.167:0/2347060052 shutdown_connections 2024-04-25T10:03:33.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- 172.21.15.167:0/2347060052 wait complete. 2024-04-25T10:03:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 Processor -- start 2024-04-25T10:03:33.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.329+0000 7fdf39c00640 1 -- start start 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf340aec50 0x7fdf34160800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340ad730 con 0x7fdf340aec50 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf340ad5b0 con 0x7fdf3415db00 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3416aa40 con 0x7fdf340701d0 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.338 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59684/0 (socket says 172.21.15.167:59684) 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 -- 172.21.15.167:0/481201551 learned_addr learned my addr 172.21.15.167:0/481201551 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39464/0 (socket says 172.21.15.167:39464) 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32000640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf340aec50 0x7fdf34160800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 -- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 msgr2=0x7fdf3415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 -- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 msgr2=0x7fdf3415cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf32a00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 -- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 msgr2=0x7fdf3415cd30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 -- 172.21.15.167:0/481201551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf340aec50 msgr2=0x7fdf34160800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf340aec50 0x7fdf34160800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 -- 172.21.15.167:0/481201551 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3415eec0 con 0x7fdf3415db00 2024-04-25T10:03:33.339 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf33400640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009d30 tx=0x7fdf2c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c018020 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c014480 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c014870 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3415f1a0 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3406f940 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fdf2c01b020 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fdf2c0139d0 con 0x7fdf3415db00 2024-04-25T10:03:33.340 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.333+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf340745d0 con 0x7fdf3415db00 2024-04-25T10:03:33.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.337+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fdf2c022070 con 0x7fdf3415db00 2024-04-25T10:03:33.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.401+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ac562c5c-eae4-4f83-b74d-95012a53dac5", "id": 6} v 0) v1 -- 0x7fdf340cc1d0 con 0x7fdf3415db00 2024-04-25T10:03:33.417 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf2aa00640 1 -- 172.21.15.167:0/481201551 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac562c5c-eae4-4f83-b74d-95012a53dac5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdf2c010040 con 0x7fdf3415db00 2024-04-25T10:03:33.417 INFO:teuthology.orchestra.run.smithi167.stdout:6 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 msgr2=0x7fdf3414b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009d30 tx=0x7fdf2c00c490 comp rx=0 tx=0).stop 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 shutdown_connections 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3415db00 0x7fdf3414b700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf340aec50 0x7fdf34160800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.418 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 --2- 172.21.15.167:0/481201551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf340701d0 0x7fdf3415cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 >> 172.21.15.167:0/481201551 conn(0x7fdf340cc830 msgr2=0x7fdf340b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 shutdown_connections 2024-04-25T10:03:33.419 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.413+0000 7fdf39c00640 1 -- 172.21.15.167:0/481201551 wait complete. 2024-04-25T10:03:33.436 DEBUG:teuthology.orchestra.run.smithi167:> sudo ceph --cluster ceph osd new 9e79e5c0-55e4-45ed-870d-b98b12aadfbb 7 2024-04-25T10:03:33.450 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:33.445+0000 7f0d43a4d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:03:33.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.565+0000 7fd494a00640 1 Processor -- start 2024-04-25T10:03:33.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.565+0000 7fd494a00640 1 -- start start 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd49015db00 0x7fd4900b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4900aec50 0x7fd490161be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4900b4e80 con 0x7fd49015db00 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4900af480 con 0x7fd4900aec50 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd494a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49015dee0 con 0x7fd4900701d0 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4900aec50 0x7fd490161be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.167:39470/0 (socket says 172.21.15.167:39470) 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 -- 172.21.15.167:0/1373138475 learned_addr learned my addr 172.21.15.167:0/1373138475 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48de00640 1 --2- 172.21.15.167:0/1373138475 >> v2:172.21.15.18:3300/0 conn(0x7fd49015db00 0x7fd4900b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 -- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 msgr2=0x7fd4901616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 -- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 msgr2=0x7fd4901616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd487e00640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 -- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 msgr2=0x7fd4901616a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 -- 172.21.15.167:0/1373138475 >> v2:172.21.15.18:3300/0 conn(0x7fd49015db00 msgr2=0x7fd4900b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 --2- 172.21.15.167:0/1373138475 >> v2:172.21.15.18:3300/0 conn(0x7fd49015db00 0x7fd4900b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.569+0000 7fd48e800640 1 -- 172.21.15.167:0/1373138475 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4900af1a0 con 0x7fd4900aec50 2024-04-25T10:03:33.575 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd48e800640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900aec50 0x7fd490161be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4900aebe0 tx=0x7fd48801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65a28ef310255bbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd48d400640 1 -- 172.21.15.167:0/1373138475 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880b2070 con 0x7fd4900aec50 2024-04-25T10:03:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd48d400640 1 -- 172.21.15.167:0/1373138475 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4880a5980 con 0x7fd4900aec50 2024-04-25T10:03:33.576 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd48d400640 1 -- 172.21.15.167:0/1373138475 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4880a5d50 con 0x7fd4900aec50 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900aec50 msgr2=0x7fd490161be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900aec50 0x7fd490161be0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd4900aebe0 tx=0x7fd48801c900 comp rx=0 tx=0).stop 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- 172.21.15.167:0/1373138475 shutdown_connections 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900aec50 0x7fd490161be0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 --2- 172.21.15.167:0/1373138475 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900701d0 0x7fd4901616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 --2- 172.21.15.167:0/1373138475 >> v2:172.21.15.18:3300/0 conn(0x7fd49015db00 0x7fd4900b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- 172.21.15.167:0/1373138475 >> 172.21.15.167:0/1373138475 conn(0x7fd4900cc830 msgr2=0x7fd4900ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- 172.21.15.167:0/1373138475 shutdown_connections 2024-04-25T10:03:33.577 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- 172.21.15.167:0/1373138475 wait complete. 2024-04-25T10:03:33.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 Processor -- start 2024-04-25T10:03:33.578 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.573+0000 7fd494a00640 1 -- start start 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd49015db00 0x7fd490071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4900ad5b0 con 0x7fd49015db00 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd490162550 con 0x7fd4900701d0 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4900ad730 con 0x7fd4900aec50 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:59688/0 (socket says 172.21.15.167:59688) 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 -- 172.21.15.167:0/1093311930 learned_addr learned my addr 172.21.15.167:0/1093311930 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-04-25T10:03:33.581 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd487e00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd487e00640 1 -- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 msgr2=0x7fd49015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd487e00640 1 -- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 msgr2=0x7fd49015eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd487e00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd487e00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 -- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 msgr2=0x7fd49015eaa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 -- 172.21.15.167:0/1093311930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd49015db00 msgr2=0x7fd490071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd49015db00 0x7fd490071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 -- 172.21.15.167:0/1093311930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49014b790 con 0x7fd4900701d0 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd48de00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd48000e8a0 tx=0x7fd48000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd480017070 con 0x7fd4900701d0 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48000c940 con 0x7fd4900701d0 2024-04-25T10:03:33.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48000ccf0 con 0x7fd4900701d0 2024-04-25T10:03:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49014ba70 con 0x7fd4900701d0 2024-04-25T10:03:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49014c030 con 0x7fd4900701d0 2024-04-25T10:03:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd48001a070 con 0x7fd4900701d0 2024-04-25T10:03:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fd480013ad0 con 0x7fd4900701d0 2024-04-25T10:03:33.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.577+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4900745d0 con 0x7fd4900701d0 2024-04-25T10:03:33.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.581+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd480013470 con 0x7fd4900701d0 2024-04-25T10:03:33.636 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:33.633+0000 7f0d43a4d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:03:33.650 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.645+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9e79e5c0-55e4-45ed-870d-b98b12aadfbb", "id": 7} v 0) v1 -- 0x7fd490153b90 con 0x7fd4900701d0 2024-04-25T10:03:33.656 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd486000640 1 -- 172.21.15.167:0/1093311930 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e79e5c0-55e4-45ed-870d-b98b12aadfbb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd480013650 con 0x7fd4900701d0 2024-04-25T10:03:33.656 INFO:teuthology.orchestra.run.smithi167.stdout:7 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 msgr2=0x7fd49014af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd48000e8a0 tx=0x7fd48000eca0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 shutdown_connections 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd49015db00 0x7fd490071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4900aec50 0x7fd49015eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.657 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 --2- 172.21.15.167:0/1093311930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4900701d0 0x7fd49014af40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 >> 172.21.15.167:0/1093311930 conn(0x7fd4900cc830 msgr2=0x7fd4900b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 shutdown_connections 2024-04-25T10:03:33.658 INFO:teuthology.orchestra.run.smithi167.stderr:2024-04-25T10:03:33.653+0000 7fd494a00640 1 -- 172.21.15.167:0/1093311930 wait complete. 2024-04-25T10:03:33.677 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T10:03:33.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T10:03:33.680 INFO:tasks.ceph.osd.0:Started 2024-04-25T10:03:33.681 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T10:03:33.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T10:03:33.681 INFO:tasks.ceph.mgr.y.smithi018.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T10:03:33.682 INFO:tasks.ceph.mgr.y.smithi018.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T10:03:33.682 INFO:tasks.ceph.mgr.y.smithi018.stderr: from numpy import show_config as show_numpy_config 2024-04-25T10:03:33.686 INFO:tasks.ceph.osd.1:Started 2024-04-25T10:03:33.687 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T10:03:33.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T10:03:33.690 INFO:tasks.ceph.osd.2:Started 2024-04-25T10:03:33.690 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T10:03:33.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T10:03:33.693 INFO:tasks.ceph.osd.3:Started 2024-04-25T10:03:33.694 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T10:03:33.694 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T10:03:33.712 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:33.709+0000 7f0d43a4d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:03:33.714 INFO:tasks.ceph.osd.4:Started 2024-04-25T10:03:33.715 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T10:03:33.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T10:03:33.718 INFO:tasks.ceph.osd.5:Started 2024-04-25T10:03:33.718 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T10:03:33.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T10:03:33.721 INFO:tasks.ceph.osd.6:Started 2024-04-25T10:03:33.721 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T10:03:33.721 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T10:03:33.727 INFO:tasks.ceph.osd.7:Started 2024-04-25T10:03:33.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:33.770 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:33.761+0000 7f4b370d3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T10:03:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.881+0000 7f0061200640 1 Processor -- start 2024-04-25T10:03:33.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.881+0000 7f0061200640 1 -- start start 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0061200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f005c0cc260 0x7f005c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0061200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c15c1f0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0061200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c15c4d0 con 0x7f005c15b890 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0061200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c15c7b0 con 0x7f005c0cc260 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f005c0ae6d0 0x7f005c06e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59008/0 (socket says 172.21.15.18:59008) 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005be00640 1 -- 172.21.15.18:0/1012612865 learned_addr learned my addr 172.21.15.18:0/1012612865 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:33.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0053e00640 1 --2- 172.21.15.18:0/1012612865 >> v2:172.21.15.167:3300/0 conn(0x7f005c0cc260 0x7f005c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3600691517 0 0) 0x7f005c15c1f0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0040003530 con 0x7f005c0ae6d0 2024-04-25T10:03:33.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059197585 0 0) 0x7f005c15c4d0 con 0x7f005c15b890 2024-04-25T10:03:33.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c15c1f0 con 0x7f005c15b890 2024-04-25T10:03:33.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0053e00640 1 -- 172.21.15.18:0/1012612865 >> v1:172.21.15.167:6789/0 conn(0x7f005c15b890 legacy=0x7f005c0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0053e00640 1 -- 172.21.15.18:0/1012612865 >> v1:172.21.15.18:6789/0 conn(0x7f005c0ae6d0 legacy=0x7f005c06e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.885+0000 7f0053e00640 1 -- 172.21.15.18:0/1012612865 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c15ca90 con 0x7f005c0cc260 2024-04-25T10:03:33.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0053e00640 1 --2- 172.21.15.18:0/1012612865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c06db10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00440097c0 tx=0x7f005c06ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a94bf472ce0ec07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440aa5f0 con 0x7f005c0cc260 2024-04-25T10:03:33.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440af070 con 0x7f005c0cc260 2024-04-25T10:03:33.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f005aa00640 1 -- 172.21.15.18:0/1012612865 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440aa9b0 con 0x7f005c0cc260 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- 172.21.15.18:0/1012612865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 msgr2=0x7f005c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 --2- 172.21.15.18:0/1012612865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c06db10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00440097c0 tx=0x7f005c06ef70 comp rx=0 tx=0).stop 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- 172.21.15.18:0/1012612865 shutdown_connections 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 --2- 172.21.15.18:0/1012612865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c06db10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- 172.21.15.18:0/1012612865 >> 172.21.15.18:0/1012612865 conn(0x7f005c0726f0 msgr2=0x7f005c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- 172.21.15.18:0/1012612865 shutdown_connections 2024-04-25T10:03:33.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- 172.21.15.18:0/1012612865 wait complete. 2024-04-25T10:03:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 Processor -- start 2024-04-25T10:03:33.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.889+0000 7f0061200640 1 -- start start 2024-04-25T10:03:33.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c1699d0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c169850 con 0x7f005c0cc260 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c169b50 con 0x7f005c15b890 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46598/0 (socket says 172.21.15.18:46598) 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 -- 172.21.15.18:0/1729802682 learned_addr learned my addr 172.21.15.18:0/1729802682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005be00640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005be00640 1 -- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 msgr2=0x7f005c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005be00640 1 -- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 msgr2=0x7f005c148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005be00640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005be00640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:33.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 -- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 msgr2=0x7f005c148ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 -- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 msgr2=0x7f005c157e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c157e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 -- 172.21.15.18:0/1729802682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c15b110 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f005b400640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c430 tx=0x7f004c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c017070 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c0052f0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c09d760 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c003840 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c152490 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f004c01a070 con 0x7f005c0ae6d0 2024-04-25T10:03:33.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f004c011c20 con 0x7f005c0ae6d0 2024-04-25T10:03:33.905 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:33.897+0000 7f0d43a4d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:03:33.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.893+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c04efa0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.897+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f004c021020 con 0x7f005c0ae6d0 2024-04-25T10:03:33.949 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:33.941+0000 7f4b370d3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:03:33.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.969+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f005c0af7f0 con 0x7f005c0ae6d0 2024-04-25T10:03:33.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.969+0000 7f0053400640 1 -- 172.21.15.18:0/1729802682 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f004c011590 con 0x7f005c0ae6d0 2024-04-25T10:03:33.979 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:33.979 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:33.647166+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:33.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 msgr2=0x7f005c09d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:33.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f004c00c430 tx=0x7f004c00c8f0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 shutdown_connections 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f005c15b890 0x7f005c148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f005c0cc260 0x7f005c157e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 --2- 172.21.15.18:0/1729802682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c0ae6d0 0x7f005c09d0d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 >> 172.21.15.18:0/1729802682 conn(0x7f005c0726f0 msgr2=0x7f005c0afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 shutdown_connections 2024-04-25T10:03:33.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:33.973+0000 7f0061200640 1 -- 172.21.15.18:0/1729802682 wait complete. 2024-04-25T10:03:34.000 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T10:03:34.000 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T10:03:34.133 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:34.125+0000 7f4b370d3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T10:03:34.210 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:34.201+0000 7f4b370d3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T10:03:34.329 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-25T10:03:34.321+0000 7fba053c27c0 -1 Falling back to public interface 2024-04-25T10:03:34.345 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-25T10:03:34.337+0000 7f83422a97c0 -1 Falling back to public interface 2024-04-25T10:03:34.353 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-25T10:03:34.345+0000 7f6116eab7c0 -1 Falling back to public interface 2024-04-25T10:03:34.353 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-25T10:03:34.345+0000 7f44432b67c0 -1 Falling back to public interface 2024-04-25T10:03:34.373 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T10:03:34.369+0000 7f688585b7c0 -1 Falling back to public interface 2024-04-25T10:03:34.376 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:34.369+0000 7f4b370d3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T10:03:34.393 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T10:03:34.389+0000 7fd8ddb9d7c0 -1 Falling back to public interface 2024-04-25T10:03:34.393 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T10:03:34.389+0000 7fa4627a77c0 -1 Falling back to public interface 2024-04-25T10:03:34.408 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T10:03:34.405+0000 7fd13a9ab7c0 -1 Falling back to public interface 2024-04-25T10:03:34.607 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:34.601+0000 7f0d43a4d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:03:34.693 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:34.689+0000 7f0d43a4d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:03:34.807 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:34.894 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:34.889+0000 7f0d43a4d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:03:34.938 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 Processor -- start 2024-04-25T10:03:34.938 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 -- start start 2024-04-25T10:03:34.939 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ac815db00 0x7f3ac80b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ac806d310 0x7f3ac80b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac80b4620 0x7f3ac815e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac806f1c0 con 0x7f3ac806d310 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac80b4a20 con 0x7f3ac815db00 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ace400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80b2d80 con 0x7f3ac80b4620 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ac806d310 0x7f3ac80b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ac806d310 0x7f3ac80b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46602/0 (socket says 172.21.15.18:46602) 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 -- 172.21.15.18:0/272885554 learned_addr learned my addr 172.21.15.18:0/272885554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ac7e00640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac80b4620 0x7f3ac815e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3ac7400640 1 --2- 172.21.15.18:0/272885554 >> v2:172.21.15.167:3300/0 conn(0x7f3ac815db00 0x7f3ac80b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 -- 172.21.15.18:0/272885554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac80b4620 msgr2=0x7f3ac815e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:34.940 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac80b4620 0x7f3ac815e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.941 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 -- 172.21.15.18:0/272885554 >> v2:172.21.15.167:3300/0 conn(0x7f3ac815db00 msgr2=0x7f3ac80b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:34.941 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 --2- 172.21.15.18:0/272885554 >> v2:172.21.15.167:3300/0 conn(0x7f3ac815db00 0x7f3ac80b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.941 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.929+0000 7f3abfe00640 1 -- 172.21.15.18:0/272885554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80b3060 con 0x7f3ac806d310 2024-04-25T10:03:34.942 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3abfe00640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac806d310 0x7f3ac80b40e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80d0710 tx=0x7f3ab001c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e813faef58020 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ac6a00640 1 -- 172.21.15.18:0/272885554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b0070 con 0x7f3ac806d310 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ac6a00640 1 -- 172.21.15.18:0/272885554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab00ab600 con 0x7f3ac806d310 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ac6a00640 1 -- 172.21.15.18:0/272885554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00ab9d0 con 0x7f3ac806d310 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 -- 172.21.15.18:0/272885554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac806d310 msgr2=0x7f3ac80b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac806d310 0x7f3ac80b40e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ac80d0710 tx=0x7f3ab001c260 comp rx=0 tx=0).stop 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 -- 172.21.15.18:0/272885554 shutdown_connections 2024-04-25T10:03:34.943 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac80b4620 0x7f3ac815e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.944 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 --2- 172.21.15.18:0/272885554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac806d310 0x7f3ac80b40e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.944 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 --2- 172.21.15.18:0/272885554 >> v2:172.21.15.167:3300/0 conn(0x7f3ac815db00 0x7f3ac80b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.944 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 -- 172.21.15.18:0/272885554 >> 172.21.15.18:0/272885554 conn(0x7f3ac8067170 msgr2=0x7f3ac806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:34.944 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 -- 172.21.15.18:0/272885554 shutdown_connections 2024-04-25T10:03:34.944 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.933+0000 7f3ace400640 1 -- 172.21.15.18:0/272885554 wait complete. 2024-04-25T10:03:34.945 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 Processor -- start 2024-04-25T10:03:34.945 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- start start 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 0x7f3ac8144100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac815e060 con 0x7f3ac815db00 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac815dee0 con 0x7f3ac80b4620 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac80cd610 con 0x7f3ac806d310 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46618/0 (socket says 172.21.15.18:46618) 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7e00640 1 -- 172.21.15.18:0/422914298 learned_addr learned my addr 172.21.15.18:0/422914298 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 0x7f3ac8144100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.948 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7400640 1 -- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 msgr2=0x7f3ac80aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7400640 1 -- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 msgr2=0x7f3ac80aff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 -- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 msgr2=0x7f3ac80aff80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 -- 172.21.15.18:0/422914298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 msgr2=0x7f3ac80b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 -- 172.21.15.18:0/422914298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80af1c0 con 0x7f3ac80b4620 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ac7e00640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abfe00640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 0x7f3ac8144100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ab000 tx=0x7f3ab0019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b0040 con 0x7f3ac80b4620 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab00b4440 con 0x7f3ac80b4620 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b4810 con 0x7f3ac80b4620 2024-04-25T10:03:34.949 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac80af4a0 con 0x7f3ac80b4620 2024-04-25T10:03:34.950 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac80afa60 con 0x7f3ac80b4620 2024-04-25T10:03:34.950 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3ab00bb020 con 0x7f3ac80b4620 2024-04-25T10:03:34.950 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.937+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3ab00b4d40 con 0x7f3ac80b4620 2024-04-25T10:03:34.950 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.941+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac804ef30 con 0x7f3ac80b4620 2024-04-25T10:03:34.951 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:34.941+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3ab00c2020 con 0x7f3ac80b4620 2024-04-25T10:03:34.979 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:34.973+0000 7f0d43a4d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:03:35.009 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.001+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ac806e560 con 0x7f3ac80b4620 2024-04-25T10:03:35.020 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.009+0000 7f3abf400640 1 -- 172.21.15.18:0/422914298 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f3ab0016110 con 0x7f3ac80b4620 2024-04-25T10:03:35.020 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-25T10:03:35.020 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":10,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:33.647166+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:35.021 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 msgr2=0x7f3ac8144100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:35.021 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 0x7f3ac8144100 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00ab000 tx=0x7f3ab0019000 comp rx=0 tx=0).stop 2024-04-25T10:03:35.021 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 shutdown_connections 2024-04-25T10:03:35.021 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ac815db00 0x7f3ac80b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:35.021 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ac80b4620 0x7f3ac8144100 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:35.022 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 --2- 172.21.15.18:0/422914298 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ac806d310 0x7f3ac80aff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:35.022 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 >> 172.21.15.18:0/422914298 conn(0x7f3ac8067170 msgr2=0x7f3ac806d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:35.022 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 shutdown_connections 2024-04-25T10:03:35.022 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:35.013+0000 7f3ace400640 1 -- 172.21.15.18:0/422914298 wait complete. 2024-04-25T10:03:35.038 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T10:03:35.191 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.181+0000 7f4b370d3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T10:03:35.282 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.273+0000 7f4b370d3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T10:03:35.308 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:35.304+0000 7f0d43a4d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:03:35.380 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:35.376+0000 7f0d43a4d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:03:35.496 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.485+0000 7f4b370d3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T10:03:35.586 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.577+0000 7f4b370d3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T10:03:35.932 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.925+0000 7f4b370d3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T10:03:36.006 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-04-25T10:03:35.997+0000 7f4b370d3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T10:03:36.403 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:36.396+0000 7f0ce9000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T10:03:36.403 INFO:tasks.ceph.mgr.x.smithi167.stderr:2024-04-25T10:03:36.396+0000 7f0ce9000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T10:03:38.122 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T10:03:38.116+0000 7fd13a9ab7c0 -1 osd.5 0 log_to_monitors true 2024-04-25T10:03:38.192 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T10:03:38.188+0000 7fa4627a77c0 -1 osd.7 0 log_to_monitors true 2024-04-25T10:03:38.226 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-25T10:03:38.217+0000 7f6116eab7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T10:03:38.302 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-25T10:03:38.293+0000 7f83422a97c0 -1 osd.1 0 log_to_monitors true 2024-04-25T10:03:38.331 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T10:03:38.324+0000 7f688585b7c0 -1 osd.4 0 log_to_monitors true 2024-04-25T10:03:38.361 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-25T10:03:38.353+0000 7fba053c27c0 -1 osd.0 0 log_to_monitors true 2024-04-25T10:03:38.367 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T10:03:38.360+0000 7fd8ddb9d7c0 -1 osd.6 0 log_to_monitors true 2024-04-25T10:03:38.439 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-25T10:03:38.429+0000 7f44432b67c0 -1 osd.3 0 log_to_monitors true 2024-04-25T10:03:40.840 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-25T10:03:40.829+0000 7f833d200640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T10:03:40.844 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-25T10:03:40.837+0000 7f6112800640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T10:03:40.846 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-25T10:03:40.837+0000 7fba00200640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T10:03:40.866 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-04-25T10:03:40.857+0000 7f8333200640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:40.873 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-04-25T10:03:40.865+0000 7fb9f6200640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:40.881 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-04-25T10:03:40.873+0000 7f6107e00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.486 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-25T10:03:41.477+0000 7f443e200640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T10:03:41.509 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-04-25T10:03:41.501+0000 7f4434200640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.680 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T10:03:41.672+0000 7f6881200640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T10:03:41.710 INFO:tasks.ceph.osd.4.smithi167.stderr:2024-04-25T10:03:41.704+0000 7f6876800640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.843 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T10:03:41.836+0000 7fd8d8a00640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T10:03:41.844 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:41.853 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T10:03:41.848+0000 7fd136200640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T10:03:41.873 INFO:tasks.ceph.osd.6.smithi167.stderr:2024-04-25T10:03:41.868+0000 7fd8cea00640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.879 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T10:03:41.872+0000 7fa45d600640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T10:03:41.893 INFO:tasks.ceph.osd.5.smithi167.stderr:2024-04-25T10:03:41.888+0000 7fd12b800640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.917 INFO:tasks.ceph.osd.7.smithi167.stderr:2024-04-25T10:03:41.912+0000 7fa453600640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T10:03:41.975 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.965+0000 7fe310000640 1 Processor -- start 2024-04-25T10:03:41.975 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.965+0000 7fe310000640 1 -- start start 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe3080cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe3080712b0 0x7fe3080cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3080ce900 0x7fe3080ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30815c040 con 0x7fe3080ce900 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30815c320 con 0x7fe3080712b0 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe310000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30815c600 con 0x7fe3080aec10 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3080ce900 0x7fe3080ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe3080ce900 0x7fe3080ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47562/0 (socket says 172.21.15.18:47562) 2024-04-25T10:03:41.977 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 -- 172.21.15.18:0/1693817374 learned_addr learned my addr 172.21.15.18:0/1693817374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30cc00640 1 --2- 172.21.15.18:0/1693817374 >> v2:172.21.15.167:3300/0 conn(0x7fe3080712b0 0x7fe3080cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30d600640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe3080cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 -- 172.21.15.18:0/1693817374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 msgr2=0x7fe3080cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe3080cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 -- 172.21.15.18:0/1693817374 >> v2:172.21.15.167:3300/0 conn(0x7fe3080712b0 msgr2=0x7fe3080cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:41.978 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 --2- 172.21.15.18:0/1693817374 >> v2:172.21.15.167:3300/0 conn(0x7fe3080712b0 0x7fe3080cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.979 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.969+0000 7fe30e000640 1 -- 172.21.15.18:0/1693817374 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30815c8e0 con 0x7fe3080ce900 2024-04-25T10:03:41.980 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe30e000640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080ce900 0x7fe3080ced90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b4c90 tx=0x7fe30001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e61b094a5a0456 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.980 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe307e00640 1 -- 172.21.15.18:0/1693817374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000a56f0 con 0x7fe3080ce900 2024-04-25T10:03:41.981 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe307e00640 1 -- 172.21.15.18:0/1693817374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3000a5890 con 0x7fe3080ce900 2024-04-25T10:03:41.981 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe307e00640 1 -- 172.21.15.18:0/1693817374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000a5c60 con 0x7fe3080ce900 2024-04-25T10:03:41.981 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- 172.21.15.18:0/1693817374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080ce900 msgr2=0x7fe3080ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080ce900 0x7fe3080ced90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b4c90 tx=0x7fe30001c9f0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- 172.21.15.18:0/1693817374 shutdown_connections 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080ce900 0x7fe3080ced90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- 172.21.15.18:0/1693817374 >> v2:172.21.15.167:3300/0 conn(0x7fe3080712b0 0x7fe3080cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- 172.21.15.18:0/1693817374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe3080cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- 172.21.15.18:0/1693817374 >> 172.21.15.18:0/1693817374 conn(0x7fe308067170 msgr2=0x7fe30806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- 172.21.15.18:0/1693817374 shutdown_connections 2024-04-25T10:03:41.982 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- 172.21.15.18:0/1693817374 wait complete. 2024-04-25T10:03:41.983 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 Processor -- start 2024-04-25T10:03:41.983 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- start start 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 0x7fe3080b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe30815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3080ce900 0x7fe30813dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30806e170 con 0x7fe3080712b0 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30806dff0 con 0x7fe3080ce900 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.973+0000 7fe310000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30806e2f0 con 0x7fe3080aec10 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 0x7fe3080b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe30815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3080ce900 0x7fe30813dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe30815a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53318/0 (socket says 172.21.15.18:53318) 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30cc00640 1 -- 172.21.15.18:0/760207356 learned_addr learned my addr 172.21.15.18:0/760207356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 -- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 msgr2=0x7fe30815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.985 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe30815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.986 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 -- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3080ce900 msgr2=0x7fe30813dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:41.986 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3080ce900 0x7fe30813dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:41.986 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 -- 172.21.15.18:0/760207356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30814be80 con 0x7fe3080712b0 2024-04-25T10:03:41.986 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe30d600640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 0x7fe3080b3340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e8a0 tx=0x7fe2fc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc017070 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00c940 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc00ccf0 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3080b2860 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3080b2e20 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30814c220 con 0x7fe3080712b0 2024-04-25T10:03:41.987 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) v1 ==== 86671+0+0 (secure 0 0 0) 0x7fe2fc01a070 con 0x7fe3080712b0 2024-04-25T10:03:41.988 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 0x7fe2e8069390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:41.988 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.977+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3351+0+0 (secure 0 0 0) 0x7fe2fc0847f0 con 0x7fe3080712b0 2024-04-25T10:03:41.988 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.981+0000 7fe30cc00640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 0x7fe2e8069390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:41.988 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.981+0000 7fe30cc00640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 0x7fe2e8069390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b4510 tx=0x7fe2f4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:41.992 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:41.985+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2fc055bb0 con 0x7fe3080712b0 2024-04-25T10:03:42.155 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.145+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe30804ef30 con 0x7fe3080712b0 2024-04-25T10:03:42.156 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.145+0000 7fe305600640 1 -- 172.21.15.18:0/760207356 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8965 (secure 0 0 0) 0x7fe2fc059c50 con 0x7fe3080712b0 2024-04-25T10:03:42.156 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-25T10:03:42.156 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":14,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:41.565912+0000","last_up_change":"2024-04-25T10:03:41.565912+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:42.158 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 msgr2=0x7fe2e8069390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:42.158 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 0x7fe2e8069390 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe3080b4510 tx=0x7fe2f4009190 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 msgr2=0x7fe3080b3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 0x7fe3080b3340 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc00e8a0 tx=0x7fe2fc00ed60 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 shutdown_connections 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe3080ce900 0x7fe30813dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe2e8066ed0 0x7fe2e8069390 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe3080aec10 0x7fe30815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 --2- 172.21.15.18:0/760207356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe3080712b0 0x7fe3080b3340 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 >> 172.21.15.18:0/760207356 conn(0x7fe308067170 msgr2=0x7fe3080b1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 shutdown_connections 2024-04-25T10:03:42.159 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:42.149+0000 7fe310000640 1 -- 172.21.15.18:0/760207356 wait complete. 2024-04-25T10:03:42.175 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-04-25T10:03:48.983 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:49.125 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 Processor -- start 2024-04-25T10:03:49.125 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 -- start start 2024-04-25T10:03:49.126 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 0x7fd5c00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.126 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.126 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c00d2560 con 0x7fd5c00d0e80 2024-04-25T10:03:49.126 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c00d2840 con 0x7fd5c015dbe0 2024-04-25T10:03:49.126 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5c6200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c00d2b20 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.127 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.127 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5bf400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 0x7fd5c00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.127 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53320/0 (socket says 172.21.15.18:53320) 2024-04-25T10:03:49.127 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 -- 172.21.15.18:0/702458030 learned_addr learned my addr 172.21.15.18:0/702458030 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:49.128 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 -- 172.21.15.18:0/702458030 >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 msgr2=0x7fd5c00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:49.128 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 --2- 172.21.15.18:0/702458030 >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 0x7fd5c00d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.128 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 -- 172.21.15.18:0/702458030 >> v1:172.21.15.167:6789/0 conn(0x7fd5c00d0e80 legacy=0x7fd5c00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.128 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5b6a00640 1 -- 172.21.15.18:0/702458030 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00d2e00 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.128 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.117+0000 7fd5bf400640 1 --2- 172.21.15.18:0/702458030 >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 0x7fd5c00d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:49.130 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5b6a00640 1 --2- 172.21.15.18:0/702458030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009e50 tx=0x7fd5a801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82715dc837c4c528 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.131 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5bea00640 1 -- 172.21.15.18:0/702458030 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80a5580 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.131 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5bea00640 1 -- 172.21.15.18:0/702458030 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a80a5720 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.131 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5bea00640 1 -- 172.21.15.18:0/702458030 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80a5af0 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 -- 172.21.15.18:0/702458030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 msgr2=0x7fd5c00d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 --2- 172.21.15.18:0/702458030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009e50 tx=0x7fd5a801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 -- 172.21.15.18:0/702458030 shutdown_connections 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 --2- 172.21.15.18:0/702458030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d1fe0 0x7fd5c00d0940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 --2- 172.21.15.18:0/702458030 >> v2:172.21.15.167:3300/0 conn(0x7fd5c015dbe0 0x7fd5c00d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 -- 172.21.15.18:0/702458030 >> 172.21.15.18:0/702458030 conn(0x7fd5c0072740 msgr2=0x7fd5c0072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 -- 172.21.15.18:0/702458030 shutdown_connections 2024-04-25T10:03:49.132 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.121+0000 7fd5c6200640 1 -- 172.21.15.18:0/702458030 wait complete. 2024-04-25T10:03:49.133 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 Processor -- start 2024-04-25T10:03:49.133 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- start start 2024-04-25T10:03:49.135 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d0e80 0x7fd5c00b8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.135 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c00d1fe0 0x7fd5c0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.135 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.135 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c015e140 con 0x7fd5c015dbe0 2024-04-25T10:03:49.135 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c015dfc0 con 0x7fd5c00d1fe0 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c016a850 con 0x7fd5c00d0e80 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47580/0 (socket says 172.21.15.18:47580) 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 -- 172.21.15.18:0/2094999620 learned_addr learned my addr 172.21.15.18:0/2094999620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bf400640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d0e80 0x7fd5c00b8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5b6a00640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c00d1fe0 0x7fd5c0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 -- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d0e80 msgr2=0x7fd5c00b8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d0e80 0x7fd5c00b8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 -- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c00d1fe0 msgr2=0x7fd5c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c00d1fe0 0x7fd5c0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 -- 172.21.15.18:0/2094999620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0158c70 con 0x7fd5c015dbe0 2024-04-25T10:03:49.136 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5bfe00640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c340 tx=0x7fd5b800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8005220 con 0x7fd5c015dbe0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b80053c0 con 0x7fd5c015dbe0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c0158f50 con 0x7fd5c015dbe0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8007270 con 0x7fd5c015dbe0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.125+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c0159510 con 0x7fd5c015dbe0 2024-04-25T10:03:49.137 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.129+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c004ef30 con 0x7fd5c015dbe0 2024-04-25T10:03:49.138 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.129+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5b8019020 con 0x7fd5c015dbe0 2024-04-25T10:03:49.139 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.129+0000 7fd5b7e00640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 0x7fd59c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.139 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.129+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5b8083fe0 con 0x7fd5c015dbe0 2024-04-25T10:03:49.139 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.129+0000 7fd5bf400640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 0x7fd59c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.140 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.133+0000 7fd5bf400640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 0x7fd59c069420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009580 tx=0x7fd5b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.144 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.133+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5b8054ba0 con 0x7fd5c015dbe0 2024-04-25T10:03:49.306 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.297+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5c0073cf0 con 0x7fd5c015dbe0 2024-04-25T10:03:49.307 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.297+0000 7fd5b7e00640 1 -- 172.21.15.18:0/2094999620 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12860 (secure 0 0 0) 0x7fd5b8058c40 con 0x7fd5c015dbe0 2024-04-25T10:03:49.307 INFO:teuthology.misc.health.smithi018.stdout: 2024-04-25T10:03:49.308 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":18,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:45.696482+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 msgr2=0x7fd59c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 0x7fd59c069420 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd5b0009580 tx=0x7fd5b0009190 comp rx=0 tx=0).stop 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 msgr2=0x7fd5c015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c340 tx=0x7fd5b800c800 comp rx=0 tx=0).stop 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 shutdown_connections 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c015dbe0 0x7fd5c015a400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c00d1fe0 0x7fd5c0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.310 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd59c066f60 0x7fd59c069420 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.311 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 --2- 172.21.15.18:0/2094999620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c00d0e80 0x7fd5c00b8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.311 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 >> 172.21.15.18:0/2094999620 conn(0x7fd5c0072740 msgr2=0x7fd5c014ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:49.311 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 shutdown_connections 2024-04-25T10:03:49.311 INFO:teuthology.misc.health.smithi018.stderr:2024-04-25T10:03:49.301+0000 7fd5c6200640 1 -- 172.21.15.18:0/2094999620 wait complete. 2024-04-25T10:03:49.327 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T10:03:49.327 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T10:03:49.328 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:03:49.328 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:03:49.331 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:03:49.331 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:03:49.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:03:49.334 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:03:49.334 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:03:49.334 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:03:49.338 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:03:49.338 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:03:49.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:03:49.342 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:03:49.342 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T10:03:49.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:49.431 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:03:49.432 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:03:49.449 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:03:49.450 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:03:49.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 Processor -- start 2024-04-25T10:03:49.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 -- start start 2024-04-25T10:03:49.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 0x7f2d340afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d340d11b0 0x7f2d3406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3415ddf0 con 0x7f2d340b4210 2024-04-25T10:03:49.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3406b480 con 0x7f2d340d11b0 2024-04-25T10:03:49.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d39400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340d06d0 con 0x7f2d3415da10 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d340d11b0 0x7f2d3406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d340d11b0 0x7f2d3406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47610/0 (socket says 172.21.15.18:47610) 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 -- 172.21.15.18:0/676846305 learned_addr learned my addr 172.21.15.18:0/676846305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d32800640 1 --2- 172.21.15.18:0/676846305 >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 0x7f2d340afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 -- 172.21.15.18:0/676846305 >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 msgr2=0x7f2d340afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 --2- 172.21.15.18:0/676846305 >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 0x7f2d340afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 -- 172.21.15.18:0/676846305 >> v1:172.21.15.167:6789/0 conn(0x7f2d340b4210 legacy=0x7f2d340b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d2be00640 1 -- 172.21.15.18:0/676846305 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340d09b0 con 0x7f2d340d11b0 2024-04-25T10:03:49.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.481+0000 7f2d32800640 1 --2- 172.21.15.18:0/676846305 >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 0x7f2d340afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:49.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d2be00640 1 --2- 172.21.15.18:0/676846305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d3406ac10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d340684f0 tx=0x7f2d1c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed4721e3fd01099 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d31e00640 1 -- 172.21.15.18:0/676846305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0b0070 con 0x7f2d340d11b0 2024-04-25T10:03:49.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d31e00640 1 -- 172.21.15.18:0/676846305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0ab600 con 0x7f2d340d11b0 2024-04-25T10:03:49.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d31e00640 1 -- 172.21.15.18:0/676846305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ab9d0 con 0x7f2d340d11b0 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 -- 172.21.15.18:0/676846305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 msgr2=0x7f2d3406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 --2- 172.21.15.18:0/676846305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d3406ac10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d340684f0 tx=0x7f2d1c01c490 comp rx=0 tx=0).stop 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 -- 172.21.15.18:0/676846305 shutdown_connections 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 --2- 172.21.15.18:0/676846305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d3406ac10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 --2- 172.21.15.18:0/676846305 >> v2:172.21.15.167:3300/0 conn(0x7f2d3415da10 0x7f2d340afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 -- 172.21.15.18:0/676846305 >> 172.21.15.18:0/676846305 conn(0x7f2d340b2400 msgr2=0x7f2d340b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 -- 172.21.15.18:0/676846305 shutdown_connections 2024-04-25T10:03:49.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.485+0000 7f2d39400640 1 -- 172.21.15.18:0/676846305 wait complete. 2024-04-25T10:03:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 Processor -- start 2024-04-25T10:03:49.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- start start 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d340b4210 0x7f2d34146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d3415da10 0x7f2d3415f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34162190 con 0x7f2d340d11b0 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34162010 con 0x7f2d3415da10 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d34162310 con 0x7f2d340b4210 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47612/0 (socket says 172.21.15.18:47612) 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 -- 172.21.15.18:0/2312422157 learned_addr learned my addr 172.21.15.18:0/2312422157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d32800640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d340b4210 0x7f2d34146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d33200640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d3415da10 0x7f2d3415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 -- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d340b4210 msgr2=0x7f2d34146d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d340b4210 0x7f2d34146d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 -- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d3415da10 msgr2=0x7f2d3415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d3415da10 0x7f2d3415f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 -- 172.21.15.18:0/2312422157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34158290 con 0x7f2d340d11b0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2be00640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ae040 tx=0x7f2d1c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0b8020 con 0x7f2d340d11b0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0b4410 con 0x7f2d340d11b0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0b0040 con 0x7f2d340d11b0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d34158570 con 0x7f2d340d11b0 2024-04-25T10:03:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.489+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d34158b30 con 0x7f2d340d11b0 2024-04-25T10:03:49.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d340745d0 con 0x7f2d340d11b0 2024-04-25T10:03:49.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d1c0bb020 con 0x7f2d340d11b0 2024-04-25T10:03:49.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d2aa00640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 0x7f2d10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2d1c11e420 con 0x7f2d340d11b0 2024-04-25T10:03:49.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d32800640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 0x7f2d10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.493+0000 7f2d32800640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 0x7f2d10069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d341fa070 tx=0x7f2d24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.497+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d1c0c2070 con 0x7f2d340d11b0 2024-04-25T10:03:49.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.657+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d340ccfe0 con 0x7f2d340d11b0 2024-04-25T10:03:49.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.657+0000 7f2d2aa00640 1 -- 172.21.15.18:0/2312422157 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12860 (secure 0 0 0) 0x7f2d1c016110 con 0x7f2d340d11b0 2024-04-25T10:03:49.668 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:49.668 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:45.696482+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:49.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 msgr2=0x7f2d10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 0x7f2d10069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2d341fa070 tx=0x7f2d24008040 comp rx=0 tx=0).stop 2024-04-25T10:03:49.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 msgr2=0x7f2d34159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c0ae040 tx=0x7f2d1c019230 comp rx=0 tx=0).stop 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 shutdown_connections 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d3415da10 0x7f2d3415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d340d11b0 0x7f2d34159330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d10066f60 0x7f2d10069420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 --2- 172.21.15.18:0/2312422157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d340b4210 0x7f2d34146d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 >> 172.21.15.18:0/2312422157 conn(0x7f2d340b2400 msgr2=0x7f2d340736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 shutdown_connections 2024-04-25T10:03:49.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.661+0000 7f2d39400640 1 -- 172.21.15.18:0/2312422157 wait complete. 2024-04-25T10:03:49.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:03:49.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:03:49.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 Processor -- start 2024-04-25T10:03:49.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 -- start start 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c15bc40 con 0x7f504c144120 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c15b3a0 con 0x7f504c15acd0 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5054200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15e490 con 0x7f504c0b3090 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5051800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f504c144120 0x7f504c0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35754/0 (socket says 172.21.15.18:35754) 2024-04-25T10:03:49.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5051800640 1 -- 172.21.15.18:0/3702652812 learned_addr learned my addr 172.21.15.18:0/3702652812 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:49.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f5052200640 1 --2- 172.21.15.18:0/3702652812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629078901 0 0) 0x7f504c15bc40 con 0x7f504c144120 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5034005740 con 0x7f504c144120 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252216158 0 0) 0x7f504c15b3a0 con 0x7f504c15acd0 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.825+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f504c15bc40 con 0x7f504c15acd0 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5052200640 1 -- 172.21.15.18:0/3702652812 >> v1:172.21.15.167:6789/0 conn(0x7f504c15acd0 legacy=0x7f504c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876171321 0 0) 0x7f5034005740 con 0x7f504c144120 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5052200640 1 -- 172.21.15.18:0/3702652812 >> v1:172.21.15.18:6789/0 conn(0x7f504c144120 legacy=0x7f504c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5052200640 1 -- 172.21.15.18:0/3702652812 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c15b680 con 0x7f504c0b3090 2024-04-25T10:03:49.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5052200640 1 --2- 172.21.15.18:0/3702652812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0b3520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f504c15e610 tx=0x7f504401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281231c3e4ba5b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440b2070 con 0x7f504c0b3090 2024-04-25T10:03:49.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50440a5550 con 0x7f504c0b3090 2024-04-25T10:03:49.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f504be00640 1 -- 172.21.15.18:0/3702652812 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040001680 con 0x7f504c0b3090 2024-04-25T10:03:49.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 -- 172.21.15.18:0/3702652812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 msgr2=0x7f504c0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 --2- 172.21.15.18:0/3702652812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0b3520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f504c15e610 tx=0x7f504401c820 comp rx=0 tx=0).stop 2024-04-25T10:03:49.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 -- 172.21.15.18:0/3702652812 shutdown_connections 2024-04-25T10:03:49.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 --2- 172.21.15.18:0/3702652812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0b3520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 -- 172.21.15.18:0/3702652812 >> 172.21.15.18:0/3702652812 conn(0x7f504c067080 msgr2=0x7f504c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:49.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 -- 172.21.15.18:0/3702652812 shutdown_connections 2024-04-25T10:03:49.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.829+0000 7f5054200640 1 -- 172.21.15.18:0/3702652812 wait complete. 2024-04-25T10:03:49.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 Processor -- start 2024-04-25T10:03:49.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 -- start start 2024-04-25T10:03:49.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f504c15acd0 0x7f504c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c06dc60 con 0x7f504c144120 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c06dae0 con 0x7f504c15acd0 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c06dde0 con 0x7f504c0b3090 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5050e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53386/0 (socket says 172.21.15.18:53386) 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5050e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47626/0 (socket says 172.21.15.18:47626) 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 -- 172.21.15.18:0/3550919970 learned_addr learned my addr 172.21.15.18:0/3550919970 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5052200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f504c15acd0 0x7f504c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 -- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f504c15acd0 msgr2=0x7f504c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f504c15acd0 0x7f504c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 -- 172.21.15.18:0/3550919970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 msgr2=0x7f504c141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 -- 172.21.15.18:0/3550919970 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0aae10 con 0x7f504c0b3090 2024-04-25T10:03:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5050e00640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:49.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5051800640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f504000c5d0 tx=0x7f504000ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5040017070 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5040005cf0 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c0a9d70 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.833+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50400072b0 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c0aa330 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c0745d0 con 0x7f504c0b3090 2024-04-25T10:03:49.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f504001a070 con 0x7f504c0b3090 2024-04-25T10:03:49.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5049600640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 0x7f502c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:49.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5040084650 con 0x7f504c0b3090 2024-04-25T10:03:49.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5050e00640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 0x7f502c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:49.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.837+0000 7f5050e00640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 0x7f502c069450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f504c0cba50 tx=0x7f5038009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:49.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:49.841+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5040021020 con 0x7f504c0b3090 2024-04-25T10:03:50.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f504c15eca0 con 0x7f504c0b3090 2024-04-25T10:03:50.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5049600640 1 -- 172.21.15.18:0/3550919970 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5040055340 con 0x7f504c0b3090 2024-04-25T10:03:50.013 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:03:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 msgr2=0x7f502c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 0x7f502c069450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f504c0cba50 tx=0x7f5038009040 comp rx=0 tx=0).stop 2024-04-25T10:03:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 msgr2=0x7f504c0a8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f504000c5d0 tx=0x7f504000ca90 comp rx=0 tx=0).stop 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 shutdown_connections 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f504c15acd0 0x7f504c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f504c144120 0x7f504c141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f502c066f90 0x7f502c069450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 --2- 172.21.15.18:0/3550919970 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f504c0b3090 0x7f504c0a8ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 >> 172.21.15.18:0/3550919970 conn(0x7f504c067080 msgr2=0x7f504c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 shutdown_connections 2024-04-25T10:03:50.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.005+0000 7f5054200640 1 -- 172.21.15.18:0/3550919970 wait complete. 2024-04-25T10:03:50.034 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:50.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 Processor -- start 2024-04-25T10:03:50.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 -- start start 2024-04-25T10:03:50.176 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d90146740 0x7f2d9006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d900af840 0x7f2d900b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2d900b1f20 0x7f2d900aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d90146b20 con 0x7f2d900af840 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900b23e0 con 0x7f2d900b1f20 2024-04-25T10:03:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d97800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900acb80 con 0x7f2d90146740 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d900af840 0x7f2d900b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2d900af840 0x7f2d900b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47642/0 (socket says 172.21.15.18:47642) 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 -- 172.21.15.18:0/3305446841 learned_addr learned my addr 172.21.15.18:0/3305446841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d94e00640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d90146740 0x7f2d9006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d95800640 1 --2- 172.21.15.18:0/3305446841 >> v2:172.21.15.167:3300/0 conn(0x7f2d900b1f20 0x7f2d900aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 -- 172.21.15.18:0/3305446841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d90146740 msgr2=0x7f2d9006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d90146740 0x7f2d9006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 -- 172.21.15.18:0/3305446841 >> v2:172.21.15.167:3300/0 conn(0x7f2d900b1f20 msgr2=0x7f2d900aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/3305446841 >> v2:172.21.15.167:3300/0 conn(0x7f2d900b1f20 0x7f2d900aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.165+0000 7f2d8fe00640 1 -- 172.21.15.18:0/3305446841 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900ace60 con 0x7f2d900af840 2024-04-25T10:03:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900af840 0x7f2d900b19e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d90071070 tx=0x7f2d7c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5958730d96728ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d8f400640 1 -- 172.21.15.18:0/3305446841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b1070 con 0x7f2d900af840 2024-04-25T10:03:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d8f400640 1 -- 172.21.15.18:0/3305446841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0ac620 con 0x7f2d900af840 2024-04-25T10:03:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d8f400640 1 -- 172.21.15.18:0/3305446841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0ac9f0 con 0x7f2d900af840 2024-04-25T10:03:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 -- 172.21.15.18:0/3305446841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900af840 msgr2=0x7f2d900b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900af840 0x7f2d900b19e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d90071070 tx=0x7f2d7c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 -- 172.21.15.18:0/3305446841 shutdown_connections 2024-04-25T10:03:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 --2- 172.21.15.18:0/3305446841 >> v2:172.21.15.167:3300/0 conn(0x7f2d900b1f20 0x7f2d900aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900af840 0x7f2d900b19e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 --2- 172.21.15.18:0/3305446841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d90146740 0x7f2d9006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 -- 172.21.15.18:0/3305446841 >> 172.21.15.18:0/3305446841 conn(0x7f2d90066fa0 msgr2=0x7f2d9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 -- 172.21.15.18:0/3305446841 shutdown_connections 2024-04-25T10:03:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.169+0000 7f2d97800640 1 -- 172.21.15.18:0/3305446841 wait complete. 2024-04-25T10:03:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 Processor -- start 2024-04-25T10:03:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 -- start start 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d900af840 0x7f2d90143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 0x7f2d90140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900ae2d0 con 0x7f2d900b1f20 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900ae150 con 0x7f2d90146740 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d97800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90161580 con 0x7f2d900af840 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47654/0 (socket says 172.21.15.18:47654) 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 -- 172.21.15.18:0/4205374138 learned_addr learned my addr 172.21.15.18:0/4205374138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d94e00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d900af840 0x7f2d90143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d95800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 0x7f2d90140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 -- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d900af840 msgr2=0x7f2d90143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d900af840 0x7f2d90143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 -- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 msgr2=0x7f2d90140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 0x7f2d90140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 -- 172.21.15.18:0/4205374138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9015f7b0 con 0x7f2d900b1f20 2024-04-25T10:03:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d95800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 0x7f2d90140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.173+0000 7f2d8fe00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af040 tx=0x7f2d7c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b1040 con 0x7f2d900b1f20 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0ace50 con 0x7f2d900b1f20 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0b5640 con 0x7f2d900b1f20 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9015f4d0 con 0x7f2d900b1f20 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d900b2960 con 0x7f2d900b1f20 2024-04-25T10:03:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d900745d0 con 0x7f2d900b1f20 2024-04-25T10:03:50.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d7c0b57e0 con 0x7f2d900b1f20 2024-04-25T10:03:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 0x7f2d70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2d7c11e810 con 0x7f2d900b1f20 2024-04-25T10:03:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.177+0000 7f2d94e00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 0x7f2d70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:50.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.181+0000 7f2d94e00640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 0x7f2d70069420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009ac0 tx=0x7f2d84009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.185+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d7c016110 con 0x7f2d900b1f20 2024-04-25T10:03:50.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.377+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d9013b8f0 con 0x7f2d900b1f20 2024-04-25T10:03:50.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.377+0000 7f2d8cc00640 1 -- 172.21.15.18:0/4205374138 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f2d7c0efb60 con 0x7f2d900b1f20 2024-04-25T10:03:50.388 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:50.388 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T10:03:50.388 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 msgr2=0x7f2d70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 0x7f2d70069420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2d84009ac0 tx=0x7f2d84009190 comp rx=0 tx=0).stop 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 msgr2=0x7f2d901408a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0af040 tx=0x7f2d7c019290 comp rx=0 tx=0).stop 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 shutdown_connections 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d90146740 0x7f2d90140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d900b1f20 0x7f2d901408a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2d70066f60 0x7f2d70069420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 --2- 172.21.15.18:0/4205374138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2d900af840 0x7f2d90143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 >> 172.21.15.18:0/4205374138 conn(0x7f2d90066fa0 msgr2=0x7f2d901619e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 shutdown_connections 2024-04-25T10:03:50.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:50.381+0000 7f2d97800640 1 -- 172.21.15.18:0/4205374138 wait complete. 2024-04-25T10:03:52.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:03:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 Processor -- start 2024-04-25T10:03:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 -- start start 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 0x7feda0166730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00ce7f0 con 0x7feda015b5a0 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00cead0 con 0x7feda015b980 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7feda6400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda00ce5b0 con 0x7feda00cc440 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feda015b5a0 0x7feda00cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55064/0 (socket says 172.21.15.18:55064) 2024-04-25T10:03:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9f400640 1 -- 172.21.15.18:0/1166814233 learned_addr learned my addr 172.21.15.18:0/1166814233 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9fe00640 1 --2- 172.21.15.18:0/1166814233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 0x7feda0166730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265937163 0 0) 0x7feda00ce7f0 con 0x7feda015b5a0 2024-04-25T10:03:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed84003530 con 0x7feda015b5a0 2024-04-25T10:03:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150094622 0 0) 0x7fed84003530 con 0x7feda015b5a0 2024-04-25T10:03:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9fe00640 1 -- 172.21.15.18:0/1166814233 >> v1:172.21.15.167:6789/0 conn(0x7feda015b980 legacy=0x7feda00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9fe00640 1 -- 172.21.15.18:0/1166814233 >> v1:172.21.15.18:6789/0 conn(0x7feda015b5a0 legacy=0x7feda00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.553+0000 7fed9fe00640 1 -- 172.21.15.18:0/1166814233 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00cf960 con 0x7feda00cc440 2024-04-25T10:03:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7fed9fe00640 1 --2- 172.21.15.18:0/1166814233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 0x7feda0166730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed98009dc0 tx=0x7fed9801c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=601c669150b383be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90001680 con 0x7feda00cc440 2024-04-25T10:03:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed980a64c0 con 0x7feda00cc440 2024-04-25T10:03:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7fed9e000640 1 -- 172.21.15.18:0/1166814233 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed980a6870 con 0x7feda00cc440 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 -- 172.21.15.18:0/1166814233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 msgr2=0x7feda0166730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 --2- 172.21.15.18:0/1166814233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 0x7feda0166730 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fed98009dc0 tx=0x7fed9801c760 comp rx=0 tx=0).stop 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 -- 172.21.15.18:0/1166814233 shutdown_connections 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 --2- 172.21.15.18:0/1166814233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda00cc440 0x7feda0166730 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 -- 172.21.15.18:0/1166814233 >> 172.21.15.18:0/1166814233 conn(0x7feda00b3390 msgr2=0x7feda00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 -- 172.21.15.18:0/1166814233 shutdown_connections 2024-04-25T10:03:52.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.557+0000 7feda6400640 1 -- 172.21.15.18:0/1166814233 wait complete. 2024-04-25T10:03:52.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 Processor -- start 2024-04-25T10:03:52.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- start start 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feda00cc440 0x7feda01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 0x7feda014eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda0169820 con 0x7feda015b980 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda01696a0 con 0x7feda00cc440 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda01699a0 con 0x7feda015b5a0 2024-04-25T10:03:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37182/0 (socket says 172.21.15.18:37182) 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 -- 172.21.15.18:0/335129920 learned_addr learned my addr 172.21.15.18:0/335129920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9ea00640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 0x7feda014eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9f400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feda00cc440 0x7feda01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 -- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 msgr2=0x7feda014eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 0x7feda014eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 -- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feda00cc440 msgr2=0x7feda01524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feda00cc440 0x7feda01524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 -- 172.21.15.18:0/335129920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda015cd60 con 0x7feda015b980 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9ea00640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 0x7feda014eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed9fe00640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed9801d000 tx=0x7fed98019500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed98009450 con 0x7feda015b980 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed980c0070 con 0x7feda015b980 2024-04-25T10:03:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed980a6e30 con 0x7feda015b980 2024-04-25T10:03:52.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda015d030 con 0x7feda015b980 2024-04-25T10:03:52.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda015d5f0 con 0x7feda015b980 2024-04-25T10:03:52.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.561+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda00745d0 con 0x7feda015b980 2024-04-25T10:03:52.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.565+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed980b7040 con 0x7feda015b980 2024-04-25T10:03:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.565+0000 7fed97400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 0x7fed80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.565+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed9811fdb0 con 0x7feda015b980 2024-04-25T10:03:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.565+0000 7fed9f400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 0x7fed80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.565+0000 7fed9f400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 0x7fed80069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed900017f0 tx=0x7fed90001620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.569+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed98124070 con 0x7feda015b980 2024-04-25T10:03:52.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda00cc960 con 0x7feda015b980 2024-04-25T10:03:52.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7fed97400640 1 -- 172.21.15.18:0/335129920 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3699 (secure 0 0 0) 0x7fed980164a0 con 0x7feda015b980 2024-04-25T10:03:52.774 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:52.775 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T10:03:52.775 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 msgr2=0x7fed80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 0x7fed80069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed900017f0 tx=0x7fed90001620 comp rx=0 tx=0).stop 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 msgr2=0x7feda015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed9801d000 tx=0x7fed98019500 comp rx=0 tx=0).stop 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 shutdown_connections 2024-04-25T10:03:52.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feda015b980 0x7feda015c820 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed80066f60 0x7fed80069420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feda015b5a0 0x7feda014eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 --2- 172.21.15.18:0/335129920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feda00cc440 0x7feda01524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.765+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 >> 172.21.15.18:0/335129920 conn(0x7feda00b3390 msgr2=0x7feda015fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.769+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 shutdown_connections 2024-04-25T10:03:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.769+0000 7feda6400640 1 -- 172.21.15.18:0/335129920 wait complete. 2024-04-25T10:03:52.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:03:52.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.925+0000 7f608da00640 1 Processor -- start 2024-04-25T10:03:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.925+0000 7f608da00640 1 -- start start 2024-04-25T10:03:52.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f608da00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 0x7f608815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f608da00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608809a600 0x7f60880cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f608da00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608815c310 con 0x7f60880cf370 2024-04-25T10:03:52.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f608da00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880d0410 con 0x7f608809a600 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f608da00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60880cf800 con 0x7f6088099a60 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608809a600 0x7f60880cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608809a600 0x7f60880cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37186/0 (socket says 172.21.15.18:37186) 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 -- 172.21.15.18:0/2264134555 learned_addr learned my addr 172.21.15.18:0/2264134555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6086a00640 1 --2- 172.21.15.18:0/2264134555 >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 0x7f608815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 -- 172.21.15.18:0/2264134555 >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 msgr2=0x7f608815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 --2- 172.21.15.18:0/2264134555 >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 0x7f608815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 -- 172.21.15.18:0/2264134555 >> v1:172.21.15.167:6789/0 conn(0x7f60880cf370 legacy=0x7f6088099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6087400640 1 -- 172.21.15.18:0/2264134555 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880cfae0 con 0x7f608809a600 2024-04-25T10:03:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.929+0000 7f6086a00640 1 --2- 172.21.15.18:0/2264134555 >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 0x7f608815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f6087400640 1 --2- 172.21.15.18:0/2264134555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f60880cc2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6088072740 tx=0x7f608001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89a66d7df461394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f6086000640 1 -- 172.21.15.18:0/2264134555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800a5770 con 0x7f608809a600 2024-04-25T10:03:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f6086000640 1 -- 172.21.15.18:0/2264134555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60800a5910 con 0x7f608809a600 2024-04-25T10:03:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f6086000640 1 -- 172.21.15.18:0/2264134555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60800a5ce0 con 0x7f608809a600 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- 172.21.15.18:0/2264134555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 msgr2=0x7f60880cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- 172.21.15.18:0/2264134555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f60880cc2b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6088072740 tx=0x7f608001c930 comp rx=0 tx=0).stop 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- 172.21.15.18:0/2264134555 shutdown_connections 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- 172.21.15.18:0/2264134555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f60880cc2b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- 172.21.15.18:0/2264134555 >> v2:172.21.15.167:3300/0 conn(0x7f6088099a60 0x7f608815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- 172.21.15.18:0/2264134555 >> 172.21.15.18:0/2264134555 conn(0x7f60880d17a0 msgr2=0x7f60880d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- 172.21.15.18:0/2264134555 shutdown_connections 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- 172.21.15.18:0/2264134555 wait complete. 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 Processor -- start 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- start start 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 0x7f6088155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 0x7f60880afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cd390 con 0x7f608809a600 2024-04-25T10:03:52.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cd210 con 0x7f6088099a60 2024-04-25T10:03:52.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f608da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60880cd510 con 0x7f60880af9f0 2024-04-25T10:03:52.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f607fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f607fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37198/0 (socket says 172.21.15.18:37198) 2024-04-25T10:03:52.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.933+0000 7f607fe00640 1 -- 172.21.15.18:0/3461796557 learned_addr learned my addr 172.21.15.18:0/3461796557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f6087400640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 0x7f60880afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 -- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 msgr2=0x7f60880afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 0x7f60880afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f6086a00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 0x7f6088155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 -- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 msgr2=0x7f6088155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 0x7f6088155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 -- 172.21.15.18:0/3461796557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880b4840 con 0x7f608809a600 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f6087400640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 0x7f60880afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f6086a00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 0x7f6088155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:52.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607fe00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f607000c420 tx=0x7f607000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700052d0 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070005470 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070007260 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60880b4b20 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60880b50e0 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60880b52e0 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6070007400 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.937+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6070084230 con 0x7f608809a600 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.941+0000 7f6086a00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.941+0000 7f6086a00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 0x7f6064069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60780097a0 tx=0x7f6078008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:52.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:52.941+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60880b52e0 con 0x7f608809a600 2024-04-25T10:03:53.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.105+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60880745d0 con 0x7f608809a600 2024-04-25T10:03:53.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f607ea00640 1 -- 172.21.15.18:0/3461796557 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12860 (secure 0 0 0) 0x7f608815c310 con 0x7f608809a600 2024-04-25T10:03:53.116 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:53.116 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:03:45.696482+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:03:53.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 msgr2=0x7f6064069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 0x7f6064069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f60780097a0 tx=0x7f6078008040 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 msgr2=0x7f6088151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f607000c420 tx=0x7f607000c8e0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 shutdown_connections 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6064066f60 0x7f6064069420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60880af9f0 0x7f60880afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608809a600 0x7f6088151420 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 --2- 172.21.15.18:0/3461796557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6088099a60 0x7f6088155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 >> 172.21.15.18:0/3461796557 conn(0x7f60880d17a0 msgr2=0x7f608806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 shutdown_connections 2024-04-25T10:03:53.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.109+0000 7f608da00640 1 -- 172.21.15.18:0/3461796557 wait complete. 2024-04-25T10:03:53.137 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:03:53.138 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:03:53.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 Processor -- start 2024-04-25T10:03:53.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 -- start start 2024-04-25T10:03:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7624159320 0x7f762415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762415fc00 con 0x7f762406e010 2024-04-25T10:03:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762406d640 con 0x7f7624159320 2024-04-25T10:03:53.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7629e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762415fee0 con 0x7f762415f440 2024-04-25T10:03:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f7622a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7624159320 0x7f762415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53170/0 (socket says 172.21.15.18:53170) 2024-04-25T10:03:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 -- 172.21.15.18:0/2235312260 learned_addr learned my addr 172.21.15.18:0/2235312260 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:53.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 -- 172.21.15.18:0/2235312260 >> v2:172.21.15.167:3300/0 conn(0x7f7624159320 msgr2=0x7f762415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 --2- 172.21.15.18:0/2235312260 >> v2:172.21.15.167:3300/0 conn(0x7f7624159320 0x7f762415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 -- 172.21.15.18:0/2235312260 >> v1:172.21.15.167:6789/0 conn(0x7f762406e010 legacy=0x7f762406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.273+0000 7f761a000640 1 -- 172.21.15.18:0/2235312260 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76241601c0 con 0x7f762415f440 2024-04-25T10:03:53.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f761a000640 1 --2- 172.21.15.18:0/2235312260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f49cd2ca75365b15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7622000640 1 -- 172.21.15.18:0/2235312260 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0aa620 con 0x7f762415f440 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7622000640 1 -- 172.21.15.18:0/2235312260 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c0af070 con 0x7f762415f440 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7622000640 1 -- 172.21.15.18:0/2235312260 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c0aa9e0 con 0x7f762415f440 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 -- 172.21.15.18:0/2235312260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 msgr2=0x7f762406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 --2- 172.21.15.18:0/2235312260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f760c009870 tx=0x7f760c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 -- 172.21.15.18:0/2235312260 shutdown_connections 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 --2- 172.21.15.18:0/2235312260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762415f440 0x7f762406dad0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 --2- 172.21.15.18:0/2235312260 >> v2:172.21.15.167:3300/0 conn(0x7f7624159320 0x7f762415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 -- 172.21.15.18:0/2235312260 >> 172.21.15.18:0/2235312260 conn(0x7f7624067080 msgr2=0x7f762406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 -- 172.21.15.18:0/2235312260 shutdown_connections 2024-04-25T10:03:53.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.277+0000 7f7629e00640 1 -- 172.21.15.18:0/2235312260 wait complete. 2024-04-25T10:03:53.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 Processor -- start 2024-04-25T10:03:53.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- start start 2024-04-25T10:03:53.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762406e010 0x7f762412be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7624159320 0x7f762415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624071c00 con 0x7f762415f440 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7624071a80 con 0x7f7624159320 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762406ebb0 con 0x7f762406e010 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37200/0 (socket says 172.21.15.18:37200) 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 -- 172.21.15.18:0/2547087758 learned_addr learned my addr 172.21.15.18:0/2547087758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7622a00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762406e010 0x7f762412be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f761a000640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7624159320 0x7f762415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 -- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762406e010 msgr2=0x7f762412be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762406e010 0x7f762412be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 -- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7624159320 msgr2=0x7f762415d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7624159320 0x7f762415d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 -- 172.21.15.18:0/2547087758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762412c3d0 con 0x7f762415f440 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7623400640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c700 tx=0x7f761c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c003b80 con 0x7f762415f440 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f761c003d20 con 0x7f762415f440 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76241607f0 con 0x7f762415f440 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761c00aa90 con 0x7f762415f440 2024-04-25T10:03:53.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76240af730 con 0x7f762415f440 2024-04-25T10:03:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.281+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76240745d0 con 0x7f762415f440 2024-04-25T10:03:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.285+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f761c00ac30 con 0x7f762415f440 2024-04-25T10:03:53.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.285+0000 7f761be00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 0x7f7600069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.285+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f761c084b00 con 0x7f762415f440 2024-04-25T10:03:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.285+0000 7f7622a00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 0x7f7600069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.285+0000 7f7622a00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 0x7f7600069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7614009b60 tx=0x7f7614009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.289+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f762412c3d0 con 0x7f762415f440 2024-04-25T10:03:53.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.453+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f762406aed0 con 0x7f762415f440 2024-04-25T10:03:53.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.453+0000 7f761be00640 1 -- 172.21.15.18:0/2547087758 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f761c055780 con 0x7f762415f440 2024-04-25T10:03:53.463 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 msgr2=0x7f7600069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 0x7f7600069420 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7614009b60 tx=0x7f7614009190 comp rx=0 tx=0).stop 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 msgr2=0x7f7624143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f761c00c700 tx=0x7f761c00cbc0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 shutdown_connections 2024-04-25T10:03:53.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762415f440 0x7f7624143dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7624159320 0x7f762415d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7600066f60 0x7f7600069420 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 --2- 172.21.15.18:0/2547087758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f762406e010 0x7f762412be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 >> 172.21.15.18:0/2547087758 conn(0x7f7624067080 msgr2=0x7f762406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 shutdown_connections 2024-04-25T10:03:53.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.457+0000 7f7629e00640 1 -- 172.21.15.18:0/2547087758 wait complete. 2024-04-25T10:03:53.484 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:03:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 Processor -- start 2024-04-25T10:03:53.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 -- start start 2024-04-25T10:03:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 0x7f5e1c0b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 0x7f5e1c0d44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c0d33a0 con 0x7f5e1c06c120 2024-04-25T10:03:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1c0cea10 con 0x7f5e1c1611c0 2024-04-25T10:03:53.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e23800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c0d3680 con 0x7f5e1c0b2780 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e20e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 0x7f5e1c0b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e1be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 0x7f5e1c0d44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e21800640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5e1c06c120 0x7f5e1c161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:59678/0 (socket says 172.21.15.18:59678) 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e21800640 1 -- 172.21.15.18:0/102186722 learned_addr learned my addr 172.21.15.18:0/102186722 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e1be00640 1 -- 172.21.15.18:0/102186722 >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 msgr2=0x7f5e1c0b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:53.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e1be00640 1 --2- 172.21.15.18:0/102186722 >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 0x7f5e1c0b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e1be00640 1 -- 172.21.15.18:0/102186722 >> v1:172.21.15.167:6789/0 conn(0x7f5e1c06c120 legacy=0x7f5e1c161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e1be00640 1 -- 172.21.15.18:0/102186722 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0cec60 con 0x7f5e1c0b2780 2024-04-25T10:03:53.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.617+0000 7f5e20e00640 1 --2- 172.21.15.18:0/102186722 >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 0x7f5e1c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:03:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e1be00640 1 --2- 172.21.15.18:0/102186722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 0x7f5e1c0d44c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097c0 tx=0x7f5e0801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adae1881cae05aec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e1b400640 1 -- 172.21.15.18:0/102186722 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080aa620 con 0x7f5e1c0b2780 2024-04-25T10:03:53.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e1b400640 1 -- 172.21.15.18:0/102186722 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e080af070 con 0x7f5e1c0b2780 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e1b400640 1 -- 172.21.15.18:0/102186722 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e080aa9e0 con 0x7f5e1c0b2780 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 -- 172.21.15.18:0/102186722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 msgr2=0x7f5e1c0d44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 --2- 172.21.15.18:0/102186722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 0x7f5e1c0d44c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5e080097c0 tx=0x7f5e0801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 -- 172.21.15.18:0/102186722 shutdown_connections 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 --2- 172.21.15.18:0/102186722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c0b2780 0x7f5e1c0d44c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 --2- 172.21.15.18:0/102186722 >> v2:172.21.15.167:3300/0 conn(0x7f5e1c1611c0 0x7f5e1c0b6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 -- 172.21.15.18:0/102186722 >> 172.21.15.18:0/102186722 conn(0x7f5e1c0b5ae0 msgr2=0x7f5e1c0d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 -- 172.21.15.18:0/102186722 shutdown_connections 2024-04-25T10:03:53.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.621+0000 7f5e23800640 1 -- 172.21.15.18:0/102186722 wait complete. 2024-04-25T10:03:53.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 Processor -- start 2024-04-25T10:03:53.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- start start 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 0x7f5e1c0c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 0x7f5e1c0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c16b020 con 0x7f5e1c06c120 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c16aea0 con 0x7f5e1c0b2780 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c16b1a0 con 0x7f5e1c1611c0 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37212/0 (socket says 172.21.15.18:37212) 2024-04-25T10:03:53.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 -- 172.21.15.18:0/2577874578 learned_addr learned my addr 172.21.15.18:0/2577874578 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e1be00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 0x7f5e1c0c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e21800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 0x7f5e1c0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 -- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 msgr2=0x7f5e1c0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 0x7f5e1c0b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 -- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 msgr2=0x7f5e1c0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 0x7f5e1c0c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 -- 172.21.15.18:0/2577874578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0c9200 con 0x7f5e1c06c120 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e1be00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 0x7f5e1c0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:53.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e21800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 0x7f5e1c0b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e20e00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000ec10 tx=0x7f5e1000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10017070 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1000cc30 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e1c0c94e0 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10013470 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c0c9aa0 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.625+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c0745d0 con 0x7f5e1c06c120 2024-04-25T10:03:53.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.629+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5e1001a070 con 0x7f5e1c06c120 2024-04-25T10:03:53.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.629+0000 7f5e18c00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 0x7f5dfc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.629+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5e10085060 con 0x7f5e1c06c120 2024-04-25T10:03:53.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.629+0000 7f5e1be00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 0x7f5dfc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.629+0000 7f5e1be00640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 0x7f5dfc069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e080ae000 tx=0x7f5e08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.633+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5e10056330 con 0x7f5e1c06c120 2024-04-25T10:03:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5e1c06cf60 con 0x7f5e1c06c120 2024-04-25T10:03:53.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e18c00640 1 -- 172.21.15.18:0/2577874578 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5e10055c30 con 0x7f5e1c06c120 2024-04-25T10:03:53.810 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:03:53.810 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:03:53.811 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 msgr2=0x7f5dfc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 0x7f5dfc069450 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e080ae000 tx=0x7f5e08008040 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 msgr2=0x7f5e1c151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5e1000ec10 tx=0x7f5e1000c520 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 shutdown_connections 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dfc066f90 0x7f5dfc069450 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e1c1611c0 0x7f5e1c0b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e1c0b2780 0x7f5e1c0c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 --2- 172.21.15.18:0/2577874578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e1c06c120 0x7f5e1c151d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 >> 172.21.15.18:0/2577874578 conn(0x7f5e1c0b5ae0 msgr2=0x7f5e1c0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 shutdown_connections 2024-04-25T10:03:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.801+0000 7f5e23800640 1 -- 172.21.15.18:0/2577874578 wait complete. 2024-04-25T10:03:53.834 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:03:53.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:03:53.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 Processor -- start 2024-04-25T10:03:53.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 -- start start 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb84071250 0x7fdb840cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb8415bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 0x7fdb8415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8415ccc0 con 0x7fdb84071250 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb8415c740 con 0x7fdb8415c2d0 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb89600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84160200 con 0x7fdb84071630 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb84071250 0x7fdb840cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb84071250 0x7fdb840cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37224/0 (socket says 172.21.15.18:37224) 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 -- 172.21.15.18:0/2875637736 learned_addr learned my addr 172.21.15.18:0/2875637736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:53.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb7be00640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb8415bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb83400640 1 --2- 172.21.15.18:0/2875637736 >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 0x7fdb8415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 -- 172.21.15.18:0/2875637736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 msgr2=0x7fdb8415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb8415bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 -- 172.21.15.18:0/2875637736 >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 msgr2=0x7fdb8415cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 --2- 172.21.15.18:0/2875637736 >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 0x7fdb8415cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb82a00640 1 -- 172.21.15.18:0/2875637736 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8415c9e0 con 0x7fdb84071250 2024-04-25T10:03:53.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.969+0000 7fdb83400640 1 --2- 172.21.15.18:0/2875637736 >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 0x7fdb8415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:53.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb82a00640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb84071250 0x7fdb840cdf90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb840711e0 tx=0x7fdb7401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d9674288c8a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb82000640 1 -- 172.21.15.18:0/2875637736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740b0070 con 0x7fdb84071250 2024-04-25T10:03:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb82000640 1 -- 172.21.15.18:0/2875637736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb740ab600 con 0x7fdb84071250 2024-04-25T10:03:53.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb82000640 1 -- 172.21.15.18:0/2875637736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb740ab9d0 con 0x7fdb84071250 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 -- 172.21.15.18:0/2875637736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb84071250 msgr2=0x7fdb840cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb84071250 0x7fdb840cdf90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb840711e0 tx=0x7fdb7401c400 comp rx=0 tx=0).stop 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 -- 172.21.15.18:0/2875637736 shutdown_connections 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 --2- 172.21.15.18:0/2875637736 >> v2:172.21.15.167:3300/0 conn(0x7fdb8415c2d0 0x7fdb8415cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb8415bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 --2- 172.21.15.18:0/2875637736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb84071250 0x7fdb840cdf90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 -- 172.21.15.18:0/2875637736 >> 172.21.15.18:0/2875637736 conn(0x7fdb8406ac10 msgr2=0x7fdb8406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:53.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 -- 172.21.15.18:0/2875637736 shutdown_connections 2024-04-25T10:03:53.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.973+0000 7fdb89600640 1 -- 172.21.15.18:0/2875637736 wait complete. 2024-04-25T10:03:53.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 Processor -- start 2024-04-25T10:03:53.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- start start 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb84071250 0x7fdb84154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb84150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84071b90 con 0x7fdb8415c2d0 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb84071a10 con 0x7fdb84071250 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb8406d2b0 con 0x7fdb84071630 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37230/0 (socket says 172.21.15.18:37230) 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 -- 172.21.15.18:0/1058374361 learned_addr learned my addr 172.21.15.18:0/1058374361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb82a00640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb84071250 0x7fdb84154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb7be00640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb84150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 -- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 msgr2=0x7fdb84150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb84150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 -- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb84071250 msgr2=0x7fdb84154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb84071250 0x7fdb84154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 -- 172.21.15.18:0/1058374361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb841545a0 con 0x7fdb8415c2d0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb83400640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c007e20 tx=0x7fdb7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c01a070 con 0x7fdb8415c2d0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb7c003ba0 con 0x7fdb8415c2d0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00de80 con 0x7fdb8415c2d0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb84154840 con 0x7fdb8415c2d0 2024-04-25T10:03:53.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.977+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb84154e00 con 0x7fdb8415c2d0 2024-04-25T10:03:53.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb840745d0 con 0x7fdb8415c2d0 2024-04-25T10:03:53.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb7c01d070 con 0x7fdb8415c2d0 2024-04-25T10:03:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb7aa00640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 0x7fdb60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdb7c084f90 con 0x7fdb8415c2d0 2024-04-25T10:03:53.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb82a00640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 0x7fdb60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:53.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.981+0000 7fdb82a00640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 0x7fdb60069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ad000 tx=0x7fdb74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:53.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:53.985+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb7c010070 con 0x7fdb8415c2d0 2024-04-25T10:03:54.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.149+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdb8406c250 con 0x7fdb8415c2d0 2024-04-25T10:03:54.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.725+0000 7fdb7aa00640 1 -- 172.21.15.18:0/1058374361 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdb7c055c00 con 0x7fdb8415c2d0 2024-04-25T10:03:54.734 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:03:54.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 msgr2=0x7fdb60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 0x7fdb60069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdb740ad000 tx=0x7fdb74008040 comp rx=0 tx=0).stop 2024-04-25T10:03:54.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 msgr2=0x7fdb84152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c007e20 tx=0x7fdb7c00d4a0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 shutdown_connections 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415c2d0 0x7fdb84152e40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdb60066f60 0x7fdb60069420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb84071630 0x7fdb84150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 --2- 172.21.15.18:0/1058374361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb84071250 0x7fdb84154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 >> 172.21.15.18:0/1058374361 conn(0x7fdb8406ac10 msgr2=0x7fdb84151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 shutdown_connections 2024-04-25T10:03:54.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.729+0000 7fdb89600640 1 -- 172.21.15.18:0/1058374361 wait complete. 2024-04-25T10:03:54.766 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T10:03:54.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 Processor -- start 2024-04-25T10:03:54.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 -- start start 2024-04-25T10:03:54.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f764015acd0 0x7f764015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764015bc40 con 0x7f7640144120 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764015e490 con 0x7f764015acd0 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7646a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764015b150 con 0x7f764015ee60 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f763f400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f764015acd0 0x7f764015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53214/0 (socket says 172.21.15.18:53214) 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 -- 172.21.15.18:0/3507174368 learned_addr learned my addr 172.21.15.18:0/3507174368 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:54.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 -- 172.21.15.18:0/3507174368 >> v2:172.21.15.167:3300/0 conn(0x7f764015acd0 msgr2=0x7f764015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:54.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 --2- 172.21.15.18:0/3507174368 >> v2:172.21.15.167:3300/0 conn(0x7f764015acd0 0x7f764015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 -- 172.21.15.18:0/3507174368 >> v1:172.21.15.167:6789/0 conn(0x7f7640144120 legacy=0x7f76400ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f7644a00640 1 -- 172.21.15.18:0/3507174368 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764015b3a0 con 0x7f764015ee60 2024-04-25T10:03:54.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.909+0000 7f763ea00640 1 -- 172.21.15.18:0/3507174368 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845664444 0 0) 0x7f764015bc40 con 0x7f7640144120 2024-04-25T10:03:54.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7644a00640 1 --2- 172.21.15.18:0/3507174368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7638009e50 tx=0x7f763801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f10968747d2f988e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:54.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f763ea00640 1 -- 172.21.15.18:0/3507174368 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380a5660 con 0x7f764015ee60 2024-04-25T10:03:54.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f763ea00640 1 -- 172.21.15.18:0/3507174368 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76380a5800 con 0x7f764015ee60 2024-04-25T10:03:54.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f763ea00640 1 -- 172.21.15.18:0/3507174368 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76380a5bd0 con 0x7f764015ee60 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 -- 172.21.15.18:0/3507174368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 msgr2=0x7f76400b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 --2- 172.21.15.18:0/3507174368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7638009e50 tx=0x7f763801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 -- 172.21.15.18:0/3507174368 shutdown_connections 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 --2- 172.21.15.18:0/3507174368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015ee60 0x7f76400b3090 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 --2- 172.21.15.18:0/3507174368 >> v2:172.21.15.167:3300/0 conn(0x7f764015acd0 0x7f764015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 -- 172.21.15.18:0/3507174368 >> 172.21.15.18:0/3507174368 conn(0x7f7640067080 msgr2=0x7f764006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 -- 172.21.15.18:0/3507174368 shutdown_connections 2024-04-25T10:03:54.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.913+0000 7f7646a00640 1 -- 172.21.15.18:0/3507174368 wait complete. 2024-04-25T10:03:54.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 Processor -- start 2024-04-25T10:03:54.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- start start 2024-04-25T10:03:54.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 0x7f764015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f764015ee60 0x7f7640158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764006d450 con 0x7f7640144120 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764006d2d0 con 0x7f764015ee60 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764006d5d0 con 0x7f764015acd0 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37240/0 (socket says 172.21.15.18:37240) 2024-04-25T10:03:54.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 -- 172.21.15.18:0/2131854689 learned_addr learned my addr 172.21.15.18:0/2131854689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:54.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7644a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f764015ee60 0x7f7640158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763f400640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 0x7f764015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 -- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 msgr2=0x7f764015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 0x7f764015bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 -- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f764015ee60 msgr2=0x7f7640158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f764015ee60 0x7f7640158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 -- 172.21.15.18:0/2131854689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76401647d0 con 0x7f7640144120 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763f400640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 0x7f764015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f763fe00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f763000c4d0 tx=0x7f763000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630017070 con 0x7f7640144120 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7630005480 con 0x7f7640144120 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764015cc90 con 0x7f7640144120 2024-04-25T10:03:54.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7630003840 con 0x7f7640144120 2024-04-25T10:03:54.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76400b0610 con 0x7f7640144120 2024-04-25T10:03:54.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.917+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76400745d0 con 0x7f7640144120 2024-04-25T10:03:54.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.921+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f763001a070 con 0x7f7640144120 2024-04-25T10:03:54.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.921+0000 7f7637e00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 0x7f7620069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:54.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.921+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f76300842e0 con 0x7f7640144120 2024-04-25T10:03:54.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.921+0000 7f763f400640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 0x7f7620069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:54.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.921+0000 7f763f400640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 0x7f7620069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f76400b4840 tx=0x7f762c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:54.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:54.925+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76300554f0 con 0x7f7640144120 2024-04-25T10:03:55.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.089+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f764006ad90 con 0x7f7640144120 2024-04-25T10:03:55.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7637e00640 1 -- 172.21.15.18:0/2131854689 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7630054df0 con 0x7f7640144120 2024-04-25T10:03:55.741 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 msgr2=0x7f7620069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 0x7f7620069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f76400b4840 tx=0x7f762c008040 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 msgr2=0x7f764015c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f763000c4d0 tx=0x7f763000c990 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 shutdown_connections 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f764015ee60 0x7f7640158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7620066f60 0x7f7620069420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f764015acd0 0x7f764015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 --2- 172.21.15.18:0/2131854689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7640144120 0x7f764015c590 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 >> 172.21.15.18:0/2131854689 conn(0x7f7640067080 msgr2=0x7f7640140dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 shutdown_connections 2024-04-25T10:03:55.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.733+0000 7f7646a00640 1 -- 172.21.15.18:0/2131854689 wait complete. 2024-04-25T10:03:55.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:03:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.917+0000 7fc58e600640 1 Processor -- start 2024-04-25T10:03:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.917+0000 7fc58e600640 1 -- start start 2024-04-25T10:03:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc58e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc5880d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc58e600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58815e040 con 0x7fc58815dc60 2024-04-25T10:03:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc58e600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5880cff80 con 0x7fc58806bf30 2024-04-25T10:03:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc58e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880d0260 con 0x7fc58809a170 2024-04-25T10:03:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc587400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc58815dc60 0x7fc588099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55070/0 (socket says 172.21.15.18:55070) 2024-04-25T10:03:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc587400640 1 -- 172.21.15.18:0/1741436495 learned_addr learned my addr 172.21.15.18:0/1741436495 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586a00640 1 --2- 172.21.15.18:0/1741436495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc5880d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368470006 0 0) 0x7fc58815e040 con 0x7fc58815dc60 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56c003530 con 0x7fc58815dc60 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450416134 0 0) 0x7fc5880cff80 con 0x7fc58806bf30 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58815e040 con 0x7fc58806bf30 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586a00640 1 -- 172.21.15.18:0/1741436495 >> v1:172.21.15.167:6789/0 conn(0x7fc58806bf30 legacy=0x7fc5880cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586a00640 1 -- 172.21.15.18:0/1741436495 >> v1:172.21.15.18:6789/0 conn(0x7fc58815dc60 legacy=0x7fc588099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.921+0000 7fc586a00640 1 -- 172.21.15.18:0/1741436495 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880d0540 con 0x7fc58809a170 2024-04-25T10:03:55.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc586a00640 1 --2- 172.21.15.18:0/1741436495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc5880d1020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5740097f0 tx=0x7fc57401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bdf332b25b62672 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:55.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740ab620 con 0x7fc58809a170 2024-04-25T10:03:55.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5740b0070 con 0x7fc58809a170 2024-04-25T10:03:55.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc586000640 1 -- 172.21.15.18:0/1741436495 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5740ab9e0 con 0x7fc58809a170 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- 172.21.15.18:0/1741436495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 msgr2=0x7fc5880d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 --2- 172.21.15.18:0/1741436495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc5880d1020 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc5740097f0 tx=0x7fc57401c420 comp rx=0 tx=0).stop 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- 172.21.15.18:0/1741436495 shutdown_connections 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 --2- 172.21.15.18:0/1741436495 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc5880d1020 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- 172.21.15.18:0/1741436495 >> 172.21.15.18:0/1741436495 conn(0x7fc5880b3200 msgr2=0x7fc5880b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- 172.21.15.18:0/1741436495 shutdown_connections 2024-04-25T10:03:55.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- 172.21.15.18:0/1741436495 wait complete. 2024-04-25T10:03:55.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 Processor -- start 2024-04-25T10:03:55.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 -- start start 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc58806bf30 0x7fc58815b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc588154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.925+0000 7fc58e600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58806cfa0 con 0x7fc58815dc60 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880cc880 con 0x7fc58806bf30 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58815b4d0 con 0x7fc58809a170 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37246/0 (socket says 172.21.15.18:37246) 2024-04-25T10:03:55.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 -- 172.21.15.18:0/1282964971 learned_addr learned my addr 172.21.15.18:0/1282964971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc586a00640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc588154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587400640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc58806bf30 0x7fc58815b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 -- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 msgr2=0x7fc588154740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc588154740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 -- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc58806bf30 msgr2=0x7fc58815b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc58806bf30 0x7fc58815b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:55.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 -- 172.21.15.18:0/1282964971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58815a900 con 0x7fc58815dc60 2024-04-25T10:03:55.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc587e00640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c790 tx=0x7fc58000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:55.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580003b80 con 0x7fc58815dc60 2024-04-25T10:03:55.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc580003d20 con 0x7fc58815dc60 2024-04-25T10:03:55.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000aa50 con 0x7fc58815dc60 2024-04-25T10:03:55.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc588154c80 con 0x7fc58815dc60 2024-04-25T10:03:55.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58815ae80 con 0x7fc58815dc60 2024-04-25T10:03:55.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5880745d0 con 0x7fc58815dc60 2024-04-25T10:03:55.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.929+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc58000abf0 con 0x7fc58815dc60 2024-04-25T10:03:55.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.933+0000 7fc57f400640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 0x7fc568069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:55.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.933+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc580084ff0 con 0x7fc58815dc60 2024-04-25T10:03:55.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.933+0000 7fc587400640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 0x7fc568069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:55.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.933+0000 7fc587400640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 0x7fc568069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5780011f0 tx=0x7fc578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:55.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:55.937+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc580056020 con 0x7fc58815dc60 2024-04-25T10:03:56.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.133+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc588169880 con 0x7fc58815dc60 2024-04-25T10:03:56.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.733+0000 7fc57f400640 1 -- 172.21.15.18:0/1282964971 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc580055920 con 0x7fc58815dc60 2024-04-25T10:03:56.743 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T10:03:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.737+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 msgr2=0x7fc568069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.737+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 0x7fc568069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc5780011f0 tx=0x7fc578009040 comp rx=0 tx=0).stop 2024-04-25T10:03:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.737+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 msgr2=0x7fc5880ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.737+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc58000c790 tx=0x7fc58000cc50 comp rx=0 tx=0).stop 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 shutdown_connections 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815dc60 0x7fc5880ca830 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc568066f60 0x7fc568069420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc58809a170 0x7fc588154740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 --2- 172.21.15.18:0/1282964971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc58806bf30 0x7fc58815b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 >> 172.21.15.18:0/1282964971 conn(0x7fc5880b3200 msgr2=0x7fc5881556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:56.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 shutdown_connections 2024-04-25T10:03:56.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.741+0000 7fc58e600640 1 -- 172.21.15.18:0/1282964971 wait complete. 2024-04-25T10:03:56.799 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T10:03:56.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T10:03:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 Processor -- start 2024-04-25T10:03:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 -- start start 2024-04-25T10:03:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe45c15eda0 0x7fe45c070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe45c06f3f0 0x7fe45c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe45c070200 con 0x7fe45c06fdb0 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0714d0 con 0x7fe45c15eda0 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe463000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45c0711f0 con 0x7fe45c06f3f0 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe462600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe45c06fdb0 0x7fe45c15f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55084/0 (socket says 172.21.15.18:55084) 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe462600640 1 -- 172.21.15.18:0/4134968412 learned_addr learned my addr 172.21.15.18:0/4134968412 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe461c00640 1 --2- 172.21.15.18:0/4134968412 >> v2:172.21.15.18:3300/0 conn(0x7fe45c15eda0 0x7fe45c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe461200640 1 --2- 172.21.15.18:0/4134968412 >> v2:172.21.15.167:3300/0 conn(0x7fe45c06f3f0 0x7fe45c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.937+0000 7fe461c00640 1 -- 172.21.15.18:0/4134968412 >> v2:172.21.15.167:3300/0 conn(0x7fe45c06f3f0 msgr2=0x7fe45c06f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe461c00640 1 --2- 172.21.15.18:0/4134968412 >> v2:172.21.15.167:3300/0 conn(0x7fe45c06f3f0 0x7fe45c06f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe461c00640 1 -- 172.21.15.18:0/4134968412 >> v1:172.21.15.18:6789/0 conn(0x7fe45c06fdb0 legacy=0x7fe45c15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe461c00640 1 -- 172.21.15.18:0/4134968412 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0cf320 con 0x7fe45c15eda0 2024-04-25T10:03:56.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe45be00640 1 -- 172.21.15.18:0/4134968412 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049070665 0 0) 0x7fe45c070200 con 0x7fe45c06fdb0 2024-04-25T10:03:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe461c00640 1 --2- 172.21.15.18:0/4134968412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c15eda0 0x7fe45c070590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe45c068960 tx=0x7fe45001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a427009c6898b6a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe45be00640 1 -- 172.21.15.18:0/4134968412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500b0070 con 0x7fe45c15eda0 2024-04-25T10:03:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe45be00640 1 -- 172.21.15.18:0/4134968412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe450004230 con 0x7fe45c15eda0 2024-04-25T10:03:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe45be00640 1 -- 172.21.15.18:0/4134968412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c1603e0 con 0x7fe45c15eda0 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 -- 172.21.15.18:0/4134968412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c15eda0 msgr2=0x7fe45c070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 --2- 172.21.15.18:0/4134968412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c15eda0 0x7fe45c070590 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe45c068960 tx=0x7fe45001c480 comp rx=0 tx=0).stop 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 -- 172.21.15.18:0/4134968412 shutdown_connections 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 --2- 172.21.15.18:0/4134968412 >> v2:172.21.15.167:3300/0 conn(0x7fe45c06f3f0 0x7fe45c06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 --2- 172.21.15.18:0/4134968412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c15eda0 0x7fe45c070590 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 -- 172.21.15.18:0/4134968412 >> 172.21.15.18:0/4134968412 conn(0x7fe45c0d15b0 msgr2=0x7fe45c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 -- 172.21.15.18:0/4134968412 shutdown_connections 2024-04-25T10:03:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.941+0000 7fe463000640 1 -- 172.21.15.18:0/4134968412 wait complete. 2024-04-25T10:03:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 Processor -- start 2024-04-25T10:03:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- start start 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45c06fdb0 0x7fe45c1f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 0x7fe45c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c099be0 con 0x7fe45c06f3f0 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c099a60 con 0x7fe45c15eda0 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c168800 con 0x7fe45c06fdb0 2024-04-25T10:03:56.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37260/0 (socket says 172.21.15.18:37260) 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 -- 172.21.15.18:0/2465914740 learned_addr learned my addr 172.21.15.18:0/2465914740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe462600640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 0x7fe45c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461200640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45c06fdb0 0x7fe45c1f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 -- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45c06fdb0 msgr2=0x7fe45c1f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45c06fdb0 0x7fe45c1f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 -- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 msgr2=0x7fe45c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 0x7fe45c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 -- 172.21.15.18:0/2465914740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0c93b0 con 0x7fe45c06f3f0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe462600640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 0x7fe45c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe461c00640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4500ae040 tx=0x7fe450019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500b9070 con 0x7fe45c06f3f0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4500043e0 con 0x7fe45c06f3f0 2024-04-25T10:03:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4500b0040 con 0x7fe45c06f3f0 2024-04-25T10:03:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0c9690 con 0x7fe45c06f3f0 2024-04-25T10:03:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.945+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c0c9c50 con 0x7fe45c06f3f0 2024-04-25T10:03:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c0745d0 con 0x7fe45c06f3f0 2024-04-25T10:03:56.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4500bc070 con 0x7fe45c06f3f0 2024-04-25T10:03:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe459600640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe45011f240 con 0x7fe45c06f3f0 2024-04-25T10:03:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe461200640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:56.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.949+0000 7fe461200640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe44800b930 tx=0x7fe448008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:56.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:56.953+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe450016070 con 0x7fe45c06f3f0 2024-04-25T10:03:57.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.121+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe45c15e560 con 0x7fe45c06f3f0 2024-04-25T10:03:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.753+0000 7fe459600640 1 -- 172.21.15.18:0/2465914740 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe4500f0360 con 0x7fe45c06f3f0 2024-04-25T10:03:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.753+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 msgr2=0x7fe43c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.753+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe44800b930 tx=0x7fe448008040 comp rx=0 tx=0).stop 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.753+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 msgr2=0x7fe45c154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.753+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe4500ae040 tx=0x7fe450019220 comp rx=0 tx=0).stop 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 shutdown_connections 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe45c15eda0 0x7fe45c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45c06fdb0 0x7fe45c1f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 --2- 172.21.15.18:0/2465914740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe45c06f3f0 0x7fe45c154e90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 >> 172.21.15.18:0/2465914740 conn(0x7fe45c0d15b0 msgr2=0x7fe45c0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:57.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 shutdown_connections 2024-04-25T10:03:57.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.757+0000 7fe463000640 1 -- 172.21.15.18:0/2465914740 wait complete. 2024-04-25T10:03:57.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:03:57.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 Processor -- start 2024-04-25T10:03:57.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 -- start start 2024-04-25T10:03:57.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c600cef30 0x7f9c6006e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 0x7f9c600cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6015ac30 con 0x7f9c600ccc10 2024-04-25T10:03:57.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c600b29b0 con 0x7f9c600cef30 2024-04-25T10:03:57.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c68600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600cf310 con 0x7f9c6006ec40 2024-04-25T10:03:57.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 0x7f9c600cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c600cef30 0x7f9c6006e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 0x7f9c600cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53272/0 (socket says 172.21.15.18:53272) 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65200640 1 -- 172.21.15.18:0/2126663265 learned_addr learned my addr 172.21.15.18:0/2126663265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c600cef30 0x7f9c6006e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:33266/0 (socket says 172.21.15.18:33266) 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c66600640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9c600ccc10 0x7f9c60071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:59690/0 (socket says 172.21.15.18:59690) 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 -- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 msgr2=0x7f9c600cc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 0x7f9c600cc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 -- 172.21.15.18:0/2126663265 >> v1:172.21.15.167:6789/0 conn(0x7f9c600ccc10 legacy=0x7f9c60071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.933+0000 7f9c65c00640 1 -- 172.21.15.18:0/2126663265 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6015aef0 con 0x7f9c600cef30 2024-04-25T10:03:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c600cef30 0x7f9c6006e700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c600b2b30 tx=0x7f9c5401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c52cd7e07171a323 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c5fe00640 1 -- 172.21.15.18:0/2126663265 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540b2070 con 0x7f9c600cef30 2024-04-25T10:03:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c5fe00640 1 -- 172.21.15.18:0/2126663265 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c540ad640 con 0x7f9c600cef30 2024-04-25T10:03:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c5fe00640 1 -- 172.21.15.18:0/2126663265 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c540ada10 con 0x7f9c600cef30 2024-04-25T10:03:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 -- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c600cef30 msgr2=0x7f9c6006e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 --2- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c600cef30 0x7f9c6006e700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c600b2b30 tx=0x7f9c5401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 -- 172.21.15.18:0/2126663265 shutdown_connections 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 --2- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c6006ec40 0x7f9c600cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 --2- 172.21.15.18:0/2126663265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c600cef30 0x7f9c6006e700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 -- 172.21.15.18:0/2126663265 >> 172.21.15.18:0/2126663265 conn(0x7f9c60067000 msgr2=0x7f9c6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 -- 172.21.15.18:0/2126663265 shutdown_connections 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.937+0000 7f9c68600640 1 -- 172.21.15.18:0/2126663265 wait complete. 2024-04-25T10:03:57.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 Processor -- start 2024-04-25T10:03:57.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- start start 2024-04-25T10:03:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 0x7f9c60148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c600ccc10 0x7f9c60154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6006d2d0 con 0x7f9c600cef30 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c600cd020 con 0x7f9c6006ec40 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6006d450 con 0x7f9c600ccc10 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37268/0 (socket says 172.21.15.18:37268) 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 -- 172.21.15.18:0/2757047666 learned_addr learned my addr 172.21.15.18:0/2757047666 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 0x7f9c60148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c65200640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c600ccc10 0x7f9c60154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 -- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c600ccc10 msgr2=0x7f9c60154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c600ccc10 0x7f9c60154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 -- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 msgr2=0x7f9c60148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 0x7f9c60148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 -- 172.21.15.18:0/2757047666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c600ae4b0 con 0x7f9c600cef30 2024-04-25T10:03:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 0x7f9c60148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c66600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c7a0 tx=0x7f9c5800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c58017070 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5800a640 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5800a9f0 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c60154140 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c600ae140 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.941+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c600745d0 con 0x7f9c600cef30 2024-04-25T10:03:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.945+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9c5801a070 con 0x7f9c600cef30 2024-04-25T10:03:57.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.945+0000 7f9c5d600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 0x7f9c40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:57.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.945+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6007+0+0 (secure 0 0 0) 0x7f9c58084730 con 0x7f9c600cef30 2024-04-25T10:03:57.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.945+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 0x7f9c40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:57.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.945+0000 7f9c65c00640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 0x7f9c40069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:57.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:57.949+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c58054fb0 con 0x7f9c600cef30 2024-04-25T10:03:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:58.109+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9c600cbdc0 con 0x7f9c600cef30 2024-04-25T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.769+0000 7f9c5d600640 1 -- 172.21.15.18:0/2757047666 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7f9c58059050 con 0x7f9c600cef30 2024-04-25T10:03:59.779 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' created 2024-04-25T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 msgr2=0x7f9c40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:59.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 0x7f9c40069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af000 tx=0x7f9c54008040 comp rx=0 tx=0).stop 2024-04-25T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 msgr2=0x7f9c60157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9c5800c7a0 tx=0x7f9c5800cc60 comp rx=0 tx=0).stop 2024-04-25T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 shutdown_connections 2024-04-25T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c600cef30 0x7f9c60157650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c40066f60 0x7f9c40069420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c600ccc10 0x7f9c60154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 --2- 172.21.15.18:0/2757047666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c6006ec40 0x7f9c60148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 >> 172.21.15.18:0/2757047666 conn(0x7f9c60067000 msgr2=0x7f9c601552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 shutdown_connections 2024-04-25T10:03:59.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.773+0000 7f9c68600640 1 -- 172.21.15.18:0/2757047666 wait complete. 2024-04-25T10:03:59.815 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T10:03:59.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.953+0000 7f9cf2c00640 1 Processor -- start 2024-04-25T10:03:59.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.953+0000 7f9cf2c00640 1 -- start start 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.953+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 0x7f9cec070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.953+0000 7f9cf2c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9cec06f3f0 0x7f9cec06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf2c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cec06fdb0 0x7f9cec15f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf2c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec0714d0 con 0x7f9cec06f3f0 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf2c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cec070240 con 0x7f9cec06fdb0 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0711f0 con 0x7f9cec15eda0 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9cec06f3f0 0x7f9cec06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9cec06f3f0 0x7f9cec06f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37280/0 (socket says 172.21.15.18:37280) 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 -- 172.21.15.18:0/4223853866 learned_addr learned my addr 172.21.15.18:0/4223853866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:59.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf2200640 1 --2- 172.21.15.18:0/4223853866 >> v2:172.21.15.167:3300/0 conn(0x7f9cec06fdb0 0x7f9cec15f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf1800640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 0x7f9cec070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 -- 172.21.15.18:0/4223853866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 msgr2=0x7f9cec070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 0x7f9cec070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 -- 172.21.15.18:0/4223853866 >> v2:172.21.15.167:3300/0 conn(0x7f9cec06fdb0 msgr2=0x7f9cec15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 --2- 172.21.15.18:0/4223853866 >> v2:172.21.15.167:3300/0 conn(0x7f9cec06fdb0 0x7f9cec15f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 -- 172.21.15.18:0/4223853866 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec0cf320 con 0x7f9cec06f3f0 2024-04-25T10:03:59.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf1800640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 0x7f9cec070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:03:59.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cf0e00640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec06f3f0 0x7f9cec06f870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0cbd20 tx=0x7f9cd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2c31544c0541f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:59.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cebe00640 1 -- 172.21.15.18:0/4223853866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80b1070 con 0x7f9cec06f3f0 2024-04-25T10:03:59.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cebe00640 1 -- 172.21.15.18:0/4223853866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80ac410 con 0x7f9cec06f3f0 2024-04-25T10:03:59.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.957+0000 7f9cebe00640 1 -- 172.21.15.18:0/4223853866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80ac7e0 con 0x7f9cec06f3f0 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- 172.21.15.18:0/4223853866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec06f3f0 msgr2=0x7f9cec06f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec06f3f0 0x7f9cec06f870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9cec0cbd20 tx=0x7f9cd801c520 comp rx=0 tx=0).stop 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- 172.21.15.18:0/4223853866 shutdown_connections 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/4223853866 >> v2:172.21.15.167:3300/0 conn(0x7f9cec06fdb0 0x7f9cec15f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec06f3f0 0x7f9cec06f870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/4223853866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec15eda0 0x7f9cec070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- 172.21.15.18:0/4223853866 >> 172.21.15.18:0/4223853866 conn(0x7f9cec0d15b0 msgr2=0x7f9cec0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- 172.21.15.18:0/4223853866 shutdown_connections 2024-04-25T10:03:59.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- 172.21.15.18:0/4223853866 wait complete. 2024-04-25T10:03:59.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 Processor -- start 2024-04-25T10:03:59.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- start start 2024-04-25T10:03:59.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec06f3f0 0x7f9cec14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cec06fdb0 0x7f9cec15d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec099be0 con 0x7f9cec15eda0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec099a60 con 0x7f9cec06fdb0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec0cc480 con 0x7f9cec06f3f0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37284/0 (socket says 172.21.15.18:37284) 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 -- 172.21.15.18:0/3915354662 learned_addr learned my addr 172.21.15.18:0/3915354662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf0e00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cec06fdb0 0x7f9cec15d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf1800640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec06f3f0 0x7f9cec14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 -- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec06f3f0 msgr2=0x7f9cec14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec06f3f0 0x7f9cec14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 -- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cec06fdb0 msgr2=0x7f9cec15d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cec06fdb0 0x7f9cec15d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 -- 172.21.15.18:0/3915354662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec149290 con 0x7f9cec15eda0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.961+0000 7f9cf2200640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007e60 tx=0x7f9ce400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:59.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4014620 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4019070 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce4014a20 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec149570 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cec149e10 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cec0745d0 con 0x7f9cec15eda0 2024-04-25T10:03:59.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ce4014bc0 con 0x7f9cec15eda0 2024-04-25T10:03:59.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 0x7f9ccc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:03:59.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f9ce4085bd0 con 0x7f9cec15eda0 2024-04-25T10:03:59.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.965+0000 7f9cf1800640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 0x7f9ccc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:03:59.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.969+0000 7f9cf1800640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 0x7f9ccc069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:03:59.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:03:59.969+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ce4056820 con 0x7f9cec15eda0 2024-04-25T10:04:00.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.133+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f9cec0b7530 con 0x7f9cec15eda0 2024-04-25T10:04:00.453 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:04:00.447+0000 7f8613c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.773+0000 7f9ce9600640 1 -- 172.21.15.18:0/3915354662 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9ce4056120 con 0x7f9cec15eda0 2024-04-25T10:04:00.781 INFO:teuthology.orchestra.run.smithi018.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T10:04:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 msgr2=0x7f9ccc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 0x7f9ccc069420 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0006fd0 tx=0x7f9ce0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 msgr2=0x7f9cec0ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ce4007e60 tx=0x7f9ce400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 shutdown_connections 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cec15eda0 0x7f9cec0ca6a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cec06fdb0 0x7f9cec15d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9ccc066f60 0x7f9ccc069420 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 --2- 172.21.15.18:0/3915354662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cec06f3f0 0x7f9cec14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 >> 172.21.15.18:0/3915354662 conn(0x7f9cec0d15b0 msgr2=0x7f9cec154410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 shutdown_connections 2024-04-25T10:04:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.777+0000 7f9cf2c00640 1 -- 172.21.15.18:0/3915354662 wait complete. 2024-04-25T10:04:00.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T10:04:00.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.961+0000 7fd79c800640 1 Processor -- start 2024-04-25T10:04:00.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.961+0000 7fd79c800640 1 -- start start 2024-04-25T10:04:00.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79c800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd79406e4a0 0x7fd79406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:00.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79c800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79415fc00 con 0x7fd79415c9b0 2024-04-25T10:04:00.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79c800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd79415fee0 con 0x7fd794159320 2024-04-25T10:04:00.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79c800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406d640 con 0x7fd79406e4a0 2024-04-25T10:04:00.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd799400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd79415c9b0 0x7fd79406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55086/0 (socket says 172.21.15.18:55086) 2024-04-25T10:04:00.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd799400640 1 -- 172.21.15.18:0/4246246505 learned_addr learned my addr 172.21.15.18:0/4246246505 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:00.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79a800640 1 --2- 172.21.15.18:0/4246246505 >> v2:172.21.15.167:3300/0 conn(0x7fd79406e4a0 0x7fd79406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092247245 0 0) 0x7fd79415fc00 con 0x7fd79415c9b0 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77c003530 con 0x7fd79415c9b0 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79a800640 1 -- 172.21.15.18:0/4246246505 >> v1:172.21.15.167:6789/0 conn(0x7fd794159320 legacy=0x7fd79415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051514996 0 0) 0x7fd79415fee0 con 0x7fd794159320 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79a800640 1 -- 172.21.15.18:0/4246246505 >> v1:172.21.15.18:6789/0 conn(0x7fd79415c9b0 legacy=0x7fd79406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.965+0000 7fd79a800640 1 -- 172.21.15.18:0/4246246505 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7941601c0 con 0x7fd79406e4a0 2024-04-25T10:04:00.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79a800640 1 --2- 172.21.15.18:0/4246246505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79406e4a0 0x7fd79406e8d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd79406d7c0 tx=0x7fd79001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fa22431fd6564bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:00.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900b2070 con 0x7fd79406e4a0 2024-04-25T10:04:00.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7900a5810 con 0x7fd79406e4a0 2024-04-25T10:04:00.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd798a00640 1 -- 172.21.15.18:0/4246246505 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900a5be0 con 0x7fd79406e4a0 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- 172.21.15.18:0/4246246505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79406e4a0 msgr2=0x7fd79406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 --2- 172.21.15.18:0/4246246505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79406e4a0 0x7fd79406e8d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd79406d7c0 tx=0x7fd79001c950 comp rx=0 tx=0).stop 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- 172.21.15.18:0/4246246505 shutdown_connections 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 --2- 172.21.15.18:0/4246246505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79406e4a0 0x7fd79406e8d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- 172.21.15.18:0/4246246505 >> 172.21.15.18:0/4246246505 conn(0x7fd794067080 msgr2=0x7fd79406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:00.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- 172.21.15.18:0/4246246505 shutdown_connections 2024-04-25T10:04:00.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- 172.21.15.18:0/4246246505 wait complete. 2024-04-25T10:04:00.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 Processor -- start 2024-04-25T10:04:00.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.969+0000 7fd79c800640 1 -- start start 2024-04-25T10:04:00.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd79406e4a0 0x7fd7940b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:00.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:00.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 0x7fd7940b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794169720 con 0x7fd794159320 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941695a0 con 0x7fd79415c9b0 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7941698a0 con 0x7fd79406e4a0 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37298/0 (socket says 172.21.15.18:37298) 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 -- 172.21.15.18:0/993844491 learned_addr learned my addr 172.21.15.18:0/993844491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79a800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 0x7fd7940b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799e00640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd79406e4a0 0x7fd7940b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 -- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd79406e4a0 msgr2=0x7fd7940b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd79406e4a0 0x7fd7940b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 -- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 msgr2=0x7fd7940b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 0x7fd7940b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:00.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 -- 172.21.15.18:0/993844491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7940b3f40 con 0x7fd794159320 2024-04-25T10:04:00.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79a800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 0x7fd7940b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:00.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd799400640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c480 tx=0x7fd78400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784017070 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784005cf0 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79413fe60 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784007290 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940af7a0 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7940745d0 con 0x7fd794159320 2024-04-25T10:04:00.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.973+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd78401a070 con 0x7fd794159320 2024-04-25T10:04:00.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.977+0000 7fd78e000640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 0x7fd778069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:00.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.977+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6500+0+0 (secure 0 0 0) 0x7fd784084710 con 0x7fd794159320 2024-04-25T10:04:00.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.977+0000 7fd799e00640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 0x7fd778069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:00.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.977+0000 7fd799e00640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 0x7fd778069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd788007fd0 tx=0x7fd788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:00.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:00.981+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd784054da0 con 0x7fd794159320 2024-04-25T10:04:01.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.173+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fd7940af1f0 con 0x7fd794159320 2024-04-25T10:04:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd78e000640 1 -- 172.21.15.18:0/993844491 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fd784058e40 con 0x7fd794159320 2024-04-25T10:04:01.793 INFO:teuthology.orchestra.run.smithi018.stderr:added data pool 4 to fsmap 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 msgr2=0x7fd778069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 0x7fd778069420 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd788007fd0 tx=0x7fd788009040 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 msgr2=0x7fd794157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd78400c480 tx=0x7fd78400c940 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 shutdown_connections 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd79415c9b0 0x7fd7940b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd794159320 0x7fd794157f10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd778066f60 0x7fd778069420 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 --2- 172.21.15.18:0/993844491 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd79406e4a0 0x7fd7940b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 >> 172.21.15.18:0/993844491 conn(0x7fd794067080 msgr2=0x7fd7940cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 shutdown_connections 2024-04-25T10:04:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.785+0000 7fd79c800640 1 -- 172.21.15.18:0/993844491 wait complete. 2024-04-25T10:04:01.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:01.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 Processor -- start 2024-04-25T10:04:01.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 -- start start 2024-04-25T10:04:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80cc4e0 con 0x7fcbc80b1e60 2024-04-25T10:04:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80ce040 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.953+0000 7fcbcde00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8145650 con 0x7fcbc8145270 2024-04-25T10:04:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc7400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcbc80b1e60 0x7fcbc815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55950/0 (socket says 172.21.15.18:55950) 2024-04-25T10:04:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc7400640 1 -- 172.21.15.18:0/2842935872 learned_addr learned my addr 172.21.15.18:0/2842935872 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6a00640 1 --2- 172.21.15.18:0/2842935872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763979381 0 0) 0x7fcbc80cc4e0 con 0x7fcbc80b1e60 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac003530 con 0x7fcbc80b1e60 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456684191 0 0) 0x7fcbc80ce040 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc80cc4e0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6a00640 1 -- 172.21.15.18:0/2842935872 >> v1:172.21.15.167:6789/0 conn(0x7fcbc80cd4d0 legacy=0x7fcbc80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6a00640 1 -- 172.21.15.18:0/2842935872 >> v1:172.21.15.18:6789/0 conn(0x7fcbc80b1e60 legacy=0x7fcbc815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6a00640 1 -- 172.21.15.18:0/2842935872 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80ce320 con 0x7fcbc8145270 2024-04-25T10:04:01.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.957+0000 7fcbc6a00640 1 --2- 172.21.15.18:0/2842935872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815fe50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097f0 tx=0x7fcbb801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e13d22416436e2f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:01.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80aa610 con 0x7fcbc8145270 2024-04-25T10:04:01.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80af070 con 0x7fcbc8145270 2024-04-25T10:04:01.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbc6000640 1 -- 172.21.15.18:0/2842935872 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80aa9d0 con 0x7fcbc8145270 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- 172.21.15.18:0/2842935872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 msgr2=0x7fcbc815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 --2- 172.21.15.18:0/2842935872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815fe50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097f0 tx=0x7fcbb801c4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- 172.21.15.18:0/2842935872 shutdown_connections 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 --2- 172.21.15.18:0/2842935872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815fe50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- 172.21.15.18:0/2842935872 >> 172.21.15.18:0/2842935872 conn(0x7fcbc8066fa0 msgr2=0x7fcbc806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- 172.21.15.18:0/2842935872 shutdown_connections 2024-04-25T10:04:01.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- 172.21.15.18:0/2842935872 wait complete. 2024-04-25T10:04:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 Processor -- start 2024-04-25T10:04:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- start start 2024-04-25T10:04:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b1e60 0x7fcbc80b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8169720 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80cdcc0 con 0x7fcbc80b1e60 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbcde00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc81698a0 con 0x7fcbc8145270 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32870/0 (socket says 172.21.15.18:32870) 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 -- 172.21.15.18:0/1116597983 learned_addr learned my addr 172.21.15.18:0/1116597983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbc6a00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b1e60 0x7fcbc80b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbc7400640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 -- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 msgr2=0x7fcbc815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 -- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b1e60 msgr2=0x7fcbc80b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b1e60 0x7fcbc80b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.961+0000 7fcbbfe00640 1 -- 172.21.15.18:0/1116597983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc813ebe0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbfe00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c500 tx=0x7fcbb000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00052d0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb0005490 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0012850 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc80b16a0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc813e900 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc80745d0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcbb00129f0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 0x7fcba4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:01.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcbb0084fe0 con 0x7fcbc80cd4d0 2024-04-25T10:04:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.965+0000 7fcbc6a00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 0x7fcba4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.969+0000 7fcbc6a00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 0x7fcba4069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80ae000 tx=0x7fcbb80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:01.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:01.969+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcbb0055c40 con 0x7fcbc80cd4d0 2024-04-25T10:04:02.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.165+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc806b8e0 con 0x7fcbc80cd4d0 2024-04-25T10:04:02.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.165+0000 7fcbbf400640 1 -- 172.21.15.18:0/1116597983 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fcbb0055540 con 0x7fcbc80cd4d0 2024-04-25T10:04:02.177 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:02.177 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:01.180241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T10:04:02.177 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-25T10:04:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 msgr2=0x7fcba4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 0x7fcba4069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80ae000 tx=0x7fcbb80a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 msgr2=0x7fcbc80b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcbb000c500 tx=0x7fcbb000c9c0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 shutdown_connections 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcba4066f60 0x7fcba4069420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbc8145270 0x7fcbc815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbc80cd4d0 0x7fcbc80b33d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 --2- 172.21.15.18:0/1116597983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbc80b1e60 0x7fcbc80b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 >> 172.21.15.18:0/1116597983 conn(0x7fcbc8066fa0 msgr2=0x7fcbc815e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:02.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 shutdown_connections 2024-04-25T10:04:02.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.169+0000 7fcbcde00640 1 -- 172.21.15.18:0/1116597983 wait complete. 2024-04-25T10:04:02.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:02.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.329+0000 7f312ac00640 1 Processor -- start 2024-04-25T10:04:02.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.329+0000 7f312ac00640 1 -- start start 2024-04-25T10:04:02.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 0x7f312406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31240af840 0x7f31240b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 0x7f31240aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3124146b20 con 0x7f31240af840 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31240b23e0 con 0x7f31240b1f20 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f312ac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31240acb80 con 0x7f3124146740 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31240af840 0x7f31240b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f31240af840 0x7f31240b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32884/0 (socket says 172.21.15.18:32884) 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 -- 172.21.15.18:0/3628194626 learned_addr learned my addr 172.21.15.18:0/3628194626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:02.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f3123e00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 0x7f312406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f3128c00640 1 --2- 172.21.15.18:0/3628194626 >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 0x7f31240aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 -- 172.21.15.18:0/3628194626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 msgr2=0x7f312406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 0x7f312406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 -- 172.21.15.18:0/3628194626 >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 msgr2=0x7f31240aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 --2- 172.21.15.18:0/3628194626 >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 0x7f31240aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f311be00640 1 -- 172.21.15.18:0/3628194626 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31240ace60 con 0x7f31240af840 2024-04-25T10:04:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f3123e00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 0x7f312406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:02.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.333+0000 7f3128c00640 1 --2- 172.21.15.18:0/3628194626 >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 0x7f31240aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f311be00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240af840 0x7f31240b19e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3124071070 tx=0x7f310c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b9919e272aa9e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f3123400640 1 -- 172.21.15.18:0/3628194626 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b1070 con 0x7f31240af840 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f3123400640 1 -- 172.21.15.18:0/3628194626 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c0ac620 con 0x7f31240af840 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f3123400640 1 -- 172.21.15.18:0/3628194626 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0ac9f0 con 0x7f31240af840 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- 172.21.15.18:0/3628194626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240af840 msgr2=0x7f31240b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240af840 0x7f31240b19e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3124071070 tx=0x7f310c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- 172.21.15.18:0/3628194626 shutdown_connections 2024-04-25T10:04:02.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 --2- 172.21.15.18:0/3628194626 >> v2:172.21.15.167:3300/0 conn(0x7f31240b1f20 0x7f31240aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240af840 0x7f31240b19e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 --2- 172.21.15.18:0/3628194626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3124146740 0x7f312406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- 172.21.15.18:0/3628194626 >> 172.21.15.18:0/3628194626 conn(0x7f3124066fa0 msgr2=0x7f312406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- 172.21.15.18:0/3628194626 shutdown_connections 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- 172.21.15.18:0/3628194626 wait complete. 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 Processor -- start 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.337+0000 7f312ac00640 1 -- start start 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 0x7f3124158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 0x7f312413aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3124146740 0x7f31240b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240ae2d0 con 0x7f31240b1f20 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31240ae150 con 0x7f3124146740 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3124161580 con 0x7f31240af840 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 0x7f312413aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3123e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 0x7f3124158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3128c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3124146740 0x7f31240b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3123e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 0x7f3124158210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:40384/0 (socket says 172.21.15.18:40384) 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3123e00640 1 -- 172.21.15.18:0/1689089452 learned_addr learned my addr 172.21.15.18:0/1689089452 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 -- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 msgr2=0x7f3124158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 0x7f3124158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 -- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3124146740 msgr2=0x7f31240b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3124146740 0x7f31240b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 -- 172.21.15.18:0/1689089452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124144ba0 con 0x7f31240b1f20 2024-04-25T10:04:02.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f311be00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 0x7f312413aa10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f312406f6d0 tx=0x7f310c019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0ba070 con 0x7f31240b1f20 2024-04-25T10:04:02.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c0b5600 con 0x7f31240b1f20 2024-04-25T10:04:02.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312413af50 con 0x7f31240b1f20 2024-04-25T10:04:02.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c0b1040 con 0x7f31240b1f20 2024-04-25T10:04:02.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3124145120 con 0x7f31240b1f20 2024-04-25T10:04:02.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31240745d0 con 0x7f31240b1f20 2024-04-25T10:04:02.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.341+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f310c0bd070 con 0x7f31240b1f20 2024-04-25T10:04:02.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.345+0000 7f3120c00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 0x7f3100069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.345+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f310c11e590 con 0x7f31240b1f20 2024-04-25T10:04:02.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.345+0000 7f3123e00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 0x7f3100069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.345+0000 7f3123e00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 0x7f3100069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f311400bb70 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.349+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f310c016110 con 0x7f31240b1f20 2024-04-25T10:04:02.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.513+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f312406b870 con 0x7f31240b1f20 2024-04-25T10:04:02.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.513+0000 7f3120c00640 1 -- 172.21.15.18:0/1689089452 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18503 (secure 0 0 0) 0x7f310c0eec00 con 0x7f31240b1f20 2024-04-25T10:04:02.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:02.524 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:01.179997+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 msgr2=0x7f3100069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 0x7f3100069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f311400bb70 tx=0x7f3114008040 comp rx=0 tx=0).stop 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 msgr2=0x7f312413aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 0x7f312413aa10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f312406f6d0 tx=0x7f310c019290 comp rx=0 tx=0).stop 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 shutdown_connections 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3124146740 0x7f31240b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31240b1f20 0x7f312413aa10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3100066f60 0x7f3100069420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 --2- 172.21.15.18:0/1689089452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31240af840 0x7f3124158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 >> 172.21.15.18:0/1689089452 conn(0x7f3124066fa0 msgr2=0x7f312406da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 shutdown_connections 2024-04-25T10:04:02.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.517+0000 7f312ac00640 1 -- 172.21.15.18:0/1689089452 wait complete. 2024-04-25T10:04:02.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:02.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 Processor -- start 2024-04-25T10:04:02.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 -- start start 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa46c15dad0 0x7fa46c1621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa46c15deb0 0x7fa46c0d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0ce810 con 0x7fa46c0ce250 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c0d1be0 con 0x7fa46c15dad0 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa474400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa46c162720 con 0x7fa46c15deb0 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa46c15dad0 0x7fa46c1621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa472400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa46c0ce250 0x7fa46c06c120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55960/0 (socket says 172.21.15.18:55960) 2024-04-25T10:04:02.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa472400640 1 -- 172.21.15.18:0/464634759 learned_addr learned my addr 172.21.15.18:0/464634759 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471000640 1 --2- 172.21.15.18:0/464634759 >> v2:172.21.15.167:3300/0 conn(0x7fa46c15deb0 0x7fa46c0d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471a00640 1 -- 172.21.15.18:0/464634759 >> v2:172.21.15.167:3300/0 conn(0x7fa46c15deb0 msgr2=0x7fa46c0d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471a00640 1 --2- 172.21.15.18:0/464634759 >> v2:172.21.15.167:3300/0 conn(0x7fa46c15deb0 0x7fa46c0d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471a00640 1 -- 172.21.15.18:0/464634759 >> v1:172.21.15.18:6789/0 conn(0x7fa46c0ce250 legacy=0x7fa46c06c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa471a00640 1 -- 172.21.15.18:0/464634759 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0ceaf0 con 0x7fa46c15dad0 2024-04-25T10:04:02.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.677+0000 7fa46be00640 1 -- 172.21.15.18:0/464634759 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2538230004 0 0) 0x7fa46c0ce810 con 0x7fa46c0ce250 2024-04-25T10:04:02.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa471a00640 1 --2- 172.21.15.18:0/464634759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c15dad0 0x7fa46c1621e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0d1550 tx=0x7fa46001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c969d148deb23931 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa46be00640 1 -- 172.21.15.18:0/464634759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b2070 con 0x7fa46c15dad0 2024-04-25T10:04:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa46be00640 1 -- 172.21.15.18:0/464634759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600a9070 con 0x7fa46c15dad0 2024-04-25T10:04:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa46be00640 1 -- 172.21.15.18:0/464634759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600ad880 con 0x7fa46c15dad0 2024-04-25T10:04:02.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- 172.21.15.18:0/464634759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c15dad0 msgr2=0x7fa46c1621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 --2- 172.21.15.18:0/464634759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c15dad0 0x7fa46c1621e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0d1550 tx=0x7fa46001c450 comp rx=0 tx=0).stop 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- 172.21.15.18:0/464634759 shutdown_connections 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 --2- 172.21.15.18:0/464634759 >> v2:172.21.15.167:3300/0 conn(0x7fa46c15deb0 0x7fa46c0d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 --2- 172.21.15.18:0/464634759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c15dad0 0x7fa46c1621e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- 172.21.15.18:0/464634759 >> 172.21.15.18:0/464634759 conn(0x7fa46c0b5900 msgr2=0x7fa46c0b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- 172.21.15.18:0/464634759 shutdown_connections 2024-04-25T10:04:02.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- 172.21.15.18:0/464634759 wait complete. 2024-04-25T10:04:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 Processor -- start 2024-04-25T10:04:02.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.681+0000 7fa474400640 1 -- start start 2024-04-25T10:04:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 0x7fa46c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 0x7fa46c164e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c16ad20 con 0x7fa46c0ce250 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0d10c0 con 0x7fa46c15dad0 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c16aea0 con 0x7fa46c15deb0 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32930/0 (socket says 172.21.15.18:32930) 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 -- 172.21.15.18:0/3099091178 learned_addr learned my addr 172.21.15.18:0/3099091178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa472400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 0x7fa46c164e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471000640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 0x7fa46c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 -- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 msgr2=0x7fa46c164e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 0x7fa46c164e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 -- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 msgr2=0x7fa46c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 0x7fa46c0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 -- 172.21.15.18:0/3099091178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c15f2e0 con 0x7fa46c0ce250 2024-04-25T10:04:02.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa472400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 0x7fa46c164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471000640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 0x7fa46c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa471a00640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa46001a080 tx=0x7fa46001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600b2040 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4600ade30 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460006e20 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c168240 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c168800 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.685+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c0745d0 con 0x7fa46c0ce250 2024-04-25T10:04:02.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.689+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4600ab070 con 0x7fa46c0ce250 2024-04-25T10:04:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.689+0000 7fa469600640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 0x7fa44c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.689+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa46011f9a0 con 0x7fa46c0ce250 2024-04-25T10:04:02.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.689+0000 7fa471000640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 0x7fa44c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:02.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.689+0000 7fa471000640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 0x7fa44c069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cd3f0 tx=0x7fa458008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:02.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.693+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa460016070 con 0x7fa46c0ce250 2024-04-25T10:04:02.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.861+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46c0d1700 con 0x7fa46c0ce250 2024-04-25T10:04:02.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.861+0000 7fa469600640 1 -- 172.21.15.18:0/3099091178 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7fa4600f0780 con 0x7fa46c0ce250 2024-04-25T10:04:02.872 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:02.872 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 msgr2=0x7fa44c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 0x7fa44c069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0cd3f0 tx=0x7fa458008040 comp rx=0 tx=0).stop 2024-04-25T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 msgr2=0x7fa46c1679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa46001a080 tx=0x7fa46001ac90 comp rx=0 tx=0).stop 2024-04-25T10:04:02.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 shutdown_connections 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa44c066f60 0x7fa44c069420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa46c15deb0 0x7fa46c164e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa46c15dad0 0x7fa46c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 --2- 172.21.15.18:0/3099091178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa46c0ce250 0x7fa46c1679a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 >> 172.21.15.18:0/3099091178 conn(0x7fa46c0b5900 msgr2=0x7fa46c0b85f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 shutdown_connections 2024-04-25T10:04:02.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:02.865+0000 7fa474400640 1 -- 172.21.15.18:0/3099091178 wait complete. 2024-04-25T10:04:02.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:03.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 Processor -- start 2024-04-25T10:04:03.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 -- start start 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb406daf0 0x7f0fb40b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40ce610 con 0x7f0fb4070cb0 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb40b56f0 con 0x7f0fb4070030 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fbaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40704a0 con 0x7f0fb406daf0 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0fb4070cb0 0x7f0fb4071090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55970/0 (socket says 172.21.15.18:55970) 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3e00640 1 -- 172.21.15.18:0/3484510086 learned_addr learned my addr 172.21.15.18:0/3484510086 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb406daf0 0x7f0fb40b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052033065 0 0) 0x7f0fa4001120 con 0x7f0fb4070cb0 2024-04-25T10:04:03.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f98003530 con 0x7f0fb4070cb0 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373444468 0 0) 0x7f0fb40b56f0 con 0x7f0fb4070030 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa4001120 con 0x7f0fb4070030 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911935284 0 0) 0x7f0f98003530 con 0x7f0fb4070cb0 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb406daf0 msgr2=0x7f0fb40b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb406daf0 0x7f0fb40b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 >> v1:172.21.15.167:6789/0 conn(0x7f0fb4070030 legacy=0x7f0fb41675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb406bd20 con 0x7f0fb4070cb0 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f0fa4001850 con 0x7f0fb4070cb0 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 >> v1:172.21.15.18:6789/0 conn(0x7f0fb4070cb0 legacy=0x7f0fb4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f98003b80 0x7f0f98003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f98004810 0x7f0f98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f980051d0 0x7f0f9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9800bfc0 con 0x7f0f98004810 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9800c170 con 0x7f0f980051d0 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9800c370 con 0x7f0f98003b80 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f98004810 0x7f0f98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb8a00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f980051d0 0x7f0f9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3e00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f98003b80 0x7f0f98003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 -- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f98003b80 msgr2=0x7f0f98003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f98003b80 0x7f0f98003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 -- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f980051d0 msgr2=0x7f0f9800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f980051d0 0x7f0f9800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.041+0000 7f0fb3400640 1 -- 172.21.15.18:0/3484510086 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f98003530 con 0x7f0f98004810 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fb3400640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f98004810 0x7f0f98004c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00099a0 tx=0x7f0fa001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed6c2a6efb279ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00b2070 con 0x7f0f98004810 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa00a5520 con 0x7f0f98004810 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fb2a00640 1 -- 172.21.15.18:0/3484510086 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0009670 con 0x7f0f98004810 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 -- 172.21.15.18:0/3484510086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f98004810 msgr2=0x7f0f98004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/3484510086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f98004810 0x7f0f98004c90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00099a0 tx=0x7f0fa001c930 comp rx=0 tx=0).stop 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fb8a00640 1 -- 172.21.15.18:0/3484510086 reap_dead start 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 -- 172.21.15.18:0/3484510086 shutdown_connections 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 -- 172.21.15.18:0/3484510086 >> 172.21.15.18:0/3484510086 conn(0x7f0fb406f510 msgr2=0x7f0fb406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 -- 172.21.15.18:0/3484510086 shutdown_connections 2024-04-25T10:04:03.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.045+0000 7f0fbaa00640 1 -- 172.21.15.18:0/3484510086 wait complete. 2024-04-25T10:04:03.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 Processor -- start 2024-04-25T10:04:03.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- start start 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 0x7f0fb4157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb415c2e0 0x7f0fb415c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406c5c0 con 0x7f0fb415b890 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb406c2e0 con 0x7f0f98004810 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40b5110 con 0x7f0fb415c2e0 2024-04-25T10:04:03.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32958/0 (socket says 172.21.15.18:32958) 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 -- 172.21.15.18:0/1987255204 learned_addr learned my addr 172.21.15.18:0/1987255204 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3e00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 0x7f0fb4157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb8a00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb415c2e0 0x7f0fb415c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 -- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb415c2e0 msgr2=0x7f0fb415c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb415c2e0 0x7f0fb415c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 -- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 msgr2=0x7f0fb4157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 0x7f0fb4157140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 -- 172.21.15.18:0/1987255204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb40d11f0 con 0x7f0fb415b890 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3e00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 0x7f0fb4157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:03.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fb3400640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00b0040 tx=0x7f0f98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00bd070 con 0x7f0fb415b890 2024-04-25T10:04:03.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa00a5910 con 0x7f0fb415b890 2024-04-25T10:04:03.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa00b2040 con 0x7f0fb415b890 2024-04-25T10:04:03.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40d14d0 con 0x7f0fb415b890 2024-04-25T10:04:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.049+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40d1a90 con 0x7f0fb415b890 2024-04-25T10:04:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb40745d0 con 0x7f0fb415b890 2024-04-25T10:04:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0fa00c0070 con 0x7f0fb415b890 2024-04-25T10:04:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fabe00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 0x7f0f94069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0fa011f1c0 con 0x7f0fb415b890 2024-04-25T10:04:03.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fb3e00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 0x7f0f94069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.053+0000 7f0fb3e00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 0x7f0f94069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4000c10 tx=0x7f0fa4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.057+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0fa0016680 con 0x7f0fb415b890 2024-04-25T10:04:03.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.253+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0fb40b5ad0 con 0x7f0fb415b890 2024-04-25T10:04:03.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fabe00640 1 -- 172.21.15.18:0/1987255204 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f0fa00ef830 con 0x7f0fb415b890 2024-04-25T10:04:03.264 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:03.265 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:01.180241+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T10:04:03.265 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 7 2024-04-25T10:04:03.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 msgr2=0x7f0f94069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 0x7f0f94069450 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4000c10 tx=0x7f0fa4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 msgr2=0x7f0fb415bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00b0040 tx=0x7f0f98005840 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 shutdown_connections 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f94066f90 0x7f0f94069450 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0fb415c2e0 0x7f0fb415c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0fb415b890 0x7f0fb415bcf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 --2- 172.21.15.18:0/1987255204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f98004810 0x7f0fb4157140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 >> 172.21.15.18:0/1987255204 conn(0x7f0fb406f510 msgr2=0x7f0fb41594c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 shutdown_connections 2024-04-25T10:04:03.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.257+0000 7f0fbaa00640 1 -- 172.21.15.18:0/1987255204 wait complete. 2024-04-25T10:04:03.289 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:03.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 Processor -- start 2024-04-25T10:04:03.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 -- start start 2024-04-25T10:04:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a806ac10 0x7f38a815df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38a80b39a0 0x7f38a806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a80d0c40 0x7f38a80d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a815eef0 con 0x7f38a806ac10 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806b530 con 0x7f38a80b39a0 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38ae600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a815e650 con 0x7f38a80d0c40 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a806ac10 0x7f38a815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a806ac10 0x7f38a815df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32972/0 (socket says 172.21.15.18:32972) 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 -- 172.21.15.18:0/862110401 learned_addr learned my addr 172.21.15.18:0/862110401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7e00640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a80d0c40 0x7f38a80d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f389ea00640 1 --2- 172.21.15.18:0/862110401 >> v2:172.21.15.167:3300/0 conn(0x7f38a80b39a0 0x7f38a806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 -- 172.21.15.18:0/862110401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a80d0c40 msgr2=0x7f38a80d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:03.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a80d0c40 0x7f38a80d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 -- 172.21.15.18:0/862110401 >> v2:172.21.15.167:3300/0 conn(0x7f38a80b39a0 msgr2=0x7f38a806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 --2- 172.21.15.18:0/862110401 >> v2:172.21.15.167:3300/0 conn(0x7f38a80b39a0 0x7f38a806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.421+0000 7f38a7400640 1 -- 172.21.15.18:0/862110401 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a815e930 con 0x7f38a806ac10 2024-04-25T10:04:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38a7400640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a806ac10 0x7f38a815df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38a8071d40 tx=0x7f389801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d3bddd33600341 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38a6a00640 1 -- 172.21.15.18:0/862110401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980b1070 con 0x7f38a806ac10 2024-04-25T10:04:03.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38a6a00640 1 -- 172.21.15.18:0/862110401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980ac630 con 0x7f38a806ac10 2024-04-25T10:04:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38a6a00640 1 -- 172.21.15.18:0/862110401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980a8050 con 0x7f38a806ac10 2024-04-25T10:04:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 -- 172.21.15.18:0/862110401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a806ac10 msgr2=0x7f38a815df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a806ac10 0x7f38a815df00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f38a8071d40 tx=0x7f389801c520 comp rx=0 tx=0).stop 2024-04-25T10:04:03.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 -- 172.21.15.18:0/862110401 shutdown_connections 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a80d0c40 0x7f38a80d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 --2- 172.21.15.18:0/862110401 >> v2:172.21.15.167:3300/0 conn(0x7f38a80b39a0 0x7f38a806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 --2- 172.21.15.18:0/862110401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a806ac10 0x7f38a815df00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 -- 172.21.15.18:0/862110401 >> 172.21.15.18:0/862110401 conn(0x7f38a80b2400 msgr2=0x7f38a80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 -- 172.21.15.18:0/862110401 shutdown_connections 2024-04-25T10:04:03.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.425+0000 7f38ae600640 1 -- 172.21.15.18:0/862110401 wait complete. 2024-04-25T10:04:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 Processor -- start 2024-04-25T10:04:03.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- start start 2024-04-25T10:04:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a806ac10 0x7f38a81549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a80d0c40 0x7f38a814c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80b3f00 con 0x7f38a80b39a0 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80b3d80 con 0x7f38a80d0c40 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a8161540 con 0x7f38a806ac10 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32974/0 (socket says 172.21.15.18:32974) 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 -- 172.21.15.18:0/1630457801 learned_addr learned my addr 172.21.15.18:0/1630457801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38a7e00640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a80d0c40 0x7f38a814c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38a7400640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a806ac10 0x7f38a81549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 -- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a806ac10 msgr2=0x7f38a81549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a806ac10 0x7f38a81549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 -- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a80d0c40 msgr2=0x7f38a814c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a80d0c40 0x7f38a814c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 -- 172.21.15.18:0/1630457801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a8157c90 con 0x7f38a80b39a0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389ea00640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f389000e8b0 tx=0x7f389000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890017070 con 0x7f38a80b39a0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389000c940 con 0x7f38a80b39a0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389000cd10 con 0x7f38a80b39a0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a8157f70 con 0x7f38a80b39a0 2024-04-25T10:04:03.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a8158530 con 0x7f38a80b39a0 2024-04-25T10:04:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.429+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a80745d0 con 0x7f38a80b39a0 2024-04-25T10:04:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.433+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f389001a070 con 0x7f38a80b39a0 2024-04-25T10:04:03.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.433+0000 7f389fe00640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 0x7f3884069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:03.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.433+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3890085770 con 0x7f38a80b39a0 2024-04-25T10:04:03.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.433+0000 7f38a7400640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 0x7f3884069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:03.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.433+0000 7f38a7400640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 0x7f3884069450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38980ae000 tx=0x7f3898008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:03.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.437+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3890055cc0 con 0x7f38a80b39a0 2024-04-25T10:04:03.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.613+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38a80728d0 con 0x7f38a80b39a0 2024-04-25T10:04:03.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f389fe00640 1 -- 172.21.15.18:0/1630457801 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f3890059d60 con 0x7f38a80b39a0 2024-04-25T10:04:03.624 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:03.625 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 msgr2=0x7f3884069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 0x7f3884069450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f38980ae000 tx=0x7f3898008040 comp rx=0 tx=0).stop 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 msgr2=0x7f38a8157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f389000e8b0 tx=0x7f389000ed70 comp rx=0 tx=0).stop 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 shutdown_connections 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a80d0c40 0x7f38a814c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a80b39a0 0x7f38a8157560 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3884066f90 0x7f3884069450 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 --2- 172.21.15.18:0/1630457801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a806ac10 0x7f38a81549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 >> 172.21.15.18:0/1630457801 conn(0x7f38a80b2400 msgr2=0x7f38a815d620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 shutdown_connections 2024-04-25T10:04:03.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:03.617+0000 7f38ae600640 1 -- 172.21.15.18:0/1630457801 wait complete. 2024-04-25T10:04:04.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:03:56.137194+0000', 'modified': '2024-04-25T10:04:01.180241+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34181': {'gid': 34181, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/1802921745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 1802921745}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1802921745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-25T10:04:04.050 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:04:04.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:04:04.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 Processor -- start 2024-04-25T10:04:04.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 -- start start 2024-04-25T10:04:04.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcad015dc60 0x7fcad00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcad006bf30 0x7fcad00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad015e040 con 0x7fcad0099a60 2024-04-25T10:04:04.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00cff80 con 0x7fcad015dc60 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcad6c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad00d0260 con 0x7fcad006bf30 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcad015dc60 0x7fcad00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcad015dc60 0x7fcad00d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:32990/0 (socket says 172.21.15.18:32990) 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 -- 172.21.15.18:0/137051683 learned_addr learned my addr 172.21.15.18:0/137051683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcac7400640 1 --2- 172.21.15.18:0/137051683 >> v2:172.21.15.167:3300/0 conn(0x7fcad006bf30 0x7fcad00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 -- 172.21.15.18:0/137051683 >> v2:172.21.15.167:3300/0 conn(0x7fcad006bf30 msgr2=0x7fcad00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 --2- 172.21.15.18:0/137051683 >> v2:172.21.15.167:3300/0 conn(0x7fcad006bf30 0x7fcad00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 -- 172.21.15.18:0/137051683 >> v1:172.21.15.167:6789/0 conn(0x7fcad0099a60 legacy=0x7fcad00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.189+0000 7fcacfe00640 1 -- 172.21.15.18:0/137051683 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00d0540 con 0x7fcad015dc60 2024-04-25T10:04:04.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcacfe00640 1 --2- 172.21.15.18:0/137051683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad015dc60 0x7fcad00d1020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcad00d2810 tx=0x7fcac001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0b21dc598c4daa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcacf400640 1 -- 172.21.15.18:0/137051683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00ab620 con 0x7fcad015dc60 2024-04-25T10:04:04.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcacf400640 1 -- 172.21.15.18:0/137051683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00b0070 con 0x7fcad015dc60 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcacf400640 1 -- 172.21.15.18:0/137051683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac00ab9e0 con 0x7fcad015dc60 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 -- 172.21.15.18:0/137051683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad015dc60 msgr2=0x7fcad00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 --2- 172.21.15.18:0/137051683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad015dc60 0x7fcad00d1020 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcad00d2810 tx=0x7fcac001c420 comp rx=0 tx=0).stop 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 -- 172.21.15.18:0/137051683 shutdown_connections 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 --2- 172.21.15.18:0/137051683 >> v2:172.21.15.167:3300/0 conn(0x7fcad006bf30 0x7fcad00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 --2- 172.21.15.18:0/137051683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad015dc60 0x7fcad00d1020 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 -- 172.21.15.18:0/137051683 >> 172.21.15.18:0/137051683 conn(0x7fcad00b3200 msgr2=0x7fcad00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 -- 172.21.15.18:0/137051683 shutdown_connections 2024-04-25T10:04:04.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.193+0000 7fcad6c00640 1 -- 172.21.15.18:0/137051683 wait complete. 2024-04-25T10:04:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 Processor -- start 2024-04-25T10:04:04.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- start start 2024-04-25T10:04:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006bf30 0x7fcad00b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015dc60 0x7fcad015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad006cfa0 con 0x7fcad0099a60 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad00cc880 con 0x7fcad015dc60 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad015bc30 con 0x7fcad006bf30 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33004/0 (socket says 172.21.15.18:33004) 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 -- 172.21.15.18:0/671217377 learned_addr learned my addr 172.21.15.18:0/671217377 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcacfe00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006bf30 0x7fcad00b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad4c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015dc60 0x7fcad015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 -- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006bf30 msgr2=0x7fcad00b6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006bf30 0x7fcad00b6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 -- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015dc60 msgr2=0x7fcad015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015dc60 0x7fcad015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 -- 172.21.15.18:0/671217377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad00c9ff0 con 0x7fcad0099a60 2024-04-25T10:04:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcac7400640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcab800d5f0 tx=0x7fcab800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcaccc00640 1 -- 172.21.15.18:0/671217377 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80125f0 con 0x7fcad0099a60 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcaccc00640 1 -- 172.21.15.18:0/671217377 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8019070 con 0x7fcad0099a60 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcaccc00640 1 -- 172.21.15.18:0/671217377 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80129b0 con 0x7fcad0099a60 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad015ad60 con 0x7fcad0099a60 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.197+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad015b300 con 0x7fcad0099a60 2024-04-25T10:04:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcaccc00640 1 -- 172.21.15.18:0/671217377 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcab8012b50 con 0x7fcad0099a60 2024-04-25T10:04:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcaccc00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 0x7fcaac069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcaccc00640 1 -- 172.21.15.18:0/671217377 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcab8085610 con 0x7fcad0099a60 2024-04-25T10:04:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcacfe00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 0x7fcaac069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcada0d8000 1 Processor -- start 2024-04-25T10:04:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.201+0000 7fcada0d8000 1 -- start start 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcacfe00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 0x7fcaac069470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcac00af000 tx=0x7fcac00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c479920 0x55db5c479d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c430310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c3175f0 con 0x55db5c47a240 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c27eda0 con 0x55db5c479920 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5c207150 con 0x55db5c42ff30 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33010/0 (socket says 172.21.15.18:33010) 2024-04-25T10:04:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 -- 172.21.15.18:0/953960267 learned_addr learned my addr 172.21.15.18:0/953960267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 -- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 msgr2=0x55db5c430310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c430310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 -- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c479920 msgr2=0x55db5c479d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c479920 0x55db5c479d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 -- 172.21.15.18:0/953960267 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5c220ca0 con 0x55db5c47a240 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac7400640 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcab8083750 tx=0x7fcab8055c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6e201ce647f680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac4c00640 1 -- 172.21.15.18:0/953960267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab805e2d0 con 0x55db5c47a240 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac4c00640 1 -- 172.21.15.18:0/953960267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8053d10 con 0x55db5c47a240 2024-04-25T10:04:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcac4c00640 1 -- 172.21.15.18:0/953960267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab80522e0 con 0x55db5c47a240 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- 172.21.15.18:0/953960267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 msgr2=0x55db5c42f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcab8083750 tx=0x7fcab8055c70 comp rx=0 tx=0).stop 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- 172.21.15.18:0/953960267 shutdown_connections 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c430310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c47a240 0x55db5c42f9f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 --2- 172.21.15.18:0/953960267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c479920 0x55db5c479d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- 172.21.15.18:0/953960267 >> 172.21.15.18:0/953960267 conn(0x55db5c4362a0 msgr2=0x55db5c42e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- 172.21.15.18:0/953960267 shutdown_connections 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- 172.21.15.18:0/953960267 wait complete. 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 -- start start 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.205+0000 7fcada0d8000 1 Processor -- start 2024-04-25T10:04:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c480e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c433aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c239990 con 0x55db5c479920 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c27ae40 con 0x55db5c42ff30 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5c20a900 con 0x55db5c47a240 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 10 client.0 _ll_register_callbacks cb 0x55db5c3321c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33016/0 (socket says 172.21.15.18:33016) 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 -- 172.21.15.18:0/230525980 learned_addr learned my addr 172.21.15.18:0/230525980 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcad4c00640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c433aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcacfe00640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c480e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 -- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 msgr2=0x55db5c433aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c433aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 -- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 msgr2=0x55db5c480e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c480e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 -- 172.21.15.18:0/230525980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db5c237630 con 0x55db5c479920 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcac7400640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcab800dfb0 tx=0x7fcab8085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb33064d191f9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8071070 con 0x55db5c479920 2024-04-25T10:04:04.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcab8053d10 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcab80522e0 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab807b050 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 10 client.4398 fetch_fsmap learned FSMap version 7 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55db5c2073a0 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab8053d10 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fcab8013070 con 0x55db5c479920 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 10 client.4398 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 20 client.4398 populate_metadata read hostname 'smithi018' 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c4344b0 0x55db5c434890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 4 client.4398 mds_command: new command op to 34181 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 --> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db5c21aa50 con 0x55db5c4344b0 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcacfe00640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c4344b0 0x55db5c434890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcacfe00640 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c4344b0 0x55db5c434890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1604e7e8e042f33 server_cookie=b75aca77f5dcb7f4 in_seq=0 out_seq=0 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.209+0000 7fcabd600640 10 client.4398 ms_handle_connect on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcabd600640 1 -- 172.21.15.18:0/230525980 <== mds.0 v2:172.21.15.167:6835/1802921745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55db5c21aa50 con 0x55db5c4344b0 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcabd600640 10 client.4398 handle_command_reply: tid=0 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 client.4398 shutdown 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 msgr2=0x55db5c4813a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcab800dfb0 tx=0x7fcab8085040 comp rx=0 tx=0).stop 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 shutdown_connections 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c4344b0 0x55db5c434890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c433aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4813a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 --2- 172.21.15.18:0/230525980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c480e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcabd600640 0 client.4398 ms_handle_reset on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 >> 172.21.15.18:0/230525980 conn(0x55db5c4362a0 msgr2=0x55db5c42e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 shutdown_connections 2024-04-25T10:04:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 1 -- 172.21.15.18:0/230525980 wait complete. 2024-04-25T10:04:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.213+0000 7fcada0d8000 20 client.4398 trim_cache size 0 max 16384 2024-04-25T10:04:04.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 Processor -- start 2024-04-25T10:04:04.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- start start 2024-04-25T10:04:04.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c4d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c47a240 0x55db5c4d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad02039b0 con 0x55db5c479920 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad0202ed0 con 0x55db5c47a240 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad02033b0 con 0x55db5c42ff30 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33032/0 (socket says 172.21.15.18:33032) 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 -- 172.21.15.18:0/1891965612 learned_addr learned my addr 172.21.15.18:0/1891965612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 -- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 msgr2=0x55db5c4d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c4d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 -- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c47a240 msgr2=0x55db5c4d5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c47a240 0x55db5c4d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 -- 172.21.15.18:0/1891965612 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5c300600 con 0x55db5c479920 2024-04-25T10:04:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcac7400640 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcab8052010 tx=0x7fcab8082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40fb4eb96229b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcabfe00640 1 -- 172.21.15.18:0/1891965612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8071070 con 0x55db5c479920 2024-04-25T10:04:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcabfe00640 1 -- 172.21.15.18:0/1891965612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab805e2d0 con 0x55db5c479920 2024-04-25T10:04:04.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcabfe00640 1 -- 172.21.15.18:0/1891965612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8053d10 con 0x55db5c479920 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- 172.21.15.18:0/1891965612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 msgr2=0x55db5c4d56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcab8052010 tx=0x7fcab8082000 comp rx=0 tx=0).stop 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- 172.21.15.18:0/1891965612 shutdown_connections 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c47a240 0x55db5c4d5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d56f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 --2- 172.21.15.18:0/1891965612 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c42ff30 0x55db5c4d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- 172.21.15.18:0/1891965612 >> 172.21.15.18:0/1891965612 conn(0x55db5c4362a0 msgr2=0x55db5c433220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- 172.21.15.18:0/1891965612 shutdown_connections 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- 172.21.15.18:0/1891965612 wait complete. 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 -- start start 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.229+0000 7fcada0d8000 1 Processor -- start 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c486760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c4d98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2833d0 con 0x55db5c479920 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c33ad50 con 0x55db5c42ff30 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db5c219980 con 0x55db5c47a240 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 10 client.0 _ll_register_callbacks cb 0x7fcab8051f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33046/0 (socket says 172.21.15.18:33046) 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 -- 172.21.15.18:0/3372338014 learned_addr learned my addr 172.21.15.18:0/3372338014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcad4c00640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c4d98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcacfe00640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c486760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 -- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 msgr2=0x55db5c4d98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c4d98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 -- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 msgr2=0x55db5c486760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c486760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 -- 172.21.15.18:0/3372338014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db5c2139b0 con 0x55db5c479920 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcac7400640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcab800dfb0 tx=0x7fcab8052040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7117becdd8fe9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8069b80 con 0x55db5c479920 2024-04-25T10:04:04.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcab8069d20 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcab805e2d0 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab80550c0 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 10 client.4404 fetch_fsmap learned FSMap version 7 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55db5c2260b0 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab805e2d0 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fcab8055260 con 0x55db5c479920 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 10 client.4404 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 20 client.4404 populate_metadata read hostname 'smithi018' 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c495580 0x55db5c495960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 4 client.4404 mds_command: new command op to 34181 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:04:04.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 --> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55db5c28c2e0 con 0x55db5c495580 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcacfe00640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c495580 0x55db5c495960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcacfe00640 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c495580 0x55db5c495960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4b27cb0716a193e server_cookie=3530265f038e6e51 in_seq=0 out_seq=0 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 10 client.4404 ms_handle_connect on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 1 -- 172.21.15.18:0/3372338014 <== mds.0 v2:172.21.15.167:6835/1802921745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55db5c28c2e0 con 0x55db5c495580 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcabd600640 10 client.4404 handle_command_reply: tid=0 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.233+0000 7fcada0d8000 1 client.4404 shutdown 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 msgr2=0x55db5c4d9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcab800dfb0 tx=0x7fcab8052040 comp rx=0 tx=0).stop 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 shutdown_connections 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x55db5c495580 0x55db5c495960 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55db5c47a240 0x55db5c4d98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55db5c479920 0x55db5c4d9380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 --2- 172.21.15.18:0/3372338014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55db5c42ff30 0x55db5c486760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 >> 172.21.15.18:0/3372338014 conn(0x55db5c4362a0 msgr2=0x55db5c481a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcabd600640 0 client.4404 ms_handle_reset on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 shutdown_connections 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 1 -- 172.21.15.18:0/3372338014 wait complete. 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcada0d8000 20 client.4404 trim_cache size 0 max 16384 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:04:04.250 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 34181, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 7.4981329580000002, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 7, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 27, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 14.789033572999999 2024-04-25T10:04:04.251 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:04:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 msgr2=0x7fcaac069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 0x7fcaac069470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcac00af000 tx=0x7fcac00a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:04.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 msgr2=0x7fcad015c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcab800d5f0 tx=0x7fcab800dab0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 shutdown_connections 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcad015dc60 0x7fcad015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcad0099a60 0x7fcad015c640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcaac066fb0 0x7fcaac069470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 --2- 172.21.15.18:0/671217377 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcad006bf30 0x7fcad00b6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 >> 172.21.15.18:0/671217377 conn(0x7fcad00b3200 msgr2=0x7fcad00b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 shutdown_connections 2024-04-25T10:04:04.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.237+0000 7fcad6c00640 1 -- 172.21.15.18:0/671217377 wait complete. 2024-04-25T10:04:04.264 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:04:04.264 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:04.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:04.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 Processor -- start 2024-04-25T10:04:04.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 -- start start 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1edc15fe50 0x7f1edc0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1edc0b1c90 0x7f1edc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1edc0b20a0 con 0x7f1edc145270 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc145650 con 0x7f1edc15fe50 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee2e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1edc1602b0 con 0x7f1edc0b1c90 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ed3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1edc15fe50 0x7f1edc0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ed3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1edc15fe50 0x7f1edc0b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33050/0 (socket says 172.21.15.18:33050) 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ed3400640 1 -- 172.21.15.18:0/3624661225 learned_addr learned my addr 172.21.15.18:0/3624661225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.397+0000 7f1ee0e00640 1 --2- 172.21.15.18:0/3624661225 >> v2:172.21.15.167:3300/0 conn(0x7f1edc0b1c90 0x7f1edc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ed3400640 1 -- 172.21.15.18:0/3624661225 >> v2:172.21.15.167:3300/0 conn(0x7f1edc0b1c90 msgr2=0x7f1edc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ed3400640 1 --2- 172.21.15.18:0/3624661225 >> v2:172.21.15.167:3300/0 conn(0x7f1edc0b1c90 0x7f1edc15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ed3400640 1 -- 172.21.15.18:0/3624661225 >> v1:172.21.15.167:6789/0 conn(0x7f1edc145270 legacy=0x7f1edc0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:04.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ed3400640 1 -- 172.21.15.18:0/3624661225 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc0cc4e0 con 0x7f1edc15fe50 2024-04-25T10:04:04.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ed3400640 1 --2- 172.21.15.18:0/3624661225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc15fe50 0x7f1edc0b1750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0b4b90 tx=0x7f1ec401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53265de52b24af15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1edb400640 1 -- 172.21.15.18:0/3624661225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40b0070 con 0x7f1edc15fe50 2024-04-25T10:04:04.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1edb400640 1 -- 172.21.15.18:0/3624661225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40ab600 con 0x7f1edc15fe50 2024-04-25T10:04:04.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1edb400640 1 -- 172.21.15.18:0/3624661225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40ab9d0 con 0x7f1edc15fe50 2024-04-25T10:04:04.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.401+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3624661225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc15fe50 msgr2=0x7f1edc0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3624661225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc15fe50 0x7f1edc0b1750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1edc0b4b90 tx=0x7f1ec401c2d0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3624661225 shutdown_connections 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3624661225 >> v2:172.21.15.167:3300/0 conn(0x7f1edc0b1c90 0x7f1edc15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3624661225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc15fe50 0x7f1edc0b1750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3624661225 >> 172.21.15.18:0/3624661225 conn(0x7f1edc066fa0 msgr2=0x7f1edc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3624661225 shutdown_connections 2024-04-25T10:04:04.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3624661225 wait complete. 2024-04-25T10:04:04.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 Processor -- start 2024-04-25T10:04:04.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- start start 2024-04-25T10:04:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1edc0b1c90 0x7f1edc141ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1edc15fe50 0x7f1edc15b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc15f930 con 0x7f1edc145270 2024-04-25T10:04:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc15f650 con 0x7f1edc15fe50 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee2e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1edc0cdbe0 con 0x7f1edc0b1c90 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33060/0 (socket says 172.21.15.18:33060) 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 -- 172.21.15.18:0/3166961935 learned_addr learned my addr 172.21.15.18:0/3166961935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ee0e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1edc15fe50 0x7f1edc15b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1edbe00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1edc0b1c90 0x7f1edc141ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 -- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1edc0b1c90 msgr2=0x7f1edc141ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1edc0b1c90 0x7f1edc141ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 -- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1edc15fe50 msgr2=0x7f1edc15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1edc15fe50 0x7f1edc15b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 -- 172.21.15.18:0/3166961935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1edc13ef70 con 0x7f1edc145270 2024-04-25T10:04:04.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.405+0000 7f1ed3400640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ae040 tx=0x7f1ec4019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40bb070 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec40b6430 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec40b0040 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1edc140130 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1edc1406f0 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1edc0745d0 con 0x7f1edc145270 2024-04-25T10:04:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ec40be070 con 0x7f1edc145270 2024-04-25T10:04:04.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 0x7f1eb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1ec411e930 con 0x7f1edc145270 2024-04-25T10:04:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.409+0000 7f1edbe00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 0x7f1eb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.413+0000 7f1edbe00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 0x7f1eb8069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004e30 tx=0x7f1ecc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:04.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.413+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1edc0b20a0 con 0x7f1edc145270 2024-04-25T10:04:04.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1edc06b8e0 con 0x7f1edc145270 2024-04-25T10:04:04.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ed8c00640 1 -- 172.21.15.18:0/3166961935 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1ec40ef560 con 0x7f1edc145270 2024-04-25T10:04:04.629 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:04:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 msgr2=0x7f1eb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 0x7f1eb8069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1ecc004e30 tx=0x7f1ecc009040 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 msgr2=0x7f1edc13ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40ae040 tx=0x7f1ec4019070 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 shutdown_connections 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1edc15fe50 0x7f1edc15b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1edc145270 0x7f1edc13ea30 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1eb8066f60 0x7f1eb8069420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 --2- 172.21.15.18:0/3166961935 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1edc0b1c90 0x7f1edc141ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 >> 172.21.15.18:0/3166961935 conn(0x7f1edc066fa0 msgr2=0x7f1edc15e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 shutdown_connections 2024-04-25T10:04:04.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:04.621+0000 7f1ee2e00640 1 -- 172.21.15.18:0/3166961935 wait complete. 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:04.651 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:04:04.652 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:04:04.652 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:04.652 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:04:04.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:04.652 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:04:04.660 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:04:04.661 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42460sec preferred_lft 42460sec 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:04:04.662 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:04.664 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:04:04.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:04:04.664 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:04.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:04.780 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:04.799 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:04:04.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:04.802 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:04:05.019 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:04:05.019 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:05.019 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:04:05.019 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:04:05.020 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:04:05.020 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:05.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.020 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:05.020 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:05.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:05.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:05.020 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:05.021 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:05.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.072 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:04:05.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.121 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-25T10:04:05.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.173 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:05.173 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:05.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:05.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T10:04:05.174 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:05.256 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T10:04:05.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.256 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:05.256 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:05.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T10:04:05.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:04:05.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T10:04:05.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T10:04:05.257 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T10:04:05.257 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:05.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.427 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:05.427 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:05.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:04:05.427 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:04:05.427 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:05.468 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T10:04:05.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:05.468 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:05.529 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T10:04:05.529 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:05.529 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:05.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-25T10:04:05.640 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:04:05.693 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-25T10:04:05.693 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-25T10:04:05.693 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-25T10:04:05.694 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:04:05.695 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:04:05.696 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-25T10:04:05.696 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:05.696 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:05.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.697 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-25T10:04:05.748 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T10:04:05.748 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T10:04:05.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-25T10:04:05.821 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:04:05.874 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-25T10:04:05.875 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-25T10:04:05.876 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:05.877 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:05.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:05.878 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-25T10:04:05.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:2024-04-25T10:04:05.889+0000 7f4ca4b23580 -1 init, newargv = 0x562baeffba40 newargc=15 2024-04-25T10:04:05.899 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[32352]: starting ceph client 2024-04-25T10:04:05.911 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[32352]: starting fuse 2024-04-25T10:04:07.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo modprobe fuse 2024-04-25T10:04:07.034 DEBUG:teuthology.orchestra.run.smithi018:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T10:04:07.090 INFO:teuthology.orchestra.run.smithi018.stdout:/sys 2024-04-25T10:04:07.090 INFO:teuthology.orchestra.run.smithi018.stdout:/proc 2024-04-25T10:04:07.090 INFO:teuthology.orchestra.run.smithi018.stdout:/dev 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/pts 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/run 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/ 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/security 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/shm 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/run/lock 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/cgroup 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/pstore 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/bpf 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/hugepages 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/dev/mqueue 2024-04-25T10:04:07.091 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/debug 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/tracing 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/proc/fs/nfsd 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/fs/fuse/connections 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/sys/kernel/config 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/run/rpc_pipefs 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/run/user/1000 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns 2024-04-25T10:04:07.092 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:07.093 INFO:teuthology.orchestra.run.smithi018.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:07.093 INFO:teuthology.orchestra.run.smithi018.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:07.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:07.094 DEBUG:teuthology.orchestra.run.smithi018:> ls /sys/fs/fuse/connections 2024-04-25T10:04:07.148 INFO:teuthology.orchestra.run.smithi018.stdout:44 2024-04-25T10:04:07.149 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo stdin-killer -- python3 -c ' 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> import glob 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> import re 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> def _find_admin_socket(client_name): 2024-04-25T10:04:07.149 DEBUG:teuthology.orchestra.run.smithi018:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> files = glob.glob(asok_path) 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> # Given a non-glob path, it better be there 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> if "*" not in asok_path: 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> assert(len(files) == 1) 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> return files[0] 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> for f in files: 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> contents = proc_f.read() 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> if mountpoint in contents: 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> return f 2024-04-25T10:04:07.150 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T10:04:07.151 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:04:07.151 DEBUG:teuthology.orchestra.run.smithi018:> print(_find_admin_socket("client.admin")) 2024-04-25T10:04:07.151 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:04:07.284 INFO:teuthology.orchestra.run.smithi018.stdout:/var/run/ceph/ceph-client.admin.32352.asok 2024-04-25T10:04:07.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:04:07.296 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32352.asok 2024-04-25T10:04:07.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:07.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32352.asok status 2024-04-25T10:04:07.477 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:04:07.477 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": { 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_sha1": "97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.0.0-1628-g97ae6cc9 (97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec) squid (dev)", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "entity_id": "admin", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "hostname": "smithi018", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pid": "32352", 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "root": "/" 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_count": 0, 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "dentry_pinned_count": 0, 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 34283, 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "inst": { 2024-04-25T10:04:07.478 INFO:teuthology.orchestra.run.smithi018.stdout: "name": { 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "client", 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "num": 34283 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1405968778 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": { 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:0", 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1405968778 2024-04-25T10:04:07.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "inst_str": "client.34283 172.21.15.18:0/1405968778", 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "addr_str": "172.21.15.18:0/1405968778", 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "inode_count": 1, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_epoch": 7, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch": 27, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_epoch_barrier": 0, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklisted": false, 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs" 2024-04-25T10:04:07.480 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:04:07.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:07.494 DEBUG:teuthology.orchestra.run.smithi018:> stat --file-system '--printf=%T 2024-04-25T10:04:07.494 DEBUG:teuthology.orchestra.run.smithi018:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:07.503 INFO:teuthology.orchestra.run.smithi018.stdout:fuseblk 2024-04-25T10:04:07.504 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:07.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:07.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:07.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:07.569 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T10:04:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:# file: . 2024-04-25T10:04:07.653 INFO:teuthology.orchestra.run.smithi018.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T10:04:07.653 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:07.654 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:07.654 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:07.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:07.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 Processor -- start 2024-04-25T10:04:07.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 -- start start 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fadc0099a60 0x7fadc015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc015c310 con 0x7fadc009a600 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc00cf800 con 0x7fadc00cf370 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadc5000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc00d0410 con 0x7fadc0099a60 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadbe800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fadc009a600 0x7fadc00cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55976/0 (socket says 172.21.15.18:55976) 2024-04-25T10:04:07.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadbe800640 1 -- 172.21.15.18:0/4036146057 learned_addr learned my addr 172.21.15.18:0/4036146057 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:07.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadbde00640 1 --2- 172.21.15.18:0/4036146057 >> v2:172.21.15.167:3300/0 conn(0x7fadc0099a60 0x7fadc015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808591668 0 0) 0x7fadb80014a0 con 0x7fadc009a600 2024-04-25T10:04:07.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.881+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fada4003530 con 0x7fadc009a600 2024-04-25T10:04:07.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927356027 0 0) 0x7fada4003530 con 0x7fadc009a600 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 >> v2:172.21.15.167:3300/0 conn(0x7fadc0099a60 msgr2=0x7fadc015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 --2- 172.21.15.18:0/4036146057 >> v2:172.21.15.167:3300/0 conn(0x7fadc0099a60 0x7fadc015bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 >> v1:172.21.15.167:6789/0 conn(0x7fadc00cf370 legacy=0x7fadc0099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00cfae0 con 0x7fadc009a600 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fadb8001bd0 con 0x7fadc009a600 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbde00640 1 --2- 172.21.15.18:0/4036146057 >> v2:172.21.15.167:3300/0 conn(0x7fadc0099a60 0x7fadc015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 >> v1:172.21.15.18:6789/0 conn(0x7fadc009a600 legacy=0x7fadc00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fada40039c0 0x7fada4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada4004810 0x7fada4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 0x7fada400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00d0410 con 0x7fada40051d0 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada400c170 con 0x7fada4004810 2024-04-25T10:04:07.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada400c370 con 0x7fada40039c0 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 0x7fada400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbde00640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fada40039c0 0x7fada4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadb7e00640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada4004810 0x7fada4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 -- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fada40039c0 msgr2=0x7fada4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fada40039c0 0x7fada4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 -- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada4004810 msgr2=0x7fada4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada4004810 0x7fada4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 -- 172.21.15.18:0/4036146057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4003530 con 0x7fada40051d0 2024-04-25T10:04:07.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 -- 172.21.15.18:0/4036146057 reap_dead start 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbe800640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 0x7fada400b9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fadb800aa20 tx=0x7fadb801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65b0a55ac9d750b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb800a670 con 0x7fada40051d0 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb80aa4f0 con 0x7fada40051d0 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.885+0000 7fadbd400640 1 -- 172.21.15.18:0/4036146057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb80aa8c0 con 0x7fada40051d0 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 msgr2=0x7fada400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 0x7fada400b9d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fadb800aa20 tx=0x7fadb801fac0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- 172.21.15.18:0/4036146057 shutdown_connections 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 --2- 172.21.15.18:0/4036146057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fada40051d0 0x7fada400b9d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- 172.21.15.18:0/4036146057 >> 172.21.15.18:0/4036146057 conn(0x7fadc00d17a0 msgr2=0x7fadc00d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- 172.21.15.18:0/4036146057 shutdown_connections 2024-04-25T10:04:07.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- 172.21.15.18:0/4036146057 wait complete. 2024-04-25T10:04:07.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 Processor -- start 2024-04-25T10:04:07.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- start start 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 0x7fadc00b70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc00b4fd0 0x7fadc01f6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc015bdd0 con 0x7fadc009ce80 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00d00a0 con 0x7fada40051d0 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadc5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc015bf50 con 0x7fadc00b4fd0 2024-04-25T10:04:07.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadbe800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadbde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 0x7fadc00b70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadbe800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33068/0 (socket says 172.21.15.18:33068) 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadbe800640 1 -- 172.21.15.18:0/1055741857 learned_addr learned my addr 172.21.15.18:0/1055741857 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.889+0000 7fadb7e00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc00b4fd0 0x7fadc01f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 -- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc00b4fd0 msgr2=0x7fadc01f6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc00b4fd0 0x7fadc01f6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 -- 172.21.15.18:0/1055741857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 msgr2=0x7fadc009d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 -- 172.21.15.18:0/1055741857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00b5770 con 0x7fada40051d0 2024-04-25T10:04:07.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbe800640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:07.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadbde00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 0x7fadc00b70a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009620 tx=0x7fadb0011da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:07.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb000fbb0 con 0x7fada40051d0 2024-04-25T10:04:07.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb000fd50 con 0x7fada40051d0 2024-04-25T10:04:07.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb0004260 con 0x7fada40051d0 2024-04-25T10:04:07.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc00b5a50 con 0x7fada40051d0 2024-04-25T10:04:07.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00b6010 con 0x7fada40051d0 2024-04-25T10:04:07.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00745d0 con 0x7fada40051d0 2024-04-25T10:04:07.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fadb0012040 con 0x7fada40051d0 2024-04-25T10:04:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 0x7fad9c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.893+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fadb0085c00 con 0x7fada40051d0 2024-04-25T10:04:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.897+0000 7fadb7e00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 0x7fad9c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:07.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.897+0000 7fadb7e00640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 0x7fad9c069450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fada8000c10 tx=0x7fada8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:07.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:07.901+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fadb0019030 con 0x7fada40051d0 2024-04-25T10:04:08.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.061+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadc00d2620 con 0x7fada40051d0 2024-04-25T10:04:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.061+0000 7fadb6000640 1 -- 172.21.15.18:0/1055741857 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7fadb0056260 con 0x7fada40051d0 2024-04-25T10:04:08.071 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:08.071 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:08.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 msgr2=0x7fad9c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 0x7fad9c069450 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fada8000c10 tx=0x7fada8009040 comp rx=0 tx=0).stop 2024-04-25T10:04:08.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 msgr2=0x7fadc00b70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 0x7fadc00b70a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009620 tx=0x7fadb0011da0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 shutdown_connections 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fadc009ce80 0x7fadc009d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad9c066f90 0x7fad9c069450 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fadc00b4fd0 0x7fadc01f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 --2- 172.21.15.18:0/1055741857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada40051d0 0x7fadc00b70a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 >> 172.21.15.18:0/1055741857 conn(0x7fadc00d17a0 msgr2=0x7fadc0099e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 shutdown_connections 2024-04-25T10:04:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.065+0000 7fadc5000640 1 -- 172.21.15.18:0/1055741857 wait complete. 2024-04-25T10:04:08.094 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:08.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:08.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 Processor -- start 2024-04-25T10:04:08.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 -- start start 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd63015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6300ccbf0 0x7fd63015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd63015ee60 0x7fd6300b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63015e490 con 0x7fd6300ccbf0 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd63015bc40 con 0x7fd63015ee60 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.229+0000 7fd636c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63015b3a0 con 0x7fd630144120 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6300ccbf0 0x7fd63015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6300ccbf0 0x7fd63015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33082/0 (socket says 172.21.15.18:33082) 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 -- 172.21.15.18:0/2455894754 learned_addr learned my addr 172.21.15.18:0/2455894754 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd634c00640 1 --2- 172.21.15.18:0/2455894754 >> v2:172.21.15.167:3300/0 conn(0x7fd63015ee60 0x7fd6300b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd62fe00640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd63015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 -- 172.21.15.18:0/2455894754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 msgr2=0x7fd63015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd63015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 -- 172.21.15.18:0/2455894754 >> v2:172.21.15.167:3300/0 conn(0x7fd63015ee60 msgr2=0x7fd6300b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 --2- 172.21.15.18:0/2455894754 >> v2:172.21.15.167:3300/0 conn(0x7fd63015ee60 0x7fd6300b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 -- 172.21.15.18:0/2455894754 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63015b680 con 0x7fd6300ccbf0 2024-04-25T10:04:08.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd627400640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63015e920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6300b2fe0 tx=0x7fd61801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf0bdb19aac6cef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd62f400640 1 -- 172.21.15.18:0/2455894754 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6180b0070 con 0x7fd6300ccbf0 2024-04-25T10:04:08.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd62f400640 1 -- 172.21.15.18:0/2455894754 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6180ab600 con 0x7fd6300ccbf0 2024-04-25T10:04:08.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.233+0000 7fd62f400640 1 -- 172.21.15.18:0/2455894754 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6180ab9d0 con 0x7fd6300ccbf0 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- 172.21.15.18:0/2455894754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 msgr2=0x7fd63015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63015e920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd6300b2fe0 tx=0x7fd61801c490 comp rx=0 tx=0).stop 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- 172.21.15.18:0/2455894754 shutdown_connections 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- 172.21.15.18:0/2455894754 >> v2:172.21.15.167:3300/0 conn(0x7fd63015ee60 0x7fd6300b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63015e920 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- 172.21.15.18:0/2455894754 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd63015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- 172.21.15.18:0/2455894754 >> 172.21.15.18:0/2455894754 conn(0x7fd630067080 msgr2=0x7fd63006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- 172.21.15.18:0/2455894754 shutdown_connections 2024-04-25T10:04:08.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- 172.21.15.18:0/2455894754 wait complete. 2024-04-25T10:04:08.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 Processor -- start 2024-04-25T10:04:08.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- start start 2024-04-25T10:04:08.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd630159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63015ee60 0x7fd6300ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd630071640 con 0x7fd6300ccbf0 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300714c0 con 0x7fd63015ee60 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd636c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6300717c0 con 0x7fd630144120 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33084/0 (socket says 172.21.15.18:33084) 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 -- 172.21.15.18:0/2780534677 learned_addr learned my addr 172.21.15.18:0/2780534677 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd634c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63015ee60 0x7fd6300ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd627400640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd630159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 -- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 msgr2=0x7fd630159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd630159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 -- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63015ee60 msgr2=0x7fd6300ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63015ee60 0x7fd6300ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.237+0000 7fd62fe00640 1 -- 172.21.15.18:0/2780534677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6300ac8d0 con 0x7fd6300ccbf0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62fe00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd62000d800 tx=0x7fd62000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620018020 con 0x7fd6300ccbf0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd620009640 con 0x7fd6300ccbf0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6200099f0 con 0x7fd6300ccbf0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63013dd40 con 0x7fd6300ccbf0 2024-04-25T10:04:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6300acb70 con 0x7fd6300ccbf0 2024-04-25T10:04:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6300745d0 con 0x7fd6300ccbf0 2024-04-25T10:04:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd62001b020 con 0x7fd6300ccbf0 2024-04-25T10:04:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 0x7fd60c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd620085690 con 0x7fd6300ccbf0 2024-04-25T10:04:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.241+0000 7fd627400640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 0x7fd60c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.245+0000 7fd627400640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 0x7fd60c069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6180ad000 tx=0x7fd618008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.245+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd620022020 con 0x7fd6300ccbf0 2024-04-25T10:04:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.409+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd63006de80 con 0x7fd6300ccbf0 2024-04-25T10:04:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.409+0000 7fd62cc00640 1 -- 172.21.15.18:0/2780534677 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd620055da0 con 0x7fd6300ccbf0 2024-04-25T10:04:08.419 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:08.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 msgr2=0x7fd60c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 0x7fd60c069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6180ad000 tx=0x7fd618008040 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 msgr2=0x7fd63013d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd62000d800 tx=0x7fd62000dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 shutdown_connections 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd63015ee60 0x7fd6300ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd60c066f90 0x7fd60c069450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd630144120 0x7fd630159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 --2- 172.21.15.18:0/2780534677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6300ccbf0 0x7fd63013d740 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 >> 172.21.15.18:0/2780534677 conn(0x7fd630067080 msgr2=0x7fd630140c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 shutdown_connections 2024-04-25T10:04:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.413+0000 7fd636c00640 1 -- 172.21.15.18:0/2780534677 wait complete. 2024-04-25T10:04:08.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.573+0000 7fcb9ca00640 1 Processor -- start 2024-04-25T10:04:08.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.573+0000 7fcb9ca00640 1 -- start start 2024-04-25T10:04:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb9ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb9815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb9ca00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9815bc40 con 0x7fcb980b3090 2024-04-25T10:04:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb9ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9815b3a0 con 0x7fcb980ccbf0 2024-04-25T10:04:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb9ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9815e490 con 0x7fcb98144120 2024-04-25T10:04:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb96800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcb980b3090 0x7fcb9806e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55988/0 (socket says 172.21.15.18:55988) 2024-04-25T10:04:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb96800640 1 -- 172.21.15.18:0/366614546 learned_addr learned my addr 172.21.15.18:0/366614546 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95e00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb9815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324355800 0 0) 0x7fcb9815bc40 con 0x7fcb980b3090 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb7c003530 con 0x7fcb980b3090 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581578148 0 0) 0x7fcb9815b3a0 con 0x7fcb980ccbf0 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb9815bc40 con 0x7fcb980ccbf0 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2772461473 0 0) 0x7fcb7c003530 con 0x7fcb980b3090 2024-04-25T10:04:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 msgr2=0x7fcb9815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb9815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 >> v1:172.21.15.167:6789/0 conn(0x7fcb980ccbf0 legacy=0x7fcb9815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9815b680 con 0x7fcb980b3090 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fcb90001a00 con 0x7fcb980b3090 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95e00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb9815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 >> v1:172.21.15.18:6789/0 conn(0x7fcb980b3090 legacy=0x7fcb9806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c003b80 0x7fcb7c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c004810 0x7fcb7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb7c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9815e490 con 0x7fcb7c004810 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00bae0 con 0x7fcb7c003b80 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c00bce0 con 0x7fcb98144120 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c004810 0x7fcb7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb96800640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb7c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb95e00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c003b80 0x7fcb7c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 -- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 msgr2=0x7fcb7c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb98144120 0x7fcb7c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 -- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c003b80 msgr2=0x7fcb7c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c003b80 0x7fcb7c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.577+0000 7fcb8fe00640 1 -- 172.21.15.18:0/366614546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c003530 con 0x7fcb7c004810 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c004810 0x7fcb7c004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb800018d0 tx=0x7fcb8001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83225fff7f11d069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80001520 con 0x7fcb7c004810 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800052f0 con 0x7fcb7c004810 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb95400640 1 -- 172.21.15.18:0/366614546 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80003840 con 0x7fcb7c004810 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- 172.21.15.18:0/366614546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c004810 msgr2=0x7fcb7c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/366614546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c004810 0x7fcb7c004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcb800018d0 tx=0x7fcb8001c580 comp rx=0 tx=0).stop 2024-04-25T10:04:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb96800640 1 -- 172.21.15.18:0/366614546 reap_dead start 2024-04-25T10:04:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- 172.21.15.18:0/366614546 shutdown_connections 2024-04-25T10:04:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- 172.21.15.18:0/366614546 >> 172.21.15.18:0/366614546 conn(0x7fcb98067080 msgr2=0x7fcb9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- 172.21.15.18:0/366614546 shutdown_connections 2024-04-25T10:04:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- 172.21.15.18:0/366614546 wait complete. 2024-04-25T10:04:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 Processor -- start 2024-04-25T10:04:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.581+0000 7fcb9ca00640 1 -- start start 2024-04-25T10:04:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c004810 0x7fcb98139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb980c6c90 0x7fcb980c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9806ec70 con 0x7fcb980c5170 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9806eaf0 con 0x7fcb7c004810 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9815acd0 con 0x7fcb980c6c90 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33096/0 (socket says 172.21.15.18:33096) 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb95e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c004810 0x7fcb98139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 -- 172.21.15.18:0/1375474414 learned_addr learned my addr 172.21.15.18:0/1375474414 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb96800640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb980c6c90 0x7fcb980c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 -- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb980c6c90 msgr2=0x7fcb980c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb980c6c90 0x7fcb980c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 -- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c004810 msgr2=0x7fcb98139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c004810 0x7fcb98139070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 -- 172.21.15.18:0/1375474414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb980c56f0 con 0x7fcb980c5170 2024-04-25T10:04:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8fe00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb8001c3b0 tx=0x7fcb7c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800bf070 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800054a0 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb80001500 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb980c59d0 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb980c5f90 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.585+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb980745d0 con 0x7fcb980c5170 2024-04-25T10:04:08.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.589+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb800c2070 con 0x7fcb980c5170 2024-04-25T10:04:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.589+0000 7fcb8e000640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 0x7fcb74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.589+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcb8011eba0 con 0x7fcb980c5170 2024-04-25T10:04:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.589+0000 7fcb95e00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 0x7fcb74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.589+0000 7fcb95e00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 0x7fcb74069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009af0 tx=0x7fcb88009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.593+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb80016290 con 0x7fcb980c5170 2024-04-25T10:04:08.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb980ad730 con 0x7fcb980c5170 2024-04-25T10:04:08.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb8e000640 1 -- 172.21.15.18:0/1375474414 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb800ef180 con 0x7fcb980c5170 2024-04-25T10:04:08.766 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:08.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 msgr2=0x7fcb74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 0x7fcb74069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcb88009af0 tx=0x7fcb88009190 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 msgr2=0x7fcb980b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb8001c3b0 tx=0x7fcb7c005840 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 shutdown_connections 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcb74066f60 0x7fcb74069420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcb980c6c90 0x7fcb980c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb980c5170 0x7fcb980b3940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 --2- 172.21.15.18:0/1375474414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb7c004810 0x7fcb98139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 >> 172.21.15.18:0/1375474414 conn(0x7fcb98067080 msgr2=0x7fcb9806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 shutdown_connections 2024-04-25T10:04:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.757+0000 7fcb9ca00640 1 -- 172.21.15.18:0/1375474414 wait complete. 2024-04-25T10:04:08.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:08.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 Processor -- start 2024-04-25T10:04:08.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 -- start start 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652809a170 0x7f65280d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f652806bf30 0x7f65280cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652815e040 con 0x7f652815dc60 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65280cff80 con 0x7f652806bf30 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65280d0260 con 0x7f652809a170 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f652806bf30 0x7f65280cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652ca00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f652815dc60 0x7f6528099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56004/0 (socket says 172.21.15.18:56004) 2024-04-25T10:04:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652ca00640 1 -- 172.21.15.18:0/13786860 learned_addr learned my addr 172.21.15.18:0/13786860 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f6527e00640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652809a170 0x7f65280d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652d400640 1 -- 172.21.15.18:0/13786860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652809a170 msgr2=0x7f65280d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652d400640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652809a170 0x7f65280d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652d400640 1 -- 172.21.15.18:0/13786860 >> v1:172.21.15.18:6789/0 conn(0x7f652815dc60 legacy=0x7f6528099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f652d400640 1 -- 172.21.15.18:0/13786860 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65280d0540 con 0x7f652806bf30 2024-04-25T10:04:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.925+0000 7f6527400640 1 -- 172.21.15.18:0/13786860 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188551681 0 0) 0x7f652815e040 con 0x7f652815dc60 2024-04-25T10:04:08.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652d400640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f65280cf8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6520009d90 tx=0x7f652001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829cbbcaf569398d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f6527400640 1 -- 172.21.15.18:0/13786860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200b2070 con 0x7f652806bf30 2024-04-25T10:04:08.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f6527400640 1 -- 172.21.15.18:0/13786860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65200a5970 con 0x7f652806bf30 2024-04-25T10:04:08.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f6527400640 1 -- 172.21.15.18:0/13786860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200a5d40 con 0x7f652806bf30 2024-04-25T10:04:08.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- 172.21.15.18:0/13786860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 msgr2=0x7f65280cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f65280cf8a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6520009d90 tx=0x7f652001c8b0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- 172.21.15.18:0/13786860 shutdown_connections 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f65280cf8a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 --2- 172.21.15.18:0/13786860 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652809a170 0x7f65280d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- 172.21.15.18:0/13786860 >> 172.21.15.18:0/13786860 conn(0x7f65280b3200 msgr2=0x7f65280b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- 172.21.15.18:0/13786860 shutdown_connections 2024-04-25T10:04:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- 172.21.15.18:0/13786860 wait complete. 2024-04-25T10:04:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 Processor -- start 2024-04-25T10:04:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.929+0000 7f652f400640 1 -- start start 2024-04-25T10:04:08.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 0x7f65280b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652815dc60 0x7f652815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65280cc6f0 con 0x7f652806bf30 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65280cc570 con 0x7f652809a170 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65280cc870 con 0x7f652815dc60 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33122/0 (socket says 172.21.15.18:33122) 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 -- 172.21.15.18:0/535268607 learned_addr learned my addr 172.21.15.18:0/535268607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652d400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652815dc60 0x7f652815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 -- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652815dc60 msgr2=0x7f652815bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652815dc60 0x7f652815bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f6527e00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 0x7f65280b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 -- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 msgr2=0x7f65280b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 0x7f65280b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 -- 172.21.15.18:0/535268607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528155b10 con 0x7f652806bf30 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f6527e00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 0x7f65280b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652ca00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c4b0 tx=0x7f651c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c018070 con 0x7f652806bf30 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c007500 con 0x7f652806bf30 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c004a30 con 0x7f652806bf30 2024-04-25T10:04:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6528154790 con 0x7f652806bf30 2024-04-25T10:04:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6528154d50 con 0x7f652806bf30 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.933+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65280745d0 con 0x7f652806bf30 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.937+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f651c004bd0 con 0x7f652806bf30 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.937+0000 7f6524c00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 0x7f6508069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.937+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f651c084540 con 0x7f652806bf30 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.937+0000 7f6527e00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 0x7f6508069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:08.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.937+0000 7f6527e00640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 0x7f6508069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f652809b600 tx=0x7f6514008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:08.941+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6528155b10 con 0x7f652806bf30 2024-04-25T10:04:09.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.101+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65280b7590 con 0x7f652806bf30 2024-04-25T10:04:09.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f6524c00640 1 -- 172.21.15.18:0/535268607 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f651c054b20 con 0x7f652806bf30 2024-04-25T10:04:09.113 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 msgr2=0x7f6508069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 0x7f6508069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f652809b600 tx=0x7f6514008040 comp rx=0 tx=0).stop 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 msgr2=0x7f6528153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f651c00c4b0 tx=0x7f651c00c970 comp rx=0 tx=0).stop 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 shutdown_connections 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6508066f60 0x7f6508069420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f652815dc60 0x7f652815bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f652809a170 0x7f65280b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 --2- 172.21.15.18:0/535268607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f652806bf30 0x7f6528153fe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 >> 172.21.15.18:0/535268607 conn(0x7f65280b3200 msgr2=0x7f6528099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:09.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 shutdown_connections 2024-04-25T10:04:09.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.105+0000 7f652f400640 1 -- 172.21.15.18:0/535268607 wait complete. 2024-04-25T10:04:09.133 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:09.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 Processor -- start 2024-04-25T10:04:09.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 -- start start 2024-04-25T10:04:09.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066009a170 0x7f06600d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f066006bf30 0x7f06600cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066015e040 con 0x7f066015dc60 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06600cff80 con 0x7f066006bf30 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0665200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600d0260 con 0x7f066009a170 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f066006bf30 0x7f06600cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f066006bf30 0x7f06600cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33124/0 (socket says 172.21.15.18:33124) 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 -- 172.21.15.18:0/2429774337 learned_addr learned my addr 172.21.15.18:0/2429774337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f0655400640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066009a170 0x7f06600d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 -- 172.21.15.18:0/2429774337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066009a170 msgr2=0x7f06600d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066009a170 0x7f06600d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 -- 172.21.15.18:0/2429774337 >> v1:172.21.15.167:6789/0 conn(0x7f066015dc60 legacy=0x7f0660099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.269+0000 7f065e800640 1 -- 172.21.15.18:0/2429774337 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600d0540 con 0x7f066006bf30 2024-04-25T10:04:09.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f065e800640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f06600cf8a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0658009870 tx=0x7f065801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f82d1b00d205daf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f065d400640 1 -- 172.21.15.18:0/2429774337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580aa600 con 0x7f066006bf30 2024-04-25T10:04:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f065d400640 1 -- 172.21.15.18:0/2429774337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06580af070 con 0x7f066006bf30 2024-04-25T10:04:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f065d400640 1 -- 172.21.15.18:0/2429774337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580aa9c0 con 0x7f066006bf30 2024-04-25T10:04:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 -- 172.21.15.18:0/2429774337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 msgr2=0x7f06600cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f06600cf8a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0658009870 tx=0x7f065801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 -- 172.21.15.18:0/2429774337 shutdown_connections 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f06600cf8a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 --2- 172.21.15.18:0/2429774337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066009a170 0x7f06600d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 -- 172.21.15.18:0/2429774337 >> 172.21.15.18:0/2429774337 conn(0x7f06600b3200 msgr2=0x7f06600b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 -- 172.21.15.18:0/2429774337 shutdown_connections 2024-04-25T10:04:09.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.273+0000 7f0665200640 1 -- 172.21.15.18:0/2429774337 wait complete. 2024-04-25T10:04:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 Processor -- start 2024-04-25T10:04:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- start start 2024-04-25T10:04:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f066009a170 0x7f066015c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066015dc60 0x7f0660153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600cc6f0 con 0x7f066006bf30 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06600cc570 con 0x7f066009a170 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06600cc870 con 0x7f066015dc60 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33128/0 (socket says 172.21.15.18:33128) 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 -- 172.21.15.18:0/3083847532 learned_addr learned my addr 172.21.15.18:0/3083847532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065e800640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066015dc60 0x7f0660153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0655400640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f066009a170 0x7f066015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 -- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066015dc60 msgr2=0x7f0660153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066015dc60 0x7f0660153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 -- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f066009a170 msgr2=0x7f066015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f066009a170 0x7f066015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 -- 172.21.15.18:0/3083847532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06600ca4e0 con 0x7f066006bf30 2024-04-25T10:04:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f065de00640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f065000c370 tx=0x7f065000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500052d0 con 0x7f066006bf30 2024-04-25T10:04:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650005470 con 0x7f066006bf30 2024-04-25T10:04:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650007260 con 0x7f066006bf30 2024-04-25T10:04:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06600c9f20 con 0x7f066006bf30 2024-04-25T10:04:09.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.277+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660158ab0 con 0x7f066006bf30 2024-04-25T10:04:09.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.281+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06600745d0 con 0x7f066006bf30 2024-04-25T10:04:09.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.281+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0650007400 con 0x7f066006bf30 2024-04-25T10:04:09.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.281+0000 7f0656a00640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 0x7f063c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.281+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0650084880 con 0x7f066006bf30 2024-04-25T10:04:09.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.281+0000 7f0655400640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 0x7f063c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.285+0000 7f0655400640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 0x7f063c069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f066015d1a0 tx=0x7f06480098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.285+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0650054dd0 con 0x7f066006bf30 2024-04-25T10:04:09.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f06600b7590 con 0x7f066006bf30 2024-04-25T10:04:09.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0656a00640 1 -- 172.21.15.18:0/3083847532 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0650058e70 con 0x7f066006bf30 2024-04-25T10:04:09.462 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 msgr2=0x7f063c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 0x7f063c069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f066015d1a0 tx=0x7f06480098d0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 msgr2=0x7f066015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f065000c370 tx=0x7f065000c830 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 shutdown_connections 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f063c066f60 0x7f063c069420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f066015dc60 0x7f0660153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f066009a170 0x7f066015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 --2- 172.21.15.18:0/3083847532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f066006bf30 0x7f066015be40 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 >> 172.21.15.18:0/3083847532 conn(0x7f06600b3200 msgr2=0x7f06600ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:09.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 shutdown_connections 2024-04-25T10:04:09.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.453+0000 7f0665200640 1 -- 172.21.15.18:0/3083847532 wait complete. 2024-04-25T10:04:09.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:09.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.613+0000 7fa8d9a00640 1 Processor -- start 2024-04-25T10:04:09.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.613+0000 7fa8d9a00640 1 -- start start 2024-04-25T10:04:09.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa8d415f440 0x7fa8d40b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 0x7fa8d40cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d40b1c20 con 0x7fa8d40cc150 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d40b2720 con 0x7fa8d415f440 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d40b19d0 con 0x7fa8d415ff30 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa8d415f440 0x7fa8d40b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8cbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa8d40cc150 0x7fa8d415f820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56020/0 (socket says 172.21.15.18:56020) 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8cbe00640 1 -- 172.21.15.18:0/87242704 learned_addr learned my addr 172.21.15.18:0/87242704 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9000640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 0x7fa8d40cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d3e00640 1 -- 172.21.15.18:0/87242704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 msgr2=0x7fa8d40cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d3e00640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 0x7fa8d40cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d3e00640 1 -- 172.21.15.18:0/87242704 >> v1:172.21.15.18:6789/0 conn(0x7fa8d40cc150 legacy=0x7fa8d415f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d3e00640 1 -- 172.21.15.18:0/87242704 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40b1f00 con 0x7fa8d415f440 2024-04-25T10:04:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.617+0000 7fa8d9000640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 0x7fa8d40cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d3e00640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40b21e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40097c0 tx=0x7fa8c401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1d8ac9ea934f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d3400640 1 -- 172.21.15.18:0/87242704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c40b0070 con 0x7fa8d415f440 2024-04-25T10:04:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d3400640 1 -- 172.21.15.18:0/87242704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c40ab600 con 0x7fa8d415f440 2024-04-25T10:04:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d3400640 1 -- 172.21.15.18:0/87242704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d40d05e0 con 0x7fa8d415f440 2024-04-25T10:04:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- 172.21.15.18:0/87242704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 msgr2=0x7fa8d40b21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40b21e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40097c0 tx=0x7fa8c401c410 comp rx=0 tx=0).stop 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- 172.21.15.18:0/87242704 shutdown_connections 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d415ff30 0x7fa8d40cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/87242704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40b21e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- 172.21.15.18:0/87242704 >> 172.21.15.18:0/87242704 conn(0x7fa8d40d1640 msgr2=0x7fa8d40d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- 172.21.15.18:0/87242704 shutdown_connections 2024-04-25T10:04:09.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- 172.21.15.18:0/87242704 wait complete. 2024-04-25T10:04:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 Processor -- start 2024-04-25T10:04:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- start start 2024-04-25T10:04:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d40cc150 0x7fa8d415aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 0x7fa8d4070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4168900 con 0x7fa8d415f440 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4168780 con 0x7fa8d415ff30 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.621+0000 7fa8d9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d4168a80 con 0x7fa8d40cc150 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33140/0 (socket says 172.21.15.18:33140) 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 -- 172.21.15.18:0/2290882371 learned_addr learned my addr 172.21.15.18:0/2290882371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d3e00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d40cc150 0x7fa8d415aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 -- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d40cc150 msgr2=0x7fa8d415aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d9000640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 0x7fa8d4070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d40cc150 0x7fa8d415aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 -- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 msgr2=0x7fa8d4070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 0x7fa8d4070740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 -- 172.21.15.18:0/2290882371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d415b0d0 con 0x7fa8d415f440 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d9000640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 0x7fa8d4070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8cbe00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c370 tx=0x7fa8bc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc017070 con 0x7fa8d415f440 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc005cf0 con 0x7fa8d415f440 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0072f0 con 0x7fa8d415f440 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d415b3b0 con 0x7fa8d415f440 2024-04-25T10:04:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d415b970 con 0x7fa8d415f440 2024-04-25T10:04:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d40745d0 con 0x7fa8d415f440 2024-04-25T10:04:09.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.625+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa8bc01a070 con 0x7fa8d415f440 2024-04-25T10:04:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.629+0000 7fa8d0c00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 0x7fa8b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.629+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa8bc084760 con 0x7fa8d415f440 2024-04-25T10:04:09.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.629+0000 7fa8d3e00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 0x7fa8b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:09.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.629+0000 7fa8d3e00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 0x7fa8b0069450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40ad000 tx=0x7fa8c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:09.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.633+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa8bc055390 con 0x7fa8d415f440 2024-04-25T10:04:09.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8d40d2270 con 0x7fa8d415f440 2024-04-25T10:04:09.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d0c00640 1 -- 172.21.15.18:0/2290882371 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8bc054c90 con 0x7fa8d415f440 2024-04-25T10:04:09.813 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:09.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 msgr2=0x7fa8b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 0x7fa8b0069450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c40ad000 tx=0x7fa8c4008040 comp rx=0 tx=0).stop 2024-04-25T10:04:09.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 msgr2=0x7fa8d40ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c370 tx=0x7fa8bc00c830 comp rx=0 tx=0).stop 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 shutdown_connections 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8d415ff30 0x7fa8d4070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8d415f440 0x7fa8d40ca670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa8b0066f90 0x7fa8b0069450 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 --2- 172.21.15.18:0/2290882371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8d40cc150 0x7fa8d415aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 >> 172.21.15.18:0/2290882371 conn(0x7fa8d40d1640 msgr2=0x7fa8d415eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 shutdown_connections 2024-04-25T10:04:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:09.805+0000 7fa8d9a00640 1 -- 172.21.15.18:0/2290882371 wait complete. 2024-04-25T10:04:09.835 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:09.835 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:09.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:10.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 Processor -- start 2024-04-25T10:04:10.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 -- start start 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe270144140 0x7fe2700ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe27006ead0 0x7fe2700b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27015ac60 con 0x7fe2700ced60 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700cf3e0 con 0x7fe27006ead0 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe276800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27015af20 con 0x7fe270144140 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe26fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe27006ead0 0x7fe2700b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe26ea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe2700ced60 0x7fe27006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56028/0 (socket says 172.21.15.18:56028) 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe26ea00640 1 -- 172.21.15.18:0/2054650416 learned_addr learned my addr 172.21.15.18:0/2054650416 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:10.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.017+0000 7fe26f400640 1 --2- 172.21.15.18:0/2054650416 >> v2:172.21.15.167:3300/0 conn(0x7fe270144140 0x7fe2700ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26e000640 1 -- 172.21.15.18:0/2054650416 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144837152 0 0) 0x7fe27015ac60 con 0x7fe2700ced60 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26e000640 1 -- 172.21.15.18:0/2054650416 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe254003530 con 0x7fe2700ced60 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26fe00640 1 -- 172.21.15.18:0/2054650416 >> v2:172.21.15.167:3300/0 conn(0x7fe270144140 msgr2=0x7fe2700ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26fe00640 1 --2- 172.21.15.18:0/2054650416 >> v2:172.21.15.167:3300/0 conn(0x7fe270144140 0x7fe2700ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26fe00640 1 -- 172.21.15.18:0/2054650416 >> v1:172.21.15.18:6789/0 conn(0x7fe2700ced60 legacy=0x7fe27006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26fe00640 1 -- 172.21.15.18:0/2054650416 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27015b200 con 0x7fe27006ead0 2024-04-25T10:04:10.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26fe00640 1 --2- 172.21.15.18:0/2054650416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27006ead0 0x7fe2700b0760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe27006eef0 tx=0x7fe26801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f94bb763ced3c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26e000640 1 -- 172.21.15.18:0/2054650416 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680a7070 con 0x7fe27006ead0 2024-04-25T10:04:10.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26e000640 1 -- 172.21.15.18:0/2054650416 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680b0070 con 0x7fe27006ead0 2024-04-25T10:04:10.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe26e000640 1 -- 172.21.15.18:0/2054650416 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680ab890 con 0x7fe27006ead0 2024-04-25T10:04:10.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe276800640 1 -- 172.21.15.18:0/2054650416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27006ead0 msgr2=0x7fe2700b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe276800640 1 --2- 172.21.15.18:0/2054650416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27006ead0 0x7fe2700b0760 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe27006eef0 tx=0x7fe26801c930 comp rx=0 tx=0).stop 2024-04-25T10:04:10.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.021+0000 7fe276800640 1 -- 172.21.15.18:0/2054650416 shutdown_connections 2024-04-25T10:04:10.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 --2- 172.21.15.18:0/2054650416 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe27006ead0 0x7fe2700b0760 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 --2- 172.21.15.18:0/2054650416 >> v2:172.21.15.167:3300/0 conn(0x7fe270144140 0x7fe2700ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- 172.21.15.18:0/2054650416 >> 172.21.15.18:0/2054650416 conn(0x7fe270066fa0 msgr2=0x7fe27006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- 172.21.15.18:0/2054650416 shutdown_connections 2024-04-25T10:04:10.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- 172.21.15.18:0/2054650416 wait complete. 2024-04-25T10:04:10.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 Processor -- start 2024-04-25T10:04:10.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- start start 2024-04-25T10:04:10.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27006ead0 0x7fe270142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700ced60 0x7fe270140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27015bb80 con 0x7fe270144140 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27015ba00 con 0x7fe2700ced60 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2701653d0 con 0x7fe27006ead0 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33164/0 (socket says 172.21.15.18:33164) 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 -- 172.21.15.18:0/624062623 learned_addr learned my addr 172.21.15.18:0/624062623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26f400640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27006ead0 0x7fe270142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26ea00640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700ced60 0x7fe270140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 -- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27006ead0 msgr2=0x7fe270142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27006ead0 0x7fe270142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 -- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700ced60 msgr2=0x7fe270140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700ced60 0x7fe270140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 -- 172.21.15.18:0/624062623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270141030 con 0x7fe270144140 2024-04-25T10:04:10.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe26fe00640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ad040 tx=0x7fe2680196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680c2070 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680ab8f0 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680abce0 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.025+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe270141310 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2701418d0 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2700745d0 con 0x7fe270144140 2024-04-25T10:04:10.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2680c5070 con 0x7fe270144140 2024-04-25T10:04:10.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe267400640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 0x7fe250069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe26811f5f0 con 0x7fe270144140 2024-04-25T10:04:10.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe26f400640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 0x7fe250069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.029+0000 7fe26f400640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 0x7fe250069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe260009a50 tx=0x7fe260008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.033+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe268016520 con 0x7fe270144140 2024-04-25T10:04:10.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.197+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2701650f0 con 0x7fe270144140 2024-04-25T10:04:10.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.197+0000 7fe267400640 1 -- 172.21.15.18:0/624062623 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7fe2680f0220 con 0x7fe270144140 2024-04-25T10:04:10.207 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:10.208 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:10.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 msgr2=0x7fe250069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 0x7fe250069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe260009a50 tx=0x7fe260008040 comp rx=0 tx=0).stop 2024-04-25T10:04:10.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 msgr2=0x7fe270137830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe2680ad040 tx=0x7fe2680196d0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 shutdown_connections 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe270144140 0x7fe270137830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2700ced60 0x7fe270140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe250066f60 0x7fe250069420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 --2- 172.21.15.18:0/624062623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe27006ead0 0x7fe270142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 >> 172.21.15.18:0/624062623 conn(0x7fe270066fa0 msgr2=0x7fe27006db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 shutdown_connections 2024-04-25T10:04:10.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.201+0000 7fe276800640 1 -- 172.21.15.18:0/624062623 wait complete. 2024-04-25T10:04:10.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:10.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:10.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 Processor -- start 2024-04-25T10:04:10.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 -- start start 2024-04-25T10:04:10.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006c730 0x7fa5f015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5f006cb10 0x7fa5f0161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f015ef90 con 0x7fa5f0161ad0 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f009a9e0 con 0x7fa5f006cb10 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ef200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f009ae70 con 0x7fa5f006c730 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ee800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa5f0161ad0 0x7fa5f00cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56044/0 (socket says 172.21.15.18:56044) 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ee800640 1 -- 172.21.15.18:0/3145745365 learned_addr learned my addr 172.21.15.18:0/3145745365 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5e7e00640 1 --2- 172.21.15.18:0/3145745365 >> v2:172.21.15.167:3300/0 conn(0x7fa5f006cb10 0x7fa5f0161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ede00640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006c730 0x7fa5f015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ed400640 1 -- 172.21.15.18:0/3145745365 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2211882498 0 0) 0x7fa5f015ef90 con 0x7fa5f0161ad0 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5ed400640 1 -- 172.21.15.18:0/3145745365 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5d4003530 con 0x7fa5f0161ad0 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5e7e00640 1 -- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006c730 msgr2=0x7fa5f015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5e7e00640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006c730 0x7fa5f015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5e7e00640 1 -- 172.21.15.18:0/3145745365 >> v1:172.21.15.18:6789/0 conn(0x7fa5f0161ad0 legacy=0x7fa5f00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.365+0000 7fa5e7e00640 1 -- 172.21.15.18:0/3145745365 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0099dd0 con 0x7fa5f006cb10 2024-04-25T10:04:10.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5e7e00640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006cb10 0x7fa5f0161590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80097c0 tx=0x7fa5d801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ec6ae05507ce860 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ed400640 1 -- 172.21.15.18:0/3145745365 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a7070 con 0x7fa5f006cb10 2024-04-25T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ed400640 1 -- 172.21.15.18:0/3145745365 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5d80b0070 con 0x7fa5f006cb10 2024-04-25T10:04:10.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ed400640 1 -- 172.21.15.18:0/3145745365 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80ab870 con 0x7fa5f006cb10 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 -- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006cb10 msgr2=0x7fa5f0161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006cb10 0x7fa5f0161590 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80097c0 tx=0x7fa5d801c470 comp rx=0 tx=0).stop 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 -- 172.21.15.18:0/3145745365 shutdown_connections 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006cb10 0x7fa5f0161590 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 --2- 172.21.15.18:0/3145745365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006c730 0x7fa5f015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 -- 172.21.15.18:0/3145745365 >> 172.21.15.18:0/3145745365 conn(0x7fa5f00b3030 msgr2=0x7fa5f00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 -- 172.21.15.18:0/3145745365 shutdown_connections 2024-04-25T10:04:10.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.369+0000 7fa5ef200640 1 -- 172.21.15.18:0/3145745365 wait complete. 2024-04-25T10:04:10.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 Processor -- start 2024-04-25T10:04:10.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- start start 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006c730 0x7fa5f009e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006cb10 0x7fa5f0155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f01622f0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f015de20 con 0x7fa5f006c730 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f0099a60 con 0x7fa5f006cb10 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33168/0 (socket says 172.21.15.18:33168) 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 -- 172.21.15.18:0/1712707201 learned_addr learned my addr 172.21.15.18:0/1712707201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5e7e00640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006cb10 0x7fa5f0155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ede00640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006c730 0x7fa5f009e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 -- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006cb10 msgr2=0x7fa5f0155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006cb10 0x7fa5f0155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 -- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006c730 msgr2=0x7fa5f009e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006c730 0x7fa5f009e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 -- 172.21.15.18:0/1712707201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0155a90 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ee800640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cb40 tx=0x7fa5e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8017070 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e800aca0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e8012620 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5f00b6240 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f00b6800 con 0x7fa5f0161ad0 2024-04-25T10:04:10.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.373+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f00745d0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.377+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5e801a070 con 0x7fa5f0161ad0 2024-04-25T10:04:10.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.377+0000 7fa5e6000640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 0x7fa5cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.377+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa5e80850e0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.377+0000 7fa5ede00640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 0x7fa5cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.377+0000 7fa5ede00640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 0x7fa5cc069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009ac0 tx=0x7fa5e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.381+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5e8055750 con 0x7fa5f0161ad0 2024-04-25T10:04:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.545+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5f00b2ac0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.545+0000 7fa5e6000640 1 -- 172.21.15.18:0/1712707201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5e80597f0 con 0x7fa5f0161ad0 2024-04-25T10:04:10.556 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:10.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 msgr2=0x7fa5cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 0x7fa5cc069420 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0009ac0 tx=0x7fa5e0009190 comp rx=0 tx=0).stop 2024-04-25T10:04:10.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 msgr2=0x7fa5f00b1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa5e800cb40 tx=0x7fa5e800a060 comp rx=0 tx=0).stop 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 shutdown_connections 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5f0161ad0 0x7fa5f00b1c20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5cc066f60 0x7fa5cc069420 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5f006cb10 0x7fa5f0155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 --2- 172.21.15.18:0/1712707201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5f006c730 0x7fa5f009e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 >> 172.21.15.18:0/1712707201 conn(0x7fa5f00b3030 msgr2=0x7fa5f006f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 shutdown_connections 2024-04-25T10:04:10.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.549+0000 7fa5ef200640 1 -- 172.21.15.18:0/1712707201 wait complete. 2024-04-25T10:04:10.578 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 Processor -- start 2024-04-25T10:04:10.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 -- start start 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43bc15dc60 0x7f43bc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 0x7f43bc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc15e040 con 0x7f43bc06bf30 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0cff80 con 0x7f43bc15dc60 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43c1c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc0d0260 con 0x7f43bc09a170 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43baa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43bc15dc60 0x7f43bc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43ba000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f43bc06bf30 0x7f43bc099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56050/0 (socket says 172.21.15.18:56050) 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43ba000640 1 -- 172.21.15.18:0/2177697843 learned_addr learned my addr 172.21.15.18:0/2177697843 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43bb400640 1 --2- 172.21.15.18:0/2177697843 >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 0x7f43bc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43baa00640 1 -- 172.21.15.18:0/2177697843 >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 msgr2=0x7f43bc0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43baa00640 1 --2- 172.21.15.18:0/2177697843 >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 0x7f43bc0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43baa00640 1 -- 172.21.15.18:0/2177697843 >> v1:172.21.15.18:6789/0 conn(0x7f43bc06bf30 legacy=0x7f43bc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43b9600640 1 -- 172.21.15.18:0/2177697843 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784010952 0 0) 0x7f43bc15e040 con 0x7f43bc06bf30 2024-04-25T10:04:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43baa00640 1 -- 172.21.15.18:0/2177697843 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc0d0540 con 0x7f43bc15dc60 2024-04-25T10:04:10.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.713+0000 7f43bb400640 1 --2- 172.21.15.18:0/2177697843 >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 0x7f43bc0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:10.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43baa00640 1 --2- 172.21.15.18:0/2177697843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc0d1020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43bc072a70 tx=0x7f43ac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec29f7743dc5a7e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43b9600640 1 -- 172.21.15.18:0/2177697843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0b1070 con 0x7f43bc15dc60 2024-04-25T10:04:10.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43b9600640 1 -- 172.21.15.18:0/2177697843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac0ac620 con 0x7f43bc15dc60 2024-04-25T10:04:10.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43b9600640 1 -- 172.21.15.18:0/2177697843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac0ac9f0 con 0x7f43bc15dc60 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 -- 172.21.15.18:0/2177697843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 msgr2=0x7f43bc0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 --2- 172.21.15.18:0/2177697843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc0d1020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f43bc072a70 tx=0x7f43ac01c3c0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 -- 172.21.15.18:0/2177697843 shutdown_connections 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 --2- 172.21.15.18:0/2177697843 >> v2:172.21.15.167:3300/0 conn(0x7f43bc09a170 0x7f43bc0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 --2- 172.21.15.18:0/2177697843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc0d1020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 -- 172.21.15.18:0/2177697843 >> 172.21.15.18:0/2177697843 conn(0x7f43bc0b3200 msgr2=0x7f43bc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 -- 172.21.15.18:0/2177697843 shutdown_connections 2024-04-25T10:04:10.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 -- 172.21.15.18:0/2177697843 wait complete. 2024-04-25T10:04:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.717+0000 7f43c1c00640 1 Processor -- start 2024-04-25T10:04:10.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- start start 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43bc06bf30 0x7f43bc0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43bc09a170 0x7f43bc155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0cc6f0 con 0x7f43bc15dc60 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0cc570 con 0x7f43bc09a170 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc0cc870 con 0x7f43bc06bf30 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33180/0 (socket says 172.21.15.18:33180) 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 -- 172.21.15.18:0/4229177111 learned_addr learned my addr 172.21.15.18:0/4229177111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43ba000640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43bc09a170 0x7f43bc155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43baa00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43bc06bf30 0x7f43bc0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 -- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43bc06bf30 msgr2=0x7f43bc0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43bc06bf30 0x7f43bc0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 -- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43bc09a170 msgr2=0x7f43bc155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43bc09a170 0x7f43bc155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 -- 172.21.15.18:0/4229177111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc15ae30 con 0x7f43bc15dc60 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43bb400640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43b400cea0 tx=0x7f43b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b4003ba0 con 0x7f43bc15dc60 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b4003d60 con 0x7f43bc15dc60 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc15b110 con 0x7f43bc15dc60 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b400d880 con 0x7f43bc15dc60 2024-04-25T10:04:10.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc15b6d0 con 0x7f43bc15dc60 2024-04-25T10:04:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.721+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0745d0 con 0x7f43bc15dc60 2024-04-25T10:04:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.725+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43b400da20 con 0x7f43bc15dc60 2024-04-25T10:04:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.725+0000 7f43b2a00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 0x7f439c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:10.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.725+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f43b4085ce0 con 0x7f43bc15dc60 2024-04-25T10:04:10.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.725+0000 7f43baa00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 0x7f439c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:10.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.725+0000 7f43baa00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 0x7f439c069450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0ae000 tx=0x7f43ac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.729+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43b40562c0 con 0x7f43bc15dc60 2024-04-25T10:04:10.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.893+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f43bc0b7590 con 0x7f43bc15dc60 2024-04-25T10:04:10.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.893+0000 7f43b2a00640 1 -- 172.21.15.18:0/4229177111 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43b405a360 con 0x7f43bc15dc60 2024-04-25T10:04:10.903 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 msgr2=0x7f439c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 0x7f439c069450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0ae000 tx=0x7f43ac0a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 msgr2=0x7f43bc156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f43b400cea0 tx=0x7f43b400cf90 comp rx=0 tx=0).stop 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 shutdown_connections 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43bc15dc60 0x7f43bc156920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43bc09a170 0x7f43bc155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f439c066f90 0x7f439c069450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 --2- 172.21.15.18:0/4229177111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f43bc06bf30 0x7f43bc0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:10.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 >> 172.21.15.18:0/4229177111 conn(0x7f43bc0b3200 msgr2=0x7f43bc15a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:10.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 shutdown_connections 2024-04-25T10:04:10.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:10.897+0000 7f43c1c00640 1 -- 172.21.15.18:0/4229177111 wait complete. 2024-04-25T10:04:10.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:11.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 Processor -- start 2024-04-25T10:04:11.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 -- start start 2024-04-25T10:04:11.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff9c815dc60 0x7ff9c80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9c80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c815e040 con 0x7ff9c8099a60 2024-04-25T10:04:11.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80cff80 con 0x7ff9c815dc60 2024-04-25T10:04:11.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9cd400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d0260 con 0x7ff9c806bf30 2024-04-25T10:04:11.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9c7200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff9c8099a60 0x7ff9c80cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56066/0 (socket says 172.21.15.18:56066) 2024-04-25T10:04:11.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9c7200640 1 -- 172.21.15.18:0/3220412464 learned_addr learned my addr 172.21.15.18:0/3220412464 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9c80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9c6800640 1 --2- 172.21.15.18:0/3220412464 >> v2:172.21.15.167:3300/0 conn(0x7ff9c815dc60 0x7ff9c80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035185877 0 0) 0x7ff9c815e040 con 0x7ff9c8099a60 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.057+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ac003530 con 0x7ff9c8099a60 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127272785 0 0) 0x7ff9ac003530 con 0x7ff9c8099a60 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 msgr2=0x7ff9c80cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9c80cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 >> v2:172.21.15.167:3300/0 conn(0x7ff9c815dc60 msgr2=0x7ff9c80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 --2- 172.21.15.18:0/3220412464 >> v2:172.21.15.167:3300/0 conn(0x7ff9c815dc60 0x7ff9c80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80d0540 con 0x7ff9c8099a60 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff9c0001a00 con 0x7ff9c8099a60 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 >> v1:172.21.15.18:6789/0 conn(0x7ff9c8099a60 legacy=0x7ff9c80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9ac003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac004d50 0x7ff9ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80cff80 con 0x7ff9ac0039c0 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d0260 con 0x7ff9ac004d50 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac00b9d0 con 0x7ff9c806bf30 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9ac003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c7200640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac004d50 0x7ff9ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 -- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 msgr2=0x7ff9ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c806bf30 0x7ff9ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 -- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac004d50 msgr2=0x7ff9ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac004d50 0x7ff9ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c6800640 1 -- 172.21.15.18:0/3220412464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac003530 con 0x7ff9ac0039c0 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.061+0000 7ff9c7200640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac004d50 0x7ff9ac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c6800640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9ac003dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ae0 tx=0x7ff9b801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d22cedefbedb210 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80b2070 con 0x7ff9ac0039c0 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b80a5650 con 0x7ff9ac0039c0 2024-04-25T10:04:11.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c5e00640 1 -- 172.21.15.18:0/3220412464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80096b0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- 172.21.15.18:0/3220412464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 msgr2=0x7ff9ac003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 --2- 172.21.15.18:0/3220412464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9ac003dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ae0 tx=0x7ff9b801ca80 comp rx=0 tx=0).stop 2024-04-25T10:04:11.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c7200640 1 -- 172.21.15.18:0/3220412464 reap_dead start 2024-04-25T10:04:11.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- 172.21.15.18:0/3220412464 shutdown_connections 2024-04-25T10:04:11.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- 172.21.15.18:0/3220412464 >> 172.21.15.18:0/3220412464 conn(0x7ff9c80b3200 msgr2=0x7ff9c80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- 172.21.15.18:0/3220412464 shutdown_connections 2024-04-25T10:04:11.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- 172.21.15.18:0/3220412464 wait complete. 2024-04-25T10:04:11.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 Processor -- start 2024-04-25T10:04:11.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- start start 2024-04-25T10:04:11.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 0x7ff9c81fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c81fabf0 0x7ff9c81fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c806cfa0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c809a2a0 con 0x7ff9c81fabf0 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9cd400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c81fb5b0 con 0x7ff9c8157010 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33196/0 (socket says 172.21.15.18:33196) 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.065+0000 7ff9c6800640 1 -- 172.21.15.18:0/2902438740 learned_addr learned my addr 172.21.15.18:0/2902438740 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 0x7ff9c81fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c7200640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c81fabf0 0x7ff9c81fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 -- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 msgr2=0x7ff9c81fa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 0x7ff9c81fa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 -- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c81fabf0 msgr2=0x7ff9c81fb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c81fabf0 0x7ff9c81fb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 -- 172.21.15.18:0/2902438740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c80b15a0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 0x7ff9c81fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9c6800640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ae0 tx=0x7ff9ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80bc030 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b800f000 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80b2040 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c8070830 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c81f7140 con 0x7ff9ac0039c0 2024-04-25T10:04:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80745d0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.069+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff9b80bf070 con 0x7ff9ac0039c0 2024-04-25T10:04:11.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.073+0000 7ff9bea00640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 0x7ff9a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.073+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff9b811f2b0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.073+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 0x7ff9a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.073+0000 7ff9bfe00640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 0x7ff9a4069450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80affc0 tx=0x7ff9b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.077+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff9b80167c0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9c81686c0 con 0x7ff9ac0039c0 2024-04-25T10:04:11.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9bea00640 1 -- 172.21.15.18:0/2902438740 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9b80eff70 con 0x7ff9ac0039c0 2024-04-25T10:04:11.247 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:11.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 msgr2=0x7ff9a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 0x7ff9a4069450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80affc0 tx=0x7ff9b0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 msgr2=0x7ff9c81577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.237+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ae0 tx=0x7ff9ac005840 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 shutdown_connections 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c81fabf0 0x7ff9c81fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9a4066f90 0x7ff9a4069450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9c8157010 0x7ff9c81fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 --2- 172.21.15.18:0/2902438740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac0039c0 0x7ff9c81577b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 >> 172.21.15.18:0/2902438740 conn(0x7ff9c80b3200 msgr2=0x7ff9c80b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 shutdown_connections 2024-04-25T10:04:11.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.241+0000 7ff9cd400640 1 -- 172.21.15.18:0/2902438740 wait complete. 2024-04-25T10:04:11.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:11.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.401+0000 7ff4a4c00640 1 Processor -- start 2024-04-25T10:04:11.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.401+0000 7ff4a4c00640 1 -- start start 2024-04-25T10:04:11.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff4a4c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a0144120 0x7ff4a015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff4a4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff4a4c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a015bc40 con 0x7ff4a00ccbf0 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff4a4c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a015e490 con 0x7ff4a0144120 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff4a4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a015b3a0 con 0x7ff4a00b3090 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a0144120 0x7ff4a015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4a0144120 0x7ff4a015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33198/0 (socket says 172.21.15.18:33198) 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 -- 172.21.15.18:0/1478012068 learned_addr learned my addr 172.21.15.18:0/1478012068 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49e800640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 -- 172.21.15.18:0/1478012068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 msgr2=0x7ff4a00b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a00b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 -- 172.21.15.18:0/1478012068 >> v1:172.21.15.167:6789/0 conn(0x7ff4a00ccbf0 legacy=0x7ff4a015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.405+0000 7ff49de00640 1 -- 172.21.15.18:0/1478012068 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a015b680 con 0x7ff4a0144120 2024-04-25T10:04:11.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff49de00640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a015acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff490009870 tx=0x7ff49001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89745f124884b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff49d400640 1 -- 172.21.15.18:0/1478012068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900b0070 con 0x7ff4a0144120 2024-04-25T10:04:11.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff49d400640 1 -- 172.21.15.18:0/1478012068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4900ab600 con 0x7ff4a0144120 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff49d400640 1 -- 172.21.15.18:0/1478012068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4900ab9d0 con 0x7ff4a0144120 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1478012068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 msgr2=0x7ff4a015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a015acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff490009870 tx=0x7ff49001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1478012068 shutdown_connections 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a00b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1478012068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a015acd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1478012068 >> 172.21.15.18:0/1478012068 conn(0x7ff4a0067080 msgr2=0x7ff4a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1478012068 shutdown_connections 2024-04-25T10:04:11.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1478012068 wait complete. 2024-04-25T10:04:11.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 Processor -- start 2024-04-25T10:04:11.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.409+0000 7ff4a4c00640 1 -- start start 2024-04-25T10:04:11.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a015a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 0x7ff4a00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a01675c0 con 0x7ff4a0144120 2024-04-25T10:04:11.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0167440 con 0x7ff4a00ccbf0 2024-04-25T10:04:11.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0167740 con 0x7ff4a00b3090 2024-04-25T10:04:11.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33204/0 (socket says 172.21.15.18:33204) 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 -- 172.21.15.18:0/1008818211 learned_addr learned my addr 172.21.15.18:0/1008818211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49de00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a015a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff497e00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 0x7ff4a00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 -- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 msgr2=0x7ff4a015a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a015a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 -- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 msgr2=0x7ff4a00afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 0x7ff4a00afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 -- 172.21.15.18:0/1008818211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a015a610 con 0x7ff4a0144120 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff497e00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 0x7ff4a00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff49e800640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff498009dd0 tx=0x7ff49800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498018020 con 0x7ff4a0144120 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff498014480 con 0x7ff4a0144120 2024-04-25T10:04:11.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00b05e0 con 0x7ff4a0144120 2024-04-25T10:04:11.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff498014870 con 0x7ff4a0144120 2024-04-25T10:04:11.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a013a0c0 con 0x7ff4a0144120 2024-04-25T10:04:11.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a00745d0 con 0x7ff4a0144120 2024-04-25T10:04:11.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.413+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff49801b020 con 0x7ff4a0144120 2024-04-25T10:04:11.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.417+0000 7ff496000640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 0x7ff47c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.417+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff4980860e0 con 0x7ff4a0144120 2024-04-25T10:04:11.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.417+0000 7ff49de00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 0x7ff47c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.417+0000 7ff49de00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 0x7ff47c069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4900ad000 tx=0x7ff4900a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.417+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff498022030 con 0x7ff4a0144120 2024-04-25T10:04:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff4a006c250 con 0x7ff4a0144120 2024-04-25T10:04:11.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff496000640 1 -- 172.21.15.18:0/1008818211 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff498010040 con 0x7ff4a0144120 2024-04-25T10:04:11.589 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 msgr2=0x7ff47c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 0x7ff47c069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff4900ad000 tx=0x7ff4900a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:11.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 msgr2=0x7ff4a013ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff498009dd0 tx=0x7ff49800c490 comp rx=0 tx=0).stop 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 shutdown_connections 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a0144120 0x7ff4a013ef20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a00ccbf0 0x7ff4a00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff47c066f60 0x7ff47c069420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 --2- 172.21.15.18:0/1008818211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4a00b3090 0x7ff4a015a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 >> 172.21.15.18:0/1008818211 conn(0x7ff4a0067080 msgr2=0x7ff4a00b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 shutdown_connections 2024-04-25T10:04:11.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.581+0000 7ff4a4c00640 1 -- 172.21.15.18:0/1008818211 wait complete. 2024-04-25T10:04:11.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 Processor -- start 2024-04-25T10:04:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 -- start start 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b0015eb50 0x7f9b0015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 0x7f9b000716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b0015efe0 con 0x7f9b0015e770 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b00071c20 con 0x7f9b0015eb50 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9b06600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0006db20 con 0x7f9b00071270 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9af7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b0015eb50 0x7f9b0015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9af7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9b0015eb50 0x7f9b0015f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40786/0 (socket says 172.21.15.18:40786) 2024-04-25T10:04:11.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.741+0000 7f9af7e00640 1 -- 172.21.15.18:0/4050954827 learned_addr learned my addr 172.21.15.18:0/4050954827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9affe00640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 0x7f9b000716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9af7e00640 1 -- 172.21.15.18:0/4050954827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 msgr2=0x7f9b000716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9af7e00640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 0x7f9b000716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9af7e00640 1 -- 172.21.15.18:0/4050954827 >> v1:172.21.15.167:6789/0 conn(0x7f9b0015e770 legacy=0x7f9b0006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:11.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9af7e00640 1 -- 172.21.15.18:0/4050954827 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0006de00 con 0x7f9b0015eb50 2024-04-25T10:04:11.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9affe00640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 0x7f9b000716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:11.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9af7e00640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b0015f230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009870 tx=0x7f9ae801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2775c25a2a7ee7ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9afea00640 1 -- 172.21.15.18:0/4050954827 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80aa430 con 0x7f9b0015eb50 2024-04-25T10:04:11.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9afea00640 1 -- 172.21.15.18:0/4050954827 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae80af070 con 0x7f9b0015eb50 2024-04-25T10:04:11.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9afea00640 1 -- 172.21.15.18:0/4050954827 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80aa7f0 con 0x7f9b0015eb50 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9b06600640 1 -- 172.21.15.18:0/4050954827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 msgr2=0x7f9b0015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.745+0000 7f9b06600640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b0015f230 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8009870 tx=0x7f9ae801c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- 172.21.15.18:0/4050954827 shutdown_connections 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b00071270 0x7f9b000716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 --2- 172.21.15.18:0/4050954827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b0015f230 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- 172.21.15.18:0/4050954827 >> 172.21.15.18:0/4050954827 conn(0x7f9b00067080 msgr2=0x7f9b0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- 172.21.15.18:0/4050954827 shutdown_connections 2024-04-25T10:04:11.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- 172.21.15.18:0/4050954827 wait complete. 2024-04-25T10:04:11.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 Processor -- start 2024-04-25T10:04:11.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- start start 2024-04-25T10:04:11.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b00071270 0x7f9b00153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b0015e770 0x7f9b0013f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000aed70 con 0x7f9b0015eb50 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0015f770 con 0x7f9b00071270 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9b06600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b000aeef0 con 0x7f9b0015e770 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40796/0 (socket says 172.21.15.18:40796) 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 -- 172.21.15.18:0/2117513630 learned_addr learned my addr 172.21.15.18:0/2117513630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9af7e00640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b0015e770 0x7f9b0013f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9aff400640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b00071270 0x7f9b00153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 -- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b0015e770 msgr2=0x7f9b0013f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b0015e770 0x7f9b0013f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 -- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b00071270 msgr2=0x7f9b00153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b00071270 0x7f9b00153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 -- 172.21.15.18:0/2117513630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b001544b0 con 0x7f9b0015eb50 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.749+0000 7f9affe00640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9af800cd80 tx=0x7f9af800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800f680 con 0x7f9b0015eb50 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af800f840 con 0x7f9b0015eb50 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af800fc30 con 0x7f9b0015eb50 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b00154790 con 0x7f9b0015eb50 2024-04-25T10:04:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b00154d50 con 0x7f9b0015eb50 2024-04-25T10:04:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b000745d0 con 0x7f9b0015eb50 2024-04-25T10:04:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9af800e3e0 con 0x7f9b0015eb50 2024-04-25T10:04:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9af8085ff0 con 0x7f9b0015eb50 2024-04-25T10:04:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.753+0000 7f9aff400640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.757+0000 7f9aff400640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 0x7f9adc069420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9af0001770 tx=0x7f9af0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:11.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.757+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9af8014030 con 0x7f9b0015eb50 2024-04-25T10:04:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9b000cea60 con 0x7f9b0015eb50 2024-04-25T10:04:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9af7400640 1 -- 172.21.15.18:0/2117513630 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9af80565f0 con 0x7f9b0015eb50 2024-04-25T10:04:11.945 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 msgr2=0x7f9adc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 0x7f9adc069420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9af0001770 tx=0x7f9af0009040 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 msgr2=0x7f9b00141cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9af800cd80 tx=0x7f9af800a650 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 shutdown_connections 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b0015eb50 0x7f9b00141cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9adc066f60 0x7f9adc069420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b0015e770 0x7f9b0013f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 --2- 172.21.15.18:0/2117513630 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b00071270 0x7f9b00153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 >> 172.21.15.18:0/2117513630 conn(0x7f9b00067080 msgr2=0x7f9b00155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 shutdown_connections 2024-04-25T10:04:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:11.937+0000 7f9b06600640 1 -- 172.21.15.18:0/2117513630 wait complete. 2024-04-25T10:04:11.966 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi018.front.sepia.ceph.com... 2024-04-25T10:04:11.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:11.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T10:04:11.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi018.stderr:ceph-fuse[32352]: fuse finished with error 0 and tester_r 0 2024-04-25T10:04:11.997 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:04:12.084 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:04:12.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:12.085 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T10:04:12.103 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.273+0000 7f3a73200640 1 Processor -- start 2024-04-25T10:04:12.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.273+0000 7f3a73200640 1 -- start start 2024-04-25T10:04:12.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a73200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 0x7f3a740cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a73200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3a740717c0 0x7f3a740cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a73200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a740cdb30 con 0x7f3a7415fde0 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a73200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7415c340 con 0x7f3a740717c0 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a73200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74145280 con 0x7f3a74144ea0 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a69400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a7415fde0 0x7f3a740710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58950/0 (socket says 172.21.15.18:58950) 2024-04-25T10:04:12.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a69400640 1 -- 172.21.15.18:0/899888501 learned_addr learned my addr 172.21.15.18:0/899888501 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71e00640 1 --2- 172.21.15.18:0/899888501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 0x7f3a740cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a72800640 1 --2- 172.21.15.18:0/899888501 >> v2:172.21.15.167:3300/0 conn(0x7f3a740717c0 0x7f3a740cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776133972 0 0) 0x7f3a740cdb30 con 0x7f3a7415fde0 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a58003530 con 0x7f3a7415fde0 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941125638 0 0) 0x7f3a58003530 con 0x7f3a7415fde0 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71e00640 1 -- 172.21.15.18:0/899888501 >> v2:172.21.15.167:3300/0 conn(0x7f3a740717c0 msgr2=0x7f3a740cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:12.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71e00640 1 --2- 172.21.15.18:0/899888501 >> v2:172.21.15.167:3300/0 conn(0x7f3a740717c0 0x7f3a740cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71e00640 1 -- 172.21.15.18:0/899888501 >> v1:172.21.15.18:6789/0 conn(0x7f3a7415fde0 legacy=0x7f3a740710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.277+0000 7f3a71e00640 1 -- 172.21.15.18:0/899888501 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7415bcf0 con 0x7f3a74144ea0 2024-04-25T10:04:12.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a71e00640 1 --2- 172.21.15.18:0/899888501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 0x7f3a740cd1c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097c0 tx=0x7f3a6401c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cf941de0cc2559a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640b0070 con 0x7f3a74144ea0 2024-04-25T10:04:12.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a640ab400 con 0x7f3a74144ea0 2024-04-25T10:04:12.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a71400640 1 -- 172.21.15.18:0/899888501 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c001680 con 0x7f3a74144ea0 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- 172.21.15.18:0/899888501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 msgr2=0x7f3a740cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 --2- 172.21.15.18:0/899888501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 0x7f3a740cd1c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3a640097c0 tx=0x7f3a6401c390 comp rx=0 tx=0).stop 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- 172.21.15.18:0/899888501 shutdown_connections 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 --2- 172.21.15.18:0/899888501 >> v2:172.21.15.167:3300/0 conn(0x7f3a740717c0 0x7f3a740cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 --2- 172.21.15.18:0/899888501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a74144ea0 0x7f3a740cd1c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- 172.21.15.18:0/899888501 >> 172.21.15.18:0/899888501 conn(0x7f3a74066fa0 msgr2=0x7f3a7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- 172.21.15.18:0/899888501 shutdown_connections 2024-04-25T10:04:12.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- 172.21.15.18:0/899888501 wait complete. 2024-04-25T10:04:12.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 Processor -- start 2024-04-25T10:04:12.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.281+0000 7f3a73200640 1 -- start start 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a740717c0 0x7f3a740adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 0x7f3a741302f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a741684e0 con 0x7f3a74144ea0 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a740cd910 con 0x7f3a7415fde0 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a74168660 con 0x7f3a740717c0 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40808/0 (socket says 172.21.15.18:40808) 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 -- 172.21.15.18:0/2585738997 learned_addr learned my addr 172.21.15.18:0/2585738997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a71e00640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a740717c0 0x7f3a740adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a72800640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 0x7f3a741302f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 -- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a740717c0 msgr2=0x7f3a740adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a740717c0 0x7f3a740adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 -- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 msgr2=0x7f3a741302f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 0x7f3a741302f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 -- 172.21.15.18:0/2585738997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a740c4a20 con 0x7f3a74144ea0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a72800640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 0x7f3a741302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a69400640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c6d0 tx=0x7f3a5c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c017070 con 0x7f3a74144ea0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c005ae0 con 0x7f3a74144ea0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c007070 con 0x7f3a74144ea0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a740c44a0 con 0x7f3a74144ea0 2024-04-25T10:04:12.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a74131550 con 0x7f3a74144ea0 2024-04-25T10:04:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a7404efa0 con 0x7f3a74144ea0 2024-04-25T10:04:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.285+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a5c01a070 con 0x7f3a74144ea0 2024-04-25T10:04:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.289+0000 7f3a6aa00640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 0x7f3a50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.289+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a5c084850 con 0x7f3a74144ea0 2024-04-25T10:04:12.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.289+0000 7f3a71e00640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 0x7f3a50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.289+0000 7f3a71e00640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 0x7f3a50069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a640ad000 tx=0x7f3a64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.293+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a740c4a20 con 0x7f3a74144ea0 2024-04-25T10:04:12.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a740ce350 con 0x7f3a74144ea0 2024-04-25T10:04:12.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a6aa00640 1 -- 172.21.15.18:0/2585738997 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f3a5c054e30 con 0x7f3a74144ea0 2024-04-25T10:04:12.466 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:12.466 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 msgr2=0x7f3a50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 0x7f3a50069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a640ad000 tx=0x7f3a64008040 comp rx=0 tx=0).stop 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 msgr2=0x7f3a740aabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c6d0 tx=0x7f3a5c00cb90 comp rx=0 tx=0).stop 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 shutdown_connections 2024-04-25T10:04:12.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a7415fde0 0x7f3a741302f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74144ea0 0x7f3a740aabb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a50066f60 0x7f3a50069420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 --2- 172.21.15.18:0/2585738997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a740717c0 0x7f3a740adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 >> 172.21.15.18:0/2585738997 conn(0x7f3a74066fa0 msgr2=0x7f3a7415ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 shutdown_connections 2024-04-25T10:04:12.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.457+0000 7f3a73200640 1 -- 172.21.15.18:0/2585738997 wait complete. 2024-04-25T10:04:12.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 Processor -- start 2024-04-25T10:04:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 -- start start 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b9415e1e0 0x7f6b940ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b940cd9b0 con 0x7f6b940cecf0 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b940b47c0 con 0x7f6b940adf10 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b9a600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9406bf30 con 0x7f6b9415e1e0 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6b940cecf0 0x7f6b940b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58960/0 (socket says 172.21.15.18:58960) 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93e00640 1 -- 172.21.15.18:0/3653753678 learned_addr learned my addr 172.21.15.18:0/3653753678 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93400640 1 --2- 172.21.15.18:0/3653753678 >> v2:172.21.15.167:3300/0 conn(0x7f6b9415e1e0 0x7f6b940ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b92000640 1 -- 172.21.15.18:0/3653753678 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046381989 0 0) 0x7f6b8c0014a0 con 0x7f6b940cecf0 2024-04-25T10:04:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b92000640 1 -- 172.21.15.18:0/3653753678 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b78003530 con 0x7f6b940cecf0 2024-04-25T10:04:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93400640 1 -- 172.21.15.18:0/3653753678 >> v1:172.21.15.167:6789/0 conn(0x7f6b940adf10 legacy=0x7f6b940b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93400640 1 -- 172.21.15.18:0/3653753678 >> v1:172.21.15.18:6789/0 conn(0x7f6b940cecf0 legacy=0x7f6b940b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.621+0000 7f6b93400640 1 -- 172.21.15.18:0/3653753678 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9406c180 con 0x7f6b9415e1e0 2024-04-25T10:04:12.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b93400640 1 --2- 172.21.15.18:0/3653753678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b940ad9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b840097c0 tx=0x7f6b8401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5a03bca5eec5d78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b92000640 1 -- 172.21.15.18:0/3653753678 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840b0070 con 0x7f6b9415e1e0 2024-04-25T10:04:12.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b92000640 1 -- 172.21.15.18:0/3653753678 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b840ab600 con 0x7f6b9415e1e0 2024-04-25T10:04:12.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b92000640 1 -- 172.21.15.18:0/3653753678 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b840ab9d0 con 0x7f6b9415e1e0 2024-04-25T10:04:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 -- 172.21.15.18:0/3653753678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 msgr2=0x7f6b940ad9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 --2- 172.21.15.18:0/3653753678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b940ad9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b840097c0 tx=0x7f6b8401c410 comp rx=0 tx=0).stop 2024-04-25T10:04:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 -- 172.21.15.18:0/3653753678 shutdown_connections 2024-04-25T10:04:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 --2- 172.21.15.18:0/3653753678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b940ad9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 -- 172.21.15.18:0/3653753678 >> 172.21.15.18:0/3653753678 conn(0x7f6b940cc810 msgr2=0x7f6b940ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 -- 172.21.15.18:0/3653753678 shutdown_connections 2024-04-25T10:04:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.625+0000 7f6b9a600640 1 -- 172.21.15.18:0/3653753678 wait complete. 2024-04-25T10:04:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 Processor -- start 2024-04-25T10:04:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- start start 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b940adf10 0x7f6b94153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b9414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b941692b0 con 0x7f6b940cecf0 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9406c460 con 0x7f6b9415e1e0 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b94169430 con 0x7f6b940adf10 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40818/0 (socket says 172.21.15.18:40818) 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 -- 172.21.15.18:0/474817088 learned_addr learned my addr 172.21.15.18:0/474817088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 -- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b940adf10 msgr2=0x7f6b94153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b940adf10 0x7f6b94153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 -- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 msgr2=0x7f6b9414a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b9414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 -- 172.21.15.18:0/474817088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9414d870 con 0x7f6b940cecf0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b92a00640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c530 tx=0x7f6b8000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80016020 con 0x7f6b940cecf0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80005220 con 0x7f6b940cecf0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80007030 con 0x7f6b940cecf0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9414db50 con 0x7f6b940cecf0 2024-04-25T10:04:12.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9414e110 con 0x7f6b940cecf0 2024-04-25T10:04:12.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.629+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b940745d0 con 0x7f6b940cecf0 2024-04-25T10:04:12.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.633+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b800071d0 con 0x7f6b940cecf0 2024-04-25T10:04:12.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.633+0000 7f6b8b400640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 0x7f6b74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.633+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6b80084d20 con 0x7f6b940cecf0 2024-04-25T10:04:12.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.633+0000 7f6b93400640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 0x7f6b74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.633+0000 7f6b93400640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 0x7f6b74069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b840ad000 tx=0x7f6b84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.637+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b80089070 con 0x7f6b940cecf0 2024-04-25T10:04:12.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.801+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b940cd5b0 con 0x7f6b940cecf0 2024-04-25T10:04:12.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.801+0000 7f6b8b400640 1 -- 172.21.15.18:0/474817088 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f6b80020020 con 0x7f6b940cecf0 2024-04-25T10:04:12.812 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:12.812 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:12.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 msgr2=0x7f6b74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 0x7f6b74069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6b840ad000 tx=0x7f6b84008040 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 msgr2=0x7f6b94149d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c530 tx=0x7f6b8000c9f0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 shutdown_connections 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b9415e1e0 0x7f6b9414a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b940cecf0 0x7f6b94149d40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6b74066f60 0x7f6b74069420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 --2- 172.21.15.18:0/474817088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b940adf10 0x7f6b94153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 >> 172.21.15.18:0/474817088 conn(0x7f6b940cc810 msgr2=0x7f6b9406fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 shutdown_connections 2024-04-25T10:04:12.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.805+0000 7f6b9a600640 1 -- 172.21.15.18:0/474817088 wait complete. 2024-04-25T10:04:12.834 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:04:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 Processor -- start 2024-04-25T10:04:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 -- start start 2024-04-25T10:04:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978415fc00 con 0x7f978406e4a0 2024-04-25T10:04:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978415fee0 con 0x7f978415f440 2024-04-25T10:04:12.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f978b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978406d640 con 0x7f9784159320 2024-04-25T10:04:12.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9789000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f978406e4a0 0x7f9784071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58974/0 (socket says 172.21.15.18:58974) 2024-04-25T10:04:12.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9789000640 1 -- 172.21.15.18:0/2520152204 learned_addr learned my addr 172.21.15.18:0/2520152204 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:12.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783e00640 1 --2- 172.21.15.18:0/2520152204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409550882 0 0) 0x7f978415fc00 con 0x7f978406e4a0 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9768003530 con 0x7f978406e4a0 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847544800 0 0) 0x7f978415fee0 con 0x7f978415f440 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f978415fc00 con 0x7f978415f440 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783e00640 1 -- 172.21.15.18:0/2520152204 >> v1:172.21.15.167:6789/0 conn(0x7f978415f440 legacy=0x7f978406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783e00640 1 -- 172.21.15.18:0/2520152204 >> v1:172.21.15.18:6789/0 conn(0x7f978406e4a0 legacy=0x7f9784071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834079201 0 0) 0x7f9768003530 con 0x7f978406e4a0 2024-04-25T10:04:12.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.969+0000 7f9783e00640 1 -- 172.21.15.18:0/2520152204 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97841601c0 con 0x7f9784159320 2024-04-25T10:04:12.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f9783e00640 1 --2- 172.21.15.18:0/2520152204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978415c9b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97740097f0 tx=0x7f977401c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b374f4a0b90168c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740b0070 con 0x7f9784159320 2024-04-25T10:04:12.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97740ab400 con 0x7f9784159320 2024-04-25T10:04:12.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f9783400640 1 -- 172.21.15.18:0/2520152204 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c001a00 con 0x7f9784159320 2024-04-25T10:04:12.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 -- 172.21.15.18:0/2520152204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 msgr2=0x7f978415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 --2- 172.21.15.18:0/2520152204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978415c9b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f97740097f0 tx=0x7f977401c340 comp rx=0 tx=0).stop 2024-04-25T10:04:12.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 -- 172.21.15.18:0/2520152204 shutdown_connections 2024-04-25T10:04:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 --2- 172.21.15.18:0/2520152204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978415c9b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 -- 172.21.15.18:0/2520152204 >> 172.21.15.18:0/2520152204 conn(0x7f9784067080 msgr2=0x7f978406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 -- 172.21.15.18:0/2520152204 shutdown_connections 2024-04-25T10:04:12.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.973+0000 7f978b000640 1 -- 172.21.15.18:0/2520152204 wait complete. 2024-04-25T10:04:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 Processor -- start 2024-04-25T10:04:12.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- start start 2024-04-25T10:04:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978406e4a0 0x7f9784158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978413d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978415f9a0 con 0x7f978415f440 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f978415f820 con 0x7f978406e4a0 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9784071980 con 0x7f9784159320 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40820/0 (socket says 172.21.15.18:40820) 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 -- 172.21.15.18:0/3281118549 learned_addr learned my addr 172.21.15.18:0/3281118549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9783e00640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978406e4a0 0x7f9784158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 -- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 msgr2=0x7f978413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 -- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978406e4a0 msgr2=0x7f9784158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978406e4a0 0x7f9784158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 -- 172.21.15.18:0/3281118549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978413cad0 con 0x7f978415f440 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9789000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f977c00cc50 tx=0x7f977c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c017070 con 0x7f978415f440 2024-04-25T10:04:12.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c012400 con 0x7f978415f440 2024-04-25T10:04:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978413e560 con 0x7f978415f440 2024-04-25T10:04:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00ce60 con 0x7f978415f440 2024-04-25T10:04:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.977+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978413eb20 con 0x7f978415f440 2024-04-25T10:04:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97840745d0 con 0x7f978415f440 2024-04-25T10:04:12.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f977c01a070 con 0x7f978415f440 2024-04-25T10:04:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f9780c00640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 0x7f9760069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f977c085300 con 0x7f978415f440 2024-04-25T10:04:12.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f9783e00640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 0x7f9760069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:12.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.981+0000 7f9783e00640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 0x7f9760069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97740ad000 tx=0x7f97740a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:12.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:12.985+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f977c055fd0 con 0x7f978415f440 2024-04-25T10:04:13.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.185+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f97840acf90 con 0x7f978415f440 2024-04-25T10:04:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.829+0000 7f9780c00640 1 -- 172.21.15.18:0/3281118549 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f977c0558d0 con 0x7f978415f440 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 msgr2=0x7f9760069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 0x7f9760069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f97740ad000 tx=0x7f97740a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 msgr2=0x7f9784140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f977c00cc50 tx=0x7f977c00a430 comp rx=0 tx=0).stop 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 shutdown_connections 2024-04-25T10:04:13.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f978415f440 0x7f9784140480 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9760066f60 0x7f9760069420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9784159320 0x7f978413d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 --2- 172.21.15.18:0/3281118549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f978406e4a0 0x7f9784158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 >> 172.21.15.18:0/3281118549 conn(0x7f9784067080 msgr2=0x7f97840adb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 shutdown_connections 2024-04-25T10:04:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:13.833+0000 7f978b000640 1 -- 172.21.15.18:0/3281118549 wait complete. 2024-04-25T10:04:13.867 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T10:04:13.867 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:04:14.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 Processor -- start 2024-04-25T10:04:14.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 -- start start 2024-04-25T10:04:14.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76fc15b9e0 0x7f76fc0cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 0x7f76fc15f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc09ade0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc15fd20 con 0x7f76fc15b9e0 2024-04-25T10:04:14.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f7701a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc099a60 con 0x7f76fc0d0080 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.009+0000 7f76fbe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76fc15b9e0 0x7f76fc0cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 0x7f76fc15f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76fc15b9e0 0x7f76fc0cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38316/0 (socket says 172.21.15.18:38316) 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 -- 172.21.15.18:0/406979679 learned_addr learned my addr 172.21.15.18:0/406979679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f7701000640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f76fc15f8f0 0x7f76fc15bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47752/0 (socket says 172.21.15.18:47752) 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 -- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 msgr2=0x7f76fc15f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 0x7f76fc15f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 -- 172.21.15.18:0/406979679 >> v1:172.21.15.167:6789/0 conn(0x7f76fc15f8f0 legacy=0x7f76fc15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 -- 172.21.15.18:0/406979679 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc099d40 con 0x7f76fc15b9e0 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76faa00640 1 -- 172.21.15.18:0/406979679 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759540787 0 0) 0x7f76f40014a0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fb400640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 0x7f76fc15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:14.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76fbe00640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc15b9e0 0x7f76fc0cfb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009870 tx=0x7f76ec01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fce1cce52522805f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76faa00640 1 -- 172.21.15.18:0/406979679 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0a9620 con 0x7f76fc15b9e0 2024-04-25T10:04:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76faa00640 1 -- 172.21.15.18:0/406979679 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec0a97c0 con 0x7f76fc15b9e0 2024-04-25T10:04:14.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.013+0000 7f76faa00640 1 -- 172.21.15.18:0/406979679 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0a9b90 con 0x7f76fc15b9e0 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc15b9e0 msgr2=0x7f76fc0cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc15b9e0 0x7f76fc0cfb40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009870 tx=0x7f76ec01c560 comp rx=0 tx=0).stop 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- 172.21.15.18:0/406979679 shutdown_connections 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc0d0080 0x7f76fc15f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- 172.21.15.18:0/406979679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc15b9e0 0x7f76fc0cfb40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- 172.21.15.18:0/406979679 >> 172.21.15.18:0/406979679 conn(0x7f76fc0b3030 msgr2=0x7f76fc0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- 172.21.15.18:0/406979679 shutdown_connections 2024-04-25T10:04:14.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- 172.21.15.18:0/406979679 wait complete. 2024-04-25T10:04:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 Processor -- start 2024-04-25T10:04:14.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- start start 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 0x7f76fc06d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc15b9e0 0x7f76fc0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc1686f0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc09a8c0 con 0x7f76fc0d0080 2024-04-25T10:04:14.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc168870 con 0x7f76fc15b9e0 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40834/0 (socket says 172.21.15.18:40834) 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701000640 1 -- 172.21.15.18:0/3601712972 learned_addr learned my addr 172.21.15.18:0/3601712972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f76fbe00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 0x7f76fc06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f76fb400640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc15b9e0 0x7f76fc0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701000640 1 -- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc15b9e0 msgr2=0x7f76fc0ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.017+0000 7f7701000640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc15b9e0 0x7f76fc0ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701000640 1 -- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 msgr2=0x7f76fc06d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701000640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 0x7f76fc06d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701000640 1 -- 172.21.15.18:0/3601712972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc06c200 con 0x7f76fc15f8f0 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76fbe00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 0x7f76fc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:14.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701000640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c7f0 tx=0x7f76f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4018070 con 0x7f76fc15f8f0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400a640 con 0x7f76fc15f8f0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400aa30 con 0x7f76fc15f8f0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc06c4e0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc06caa0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc0745d0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76f400abd0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 0x7f76dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:14.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f76f40849d0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.021+0000 7f76fbe00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 0x7f76dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.025+0000 7f76fbe00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 0x7f76dc069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0ae000 tx=0x7f76ec0b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:14.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.025+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76fc09ade0 con 0x7f76fc15f8f0 2024-04-25T10:04:14.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.225+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f76fc0d1320 con 0x7f76fc15f8f0 2024-04-25T10:04:14.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.837+0000 7f76f3e00640 1 -- 172.21.15.18:0/3601712972 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f76f4055610 con 0x7f76fc15f8f0 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 msgr2=0x7f76dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 0x7f76dc069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0ae000 tx=0x7f76ec0b3040 comp rx=0 tx=0).stop 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 msgr2=0x7f76fc0ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f76f400c7f0 tx=0x7f76f400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 shutdown_connections 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76fc15f8f0 0x7f76fc0ae450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76dc066f60 0x7f76dc069420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76fc15b9e0 0x7f76fc0ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 --2- 172.21.15.18:0/3601712972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76fc0d0080 0x7f76fc06d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 >> 172.21.15.18:0/3601712972 conn(0x7f76fc0b3030 msgr2=0x7f76fc14e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 shutdown_connections 2024-04-25T10:04:14.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:14.841+0000 7f7701a00640 1 -- 172.21.15.18:0/3601712972 wait complete. 2024-04-25T10:04:14.874 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:04:14.874 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 Processor -- start 2024-04-25T10:04:15.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 -- start start 2024-04-25T10:04:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f596c145270 0x7f596c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c0cd4d0 0x7f596c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c0cc4e0 con 0x7f596c0b1750 2024-04-25T10:04:15.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c145650 con 0x7f596c145270 2024-04-25T10:04:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.009+0000 7f5970c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0ce040 con 0x7f596c0cd4d0 2024-04-25T10:04:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f596a800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f596c0b1750 0x7f596c15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58982/0 (socket says 172.21.15.18:58982) 2024-04-25T10:04:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f596a800640 1 -- 172.21.15.18:0/250209279 learned_addr learned my addr 172.21.15.18:0/250209279 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 --2- 172.21.15.18:0/250209279 >> v2:172.21.15.18:3300/0 conn(0x7f596c145270 0x7f596c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5961400640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c0cd4d0 0x7f596c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 -- 172.21.15.18:0/250209279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c0cd4d0 msgr2=0x7f596c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c0cd4d0 0x7f596c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 -- 172.21.15.18:0/250209279 >> v1:172.21.15.18:6789/0 conn(0x7f596c0b1750 legacy=0x7f596c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 -- 172.21.15.18:0/250209279 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0ce320 con 0x7f596c145270 2024-04-25T10:04:15.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969400640 1 -- 172.21.15.18:0/250209279 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725195645 0 0) 0x7f596c0cc4e0 con 0x7f596c0b1750 2024-04-25T10:04:15.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969e00640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c145270 0x7f596c15fe50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246fbc8bb5c88b7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969400640 1 -- 172.21.15.18:0/250209279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0b2070 con 0x7f596c145270 2024-04-25T10:04:15.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969400640 1 -- 172.21.15.18:0/250209279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c0a5920 con 0x7f596c145270 2024-04-25T10:04:15.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.013+0000 7f5969400640 1 -- 172.21.15.18:0/250209279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c0a5cf0 con 0x7f596c145270 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- 172.21.15.18:0/250209279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c145270 msgr2=0x7f596c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c145270 0x7f596c15fe50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f595c009d90 tx=0x7f595c01c970 comp rx=0 tx=0).stop 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- 172.21.15.18:0/250209279 shutdown_connections 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c0cd4d0 0x7f596c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- 172.21.15.18:0/250209279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c145270 0x7f596c15fe50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- 172.21.15.18:0/250209279 >> 172.21.15.18:0/250209279 conn(0x7f596c066fa0 msgr2=0x7f596c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- 172.21.15.18:0/250209279 shutdown_connections 2024-04-25T10:04:15.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- 172.21.15.18:0/250209279 wait complete. 2024-04-25T10:04:15.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 Processor -- start 2024-04-25T10:04:15.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- start start 2024-04-25T10:04:15.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f596c0b1750 0x7f596c143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c145270 0x7f596c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0b1f70 con 0x7f596c0cd4d0 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c168710 con 0x7f596c0b1750 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5970c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0af600 con 0x7f596c145270 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40864/0 (socket says 172.21.15.18:40864) 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 -- 172.21.15.18:0/3128483538 learned_addr learned my addr 172.21.15.18:0/3128483538 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 -- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c145270 msgr2=0x7f596c15b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c145270 0x7f596c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 -- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f596c0b1750 msgr2=0x7f596c143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f596c0b1750 0x7f596c143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 -- 172.21.15.18:0/3128483538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c143c60 con 0x7f596c0cd4d0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.017+0000 7f5961400640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f595400d830 tx=0x7f595400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400b6c0 con 0x7f596c0cd4d0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5954019070 con 0x7f596c0cd4d0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595400ba60 con 0x7f596c0cd4d0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c143f40 con 0x7f596c0cd4d0 2024-04-25T10:04:15.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c166480 con 0x7f596c0cd4d0 2024-04-25T10:04:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c0745d0 con 0x7f596c0cd4d0 2024-04-25T10:04:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f595401e460 con 0x7f596c0cd4d0 2024-04-25T10:04:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 0x7f5948069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5954085950 con 0x7f596c0cd4d0 2024-04-25T10:04:15.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.021+0000 7f5969e00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 0x7f5948069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.025+0000 7f5969e00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 0x7f5948069470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f595c0af000 tx=0x7f595c004ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.025+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5954056700 con 0x7f596c0cd4d0 2024-04-25T10:04:15.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f596c15bc80 con 0x7f596c0cd4d0 2024-04-25T10:04:15.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5962a00640 1 -- 172.21.15.18:0/3128483538 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f5954056000 con 0x7f596c0cd4d0 2024-04-25T10:04:15.234 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:15.235 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:15.235 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:15.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 msgr2=0x7f5948069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 0x7f5948069470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f595c0af000 tx=0x7f595c004ac0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 msgr2=0x7f596c165f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f595400d830 tx=0x7f595400dcf0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 shutdown_connections 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5948066fb0 0x7f5948069470 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f596c145270 0x7f596c15b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f596c0cd4d0 0x7f596c165f40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 --2- 172.21.15.18:0/3128483538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f596c0b1750 0x7f596c143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 >> 172.21.15.18:0/3128483538 conn(0x7f596c066fa0 msgr2=0x7f596c0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.225+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 shutdown_connections 2024-04-25T10:04:15.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.229+0000 7f5970c00640 1 -- 172.21.15.18:0/3128483538 wait complete. 2024-04-25T10:04:15.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.385+0000 7fac3d800640 1 Processor -- start 2024-04-25T10:04:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 -- start start 2024-04-25T10:04:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac3815b5a0 0x7fac380cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fac3815b980 0x7fac380cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380ce7f0 con 0x7fac38071970 2024-04-25T10:04:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac380cfcd0 con 0x7fac3815b980 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac3d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac380cead0 con 0x7fac3815b5a0 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac37400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fac38071970 0x7fac3815f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58992/0 (socket says 172.21.15.18:58992) 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fac3815b980 0x7fac380cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac37400640 1 -- 172.21.15.18:0/2580452434 learned_addr learned my addr 172.21.15.18:0/2580452434 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36a00640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac3815b5a0 0x7fac380cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36000640 1 -- 172.21.15.18:0/2580452434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac3815b5a0 msgr2=0x7fac380cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36000640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac3815b5a0 0x7fac380cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36000640 1 -- 172.21.15.18:0/2580452434 >> v1:172.21.15.18:6789/0 conn(0x7fac38071970 legacy=0x7fac3815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac36000640 1 -- 172.21.15.18:0/2580452434 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380cf960 con 0x7fac3815b980 2024-04-25T10:04:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.389+0000 7fac35600640 1 -- 172.21.15.18:0/2580452434 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264532324 0 0) 0x7fac380ce7f0 con 0x7fac38071970 2024-04-25T10:04:15.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac36000640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b980 0x7fac380cbd30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62e34409e18434ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac35600640 1 -- 172.21.15.18:0/2580452434 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240aa620 con 0x7fac3815b980 2024-04-25T10:04:15.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac35600640 1 -- 172.21.15.18:0/2580452434 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac240af070 con 0x7fac3815b980 2024-04-25T10:04:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac35600640 1 -- 172.21.15.18:0/2580452434 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240aa9e0 con 0x7fac3815b980 2024-04-25T10:04:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 -- 172.21.15.18:0/2580452434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b980 msgr2=0x7fac380cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b980 0x7fac380cbd30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 -- 172.21.15.18:0/2580452434 shutdown_connections 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b980 0x7fac380cbd30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 --2- 172.21.15.18:0/2580452434 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac3815b5a0 0x7fac380cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 -- 172.21.15.18:0/2580452434 >> 172.21.15.18:0/2580452434 conn(0x7fac380b3390 msgr2=0x7fac380b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 -- 172.21.15.18:0/2580452434 shutdown_connections 2024-04-25T10:04:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 -- 172.21.15.18:0/2580452434 wait complete. 2024-04-25T10:04:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.393+0000 7fac3d800640 1 Processor -- start 2024-04-25T10:04:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- start start 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 0x7fac3813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 0x7fac3815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38168ad0 con 0x7fac3815b5a0 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38168950 con 0x7fac3815b980 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac38168c50 con 0x7fac38071970 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40874/0 (socket says 172.21.15.18:40874) 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 -- 172.21.15.18:0/2626486756 learned_addr learned my addr 172.21.15.18:0/2626486756 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac37400640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 0x7fac3815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36a00640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 0x7fac3813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 -- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 msgr2=0x7fac3813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 0x7fac3813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 -- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 msgr2=0x7fac3815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 0x7fac3815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 -- 172.21.15.18:0/2626486756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38153480 con 0x7fac3815b5a0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36a00640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 0x7fac3813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac37400640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 0x7fac3815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac36000640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240aadf0 con 0x7fac3815b5a0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24004020 con 0x7fac3815b5a0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24004410 con 0x7fac3815b5a0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac38153760 con 0x7fac3815b5a0 2024-04-25T10:04:15.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac38153d20 con 0x7fac3815b5a0 2024-04-25T10:04:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.397+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac380745d0 con 0x7fac3815b5a0 2024-04-25T10:04:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.401+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fac24003620 con 0x7fac3815b5a0 2024-04-25T10:04:15.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.401+0000 7fac2ea00640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 0x7fac18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.401+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fac2411f8a0 con 0x7fac3815b5a0 2024-04-25T10:04:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.401+0000 7fac36a00640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 0x7fac18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.401+0000 7fac36a00640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 0x7fac18069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac28009840 tx=0x7fac28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.405+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fac380cc680 con 0x7fac3815b5a0 2024-04-25T10:04:15.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac380ceeb0 con 0x7fac3815b5a0 2024-04-25T10:04:15.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac2ea00640 1 -- 172.21.15.18:0/2626486756 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7fac24016090 con 0x7fac3815b5a0 2024-04-25T10:04:15.578 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:15.578 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 msgr2=0x7fac18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 0x7fac18069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac28009840 tx=0x7fac28008040 comp rx=0 tx=0).stop 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 msgr2=0x7fac38152d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fac240097c0 tx=0x7fac2401ace0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 shutdown_connections 2024-04-25T10:04:15.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac3815b980 0x7fac3815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac3815b5a0 0x7fac38152d50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fac18066f60 0x7fac18069420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 --2- 172.21.15.18:0/2626486756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fac38071970 0x7fac3813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 >> 172.21.15.18:0/2626486756 conn(0x7fac380b3390 msgr2=0x7fac380b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 shutdown_connections 2024-04-25T10:04:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.569+0000 7fac3d800640 1 -- 172.21.15.18:0/2626486756 wait complete. 2024-04-25T10:04:15.601 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:04:15.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:15.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 Processor -- start 2024-04-25T10:04:15.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 -- start start 2024-04-25T10:04:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff9100d0f90 0x7ff91015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff91006e210 0x7ff91006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91015e4d0 con 0x7ff9100b5390 2024-04-25T10:04:15.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91015e7b0 con 0x7ff9100d0f90 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff917000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91015ea90 con 0x7ff91006e210 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff9100d0f90 0x7ff91015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff9100d0f90 0x7ff91015dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40882/0 (socket says 172.21.15.18:40882) 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 -- 172.21.15.18:0/1046888299 learned_addr learned my addr 172.21.15.18:0/1046888299 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff916600640 1 --2- 172.21.15.18:0/1046888299 >> v2:172.21.15.167:3300/0 conn(0x7ff91006e210 0x7ff91006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 -- 172.21.15.18:0/1046888299 >> v2:172.21.15.167:3300/0 conn(0x7ff91006e210 msgr2=0x7ff91006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 --2- 172.21.15.18:0/1046888299 >> v2:172.21.15.167:3300/0 conn(0x7ff91006e210 0x7ff91006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 -- 172.21.15.18:0/1046888299 >> v1:172.21.15.167:6789/0 conn(0x7ff9100b5390 legacy=0x7ff910161a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:15.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.733+0000 7ff915c00640 1 -- 172.21.15.18:0/1046888299 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910161530 con 0x7ff9100d0f90 2024-04-25T10:04:15.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff915c00640 1 --2- 172.21.15.18:0/1046888299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100d0f90 0x7ff91015dde0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff91006fa00 tx=0x7ff90401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1d0a44daa8b5b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff90fe00640 1 -- 172.21.15.18:0/1046888299 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040b0070 con 0x7ff9100d0f90 2024-04-25T10:04:15.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff90fe00640 1 -- 172.21.15.18:0/1046888299 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9040ab600 con 0x7ff9100d0f90 2024-04-25T10:04:15.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff90fe00640 1 -- 172.21.15.18:0/1046888299 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9040ab9d0 con 0x7ff9100d0f90 2024-04-25T10:04:15.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- 172.21.15.18:0/1046888299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100d0f90 msgr2=0x7ff91015dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 --2- 172.21.15.18:0/1046888299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100d0f90 0x7ff91015dde0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff91006fa00 tx=0x7ff90401c4e0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- 172.21.15.18:0/1046888299 shutdown_connections 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 --2- 172.21.15.18:0/1046888299 >> v2:172.21.15.167:3300/0 conn(0x7ff91006e210 0x7ff91006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 --2- 172.21.15.18:0/1046888299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100d0f90 0x7ff91015dde0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- 172.21.15.18:0/1046888299 >> 172.21.15.18:0/1046888299 conn(0x7ff9100b5a90 msgr2=0x7ff910099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- 172.21.15.18:0/1046888299 shutdown_connections 2024-04-25T10:04:15.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- 172.21.15.18:0/1046888299 wait complete. 2024-04-25T10:04:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 Processor -- start 2024-04-25T10:04:15.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.737+0000 7ff917000640 1 -- start start 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 0x7ff91015fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9100d0f90 0x7ff910151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91016aac0 con 0x7ff9100b5390 2024-04-25T10:04:15.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91016a940 con 0x7ff91006e210 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91016ac40 con 0x7ff9100d0f90 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40888/0 (socket says 172.21.15.18:40888) 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 -- 172.21.15.18:0/1027815046 learned_addr learned my addr 172.21.15.18:0/1027815046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff916600640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9100d0f90 0x7ff910151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915c00640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 0x7ff91015fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 -- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9100d0f90 msgr2=0x7ff910151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9100d0f90 0x7ff910151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 -- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 msgr2=0x7ff91015fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 0x7ff91015fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 -- 172.21.15.18:0/1027815046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910151990 con 0x7ff9100b5390 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915c00640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 0x7ff91015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff915200640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c480 tx=0x7ff8fc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc012830 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc017070 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91015ef20 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc012c30 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91014c450 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.741+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91004efa0 con 0x7ff9100b5390 2024-04-25T10:04:15.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.745+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8fc01c460 con 0x7ff9100b5390 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.745+0000 7ff90d600640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 0x7ff8f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:15.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.745+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff8fc085230 con 0x7ff9100b5390 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.745+0000 7ff915c00640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 0x7ff8f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:15.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.745+0000 7ff915c00640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 0x7ff8f0069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9040ad000 tx=0x7ff9040a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:15.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.749+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8fc055ef0 con 0x7ff9100b5390 2024-04-25T10:04:15.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.909+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff910072d80 con 0x7ff8f0066f60 2024-04-25T10:04:15.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.917+0000 7ff90d600640 1 -- 172.21.15.18:0/1027815046 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332562 (secure 0 0 0) 0x7ff910072d80 con 0x7ff8f0066f60 2024-04-25T10:04:15.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:15.934 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.921+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 msgr2=0x7ff8f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 0x7ff8f0069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9040ad000 tx=0x7ff9040a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 msgr2=0x7ff91014bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc00c480 tx=0x7ff8fc00c940 comp rx=0 tx=0).stop 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 shutdown_connections 2024-04-25T10:04:15.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff8f0066f60 0x7ff8f0069420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9100d0f90 0x7ff910151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9100b5390 0x7ff91014bf10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 --2- 172.21.15.18:0/1027815046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff91006e210 0x7ff91015fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 >> 172.21.15.18:0/1027815046 conn(0x7ff9100b5a90 msgr2=0x7ff91015c520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 shutdown_connections 2024-04-25T10:04:15.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:15.925+0000 7ff917000640 1 -- 172.21.15.18:0/1027815046 wait complete. 2024-04-25T10:04:15.952 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-25T10:04:15.398774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227920,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746800,"statfs":{"total":773094113280,"available":772860723200,"internally_reserved":0,"allocated":3514368,"data_stored":2103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003295"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.267071+0000","last_change":"2024-04-25T10:03:55.768315+0000","last_active":"2024-04-25T10:04:03.267071+0000","last_peered":"2024-04-25T10:04:03.267071+0000","last_clean":"2024-04-25T10:04:03.267071+0000","last_became_active":"2024-04-25T10:03:55.768048+0000","last_became_peered":"2024-04-25T10:03:55.768048+0000","last_unstale":"2024-04-25T10:04:03.267071+0000","last_undegraded":"2024-04-25T10:04:03.267071+0000","last_fullsized":"2024-04-25T10:04:03.267071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:28.383096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793497+0000","last_change":"2024-04-25T10:03:56.758112+0000","last_active":"2024-04-25T10:04:02.793497+0000","last_peered":"2024-04-25T10:04:02.793497+0000","last_clean":"2024-04-25T10:04:02.793497+0000","last_became_active":"2024-04-25T10:03:56.757744+0000","last_became_peered":"2024-04-25T10:03:56.757744+0000","last_unstale":"2024-04-25T10:04:02.793497+0000","last_undegraded":"2024-04-25T10:04:02.793497+0000","last_fullsized":"2024-04-25T10:04:02.793497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:36.379846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792515+0000","last_change":"2024-04-25T10:04:01.286170+0000","last_active":"2024-04-25T10:04:02.792515+0000","last_peered":"2024-04-25T10:04:02.792515+0000","last_clean":"2024-04-25T10:04:02.792515+0000","last_became_active":"2024-04-25T10:04:01.285749+0000","last_became_peered":"2024-04-25T10:04:01.285749+0000","last_unstale":"2024-04-25T10:04:02.792515+0000","last_undegraded":"2024-04-25T10:04:02.792515+0000","last_fullsized":"2024-04-25T10:04:02.792515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:24.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793621+0000","last_change":"2024-04-25T10:03:55.757705+0000","last_active":"2024-04-25T10:04:02.793621+0000","last_peered":"2024-04-25T10:04:02.793621+0000","last_clean":"2024-04-25T10:04:02.793621+0000","last_became_active":"2024-04-25T10:03:55.757106+0000","last_became_peered":"2024-04-25T10:03:55.757106+0000","last_unstale":"2024-04-25T10:04:02.793621+0000","last_undegraded":"2024-04-25T10:04:02.793621+0000","last_fullsized":"2024-04-25T10:04:02.793621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:28.451018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266707+0000","last_change":"2024-04-25T10:03:56.772870+0000","last_active":"2024-04-25T10:04:03.266707+0000","last_peered":"2024-04-25T10:04:03.266707+0000","last_clean":"2024-04-25T10:04:03.266707+0000","last_became_active":"2024-04-25T10:03:56.771205+0000","last_became_peered":"2024-04-25T10:03:56.771205+0000","last_unstale":"2024-04-25T10:04:03.266707+0000","last_undegraded":"2024-04-25T10:04:03.266707+0000","last_fullsized":"2024-04-25T10:04:03.266707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:44.754772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276672+0000","last_change":"2024-04-25T10:04:00.804531+0000","last_active":"2024-04-25T10:04:03.276672+0000","last_peered":"2024-04-25T10:04:03.276672+0000","last_clean":"2024-04-25T10:04:03.276672+0000","last_became_active":"2024-04-25T10:04:00.804099+0000","last_became_peered":"2024-04-25T10:04:00.804099+0000","last_unstale":"2024-04-25T10:04:03.276672+0000","last_undegraded":"2024-04-25T10:04:03.276672+0000","last_fullsized":"2024-04-25T10:04:03.276672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277581+0000","last_change":"2024-04-25T10:03:55.774735+0000","last_active":"2024-04-25T10:04:03.277581+0000","last_peered":"2024-04-25T10:04:03.277581+0000","last_clean":"2024-04-25T10:04:03.277581+0000","last_became_active":"2024-04-25T10:03:55.774388+0000","last_became_peered":"2024-04-25T10:03:55.774388+0000","last_unstale":"2024-04-25T10:04:03.277581+0000","last_undegraded":"2024-04-25T10:04:03.277581+0000","last_fullsized":"2024-04-25T10:04:03.277581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796791+0000","last_change":"2024-04-25T10:03:56.773291+0000","last_active":"2024-04-25T10:04:02.796791+0000","last_peered":"2024-04-25T10:04:02.796791+0000","last_clean":"2024-04-25T10:04:02.796791+0000","last_became_active":"2024-04-25T10:03:56.772811+0000","last_became_peered":"2024-04-25T10:03:56.772811+0000","last_unstale":"2024-04-25T10:04:02.796791+0000","last_undegraded":"2024-04-25T10:04:02.796791+0000","last_fullsized":"2024-04-25T10:04:02.796791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278159+0000","last_change":"2024-04-25T10:04:00.809365+0000","last_active":"2024-04-25T10:04:03.278159+0000","last_peered":"2024-04-25T10:04:03.278159+0000","last_clean":"2024-04-25T10:04:03.278159+0000","last_became_active":"2024-04-25T10:04:00.808889+0000","last_became_peered":"2024-04-25T10:04:00.808889+0000","last_unstale":"2024-04-25T10:04:03.278159+0000","last_undegraded":"2024-04-25T10:04:03.278159+0000","last_fullsized":"2024-04-25T10:04:03.278159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277444+0000","last_change":"2024-04-25T10:03:55.773956+0000","last_active":"2024-04-25T10:04:03.277444+0000","last_peered":"2024-04-25T10:04:03.277444+0000","last_clean":"2024-04-25T10:04:03.277444+0000","last_became_active":"2024-04-25T10:03:55.770709+0000","last_became_peered":"2024-04-25T10:03:55.770709+0000","last_unstale":"2024-04-25T10:04:03.277444+0000","last_undegraded":"2024-04-25T10:04:03.277444+0000","last_fullsized":"2024-04-25T10:04:03.277444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796965+0000","last_change":"2024-04-25T10:03:56.773544+0000","last_active":"2024-04-25T10:04:02.796965+0000","last_peered":"2024-04-25T10:04:02.796965+0000","last_clean":"2024-04-25T10:04:02.796965+0000","last_became_active":"2024-04-25T10:03:56.773246+0000","last_became_peered":"2024-04-25T10:03:56.773246+0000","last_unstale":"2024-04-25T10:04:02.796965+0000","last_undegraded":"2024-04-25T10:04:02.796965+0000","last_fullsized":"2024-04-25T10:04:02.796965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277083+0000","last_change":"2024-04-25T10:04:00.809357+0000","last_active":"2024-04-25T10:04:03.277083+0000","last_peered":"2024-04-25T10:04:03.277083+0000","last_clean":"2024-04-25T10:04:03.277083+0000","last_became_active":"2024-04-25T10:04:00.808905+0000","last_became_peered":"2024-04-25T10:04:00.808905+0000","last_unstale":"2024-04-25T10:04:03.277083+0000","last_undegraded":"2024-04-25T10:04:03.277083+0000","last_fullsized":"2024-04-25T10:04:03.277083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796173+0000","last_change":"2024-04-25T10:03:56.774064+0000","last_active":"2024-04-25T10:04:02.796173+0000","last_peered":"2024-04-25T10:04:02.796173+0000","last_clean":"2024-04-25T10:04:02.796173+0000","last_became_active":"2024-04-25T10:03:56.773617+0000","last_became_peered":"2024-04-25T10:03:56.773617+0000","last_unstale":"2024-04-25T10:04:02.796173+0000","last_undegraded":"2024-04-25T10:04:02.796173+0000","last_fullsized":"2024-04-25T10:04:02.796173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277648+0000","last_change":"2024-04-25T10:03:55.771542+0000","last_active":"2024-04-25T10:04:03.277648+0000","last_peered":"2024-04-25T10:04:03.277648+0000","last_clean":"2024-04-25T10:04:03.277648+0000","last_became_active":"2024-04-25T10:03:55.771100+0000","last_became_peered":"2024-04-25T10:03:55.771100+0000","last_unstale":"2024-04-25T10:04:03.277648+0000","last_undegraded":"2024-04-25T10:04:03.277648+0000","last_fullsized":"2024-04-25T10:04:03.277648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278167+0000","last_change":"2024-04-25T10:04:00.797932+0000","last_active":"2024-04-25T10:04:03.278167+0000","last_peered":"2024-04-25T10:04:03.278167+0000","last_clean":"2024-04-25T10:04:03.278167+0000","last_became_active":"2024-04-25T10:04:00.797547+0000","last_became_peered":"2024-04-25T10:04:00.797547+0000","last_unstale":"2024-04-25T10:04:03.278167+0000","last_undegraded":"2024-04-25T10:04:03.278167+0000","last_fullsized":"2024-04-25T10:04:03.278167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793017+0000","last_change":"2024-04-25T10:03:56.763110+0000","last_active":"2024-04-25T10:04:02.793017+0000","last_peered":"2024-04-25T10:04:02.793017+0000","last_clean":"2024-04-25T10:04:02.793017+0000","last_became_active":"2024-04-25T10:03:56.759036+0000","last_became_peered":"2024-04-25T10:03:56.759036+0000","last_unstale":"2024-04-25T10:04:02.793017+0000","last_undegraded":"2024-04-25T10:04:02.793017+0000","last_fullsized":"2024-04-25T10:04:02.793017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:09.264916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275006+0000","last_change":"2024-04-25T10:03:55.760284+0000","last_active":"2024-04-25T10:04:03.275006+0000","last_peered":"2024-04-25T10:04:03.275006+0000","last_clean":"2024-04-25T10:04:03.275006+0000","last_became_active":"2024-04-25T10:03:55.757931+0000","last_became_peered":"2024-04-25T10:03:55.757931+0000","last_unstale":"2024-04-25T10:04:03.275006+0000","last_undegraded":"2024-04-25T10:04:03.275006+0000","last_fullsized":"2024-04-25T10:04:03.275006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277167+0000","last_change":"2024-04-25T10:04:00.805760+0000","last_active":"2024-04-25T10:04:03.277167+0000","last_peered":"2024-04-25T10:04:03.277167+0000","last_clean":"2024-04-25T10:04:03.277167+0000","last_became_active":"2024-04-25T10:04:00.805409+0000","last_became_peered":"2024-04-25T10:04:00.805409+0000","last_unstale":"2024-04-25T10:04:03.277167+0000","last_undegraded":"2024-04-25T10:04:03.277167+0000","last_fullsized":"2024-04-25T10:04:03.277167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792681+0000","last_change":"2024-04-25T10:03:56.755762+0000","last_active":"2024-04-25T10:04:02.792681+0000","last_peered":"2024-04-25T10:04:02.792681+0000","last_clean":"2024-04-25T10:04:02.792681+0000","last_became_active":"2024-04-25T10:03:56.755497+0000","last_became_peered":"2024-04-25T10:03:56.755497+0000","last_unstale":"2024-04-25T10:04:02.792681+0000","last_undegraded":"2024-04-25T10:04:02.792681+0000","last_fullsized":"2024-04-25T10:04:02.792681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:39.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274613+0000","last_change":"2024-04-25T10:03:55.768303+0000","last_active":"2024-04-25T10:04:03.274613+0000","last_peered":"2024-04-25T10:04:03.274613+0000","last_clean":"2024-04-25T10:04:03.274613+0000","last_became_active":"2024-04-25T10:03:55.767994+0000","last_became_peered":"2024-04-25T10:03:55.767994+0000","last_unstale":"2024-04-25T10:04:03.274613+0000","last_undegraded":"2024-04-25T10:04:03.274613+0000","last_fullsized":"2024-04-25T10:04:03.274613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275339+0000","last_change":"2024-04-25T10:04:01.284089+0000","last_active":"2024-04-25T10:04:03.275339+0000","last_peered":"2024-04-25T10:04:03.275339+0000","last_clean":"2024-04-25T10:04:03.275339+0000","last_became_active":"2024-04-25T10:04:01.283683+0000","last_became_peered":"2024-04-25T10:04:01.283683+0000","last_unstale":"2024-04-25T10:04:03.275339+0000","last_undegraded":"2024-04-25T10:04:03.275339+0000","last_fullsized":"2024-04-25T10:04:03.275339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278023+0000","last_change":"2024-04-25T10:03:56.763149+0000","last_active":"2024-04-25T10:04:03.278023+0000","last_peered":"2024-04-25T10:04:03.278023+0000","last_clean":"2024-04-25T10:04:03.278023+0000","last_became_active":"2024-04-25T10:03:56.762775+0000","last_became_peered":"2024-04-25T10:03:56.762775+0000","last_unstale":"2024-04-25T10:04:03.278023+0000","last_undegraded":"2024-04-25T10:04:03.278023+0000","last_fullsized":"2024-04-25T10:04:03.278023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:40.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276548+0000","last_change":"2024-04-25T10:03:55.769495+0000","last_active":"2024-04-25T10:04:03.276548+0000","last_peered":"2024-04-25T10:04:03.276548+0000","last_clean":"2024-04-25T10:04:03.276548+0000","last_became_active":"2024-04-25T10:03:55.769215+0000","last_became_peered":"2024-04-25T10:03:55.769215+0000","last_unstale":"2024-04-25T10:04:03.276548+0000","last_undegraded":"2024-04-25T10:04:03.276548+0000","last_fullsized":"2024-04-25T10:04:03.276548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278249+0000","last_change":"2024-04-25T10:04:00.809196+0000","last_active":"2024-04-25T10:04:03.278249+0000","last_peered":"2024-04-25T10:04:03.278249+0000","last_clean":"2024-04-25T10:04:03.278249+0000","last_became_active":"2024-04-25T10:04:00.808831+0000","last_became_peered":"2024-04-25T10:04:00.808831+0000","last_unstale":"2024-04-25T10:04:03.278249+0000","last_undegraded":"2024-04-25T10:04:03.278249+0000","last_fullsized":"2024-04-25T10:04:03.278249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266867+0000","last_change":"2024-04-25T10:03:56.758244+0000","last_active":"2024-04-25T10:04:03.266867+0000","last_peered":"2024-04-25T10:04:03.266867+0000","last_clean":"2024-04-25T10:04:03.266867+0000","last_became_active":"2024-04-25T10:03:56.757968+0000","last_became_peered":"2024-04-25T10:03:56.757968+0000","last_unstale":"2024-04-25T10:04:03.266867+0000","last_undegraded":"2024-04-25T10:04:03.266867+0000","last_fullsized":"2024-04-25T10:04:03.266867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:01.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797119+0000","last_change":"2024-04-25T10:03:55.771510+0000","last_active":"2024-04-25T10:04:02.797119+0000","last_peered":"2024-04-25T10:04:02.797119+0000","last_clean":"2024-04-25T10:04:02.797119+0000","last_became_active":"2024-04-25T10:03:55.771339+0000","last_became_peered":"2024-04-25T10:03:55.771339+0000","last_unstale":"2024-04-25T10:04:02.797119+0000","last_undegraded":"2024-04-25T10:04:02.797119+0000","last_fullsized":"2024-04-25T10:04:02.797119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277693+0000","last_change":"2024-04-25T10:04:01.287169+0000","last_active":"2024-04-25T10:04:03.277693+0000","last_peered":"2024-04-25T10:04:03.277693+0000","last_clean":"2024-04-25T10:04:03.277693+0000","last_became_active":"2024-04-25T10:04:01.286796+0000","last_became_peered":"2024-04-25T10:04:01.286796+0000","last_unstale":"2024-04-25T10:04:03.277693+0000","last_undegraded":"2024-04-25T10:04:03.277693+0000","last_fullsized":"2024-04-25T10:04:03.277693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:30.474221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793347+0000","last_change":"2024-04-25T10:03:56.780820+0000","last_active":"2024-04-25T10:04:02.793347+0000","last_peered":"2024-04-25T10:04:02.793347+0000","last_clean":"2024-04-25T10:04:02.793347+0000","last_became_active":"2024-04-25T10:03:56.780475+0000","last_became_peered":"2024-04-25T10:03:56.780475+0000","last_unstale":"2024-04-25T10:04:02.793347+0000","last_undegraded":"2024-04-25T10:04:02.793347+0000","last_fullsized":"2024-04-25T10:04:02.793347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:31.014597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275213+0000","last_change":"2024-04-25T10:03:55.767628+0000","last_active":"2024-04-25T10:04:03.275213+0000","last_peered":"2024-04-25T10:04:03.275213+0000","last_clean":"2024-04-25T10:04:03.275213+0000","last_became_active":"2024-04-25T10:03:55.767120+0000","last_became_peered":"2024-04-25T10:03:55.767120+0000","last_unstale":"2024-04-25T10:04:03.275213+0000","last_undegraded":"2024-04-25T10:04:03.275213+0000","last_fullsized":"2024-04-25T10:04:03.275213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792464+0000","last_change":"2024-04-25T10:04:01.283339+0000","last_active":"2024-04-25T10:04:02.792464+0000","last_peered":"2024-04-25T10:04:02.792464+0000","last_clean":"2024-04-25T10:04:02.792464+0000","last_became_active":"2024-04-25T10:04:01.282887+0000","last_became_peered":"2024-04-25T10:04:01.282887+0000","last_unstale":"2024-04-25T10:04:02.792464+0000","last_undegraded":"2024-04-25T10:04:02.792464+0000","last_fullsized":"2024-04-25T10:04:02.792464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:12.942551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274964+0000","last_change":"2024-04-25T10:03:56.756195+0000","last_active":"2024-04-25T10:04:03.274964+0000","last_peered":"2024-04-25T10:04:03.274964+0000","last_clean":"2024-04-25T10:04:03.274964+0000","last_became_active":"2024-04-25T10:03:56.755888+0000","last_became_peered":"2024-04-25T10:03:56.755888+0000","last_unstale":"2024-04-25T10:04:03.274964+0000","last_undegraded":"2024-04-25T10:04:03.274964+0000","last_fullsized":"2024-04-25T10:04:03.274964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277826+0000","last_change":"2024-04-25T10:03:55.774206+0000","last_active":"2024-04-25T10:04:03.277826+0000","last_peered":"2024-04-25T10:04:03.277826+0000","last_clean":"2024-04-25T10:04:03.277826+0000","last_became_active":"2024-04-25T10:03:55.773820+0000","last_became_peered":"2024-04-25T10:03:55.773820+0000","last_unstale":"2024-04-25T10:04:03.277826+0000","last_undegraded":"2024-04-25T10:04:03.277826+0000","last_fullsized":"2024-04-25T10:04:03.277826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:37.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266562+0000","last_change":"2024-04-25T10:04:01.284399+0000","last_active":"2024-04-25T10:04:03.266562+0000","last_peered":"2024-04-25T10:04:03.266562+0000","last_clean":"2024-04-25T10:04:03.266562+0000","last_became_active":"2024-04-25T10:04:01.283878+0000","last_became_peered":"2024-04-25T10:04:01.283878+0000","last_unstale":"2024-04-25T10:04:03.266562+0000","last_undegraded":"2024-04-25T10:04:03.266562+0000","last_fullsized":"2024-04-25T10:04:03.266562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797072+0000","last_change":"2024-04-25T10:03:56.792726+0000","last_active":"2024-04-25T10:04:02.797072+0000","last_peered":"2024-04-25T10:04:02.797072+0000","last_clean":"2024-04-25T10:04:02.797072+0000","last_became_active":"2024-04-25T10:03:56.792471+0000","last_became_peered":"2024-04-25T10:03:56.792471+0000","last_unstale":"2024-04-25T10:04:02.797072+0000","last_undegraded":"2024-04-25T10:04:02.797072+0000","last_fullsized":"2024-04-25T10:04:02.797072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275057+0000","last_change":"2024-04-25T10:03:55.757369+0000","last_active":"2024-04-25T10:04:03.275057+0000","last_peered":"2024-04-25T10:04:03.275057+0000","last_clean":"2024-04-25T10:04:03.275057+0000","last_became_active":"2024-04-25T10:03:55.756884+0000","last_became_peered":"2024-04-25T10:03:55.756884+0000","last_unstale":"2024-04-25T10:04:03.275057+0000","last_undegraded":"2024-04-25T10:04:03.275057+0000","last_fullsized":"2024-04-25T10:04:03.275057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274691+0000","last_change":"2024-04-25T10:04:00.803156+0000","last_active":"2024-04-25T10:04:03.274691+0000","last_peered":"2024-04-25T10:04:03.274691+0000","last_clean":"2024-04-25T10:04:03.274691+0000","last_became_active":"2024-04-25T10:04:00.802652+0000","last_became_peered":"2024-04-25T10:04:00.802652+0000","last_unstale":"2024-04-25T10:04:03.274691+0000","last_undegraded":"2024-04-25T10:04:03.274691+0000","last_fullsized":"2024-04-25T10:04:03.274691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278393+0000","last_change":"2024-04-25T10:03:56.770389+0000","last_active":"2024-04-25T10:04:03.278393+0000","last_peered":"2024-04-25T10:04:03.278393+0000","last_clean":"2024-04-25T10:04:03.278393+0000","last_became_active":"2024-04-25T10:03:56.769936+0000","last_became_peered":"2024-04-25T10:03:56.769936+0000","last_unstale":"2024-04-25T10:04:03.278393+0000","last_undegraded":"2024-04-25T10:04:03.278393+0000","last_fullsized":"2024-04-25T10:04:03.278393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:45.815606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796171+0000","last_change":"2024-04-25T10:03:55.761355+0000","last_active":"2024-04-25T10:04:02.796171+0000","last_peered":"2024-04-25T10:04:02.796171+0000","last_clean":"2024-04-25T10:04:02.796171+0000","last_became_active":"2024-04-25T10:03:55.759914+0000","last_became_peered":"2024-04-25T10:03:55.759914+0000","last_unstale":"2024-04-25T10:04:02.796171+0000","last_undegraded":"2024-04-25T10:04:02.796171+0000","last_fullsized":"2024-04-25T10:04:02.796171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274995+0000","last_change":"2024-04-25T10:04:00.806848+0000","last_active":"2024-04-25T10:04:03.274995+0000","last_peered":"2024-04-25T10:04:03.274995+0000","last_clean":"2024-04-25T10:04:03.274995+0000","last_became_active":"2024-04-25T10:04:00.805433+0000","last_became_peered":"2024-04-25T10:04:00.805433+0000","last_unstale":"2024-04-25T10:04:03.274995+0000","last_undegraded":"2024-04-25T10:04:03.274995+0000","last_fullsized":"2024-04-25T10:04:03.274995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274628+0000","last_change":"2024-04-25T10:03:56.755931+0000","last_active":"2024-04-25T10:04:03.274628+0000","last_peered":"2024-04-25T10:04:03.274628+0000","last_clean":"2024-04-25T10:04:03.274628+0000","last_became_active":"2024-04-25T10:03:56.755452+0000","last_became_peered":"2024-04-25T10:03:56.755452+0000","last_unstale":"2024-04-25T10:04:03.274628+0000","last_undegraded":"2024-04-25T10:04:03.274628+0000","last_fullsized":"2024-04-25T10:04:03.274628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230585+0000","last_change":"2024-04-25T10:03:55.762333+0000","last_active":"2024-04-25T10:04:03.230585+0000","last_peered":"2024-04-25T10:04:03.230585+0000","last_clean":"2024-04-25T10:04:03.230585+0000","last_became_active":"2024-04-25T10:03:55.758957+0000","last_became_peered":"2024-04-25T10:03:55.758957+0000","last_unstale":"2024-04-25T10:04:03.230585+0000","last_undegraded":"2024-04-25T10:04:03.230585+0000","last_fullsized":"2024-04-25T10:04:03.230585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275382+0000","last_change":"2024-04-25T10:04:00.805357+0000","last_active":"2024-04-25T10:04:03.275382+0000","last_peered":"2024-04-25T10:04:03.275382+0000","last_clean":"2024-04-25T10:04:03.275382+0000","last_became_active":"2024-04-25T10:04:00.804893+0000","last_became_peered":"2024-04-25T10:04:00.804893+0000","last_unstale":"2024-04-25T10:04:03.275382+0000","last_undegraded":"2024-04-25T10:04:03.275382+0000","last_fullsized":"2024-04-25T10:04:03.275382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266268+0000","last_change":"2024-04-25T10:03:56.780512+0000","last_active":"2024-04-25T10:04:03.266268+0000","last_peered":"2024-04-25T10:04:03.266268+0000","last_clean":"2024-04-25T10:04:03.266268+0000","last_became_active":"2024-04-25T10:03:56.779316+0000","last_became_peered":"2024-04-25T10:03:56.779316+0000","last_unstale":"2024-04-25T10:04:03.266268+0000","last_undegraded":"2024-04-25T10:04:03.266268+0000","last_fullsized":"2024-04-25T10:04:03.266268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276680+0000","last_change":"2024-04-25T10:03:55.773928+0000","last_active":"2024-04-25T10:04:03.276680+0000","last_peered":"2024-04-25T10:04:03.276680+0000","last_clean":"2024-04-25T10:04:03.276680+0000","last_became_active":"2024-04-25T10:03:55.773501+0000","last_became_peered":"2024-04-25T10:03:55.773501+0000","last_unstale":"2024-04-25T10:04:03.276680+0000","last_undegraded":"2024-04-25T10:04:03.276680+0000","last_fullsized":"2024-04-25T10:04:03.276680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266794+0000","last_change":"2024-04-25T10:04:01.283753+0000","last_active":"2024-04-25T10:04:03.266794+0000","last_peered":"2024-04-25T10:04:03.266794+0000","last_clean":"2024-04-25T10:04:03.266794+0000","last_became_active":"2024-04-25T10:04:01.283221+0000","last_became_peered":"2024-04-25T10:04:01.283221+0000","last_unstale":"2024-04-25T10:04:03.266794+0000","last_undegraded":"2024-04-25T10:04:03.266794+0000","last_fullsized":"2024-04-25T10:04:03.266794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:18.295693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792932+0000","last_change":"2024-04-25T10:03:56.766943+0000","last_active":"2024-04-25T10:04:02.792932+0000","last_peered":"2024-04-25T10:04:02.792932+0000","last_clean":"2024-04-25T10:04:02.792932+0000","last_became_active":"2024-04-25T10:03:56.766550+0000","last_became_peered":"2024-04-25T10:03:56.766550+0000","last_unstale":"2024-04-25T10:04:02.792932+0000","last_undegraded":"2024-04-25T10:04:02.792932+0000","last_fullsized":"2024-04-25T10:04:02.792932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:05.977869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796601+0000","last_change":"2024-04-25T10:03:55.764614+0000","last_active":"2024-04-25T10:04:02.796601+0000","last_peered":"2024-04-25T10:04:02.796601+0000","last_clean":"2024-04-25T10:04:02.796601+0000","last_became_active":"2024-04-25T10:03:55.763995+0000","last_became_peered":"2024-04-25T10:03:55.763995+0000","last_unstale":"2024-04-25T10:04:02.796601+0000","last_undegraded":"2024-04-25T10:04:02.796601+0000","last_fullsized":"2024-04-25T10:04:02.796601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276800+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:04:03.276800+0000","last_peered":"2024-04-25T10:04:03.276800+0000","last_clean":"2024-04-25T10:04:03.276800+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:04:03.276800+0000","last_undegraded":"2024-04-25T10:04:03.276800+0000","last_fullsized":"2024-04-25T10:04:03.276800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797001+0000","last_change":"2024-04-25T10:04:01.285814+0000","last_active":"2024-04-25T10:04:02.797001+0000","last_peered":"2024-04-25T10:04:02.797001+0000","last_clean":"2024-04-25T10:04:02.797001+0000","last_became_active":"2024-04-25T10:04:01.285361+0000","last_became_peered":"2024-04-25T10:04:01.285361+0000","last_unstale":"2024-04-25T10:04:02.797001+0000","last_undegraded":"2024-04-25T10:04:02.797001+0000","last_fullsized":"2024-04-25T10:04:02.797001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277347+0000","last_change":"2024-04-25T10:03:56.796054+0000","last_active":"2024-04-25T10:04:03.277347+0000","last_peered":"2024-04-25T10:04:03.277347+0000","last_clean":"2024-04-25T10:04:03.277347+0000","last_became_active":"2024-04-25T10:03:56.795756+0000","last_became_peered":"2024-04-25T10:03:56.795756+0000","last_unstale":"2024-04-25T10:04:03.277347+0000","last_undegraded":"2024-04-25T10:04:03.277347+0000","last_fullsized":"2024-04-25T10:04:03.277347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230858+0000","last_change":"2024-04-25T10:03:55.760034+0000","last_active":"2024-04-25T10:04:03.230858+0000","last_peered":"2024-04-25T10:04:03.230858+0000","last_clean":"2024-04-25T10:04:03.230858+0000","last_became_active":"2024-04-25T10:03:55.757148+0000","last_became_peered":"2024-04-25T10:03:55.757148+0000","last_unstale":"2024-04-25T10:04:03.230858+0000","last_undegraded":"2024-04-25T10:04:03.230858+0000","last_fullsized":"2024-04-25T10:04:03.230858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796177+0000","last_change":"2024-04-25T10:04:01.285490+0000","last_active":"2024-04-25T10:04:02.796177+0000","last_peered":"2024-04-25T10:04:02.796177+0000","last_clean":"2024-04-25T10:04:02.796177+0000","last_became_active":"2024-04-25T10:04:01.285082+0000","last_became_peered":"2024-04-25T10:04:01.285082+0000","last_unstale":"2024-04-25T10:04:02.796177+0000","last_undegraded":"2024-04-25T10:04:02.796177+0000","last_fullsized":"2024-04-25T10:04:02.796177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796963+0000","last_change":"2024-04-25T10:03:56.767947+0000","last_active":"2024-04-25T10:04:02.796963+0000","last_peered":"2024-04-25T10:04:02.796963+0000","last_clean":"2024-04-25T10:04:02.796963+0000","last_became_active":"2024-04-25T10:03:56.767392+0000","last_became_peered":"2024-04-25T10:03:56.767392+0000","last_unstale":"2024-04-25T10:04:02.796963+0000","last_undegraded":"2024-04-25T10:04:02.796963+0000","last_fullsized":"2024-04-25T10:04:02.796963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274971+0000","last_change":"2024-04-25T10:03:55.756201+0000","last_active":"2024-04-25T10:04:03.274971+0000","last_peered":"2024-04-25T10:04:03.274971+0000","last_clean":"2024-04-25T10:04:03.274971+0000","last_became_active":"2024-04-25T10:03:55.755298+0000","last_became_peered":"2024-04-25T10:03:55.755298+0000","last_unstale":"2024-04-25T10:04:03.274971+0000","last_undegraded":"2024-04-25T10:04:03.274971+0000","last_fullsized":"2024-04-25T10:04:03.274971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266768+0000","last_change":"2024-04-25T10:04:00.799071+0000","last_active":"2024-04-25T10:04:03.266768+0000","last_peered":"2024-04-25T10:04:03.266768+0000","last_clean":"2024-04-25T10:04:03.266768+0000","last_became_active":"2024-04-25T10:04:00.798641+0000","last_became_peered":"2024-04-25T10:04:00.798641+0000","last_unstale":"2024-04-25T10:04:03.266768+0000","last_undegraded":"2024-04-25T10:04:03.266768+0000","last_fullsized":"2024-04-25T10:04:03.266768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277674+0000","last_change":"2024-04-25T10:03:56.794134+0000","last_active":"2024-04-25T10:04:03.277674+0000","last_peered":"2024-04-25T10:04:03.277674+0000","last_clean":"2024-04-25T10:04:03.277674+0000","last_became_active":"2024-04-25T10:03:56.793845+0000","last_became_peered":"2024-04-25T10:03:56.793845+0000","last_unstale":"2024-04-25T10:04:03.277674+0000","last_undegraded":"2024-04-25T10:04:03.277674+0000","last_fullsized":"2024-04-25T10:04:03.277674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230962+0000","last_change":"2024-04-25T10:03:55.758720+0000","last_active":"2024-04-25T10:04:03.230962+0000","last_peered":"2024-04-25T10:04:03.230962+0000","last_clean":"2024-04-25T10:04:03.230962+0000","last_became_active":"2024-04-25T10:03:55.758417+0000","last_became_peered":"2024-04-25T10:03:55.758417+0000","last_unstale":"2024-04-25T10:04:03.230962+0000","last_undegraded":"2024-04-25T10:04:03.230962+0000","last_fullsized":"2024-04-25T10:04:03.230962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795441+0000","last_change":"2024-04-25T10:04:01.285580+0000","last_active":"2024-04-25T10:04:02.795441+0000","last_peered":"2024-04-25T10:04:02.795441+0000","last_clean":"2024-04-25T10:04:02.795441+0000","last_became_active":"2024-04-25T10:04:01.285212+0000","last_became_peered":"2024-04-25T10:04:01.285212+0000","last_unstale":"2024-04-25T10:04:02.795441+0000","last_undegraded":"2024-04-25T10:04:02.795441+0000","last_fullsized":"2024-04-25T10:04:02.795441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277394+0000","last_change":"2024-04-25T10:03:56.787338+0000","last_active":"2024-04-25T10:04:03.277394+0000","last_peered":"2024-04-25T10:04:03.277394+0000","last_clean":"2024-04-25T10:04:03.277394+0000","last_became_active":"2024-04-25T10:03:56.787066+0000","last_became_peered":"2024-04-25T10:03:56.787066+0000","last_unstale":"2024-04-25T10:04:03.277394+0000","last_undegraded":"2024-04-25T10:04:03.277394+0000","last_fullsized":"2024-04-25T10:04:03.277394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278632+0000","last_change":"2024-04-25T10:03:55.755120+0000","last_active":"2024-04-25T10:04:03.278632+0000","last_peered":"2024-04-25T10:04:03.278632+0000","last_clean":"2024-04-25T10:04:03.278632+0000","last_became_active":"2024-04-25T10:03:55.754636+0000","last_became_peered":"2024-04-25T10:03:55.754636+0000","last_unstale":"2024-04-25T10:04:03.278632+0000","last_undegraded":"2024-04-25T10:04:03.278632+0000","last_fullsized":"2024-04-25T10:04:03.278632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:44.495603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276603+0000","last_change":"2024-04-25T10:04:00.808408+0000","last_active":"2024-04-25T10:04:03.276603+0000","last_peered":"2024-04-25T10:04:03.276603+0000","last_clean":"2024-04-25T10:04:03.276603+0000","last_became_active":"2024-04-25T10:04:00.808024+0000","last_became_peered":"2024-04-25T10:04:00.808024+0000","last_unstale":"2024-04-25T10:04:03.276603+0000","last_undegraded":"2024-04-25T10:04:03.276603+0000","last_fullsized":"2024-04-25T10:04:03.276603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277668+0000","last_change":"2024-04-25T10:03:56.783068+0000","last_active":"2024-04-25T10:04:03.277668+0000","last_peered":"2024-04-25T10:04:03.277668+0000","last_clean":"2024-04-25T10:04:03.277668+0000","last_became_active":"2024-04-25T10:03:56.782782+0000","last_became_peered":"2024-04-25T10:03:56.782782+0000","last_unstale":"2024-04-25T10:04:03.277668+0000","last_undegraded":"2024-04-25T10:04:03.277668+0000","last_fullsized":"2024-04-25T10:04:03.277668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230449+0000","last_change":"2024-04-25T10:03:55.764472+0000","last_active":"2024-04-25T10:04:03.230449+0000","last_peered":"2024-04-25T10:04:03.230449+0000","last_clean":"2024-04-25T10:04:03.230449+0000","last_became_active":"2024-04-25T10:03:55.763968+0000","last_became_peered":"2024-04-25T10:03:55.763968+0000","last_unstale":"2024-04-25T10:04:03.230449+0000","last_undegraded":"2024-04-25T10:04:03.230449+0000","last_fullsized":"2024-04-25T10:04:03.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266626+0000","last_change":"2024-04-25T10:04:00.807342+0000","last_active":"2024-04-25T10:04:03.266626+0000","last_peered":"2024-04-25T10:04:03.266626+0000","last_clean":"2024-04-25T10:04:03.266626+0000","last_became_active":"2024-04-25T10:04:00.806899+0000","last_became_peered":"2024-04-25T10:04:00.806899+0000","last_unstale":"2024-04-25T10:04:03.266626+0000","last_undegraded":"2024-04-25T10:04:03.266626+0000","last_fullsized":"2024-04-25T10:04:03.266626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797285+0000","last_change":"2024-04-25T10:03:56.759704+0000","last_active":"2024-04-25T10:04:02.797285+0000","last_peered":"2024-04-25T10:04:02.797285+0000","last_clean":"2024-04-25T10:04:02.797285+0000","last_became_active":"2024-04-25T10:03:56.758730+0000","last_became_peered":"2024-04-25T10:03:56.758730+0000","last_unstale":"2024-04-25T10:04:02.797285+0000","last_undegraded":"2024-04-25T10:04:02.797285+0000","last_fullsized":"2024-04-25T10:04:02.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796361+0000","last_change":"2024-04-25T10:03:55.753914+0000","last_active":"2024-04-25T10:04:02.796361+0000","last_peered":"2024-04-25T10:04:02.796361+0000","last_clean":"2024-04-25T10:04:02.796361+0000","last_became_active":"2024-04-25T10:03:55.752892+0000","last_became_peered":"2024-04-25T10:03:55.752892+0000","last_unstale":"2024-04-25T10:04:02.796361+0000","last_undegraded":"2024-04-25T10:04:02.796361+0000","last_fullsized":"2024-04-25T10:04:02.796361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793148+0000","last_change":"2024-04-25T10:04:01.283999+0000","last_active":"2024-04-25T10:04:02.793148+0000","last_peered":"2024-04-25T10:04:02.793148+0000","last_clean":"2024-04-25T10:04:02.793148+0000","last_became_active":"2024-04-25T10:04:01.283582+0000","last_became_peered":"2024-04-25T10:04:01.283582+0000","last_unstale":"2024-04-25T10:04:02.793148+0000","last_undegraded":"2024-04-25T10:04:02.793148+0000","last_fullsized":"2024-04-25T10:04:02.793148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:49.714373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277636+0000","last_change":"2024-04-25T10:03:56.783331+0000","last_active":"2024-04-25T10:04:03.277636+0000","last_peered":"2024-04-25T10:04:03.277636+0000","last_clean":"2024-04-25T10:04:03.277636+0000","last_became_active":"2024-04-25T10:03:56.782448+0000","last_became_peered":"2024-04-25T10:03:56.782448+0000","last_unstale":"2024-04-25T10:04:03.277636+0000","last_undegraded":"2024-04-25T10:04:03.277636+0000","last_fullsized":"2024-04-25T10:04:03.277636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:00.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796126+0000","last_change":"2024-04-25T10:03:55.761416+0000","last_active":"2024-04-25T10:04:02.796126+0000","last_peered":"2024-04-25T10:04:02.796126+0000","last_clean":"2024-04-25T10:04:02.796126+0000","last_became_active":"2024-04-25T10:03:55.760610+0000","last_became_peered":"2024-04-25T10:03:55.760610+0000","last_unstale":"2024-04-25T10:04:02.796126+0000","last_undegraded":"2024-04-25T10:04:02.796126+0000","last_fullsized":"2024-04-25T10:04:02.796126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793073+0000","last_change":"2024-04-25T10:04:01.287382+0000","last_active":"2024-04-25T10:04:02.793073+0000","last_peered":"2024-04-25T10:04:02.793073+0000","last_clean":"2024-04-25T10:04:02.793073+0000","last_became_active":"2024-04-25T10:04:01.285777+0000","last_became_peered":"2024-04-25T10:04:01.285777+0000","last_unstale":"2024-04-25T10:04:02.793073+0000","last_undegraded":"2024-04-25T10:04:02.793073+0000","last_fullsized":"2024-04-25T10:04:02.793073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:21.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266469+0000","last_change":"2024-04-25T10:03:56.772446+0000","last_active":"2024-04-25T10:04:03.266469+0000","last_peered":"2024-04-25T10:04:03.266469+0000","last_clean":"2024-04-25T10:04:03.266469+0000","last_became_active":"2024-04-25T10:03:56.772029+0000","last_became_peered":"2024-04-25T10:03:56.772029+0000","last_unstale":"2024-04-25T10:04:03.266469+0000","last_undegraded":"2024-04-25T10:04:03.266469+0000","last_fullsized":"2024-04-25T10:04:03.266469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266991+0000","last_change":"2024-04-25T10:03:55.747987+0000","last_active":"2024-04-25T10:04:03.266991+0000","last_peered":"2024-04-25T10:04:03.266991+0000","last_clean":"2024-04-25T10:04:03.266991+0000","last_became_active":"2024-04-25T10:03:55.747631+0000","last_became_peered":"2024-04-25T10:03:55.747631+0000","last_unstale":"2024-04-25T10:04:03.266991+0000","last_undegraded":"2024-04-25T10:04:03.266991+0000","last_fullsized":"2024-04-25T10:04:03.266991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:44.719385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796909+0000","last_change":"2024-04-25T10:04:01.286318+0000","last_active":"2024-04-25T10:04:02.796909+0000","last_peered":"2024-04-25T10:04:02.796909+0000","last_clean":"2024-04-25T10:04:02.796909+0000","last_became_active":"2024-04-25T10:04:01.285907+0000","last_became_peered":"2024-04-25T10:04:01.285907+0000","last_unstale":"2024-04-25T10:04:02.796909+0000","last_undegraded":"2024-04-25T10:04:02.796909+0000","last_fullsized":"2024-04-25T10:04:02.796909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277610+0000","last_change":"2024-04-25T10:03:56.781752+0000","last_active":"2024-04-25T10:04:03.277610+0000","last_peered":"2024-04-25T10:04:03.277610+0000","last_clean":"2024-04-25T10:04:03.277610+0000","last_became_active":"2024-04-25T10:03:56.781491+0000","last_became_peered":"2024-04-25T10:03:56.781491+0000","last_unstale":"2024-04-25T10:04:03.277610+0000","last_undegraded":"2024-04-25T10:04:03.277610+0000","last_fullsized":"2024-04-25T10:04:03.277610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:11.993610+0000","last_change":"2024-04-25T10:03:55.766431+0000","last_active":"2024-04-25T10:04:11.993610+0000","last_peered":"2024-04-25T10:04:11.993610+0000","last_clean":"2024-04-25T10:04:11.993610+0000","last_became_active":"2024-04-25T10:03:55.761777+0000","last_became_peered":"2024-04-25T10:03:55.761777+0000","last_unstale":"2024-04-25T10:04:11.993610+0000","last_undegraded":"2024-04-25T10:04:11.993610+0000","last_fullsized":"2024-04-25T10:04:11.993610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275114+0000","last_change":"2024-04-25T10:04:00.801843+0000","last_active":"2024-04-25T10:04:03.275114+0000","last_peered":"2024-04-25T10:04:03.275114+0000","last_clean":"2024-04-25T10:04:03.275114+0000","last_became_active":"2024-04-25T10:04:00.801403+0000","last_became_peered":"2024-04-25T10:04:00.801403+0000","last_unstale":"2024-04-25T10:04:03.275114+0000","last_undegraded":"2024-04-25T10:04:03.275114+0000","last_fullsized":"2024-04-25T10:04:03.275114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277428+0000","last_change":"2024-04-25T10:03:56.782319+0000","last_active":"2024-04-25T10:04:03.277428+0000","last_peered":"2024-04-25T10:04:03.277428+0000","last_clean":"2024-04-25T10:04:03.277428+0000","last_became_active":"2024-04-25T10:03:56.781988+0000","last_became_peered":"2024-04-25T10:03:56.781988+0000","last_unstale":"2024-04-25T10:04:03.277428+0000","last_undegraded":"2024-04-25T10:04:03.277428+0000","last_fullsized":"2024-04-25T10:04:03.277428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274941+0000","last_change":"2024-04-25T10:03:55.767225+0000","last_active":"2024-04-25T10:04:03.274941+0000","last_peered":"2024-04-25T10:04:03.274941+0000","last_clean":"2024-04-25T10:04:03.274941+0000","last_became_active":"2024-04-25T10:03:55.766947+0000","last_became_peered":"2024-04-25T10:03:55.766947+0000","last_unstale":"2024-04-25T10:04:03.274941+0000","last_undegraded":"2024-04-25T10:04:03.274941+0000","last_fullsized":"2024-04-25T10:04:03.274941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278424+0000","last_change":"2024-04-25T10:04:00.797613+0000","last_active":"2024-04-25T10:04:03.278424+0000","last_peered":"2024-04-25T10:04:03.278424+0000","last_clean":"2024-04-25T10:04:03.278424+0000","last_became_active":"2024-04-25T10:04:00.797207+0000","last_became_peered":"2024-04-25T10:04:00.797207+0000","last_unstale":"2024-04-25T10:04:03.278424+0000","last_undegraded":"2024-04-25T10:04:03.278424+0000","last_fullsized":"2024-04-25T10:04:03.278424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266976+0000","last_change":"2024-04-25T10:03:56.774964+0000","last_active":"2024-04-25T10:04:03.266976+0000","last_peered":"2024-04-25T10:04:03.266976+0000","last_clean":"2024-04-25T10:04:03.266976+0000","last_became_active":"2024-04-25T10:03:56.770623+0000","last_became_peered":"2024-04-25T10:03:56.770623+0000","last_unstale":"2024-04-25T10:04:03.266976+0000","last_undegraded":"2024-04-25T10:04:03.266976+0000","last_fullsized":"2024-04-25T10:04:03.266976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797269+0000","last_change":"2024-04-25T10:03:55.772282+0000","last_active":"2024-04-25T10:04:02.797269+0000","last_peered":"2024-04-25T10:04:02.797269+0000","last_clean":"2024-04-25T10:04:02.797269+0000","last_became_active":"2024-04-25T10:03:55.771984+0000","last_became_peered":"2024-04-25T10:03:55.771984+0000","last_unstale":"2024-04-25T10:04:02.797269+0000","last_undegraded":"2024-04-25T10:04:02.797269+0000","last_fullsized":"2024-04-25T10:04:02.797269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792604+0000","last_change":"2024-04-25T10:04:00.802185+0000","last_active":"2024-04-25T10:04:02.792604+0000","last_peered":"2024-04-25T10:04:02.792604+0000","last_clean":"2024-04-25T10:04:02.792604+0000","last_became_active":"2024-04-25T10:04:00.801810+0000","last_became_peered":"2024-04-25T10:04:00.801810+0000","last_unstale":"2024-04-25T10:04:02.792604+0000","last_undegraded":"2024-04-25T10:04:02.792604+0000","last_fullsized":"2024-04-25T10:04:02.792604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:47.336597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797055+0000","last_change":"2024-04-25T10:03:56.786962+0000","last_active":"2024-04-25T10:04:02.797055+0000","last_peered":"2024-04-25T10:04:02.797055+0000","last_clean":"2024-04-25T10:04:02.797055+0000","last_became_active":"2024-04-25T10:03:56.786671+0000","last_became_peered":"2024-04-25T10:03:56.786671+0000","last_unstale":"2024-04-25T10:04:02.797055+0000","last_undegraded":"2024-04-25T10:04:02.797055+0000","last_fullsized":"2024-04-25T10:04:02.797055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796832+0000","last_change":"2024-04-25T10:03:55.769399+0000","last_active":"2024-04-25T10:04:02.796832+0000","last_peered":"2024-04-25T10:04:02.796832+0000","last_clean":"2024-04-25T10:04:02.796832+0000","last_became_active":"2024-04-25T10:03:55.769076+0000","last_became_peered":"2024-04-25T10:03:55.769076+0000","last_unstale":"2024-04-25T10:04:02.796832+0000","last_undegraded":"2024-04-25T10:04:02.796832+0000","last_fullsized":"2024-04-25T10:04:02.796832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792653+0000","last_change":"2024-04-25T10:04:01.284799+0000","last_active":"2024-04-25T10:04:02.792653+0000","last_peered":"2024-04-25T10:04:02.792653+0000","last_clean":"2024-04-25T10:04:02.792653+0000","last_became_active":"2024-04-25T10:04:01.283596+0000","last_became_peered":"2024-04-25T10:04:01.283596+0000","last_unstale":"2024-04-25T10:04:02.792653+0000","last_undegraded":"2024-04-25T10:04:02.792653+0000","last_fullsized":"2024-04-25T10:04:02.792653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:41.435837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266621+0000","last_change":"2024-04-25T10:04:01.286375+0000","last_active":"2024-04-25T10:04:03.266621+0000","last_peered":"2024-04-25T10:04:03.266621+0000","last_clean":"2024-04-25T10:04:03.266621+0000","last_became_active":"2024-04-25T10:04:01.285832+0000","last_became_peered":"2024-04-25T10:04:01.285832+0000","last_unstale":"2024-04-25T10:04:03.266621+0000","last_undegraded":"2024-04-25T10:04:03.266621+0000","last_fullsized":"2024-04-25T10:04:03.266621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274484+0000","last_change":"2024-04-25T10:03:56.760165+0000","last_active":"2024-04-25T10:04:03.274484+0000","last_peered":"2024-04-25T10:04:03.274484+0000","last_clean":"2024-04-25T10:04:03.274484+0000","last_became_active":"2024-04-25T10:03:56.759886+0000","last_became_peered":"2024-04-25T10:03:56.759886+0000","last_unstale":"2024-04-25T10:04:03.274484+0000","last_undegraded":"2024-04-25T10:04:03.274484+0000","last_fullsized":"2024-04-25T10:04:03.274484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795508+0000","last_change":"2024-04-25T10:03:55.759342+0000","last_active":"2024-04-25T10:04:02.795508+0000","last_peered":"2024-04-25T10:04:02.795508+0000","last_clean":"2024-04-25T10:04:02.795508+0000","last_became_active":"2024-04-25T10:03:55.758902+0000","last_became_peered":"2024-04-25T10:03:55.758902+0000","last_unstale":"2024-04-25T10:04:02.795508+0000","last_undegraded":"2024-04-25T10:04:02.795508+0000","last_fullsized":"2024-04-25T10:04:02.795508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796847+0000","last_change":"2024-04-25T10:04:00.800413+0000","last_active":"2024-04-25T10:04:02.796847+0000","last_peered":"2024-04-25T10:04:02.796847+0000","last_clean":"2024-04-25T10:04:02.796847+0000","last_became_active":"2024-04-25T10:04:00.800005+0000","last_became_peered":"2024-04-25T10:04:00.800005+0000","last_unstale":"2024-04-25T10:04:02.796847+0000","last_undegraded":"2024-04-25T10:04:02.796847+0000","last_fullsized":"2024-04-25T10:04:02.796847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792578+0000","last_change":"2024-04-25T10:03:56.754790+0000","last_active":"2024-04-25T10:04:02.792578+0000","last_peered":"2024-04-25T10:04:02.792578+0000","last_clean":"2024-04-25T10:04:02.792578+0000","last_became_active":"2024-04-25T10:03:56.753655+0000","last_became_peered":"2024-04-25T10:03:56.753655+0000","last_unstale":"2024-04-25T10:04:02.792578+0000","last_undegraded":"2024-04-25T10:04:02.792578+0000","last_fullsized":"2024-04-25T10:04:02.792578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:39.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792770+0000","last_change":"2024-04-25T10:03:55.761647+0000","last_active":"2024-04-25T10:04:02.792770+0000","last_peered":"2024-04-25T10:04:02.792770+0000","last_clean":"2024-04-25T10:04:02.792770+0000","last_became_active":"2024-04-25T10:03:55.761495+0000","last_became_peered":"2024-04-25T10:03:55.761495+0000","last_unstale":"2024-04-25T10:04:02.792770+0000","last_undegraded":"2024-04-25T10:04:02.792770+0000","last_fullsized":"2024-04-25T10:04:02.792770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:24.436084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796295+0000","last_change":"2024-04-25T10:03:55.765920+0000","last_active":"2024-04-25T10:04:02.796295+0000","last_peered":"2024-04-25T10:04:02.796295+0000","last_clean":"2024-04-25T10:04:02.796295+0000","last_became_active":"2024-04-25T10:03:55.765626+0000","last_became_peered":"2024-04-25T10:03:55.765626+0000","last_unstale":"2024-04-25T10:04:02.796295+0000","last_undegraded":"2024-04-25T10:04:02.796295+0000","last_fullsized":"2024-04-25T10:04:02.796295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266888+0000","last_change":"2024-04-25T10:03:56.780813+0000","last_active":"2024-04-25T10:04:03.266888+0000","last_peered":"2024-04-25T10:04:03.266888+0000","last_clean":"2024-04-25T10:04:03.266888+0000","last_became_active":"2024-04-25T10:03:56.774414+0000","last_became_peered":"2024-04-25T10:03:56.774414+0000","last_unstale":"2024-04-25T10:04:03.266888+0000","last_undegraded":"2024-04-25T10:04:03.266888+0000","last_fullsized":"2024-04-25T10:04:03.266888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230710+0000","last_change":"2024-04-25T10:04:00.805747+0000","last_active":"2024-04-25T10:04:03.230710+0000","last_peered":"2024-04-25T10:04:03.230710+0000","last_clean":"2024-04-25T10:04:03.230710+0000","last_became_active":"2024-04-25T10:04:00.804310+0000","last_became_peered":"2024-04-25T10:04:00.804310+0000","last_unstale":"2024-04-25T10:04:03.230710+0000","last_undegraded":"2024-04-25T10:04:03.230710+0000","last_fullsized":"2024-04-25T10:04:03.230710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:05.811588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793053+0000","last_change":"2024-04-25T10:03:55.768990+0000","last_active":"2024-04-25T10:04:02.793053+0000","last_peered":"2024-04-25T10:04:02.793053+0000","last_clean":"2024-04-25T10:04:02.793053+0000","last_became_active":"2024-04-25T10:03:55.767518+0000","last_became_peered":"2024-04-25T10:03:55.767518+0000","last_unstale":"2024-04-25T10:04:02.793053+0000","last_undegraded":"2024-04-25T10:04:02.793053+0000","last_fullsized":"2024-04-25T10:04:02.793053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:11.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277092+0000","last_change":"2024-04-25T10:03:56.770753+0000","last_active":"2024-04-25T10:04:03.277092+0000","last_peered":"2024-04-25T10:04:03.277092+0000","last_clean":"2024-04-25T10:04:03.277092+0000","last_became_active":"2024-04-25T10:03:56.770399+0000","last_became_peered":"2024-04-25T10:03:56.770399+0000","last_unstale":"2024-04-25T10:04:03.277092+0000","last_undegraded":"2024-04-25T10:04:03.277092+0000","last_fullsized":"2024-04-25T10:04:03.277092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:12.633520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793274+0000","last_change":"2024-04-25T10:04:00.810546+0000","last_active":"2024-04-25T10:04:02.793274+0000","last_peered":"2024-04-25T10:04:02.793274+0000","last_clean":"2024-04-25T10:04:02.793274+0000","last_became_active":"2024-04-25T10:04:00.809965+0000","last_became_peered":"2024-04-25T10:04:00.809965+0000","last_unstale":"2024-04-25T10:04:02.793274+0000","last_undegraded":"2024-04-25T10:04:02.793274+0000","last_fullsized":"2024-04-25T10:04:02.793274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:25.609318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796086+0000","last_change":"2024-04-25T10:03:56.759410+0000","last_active":"2024-04-25T10:04:02.796086+0000","last_peered":"2024-04-25T10:04:02.796086+0000","last_clean":"2024-04-25T10:04:02.796086+0000","last_became_active":"2024-04-25T10:03:56.759063+0000","last_became_peered":"2024-04-25T10:03:56.759063+0000","last_unstale":"2024-04-25T10:04:02.796086+0000","last_undegraded":"2024-04-25T10:04:02.796086+0000","last_fullsized":"2024-04-25T10:04:02.796086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230579+0000","last_change":"2024-04-25T10:03:56.775592+0000","last_active":"2024-04-25T10:04:03.230579+0000","last_peered":"2024-04-25T10:04:03.230579+0000","last_clean":"2024-04-25T10:04:03.230579+0000","last_became_active":"2024-04-25T10:03:56.775251+0000","last_became_peered":"2024-04-25T10:03:56.775251+0000","last_unstale":"2024-04-25T10:04:03.230579+0000","last_undegraded":"2024-04-25T10:04:03.230579+0000","last_fullsized":"2024-04-25T10:04:03.230579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796019+0000","last_change":"2024-04-25T10:03:56.767847+0000","last_active":"2024-04-25T10:04:02.796019+0000","last_peered":"2024-04-25T10:04:02.796019+0000","last_clean":"2024-04-25T10:04:02.796019+0000","last_became_active":"2024-04-25T10:03:56.767543+0000","last_became_peered":"2024-04-25T10:03:56.767543+0000","last_unstale":"2024-04-25T10:04:02.796019+0000","last_undegraded":"2024-04-25T10:04:02.796019+0000","last_fullsized":"2024-04-25T10:04:02.796019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266882+0000","last_change":"2024-04-25T10:03:56.767650+0000","last_active":"2024-04-25T10:04:03.266882+0000","last_peered":"2024-04-25T10:04:03.266882+0000","last_clean":"2024-04-25T10:04:03.266882+0000","last_became_active":"2024-04-25T10:03:56.767362+0000","last_became_peered":"2024-04-25T10:03:56.767362+0000","last_unstale":"2024-04-25T10:04:03.266882+0000","last_undegraded":"2024-04-25T10:04:03.266882+0000","last_fullsized":"2024-04-25T10:04:03.266882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793258+0000","last_change":"2024-04-25T10:03:56.776617+0000","last_active":"2024-04-25T10:04:02.793258+0000","last_peered":"2024-04-25T10:04:02.793258+0000","last_clean":"2024-04-25T10:04:02.793258+0000","last_became_active":"2024-04-25T10:03:56.776219+0000","last_became_peered":"2024-04-25T10:03:56.776219+0000","last_unstale":"2024-04-25T10:04:02.793258+0000","last_undegraded":"2024-04-25T10:04:02.793258+0000","last_fullsized":"2024-04-25T10:04:02.793258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.744805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274831+0000","last_change":"2024-04-25T10:03:56.759677+0000","last_active":"2024-04-25T10:04:03.274831+0000","last_peered":"2024-04-25T10:04:03.274831+0000","last_clean":"2024-04-25T10:04:03.274831+0000","last_became_active":"2024-04-25T10:03:56.759375+0000","last_became_peered":"2024-04-25T10:03:56.759375+0000","last_unstale":"2024-04-25T10:04:03.274831+0000","last_undegraded":"2024-04-25T10:04:03.274831+0000","last_fullsized":"2024-04-25T10:04:03.274831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797482+0000","last_change":"2024-04-25T10:03:56.780048+0000","last_active":"2024-04-25T10:04:02.797482+0000","last_peered":"2024-04-25T10:04:02.797482+0000","last_clean":"2024-04-25T10:04:02.797482+0000","last_became_active":"2024-04-25T10:03:56.779166+0000","last_became_peered":"2024-04-25T10:03:56.779166+0000","last_unstale":"2024-04-25T10:04:02.797482+0000","last_undegraded":"2024-04-25T10:04:02.797482+0000","last_fullsized":"2024-04-25T10:04:02.797482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793245+0000","last_change":"2024-04-25T10:03:56.772146+0000","last_active":"2024-04-25T10:04:02.793245+0000","last_peered":"2024-04-25T10:04:02.793245+0000","last_clean":"2024-04-25T10:04:02.793245+0000","last_became_active":"2024-04-25T10:03:56.770243+0000","last_became_peered":"2024-04-25T10:03:56.770243+0000","last_unstale":"2024-04-25T10:04:02.793245+0000","last_undegraded":"2024-04-25T10:04:02.793245+0000","last_fullsized":"2024-04-25T10:04:02.793245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:14.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795467+0000","last_change":"2024-04-25T10:03:56.771691+0000","last_active":"2024-04-25T10:04:02.795467+0000","last_peered":"2024-04-25T10:04:02.795467+0000","last_clean":"2024-04-25T10:04:02.795467+0000","last_became_active":"2024-04-25T10:03:56.771315+0000","last_became_peered":"2024-04-25T10:03:56.771315+0000","last_unstale":"2024-04-25T10:04:02.795467+0000","last_undegraded":"2024-04-25T10:04:02.795467+0000","last_fullsized":"2024-04-25T10:04:02.795467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792766+0000","last_change":"2024-04-25T10:03:56.776434+0000","last_active":"2024-04-25T10:04:02.792766+0000","last_peered":"2024-04-25T10:04:02.792766+0000","last_clean":"2024-04-25T10:04:02.792766+0000","last_became_active":"2024-04-25T10:03:56.776138+0000","last_became_peered":"2024-04-25T10:03:56.776138+0000","last_unstale":"2024-04-25T10:04:02.792766+0000","last_undegraded":"2024-04-25T10:04:02.792766+0000","last_fullsized":"2024-04-25T10:04:02.792766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796045+0000","last_change":"2024-04-25T10:03:56.787227+0000","last_active":"2024-04-25T10:04:02.796045+0000","last_peered":"2024-04-25T10:04:02.796045+0000","last_clean":"2024-04-25T10:04:02.796045+0000","last_became_active":"2024-04-25T10:03:56.786628+0000","last_became_peered":"2024-04-25T10:03:56.786628+0000","last_unstale":"2024-04-25T10:04:02.796045+0000","last_undegraded":"2024-04-25T10:04:02.796045+0000","last_fullsized":"2024-04-25T10:04:02.796045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266770+0000","last_change":"2024-04-25T10:03:56.781525+0000","last_active":"2024-04-25T10:04:03.266770+0000","last_peered":"2024-04-25T10:04:03.266770+0000","last_clean":"2024-04-25T10:04:03.266770+0000","last_became_active":"2024-04-25T10:03:56.781186+0000","last_became_peered":"2024-04-25T10:03:56.781186+0000","last_unstale":"2024-04-25T10:04:03.266770+0000","last_undegraded":"2024-04-25T10:04:03.266770+0000","last_fullsized":"2024-04-25T10:04:03.266770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796586+0000","last_change":"2024-04-25T10:03:56.772909+0000","last_active":"2024-04-25T10:04:02.796586+0000","last_peered":"2024-04-25T10:04:02.796586+0000","last_clean":"2024-04-25T10:04:02.796586+0000","last_became_active":"2024-04-25T10:03:56.772651+0000","last_became_peered":"2024-04-25T10:03:56.772651+0000","last_unstale":"2024-04-25T10:04:02.796586+0000","last_undegraded":"2024-04-25T10:04:02.796586+0000","last_fullsized":"2024-04-25T10:04:02.796586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277718+0000","last_change":"2024-04-25T10:03:56.786914+0000","last_active":"2024-04-25T10:04:03.277718+0000","last_peered":"2024-04-25T10:04:03.277718+0000","last_clean":"2024-04-25T10:04:03.277718+0000","last_became_active":"2024-04-25T10:03:56.786624+0000","last_became_peered":"2024-04-25T10:03:56.786624+0000","last_unstale":"2024-04-25T10:04:03.277718+0000","last_undegraded":"2024-04-25T10:04:03.277718+0000","last_fullsized":"2024-04-25T10:04:03.277718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230883+0000","last_change":"2024-04-25T10:03:56.756870+0000","last_active":"2024-04-25T10:04:03.230883+0000","last_peered":"2024-04-25T10:04:03.230883+0000","last_clean":"2024-04-25T10:04:03.230883+0000","last_became_active":"2024-04-25T10:03:56.756588+0000","last_became_peered":"2024-04-25T10:03:56.756588+0000","last_unstale":"2024-04-25T10:04:03.230883+0000","last_undegraded":"2024-04-25T10:04:03.230883+0000","last_fullsized":"2024-04-25T10:04:03.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797271+0000","last_change":"2024-04-25T10:03:56.787720+0000","last_active":"2024-04-25T10:04:02.797271+0000","last_peered":"2024-04-25T10:04:02.797271+0000","last_clean":"2024-04-25T10:04:02.797271+0000","last_became_active":"2024-04-25T10:03:56.786712+0000","last_became_peered":"2024-04-25T10:03:56.786712+0000","last_unstale":"2024-04-25T10:04:02.797271+0000","last_undegraded":"2024-04-25T10:04:02.797271+0000","last_fullsized":"2024-04-25T10:04:02.797271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795363+0000","last_change":"2024-04-25T10:03:56.772050+0000","last_active":"2024-04-25T10:04:02.795363+0000","last_peered":"2024-04-25T10:04:02.795363+0000","last_clean":"2024-04-25T10:04:02.795363+0000","last_became_active":"2024-04-25T10:03:56.771788+0000","last_became_peered":"2024-04-25T10:03:56.771788+0000","last_unstale":"2024-04-25T10:04:02.795363+0000","last_undegraded":"2024-04-25T10:04:02.795363+0000","last_fullsized":"2024-04-25T10:04:02.795363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274557+0000","last_change":"2024-04-25T10:03:56.776805+0000","last_active":"2024-04-25T10:04:03.274557+0000","last_peered":"2024-04-25T10:04:03.274557+0000","last_clean":"2024-04-25T10:04:03.274557+0000","last_became_active":"2024-04-25T10:03:56.776521+0000","last_became_peered":"2024-04-25T10:03:56.776521+0000","last_unstale":"2024-04-25T10:04:03.274557+0000","last_undegraded":"2024-04-25T10:04:03.274557+0000","last_fullsized":"2024-04-25T10:04:03.274557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266435+0000","last_change":"2024-04-25T10:03:56.756971+0000","last_active":"2024-04-25T10:04:03.266435+0000","last_peered":"2024-04-25T10:04:03.266435+0000","last_clean":"2024-04-25T10:04:03.266435+0000","last_became_active":"2024-04-25T10:03:56.756615+0000","last_became_peered":"2024-04-25T10:03:56.756615+0000","last_unstale":"2024-04-25T10:04:03.266435+0000","last_undegraded":"2024-04-25T10:04:03.266435+0000","last_fullsized":"2024-04-25T10:04:03.266435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:37.191982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792947+0000","last_change":"2024-04-25T10:03:56.764011+0000","last_active":"2024-04-25T10:04:02.792947+0000","last_peered":"2024-04-25T10:04:02.792947+0000","last_clean":"2024-04-25T10:04:02.792947+0000","last_became_active":"2024-04-25T10:03:56.759567+0000","last_became_peered":"2024-04-25T10:03:56.759567+0000","last_unstale":"2024-04-25T10:04:02.792947+0000","last_undegraded":"2024-04-25T10:04:02.792947+0000","last_fullsized":"2024-04-25T10:04:02.792947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:44.595374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277339+0000","last_change":"2024-04-25T10:03:56.770314+0000","last_active":"2024-04-25T10:04:03.277339+0000","last_peered":"2024-04-25T10:04:03.277339+0000","last_clean":"2024-04-25T10:04:03.277339+0000","last_became_active":"2024-04-25T10:03:56.769983+0000","last_became_peered":"2024-04-25T10:03:56.769983+0000","last_unstale":"2024-04-25T10:04:03.277339+0000","last_undegraded":"2024-04-25T10:04:03.277339+0000","last_fullsized":"2024-04-25T10:04:03.277339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797467+0000","last_change":"2024-04-25T10:03:56.776383+0000","last_active":"2024-04-25T10:04:02.797467+0000","last_peered":"2024-04-25T10:04:02.797467+0000","last_clean":"2024-04-25T10:04:02.797467+0000","last_became_active":"2024-04-25T10:03:56.775871+0000","last_became_peered":"2024-04-25T10:03:56.775871+0000","last_unstale":"2024-04-25T10:04:02.797467+0000","last_undegraded":"2024-04-25T10:04:02.797467+0000","last_fullsized":"2024-04-25T10:04:02.797467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797420+0000","last_change":"2024-04-25T10:03:56.767888+0000","last_active":"2024-04-25T10:04:02.797420+0000","last_peered":"2024-04-25T10:04:02.797420+0000","last_clean":"2024-04-25T10:04:02.797420+0000","last_became_active":"2024-04-25T10:03:56.767620+0000","last_became_peered":"2024-04-25T10:03:56.767620+0000","last_unstale":"2024-04-25T10:04:02.797420+0000","last_undegraded":"2024-04-25T10:04:02.797420+0000","last_fullsized":"2024-04-25T10:04:02.797420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277564+0000","last_change":"2024-04-25T10:03:56.796106+0000","last_active":"2024-04-25T10:04:03.277564+0000","last_peered":"2024-04-25T10:04:03.277564+0000","last_clean":"2024-04-25T10:04:03.277564+0000","last_became_active":"2024-04-25T10:03:56.795843+0000","last_became_peered":"2024-04-25T10:03:56.795843+0000","last_unstale":"2024-04-25T10:04:03.277564+0000","last_undegraded":"2024-04-25T10:04:03.277564+0000","last_fullsized":"2024-04-25T10:04:03.277564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792478+0000","last_change":"2024-04-25T10:03:56.766481+0000","last_active":"2024-04-25T10:04:02.792478+0000","last_peered":"2024-04-25T10:04:02.792478+0000","last_clean":"2024-04-25T10:04:02.792478+0000","last_became_active":"2024-04-25T10:03:56.766169+0000","last_became_peered":"2024-04-25T10:03:56.766169+0000","last_unstale":"2024-04-25T10:04:02.792478+0000","last_undegraded":"2024-04-25T10:04:02.792478+0000","last_fullsized":"2024-04-25T10:04:02.792478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:58.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277557+0000","last_change":"2024-04-25T10:03:56.778866+0000","last_active":"2024-04-25T10:04:03.277557+0000","last_peered":"2024-04-25T10:04:03.277557+0000","last_clean":"2024-04-25T10:04:03.277557+0000","last_became_active":"2024-04-25T10:03:56.778491+0000","last_became_peered":"2024-04-25T10:03:56.778491+0000","last_unstale":"2024-04-25T10:04:03.277557+0000","last_undegraded":"2024-04-25T10:04:03.277557+0000","last_fullsized":"2024-04-25T10:04:03.277557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795905+0000","last_change":"2024-04-25T10:03:56.793303+0000","last_active":"2024-04-25T10:04:02.795905+0000","last_peered":"2024-04-25T10:04:02.795905+0000","last_clean":"2024-04-25T10:04:02.795905+0000","last_became_active":"2024-04-25T10:03:56.792743+0000","last_became_peered":"2024-04-25T10:03:56.792743+0000","last_unstale":"2024-04-25T10:04:02.795905+0000","last_undegraded":"2024-04-25T10:04:02.795905+0000","last_fullsized":"2024-04-25T10:04:02.795905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277067+0000","last_change":"2024-04-25T10:03:56.787411+0000","last_active":"2024-04-25T10:04:03.277067+0000","last_peered":"2024-04-25T10:04:03.277067+0000","last_clean":"2024-04-25T10:04:03.277067+0000","last_became_active":"2024-04-25T10:03:56.786639+0000","last_became_peered":"2024-04-25T10:03:56.786639+0000","last_unstale":"2024-04-25T10:04:03.277067+0000","last_undegraded":"2024-04-25T10:04:03.277067+0000","last_fullsized":"2024-04-25T10:04:03.277067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796676+0000","last_change":"2024-04-25T10:03:56.768181+0000","last_active":"2024-04-25T10:04:02.796676+0000","last_peered":"2024-04-25T10:04:02.796676+0000","last_clean":"2024-04-25T10:04:02.796676+0000","last_became_active":"2024-04-25T10:03:56.767723+0000","last_became_peered":"2024-04-25T10:03:56.767723+0000","last_unstale":"2024-04-25T10:04:02.796676+0000","last_undegraded":"2024-04-25T10:04:02.796676+0000","last_fullsized":"2024-04-25T10:04:02.796676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266736+0000","last_change":"2024-04-25T10:03:56.761621+0000","last_active":"2024-04-25T10:04:03.266736+0000","last_peered":"2024-04-25T10:04:03.266736+0000","last_clean":"2024-04-25T10:04:03.266736+0000","last_became_active":"2024-04-25T10:03:56.761220+0000","last_became_peered":"2024-04-25T10:03:56.761220+0000","last_unstale":"2024-04-25T10:04:03.266736+0000","last_undegraded":"2024-04-25T10:04:03.266736+0000","last_fullsized":"2024-04-25T10:04:03.266736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:35.367003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275178+0000","last_change":"2024-04-25T10:03:56.753004+0000","last_active":"2024-04-25T10:04:03.275178+0000","last_peered":"2024-04-25T10:04:03.275178+0000","last_clean":"2024-04-25T10:04:03.275178+0000","last_became_active":"2024-04-25T10:03:56.752524+0000","last_became_peered":"2024-04-25T10:03:56.752524+0000","last_unstale":"2024-04-25T10:04:03.275178+0000","last_undegraded":"2024-04-25T10:04:03.275178+0000","last_fullsized":"2024-04-25T10:04:03.275178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277772+0000","last_change":"2024-04-25T10:03:56.788107+0000","last_active":"2024-04-25T10:04:03.277772+0000","last_peered":"2024-04-25T10:04:03.277772+0000","last_clean":"2024-04-25T10:04:03.277772+0000","last_became_active":"2024-04-25T10:03:56.787837+0000","last_became_peered":"2024-04-25T10:03:56.787837+0000","last_unstale":"2024-04-25T10:04:03.277772+0000","last_undegraded":"2024-04-25T10:04:03.277772+0000","last_fullsized":"2024-04-25T10:04:03.277772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":114337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":117948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":114247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":888832,"data_stored":705253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:15.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.125+0000 7f295fe00640 1 Processor -- start 2024-04-25T10:04:16.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.125+0000 7f295fe00640 1 -- start start 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f295806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295fe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29580b23e0 con 0x7f29580aeb50 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295fe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29580acb80 con 0x7f29580af840 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2958146b20 con 0x7f2958146740 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f29580aeb50 0x7f29580ad940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59010/0 (socket says 172.21.15.18:59010) 2024-04-25T10:04:16.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 -- 172.21.15.18:0/857036582 learned_addr learned my addr 172.21.15.18:0/857036582 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295d400640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f295806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332843796 0 0) 0x7f29580b23e0 con 0x7f29580aeb50 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2940003530 con 0x7f29580aeb50 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086515445 0 0) 0x7f29580acb80 con 0x7f29580af840 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29580b23e0 con 0x7f29580af840 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729938736 0 0) 0x7f2940003530 con 0x7f29580aeb50 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 msgr2=0x7f295806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f295806d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 >> v1:172.21.15.167:6789/0 conn(0x7f29580af840 legacy=0x7f29580b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580ace60 con 0x7f29580aeb50 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f2950001a00 con 0x7f29580aeb50 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 >> v1:172.21.15.18:6789/0 conn(0x7f29580aeb50 legacy=0x7f29580ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f2940003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004130 0x7f2940004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2940004d50 0x7f29400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294000bae0 con 0x7f2940004d50 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294000bc90 con 0x7f2940004130 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294000be90 con 0x7f2958146740 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2940004d50 0x7f29400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295d400640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f2940003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295ca00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004130 0x7f2940004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 -- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 msgr2=0x7f2940003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f2940003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 -- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004130 msgr2=0x7f2940004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004130 0x7f2940004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295de00640 1 -- 172.21.15.18:0/857036582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2940003530 con 0x7f2940004d50 2024-04-25T10:04:16.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.129+0000 7f295d400640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2958146740 0x7f2940003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:16.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295de00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2940004d50 0x7f29400051d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f295000a730 tx=0x7f295001f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250b00bb568e9059 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000a350 con 0x7f2940004d50 2024-04-25T10:04:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500b1070 con 0x7f2940004d50 2024-04-25T10:04:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f2957e00640 1 -- 172.21.15.18:0/857036582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29500ac8f0 con 0x7f2940004d50 2024-04-25T10:04:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 -- 172.21.15.18:0/857036582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2940004d50 msgr2=0x7f29400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 --2- 172.21.15.18:0/857036582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2940004d50 0x7f29400051d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f295000a730 tx=0x7f295001f9a0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295de00640 1 -- 172.21.15.18:0/857036582 reap_dead start 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 -- 172.21.15.18:0/857036582 shutdown_connections 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 -- 172.21.15.18:0/857036582 >> 172.21.15.18:0/857036582 conn(0x7f2958066fa0 msgr2=0x7f295806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 -- 172.21.15.18:0/857036582 shutdown_connections 2024-04-25T10:04:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.133+0000 7f295fe00640 1 -- 172.21.15.18:0/857036582 wait complete. 2024-04-25T10:04:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 Processor -- start 2024-04-25T10:04:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- start start 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 0x7f29580cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 0x7f29581f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580b20f0 con 0x7f29581f4ed0 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29580ad420 con 0x7f2940004d50 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29580ae050 con 0x7f29581f4250 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40902/0 (socket says 172.21.15.18:40902) 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 -- 172.21.15.18:0/2403005848 learned_addr learned my addr 172.21.15.18:0/2403005848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295ca00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 0x7f29581f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295d400640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 0x7f29580cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 -- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 msgr2=0x7f29581f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 0x7f29581f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 -- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 msgr2=0x7f29580cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 0x7f29580cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 -- 172.21.15.18:0/2403005848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295813d200 con 0x7f29581f4ed0 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295ca00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 0x7f29581f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295d400640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 0x7f29580cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:16.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295de00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29500ae040 tx=0x7f2940005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0096b0 con 0x7f29581f4ed0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29500bc070 con 0x7f29581f4ed0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f295813d4a0 con 0x7f29581f4ed0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295000a350 con 0x7f29581f4ed0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.137+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295813da60 con 0x7f29581f4ed0 2024-04-25T10:04:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29580745d0 con 0x7f29581f4ed0 2024-04-25T10:04:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29500c1470 con 0x7f29581f4ed0 2024-04-25T10:04:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f2955600640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 0x7f2938069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f29501238f0 con 0x7f29581f4ed0 2024-04-25T10:04:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f295d400640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 0x7f2938069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.141+0000 7f295d400640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 0x7f2938069450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f295813f2c0 tx=0x7f294c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.145+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29500196b0 con 0x7f29581f4ed0 2024-04-25T10:04:16.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.309+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f295806b870 con 0x7f2938066f90 2024-04-25T10:04:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.317+0000 7f2955600640 1 -- 172.21.15.18:0/2403005848 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332562 (secure 0 0 0) 0x7f295806b870 con 0x7f2938066f90 2024-04-25T10:04:16.329 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 msgr2=0x7f2938069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 0x7f2938069450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f295813f2c0 tx=0x7f294c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 msgr2=0x7f29580b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f29500ae040 tx=0x7f2940005840 comp rx=0 tx=0).stop 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 shutdown_connections 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29581f4ed0 0x7f29580b36f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2938066f90 0x7f2938069450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f29581f4250 0x7f29581f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 --2- 172.21.15.18:0/2403005848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2940004d50 0x7f29580cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 >> 172.21.15.18:0/2403005848 conn(0x7f2958066fa0 msgr2=0x7f2958146b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 shutdown_connections 2024-04-25T10:04:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.321+0000 7f295fe00640 1 -- 172.21.15.18:0/2403005848 wait complete. 2024-04-25T10:04:16.349 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-25T10:04:15.398774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227920,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746800,"statfs":{"total":773094113280,"available":772860723200,"internally_reserved":0,"allocated":3514368,"data_stored":2103851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003295"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.267071+0000","last_change":"2024-04-25T10:03:55.768315+0000","last_active":"2024-04-25T10:04:03.267071+0000","last_peered":"2024-04-25T10:04:03.267071+0000","last_clean":"2024-04-25T10:04:03.267071+0000","last_became_active":"2024-04-25T10:03:55.768048+0000","last_became_peered":"2024-04-25T10:03:55.768048+0000","last_unstale":"2024-04-25T10:04:03.267071+0000","last_undegraded":"2024-04-25T10:04:03.267071+0000","last_fullsized":"2024-04-25T10:04:03.267071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:28.383096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793497+0000","last_change":"2024-04-25T10:03:56.758112+0000","last_active":"2024-04-25T10:04:02.793497+0000","last_peered":"2024-04-25T10:04:02.793497+0000","last_clean":"2024-04-25T10:04:02.793497+0000","last_became_active":"2024-04-25T10:03:56.757744+0000","last_became_peered":"2024-04-25T10:03:56.757744+0000","last_unstale":"2024-04-25T10:04:02.793497+0000","last_undegraded":"2024-04-25T10:04:02.793497+0000","last_fullsized":"2024-04-25T10:04:02.793497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:36.379846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792515+0000","last_change":"2024-04-25T10:04:01.286170+0000","last_active":"2024-04-25T10:04:02.792515+0000","last_peered":"2024-04-25T10:04:02.792515+0000","last_clean":"2024-04-25T10:04:02.792515+0000","last_became_active":"2024-04-25T10:04:01.285749+0000","last_became_peered":"2024-04-25T10:04:01.285749+0000","last_unstale":"2024-04-25T10:04:02.792515+0000","last_undegraded":"2024-04-25T10:04:02.792515+0000","last_fullsized":"2024-04-25T10:04:02.792515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:24.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793621+0000","last_change":"2024-04-25T10:03:55.757705+0000","last_active":"2024-04-25T10:04:02.793621+0000","last_peered":"2024-04-25T10:04:02.793621+0000","last_clean":"2024-04-25T10:04:02.793621+0000","last_became_active":"2024-04-25T10:03:55.757106+0000","last_became_peered":"2024-04-25T10:03:55.757106+0000","last_unstale":"2024-04-25T10:04:02.793621+0000","last_undegraded":"2024-04-25T10:04:02.793621+0000","last_fullsized":"2024-04-25T10:04:02.793621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:28.451018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266707+0000","last_change":"2024-04-25T10:03:56.772870+0000","last_active":"2024-04-25T10:04:03.266707+0000","last_peered":"2024-04-25T10:04:03.266707+0000","last_clean":"2024-04-25T10:04:03.266707+0000","last_became_active":"2024-04-25T10:03:56.771205+0000","last_became_peered":"2024-04-25T10:03:56.771205+0000","last_unstale":"2024-04-25T10:04:03.266707+0000","last_undegraded":"2024-04-25T10:04:03.266707+0000","last_fullsized":"2024-04-25T10:04:03.266707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:44.754772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276672+0000","last_change":"2024-04-25T10:04:00.804531+0000","last_active":"2024-04-25T10:04:03.276672+0000","last_peered":"2024-04-25T10:04:03.276672+0000","last_clean":"2024-04-25T10:04:03.276672+0000","last_became_active":"2024-04-25T10:04:00.804099+0000","last_became_peered":"2024-04-25T10:04:00.804099+0000","last_unstale":"2024-04-25T10:04:03.276672+0000","last_undegraded":"2024-04-25T10:04:03.276672+0000","last_fullsized":"2024-04-25T10:04:03.276672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277581+0000","last_change":"2024-04-25T10:03:55.774735+0000","last_active":"2024-04-25T10:04:03.277581+0000","last_peered":"2024-04-25T10:04:03.277581+0000","last_clean":"2024-04-25T10:04:03.277581+0000","last_became_active":"2024-04-25T10:03:55.774388+0000","last_became_peered":"2024-04-25T10:03:55.774388+0000","last_unstale":"2024-04-25T10:04:03.277581+0000","last_undegraded":"2024-04-25T10:04:03.277581+0000","last_fullsized":"2024-04-25T10:04:03.277581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796791+0000","last_change":"2024-04-25T10:03:56.773291+0000","last_active":"2024-04-25T10:04:02.796791+0000","last_peered":"2024-04-25T10:04:02.796791+0000","last_clean":"2024-04-25T10:04:02.796791+0000","last_became_active":"2024-04-25T10:03:56.772811+0000","last_became_peered":"2024-04-25T10:03:56.772811+0000","last_unstale":"2024-04-25T10:04:02.796791+0000","last_undegraded":"2024-04-25T10:04:02.796791+0000","last_fullsized":"2024-04-25T10:04:02.796791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278159+0000","last_change":"2024-04-25T10:04:00.809365+0000","last_active":"2024-04-25T10:04:03.278159+0000","last_peered":"2024-04-25T10:04:03.278159+0000","last_clean":"2024-04-25T10:04:03.278159+0000","last_became_active":"2024-04-25T10:04:00.808889+0000","last_became_peered":"2024-04-25T10:04:00.808889+0000","last_unstale":"2024-04-25T10:04:03.278159+0000","last_undegraded":"2024-04-25T10:04:03.278159+0000","last_fullsized":"2024-04-25T10:04:03.278159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277444+0000","last_change":"2024-04-25T10:03:55.773956+0000","last_active":"2024-04-25T10:04:03.277444+0000","last_peered":"2024-04-25T10:04:03.277444+0000","last_clean":"2024-04-25T10:04:03.277444+0000","last_became_active":"2024-04-25T10:03:55.770709+0000","last_became_peered":"2024-04-25T10:03:55.770709+0000","last_unstale":"2024-04-25T10:04:03.277444+0000","last_undegraded":"2024-04-25T10:04:03.277444+0000","last_fullsized":"2024-04-25T10:04:03.277444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796965+0000","last_change":"2024-04-25T10:03:56.773544+0000","last_active":"2024-04-25T10:04:02.796965+0000","last_peered":"2024-04-25T10:04:02.796965+0000","last_clean":"2024-04-25T10:04:02.796965+0000","last_became_active":"2024-04-25T10:03:56.773246+0000","last_became_peered":"2024-04-25T10:03:56.773246+0000","last_unstale":"2024-04-25T10:04:02.796965+0000","last_undegraded":"2024-04-25T10:04:02.796965+0000","last_fullsized":"2024-04-25T10:04:02.796965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277083+0000","last_change":"2024-04-25T10:04:00.809357+0000","last_active":"2024-04-25T10:04:03.277083+0000","last_peered":"2024-04-25T10:04:03.277083+0000","last_clean":"2024-04-25T10:04:03.277083+0000","last_became_active":"2024-04-25T10:04:00.808905+0000","last_became_peered":"2024-04-25T10:04:00.808905+0000","last_unstale":"2024-04-25T10:04:03.277083+0000","last_undegraded":"2024-04-25T10:04:03.277083+0000","last_fullsized":"2024-04-25T10:04:03.277083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796173+0000","last_change":"2024-04-25T10:03:56.774064+0000","last_active":"2024-04-25T10:04:02.796173+0000","last_peered":"2024-04-25T10:04:02.796173+0000","last_clean":"2024-04-25T10:04:02.796173+0000","last_became_active":"2024-04-25T10:03:56.773617+0000","last_became_peered":"2024-04-25T10:03:56.773617+0000","last_unstale":"2024-04-25T10:04:02.796173+0000","last_undegraded":"2024-04-25T10:04:02.796173+0000","last_fullsized":"2024-04-25T10:04:02.796173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277648+0000","last_change":"2024-04-25T10:03:55.771542+0000","last_active":"2024-04-25T10:04:03.277648+0000","last_peered":"2024-04-25T10:04:03.277648+0000","last_clean":"2024-04-25T10:04:03.277648+0000","last_became_active":"2024-04-25T10:03:55.771100+0000","last_became_peered":"2024-04-25T10:03:55.771100+0000","last_unstale":"2024-04-25T10:04:03.277648+0000","last_undegraded":"2024-04-25T10:04:03.277648+0000","last_fullsized":"2024-04-25T10:04:03.277648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278167+0000","last_change":"2024-04-25T10:04:00.797932+0000","last_active":"2024-04-25T10:04:03.278167+0000","last_peered":"2024-04-25T10:04:03.278167+0000","last_clean":"2024-04-25T10:04:03.278167+0000","last_became_active":"2024-04-25T10:04:00.797547+0000","last_became_peered":"2024-04-25T10:04:00.797547+0000","last_unstale":"2024-04-25T10:04:03.278167+0000","last_undegraded":"2024-04-25T10:04:03.278167+0000","last_fullsized":"2024-04-25T10:04:03.278167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793017+0000","last_change":"2024-04-25T10:03:56.763110+0000","last_active":"2024-04-25T10:04:02.793017+0000","last_peered":"2024-04-25T10:04:02.793017+0000","last_clean":"2024-04-25T10:04:02.793017+0000","last_became_active":"2024-04-25T10:03:56.759036+0000","last_became_peered":"2024-04-25T10:03:56.759036+0000","last_unstale":"2024-04-25T10:04:02.793017+0000","last_undegraded":"2024-04-25T10:04:02.793017+0000","last_fullsized":"2024-04-25T10:04:02.793017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:09.264916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275006+0000","last_change":"2024-04-25T10:03:55.760284+0000","last_active":"2024-04-25T10:04:03.275006+0000","last_peered":"2024-04-25T10:04:03.275006+0000","last_clean":"2024-04-25T10:04:03.275006+0000","last_became_active":"2024-04-25T10:03:55.757931+0000","last_became_peered":"2024-04-25T10:03:55.757931+0000","last_unstale":"2024-04-25T10:04:03.275006+0000","last_undegraded":"2024-04-25T10:04:03.275006+0000","last_fullsized":"2024-04-25T10:04:03.275006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277167+0000","last_change":"2024-04-25T10:04:00.805760+0000","last_active":"2024-04-25T10:04:03.277167+0000","last_peered":"2024-04-25T10:04:03.277167+0000","last_clean":"2024-04-25T10:04:03.277167+0000","last_became_active":"2024-04-25T10:04:00.805409+0000","last_became_peered":"2024-04-25T10:04:00.805409+0000","last_unstale":"2024-04-25T10:04:03.277167+0000","last_undegraded":"2024-04-25T10:04:03.277167+0000","last_fullsized":"2024-04-25T10:04:03.277167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792681+0000","last_change":"2024-04-25T10:03:56.755762+0000","last_active":"2024-04-25T10:04:02.792681+0000","last_peered":"2024-04-25T10:04:02.792681+0000","last_clean":"2024-04-25T10:04:02.792681+0000","last_became_active":"2024-04-25T10:03:56.755497+0000","last_became_peered":"2024-04-25T10:03:56.755497+0000","last_unstale":"2024-04-25T10:04:02.792681+0000","last_undegraded":"2024-04-25T10:04:02.792681+0000","last_fullsized":"2024-04-25T10:04:02.792681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:39.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274613+0000","last_change":"2024-04-25T10:03:55.768303+0000","last_active":"2024-04-25T10:04:03.274613+0000","last_peered":"2024-04-25T10:04:03.274613+0000","last_clean":"2024-04-25T10:04:03.274613+0000","last_became_active":"2024-04-25T10:03:55.767994+0000","last_became_peered":"2024-04-25T10:03:55.767994+0000","last_unstale":"2024-04-25T10:04:03.274613+0000","last_undegraded":"2024-04-25T10:04:03.274613+0000","last_fullsized":"2024-04-25T10:04:03.274613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275339+0000","last_change":"2024-04-25T10:04:01.284089+0000","last_active":"2024-04-25T10:04:03.275339+0000","last_peered":"2024-04-25T10:04:03.275339+0000","last_clean":"2024-04-25T10:04:03.275339+0000","last_became_active":"2024-04-25T10:04:01.283683+0000","last_became_peered":"2024-04-25T10:04:01.283683+0000","last_unstale":"2024-04-25T10:04:03.275339+0000","last_undegraded":"2024-04-25T10:04:03.275339+0000","last_fullsized":"2024-04-25T10:04:03.275339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278023+0000","last_change":"2024-04-25T10:03:56.763149+0000","last_active":"2024-04-25T10:04:03.278023+0000","last_peered":"2024-04-25T10:04:03.278023+0000","last_clean":"2024-04-25T10:04:03.278023+0000","last_became_active":"2024-04-25T10:03:56.762775+0000","last_became_peered":"2024-04-25T10:03:56.762775+0000","last_unstale":"2024-04-25T10:04:03.278023+0000","last_undegraded":"2024-04-25T10:04:03.278023+0000","last_fullsized":"2024-04-25T10:04:03.278023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:40.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276548+0000","last_change":"2024-04-25T10:03:55.769495+0000","last_active":"2024-04-25T10:04:03.276548+0000","last_peered":"2024-04-25T10:04:03.276548+0000","last_clean":"2024-04-25T10:04:03.276548+0000","last_became_active":"2024-04-25T10:03:55.769215+0000","last_became_peered":"2024-04-25T10:03:55.769215+0000","last_unstale":"2024-04-25T10:04:03.276548+0000","last_undegraded":"2024-04-25T10:04:03.276548+0000","last_fullsized":"2024-04-25T10:04:03.276548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278249+0000","last_change":"2024-04-25T10:04:00.809196+0000","last_active":"2024-04-25T10:04:03.278249+0000","last_peered":"2024-04-25T10:04:03.278249+0000","last_clean":"2024-04-25T10:04:03.278249+0000","last_became_active":"2024-04-25T10:04:00.808831+0000","last_became_peered":"2024-04-25T10:04:00.808831+0000","last_unstale":"2024-04-25T10:04:03.278249+0000","last_undegraded":"2024-04-25T10:04:03.278249+0000","last_fullsized":"2024-04-25T10:04:03.278249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266867+0000","last_change":"2024-04-25T10:03:56.758244+0000","last_active":"2024-04-25T10:04:03.266867+0000","last_peered":"2024-04-25T10:04:03.266867+0000","last_clean":"2024-04-25T10:04:03.266867+0000","last_became_active":"2024-04-25T10:03:56.757968+0000","last_became_peered":"2024-04-25T10:03:56.757968+0000","last_unstale":"2024-04-25T10:04:03.266867+0000","last_undegraded":"2024-04-25T10:04:03.266867+0000","last_fullsized":"2024-04-25T10:04:03.266867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:01.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797119+0000","last_change":"2024-04-25T10:03:55.771510+0000","last_active":"2024-04-25T10:04:02.797119+0000","last_peered":"2024-04-25T10:04:02.797119+0000","last_clean":"2024-04-25T10:04:02.797119+0000","last_became_active":"2024-04-25T10:03:55.771339+0000","last_became_peered":"2024-04-25T10:03:55.771339+0000","last_unstale":"2024-04-25T10:04:02.797119+0000","last_undegraded":"2024-04-25T10:04:02.797119+0000","last_fullsized":"2024-04-25T10:04:02.797119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277693+0000","last_change":"2024-04-25T10:04:01.287169+0000","last_active":"2024-04-25T10:04:03.277693+0000","last_peered":"2024-04-25T10:04:03.277693+0000","last_clean":"2024-04-25T10:04:03.277693+0000","last_became_active":"2024-04-25T10:04:01.286796+0000","last_became_peered":"2024-04-25T10:04:01.286796+0000","last_unstale":"2024-04-25T10:04:03.277693+0000","last_undegraded":"2024-04-25T10:04:03.277693+0000","last_fullsized":"2024-04-25T10:04:03.277693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:30.474221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793347+0000","last_change":"2024-04-25T10:03:56.780820+0000","last_active":"2024-04-25T10:04:02.793347+0000","last_peered":"2024-04-25T10:04:02.793347+0000","last_clean":"2024-04-25T10:04:02.793347+0000","last_became_active":"2024-04-25T10:03:56.780475+0000","last_became_peered":"2024-04-25T10:03:56.780475+0000","last_unstale":"2024-04-25T10:04:02.793347+0000","last_undegraded":"2024-04-25T10:04:02.793347+0000","last_fullsized":"2024-04-25T10:04:02.793347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:31.014597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275213+0000","last_change":"2024-04-25T10:03:55.767628+0000","last_active":"2024-04-25T10:04:03.275213+0000","last_peered":"2024-04-25T10:04:03.275213+0000","last_clean":"2024-04-25T10:04:03.275213+0000","last_became_active":"2024-04-25T10:03:55.767120+0000","last_became_peered":"2024-04-25T10:03:55.767120+0000","last_unstale":"2024-04-25T10:04:03.275213+0000","last_undegraded":"2024-04-25T10:04:03.275213+0000","last_fullsized":"2024-04-25T10:04:03.275213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792464+0000","last_change":"2024-04-25T10:04:01.283339+0000","last_active":"2024-04-25T10:04:02.792464+0000","last_peered":"2024-04-25T10:04:02.792464+0000","last_clean":"2024-04-25T10:04:02.792464+0000","last_became_active":"2024-04-25T10:04:01.282887+0000","last_became_peered":"2024-04-25T10:04:01.282887+0000","last_unstale":"2024-04-25T10:04:02.792464+0000","last_undegraded":"2024-04-25T10:04:02.792464+0000","last_fullsized":"2024-04-25T10:04:02.792464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:12.942551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274964+0000","last_change":"2024-04-25T10:03:56.756195+0000","last_active":"2024-04-25T10:04:03.274964+0000","last_peered":"2024-04-25T10:04:03.274964+0000","last_clean":"2024-04-25T10:04:03.274964+0000","last_became_active":"2024-04-25T10:03:56.755888+0000","last_became_peered":"2024-04-25T10:03:56.755888+0000","last_unstale":"2024-04-25T10:04:03.274964+0000","last_undegraded":"2024-04-25T10:04:03.274964+0000","last_fullsized":"2024-04-25T10:04:03.274964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277826+0000","last_change":"2024-04-25T10:03:55.774206+0000","last_active":"2024-04-25T10:04:03.277826+0000","last_peered":"2024-04-25T10:04:03.277826+0000","last_clean":"2024-04-25T10:04:03.277826+0000","last_became_active":"2024-04-25T10:03:55.773820+0000","last_became_peered":"2024-04-25T10:03:55.773820+0000","last_unstale":"2024-04-25T10:04:03.277826+0000","last_undegraded":"2024-04-25T10:04:03.277826+0000","last_fullsized":"2024-04-25T10:04:03.277826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:37.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266562+0000","last_change":"2024-04-25T10:04:01.284399+0000","last_active":"2024-04-25T10:04:03.266562+0000","last_peered":"2024-04-25T10:04:03.266562+0000","last_clean":"2024-04-25T10:04:03.266562+0000","last_became_active":"2024-04-25T10:04:01.283878+0000","last_became_peered":"2024-04-25T10:04:01.283878+0000","last_unstale":"2024-04-25T10:04:03.266562+0000","last_undegraded":"2024-04-25T10:04:03.266562+0000","last_fullsized":"2024-04-25T10:04:03.266562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797072+0000","last_change":"2024-04-25T10:03:56.792726+0000","last_active":"2024-04-25T10:04:02.797072+0000","last_peered":"2024-04-25T10:04:02.797072+0000","last_clean":"2024-04-25T10:04:02.797072+0000","last_became_active":"2024-04-25T10:03:56.792471+0000","last_became_peered":"2024-04-25T10:03:56.792471+0000","last_unstale":"2024-04-25T10:04:02.797072+0000","last_undegraded":"2024-04-25T10:04:02.797072+0000","last_fullsized":"2024-04-25T10:04:02.797072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275057+0000","last_change":"2024-04-25T10:03:55.757369+0000","last_active":"2024-04-25T10:04:03.275057+0000","last_peered":"2024-04-25T10:04:03.275057+0000","last_clean":"2024-04-25T10:04:03.275057+0000","last_became_active":"2024-04-25T10:03:55.756884+0000","last_became_peered":"2024-04-25T10:03:55.756884+0000","last_unstale":"2024-04-25T10:04:03.275057+0000","last_undegraded":"2024-04-25T10:04:03.275057+0000","last_fullsized":"2024-04-25T10:04:03.275057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274691+0000","last_change":"2024-04-25T10:04:00.803156+0000","last_active":"2024-04-25T10:04:03.274691+0000","last_peered":"2024-04-25T10:04:03.274691+0000","last_clean":"2024-04-25T10:04:03.274691+0000","last_became_active":"2024-04-25T10:04:00.802652+0000","last_became_peered":"2024-04-25T10:04:00.802652+0000","last_unstale":"2024-04-25T10:04:03.274691+0000","last_undegraded":"2024-04-25T10:04:03.274691+0000","last_fullsized":"2024-04-25T10:04:03.274691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278393+0000","last_change":"2024-04-25T10:03:56.770389+0000","last_active":"2024-04-25T10:04:03.278393+0000","last_peered":"2024-04-25T10:04:03.278393+0000","last_clean":"2024-04-25T10:04:03.278393+0000","last_became_active":"2024-04-25T10:03:56.769936+0000","last_became_peered":"2024-04-25T10:03:56.769936+0000","last_unstale":"2024-04-25T10:04:03.278393+0000","last_undegraded":"2024-04-25T10:04:03.278393+0000","last_fullsized":"2024-04-25T10:04:03.278393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:45.815606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796171+0000","last_change":"2024-04-25T10:03:55.761355+0000","last_active":"2024-04-25T10:04:02.796171+0000","last_peered":"2024-04-25T10:04:02.796171+0000","last_clean":"2024-04-25T10:04:02.796171+0000","last_became_active":"2024-04-25T10:03:55.759914+0000","last_became_peered":"2024-04-25T10:03:55.759914+0000","last_unstale":"2024-04-25T10:04:02.796171+0000","last_undegraded":"2024-04-25T10:04:02.796171+0000","last_fullsized":"2024-04-25T10:04:02.796171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274995+0000","last_change":"2024-04-25T10:04:00.806848+0000","last_active":"2024-04-25T10:04:03.274995+0000","last_peered":"2024-04-25T10:04:03.274995+0000","last_clean":"2024-04-25T10:04:03.274995+0000","last_became_active":"2024-04-25T10:04:00.805433+0000","last_became_peered":"2024-04-25T10:04:00.805433+0000","last_unstale":"2024-04-25T10:04:03.274995+0000","last_undegraded":"2024-04-25T10:04:03.274995+0000","last_fullsized":"2024-04-25T10:04:03.274995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274628+0000","last_change":"2024-04-25T10:03:56.755931+0000","last_active":"2024-04-25T10:04:03.274628+0000","last_peered":"2024-04-25T10:04:03.274628+0000","last_clean":"2024-04-25T10:04:03.274628+0000","last_became_active":"2024-04-25T10:03:56.755452+0000","last_became_peered":"2024-04-25T10:03:56.755452+0000","last_unstale":"2024-04-25T10:04:03.274628+0000","last_undegraded":"2024-04-25T10:04:03.274628+0000","last_fullsized":"2024-04-25T10:04:03.274628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230585+0000","last_change":"2024-04-25T10:03:55.762333+0000","last_active":"2024-04-25T10:04:03.230585+0000","last_peered":"2024-04-25T10:04:03.230585+0000","last_clean":"2024-04-25T10:04:03.230585+0000","last_became_active":"2024-04-25T10:03:55.758957+0000","last_became_peered":"2024-04-25T10:03:55.758957+0000","last_unstale":"2024-04-25T10:04:03.230585+0000","last_undegraded":"2024-04-25T10:04:03.230585+0000","last_fullsized":"2024-04-25T10:04:03.230585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275382+0000","last_change":"2024-04-25T10:04:00.805357+0000","last_active":"2024-04-25T10:04:03.275382+0000","last_peered":"2024-04-25T10:04:03.275382+0000","last_clean":"2024-04-25T10:04:03.275382+0000","last_became_active":"2024-04-25T10:04:00.804893+0000","last_became_peered":"2024-04-25T10:04:00.804893+0000","last_unstale":"2024-04-25T10:04:03.275382+0000","last_undegraded":"2024-04-25T10:04:03.275382+0000","last_fullsized":"2024-04-25T10:04:03.275382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266268+0000","last_change":"2024-04-25T10:03:56.780512+0000","last_active":"2024-04-25T10:04:03.266268+0000","last_peered":"2024-04-25T10:04:03.266268+0000","last_clean":"2024-04-25T10:04:03.266268+0000","last_became_active":"2024-04-25T10:03:56.779316+0000","last_became_peered":"2024-04-25T10:03:56.779316+0000","last_unstale":"2024-04-25T10:04:03.266268+0000","last_undegraded":"2024-04-25T10:04:03.266268+0000","last_fullsized":"2024-04-25T10:04:03.266268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276680+0000","last_change":"2024-04-25T10:03:55.773928+0000","last_active":"2024-04-25T10:04:03.276680+0000","last_peered":"2024-04-25T10:04:03.276680+0000","last_clean":"2024-04-25T10:04:03.276680+0000","last_became_active":"2024-04-25T10:03:55.773501+0000","last_became_peered":"2024-04-25T10:03:55.773501+0000","last_unstale":"2024-04-25T10:04:03.276680+0000","last_undegraded":"2024-04-25T10:04:03.276680+0000","last_fullsized":"2024-04-25T10:04:03.276680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266794+0000","last_change":"2024-04-25T10:04:01.283753+0000","last_active":"2024-04-25T10:04:03.266794+0000","last_peered":"2024-04-25T10:04:03.266794+0000","last_clean":"2024-04-25T10:04:03.266794+0000","last_became_active":"2024-04-25T10:04:01.283221+0000","last_became_peered":"2024-04-25T10:04:01.283221+0000","last_unstale":"2024-04-25T10:04:03.266794+0000","last_undegraded":"2024-04-25T10:04:03.266794+0000","last_fullsized":"2024-04-25T10:04:03.266794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:18.295693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792932+0000","last_change":"2024-04-25T10:03:56.766943+0000","last_active":"2024-04-25T10:04:02.792932+0000","last_peered":"2024-04-25T10:04:02.792932+0000","last_clean":"2024-04-25T10:04:02.792932+0000","last_became_active":"2024-04-25T10:03:56.766550+0000","last_became_peered":"2024-04-25T10:03:56.766550+0000","last_unstale":"2024-04-25T10:04:02.792932+0000","last_undegraded":"2024-04-25T10:04:02.792932+0000","last_fullsized":"2024-04-25T10:04:02.792932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:05.977869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796601+0000","last_change":"2024-04-25T10:03:55.764614+0000","last_active":"2024-04-25T10:04:02.796601+0000","last_peered":"2024-04-25T10:04:02.796601+0000","last_clean":"2024-04-25T10:04:02.796601+0000","last_became_active":"2024-04-25T10:03:55.763995+0000","last_became_peered":"2024-04-25T10:03:55.763995+0000","last_unstale":"2024-04-25T10:04:02.796601+0000","last_undegraded":"2024-04-25T10:04:02.796601+0000","last_fullsized":"2024-04-25T10:04:02.796601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276800+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:04:03.276800+0000","last_peered":"2024-04-25T10:04:03.276800+0000","last_clean":"2024-04-25T10:04:03.276800+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:04:03.276800+0000","last_undegraded":"2024-04-25T10:04:03.276800+0000","last_fullsized":"2024-04-25T10:04:03.276800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797001+0000","last_change":"2024-04-25T10:04:01.285814+0000","last_active":"2024-04-25T10:04:02.797001+0000","last_peered":"2024-04-25T10:04:02.797001+0000","last_clean":"2024-04-25T10:04:02.797001+0000","last_became_active":"2024-04-25T10:04:01.285361+0000","last_became_peered":"2024-04-25T10:04:01.285361+0000","last_unstale":"2024-04-25T10:04:02.797001+0000","last_undegraded":"2024-04-25T10:04:02.797001+0000","last_fullsized":"2024-04-25T10:04:02.797001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277347+0000","last_change":"2024-04-25T10:03:56.796054+0000","last_active":"2024-04-25T10:04:03.277347+0000","last_peered":"2024-04-25T10:04:03.277347+0000","last_clean":"2024-04-25T10:04:03.277347+0000","last_became_active":"2024-04-25T10:03:56.795756+0000","last_became_peered":"2024-04-25T10:03:56.795756+0000","last_unstale":"2024-04-25T10:04:03.277347+0000","last_undegraded":"2024-04-25T10:04:03.277347+0000","last_fullsized":"2024-04-25T10:04:03.277347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230858+0000","last_change":"2024-04-25T10:03:55.760034+0000","last_active":"2024-04-25T10:04:03.230858+0000","last_peered":"2024-04-25T10:04:03.230858+0000","last_clean":"2024-04-25T10:04:03.230858+0000","last_became_active":"2024-04-25T10:03:55.757148+0000","last_became_peered":"2024-04-25T10:03:55.757148+0000","last_unstale":"2024-04-25T10:04:03.230858+0000","last_undegraded":"2024-04-25T10:04:03.230858+0000","last_fullsized":"2024-04-25T10:04:03.230858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796177+0000","last_change":"2024-04-25T10:04:01.285490+0000","last_active":"2024-04-25T10:04:02.796177+0000","last_peered":"2024-04-25T10:04:02.796177+0000","last_clean":"2024-04-25T10:04:02.796177+0000","last_became_active":"2024-04-25T10:04:01.285082+0000","last_became_peered":"2024-04-25T10:04:01.285082+0000","last_unstale":"2024-04-25T10:04:02.796177+0000","last_undegraded":"2024-04-25T10:04:02.796177+0000","last_fullsized":"2024-04-25T10:04:02.796177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796963+0000","last_change":"2024-04-25T10:03:56.767947+0000","last_active":"2024-04-25T10:04:02.796963+0000","last_peered":"2024-04-25T10:04:02.796963+0000","last_clean":"2024-04-25T10:04:02.796963+0000","last_became_active":"2024-04-25T10:03:56.767392+0000","last_became_peered":"2024-04-25T10:03:56.767392+0000","last_unstale":"2024-04-25T10:04:02.796963+0000","last_undegraded":"2024-04-25T10:04:02.796963+0000","last_fullsized":"2024-04-25T10:04:02.796963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274971+0000","last_change":"2024-04-25T10:03:55.756201+0000","last_active":"2024-04-25T10:04:03.274971+0000","last_peered":"2024-04-25T10:04:03.274971+0000","last_clean":"2024-04-25T10:04:03.274971+0000","last_became_active":"2024-04-25T10:03:55.755298+0000","last_became_peered":"2024-04-25T10:03:55.755298+0000","last_unstale":"2024-04-25T10:04:03.274971+0000","last_undegraded":"2024-04-25T10:04:03.274971+0000","last_fullsized":"2024-04-25T10:04:03.274971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266768+0000","last_change":"2024-04-25T10:04:00.799071+0000","last_active":"2024-04-25T10:04:03.266768+0000","last_peered":"2024-04-25T10:04:03.266768+0000","last_clean":"2024-04-25T10:04:03.266768+0000","last_became_active":"2024-04-25T10:04:00.798641+0000","last_became_peered":"2024-04-25T10:04:00.798641+0000","last_unstale":"2024-04-25T10:04:03.266768+0000","last_undegraded":"2024-04-25T10:04:03.266768+0000","last_fullsized":"2024-04-25T10:04:03.266768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277674+0000","last_change":"2024-04-25T10:03:56.794134+0000","last_active":"2024-04-25T10:04:03.277674+0000","last_peered":"2024-04-25T10:04:03.277674+0000","last_clean":"2024-04-25T10:04:03.277674+0000","last_became_active":"2024-04-25T10:03:56.793845+0000","last_became_peered":"2024-04-25T10:03:56.793845+0000","last_unstale":"2024-04-25T10:04:03.277674+0000","last_undegraded":"2024-04-25T10:04:03.277674+0000","last_fullsized":"2024-04-25T10:04:03.277674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230962+0000","last_change":"2024-04-25T10:03:55.758720+0000","last_active":"2024-04-25T10:04:03.230962+0000","last_peered":"2024-04-25T10:04:03.230962+0000","last_clean":"2024-04-25T10:04:03.230962+0000","last_became_active":"2024-04-25T10:03:55.758417+0000","last_became_peered":"2024-04-25T10:03:55.758417+0000","last_unstale":"2024-04-25T10:04:03.230962+0000","last_undegraded":"2024-04-25T10:04:03.230962+0000","last_fullsized":"2024-04-25T10:04:03.230962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795441+0000","last_change":"2024-04-25T10:04:01.285580+0000","last_active":"2024-04-25T10:04:02.795441+0000","last_peered":"2024-04-25T10:04:02.795441+0000","last_clean":"2024-04-25T10:04:02.795441+0000","last_became_active":"2024-04-25T10:04:01.285212+0000","last_became_peered":"2024-04-25T10:04:01.285212+0000","last_unstale":"2024-04-25T10:04:02.795441+0000","last_undegraded":"2024-04-25T10:04:02.795441+0000","last_fullsized":"2024-04-25T10:04:02.795441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277394+0000","last_change":"2024-04-25T10:03:56.787338+0000","last_active":"2024-04-25T10:04:03.277394+0000","last_peered":"2024-04-25T10:04:03.277394+0000","last_clean":"2024-04-25T10:04:03.277394+0000","last_became_active":"2024-04-25T10:03:56.787066+0000","last_became_peered":"2024-04-25T10:03:56.787066+0000","last_unstale":"2024-04-25T10:04:03.277394+0000","last_undegraded":"2024-04-25T10:04:03.277394+0000","last_fullsized":"2024-04-25T10:04:03.277394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278632+0000","last_change":"2024-04-25T10:03:55.755120+0000","last_active":"2024-04-25T10:04:03.278632+0000","last_peered":"2024-04-25T10:04:03.278632+0000","last_clean":"2024-04-25T10:04:03.278632+0000","last_became_active":"2024-04-25T10:03:55.754636+0000","last_became_peered":"2024-04-25T10:03:55.754636+0000","last_unstale":"2024-04-25T10:04:03.278632+0000","last_undegraded":"2024-04-25T10:04:03.278632+0000","last_fullsized":"2024-04-25T10:04:03.278632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:44.495603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276603+0000","last_change":"2024-04-25T10:04:00.808408+0000","last_active":"2024-04-25T10:04:03.276603+0000","last_peered":"2024-04-25T10:04:03.276603+0000","last_clean":"2024-04-25T10:04:03.276603+0000","last_became_active":"2024-04-25T10:04:00.808024+0000","last_became_peered":"2024-04-25T10:04:00.808024+0000","last_unstale":"2024-04-25T10:04:03.276603+0000","last_undegraded":"2024-04-25T10:04:03.276603+0000","last_fullsized":"2024-04-25T10:04:03.276603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277668+0000","last_change":"2024-04-25T10:03:56.783068+0000","last_active":"2024-04-25T10:04:03.277668+0000","last_peered":"2024-04-25T10:04:03.277668+0000","last_clean":"2024-04-25T10:04:03.277668+0000","last_became_active":"2024-04-25T10:03:56.782782+0000","last_became_peered":"2024-04-25T10:03:56.782782+0000","last_unstale":"2024-04-25T10:04:03.277668+0000","last_undegraded":"2024-04-25T10:04:03.277668+0000","last_fullsized":"2024-04-25T10:04:03.277668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230449+0000","last_change":"2024-04-25T10:03:55.764472+0000","last_active":"2024-04-25T10:04:03.230449+0000","last_peered":"2024-04-25T10:04:03.230449+0000","last_clean":"2024-04-25T10:04:03.230449+0000","last_became_active":"2024-04-25T10:03:55.763968+0000","last_became_peered":"2024-04-25T10:03:55.763968+0000","last_unstale":"2024-04-25T10:04:03.230449+0000","last_undegraded":"2024-04-25T10:04:03.230449+0000","last_fullsized":"2024-04-25T10:04:03.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266626+0000","last_change":"2024-04-25T10:04:00.807342+0000","last_active":"2024-04-25T10:04:03.266626+0000","last_peered":"2024-04-25T10:04:03.266626+0000","last_clean":"2024-04-25T10:04:03.266626+0000","last_became_active":"2024-04-25T10:04:00.806899+0000","last_became_peered":"2024-04-25T10:04:00.806899+0000","last_unstale":"2024-04-25T10:04:03.266626+0000","last_undegraded":"2024-04-25T10:04:03.266626+0000","last_fullsized":"2024-04-25T10:04:03.266626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797285+0000","last_change":"2024-04-25T10:03:56.759704+0000","last_active":"2024-04-25T10:04:02.797285+0000","last_peered":"2024-04-25T10:04:02.797285+0000","last_clean":"2024-04-25T10:04:02.797285+0000","last_became_active":"2024-04-25T10:03:56.758730+0000","last_became_peered":"2024-04-25T10:03:56.758730+0000","last_unstale":"2024-04-25T10:04:02.797285+0000","last_undegraded":"2024-04-25T10:04:02.797285+0000","last_fullsized":"2024-04-25T10:04:02.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796361+0000","last_change":"2024-04-25T10:03:55.753914+0000","last_active":"2024-04-25T10:04:02.796361+0000","last_peered":"2024-04-25T10:04:02.796361+0000","last_clean":"2024-04-25T10:04:02.796361+0000","last_became_active":"2024-04-25T10:03:55.752892+0000","last_became_peered":"2024-04-25T10:03:55.752892+0000","last_unstale":"2024-04-25T10:04:02.796361+0000","last_undegraded":"2024-04-25T10:04:02.796361+0000","last_fullsized":"2024-04-25T10:04:02.796361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793148+0000","last_change":"2024-04-25T10:04:01.283999+0000","last_active":"2024-04-25T10:04:02.793148+0000","last_peered":"2024-04-25T10:04:02.793148+0000","last_clean":"2024-04-25T10:04:02.793148+0000","last_became_active":"2024-04-25T10:04:01.283582+0000","last_became_peered":"2024-04-25T10:04:01.283582+0000","last_unstale":"2024-04-25T10:04:02.793148+0000","last_undegraded":"2024-04-25T10:04:02.793148+0000","last_fullsized":"2024-04-25T10:04:02.793148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:49.714373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277636+0000","last_change":"2024-04-25T10:03:56.783331+0000","last_active":"2024-04-25T10:04:03.277636+0000","last_peered":"2024-04-25T10:04:03.277636+0000","last_clean":"2024-04-25T10:04:03.277636+0000","last_became_active":"2024-04-25T10:03:56.782448+0000","last_became_peered":"2024-04-25T10:03:56.782448+0000","last_unstale":"2024-04-25T10:04:03.277636+0000","last_undegraded":"2024-04-25T10:04:03.277636+0000","last_fullsized":"2024-04-25T10:04:03.277636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:00.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796126+0000","last_change":"2024-04-25T10:03:55.761416+0000","last_active":"2024-04-25T10:04:02.796126+0000","last_peered":"2024-04-25T10:04:02.796126+0000","last_clean":"2024-04-25T10:04:02.796126+0000","last_became_active":"2024-04-25T10:03:55.760610+0000","last_became_peered":"2024-04-25T10:03:55.760610+0000","last_unstale":"2024-04-25T10:04:02.796126+0000","last_undegraded":"2024-04-25T10:04:02.796126+0000","last_fullsized":"2024-04-25T10:04:02.796126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793073+0000","last_change":"2024-04-25T10:04:01.287382+0000","last_active":"2024-04-25T10:04:02.793073+0000","last_peered":"2024-04-25T10:04:02.793073+0000","last_clean":"2024-04-25T10:04:02.793073+0000","last_became_active":"2024-04-25T10:04:01.285777+0000","last_became_peered":"2024-04-25T10:04:01.285777+0000","last_unstale":"2024-04-25T10:04:02.793073+0000","last_undegraded":"2024-04-25T10:04:02.793073+0000","last_fullsized":"2024-04-25T10:04:02.793073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:21.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266469+0000","last_change":"2024-04-25T10:03:56.772446+0000","last_active":"2024-04-25T10:04:03.266469+0000","last_peered":"2024-04-25T10:04:03.266469+0000","last_clean":"2024-04-25T10:04:03.266469+0000","last_became_active":"2024-04-25T10:03:56.772029+0000","last_became_peered":"2024-04-25T10:03:56.772029+0000","last_unstale":"2024-04-25T10:04:03.266469+0000","last_undegraded":"2024-04-25T10:04:03.266469+0000","last_fullsized":"2024-04-25T10:04:03.266469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266991+0000","last_change":"2024-04-25T10:03:55.747987+0000","last_active":"2024-04-25T10:04:03.266991+0000","last_peered":"2024-04-25T10:04:03.266991+0000","last_clean":"2024-04-25T10:04:03.266991+0000","last_became_active":"2024-04-25T10:03:55.747631+0000","last_became_peered":"2024-04-25T10:03:55.747631+0000","last_unstale":"2024-04-25T10:04:03.266991+0000","last_undegraded":"2024-04-25T10:04:03.266991+0000","last_fullsized":"2024-04-25T10:04:03.266991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:44.719385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796909+0000","last_change":"2024-04-25T10:04:01.286318+0000","last_active":"2024-04-25T10:04:02.796909+0000","last_peered":"2024-04-25T10:04:02.796909+0000","last_clean":"2024-04-25T10:04:02.796909+0000","last_became_active":"2024-04-25T10:04:01.285907+0000","last_became_peered":"2024-04-25T10:04:01.285907+0000","last_unstale":"2024-04-25T10:04:02.796909+0000","last_undegraded":"2024-04-25T10:04:02.796909+0000","last_fullsized":"2024-04-25T10:04:02.796909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277610+0000","last_change":"2024-04-25T10:03:56.781752+0000","last_active":"2024-04-25T10:04:03.277610+0000","last_peered":"2024-04-25T10:04:03.277610+0000","last_clean":"2024-04-25T10:04:03.277610+0000","last_became_active":"2024-04-25T10:03:56.781491+0000","last_became_peered":"2024-04-25T10:03:56.781491+0000","last_unstale":"2024-04-25T10:04:03.277610+0000","last_undegraded":"2024-04-25T10:04:03.277610+0000","last_fullsized":"2024-04-25T10:04:03.277610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:11.993610+0000","last_change":"2024-04-25T10:03:55.766431+0000","last_active":"2024-04-25T10:04:11.993610+0000","last_peered":"2024-04-25T10:04:11.993610+0000","last_clean":"2024-04-25T10:04:11.993610+0000","last_became_active":"2024-04-25T10:03:55.761777+0000","last_became_peered":"2024-04-25T10:03:55.761777+0000","last_unstale":"2024-04-25T10:04:11.993610+0000","last_undegraded":"2024-04-25T10:04:11.993610+0000","last_fullsized":"2024-04-25T10:04:11.993610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275114+0000","last_change":"2024-04-25T10:04:00.801843+0000","last_active":"2024-04-25T10:04:03.275114+0000","last_peered":"2024-04-25T10:04:03.275114+0000","last_clean":"2024-04-25T10:04:03.275114+0000","last_became_active":"2024-04-25T10:04:00.801403+0000","last_became_peered":"2024-04-25T10:04:00.801403+0000","last_unstale":"2024-04-25T10:04:03.275114+0000","last_undegraded":"2024-04-25T10:04:03.275114+0000","last_fullsized":"2024-04-25T10:04:03.275114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277428+0000","last_change":"2024-04-25T10:03:56.782319+0000","last_active":"2024-04-25T10:04:03.277428+0000","last_peered":"2024-04-25T10:04:03.277428+0000","last_clean":"2024-04-25T10:04:03.277428+0000","last_became_active":"2024-04-25T10:03:56.781988+0000","last_became_peered":"2024-04-25T10:03:56.781988+0000","last_unstale":"2024-04-25T10:04:03.277428+0000","last_undegraded":"2024-04-25T10:04:03.277428+0000","last_fullsized":"2024-04-25T10:04:03.277428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274941+0000","last_change":"2024-04-25T10:03:55.767225+0000","last_active":"2024-04-25T10:04:03.274941+0000","last_peered":"2024-04-25T10:04:03.274941+0000","last_clean":"2024-04-25T10:04:03.274941+0000","last_became_active":"2024-04-25T10:03:55.766947+0000","last_became_peered":"2024-04-25T10:03:55.766947+0000","last_unstale":"2024-04-25T10:04:03.274941+0000","last_undegraded":"2024-04-25T10:04:03.274941+0000","last_fullsized":"2024-04-25T10:04:03.274941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278424+0000","last_change":"2024-04-25T10:04:00.797613+0000","last_active":"2024-04-25T10:04:03.278424+0000","last_peered":"2024-04-25T10:04:03.278424+0000","last_clean":"2024-04-25T10:04:03.278424+0000","last_became_active":"2024-04-25T10:04:00.797207+0000","last_became_peered":"2024-04-25T10:04:00.797207+0000","last_unstale":"2024-04-25T10:04:03.278424+0000","last_undegraded":"2024-04-25T10:04:03.278424+0000","last_fullsized":"2024-04-25T10:04:03.278424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266976+0000","last_change":"2024-04-25T10:03:56.774964+0000","last_active":"2024-04-25T10:04:03.266976+0000","last_peered":"2024-04-25T10:04:03.266976+0000","last_clean":"2024-04-25T10:04:03.266976+0000","last_became_active":"2024-04-25T10:03:56.770623+0000","last_became_peered":"2024-04-25T10:03:56.770623+0000","last_unstale":"2024-04-25T10:04:03.266976+0000","last_undegraded":"2024-04-25T10:04:03.266976+0000","last_fullsized":"2024-04-25T10:04:03.266976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797269+0000","last_change":"2024-04-25T10:03:55.772282+0000","last_active":"2024-04-25T10:04:02.797269+0000","last_peered":"2024-04-25T10:04:02.797269+0000","last_clean":"2024-04-25T10:04:02.797269+0000","last_became_active":"2024-04-25T10:03:55.771984+0000","last_became_peered":"2024-04-25T10:03:55.771984+0000","last_unstale":"2024-04-25T10:04:02.797269+0000","last_undegraded":"2024-04-25T10:04:02.797269+0000","last_fullsized":"2024-04-25T10:04:02.797269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792604+0000","last_change":"2024-04-25T10:04:00.802185+0000","last_active":"2024-04-25T10:04:02.792604+0000","last_peered":"2024-04-25T10:04:02.792604+0000","last_clean":"2024-04-25T10:04:02.792604+0000","last_became_active":"2024-04-25T10:04:00.801810+0000","last_became_peered":"2024-04-25T10:04:00.801810+0000","last_unstale":"2024-04-25T10:04:02.792604+0000","last_undegraded":"2024-04-25T10:04:02.792604+0000","last_fullsized":"2024-04-25T10:04:02.792604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:47.336597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797055+0000","last_change":"2024-04-25T10:03:56.786962+0000","last_active":"2024-04-25T10:04:02.797055+0000","last_peered":"2024-04-25T10:04:02.797055+0000","last_clean":"2024-04-25T10:04:02.797055+0000","last_became_active":"2024-04-25T10:03:56.786671+0000","last_became_peered":"2024-04-25T10:03:56.786671+0000","last_unstale":"2024-04-25T10:04:02.797055+0000","last_undegraded":"2024-04-25T10:04:02.797055+0000","last_fullsized":"2024-04-25T10:04:02.797055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796832+0000","last_change":"2024-04-25T10:03:55.769399+0000","last_active":"2024-04-25T10:04:02.796832+0000","last_peered":"2024-04-25T10:04:02.796832+0000","last_clean":"2024-04-25T10:04:02.796832+0000","last_became_active":"2024-04-25T10:03:55.769076+0000","last_became_peered":"2024-04-25T10:03:55.769076+0000","last_unstale":"2024-04-25T10:04:02.796832+0000","last_undegraded":"2024-04-25T10:04:02.796832+0000","last_fullsized":"2024-04-25T10:04:02.796832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792653+0000","last_change":"2024-04-25T10:04:01.284799+0000","last_active":"2024-04-25T10:04:02.792653+0000","last_peered":"2024-04-25T10:04:02.792653+0000","last_clean":"2024-04-25T10:04:02.792653+0000","last_became_active":"2024-04-25T10:04:01.283596+0000","last_became_peered":"2024-04-25T10:04:01.283596+0000","last_unstale":"2024-04-25T10:04:02.792653+0000","last_undegraded":"2024-04-25T10:04:02.792653+0000","last_fullsized":"2024-04-25T10:04:02.792653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:41.435837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266621+0000","last_change":"2024-04-25T10:04:01.286375+0000","last_active":"2024-04-25T10:04:03.266621+0000","last_peered":"2024-04-25T10:04:03.266621+0000","last_clean":"2024-04-25T10:04:03.266621+0000","last_became_active":"2024-04-25T10:04:01.285832+0000","last_became_peered":"2024-04-25T10:04:01.285832+0000","last_unstale":"2024-04-25T10:04:03.266621+0000","last_undegraded":"2024-04-25T10:04:03.266621+0000","last_fullsized":"2024-04-25T10:04:03.266621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274484+0000","last_change":"2024-04-25T10:03:56.760165+0000","last_active":"2024-04-25T10:04:03.274484+0000","last_peered":"2024-04-25T10:04:03.274484+0000","last_clean":"2024-04-25T10:04:03.274484+0000","last_became_active":"2024-04-25T10:03:56.759886+0000","last_became_peered":"2024-04-25T10:03:56.759886+0000","last_unstale":"2024-04-25T10:04:03.274484+0000","last_undegraded":"2024-04-25T10:04:03.274484+0000","last_fullsized":"2024-04-25T10:04:03.274484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795508+0000","last_change":"2024-04-25T10:03:55.759342+0000","last_active":"2024-04-25T10:04:02.795508+0000","last_peered":"2024-04-25T10:04:02.795508+0000","last_clean":"2024-04-25T10:04:02.795508+0000","last_became_active":"2024-04-25T10:03:55.758902+0000","last_became_peered":"2024-04-25T10:03:55.758902+0000","last_unstale":"2024-04-25T10:04:02.795508+0000","last_undegraded":"2024-04-25T10:04:02.795508+0000","last_fullsized":"2024-04-25T10:04:02.795508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796847+0000","last_change":"2024-04-25T10:04:00.800413+0000","last_active":"2024-04-25T10:04:02.796847+0000","last_peered":"2024-04-25T10:04:02.796847+0000","last_clean":"2024-04-25T10:04:02.796847+0000","last_became_active":"2024-04-25T10:04:00.800005+0000","last_became_peered":"2024-04-25T10:04:00.800005+0000","last_unstale":"2024-04-25T10:04:02.796847+0000","last_undegraded":"2024-04-25T10:04:02.796847+0000","last_fullsized":"2024-04-25T10:04:02.796847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792578+0000","last_change":"2024-04-25T10:03:56.754790+0000","last_active":"2024-04-25T10:04:02.792578+0000","last_peered":"2024-04-25T10:04:02.792578+0000","last_clean":"2024-04-25T10:04:02.792578+0000","last_became_active":"2024-04-25T10:03:56.753655+0000","last_became_peered":"2024-04-25T10:03:56.753655+0000","last_unstale":"2024-04-25T10:04:02.792578+0000","last_undegraded":"2024-04-25T10:04:02.792578+0000","last_fullsized":"2024-04-25T10:04:02.792578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:39.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792770+0000","last_change":"2024-04-25T10:03:55.761647+0000","last_active":"2024-04-25T10:04:02.792770+0000","last_peered":"2024-04-25T10:04:02.792770+0000","last_clean":"2024-04-25T10:04:02.792770+0000","last_became_active":"2024-04-25T10:03:55.761495+0000","last_became_peered":"2024-04-25T10:03:55.761495+0000","last_unstale":"2024-04-25T10:04:02.792770+0000","last_undegraded":"2024-04-25T10:04:02.792770+0000","last_fullsized":"2024-04-25T10:04:02.792770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:24.436084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796295+0000","last_change":"2024-04-25T10:03:55.765920+0000","last_active":"2024-04-25T10:04:02.796295+0000","last_peered":"2024-04-25T10:04:02.796295+0000","last_clean":"2024-04-25T10:04:02.796295+0000","last_became_active":"2024-04-25T10:03:55.765626+0000","last_became_peered":"2024-04-25T10:03:55.765626+0000","last_unstale":"2024-04-25T10:04:02.796295+0000","last_undegraded":"2024-04-25T10:04:02.796295+0000","last_fullsized":"2024-04-25T10:04:02.796295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266888+0000","last_change":"2024-04-25T10:03:56.780813+0000","last_active":"2024-04-25T10:04:03.266888+0000","last_peered":"2024-04-25T10:04:03.266888+0000","last_clean":"2024-04-25T10:04:03.266888+0000","last_became_active":"2024-04-25T10:03:56.774414+0000","last_became_peered":"2024-04-25T10:03:56.774414+0000","last_unstale":"2024-04-25T10:04:03.266888+0000","last_undegraded":"2024-04-25T10:04:03.266888+0000","last_fullsized":"2024-04-25T10:04:03.266888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230710+0000","last_change":"2024-04-25T10:04:00.805747+0000","last_active":"2024-04-25T10:04:03.230710+0000","last_peered":"2024-04-25T10:04:03.230710+0000","last_clean":"2024-04-25T10:04:03.230710+0000","last_became_active":"2024-04-25T10:04:00.804310+0000","last_became_peered":"2024-04-25T10:04:00.804310+0000","last_unstale":"2024-04-25T10:04:03.230710+0000","last_undegraded":"2024-04-25T10:04:03.230710+0000","last_fullsized":"2024-04-25T10:04:03.230710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:05.811588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793053+0000","last_change":"2024-04-25T10:03:55.768990+0000","last_active":"2024-04-25T10:04:02.793053+0000","last_peered":"2024-04-25T10:04:02.793053+0000","last_clean":"2024-04-25T10:04:02.793053+0000","last_became_active":"2024-04-25T10:03:55.767518+0000","last_became_peered":"2024-04-25T10:03:55.767518+0000","last_unstale":"2024-04-25T10:04:02.793053+0000","last_undegraded":"2024-04-25T10:04:02.793053+0000","last_fullsized":"2024-04-25T10:04:02.793053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:11.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277092+0000","last_change":"2024-04-25T10:03:56.770753+0000","last_active":"2024-04-25T10:04:03.277092+0000","last_peered":"2024-04-25T10:04:03.277092+0000","last_clean":"2024-04-25T10:04:03.277092+0000","last_became_active":"2024-04-25T10:03:56.770399+0000","last_became_peered":"2024-04-25T10:03:56.770399+0000","last_unstale":"2024-04-25T10:04:03.277092+0000","last_undegraded":"2024-04-25T10:04:03.277092+0000","last_fullsized":"2024-04-25T10:04:03.277092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:12.633520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793274+0000","last_change":"2024-04-25T10:04:00.810546+0000","last_active":"2024-04-25T10:04:02.793274+0000","last_peered":"2024-04-25T10:04:02.793274+0000","last_clean":"2024-04-25T10:04:02.793274+0000","last_became_active":"2024-04-25T10:04:00.809965+0000","last_became_peered":"2024-04-25T10:04:00.809965+0000","last_unstale":"2024-04-25T10:04:02.793274+0000","last_undegraded":"2024-04-25T10:04:02.793274+0000","last_fullsized":"2024-04-25T10:04:02.793274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:25.609318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796086+0000","last_change":"2024-04-25T10:03:56.759410+0000","last_active":"2024-04-25T10:04:02.796086+0000","last_peered":"2024-04-25T10:04:02.796086+0000","last_clean":"2024-04-25T10:04:02.796086+0000","last_became_active":"2024-04-25T10:03:56.759063+0000","last_became_peered":"2024-04-25T10:03:56.759063+0000","last_unstale":"2024-04-25T10:04:02.796086+0000","last_undegraded":"2024-04-25T10:04:02.796086+0000","last_fullsized":"2024-04-25T10:04:02.796086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230579+0000","last_change":"2024-04-25T10:03:56.775592+0000","last_active":"2024-04-25T10:04:03.230579+0000","last_peered":"2024-04-25T10:04:03.230579+0000","last_clean":"2024-04-25T10:04:03.230579+0000","last_became_active":"2024-04-25T10:03:56.775251+0000","last_became_peered":"2024-04-25T10:03:56.775251+0000","last_unstale":"2024-04-25T10:04:03.230579+0000","last_undegraded":"2024-04-25T10:04:03.230579+0000","last_fullsized":"2024-04-25T10:04:03.230579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796019+0000","last_change":"2024-04-25T10:03:56.767847+0000","last_active":"2024-04-25T10:04:02.796019+0000","last_peered":"2024-04-25T10:04:02.796019+0000","last_clean":"2024-04-25T10:04:02.796019+0000","last_became_active":"2024-04-25T10:03:56.767543+0000","last_became_peered":"2024-04-25T10:03:56.767543+0000","last_unstale":"2024-04-25T10:04:02.796019+0000","last_undegraded":"2024-04-25T10:04:02.796019+0000","last_fullsized":"2024-04-25T10:04:02.796019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266882+0000","last_change":"2024-04-25T10:03:56.767650+0000","last_active":"2024-04-25T10:04:03.266882+0000","last_peered":"2024-04-25T10:04:03.266882+0000","last_clean":"2024-04-25T10:04:03.266882+0000","last_became_active":"2024-04-25T10:03:56.767362+0000","last_became_peered":"2024-04-25T10:03:56.767362+0000","last_unstale":"2024-04-25T10:04:03.266882+0000","last_undegraded":"2024-04-25T10:04:03.266882+0000","last_fullsized":"2024-04-25T10:04:03.266882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793258+0000","last_change":"2024-04-25T10:03:56.776617+0000","last_active":"2024-04-25T10:04:02.793258+0000","last_peered":"2024-04-25T10:04:02.793258+0000","last_clean":"2024-04-25T10:04:02.793258+0000","last_became_active":"2024-04-25T10:03:56.776219+0000","last_became_peered":"2024-04-25T10:03:56.776219+0000","last_unstale":"2024-04-25T10:04:02.793258+0000","last_undegraded":"2024-04-25T10:04:02.793258+0000","last_fullsized":"2024-04-25T10:04:02.793258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.744805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274831+0000","last_change":"2024-04-25T10:03:56.759677+0000","last_active":"2024-04-25T10:04:03.274831+0000","last_peered":"2024-04-25T10:04:03.274831+0000","last_clean":"2024-04-25T10:04:03.274831+0000","last_became_active":"2024-04-25T10:03:56.759375+0000","last_became_peered":"2024-04-25T10:03:56.759375+0000","last_unstale":"2024-04-25T10:04:03.274831+0000","last_undegraded":"2024-04-25T10:04:03.274831+0000","last_fullsized":"2024-04-25T10:04:03.274831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797482+0000","last_change":"2024-04-25T10:03:56.780048+0000","last_active":"2024-04-25T10:04:02.797482+0000","last_peered":"2024-04-25T10:04:02.797482+0000","last_clean":"2024-04-25T10:04:02.797482+0000","last_became_active":"2024-04-25T10:03:56.779166+0000","last_became_peered":"2024-04-25T10:03:56.779166+0000","last_unstale":"2024-04-25T10:04:02.797482+0000","last_undegraded":"2024-04-25T10:04:02.797482+0000","last_fullsized":"2024-04-25T10:04:02.797482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793245+0000","last_change":"2024-04-25T10:03:56.772146+0000","last_active":"2024-04-25T10:04:02.793245+0000","last_peered":"2024-04-25T10:04:02.793245+0000","last_clean":"2024-04-25T10:04:02.793245+0000","last_became_active":"2024-04-25T10:03:56.770243+0000","last_became_peered":"2024-04-25T10:03:56.770243+0000","last_unstale":"2024-04-25T10:04:02.793245+0000","last_undegraded":"2024-04-25T10:04:02.793245+0000","last_fullsized":"2024-04-25T10:04:02.793245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:14.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795467+0000","last_change":"2024-04-25T10:03:56.771691+0000","last_active":"2024-04-25T10:04:02.795467+0000","last_peered":"2024-04-25T10:04:02.795467+0000","last_clean":"2024-04-25T10:04:02.795467+0000","last_became_active":"2024-04-25T10:03:56.771315+0000","last_became_peered":"2024-04-25T10:03:56.771315+0000","last_unstale":"2024-04-25T10:04:02.795467+0000","last_undegraded":"2024-04-25T10:04:02.795467+0000","last_fullsized":"2024-04-25T10:04:02.795467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792766+0000","last_change":"2024-04-25T10:03:56.776434+0000","last_active":"2024-04-25T10:04:02.792766+0000","last_peered":"2024-04-25T10:04:02.792766+0000","last_clean":"2024-04-25T10:04:02.792766+0000","last_became_active":"2024-04-25T10:03:56.776138+0000","last_became_peered":"2024-04-25T10:03:56.776138+0000","last_unstale":"2024-04-25T10:04:02.792766+0000","last_undegraded":"2024-04-25T10:04:02.792766+0000","last_fullsized":"2024-04-25T10:04:02.792766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796045+0000","last_change":"2024-04-25T10:03:56.787227+0000","last_active":"2024-04-25T10:04:02.796045+0000","last_peered":"2024-04-25T10:04:02.796045+0000","last_clean":"2024-04-25T10:04:02.796045+0000","last_became_active":"2024-04-25T10:03:56.786628+0000","last_became_peered":"2024-04-25T10:03:56.786628+0000","last_unstale":"2024-04-25T10:04:02.796045+0000","last_undegraded":"2024-04-25T10:04:02.796045+0000","last_fullsized":"2024-04-25T10:04:02.796045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266770+0000","last_change":"2024-04-25T10:03:56.781525+0000","last_active":"2024-04-25T10:04:03.266770+0000","last_peered":"2024-04-25T10:04:03.266770+0000","last_clean":"2024-04-25T10:04:03.266770+0000","last_became_active":"2024-04-25T10:03:56.781186+0000","last_became_peered":"2024-04-25T10:03:56.781186+0000","last_unstale":"2024-04-25T10:04:03.266770+0000","last_undegraded":"2024-04-25T10:04:03.266770+0000","last_fullsized":"2024-04-25T10:04:03.266770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796586+0000","last_change":"2024-04-25T10:03:56.772909+0000","last_active":"2024-04-25T10:04:02.796586+0000","last_peered":"2024-04-25T10:04:02.796586+0000","last_clean":"2024-04-25T10:04:02.796586+0000","last_became_active":"2024-04-25T10:03:56.772651+0000","last_became_peered":"2024-04-25T10:03:56.772651+0000","last_unstale":"2024-04-25T10:04:02.796586+0000","last_undegraded":"2024-04-25T10:04:02.796586+0000","last_fullsized":"2024-04-25T10:04:02.796586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277718+0000","last_change":"2024-04-25T10:03:56.786914+0000","last_active":"2024-04-25T10:04:03.277718+0000","last_peered":"2024-04-25T10:04:03.277718+0000","last_clean":"2024-04-25T10:04:03.277718+0000","last_became_active":"2024-04-25T10:03:56.786624+0000","last_became_peered":"2024-04-25T10:03:56.786624+0000","last_unstale":"2024-04-25T10:04:03.277718+0000","last_undegraded":"2024-04-25T10:04:03.277718+0000","last_fullsized":"2024-04-25T10:04:03.277718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230883+0000","last_change":"2024-04-25T10:03:56.756870+0000","last_active":"2024-04-25T10:04:03.230883+0000","last_peered":"2024-04-25T10:04:03.230883+0000","last_clean":"2024-04-25T10:04:03.230883+0000","last_became_active":"2024-04-25T10:03:56.756588+0000","last_became_peered":"2024-04-25T10:03:56.756588+0000","last_unstale":"2024-04-25T10:04:03.230883+0000","last_undegraded":"2024-04-25T10:04:03.230883+0000","last_fullsized":"2024-04-25T10:04:03.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797271+0000","last_change":"2024-04-25T10:03:56.787720+0000","last_active":"2024-04-25T10:04:02.797271+0000","last_peered":"2024-04-25T10:04:02.797271+0000","last_clean":"2024-04-25T10:04:02.797271+0000","last_became_active":"2024-04-25T10:03:56.786712+0000","last_became_peered":"2024-04-25T10:03:56.786712+0000","last_unstale":"2024-04-25T10:04:02.797271+0000","last_undegraded":"2024-04-25T10:04:02.797271+0000","last_fullsized":"2024-04-25T10:04:02.797271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795363+0000","last_change":"2024-04-25T10:03:56.772050+0000","last_active":"2024-04-25T10:04:02.795363+0000","last_peered":"2024-04-25T10:04:02.795363+0000","last_clean":"2024-04-25T10:04:02.795363+0000","last_became_active":"2024-04-25T10:03:56.771788+0000","last_became_peered":"2024-04-25T10:03:56.771788+0000","last_unstale":"2024-04-25T10:04:02.795363+0000","last_undegraded":"2024-04-25T10:04:02.795363+0000","last_fullsized":"2024-04-25T10:04:02.795363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274557+0000","last_change":"2024-04-25T10:03:56.776805+0000","last_active":"2024-04-25T10:04:03.274557+0000","last_peered":"2024-04-25T10:04:03.274557+0000","last_clean":"2024-04-25T10:04:03.274557+0000","last_became_active":"2024-04-25T10:03:56.776521+0000","last_became_peered":"2024-04-25T10:03:56.776521+0000","last_unstale":"2024-04-25T10:04:03.274557+0000","last_undegraded":"2024-04-25T10:04:03.274557+0000","last_fullsized":"2024-04-25T10:04:03.274557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266435+0000","last_change":"2024-04-25T10:03:56.756971+0000","last_active":"2024-04-25T10:04:03.266435+0000","last_peered":"2024-04-25T10:04:03.266435+0000","last_clean":"2024-04-25T10:04:03.266435+0000","last_became_active":"2024-04-25T10:03:56.756615+0000","last_became_peered":"2024-04-25T10:03:56.756615+0000","last_unstale":"2024-04-25T10:04:03.266435+0000","last_undegraded":"2024-04-25T10:04:03.266435+0000","last_fullsized":"2024-04-25T10:04:03.266435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:37.191982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792947+0000","last_change":"2024-04-25T10:03:56.764011+0000","last_active":"2024-04-25T10:04:02.792947+0000","last_peered":"2024-04-25T10:04:02.792947+0000","last_clean":"2024-04-25T10:04:02.792947+0000","last_became_active":"2024-04-25T10:03:56.759567+0000","last_became_peered":"2024-04-25T10:03:56.759567+0000","last_unstale":"2024-04-25T10:04:02.792947+0000","last_undegraded":"2024-04-25T10:04:02.792947+0000","last_fullsized":"2024-04-25T10:04:02.792947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:44.595374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277339+0000","last_change":"2024-04-25T10:03:56.770314+0000","last_active":"2024-04-25T10:04:03.277339+0000","last_peered":"2024-04-25T10:04:03.277339+0000","last_clean":"2024-04-25T10:04:03.277339+0000","last_became_active":"2024-04-25T10:03:56.769983+0000","last_became_peered":"2024-04-25T10:03:56.769983+0000","last_unstale":"2024-04-25T10:04:03.277339+0000","last_undegraded":"2024-04-25T10:04:03.277339+0000","last_fullsized":"2024-04-25T10:04:03.277339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797467+0000","last_change":"2024-04-25T10:03:56.776383+0000","last_active":"2024-04-25T10:04:02.797467+0000","last_peered":"2024-04-25T10:04:02.797467+0000","last_clean":"2024-04-25T10:04:02.797467+0000","last_became_active":"2024-04-25T10:03:56.775871+0000","last_became_peered":"2024-04-25T10:03:56.775871+0000","last_unstale":"2024-04-25T10:04:02.797467+0000","last_undegraded":"2024-04-25T10:04:02.797467+0000","last_fullsized":"2024-04-25T10:04:02.797467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797420+0000","last_change":"2024-04-25T10:03:56.767888+0000","last_active":"2024-04-25T10:04:02.797420+0000","last_peered":"2024-04-25T10:04:02.797420+0000","last_clean":"2024-04-25T10:04:02.797420+0000","last_became_active":"2024-04-25T10:03:56.767620+0000","last_became_peered":"2024-04-25T10:03:56.767620+0000","last_unstale":"2024-04-25T10:04:02.797420+0000","last_undegraded":"2024-04-25T10:04:02.797420+0000","last_fullsized":"2024-04-25T10:04:02.797420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277564+0000","last_change":"2024-04-25T10:03:56.796106+0000","last_active":"2024-04-25T10:04:03.277564+0000","last_peered":"2024-04-25T10:04:03.277564+0000","last_clean":"2024-04-25T10:04:03.277564+0000","last_became_active":"2024-04-25T10:03:56.795843+0000","last_became_peered":"2024-04-25T10:03:56.795843+0000","last_unstale":"2024-04-25T10:04:03.277564+0000","last_undegraded":"2024-04-25T10:04:03.277564+0000","last_fullsized":"2024-04-25T10:04:03.277564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792478+0000","last_change":"2024-04-25T10:03:56.766481+0000","last_active":"2024-04-25T10:04:02.792478+0000","last_peered":"2024-04-25T10:04:02.792478+0000","last_clean":"2024-04-25T10:04:02.792478+0000","last_became_active":"2024-04-25T10:03:56.766169+0000","last_became_peered":"2024-04-25T10:03:56.766169+0000","last_unstale":"2024-04-25T10:04:02.792478+0000","last_undegraded":"2024-04-25T10:04:02.792478+0000","last_fullsized":"2024-04-25T10:04:02.792478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:58.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277557+0000","last_change":"2024-04-25T10:03:56.778866+0000","last_active":"2024-04-25T10:04:03.277557+0000","last_peered":"2024-04-25T10:04:03.277557+0000","last_clean":"2024-04-25T10:04:03.277557+0000","last_became_active":"2024-04-25T10:03:56.778491+0000","last_became_peered":"2024-04-25T10:03:56.778491+0000","last_unstale":"2024-04-25T10:04:03.277557+0000","last_undegraded":"2024-04-25T10:04:03.277557+0000","last_fullsized":"2024-04-25T10:04:03.277557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795905+0000","last_change":"2024-04-25T10:03:56.793303+0000","last_active":"2024-04-25T10:04:02.795905+0000","last_peered":"2024-04-25T10:04:02.795905+0000","last_clean":"2024-04-25T10:04:02.795905+0000","last_became_active":"2024-04-25T10:03:56.792743+0000","last_became_peered":"2024-04-25T10:03:56.792743+0000","last_unstale":"2024-04-25T10:04:02.795905+0000","last_undegraded":"2024-04-25T10:04:02.795905+0000","last_fullsized":"2024-04-25T10:04:02.795905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277067+0000","last_change":"2024-04-25T10:03:56.787411+0000","last_active":"2024-04-25T10:04:03.277067+0000","last_peered":"2024-04-25T10:04:03.277067+0000","last_clean":"2024-04-25T10:04:03.277067+0000","last_became_active":"2024-04-25T10:03:56.786639+0000","last_became_peered":"2024-04-25T10:03:56.786639+0000","last_unstale":"2024-04-25T10:04:03.277067+0000","last_undegraded":"2024-04-25T10:04:03.277067+0000","last_fullsized":"2024-04-25T10:04:03.277067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796676+0000","last_change":"2024-04-25T10:03:56.768181+0000","last_active":"2024-04-25T10:04:02.796676+0000","last_peered":"2024-04-25T10:04:02.796676+0000","last_clean":"2024-04-25T10:04:02.796676+0000","last_became_active":"2024-04-25T10:03:56.767723+0000","last_became_peered":"2024-04-25T10:03:56.767723+0000","last_unstale":"2024-04-25T10:04:02.796676+0000","last_undegraded":"2024-04-25T10:04:02.796676+0000","last_fullsized":"2024-04-25T10:04:02.796676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266736+0000","last_change":"2024-04-25T10:03:56.761621+0000","last_active":"2024-04-25T10:04:03.266736+0000","last_peered":"2024-04-25T10:04:03.266736+0000","last_clean":"2024-04-25T10:04:03.266736+0000","last_became_active":"2024-04-25T10:03:56.761220+0000","last_became_peered":"2024-04-25T10:03:56.761220+0000","last_unstale":"2024-04-25T10:04:03.266736+0000","last_undegraded":"2024-04-25T10:04:03.266736+0000","last_fullsized":"2024-04-25T10:04:03.266736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:35.367003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275178+0000","last_change":"2024-04-25T10:03:56.753004+0000","last_active":"2024-04-25T10:04:03.275178+0000","last_peered":"2024-04-25T10:04:03.275178+0000","last_clean":"2024-04-25T10:04:03.275178+0000","last_became_active":"2024-04-25T10:03:56.752524+0000","last_became_peered":"2024-04-25T10:03:56.752524+0000","last_unstale":"2024-04-25T10:04:03.275178+0000","last_undegraded":"2024-04-25T10:04:03.275178+0000","last_fullsized":"2024-04-25T10:04:03.275178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277772+0000","last_change":"2024-04-25T10:03:56.788107+0000","last_active":"2024-04-25T10:04:03.277772+0000","last_peered":"2024-04-25T10:04:03.277772+0000","last_clean":"2024-04-25T10:04:03.277772+0000","last_became_active":"2024-04-25T10:03:56.787837+0000","last_became_peered":"2024-04-25T10:03:56.787837+0000","last_unstale":"2024-04-25T10:04:03.277772+0000","last_undegraded":"2024-04-25T10:04:03.277772+0000","last_fullsized":"2024-04-25T10:04:03.277772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":114337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":117948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":114247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":888832,"data_stored":705253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:16.353 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:04:16.354 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T10:04:16.354 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T10:04:16.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T10:04:16.354 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T10:04:16.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.521+0000 7f9540800640 1 Processor -- start 2024-04-25T10:04:16.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.521+0000 7f9540800640 1 -- start start 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f9540800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95380d11b0 0x7f95380afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f9540800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380b4210 0x7f95380b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f9540800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953815ddf0 con 0x7f953815da10 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f9540800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95380b4ba0 con 0x7f95380d11b0 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f9540800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953806b480 con 0x7f95380b4210 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95380d11b0 0x7f95380afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95380d11b0 0x7f95380afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40904/0 (socket says 172.21.15.18:40904) 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 -- 172.21.15.18:0/424572975 learned_addr learned my addr 172.21.15.18:0/424572975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:16.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953e800640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380b4210 0x7f95380b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 -- 172.21.15.18:0/424572975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380b4210 msgr2=0x7f95380b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380b4210 0x7f95380b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 -- 172.21.15.18:0/424572975 >> v1:172.21.15.167:6789/0 conn(0x7f953815da10 legacy=0x7f953806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.525+0000 7f953d400640 1 -- 172.21.15.18:0/424572975 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95380d06d0 con 0x7f95380d11b0 2024-04-25T10:04:16.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f953d400640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95380d11b0 0x7f95380afe20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9528009870 tx=0x7f952801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370d1e6aa05c060d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f953ca00640 1 -- 172.21.15.18:0/424572975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280b1070 con 0x7f95380d11b0 2024-04-25T10:04:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f953ca00640 1 -- 172.21.15.18:0/424572975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95280ac620 con 0x7f95380d11b0 2024-04-25T10:04:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f953ca00640 1 -- 172.21.15.18:0/424572975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280ac9f0 con 0x7f95380d11b0 2024-04-25T10:04:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- 172.21.15.18:0/424572975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95380d11b0 msgr2=0x7f95380afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95380d11b0 0x7f95380afe20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9528009870 tx=0x7f952801c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- 172.21.15.18:0/424572975 shutdown_connections 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380b4210 0x7f95380b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- 172.21.15.18:0/424572975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95380d11b0 0x7f95380afe20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- 172.21.15.18:0/424572975 >> 172.21.15.18:0/424572975 conn(0x7f95380b2400 msgr2=0x7f95380b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- 172.21.15.18:0/424572975 shutdown_connections 2024-04-25T10:04:16.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- 172.21.15.18:0/424572975 wait complete. 2024-04-25T10:04:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 Processor -- start 2024-04-25T10:04:16.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- start start 2024-04-25T10:04:16.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95380b4210 0x7f953815dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380d11b0 0x7f953815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538162150 con 0x7f953815da10 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538161fd0 con 0x7f95380b4210 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.529+0000 7f9540800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95381622d0 con 0x7f95380d11b0 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95380b4210 0x7f953815dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380d11b0 0x7f953815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40908/0 (socket says 172.21.15.18:40908) 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 -- 172.21.15.18:0/3896766851 learned_addr learned my addr 172.21.15.18:0/3896766851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 -- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380d11b0 msgr2=0x7f953815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380d11b0 0x7f953815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 -- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95380b4210 msgr2=0x7f953815dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95380b4210 0x7f953815dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 -- 172.21.15.18:0/3896766851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953815e500 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f953e800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9534009d30 tx=0x7f953400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534018020 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9534014480 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953815e780 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9534014870 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953815ed40 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95380745d0 con 0x7f953815da10 2024-04-25T10:04:16.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.533+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f953401b020 con 0x7f953815da10 2024-04-25T10:04:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.537+0000 7f9532000640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 0x7f951c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.537+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9534085bf0 con 0x7f953815da10 2024-04-25T10:04:16.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.537+0000 7f953de00640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 0x7f951c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.537+0000 7f953de00640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 0x7f951c069450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95381592b0 tx=0x7f952c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.541+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9534022070 con 0x7f953815da10 2024-04-25T10:04:16.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.741+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9538072860 con 0x7f953815da10 2024-04-25T10:04:16.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.741+0000 7f9532000640 1 -- 172.21.15.18:0/3896766851 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165737 (secure 0 0 0) 0x7f953815e500 con 0x7f953815da10 2024-04-25T10:04:16.754 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:16.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 msgr2=0x7f951c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 0x7f951c069450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f95381592b0 tx=0x7f952c009040 comp rx=0 tx=0).stop 2024-04-25T10:04:16.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 msgr2=0x7f953815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9534009d30 tx=0x7f953400c490 comp rx=0 tx=0).stop 2024-04-25T10:04:16.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 shutdown_connections 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f953815da10 0x7f953815b550 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f951c066f90 0x7f951c069450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95380d11b0 0x7f953815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 --2- 172.21.15.18:0/3896766851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95380b4210 0x7f953815dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 >> 172.21.15.18:0/3896766851 conn(0x7f95380b2400 msgr2=0x7f95380b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 shutdown_connections 2024-04-25T10:04:16.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.745+0000 7f9540800640 1 -- 172.21.15.18:0/3896766851 wait complete. 2024-04-25T10:04:16.774 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2114050973},{"type":"v1","addr":"172.21.15.167:6833","nonce":2114050973}]},"active_addr":"172.21.15.167:6833/2114050973","active_change":"2024-04-25T10:03:35.378050+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":3696615390}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":537963118}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":126890846}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.167:0","nonce":906260311}]}]} 2024-04-25T10:04:16.777 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T10:04:16.777 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T10:04:16.777 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.909+0000 7faed5200640 1 Processor -- start 2024-04-25T10:04:16.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.909+0000 7faed5200640 1 -- start start 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faed5200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faed0099a60 0x7faed015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faed5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed009a600 0x7faed00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faed5200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed015c310 con 0x7faed00cf370 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faed5200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed00d0410 con 0x7faed0099a60 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faed5200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00cf800 con 0x7faed009a600 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecd400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faed00cf370 0x7faed0099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59016/0 (socket says 172.21.15.18:59016) 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecd400640 1 -- 172.21.15.18:0/556596454 learned_addr learned my addr 172.21.15.18:0/556596454 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:16.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faed0099a60 0x7faed015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faece800640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed009a600 0x7faed00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 -- 172.21.15.18:0/556596454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed009a600 msgr2=0x7faed00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed009a600 0x7faed00cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 -- 172.21.15.18:0/556596454 >> v1:172.21.15.18:6789/0 conn(0x7faed00cf370 legacy=0x7faed0099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecca00640 1 -- 172.21.15.18:0/556596454 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373038012 0 0) 0x7faebc001120 con 0x7faed00cf370 2024-04-25T10:04:16.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 -- 172.21.15.18:0/556596454 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00cfae0 con 0x7faed0099a60 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecde00640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0099a60 0x7faed015bdd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faec00097c0 tx=0x7faec001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0718a84fab68990 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.913+0000 7faecca00640 1 -- 172.21.15.18:0/556596454 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00b2070 con 0x7faed0099a60 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faecca00640 1 -- 172.21.15.18:0/556596454 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00a9070 con 0x7faed0099a60 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faecca00640 1 -- 172.21.15.18:0/556596454 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec00ad880 con 0x7faed0099a60 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- 172.21.15.18:0/556596454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0099a60 msgr2=0x7faed015bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0099a60 0x7faed015bdd0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faec00097c0 tx=0x7faec001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- 172.21.15.18:0/556596454 shutdown_connections 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed009a600 0x7faed00cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- 172.21.15.18:0/556596454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0099a60 0x7faed015bdd0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- 172.21.15.18:0/556596454 >> 172.21.15.18:0/556596454 conn(0x7faed00d17a0 msgr2=0x7faed00d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- 172.21.15.18:0/556596454 shutdown_connections 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- 172.21.15.18:0/556596454 wait complete. 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 Processor -- start 2024-04-25T10:04:16.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- start start 2024-04-25T10:04:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed0099a60 0x7faed01f6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed009a600 0x7faed014f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00cd390 con 0x7faed0165dd0 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed00cd210 con 0x7faed009a600 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faed5200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed00cd510 con 0x7faed0099a60 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faece800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faece800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40924/0 (socket says 172.21.15.18:40924) 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faece800640 1 -- 172.21.15.18:0/288651455 learned_addr learned my addr 172.21.15.18:0/288651455 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faecde00640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed0099a60 0x7faed01f6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.917+0000 7faecd400640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed009a600 0x7faed014f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 -- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed0099a60 msgr2=0x7faed01f6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed0099a60 0x7faed01f6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 -- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed009a600 msgr2=0x7faed014f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed009a600 0x7faed014f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 -- 172.21.15.18:0/288651455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed0153fb0 con 0x7faed0165dd0 2024-04-25T10:04:16.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faece800640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faec8007e40 tx=0x7faec800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8014620 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec8019070 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed0154290 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec8014a20 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed0154850 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed00745d0 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faec8014bc0 con 0x7faed0165dd0 2024-04-25T10:04:16.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 0x7faeb0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faec8085af0 con 0x7faed0165dd0 2024-04-25T10:04:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.921+0000 7faecde00640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 0x7faeb0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:16.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.925+0000 7faecde00640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 0x7faeb0069420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faec00af000 tx=0x7faec00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:16.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:16.925+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faec8056160 con 0x7faed0165dd0 2024-04-25T10:04:17.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.089+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faed00d2620 con 0x7faed0165dd0 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faec6000640 1 -- 172.21.15.18:0/288651455 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7faec805a200 con 0x7faed0165dd0 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:17.101 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 msgr2=0x7faeb0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 0x7faeb0069420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faec00af000 tx=0x7faec00a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:17.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 msgr2=0x7faed0166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faec8007e40 tx=0x7faec800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 shutdown_connections 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faed0165dd0 0x7faed0166280 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faed009a600 0x7faed014f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faeb0066f60 0x7faeb0069420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 --2- 172.21.15.18:0/288651455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faed0099a60 0x7faed01f6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 >> 172.21.15.18:0/288651455 conn(0x7faed00d17a0 msgr2=0x7faed00b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 shutdown_connections 2024-04-25T10:04:17.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.093+0000 7faed5200640 1 -- 172.21.15.18:0/288651455 wait complete. 2024-04-25T10:04:17.122 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T10:04:17.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 Processor -- start 2024-04-25T10:04:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 -- start start 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2e80d0f40 0x7fd2e81689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e806c650 con 0x7fd2e8099a60 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2e806c930 con 0x7fd2e815ee00 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2eda00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e806c430 con 0x7fd2e80d0f40 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2e6a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd2e8099a60 0x7fd2e8099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59024/0 (socket says 172.21.15.18:59024) 2024-04-25T10:04:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2e6a00640 1 -- 172.21.15.18:0/1523909741 learned_addr learned my addr 172.21.15.18:0/1523909741 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2e7400640 1 --2- 172.21.15.18:0/1523909741 >> v2:172.21.15.167:3300/0 conn(0x7fd2e80d0f40 0x7fd2e81689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3201973890 0 0) 0x7fd2e806c650 con 0x7fd2e8099a60 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.253+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2cc003530 con 0x7fd2e8099a60 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2861527740 0 0) 0x7fd2cc003530 con 0x7fd2e8099a60 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 >> v2:172.21.15.167:3300/0 conn(0x7fd2e80d0f40 msgr2=0x7fd2e81689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 --2- 172.21.15.18:0/1523909741 >> v2:172.21.15.167:3300/0 conn(0x7fd2e80d0f40 0x7fd2e81689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 >> v1:172.21.15.167:6789/0 conn(0x7fd2e815ee00 legacy=0x7fd2e806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e806cc10 con 0x7fd2e8099a60 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fd2d8001680 con 0x7fd2e8099a60 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e7400640 1 --2- 172.21.15.18:0/1523909741 >> v2:172.21.15.167:3300/0 conn(0x7fd2e80d0f40 0x7fd2e81689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 >> v1:172.21.15.18:6789/0 conn(0x7fd2e8099a60 legacy=0x7fd2e8099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc003a10 0x7fd2cc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2cc0051d0 0x7fd2cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e806c430 con 0x7fd2cc004810 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00c0d0 con 0x7fd2cc0051d0 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2cc00c2d0 con 0x7fd2cc003a10 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e6a00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc003a10 0x7fd2cc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e7400640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2cc0051d0 0x7fd2cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 -- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc003a10 msgr2=0x7fd2cc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc003a10 0x7fd2cc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 -- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2cc0051d0 msgr2=0x7fd2cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2cc0051d0 0x7fd2cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 -- 172.21.15.18:0/1523909741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2cc003530 con 0x7fd2cc004810 2024-04-25T10:04:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2e7400640 1 -- 172.21.15.18:0/1523909741 reap_dead start 2024-04-25T10:04:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.257+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0001750 tx=0x7fd2d001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a75e7493b6f7e601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d00013a0 con 0x7fd2cc004810 2024-04-25T10:04:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d00052f0 con 0x7fd2cc004810 2024-04-25T10:04:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e6000640 1 -- 172.21.15.18:0/1523909741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d0003840 con 0x7fd2cc004810 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 msgr2=0x7fd2cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0001750 tx=0x7fd2d001c3c0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- 172.21.15.18:0/1523909741 shutdown_connections 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 --2- 172.21.15.18:0/1523909741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc004810 0x7fd2cc004c90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- 172.21.15.18:0/1523909741 >> 172.21.15.18:0/1523909741 conn(0x7fd2e80d17a0 msgr2=0x7fd2e80d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- 172.21.15.18:0/1523909741 shutdown_connections 2024-04-25T10:04:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- 172.21.15.18:0/1523909741 wait complete. 2024-04-25T10:04:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 Processor -- start 2024-04-25T10:04:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- start start 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc004810 0x7fd2e81f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 0x7fd2e815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815de80 con 0x7fd2e8152100 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e80cf9e0 con 0x7fd2e8151ca0 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2eda00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e815e000 con 0x7fd2cc004810 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40942/0 (socket says 172.21.15.18:40942) 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e7400640 1 -- 172.21.15.18:0/619337328 learned_addr learned my addr 172.21.15.18:0/619337328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 0x7fd2e815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.261+0000 7fd2e6a00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc004810 0x7fd2e81f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 -- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc004810 msgr2=0x7fd2e81f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc004810 0x7fd2e81f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 -- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 msgr2=0x7fd2e815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 0x7fd2e815bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 -- 172.21.15.18:0/619337328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e80c53e0 con 0x7fd2e8152100 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dfe00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 0x7fd2e815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e7400640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8068490 tx=0x7fd2e000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000fd90 con 0x7fd2e8152100 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00039a0 con 0x7fd2e8152100 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e80c56c0 con 0x7fd2e8152100 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0003d90 con 0x7fd2e8152100 2024-04-25T10:04:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e80c5c80 con 0x7fd2e8152100 2024-04-25T10:04:17.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2e80745d0 con 0x7fd2e8152100 2024-04-25T10:04:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd2e001f020 con 0x7fd2e8152100 2024-04-25T10:04:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 0x7fd2c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd2e0085ba0 con 0x7fd2e8152100 2024-04-25T10:04:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.265+0000 7fd2e6a00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 0x7fd2c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.269+0000 7fd2e6a00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 0x7fd2c4069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001c10 tx=0x7fd2d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.269+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd2e0026020 con 0x7fd2e8152100 2024-04-25T10:04:17.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2e8073c30 con 0x7fd2e8152100 2024-04-25T10:04:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2dea00640 1 -- 172.21.15.18:0/619337328 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7fd2e0010040 con 0x7fd2e8152100 2024-04-25T10:04:17.446 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:17.446 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 msgr2=0x7fd2c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 0x7fd2c4069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8001c10 tx=0x7fd2d8009040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 msgr2=0x7fd2e815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8068490 tx=0x7fd2e000f580 comp rx=0 tx=0).stop 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 shutdown_connections 2024-04-25T10:04:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2e8152100 0x7fd2e815c310 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2e8151ca0 0x7fd2e815bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd2c4066f60 0x7fd2c4069420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 --2- 172.21.15.18:0/619337328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd2cc004810 0x7fd2e81f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 >> 172.21.15.18:0/619337328 conn(0x7fd2e80d17a0 msgr2=0x7fd2e8153bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 shutdown_connections 2024-04-25T10:04:17.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.437+0000 7fd2eda00640 1 -- 172.21.15.18:0/619337328 wait complete. 2024-04-25T10:04:17.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T10:04:17.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T10:04:17.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T10:04:17.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T10:04:17.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T10:04:17.470 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T10:04:17.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T10:04:17.471 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T10:04:17.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.705+0000 7f8bbf200640 1 Processor -- start 2024-04-25T10:04:17.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.705+0000 7f8bbf200640 1 -- start start 2024-04-25T10:04:17.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 Processor -- start 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 -- start start 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbf200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbf200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8bb8053750 0x7f8bb80e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbf200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80e75f0 con 0x7f8bb803c100 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbf200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80e3640 con 0x7f8bb8053750 2024-04-25T10:04:17.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbf200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80061d0 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbd400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8bb8053750 0x7f8bb80e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57490/0 (socket says 172.21.15.18:57490) 2024-04-25T10:04:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 -- 172.21.15.18:0/981472150 learned_addr learned my addr 172.21.15.18:0/981472150 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 -- 172.21.15.18:0/981472150 >> v2:172.21.15.18:3300/0 conn(0x7f8bb8053750 msgr2=0x7f8bb80e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 --2- 172.21.15.18:0/981472150 >> v2:172.21.15.18:3300/0 conn(0x7f8bb8053750 0x7f8bb80e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 -- 172.21.15.18:0/981472150 >> v1:172.21.15.18:6789/0 conn(0x7f8bb803c100 legacy=0x7f8bb8006f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 0x7f5ba01627d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba00afc90 con 0x7f5ba00af800 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba00aff70 con 0x7f5ba00b0d30 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5ba5e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00b0250 con 0x7f5ba0161ce0 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5b9ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5b9ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57496/0 (socket says 172.21.15.18:57496) 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5b9ea00640 1 -- 172.21.15.18:0/2643455151 learned_addr learned my addr 172.21.15.18:0/2643455151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f8bbde00640 1 -- 172.21.15.18:0/981472150 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80e7a90 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.709+0000 7f5b9f400640 1 --2- 172.21.15.18:0/2643455151 >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 0x7f5ba01627d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f5b9ea00640 1 -- 172.21.15.18:0/2643455151 >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 msgr2=0x7f5ba01627d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f5b9ea00640 1 --2- 172.21.15.18:0/2643455151 >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 0x7f5ba01627d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f5b9ea00640 1 -- 172.21.15.18:0/2643455151 >> v1:172.21.15.18:6789/0 conn(0x7f5ba00af800 legacy=0x7f5ba01620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f5b9ea00640 1 -- 172.21.15.18:0/2643455151 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00b0530 con 0x7f5ba0161ce0 2024-04-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f5b9f400640 1 --2- 172.21.15.18:0/2643455151 >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 0x7f5ba01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:17.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f15c0800640 1 Processor -- start 2024-04-25T10:04:17.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f8bbde00640 1 --2- 172.21.15.18:0/981472150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009870 tx=0x7f8bb001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7b98df5ef4aa458 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f8bbca00640 1 -- 172.21.15.18:0/981472150 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b0070 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbca00640 1 -- 172.21.15.18:0/981472150 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00ab600 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbca00640 1 -- 172.21.15.18:0/981472150 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b0070 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5b9ea00640 1 --2- 172.21.15.18:0/2643455151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009870 tx=0x7f5b8c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ac875557203820 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 -- 172.21.15.18:0/981472150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 msgr2=0x7f8bb8053f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 --2- 172.21.15.18:0/981472150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0009870 tx=0x7f8bb001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 -- 172.21.15.18:0/981472150 shutdown_connections 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 --2- 172.21.15.18:0/981472150 >> v2:172.21.15.18:3300/0 conn(0x7f8bb8053750 0x7f8bb80e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 --2- 172.21.15.18:0/981472150 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb80e6cd0 0x7f8bb8053f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 -- 172.21.15.18:0/981472150 >> 172.21.15.18:0/981472150 conn(0x7f8bb8058ef0 msgr2=0x7f8bb8059300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 -- 172.21.15.18:0/981472150 shutdown_connections 2024-04-25T10:04:17.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f8bbf200640 1 -- 172.21.15.18:0/981472150 wait complete. 2024-04-25T10:04:17.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.713+0000 7f15c0800640 1 -- start start 2024-04-25T10:04:17.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5b9d600640 1 -- 172.21.15.18:0/2643455151 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0aa610 con 0x7f5ba0161ce0 2024-04-25T10:04:17.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15c0800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15b8163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15c0800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f15b8163610 0x7f15b8071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5b9d600640 1 -- 172.21.15.18:0/2643455151 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0af070 con 0x7f5ba0161ce0 2024-04-25T10:04:17.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5b9d600640 1 -- 172.21.15.18:0/2643455151 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0aa9d0 con 0x7f5ba0161ce0 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15c0800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b80cd470 con 0x7f15b815c330 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15bde00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f15b815c330 0x7f15b806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47816/0 (socket says 172.21.15.18:47816) 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15bde00640 1 -- 172.21.15.18:0/4290962033 learned_addr learned my addr 172.21.15.18:0/4290962033 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15be800640 1 --2- 172.21.15.18:0/4290962033 >> v2:172.21.15.18:3300/0 conn(0x7f15b8163610 0x7f15b8071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b80af0e0 con 0x7f15b8163610 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b806e350 con 0x7f15b815c710 2024-04-25T10:04:17.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f9fa5000640 1 Processor -- start 2024-04-25T10:04:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5ba5e00640 1 -- 172.21.15.18:0/2643455151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 msgr2=0x7f5ba00b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/2643455151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c009870 tx=0x7f5b8c01c510 comp rx=0 tx=0).stop 2024-04-25T10:04:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95668292 0 0) 0x7f15b80cd470 con 0x7f15b815c330 2024-04-25T10:04:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a0003530 con 0x7f15b815c330 2024-04-25T10:04:17.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.717+0000 7f9fa5000640 1 -- start start 2024-04-25T10:04:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 -- 172.21.15.18:0/2643455151 shutdown_connections 2024-04-25T10:04:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/2643455151 >> v2:172.21.15.167:3300/0 conn(0x7f5ba00b0d30 0x7f5ba01627d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/2643455151 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba0161ce0 0x7f5ba00b1bd0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 -- 172.21.15.18:0/2643455151 >> 172.21.15.18:0/2643455151 conn(0x7f5ba0066dd0 msgr2=0x7f5ba006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 -- 172.21.15.18:0/2643455151 shutdown_connections 2024-04-25T10:04:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 Processor -- start 2024-04-25T10:04:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 -- start start 2024-04-25T10:04:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 Processor -- start 2024-04-25T10:04:17.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 -- 172.21.15.18:0/2643455151 wait complete. 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bd400640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15b8163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2537627385 0 0) 0x7f15a0003530 con 0x7f15b815c330 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 msgr2=0x7f15b8163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15b8163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 >> v2:172.21.15.18:3300/0 conn(0x7f15b8163610 msgr2=0x7f15b8071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 --2- 172.21.15.18:0/4290962033 >> v2:172.21.15.18:3300/0 conn(0x7f15b8163610 0x7f15b8071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8163a60 con 0x7f15b815c330 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f15ac0016a0 con 0x7f15b815c330 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 >> v1:172.21.15.167:6789/0 conn(0x7f15b815c330 legacy=0x7f15b806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15a00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a0003f40 0x7f15a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a0004d50 0x7f15a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 -- start start 2024-04-25T10:04:17.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a000bb90 con 0x7f15a0003f40 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a000bd40 con 0x7f15a0004d50 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15a000bf40 con 0x7f15b815c710 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15be800640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a0004d50 0x7f15a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9fa5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9fa5000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9fa00b5cc0 0x7f9fa0162100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9fa5000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa00b5520 con 0x7f9fa0166480 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9fa5000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa0165750 con 0x7f9fa00b5cc0 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9fa5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa01659a0 con 0x7f9fa00b58e0 2024-04-25T10:04:17.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57520/0 (socket says 172.21.15.18:57520) 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 0x7f3a88168b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880b95d0 con 0x7f3a880d0aa0 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a881623d0 con 0x7f3a8815dc60 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a8d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a881626b0 con 0x7f3a88161f00 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3203200640 1 Processor -- start 2024-04-25T10:04:17.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3203200640 1 -- start start 2024-04-25T10:04:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 -- 172.21.15.18:0/2104992714 learned_addr learned my addr 172.21.15.18:0/2104992714 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f5ba5e00640 1 Processor -- start 2024-04-25T10:04:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 0x7f8bb8188890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb8053750 0x7f8bb80dd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80e6cd0 0x7f8bb80dde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8007a20 con 0x7f8bb80e6cd0 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80069e0 con 0x7f8bb803c100 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f8bbf200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb803c530 con 0x7f8bb8053750 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bde00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15a00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f15bd400640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a0003f40 0x7f15a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a86a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f3a8815dc60 0x7f3a880d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47828/0 (socket says 172.21.15.18:47828) 2024-04-25T10:04:17.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f3a86a00640 1 -- 172.21.15.18:0/858373673 learned_addr learned my addr 172.21.15.18:0/858373673 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb8053750 0x7f8bb80dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 0x7f8bb8188890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 0x7f8bb8188890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38478/0 (socket says 172.21.15.18:38478) 2024-04-25T10:04:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 -- 172.21.15.18:0/1749218720 learned_addr learned my addr 172.21.15.18:0/1749218720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a85600640 1 -- 172.21.15.18:0/858373673 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815487673 0 0) 0x7f3a881623d0 con 0x7f3a8815dc60 2024-04-25T10:04:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a85600640 1 -- 172.21.15.18:0/858373673 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a6c003530 con 0x7f3a8815dc60 2024-04-25T10:04:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3203200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32040b5230 0x7f32040b2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bde00640 1 -- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a0004d50 msgr2=0x7f15a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3203200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32041621c0 con 0x7f32040d0590 2024-04-25T10:04:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7fc4b8400640 1 Processor -- start 2024-04-25T10:04:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 -- 172.21.15.18:0/2104992714 >> v2:172.21.15.18:3300/0 conn(0x7f9fa00b5cc0 msgr2=0x7f9fa0162100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 --2- 172.21.15.18:0/2104992714 >> v2:172.21.15.18:3300/0 conn(0x7f9fa00b5cc0 0x7f9fa0162100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 -- 172.21.15.18:0/2104992714 >> v1:172.21.15.18:6789/0 conn(0x7f9fa0166480 legacy=0x7f9fa006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.721+0000 7f9f9f400640 1 -- 172.21.15.18:0/2104992714 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0165c80 con 0x7f9fa00b58e0 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 -- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb8053750 msgr2=0x7f8bb80dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8bb8053750 0x7f8bb80dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 -- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80e6cd0 msgr2=0x7f8bb80dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80e6cd0 0x7f8bb80dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8038d20 con 0x7f8bb803c100 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3203200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32040b58c0 con 0x7f32040cf760 2024-04-25T10:04:17.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3203200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32040b5690 con 0x7f32040b5230 2024-04-25T10:04:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bde00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a0004d50 0x7f15a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bde00640 1 -- 172.21.15.18:0/4290962033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a0003f40 msgr2=0x7f15a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bde00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a0003f40 0x7f15a0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 Processor -- start 2024-04-25T10:04:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbde00640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 0x7f8bb8188890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00ae040 tx=0x7f8bb0019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a87400640 1 --2- 172.21.15.18:0/858373673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 0x7f3a88168b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 -- start start 2024-04-25T10:04:17.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bde00640 1 -- 172.21.15.18:0/4290962033 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b8163a60 con 0x7f15b815c710 2024-04-25T10:04:17.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f32040cf760 0x7f3204165f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47836/0 (socket says 172.21.15.18:47836) 2024-04-25T10:04:17.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201e00640 1 -- 172.21.15.18:0/3141738706 learned_addr learned my addr 172.21.15.18:0/3141738706 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:17.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3202800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f32040d0590 0x7f32040b76a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59070/0 (socket says 172.21.15.18:59070) 2024-04-25T10:04:17.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201400640 1 --2- 172.21.15.18:0/3141738706 >> v2:172.21.15.167:3300/0 conn(0x7f32040b5230 0x7f32040b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 -- start start 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 0x7f5ba0158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ba0161ce0 0x7f5ba0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0158ab0 0x7f5ba0150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00b3180 con 0x7f5ba0161ce0 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00b3000 con 0x7f5ba0158ab0 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5ba5e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00b3300 con 0x7f5ba00b0d30 2024-04-25T10:04:17.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7fc4b8400640 1 -- start start 2024-04-25T10:04:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15bd400640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15a0003f40 0x7f15a0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f15be800640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15a0004d50 0x7f15a00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5b9ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 0x7f5ba0158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b0070 con 0x7f8bb803c100 2024-04-25T10:04:17.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a87400640 1 -- 172.21.15.18:0/858373673 >> v1:172.21.15.167:6789/0 conn(0x7f3a8815dc60 legacy=0x7f3a880d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a87400640 1 -- 172.21.15.18:0/858373673 >> v1:172.21.15.18:6789/0 conn(0x7f3a880d0aa0 legacy=0x7f3a881617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3200a00640 1 -- 172.21.15.18:0/3141738706 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650185892 0 0) 0x7f32040b58c0 con 0x7f32040cf760 2024-04-25T10:04:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3200a00640 1 -- 172.21.15.18:0/3141738706 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31e8003530 con 0x7f32040cf760 2024-04-25T10:04:17.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00b1040 con 0x7f8bb803c100 2024-04-25T10:04:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201400640 1 -- 172.21.15.18:0/3141738706 >> v1:172.21.15.167:6789/0 conn(0x7f32040cf760 legacy=0x7f3204165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201400640 1 -- 172.21.15.18:0/3141738706 >> v1:172.21.15.18:6789/0 conn(0x7f32040d0590 legacy=0x7f32040b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3201400640 1 -- 172.21.15.18:0/3141738706 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040b5ba0 con 0x7f32040b5230 2024-04-25T10:04:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00abc20 con 0x7f8bb803c100 2024-04-25T10:04:17.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5b9ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 0x7f5ba0158570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57546/0 (socket says 172.21.15.18:57546) 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5b9ea00640 1 -- 172.21.15.18:0/3223374469 learned_addr learned my addr 172.21.15.18:0/3223374469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f5b9f400640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0158ab0 0x7f5ba0150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 -- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0158ab0 msgr2=0x7f5ba0150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ba0158ab0 0x7f5ba0150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 -- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ba0161ce0 msgr2=0x7f5ba0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ba0161ce0 0x7f5ba0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba01636a0 con 0x7f5ba00b0d30 2024-04-25T10:04:17.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb80e1260 con 0x7f8bb803c100 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb80e1820 con 0x7f8bb803c100 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f3a87400640 1 -- 172.21.15.18:0/858373673 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a880d1b30 con 0x7f3a88161f00 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7fc4b8400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38524/0 (socket says 172.21.15.18:38524) 2024-04-25T10:04:17.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4b0161dc0 0x7fc4b0162f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59078/0 (socket says 172.21.15.18:59078) 2024-04-25T10:04:17.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b9ea00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 0x7f5ba0158570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ac040 tx=0x7f5b8c0192b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b8400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 0x7fc4b006c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b8400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00cff50 con 0x7fc4b0161dc0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b8400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b006cc50 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b8400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00d0f00 con 0x7fc4b006c2c0 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 -- 172.21.15.18:0/3846786169 learned_addr learned my addr 172.21.15.18:0/3846786169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0b4810 con 0x7f5ba00b0d30 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b6400640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 0x7fc4b006c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9a7c159320 0x7f9a7c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 0x7f9a7c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c15fc00 con 0x7f9a7c15f440 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c06ee50 con 0x7f9a7c159320 2024-04-25T10:04:17.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.725+0000 7f9a83e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c06d640 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a80a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9a7c15f440 0x7f9a7c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47842/0 (socket says 172.21.15.18:47842) 2024-04-25T10:04:17.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a80a00640 1 -- 172.21.15.18:0/415362117 learned_addr learned my addr 172.21.15.18:0/415362117 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:17.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81e00640 1 --2- 172.21.15.18:0/415362117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 0x7f9a7c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81400640 1 --2- 172.21.15.18:0/415362117 >> v2:172.21.15.167:3300/0 conn(0x7f9a7c159320 0x7f9a7c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81e00640 1 -- 172.21.15.18:0/415362117 >> v2:172.21.15.167:3300/0 conn(0x7f9a7c159320 msgr2=0x7f9a7c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81e00640 1 --2- 172.21.15.18:0/415362117 >> v2:172.21.15.167:3300/0 conn(0x7f9a7c159320 0x7f9a7c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81e00640 1 -- 172.21.15.18:0/415362117 >> v1:172.21.15.167:6789/0 conn(0x7f9a7c15f440 legacy=0x7f9a7c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9a81e00640 1 -- 172.21.15.18:0/415362117 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c15fee0 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8c0b49d0 con 0x7f5ba00b0d30 2024-04-25T10:04:17.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0b4dc0 con 0x7f5ba00b0d30 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba0163980 con 0x7f5ba00b0d30 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 -- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 msgr2=0x7fc4b006c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 0x7fc4b006c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 -- 172.21.15.18:0/3846786169 >> v1:172.21.15.18:6789/0 conn(0x7fc4b0161dc0 legacy=0x7fc4b0162f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba0163f40 con 0x7f5ba00b0d30 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8bb80e1c00 con 0x7f8bb803c100 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b5000640 1 -- 172.21.15.18:0/3846786169 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00ce500 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7fc4b6400640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 0x7fc4b006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f9f9f400640 1 --2- 172.21.15.18:0/2104992714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009870 tx=0x7f9f8c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66d290f3790d394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ba0164320 con 0x7f5ba00b0d30 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.729+0000 7f3201400640 1 --2- 172.21.15.18:0/3141738706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040b5230 0x7f32040b2690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31f40097c0 tx=0x7f31f401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=944ee8e5bfff6828 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15bde00640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15a00039c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c340 tx=0x7f15ac01cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b81daca068052e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3200a00640 1 -- 172.21.15.18:0/3141738706 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40b0070 con 0x7f32040b5230 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3200a00640 1 -- 172.21.15.18:0/3141738706 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f40ab600 con 0x7f32040b5230 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3200a00640 1 -- 172.21.15.18:0/3141738706 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f40ab9d0 con 0x7f32040b5230 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9f9e000640 1 -- 172.21.15.18:0/2104992714 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b2070 con 0x7f9fa00b58e0 2024-04-25T10:04:17.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9f9e000640 1 -- 172.21.15.18:0/2104992714 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0a9070 con 0x7f9fa00b58e0 2024-04-25T10:04:17.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9f9e000640 1 -- 172.21.15.18:0/2104992714 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0ad880 con 0x7f9fa00b58e0 2024-04-25T10:04:17.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a87400640 1 --2- 172.21.15.18:0/858373673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 0x7f3a88168b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009dc0 tx=0x7f3a8001c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c41e0d1b9168361b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac007da0 con 0x7f15b815c710 2024-04-25T10:04:17.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac0a9070 con 0x7f15b815c710 2024-04-25T10:04:17.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15bca00640 1 -- 172.21.15.18:0/4290962033 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac005d60 con 0x7f15b815c710 2024-04-25T10:04:17.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 -- 172.21.15.18:0/3141738706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040b5230 msgr2=0x7f32040b2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 --2- 172.21.15.18:0/3141738706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040b5230 0x7f32040b2690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f31f40097c0 tx=0x7f31f401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5b8c0c83f0 con 0x7f5ba00b0d30 2024-04-25T10:04:17.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 -- 172.21.15.18:0/2104992714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 msgr2=0x7f9fa00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 --2- 172.21.15.18:0/2104992714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009870 tx=0x7f9f8c01c4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 -- 172.21.15.18:0/2104992714 shutdown_connections 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 --2- 172.21.15.18:0/2104992714 >> v2:172.21.15.18:3300/0 conn(0x7f9fa00b5cc0 0x7f9fa0162100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 --2- 172.21.15.18:0/2104992714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa00b4e20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 -- 172.21.15.18:0/2104992714 >> 172.21.15.18:0/2104992714 conn(0x7f9fa00726e0 msgr2=0x7f9fa0099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a85600640 1 -- 172.21.15.18:0/858373673 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800b2070 con 0x7f3a88161f00 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a85600640 1 -- 172.21.15.18:0/858373673 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a800a55c0 con 0x7f3a88161f00 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a85600640 1 -- 172.21.15.18:0/858373673 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a78001600 con 0x7f3a88161f00 2024-04-25T10:04:17.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 -- 172.21.15.18:0/3141738706 shutdown_connections 2024-04-25T10:04:17.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 --2- 172.21.15.18:0/3141738706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040b5230 0x7f32040b2690 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 -- 172.21.15.18:0/3141738706 >> 172.21.15.18:0/3141738706 conn(0x7f320406c000 msgr2=0x7f320406c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8bb00bc030 con 0x7f8bb803c100 2024-04-25T10:04:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a81e00640 1 --2- 172.21.15.18:0/415362117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 0x7f9a7c06e910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a700097c0 tx=0x7f9a7001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ad2510b4046681e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 -- 172.21.15.18:0/2104992714 shutdown_connections 2024-04-25T10:04:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9fa5000640 1 -- 172.21.15.18:0/2104992714 wait complete. 2024-04-25T10:04:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a7be00640 1 -- 172.21.15.18:0/415362117 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700b1070 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a7be00640 1 -- 172.21.15.18:0/415362117 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700a8050 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a7be00640 1 -- 172.21.15.18:0/415362117 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700b1070 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 msgr2=0x7f15a00039c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 --2- 172.21.15.18:0/4290962033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815c710 0x7f15a00039c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00c340 tx=0x7f15ac01cc90 comp rx=0 tx=0).stop 2024-04-25T10:04:17.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15be800640 1 -- 172.21.15.18:0/4290962033 reap_dead start 2024-04-25T10:04:17.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f5b97400640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b80067030 0x7f5b800694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a8d600640 1 -- 172.21.15.18:0/858373673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 msgr2=0x7f3a88168b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a8d600640 1 --2- 172.21.15.18:0/858373673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 0x7f3a88168b20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3a80009dc0 tx=0x7f3a8001c760 comp rx=0 tx=0).stop 2024-04-25T10:04:17.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 -- 172.21.15.18:0/3141738706 shutdown_connections 2024-04-25T10:04:17.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 shutdown_connections 2024-04-25T10:04:17.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 >> 172.21.15.18:0/4290962033 conn(0x7f15b8067080 msgr2=0x7f15b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3203200640 1 -- 172.21.15.18:0/3141738706 wait complete. 2024-04-25T10:04:17.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a8d600640 1 -- 172.21.15.18:0/858373673 shutdown_connections 2024-04-25T10:04:17.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a8d600640 1 --2- 172.21.15.18:0/858373673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a88161f00 0x7f3a88168b20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5b8c1203c0 con 0x7f5ba00b0d30 2024-04-25T10:04:17.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f3a8d600640 1 -- 172.21.15.18:0/858373673 >> 172.21.15.18:0/858373673 conn(0x7f3a880b5490 msgr2=0x7f3a880b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 shutdown_connections 2024-04-25T10:04:17.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f8bb6000640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ba0066fb0 0x7f8ba0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f15c0800640 1 -- 172.21.15.18:0/4290962033 wait complete. 2024-04-25T10:04:17.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f5b97400640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f5b800707b0 0x7f5b80072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f5b9e000640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b80067030 0x7f5b800694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8bb011e740 con 0x7f8bb803c100 2024-04-25T10:04:17.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a83e00640 1 -- 172.21.15.18:0/415362117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 msgr2=0x7f9a7c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7f9a83e00640 1 --2- 172.21.15.18:0/415362117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 0x7f9a7c06e910 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9a700097c0 tx=0x7f9a7001c400 comp rx=0 tx=0).stop 2024-04-25T10:04:17.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.733+0000 7fc4b5000640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009e50 tx=0x7fc4a801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d165145540bb66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5b800732c0 con 0x7f5b800707b0 2024-04-25T10:04:17.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b8c127050 con 0x7f5ba00b0d30 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bbd400640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ba0066fb0 0x7f8ba0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bb6000640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f8ba0070730 0x7f8ba0072b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ba0073240 con 0x7f8ba0070730 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8bb01232c0 con 0x7f8bb803c100 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bbe800640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f8ba0070730 0x7f8ba0072b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bbd400640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ba0066fb0 0x7f8ba0069470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80e0e50 tx=0x7f8bac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 Processor -- start 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9fa5000640 1 Processor -- start 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9fa5000640 1 -- start start 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3a8d600640 1 -- 172.21.15.18:0/858373673 shutdown_connections 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 -- 172.21.15.18:0/415362117 shutdown_connections 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 --2- 172.21.15.18:0/415362117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c06e4a0 0x7f9a7c06e910 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 --2- 172.21.15.18:0/415362117 >> v2:172.21.15.167:3300/0 conn(0x7f9a7c159320 0x7f9a7c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4afe00640 1 -- 172.21.15.18:0/3846786169 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80a57f0 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4afe00640 1 -- 172.21.15.18:0/3846786169 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a80a5990 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4afe00640 1 -- 172.21.15.18:0/3846786169 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a80a5d60 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 -- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b00cdfd0 msgr2=0x7fc4b00d09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009e50 tx=0x7fc4a801ca30 comp rx=0 tx=0).stop 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 -- 172.21.15.18:0/3846786169 shutdown_connections 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b006c2c0 0x7fc4b006c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 --2- 172.21.15.18:0/3846786169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b00cdfd0 0x7fc4b00d09c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 -- 172.21.15.18:0/3846786169 >> 172.21.15.18:0/3846786169 conn(0x7fc4b00b5490 msgr2=0x7fc4b00b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3203200640 1 Processor -- start 2024-04-25T10:04:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3203200640 1 -- start start 2024-04-25T10:04:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 -- 172.21.15.18:0/415362117 >> 172.21.15.18:0/415362117 conn(0x7f9a7c067080 msgr2=0x7f9a7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f5b9f400640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f5b800707b0 0x7f5b80072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f5b9e000640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b80067030 0x7f5b800694f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ba01fe110 tx=0x7f5b900079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f5b9f400640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f5b800707b0 0x7f5b80072bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 -- 172.21.15.18:0/3846786169 shutdown_connections 2024-04-25T10:04:17.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7fc4b8400640 1 -- 172.21.15.18:0/3846786169 wait complete. 2024-04-25T10:04:17.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3a8d600640 1 -- 172.21.15.18:0/858373673 wait complete. 2024-04-25T10:04:17.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f8bbe800640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f8ba0070730 0x7f8ba0072b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 -- start start 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b815c710 0x7f15b81562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15b80b23f0 0x7f15b80b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 0x7f15b815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80cd710 con 0x7f15b815c710 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8071bc0 con 0x7f15b80b23f0 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15c0800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b8165490 con 0x7f15b815caf0 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f15be800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 0x7f15b815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 0x7f15b815cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57564/0 (socket says 172.21.15.18:57564) 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 -- 172.21.15.18:0/439812883 learned_addr learned my addr 172.21.15.18:0/439812883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15bd400640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15b80b23f0 0x7f15b80b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9fa5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa0150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fa00b5cc0 0x7f9fa00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fa0166480 0x7f9fa0164630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3a8d600640 1 Processor -- start 2024-04-25T10:04:17.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f3a8d600640 1 -- start start 2024-04-25T10:04:17.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 -- 172.21.15.18:0/415362117 shutdown_connections 2024-04-25T10:04:17.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.737+0000 7f9a83e00640 1 -- 172.21.15.18:0/415362117 wait complete. 2024-04-25T10:04:17.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 0x7f32040c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32040cf760 0x7f32040cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040d0590 0x7f3204161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15bde00640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b815c710 0x7f15b81562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f8ba0073240 con 0x7f8ba0070730 2024-04-25T10:04:17.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0162fd0 con 0x7f9fa00b5cc0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa0162e50 con 0x7f9fa0166480 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa016eaf0 con 0x7f9fa00b58e0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa0150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fa00b5cc0 0x7f9fa00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa0150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57590/0 (socket says 172.21.15.18:57590) 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 -- 172.21.15.18:0/3743084650 learned_addr learned my addr 172.21.15.18:0/3743084650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9fe00640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fa0166480 0x7f9fa0164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 0x7f32040c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 0x7f32040c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57578/0 (socket says 172.21.15.18:57578) 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040cfcc0 con 0x7f32040cf760 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32040cfb40 con 0x7f32040d0590 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3203200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3204166680 con 0x7f32040b5230 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5b800732c0 con 0x7f5b800707b0 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a880d0aa0 0x7f3a8815ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040d0590 0x7f3204161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3201e00640 1 -- 172.21.15.18:0/428466152 learned_addr learned my addr 172.21.15.18:0/428466152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 -- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15b80b23f0 msgr2=0x7f15b80b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f15b80b23f0 0x7f15b80b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 -- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b815c710 msgr2=0x7f15b81562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b815c710 0x7f15b81562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b80b2880 con 0x7f15b815caf0 2024-04-25T10:04:17.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7fc4b8400640 1 Processor -- start 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 -- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fa0166480 msgr2=0x7f9fa0164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fa0166480 0x7f9fa0164630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 -- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fa00b5cc0 msgr2=0x7f9fa00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fa00b5cc0 0x7f9fa00ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa0152480 con 0x7f9fa00b58e0 2024-04-25T10:04:17.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 0x7f3a88200560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7fc4b8400640 1 -- start start 2024-04-25T10:04:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a88161f00 0x7f3a88200aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 -- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 msgr2=0x7f32040c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 0x7f32040c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 -- 172.21.15.18:0/428466152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32040cf760 msgr2=0x7f32040cc2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32040cf760 0x7f32040cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15be800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 0x7f15b815cf80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f15b81639f0 tx=0x7f15b400f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32040cca50 con 0x7f32040d0590 2024-04-25T10:04:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f9f400640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa0150250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0b0040 tx=0x7f9f8c01acf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a86000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 0x7f3a88200560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a86000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 0x7f3a88200560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57598/0 (socket says 172.21.15.18:57598) 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a880d0aa0 0x7f3a8815ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a86a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a880d0aa0 0x7f3a8815ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41048/0 (socket says 172.21.15.18:41048) 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a86000640 1 -- 172.21.15.18:0/2614061336 learned_addr learned my addr 172.21.15.18:0/2614061336 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880b6ab0 con 0x7f3a880d0aa0 2024-04-25T10:04:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880d2180 con 0x7f3a88161f00 2024-04-25T10:04:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8815e040 con 0x7f3a8815dc60 2024-04-25T10:04:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0bc020 con 0x7f9fa00b58e0 2024-04-25T10:04:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a88161f00 0x7f3a88200aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0b8420 con 0x7f9fa00b58e0 2024-04-25T10:04:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0b2040 con 0x7f9fa00b58e0 2024-04-25T10:04:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9a83e00640 1 Processor -- start 2024-04-25T10:04:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4009c10 con 0x7f15b815caf0 2024-04-25T10:04:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400fd90 con 0x7f15b815caf0 2024-04-25T10:04:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4003be0 con 0x7f15b815caf0 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa0152760 con 0x7f9fa00b58e0 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa0152d20 con 0x7f9fa00b58e0 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 -- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 msgr2=0x7f3a88200560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 0x7f3a88200560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 -- 172.21.15.18:0/2614061336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a880d0aa0 msgr2=0x7f3a8815ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a880d0aa0 0x7f3a8815ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3a87400640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8815fd70 con 0x7f3a88161f00 2024-04-25T10:04:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f9a83e00640 1 -- start start 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a87400640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a88161f00 0x7f3a88200aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a800ac000 tx=0x7f3a80019500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3202800640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040d0590 0x7f3204161110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c390 tx=0x7f31f000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f3201e00640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32040b5230 0x7f32040c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f00074e0 con 0x7f32040d0590 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f0007680 con 0x7f32040d0590 2024-04-25T10:04:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f0004a10 con 0x7f32040d0590 2024-04-25T10:04:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a86000640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a8815dc60 0x7f3a88200560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b80b2b60 con 0x7f15b815caf0 2024-04-25T10:04:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9fa00745d0 con 0x7f9fa00b58e0 2024-04-25T10:04:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.741+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b80b3120 con 0x7f15b815caf0 2024-04-25T10:04:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 0x7fc4b0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32040ccd30 con 0x7f32040d0590 2024-04-25T10:04:17.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320415e6e0 con 0x7f32040d0590 2024-04-25T10:04:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b00cdfd0 0x7fc4b00c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a800b2040 con 0x7f3a88161f00 2024-04-25T10:04:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a800bf070 con 0x7f3a88161f00 2024-04-25T10:04:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80009450 con 0x7f3a88161f00 2024-04-25T10:04:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b0161dc0 0x7fc4b015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a8815f200 con 0x7f3a88161f00 2024-04-25T10:04:17.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b00cdfd0 0x7fc4b00c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a8815f7b0 con 0x7f3a88161f00 2024-04-25T10:04:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 0x7fc4b0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 0x7fc4b0150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38576/0 (socket says 172.21.15.18:38576) 2024-04-25T10:04:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 -- 172.21.15.18:0/2810117014 learned_addr learned my addr 172.21.15.18:0/2810117014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15b80745d0 con 0x7f15b815caf0 2024-04-25T10:04:17.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0162320 con 0x7fc4b0161dc0 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b01621a0 con 0x7fc4b006c2c0 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00d1d60 con 0x7fc4b00cdfd0 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c06e4a0 0x7f9a7c136f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a7c159320 0x7f9a7c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c15f440 0x7f9a7c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c15f820 con 0x7f9a7c159320 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c159700 con 0x7f9a7c06e4a0 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a83e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c15f9a0 con 0x7f9a7c15f440 2024-04-25T10:04:17.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b6400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b0161dc0 0x7fc4b015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a7c159320 0x7f9a7c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c06e4a0 0x7f9a7c136f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a80a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a7c159320 0x7f9a7c157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41066/0 (socket says 172.21.15.18:41066) 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a80a00640 1 -- 172.21.15.18:0/3623541214 learned_addr learned my addr 172.21.15.18:0/3623541214 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c15f440 0x7f9a7c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f8c0bf020 con 0x7f9fa00b58e0 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a60001040 con 0x7f3a88161f00 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 -- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c06e4a0 msgr2=0x7f9a7c136f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c06e4a0 0x7f9a7c136f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 -- 172.21.15.18:0/3623541214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a7c159320 msgr2=0x7f9a7c157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a7c159320 0x7f9a7c157960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81e00640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c137920 con 0x7f9a7c15f440 2024-04-25T10:04:17.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f9a81400640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c06e4a0 0x7f9a7c136f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 -- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b00cdfd0 msgr2=0x7fc4b00c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4b00cdfd0 0x7fc4b00c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 -- 172.21.15.18:0/2810117014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b0161dc0 msgr2=0x7fc4b015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b0161dc0 0x7fc4b015a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7fc4b5a00640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00c9e40 con 0x7fc4b006c2c0 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.745+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31dc001040 con 0x7f32040d0590 2024-04-25T10:04:17.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4b5a00640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 0x7fc4b0150ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00c460 tx=0x7fc49c00c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f97400640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f80067060 0x7f9f80069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c018070 con 0x7fc4b006c2c0 2024-04-25T10:04:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c007480 con 0x7fc4b006c2c0 2024-04-25T10:04:17.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0047f0 con 0x7fc4b006c2c0 2024-04-25T10:04:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9f8c11f6c0 con 0x7f9fa00b58e0 2024-04-25T10:04:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f97400640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f9f800707e0 0x7f9f80072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a81e00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c15f440 0x7f9a7c157ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ac000 tx=0x7f9a700191a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f8c0c8e50 con 0x7f9f800707e0 2024-04-25T10:04:17.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f8c11fab0 con 0x7f9fa00b58e0 2024-04-25T10:04:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a700b1040 con 0x7f9a7c15f440 2024-04-25T10:04:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b00ca120 con 0x7fc4b006c2c0 2024-04-25T10:04:17.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b015f6d0 con 0x7fc4b006c2c0 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a83e00640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c137c00 con 0x7f9a7c15f440 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700ba070 con 0x7f9a7c15f440 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70003b40 con 0x7f9a7c15f440 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a83e00640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c1381c0 con 0x7f9a7c15f440 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9f9ea00640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f80067060 0x7f9f80069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a800adc10 con 0x7f3a88161f00 2024-04-25T10:04:17.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc4b00745d0 con 0x7fc4b006c2c0 2024-04-25T10:04:17.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f15b401f020 con 0x7f15b815caf0 2024-04-25T10:04:17.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a7ea00640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a68067030 0x7f3a680694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f9a83e00640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a7c137470 con 0x7f9a7c15f440 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15b2000640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f159c067260 0x7f159c069720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a80120fc0 con 0x7f3a88161f00 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a86a00640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a68067030 0x7f3a680694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a7ea00640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7f3a680707a0 0x7f3a68072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a680732b0 con 0x7f3a680707a0 2024-04-25T10:04:17.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a801213b0 con 0x7f3a88161f00 2024-04-25T10:04:17.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15bde00640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f159c067260 0x7f159c069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f15b40039a0 con 0x7f15b815caf0 2024-04-25T10:04:17.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9f9ea00640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f80067060 0x7f9f80069520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00ce070 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9f9fe00640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f9f800707e0 0x7f9f80072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a70003ce0 con 0x7f9a7c15f440 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.749+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31f001a020 con 0x7f32040d0590 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f31fa000640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31e4066fb0 0x7f31e4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f31f0085010 con 0x7f32040d0590 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f31fa000640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7f31e4070720 0x7f31e4072b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31f0013e50 con 0x7f31e4070720 2024-04-25T10:04:17.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31f00854f0 con 0x7f32040d0590 2024-04-25T10:04:17.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3201e00640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31e4066fb0 0x7f31e4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a86000640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7f3a680707a0 0x7f3a68072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15b2000640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f159c0709e0 0x7f159c072e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3201400640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7f31e4070720 0x7f31e4072b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9f9fe00640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f9f800707e0 0x7f9f80072c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc49c01b070 con 0x7fc4b006c2c0 2024-04-25T10:04:17.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a5c066f60 0x7f9a5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9a7011f030 con 0x7f9a7c15f440 2024-04-25T10:04:17.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3201e00640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31e4066fb0 0x7f31e4069470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31fc001570 tx=0x7f31fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a81400640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a5c066f60 0x7f9a5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3201400640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7f31e4070720 0x7f31e4072b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7f9a5c0706e0 0x7f9a5c072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a5c0731f0 con 0x7f9a5c0706e0 2024-04-25T10:04:17.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc490067030 0x7fc4900694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a70126050 con 0x7f9a7c15f440 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15bde00640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f159c067260 0x7f159c069720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ab000 tx=0x7f15ac0b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f159c0734f0 con 0x7f159c0709e0 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15b408c050 con 0x7f15b815caf0 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a86a00640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a68067030 0x7f3a680694f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000fc0 tx=0x7f3a78001bc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7f3a86000640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7f3a680707a0 0x7f3a68072be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc49c084580 con 0x7fc4b006c2c0 2024-04-25T10:04:17.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7fc4900707b0 0x7fc490072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:17.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc4900732c0 con 0x7fc4900707b0 2024-04-25T10:04:17.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f9a80a00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7f9a5c0706e0 0x7f9a5c072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f15bd400640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f159c0709e0 0x7f159c072e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.753+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc49c08b050 con 0x7fc4b006c2c0 2024-04-25T10:04:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7fc4b5000640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc490067030 0x7fc4900694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9f8c0c8e50 con 0x7f9f800707e0 2024-04-25T10:04:17.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f9a81400640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a5c066f60 0x7f9a5c069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400e740 tx=0x7f9a7400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7fc4b6400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7fc4900707b0 0x7fc490072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3a680732b0 con 0x7f3a680707a0 2024-04-25T10:04:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f31f0013e50 con 0x7f31e4070720 2024-04-25T10:04:17.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f15bd400640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f159c0709e0 0x7f159c072e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f9a80a00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7f9a5c0706e0 0x7f9a5c072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9a5c0731f0 con 0x7f9a5c0706e0 2024-04-25T10:04:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7fc4b5000640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc490067030 0x7fc4900694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f159c0734f0 con 0x7f159c0709e0 2024-04-25T10:04:17.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.757+0000 7fc4b6400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7fc4900707b0 0x7fc490072bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:17.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.761+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc4900732c0 con 0x7fc4900707b0 2024-04-25T10:04:17.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.769+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ba00745d0 con 0x7f5b800707b0 2024-04-25T10:04:17.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.769+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8bb80053a0 con 0x7f8ba0070730 2024-04-25T10:04:17.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.769+0000 7f5b97400640 1 -- 172.21.15.18:0/3223374469 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ba00745d0 con 0x7f5b800707b0 2024-04-25T10:04:17.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.769+0000 7f8bb6000640 1 -- 172.21.15.18:0/1749218720 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8bb80053a0 con 0x7f8ba0070730 2024-04-25T10:04:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f8ba0070730 msgr2=0x7f8ba0072b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f5b800707b0 msgr2=0x7f5b80072bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f5b800707b0 0x7f5b80072bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f8ba0070730 0x7f8ba0072b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ba0066fb0 msgr2=0x7f8ba0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b80067030 msgr2=0x7f5b800694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b80067030 0x7f5b800694f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ba01fe110 tx=0x7f5b900079c0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ba0066fb0 0x7f8ba0069470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8bb80e0e50 tx=0x7f8bac008040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 msgr2=0x7f5ba0158570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 --2- 172.21.15.18:0/3223374469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ba00b0d30 0x7f5ba0158570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0ac040 tx=0x7f5b8c0192b0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5b9f400640 1 -- 172.21.15.18:0/3223374469 reap_dead start 2024-04-25T10:04:17.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 msgr2=0x7f8bb8188890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 shutdown_connections 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 >> 172.21.15.18:0/3223374469 conn(0x7f5ba0066dd0 msgr2=0x7f5ba00cd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 shutdown_connections 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f5ba5e00640 1 -- 172.21.15.18:0/3223374469 wait complete. 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 --2- 172.21.15.18:0/1749218720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bb803c100 0x7f8bb8188890 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00ae040 tx=0x7f8bb0019270 comp rx=0 tx=0).stop 2024-04-25T10:04:17.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbe800640 1 -- 172.21.15.18:0/1749218720 reap_dead start 2024-04-25T10:04:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 shutdown_connections 2024-04-25T10:04:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 >> 172.21.15.18:0/1749218720 conn(0x7f8bb8058ef0 msgr2=0x7f8bb8058230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 shutdown_connections 2024-04-25T10:04:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.773+0000 7f8bbf200640 1 -- 172.21.15.18:0/1749218720 wait complete. 2024-04-25T10:04:17.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fa00d07b0 con 0x7f9f800707e0 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31dc002d60 con 0x7f31e4070720 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f31fa000640 1 -- 172.21.15.18:0/428466152 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31dc002d60 con 0x7f31e4070720 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7f31e4070720 msgr2=0x7f31e4072b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7f31e4070720 0x7f31e4072b60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31e4066fb0 msgr2=0x7f31e4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31e4066fb0 0x7f31e4069470 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f31fc001570 tx=0x7f31fc009040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040d0590 msgr2=0x7f3204161110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 --2- 172.21.15.18:0/428466152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32040d0590 0x7f3204161110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f31f000c390 tx=0x7f31f000c850 comp rx=0 tx=0).stop 2024-04-25T10:04:17.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f9a83e00640 1 -- 172.21.15.18:0/3623541214 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a7c0745d0 con 0x7f9a5c0706e0 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3202800640 1 -- 172.21.15.18:0/428466152 reap_dead start 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 shutdown_connections 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 >> 172.21.15.18:0/428466152 conn(0x7f320406c000 msgr2=0x7f32041643c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 shutdown_connections 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f3203200640 1 -- 172.21.15.18:0/428466152 wait complete. 2024-04-25T10:04:17.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.785+0000 7f9f97400640 1 -- 172.21.15.18:0/3743084650 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fa00d07b0 con 0x7f9f800707e0 2024-04-25T10:04:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc4b00b2bd0 con 0x7fc4900707b0 2024-04-25T10:04:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a79600640 1 -- 172.21.15.18:0/3623541214 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a7c0745d0 con 0x7f9a5c0706e0 2024-04-25T10:04:17.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a60002de0 con 0x7f3a680707a0 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f9f800707e0 msgr2=0x7f9f80072c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f9f800707e0 0x7f9f80072c20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f80067060 msgr2=0x7f9f80069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f80067060 0x7f9f80069520 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00ce070 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 msgr2=0x7f9fa0150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 --2- 172.21.15.18:0/3743084650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9fa00b58e0 0x7f9fa0150250 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c0b0040 tx=0x7f9f8c01acf0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7f9a5c0706e0 msgr2=0x7f9a5c072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7f9a5c0706e0 0x7f9a5c072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9f9fe00640 1 -- 172.21.15.18:0/3743084650 reap_dead start 2024-04-25T10:04:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 shutdown_connections 2024-04-25T10:04:17.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 >> 172.21.15.18:0/3743084650 conn(0x7f9fa00726e0 msgr2=0x7f9fa0158760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f3a7ea00640 1 -- 172.21.15.18:0/2614061336 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a60002de0 con 0x7f3a680707a0 2024-04-25T10:04:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a5c066f60 msgr2=0x7f9a5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a5c066f60 0x7f9a5c069420 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400e740 tx=0x7f9a7400b040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4ad600640 1 -- 172.21.15.18:0/2810117014 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc4b00b2bd0 con 0x7fc4900707b0 2024-04-25T10:04:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c15f440 msgr2=0x7f9a7c157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 --2- 172.21.15.18:0/3623541214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a7c15f440 0x7f9a7c157ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a700ac000 tx=0x7f9a700191a0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a81e00640 1 -- 172.21.15.18:0/3623541214 reap_dead start 2024-04-25T10:04:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f15b80b1070 con 0x7f159c0709e0 2024-04-25T10:04:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 shutdown_connections 2024-04-25T10:04:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9fa5000640 1 -- 172.21.15.18:0/3743084650 wait complete. 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7fc4900707b0 msgr2=0x7fc490072bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7fc4900707b0 0x7fc490072bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc490067030 msgr2=0x7fc4900694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc490067030 0x7fc4900694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc4a80ae000 tx=0x7fc4a80a7070 comp rx=0 tx=0).stop 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 msgr2=0x7fc4b0150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 --2- 172.21.15.18:0/2810117014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4b006c2c0 0x7fc4b0150ee0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc49c00c460 tx=0x7fc49c00c920 comp rx=0 tx=0).stop 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b6400640 1 -- 172.21.15.18:0/2810117014 reap_dead start 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 shutdown_connections 2024-04-25T10:04:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 >> 172.21.15.18:0/2810117014 conn(0x7fc4b00b5490 msgr2=0x7fc4b015e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f15b2000640 1 -- 172.21.15.18:0/439812883 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f15b80b1070 con 0x7f159c0709e0 2024-04-25T10:04:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 shutdown_connections 2024-04-25T10:04:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7fc4b8400640 1 -- 172.21.15.18:0/2810117014 wait complete. 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 shutdown_connections 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 >> 172.21.15.18:0/3623541214 conn(0x7f9a7c067080 msgr2=0x7f9a7c1422c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 shutdown_connections 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f9a6ea00640 1 -- 172.21.15.18:0/3623541214 wait complete. 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f159c0709e0 msgr2=0x7f159c072e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f15c0800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f159c0709e0 0x7f159c072e20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7f3a680707a0 msgr2=0x7f3a68072be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f3a8d600640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7f3a680707a0 0x7f3a68072be0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.789+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f159c067260 msgr2=0x7f159c069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15c0800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f159c067260 0x7f159c069720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f15ac0ab000 tx=0x7f15ac0b1040 comp rx=0 tx=0).stop 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 msgr2=0x7f15b815cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15c0800640 1 --2- 172.21.15.18:0/439812883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f15b815caf0 0x7f15b815cf80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f15b81639f0 tx=0x7f15b400f580 comp rx=0 tx=0).stop 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15be800640 1 -- 172.21.15.18:0/439812883 reap_dead start 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 shutdown_connections 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 >> 172.21.15.18:0/439812883 conn(0x7f15b8067080 msgr2=0x7f15b80b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a68067030 msgr2=0x7f3a680694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a68067030 0x7f3a680694f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a78000fc0 tx=0x7f3a78001bc0 comp rx=0 tx=0).stop 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a88161f00 msgr2=0x7f3a88200aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 --2- 172.21.15.18:0/2614061336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a88161f00 0x7f3a88200aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3a800ac000 tx=0x7f3a80019500 comp rx=0 tx=0).stop 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a87400640 1 -- 172.21.15.18:0/2614061336 reap_dead start 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 shutdown_connections 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.793+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 >> 172.21.15.18:0/2614061336 conn(0x7f3a880b5490 msgr2=0x7f3a880d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.797+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 shutdown_connections 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.797+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 shutdown_connections 2024-04-25T10:04:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.797+0000 7f15c0800640 1 -- 172.21.15.18:0/439812883 wait complete. 2024-04-25T10:04:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:17.797+0000 7f3a8d600640 1 -- 172.21.15.18:0/2614061336 wait complete. 2024-04-25T10:04:17.841 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-25T10:04:17.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:04:17.843 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:17.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:04:17.844 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-25T10:04:17.844 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:04:17.845 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-25T10:04:17.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:04:17.846 INFO:teuthology.orchestra.run.smithi018.stdout:64424509451 2024-04-25T10:04:17.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:04:17.847 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-25T10:04:17.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:04:17.848 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:17.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:04:17.849 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-25T10:04:17.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:04:18.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.113+0000 7f6119600640 1 Processor -- start 2024-04-25T10:04:18.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.113+0000 7f6119600640 1 -- start start 2024-04-25T10:04:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6119600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6119600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61140cbed0 0x7f61140b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6119600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f611415f3c0 con 0x7f61140cd7f0 2024-04-25T10:04:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6119600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61140b21d0 con 0x7f61140cbed0 2024-04-25T10:04:18.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6119600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61140b3940 con 0x7f611406dcb0 2024-04-25T10:04:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57612/0 (socket says 172.21.15.18:57612) 2024-04-25T10:04:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 -- 172.21.15.18:0/2740191458 learned_addr learned my addr 172.21.15.18:0/2740191458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112000640 1 --2- 172.21.15.18:0/2740191458 >> v2:172.21.15.18:3300/0 conn(0x7f61140cbed0 0x7f61140b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f7f7b800640 1 Processor -- start 2024-04-25T10:04:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 -- 172.21.15.18:0/2740191458 >> v2:172.21.15.18:3300/0 conn(0x7f61140cbed0 msgr2=0x7f61140b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 --2- 172.21.15.18:0/2740191458 >> v2:172.21.15.18:3300/0 conn(0x7f61140cbed0 0x7f61140b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 -- 172.21.15.18:0/2740191458 >> v1:172.21.15.167:6789/0 conn(0x7f61140cd7f0 legacy=0x7f61140cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f6112a00640 1 -- 172.21.15.18:0/2740191458 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140b3c20 con 0x7f611406dcb0 2024-04-25T10:04:18.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.117+0000 7f7f7b800640 1 -- start start 2024-04-25T10:04:18.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f7b800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f78e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f78e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57628/0 (socket says 172.21.15.18:57628) 2024-04-25T10:04:18.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f73e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f7f7415aa20 0x7f7f740b19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47858/0 (socket says 172.21.15.18:47858) 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f7b800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740afb70 con 0x7f7f740b0ca0 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f78e00640 1 -- 172.21.15.18:0/4032115834 learned_addr learned my addr 172.21.15.18:0/4032115834 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f740afe50 con 0x7f7f7415aa20 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f740b0130 con 0x7f7f7406f150 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.121+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4266900963 0 0) 0x7f7f740afe50 con 0x7f7f7415aa20 2024-04-25T10:04:18.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f58003530 con 0x7f7f7415aa20 2024-04-25T10:04:18.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6112a00640 1 --2- 172.21.15.18:0/2740191458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610001c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=528f52f034e024a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f7f78e00640 1 -- 172.21.15.18:0/4032115834 >> v1:172.21.15.167:6789/0 conn(0x7f7f7415aa20 legacy=0x7f7f740b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f7f78e00640 1 -- 172.21.15.18:0/4032115834 >> v1:172.21.15.18:6789/0 conn(0x7f7f740b0ca0 legacy=0x7f7f740cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1450388483 0 0) 0x7f7f58003530 con 0x7f7f7415aa20 2024-04-25T10:04:18.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f7f78e00640 1 -- 172.21.15.18:0/4032115834 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f740b0410 con 0x7f7f7406f150 2024-04-25T10:04:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6111600640 1 -- 172.21.15.18:0/2740191458 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a9680 con 0x7f611406dcb0 2024-04-25T10:04:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6111600640 1 -- 172.21.15.18:0/2740191458 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000a9820 con 0x7f611406dcb0 2024-04-25T10:04:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6111600640 1 -- 172.21.15.18:0/2740191458 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000a9c30 con 0x7f611406dcb0 2024-04-25T10:04:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7fa567c00640 1 Processor -- start 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7fa567c00640 1 -- start start 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 -- 172.21.15.18:0/2740191458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 msgr2=0x7f61140b2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 --2- 172.21.15.18:0/2740191458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6100009870 tx=0x7f610001c5a0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 -- 172.21.15.18:0/2740191458 shutdown_connections 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 --2- 172.21.15.18:0/2740191458 >> v2:172.21.15.18:3300/0 conn(0x7f61140cbed0 0x7f61140b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 --2- 172.21.15.18:0/2740191458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f611406dcb0 0x7f61140b2ff0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 -- 172.21.15.18:0/2740191458 >> 172.21.15.18:0/2740191458 conn(0x7f611406d190 msgr2=0x7f611406d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7fb96e400640 1 Processor -- start 2024-04-25T10:04:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 -- 172.21.15.18:0/2740191458 shutdown_connections 2024-04-25T10:04:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7f6119600640 1 -- 172.21.15.18:0/2740191458 wait complete. 2024-04-25T10:04:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.125+0000 7fb96e400640 1 -- start start 2024-04-25T10:04:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f78e00640 1 --2- 172.21.15.18:0/4032115834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009e80 tx=0x7f7f6c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73efc9d5379a5762 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb96e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f6119600640 1 Processor -- start 2024-04-25T10:04:18.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64001680 con 0x7f7f7406f150 2024-04-25T10:04:18.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c0090d0 con 0x7f7f7406f150 2024-04-25T10:04:18.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f73400640 1 -- 172.21.15.18:0/4032115834 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0a5550 con 0x7f7f7406f150 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f6119600640 1 -- start start 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb96e400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 0x7fb968099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb96e400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9680d02a0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb96e400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9680cc350 con 0x7fb96815bcf0 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb96e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9680cc630 con 0x7fb96815b910 2024-04-25T10:04:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57632/0 (socket says 172.21.15.18:57632) 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 -- 172.21.15.18:0/3414309742 learned_addr learned my addr 172.21.15.18:0/3414309742 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5600ccbf0 0x7fa56015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 0x7fa5600b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa565200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5600ccbf0 0x7fa56015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa565200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57630/0 (socket says 172.21.15.18:57630) 2024-04-25T10:04:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5600ccbf0 0x7fa56015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38592/0 (socket says 172.21.15.18:38592) 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa565c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 0x7fa5600b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa565c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 0x7fa5600b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41086/0 (socket says 172.21.15.18:41086) 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56015e490 con 0x7fa56015ee60 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa56015bc40 con 0x7fa5600ccbf0 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa567c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56015b3a0 con 0x7fa560144120 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa565200640 1 -- 172.21.15.18:0/137923050 learned_addr learned my addr 172.21.15.18:0/137923050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f6119600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611406dcb0 0x7f611413aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967e00640 1 --2- 172.21.15.18:0/3414309742 >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 0x7fb968099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 msgr2=0x7f7f74150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 --2- 172.21.15.18:0/4032115834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009e80 tx=0x7f7f6c01c990 comp rx=0 tx=0).stop 2024-04-25T10:04:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 shutdown_connections 2024-04-25T10:04:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 --2- 172.21.15.18:0/4032115834 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7406f150 0x7f7f74150810 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 >> 172.21.15.18:0/4032115834 conn(0x7f7f74066dd0 msgr2=0x7f7f7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f6119600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 shutdown_connections 2024-04-25T10:04:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 -- 172.21.15.18:0/3414309742 >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 msgr2=0x7fb968099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 --2- 172.21.15.18:0/3414309742 >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 0x7fb968099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fb967400640 1 -- 172.21.15.18:0/3414309742 >> v1:172.21.15.18:6789/0 conn(0x7fb9680cf3c0 legacy=0x7fb9680cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 0x7f61141670e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7fb967400640 1 -- 172.21.15.18:0/3414309742 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680cc910 con 0x7fb96815b910 2024-04-25T10:04:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7fb967e00640 1 --2- 172.21.15.18:0/3414309742 >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 0x7fb968099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6112000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6112000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57644/0 (socket says 172.21.15.18:57644) 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6112000640 1 -- 172.21.15.18:0/2499860014 learned_addr learned my addr 172.21.15.18:0/2499860014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6114166010 con 0x7f611406dcb0 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 0x7f61141670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61140ce780 con 0x7f61140cd7f0 2024-04-25T10:04:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6114166190 con 0x7f61140cbed0 2024-04-25T10:04:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 -- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 msgr2=0x7fa56015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 -- 172.21.15.18:0/137923050 >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 msgr2=0x7fa5600b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 --2- 172.21.15.18:0/137923050 >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 0x7fa5600b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.129+0000 7fa55fe00640 1 -- 172.21.15.18:0/137923050 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56015b680 con 0x7fa5600ccbf0 2024-04-25T10:04:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 -- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 msgr2=0x7f61141568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 -- 172.21.15.18:0/2499860014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611406dcb0 msgr2=0x7f611413aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611406dcb0 0x7f611413aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611413b400 con 0x7f61140cd7f0 2024-04-25T10:04:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f7f7b800640 1 -- 172.21.15.18:0/4032115834 wait complete. 2024-04-25T10:04:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f7f7b800640 1 Processor -- start 2024-04-25T10:04:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6112000640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:18.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6113400640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 0x7f61141670e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f610c00c730 tx=0x7f610c00cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f7f7b800640 1 -- start start 2024-04-25T10:04:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c016020 con 0x7f61140cd7f0 2024-04-25T10:04:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610c006d60 con 0x7f61140cd7f0 2024-04-25T10:04:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610c003bc0 con 0x7f61140cd7f0 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6114159f30 con 0x7f61140cd7f0 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f7f7b800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 0x7f7f740b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f7f7b800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 0x7f7f74151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 0x7f7f7414f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74167af0 con 0x7f7f740b0ca0 2024-04-25T10:04:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74167970 con 0x7f7f7406f150 2024-04-25T10:04:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.133+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f611415a790 con 0x7f61140cd7f0 2024-04-25T10:04:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f74167c70 con 0x7f7f7415aa20 2024-04-25T10:04:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f79800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 0x7f7f7414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f79800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 0x7f7f7414f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57658/0 (socket says 172.21.15.18:57658) 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f79800640 1 -- 172.21.15.18:0/1166481513 learned_addr learned my addr 172.21.15.18:0/1166481513 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 0x7f7f74151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 -- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 msgr2=0x7f7f7414f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 0x7f7f7414f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 -- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 msgr2=0x7f7f740b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa565200640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa55fe00640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5600ccbf0 0x7fa56015e920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa56006f780 tx=0x7fa54c024b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1081463aec88839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa55f400640 1 -- 172.21.15.18:0/137923050 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0112d0 con 0x7fa5600ccbf0 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f78e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 0x7f7f740b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa55f400640 1 -- 172.21.15.18:0/137923050 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c011470 con 0x7fa5600ccbf0 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa55f400640 1 -- 172.21.15.18:0/137923050 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00f850 con 0x7fa5600ccbf0 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 0x7f7f740b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 -- 172.21.15.18:0/1166481513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f74152a20 con 0x7f7f740b0ca0 2024-04-25T10:04:18.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f78e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 0x7f7f740b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61140745d0 con 0x7f61140cd7f0 2024-04-25T10:04:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f73e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 0x7f7f74151b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c740 tx=0x7f7f6400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fb967400640 1 --2- 172.21.15.18:0/3414309742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb958009870 tx=0x7fb95801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a00ac159c41bf28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64018070 con 0x7f7f740b0ca0 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fb966000640 1 -- 172.21.15.18:0/3414309742 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580ab640 con 0x7fb96815b910 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fb966000640 1 -- 172.21.15.18:0/3414309742 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9580b0070 con 0x7fb96815b910 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fb966000640 1 -- 172.21.15.18:0/3414309742 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580aba00 con 0x7fb96815b910 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 -- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5600ccbf0 msgr2=0x7fa56015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5600ccbf0 0x7fa56015e920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa56006f780 tx=0x7fa54c024b00 comp rx=0 tx=0).stop 2024-04-25T10:04:18.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 -- 172.21.15.18:0/137923050 shutdown_connections 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 --2- 172.21.15.18:0/137923050 >> v2:172.21.15.18:3300/0 conn(0x7fa56015ee60 0x7fa5600b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5600ccbf0 0x7fa56015e920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 --2- 172.21.15.18:0/137923050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa560144120 0x7fa56015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 -- 172.21.15.18:0/137923050 >> 172.21.15.18:0/137923050 conn(0x7fa560067080 msgr2=0x7fa56006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 -- 172.21.15.18:0/137923050 shutdown_connections 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f610c0050d0 con 0x7f61140cd7f0 2024-04-25T10:04:18.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7974600640 1 Processor -- start 2024-04-25T10:04:18.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 Processor -- start 2024-04-25T10:04:18.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f610aa00640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 0x7f60f4069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f610c084e30 con 0x7f61140cd7f0 2024-04-25T10:04:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6400ce50 con 0x7f7f740b0ca0 2024-04-25T10:04:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f64007530 con 0x7f7f740b0ca0 2024-04-25T10:04:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 -- 172.21.15.18:0/1166481513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f74152cc0 con 0x7f7f740b0ca0 2024-04-25T10:04:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7f7b800640 1 -- 172.21.15.18:0/1166481513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f74151320 con 0x7f7f740b0ca0 2024-04-25T10:04:18.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7fa567c00640 1 -- 172.21.15.18:0/137923050 wait complete. 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.137+0000 7f7974600640 1 -- start start 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7974600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f796c071980 0x7f796c163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7974600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0cd470 con 0x7f796c15c330 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7974600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c06dab0 con 0x7f796c15c710 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7974600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c0af0e0 con 0x7f796c071980 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7971c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f796c15c330 0x7f796c06d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59106/0 (socket says 172.21.15.18:59106) 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7971c00640 1 -- 172.21.15.18:0/1181122370 learned_addr learned my addr 172.21.15.18:0/1181122370 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:18.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 -- 172.21.15.18:0/3414309742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 msgr2=0x7fb9680cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7406bba0 con 0x7f7f740b0ca0 2024-04-25T10:04:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f6112a00640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 0x7f60f4069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817082542 0 0) 0x7f796c0cd470 con 0x7f796c15c330 2024-04-25T10:04:18.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 --2- 172.21.15.18:0/3414309742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb958009870 tx=0x7fb95801c530 comp rx=0 tx=0).stop 2024-04-25T10:04:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7950003530 con 0x7f796c15c330 2024-04-25T10:04:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f7972600640 1 --2- 172.21.15.18:0/1181122370 >> v2:172.21.15.167:3300/0 conn(0x7f796c071980 0x7f796c163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 -- start start 2024-04-25T10:04:18.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 0x7fe4580cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe4580cd540 0x7fe4580cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe45815ba60 con 0x7fe4580ce750 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4580cf070 con 0x7fe4580cd540 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580b2a10 con 0x7fe45815b5d0 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fa567c00640 1 Processor -- start 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 -- 172.21.15.18:0/3414309742 shutdown_connections 2024-04-25T10:04:18.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 --2- 172.21.15.18:0/3414309742 >> v2:172.21.15.18:3300/0 conn(0x7fb96815bcf0 0x7fb968099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 --2- 172.21.15.18:0/3414309742 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb96815b910 0x7fb9680cf9a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 -- 172.21.15.18:0/3414309742 >> 172.21.15.18:0/3414309742 conn(0x7fb9680b3200 msgr2=0x7fb9680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f6112a00640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 0x7f60f4069520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61000ae000 tx=0x7f6100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 -- 172.21.15.18:0/3414309742 shutdown_connections 2024-04-25T10:04:18.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fa567c00640 1 -- start start 2024-04-25T10:04:18.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941458901 0 0) 0x7f7950003530 con 0x7f796c15c330 2024-04-25T10:04:18.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fb96e400640 1 -- 172.21.15.18:0/3414309742 wait complete. 2024-04-25T10:04:18.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 >> v2:172.21.15.167:3300/0 conn(0x7f796c071980 msgr2=0x7f796c163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 --2- 172.21.15.18:0/1181122370 >> v2:172.21.15.167:3300/0 conn(0x7f796c071980 0x7f796c163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 >> v1:172.21.15.167:6789/0 conn(0x7f796c15c710 legacy=0x7f796c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57666/0 (socket says 172.21.15.18:57666) 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.141+0000 7fe45de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 0x7fe4580cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 -- 172.21.15.18:0/1308878764 learned_addr learned my addr 172.21.15.18:0/1308878764 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c06dd90 con 0x7f796c15c330 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45e800640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.167:3300/0 conn(0x7fe4580cd540 0x7fe4580cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 -- 172.21.15.18:0/1308878764 >> v2:172.21.15.167:3300/0 conn(0x7fe4580cd540 msgr2=0x7fe4580cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.167:3300/0 conn(0x7fe4580cd540 0x7fe4580cd970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 -- 172.21.15.18:0/1308878764 >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 msgr2=0x7fe4580cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 0x7fe4580cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45d400640 1 -- 172.21.15.18:0/1308878764 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580b2cf0 con 0x7fe45815b5d0 2024-04-25T10:04:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7f6401b070 con 0x7f7f740b0ca0 2024-04-25T10:04:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fb96e400640 1 Processor -- start 2024-04-25T10:04:18.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f3a73400640 1 Processor -- start 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f610c020020 con 0x7f61140cd7f0 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 0x7fa5600a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa56015ee60 0x7fa5600afe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560071e50 con 0x7fa56015ee60 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560071cd0 con 0x7fa560144120 2024-04-25T10:04:18.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa567c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560071fd0 con 0x7fa5600ccbf0 2024-04-25T10:04:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fe45de00640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 0x7fe4580cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fb96e400640 1 -- start start 2024-04-25T10:04:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f7f70c00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 0x7f7f54069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7f64084ac0 con 0x7f7f740b0ca0 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f795c0016a0 con 0x7f796c15c330 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 >> v1:172.21.15.18:6789/0 conn(0x7f796c15c330 legacy=0x7f796c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79500039c0 0x7f7950003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7950004810 0x7f7950004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f795000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795000c190 con 0x7f79500039c0 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795000c340 con 0x7f79500052f0 2024-04-25T10:04:18.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795000c540 con 0x7f7950004810 2024-04-25T10:04:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa565200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa565200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57670/0 (socket says 172.21.15.18:57670) 2024-04-25T10:04:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa565200640 1 -- 172.21.15.18:0/2409822482 learned_addr learned my addr 172.21.15.18:0/2409822482 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa55fe00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 0x7fa5600a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f7f78e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 0x7f7f54069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb96815b910 0x7fb9680b62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb96815bcf0 0x7fb96814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96806bea0 con 0x7fb96815bcf0 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96806bd20 con 0x7fb96815b910 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb96e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96806c020 con 0x7fb9680cf3c0 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7fa565c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa56015ee60 0x7fa5600afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.145+0000 7f3a73400640 1 -- start start 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a73400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a6c159c80 0x7f3a6c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a73400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a73400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0ce120 con 0x7f3a6c1598a0 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a73400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c06e810 con 0x7f3a6c159c80 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a73400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b3610 con 0x7f3a6c06f290 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7971200640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7950004810 0x7f7950004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7971c00640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79500039c0 0x7f7950003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f795000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a71400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a70a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a6c1598a0 0x7f3a6c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59122/0 (socket says 172.21.15.18:59122) 2024-04-25T10:04:18.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a70a00640 1 -- 172.21.15.18:0/880648054 learned_addr learned my addr 172.21.15.18:0/880648054 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:18.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57704/0 (socket says 172.21.15.18:57704) 2024-04-25T10:04:18.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 -- 172.21.15.18:0/212764664 learned_addr learned my addr 172.21.15.18:0/212764664 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 -- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 msgr2=0x7fa5600ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a63e00640 1 --2- 172.21.15.18:0/880648054 >> v2:172.21.15.18:3300/0 conn(0x7f3a6c159c80 0x7f3a6c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45d400640 1 --2- 172.21.15.18:0/1308878764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe45815df90 tx=0x7fe44801eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f66dc884e95bd45b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb966a00640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb96815b910 0x7fb9680b62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a71400640 1 -- 172.21.15.18:0/880648054 >> v2:172.21.15.18:3300/0 conn(0x7f3a6c159c80 msgr2=0x7f3a6c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a71400640 1 --2- 172.21.15.18:0/880648054 >> v2:172.21.15.18:3300/0 conn(0x7f3a6c159c80 0x7f3a6c06e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a71400640 1 -- 172.21.15.18:0/880648054 >> v1:172.21.15.18:6789/0 conn(0x7f3a6c1598a0 legacy=0x7f3a6c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f3a71400640 1 -- 172.21.15.18:0/880648054 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0ce400 con 0x7f3a6c06f290 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7f78e00640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 0x7f7f54069470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0ae000 tx=0x7f7f6c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 -- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb96815b910 msgr2=0x7fb9680b62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb96815b910 0x7fb9680b62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 -- 172.21.15.18:0/212764664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb96815bcf0 msgr2=0x7fb96814a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb96815bcf0 0x7fb96814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 -- 172.21.15.18:0/212764664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9680b67e0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45ca00640 1 -- 172.21.15.18:0/1308878764 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480b4070 con 0x7fe45815b5d0 2024-04-25T10:04:18.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 -- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7950004810 msgr2=0x7f7950004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 -- 172.21.15.18:0/2409822482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa56015ee60 msgr2=0x7fa5600afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa56015ee60 0x7fa5600afe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 -- 172.21.15.18:0/2409822482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600ae830 con 0x7fa560144120 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45ca00640 1 -- 172.21.15.18:0/1308878764 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480a7960 con 0x7fe45815b5d0 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55fe00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 0x7fa5600a85a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b3000 tx=0x7fa54c0218a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa565200640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45ca00640 1 -- 172.21.15.18:0/1308878764 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480a7d30 con 0x7fe45815b5d0 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7950004810 0x7f7950004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 -- 172.21.15.18:0/1181122370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79500039c0 msgr2=0x7f7950003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79500039c0 0x7f7950003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7972600640 1 -- 172.21.15.18:0/1181122370 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950003530 con 0x7f79500052f0 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7971200640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7950004810 0x7f7950004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:18.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7f7971c00640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79500039c0 0x7f7950003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45f200640 1 -- 172.21.15.18:0/1308878764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 msgr2=0x7fe4580ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fb967400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9580ad040 tx=0x7fb95801ad70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0c4020 con 0x7fa560144120 2024-04-25T10:04:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0ad770 con 0x7fa560144120 2024-04-25T10:04:18.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0c4020 con 0x7fa560144120 2024-04-25T10:04:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.149+0000 7fe45f200640 1 --2- 172.21.15.18:0/1308878764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe45815df90 tx=0x7fe44801eb10 comp rx=0 tx=0).stop 2024-04-25T10:04:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 -- 172.21.15.18:0/1308878764 shutdown_connections 2024-04-25T10:04:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.167:3300/0 conn(0x7fe4580cd540 0x7fe4580cd970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 --2- 172.21.15.18:0/1308878764 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe4580ceb30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 --2- 172.21.15.18:0/1308878764 >> v2:172.21.15.18:3300/0 conn(0x7fe4580ce750 0x7fe4580cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 -- 172.21.15.18:0/1308878764 >> 172.21.15.18:0/1308878764 conn(0x7fe458099a60 msgr2=0x7fe4580b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 -- 172.21.15.18:0/1308878764 shutdown_connections 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fe45f200640 1 -- 172.21.15.18:0/1308878764 wait complete. 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580be3f0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9580be5b0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580be9a0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5600ae040 con 0x7fa560144120 2024-04-25T10:04:18.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560159080 con 0x7fa560144120 2024-04-25T10:04:18.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5600745d0 con 0x7fa560144120 2024-04-25T10:04:18.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7f3a71400640 1 --2- 172.21.15.18:0/880648054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c06f720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a640087c0 tx=0x7f3a6401e970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b60228a7b7728db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9680c2c00 con 0x7fb9680cf3c0 2024-04-25T10:04:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9680c31c0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7f7972600640 1 -- 172.21.15.18:0/1181122370 reap_dead start 2024-04-25T10:04:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7f3a6be00640 1 -- 172.21.15.18:0/880648054 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640ad070 con 0x7f3a6c06f290 2024-04-25T10:04:18.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa54c0c7020 con 0x7fa560144120 2024-04-25T10:04:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7f3a6be00640 1 -- 172.21.15.18:0/880648054 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a640a78f0 con 0x7f3a6c06f290 2024-04-25T10:04:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.153+0000 7f3a6be00640 1 -- 172.21.15.18:0/880648054 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a640a7cc0 con 0x7f3a6c06f290 2024-04-25T10:04:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 Processor -- start 2024-04-25T10:04:18.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 -- start start 2024-04-25T10:04:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7f64022020 con 0x7f7f740b0ca0 2024-04-25T10:04:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f7972600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f795000b9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796c0cd020 tx=0x7f796401cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8daf6089b31aa11f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9680745d0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 -- 172.21.15.18:0/880648054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 msgr2=0x7f3a6c06f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 --2- 172.21.15.18:0/880648054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c06f720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a640087c0 tx=0x7f3a6401e970 comp rx=0 tx=0).stop 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 -- 172.21.15.18:0/880648054 shutdown_connections 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 --2- 172.21.15.18:0/880648054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c06f720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 --2- 172.21.15.18:0/880648054 >> v2:172.21.15.18:3300/0 conn(0x7f3a6c159c80 0x7f3a6c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 -- 172.21.15.18:0/880648054 >> 172.21.15.18:0/880648054 conn(0x7f3a6c06b010 msgr2=0x7f3a6c06b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 -- 172.21.15.18:0/880648054 shutdown_connections 2024-04-25T10:04:18.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f2f12e00640 1 Processor -- start 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 0x7fe4580b6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 0x7fe4580b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe45806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45815e420 con 0x7fe4580ce750 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45815e2a0 con 0x7fe4580cd540 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45815e5a0 con 0x7fe45815b5d0 2024-04-25T10:04:18.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fa55cc00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 0x7fa540069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa54c128150 con 0x7fa560144120 2024-04-25T10:04:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f2f12e00640 1 -- start start 2024-04-25T10:04:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb9580b43f0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7f3a73400640 1 -- 172.21.15.18:0/880648054 wait complete. 2024-04-25T10:04:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fa565200640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 0x7fa540069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 0x7fe4580b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 0x7fe4580b6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38682/0 (socket says 172.21.15.18:38682) 2024-04-25T10:04:18.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45de00640 1 -- 172.21.15.18:0/2197258270 learned_addr learned my addr 172.21.15.18:0/2197258270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 0x7fe4580b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45e800640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe45806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 -- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 msgr2=0x7fe45806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe45806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 -- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 msgr2=0x7fe4580b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 0x7fe4580b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 -- 172.21.15.18:0/2197258270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45813db50 con 0x7fe4580ce750 2024-04-25T10:04:18.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fb95f400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 0x7fb948069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fa565200640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 0x7fa540069620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa55000dd80 tx=0x7fa55000f040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb95811f640 con 0x7fb9680cf3c0 2024-04-25T10:04:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fe45d400640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 0x7fe4580b37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4480ae000 tx=0x7fe44801b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.157+0000 7fb966a00640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 0x7fb948069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480bd070 con 0x7fe4580ce750 2024-04-25T10:04:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480af720 con 0x7fe4580ce750 2024-04-25T10:04:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4580b5640 con 0x7fe4580ce750 2024-04-25T10:04:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480b4040 con 0x7fe4580ce750 2024-04-25T10:04:18.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4580b5c00 con 0x7fe4580ce750 2024-04-25T10:04:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fb966a00640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 0x7fb948069470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb968166610 tx=0x7fb960009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f12e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f0c157610 0x7f2f0c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f3a73400640 1 Processor -- start 2024-04-25T10:04:18.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa54c0ce030 con 0x7fa560144120 2024-04-25T10:04:18.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f3a73400640 1 -- start start 2024-04-25T10:04:18.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4580745d0 con 0x7fe4580ce750 2024-04-25T10:04:18.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640b2070 con 0x7f79500052f0 2024-04-25T10:04:18.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79640a5be0 con 0x7f79500052f0 2024-04-25T10:04:18.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f796be00640 1 -- 172.21.15.18:0/1181122370 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79580013a0 con 0x7f79500052f0 2024-04-25T10:04:18.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f12e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f0c071270 0x7f2f0c071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f03400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f2f0c15aa10 0x7f2f0c0cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47884/0 (socket says 172.21.15.18:47884) 2024-04-25T10:04:18.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f03400640 1 -- 172.21.15.18:0/2598962601 learned_addr learned my addr 172.21.15.18:0/2598962601 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:18.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f12e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c0b2c20 con 0x7f2f0c15aa10 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b3a40 con 0x7f2f0c157610 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124316791 0 0) 0x7f2f0c0b2c20 con 0x7f2f0c15aa10 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1579f0 con 0x7f2f0c071270 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ef0003530 con 0x7f2f0c15aa10 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f7974600640 1 -- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 msgr2=0x7f795000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f7974600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f795000b9d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f796c0cd020 tx=0x7f796401cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f10e00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f0c071270 0x7f2f0c071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.1 v1:172.21.15.167:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 123141115 0 0) 0x7f2ef0003530 con 0x7f2f0c15aa10 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f0c071270 msgr2=0x7f2f0c071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f0c071270 0x7f2f0c071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 >> v2:172.21.15.18:3300/0 conn(0x7f2f0c157610 msgr2=0x7f2f0c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> v2:172.21.15.18:3300/0 conn(0x7f2f0c157610 0x7f2f0c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4580cb680 con 0x7fe4580ce750 2024-04-25T10:04:18.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 --2- 172.21.15.18:0/2598962601 >> v2:172.21.15.18:3300/0 conn(0x7f2f0c157610 0x7f2f0c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 --> v1:172.21.15.167:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0b2f00 con 0x7f2f0c15aa10 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.1 v1:172.21.15.167:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f2ef4001680 con 0x7f2f0c15aa10 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 >> v1:172.21.15.167:6789/0 conn(0x7f2f0c15aa10 legacy=0x7f2f0c0cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.161+0000 7f2f0b400640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef0003b90 0x7f2ef0005fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0b400640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ef0006770 0x7f2ef0008c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0b400640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef00094a0 0x7f2ef000b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b3a40 con 0x7f2ef0003b90 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1579f0 con 0x7f2ef0006770 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef000c240 con 0x7f2ef00094a0 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a6c159c80 0x7f3a6c14a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0cf1c0 con 0x7f3a6c159c80 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f10e00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f0c071270 0x7f2f0c071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> v2:172.21.15.18:3300/0 conn(0x7f2f0c157610 0x7f2f0c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7fe452000640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b2e10 con 0x7f3a6c1598a0 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a73400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0ae970 con 0x7f3a6c06f290 2024-04-25T10:04:18.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a70a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fe44811eb70 con 0x7fe4580ce750 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38686/0 (socket says 172.21.15.18:38686) 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 -- 172.21.15.18:0/631063335 learned_addr learned my addr 172.21.15.18:0/631063335 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 -- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 msgr2=0x7f3a6c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 -- 172.21.15.18:0/631063335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a6c159c80 msgr2=0x7f3a6c14a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a6c159c80 0x7f3a6c14a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 -- 172.21.15.18:0/631063335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c153210 con 0x7f3a6c1598a0 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7fe45de00640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f10e00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef00094a0 0x7f2ef000b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f03400640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ef0006770 0x7f2ef0008c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef0003b90 0x7f2ef0005fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 -- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef00094a0 msgr2=0x7f2ef000b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef00094a0 0x7f2ef000b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 -- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ef0006770 msgr2=0x7f2ef0008c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ef0006770 0x7f2ef0008c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f2f0be00640 1 -- 172.21.15.18:0/2598962601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c0b2f00 con 0x7f2ef0003b90 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb958016150 con 0x7fb9680cf3c0 2024-04-25T10:04:18.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a63e00640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400c7f0 tx=0x7f3a5400ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54015070 con 0x7f3a6c1598a0 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a54007820 con 0x7f3a6c1598a0 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a54007c10 con 0x7f3a6c1598a0 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f7974600640 1 -- 172.21.15.18:0/1181122370 shutdown_connections 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f7974600640 1 --2- 172.21.15.18:0/1181122370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f795000b9d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.165+0000 7f7974600640 1 -- 172.21.15.18:0/1181122370 >> 172.21.15.18:0/1181122370 conn(0x7f796c067080 msgr2=0x7f796c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c1534f0 con 0x7f3a6c1598a0 2024-04-25T10:04:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c15a340 con 0x7f3a6c1598a0 2024-04-25T10:04:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a6c0745d0 con 0x7f3a6c1598a0 2024-04-25T10:04:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef0003b90 0x7f2ef0005fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c410 tx=0x7f2efc01d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c17d1ab8f2e1f03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7fe45de00640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe44c006fd0 tx=0x7fe44c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f7974600640 1 -- 172.21.15.18:0/1181122370 shutdown_connections 2024-04-25T10:04:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f7974600640 1 -- 172.21.15.18:0/1181122370 wait complete. 2024-04-25T10:04:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f7974600640 1 Processor -- start 2024-04-25T10:04:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.169+0000 7f7974600640 1 -- start start 2024-04-25T10:04:18.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc007c00 con 0x7f2ef0003b90 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f796c1560b0 0x7f796c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f796c1495f0 0x7f796c149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c1631c0 con 0x7f796c1560b0 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c163040 con 0x7f79500052f0 2024-04-25T10:04:18.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7974600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c163340 con 0x7f796c1495f0 2024-04-25T10:04:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe448018820 con 0x7fe4580ce750 2024-04-25T10:04:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38706/0 (socket says 172.21.15.18:38706) 2024-04-25T10:04:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 -- 172.21.15.18:0/3058877014 learned_addr learned my addr 172.21.15.18:0/3058877014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7972600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f796c1495f0 0x7f796c149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc003ba0 con 0x7f2ef0003b90 2024-04-25T10:04:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f0b400640 1 -- 172.21.15.18:0/2598962601 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc007c00 con 0x7f2ef0003b90 2024-04-25T10:04:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a54018070 con 0x7f3a6c1598a0 2024-04-25T10:04:18.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971200640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f796c1560b0 0x7f796c156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 -- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f796c1495f0 msgr2=0x7f796c149a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f796c1495f0 0x7f796c149a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 -- 172.21.15.18:0/3058877014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f796c1560b0 msgr2=0x7f796c156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f796c1560b0 0x7f796c156530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 -- 172.21.15.18:0/3058877014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b12e0 con 0x7f79500052f0 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f7971c00640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f795c00e7b0 tx=0x7f795c00ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef0003b90 msgr2=0x7f2ef0005fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f12e00640 1 --2- 172.21.15.18:0/2598962601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef0003b90 0x7f2ef0005fc0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c410 tx=0x7f2efc01d050 comp rx=0 tx=0).stop 2024-04-25T10:04:18.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f3a69600640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 0x7f3a480694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.173+0000 7f2f10e00640 1 -- 172.21.15.18:0/2598962601 reap_dead start 2024-04-25T10:04:18.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 shutdown_connections 2024-04-25T10:04:18.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3a540851b0 con 0x7f3a6c1598a0 2024-04-25T10:04:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 >> 172.21.15.18:0/2598962601 conn(0x7f2f0c067080 msgr2=0x7f2f0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 shutdown_connections 2024-04-25T10:04:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f3a70a00640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 0x7f3a480694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f3a70a00640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 0x7f3a480694f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c1f9e90 tx=0x7f3a5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00c8d0 con 0x7f79500052f0 2024-04-25T10:04:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c018070 con 0x7f79500052f0 2024-04-25T10:04:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.177+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c00ccb0 con 0x7f79500052f0 2024-04-25T10:04:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a54055e60 con 0x7f3a6c1598a0 2024-04-25T10:04:18.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c156a70 con 0x7f79500052f0 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c150060 con 0x7f79500052f0 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f2f12e00640 1 -- 172.21.15.18:0/2598962601 wait complete. 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f2f12e00640 1 Processor -- start 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.181+0000 7f2f12e00640 1 -- start start 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f0c150860 0x7f2f0c14f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f795c01d460 con 0x7f79500052f0 2024-04-25T10:04:18.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f7969600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 0x7f794c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57762/0 (socket says 172.21.15.18:57762) 2024-04-25T10:04:18.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f795c085040 con 0x7f79500052f0 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f0c150860 0x7f2f0c14f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 -- 172.21.15.18:0/2078366141 learned_addr learned my addr 172.21.15.18:0/2078366141 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f0c0a9650 0x7f2f0c0a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c071a90 con 0x7f2f0c150860 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b46c0 con 0x7f2f0c0a9650 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c152b50 con 0x7f2ef0003b90 2024-04-25T10:04:18.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c0745d0 con 0x7f79500052f0 2024-04-25T10:04:18.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f10e00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f0c0a9650 0x7f2f0c0a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f7971200640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 0x7f794c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 -- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f0c0a9650 msgr2=0x7f2f0c0a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f0c0a9650 0x7f2f0c0a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 -- 172.21.15.18:0/2078366141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f0c150860 msgr2=0x7f2f0c14f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f0c150860 0x7f2f0c14f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.185+0000 7f2f0be00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c153b90 con 0x7f2ef0003b90 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f0be00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2efc01ce80 tx=0x7f2ef0003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f7971200640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 0x7f794c069520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d8a0 tx=0x7f7958009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0bb030 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc0039a0 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c152dd0 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0074e0 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c153390 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.189+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0745d0 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2efc0be030 con 0x7f2ef0003b90 2024-04-25T10:04:18.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f795c055d80 con 0x7f79500052f0 2024-04-25T10:04:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f2f08c00640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 0x7f2ee80694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2efc120ce0 con 0x7f2ef0003b90 2024-04-25T10:04:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f2f03400640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 0x7f2ee80694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:18.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.193+0000 7f2f03400640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 0x7f2ee80694f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001ec0 tx=0x7f2ef4001460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:18.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.197+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2efc016df0 con 0x7f2ef0003b90 2024-04-25T10:04:18.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.489+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61140cdfe0 con 0x7f61140cd7f0 2024-04-25T10:04:18.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.489+0000 7f610aa00640 1 -- 172.21.15.18:0/2499860014 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f610c055ae0 con 0x7f61140cd7f0 2024-04-25T10:04:18.500 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:18.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 msgr2=0x7f60f4069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 0x7f60f4069520 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61000ae000 tx=0x7f6100008040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 msgr2=0x7f61141670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 0x7f61141670e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f610c00c730 tx=0x7f610c00cbf0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 shutdown_connections 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61140cd7f0 0x7f61141670e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4067060 0x7f60f4069520 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61000ae000 tx=0x7f6100008040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61140cbed0 0x7f61141568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 --2- 172.21.15.18:0/2499860014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611406dcb0 0x7f611413aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 >> 172.21.15.18:0/2499860014 conn(0x7f611406d190 msgr2=0x7f61140717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 shutdown_connections 2024-04-25T10:04:18.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.497+0000 7f6119600640 1 -- 172.21.15.18:0/2499860014 wait complete. 2024-04-25T10:04:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.505+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f7f74150e60 con 0x7f7f740b0ca0 2024-04-25T10:04:18.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.505+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa5600cc310 con 0x7fa560144120 2024-04-25T10:04:18.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.505+0000 7fa55cc00640 1 -- 172.21.15.18:0/2409822482 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa54c01e780 con 0x7fa560144120 2024-04-25T10:04:18.516 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-25T10:04:18.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7f7f70c00640 1 -- 172.21.15.18:0/1166481513 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7f74150e60 con 0x7f7f740b0ca0 2024-04-25T10:04:18.516 INFO:teuthology.orchestra.run.smithi018.stdout:60129542151 2024-04-25T10:04:18.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 msgr2=0x7fa540069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 0x7fa540069620 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa55000dd80 tx=0x7fa55000f040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 msgr2=0x7fa5600a85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 msgr2=0x7f7f54069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 0x7f7f54069470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0ae000 tx=0x7f7f6c0a7070 comp rx=0 tx=0).stop 2024-04-25T10:04:18.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 0x7fa5600a85a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0b3000 tx=0x7fa54c0218a0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 msgr2=0x7f7f74151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.509+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 0x7f7f74151b20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7f6400c740 tx=0x7f7f6400cc00 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 shutdown_connections 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f54066fb0 0x7f7f54069470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f7415aa20 0x7f7f7414f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f740b0ca0 0x7f7f74151b20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 --2- 172.21.15.18:0/1166481513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f7406f150 0x7f7f740b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 >> 172.21.15.18:0/1166481513 conn(0x7f7f74066dd0 msgr2=0x7f7f7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 shutdown_connections 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa56015ee60 0x7fa5600afe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa560144120 0x7fa5600a85a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa540067160 0x7fa540069620 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 --2- 172.21.15.18:0/2409822482 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5600ccbf0 0x7fa5600ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 >> 172.21.15.18:0/2409822482 conn(0x7fa560067080 msgr2=0x7fa560141100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 shutdown_connections 2024-04-25T10:04:18.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 shutdown_connections 2024-04-25T10:04:18.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fa567c00640 1 -- 172.21.15.18:0/2409822482 wait complete. 2024-04-25T10:04:18.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7f7f6a000640 1 -- 172.21.15.18:0/1166481513 wait complete. 2024-04-25T10:04:18.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb9680cdcd0 con 0x7fb9680cf3c0 2024-04-25T10:04:18.527 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:18.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.513+0000 7fb95f400640 1 -- 172.21.15.18:0/212764664 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9580efc10 con 0x7fb9680cf3c0 2024-04-25T10:04:18.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 msgr2=0x7fb948069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 0x7fb948069470 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb968166610 tx=0x7fb960009040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 msgr2=0x7fb9681f70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb9580ad040 tx=0x7fb95801ad70 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 shutdown_connections 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb96815bcf0 0x7fb96814a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb96815b910 0x7fb9680b62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb948066fb0 0x7fb948069470 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 --2- 172.21.15.18:0/212764664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9680cf3c0 0x7fb9681f70e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 >> 172.21.15.18:0/212764664 conn(0x7fb9680b3200 msgr2=0x7fb96815e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 shutdown_connections 2024-04-25T10:04:18.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe4580cdc30 con 0x7fe4580ce750 2024-04-25T10:04:18.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fb96e400640 1 -- 172.21.15.18:0/212764664 wait complete. 2024-04-25T10:04:18.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.521+0000 7fe452000640 1 -- 172.21.15.18:0/2197258270 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4480ef7b0 con 0x7fe4580ce750 2024-04-25T10:04:18.532 INFO:teuthology.orchestra.run.smithi018.stdout:64424509448 2024-04-25T10:04:18.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.525+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 msgr2=0x7fe43c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.525+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe44c006fd0 tx=0x7fe44c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.525+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 msgr2=0x7fe4580b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.525+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 0x7fe4580b37c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4480ae000 tx=0x7fe44801b8b0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.525+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3a6c072250 con 0x7f3a6c1598a0 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 shutdown_connections 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe43c066f60 0x7fe43c069420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815b5d0 0x7fe45806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580ce750 0x7fe4580b37c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 --2- 172.21.15.18:0/2197258270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580cd540 0x7fe4580b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 >> 172.21.15.18:0/2197258270 conn(0x7fe458099a60 msgr2=0x7fe45815d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 shutdown_connections 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7fe45f200640 1 -- 172.21.15.18:0/2197258270 wait complete. 2024-04-25T10:04:18.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.529+0000 7f3a69600640 1 -- 172.21.15.18:0/631063335 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a54055760 con 0x7f3a6c1598a0 2024-04-25T10:04:18.540 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-25T10:04:18.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 msgr2=0x7f3a480694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 0x7f3a480694f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c1f9e90 tx=0x7f3a5c009040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 msgr2=0x7f3a6c138d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3a5400c7f0 tx=0x7f3a5400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.546 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.3 2024-04-25T10:04:18.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 shutdown_connections 2024-04-25T10:04:18.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a6c159c80 0x7f3a6c14a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a6c1598a0 0x7f3a6c138d10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a48067030 0x7f3a480694f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 --2- 172.21.15.18:0/631063335 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a6c06f290 0x7f3a6c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.537+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 >> 172.21.15.18:0/631063335 conn(0x7f3a6c06b010 msgr2=0x7f3a6c14c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 shutdown_connections 2024-04-25T10:04:18.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f12e00640 1 -- 172.21.15.18:0/2078366141 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2f0c0b0da0 con 0x7f2ef0003b90 2024-04-25T10:04:18.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f3a73400640 1 -- 172.21.15.18:0/631063335 wait complete. 2024-04-25T10:04:18.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f08c00640 1 -- 172.21.15.18:0/2078366141 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2efc0f14f0 con 0x7f2ef0003b90 2024-04-25T10:04:18.549 INFO:teuthology.orchestra.run.smithi018.stdout:64424509447 2024-04-25T10:04:18.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f796c0cd180 con 0x7f79500052f0 2024-04-25T10:04:18.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f7969600640 1 -- 172.21.15.18:0/3058877014 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f795c055680 con 0x7f79500052f0 2024-04-25T10:04:18.553 INFO:teuthology.orchestra.run.smithi018.stdout:60129542151 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 msgr2=0x7f2ee80694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 0x7f2ee80694f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4001ec0 tx=0x7f2ef4001460 comp rx=0 tx=0).stop 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 msgr2=0x7f2f0c14e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2efc01ce80 tx=0x7f2ef0003820 comp rx=0 tx=0).stop 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 shutdown_connections 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f0c0a9650 0x7f2f0c0a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f0c150860 0x7f2f0c14f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ee8067030 0x7f2ee80694f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 --2- 172.21.15.18:0/2078366141 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ef0003b90 0x7f2f0c14e330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 >> 172.21.15.18:0/2078366141 conn(0x7f2f0c067080 msgr2=0x7f2f0c1565f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 shutdown_connections 2024-04-25T10:04:18.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.541+0000 7f2f01600640 1 -- 172.21.15.18:0/2078366141 wait complete. 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 msgr2=0x7f794c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 0x7f794c069520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f796c06d8a0 tx=0x7f7958009040 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 msgr2=0x7f796c15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f795c00e7b0 tx=0x7f795c00ec70 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 shutdown_connections 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f794c067060 0x7f794c069520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f796c1495f0 0x7f796c149a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f796c1560b0 0x7f796c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 --2- 172.21.15.18:0/3058877014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79500052f0 0x7f796c15ef40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:18.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.545+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 >> 172.21.15.18:0/3058877014 conn(0x7f796c067080 msgr2=0x7f796c1530b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:18.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.549+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 shutdown_connections 2024-04-25T10:04:18.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:18.549+0000 7f7974600640 1 -- 172.21.15.18:0/3058877014 wait complete. 2024-04-25T10:04:18.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.0 2024-04-25T10:04:18.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2024-04-25T10:04:18.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.1 2024-04-25T10:04:18.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.5 2024-04-25T10:04:18.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.2 2024-04-25T10:04:18.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2024-04-25T10:04:18.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.4 2024-04-25T10:04:19.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T10:04:19.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T10:04:19.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T10:04:19.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T10:04:19.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T10:04:19.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T10:04:19.587 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T10:04:19.590 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T10:04:19.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.769+0000 7f9f46e00640 1 Processor -- start 2024-04-25T10:04:19.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.769+0000 7f9f46e00640 1 -- start start 2024-04-25T10:04:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f46e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9f4006f150 0x7f9f400b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f46e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f46e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f400b15f0 con 0x7f9f4015aa20 2024-04-25T10:04:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f46e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f400afe50 con 0x7f9f4006f150 2024-04-25T10:04:19.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f46e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400b0130 con 0x7f9f400b0ca0 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57770/0 (socket says 172.21.15.18:57770) 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 -- 172.21.15.18:0/2380386924 learned_addr learned my addr 172.21.15.18:0/2380386924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 -- 172.21.15.18:0/2380386924 >> v2:172.21.15.18:3300/0 conn(0x7f9f4006f150 msgr2=0x7f9f400b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2380386924 >> v2:172.21.15.18:3300/0 conn(0x7f9f4006f150 0x7f9f400b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 -- 172.21.15.18:0/2380386924 >> v1:172.21.15.18:6789/0 conn(0x7f9f4015aa20 legacy=0x7f9f40150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.773+0000 7f9f44e00640 1 -- 172.21.15.18:0/2380386924 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f400b0410 con 0x7f9f400b0ca0 2024-04-25T10:04:19.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2380386924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009870 tx=0x7f9f2c01eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42aae636b935ba3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f3ea00640 1 -- 172.21.15.18:0/2380386924 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0b5070 con 0x7f9f400b0ca0 2024-04-25T10:04:19.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f3ea00640 1 -- 172.21.15.18:0/2380386924 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0a8810 con 0x7f9f400b0ca0 2024-04-25T10:04:19.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f3ea00640 1 -- 172.21.15.18:0/2380386924 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0a8c20 con 0x7f9f400b0ca0 2024-04-25T10:04:19.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f46e00640 1 -- 172.21.15.18:0/2380386924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 msgr2=0x7f9f400b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.781+0000 7f9f46e00640 1 --2- 172.21.15.18:0/2380386924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009870 tx=0x7f9f2c01eb50 comp rx=0 tx=0).stop 2024-04-25T10:04:19.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 -- 172.21.15.18:0/2380386924 shutdown_connections 2024-04-25T10:04:19.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 --2- 172.21.15.18:0/2380386924 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f400b0ca0 0x7f9f400b10b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 --2- 172.21.15.18:0/2380386924 >> v2:172.21.15.18:3300/0 conn(0x7f9f4006f150 0x7f9f400b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 -- 172.21.15.18:0/2380386924 >> 172.21.15.18:0/2380386924 conn(0x7f9f40066dd0 msgr2=0x7f9f4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 -- 172.21.15.18:0/2380386924 shutdown_connections 2024-04-25T10:04:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 -- 172.21.15.18:0/2380386924 wait complete. 2024-04-25T10:04:19.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 Processor -- start 2024-04-25T10:04:19.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.785+0000 7f9f46e00640 1 -- start start 2024-04-25T10:04:19.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 0x7f9f40144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 0x7f9f40071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cb740 con 0x7f9f400b0ca0 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cb5c0 con 0x7f9f4006f150 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f46e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f400cb8c0 con 0x7f9f4015aa20 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f3fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f3fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38724/0 (socket says 172.21.15.18:38724) 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f3fe00640 1 -- 172.21.15.18:0/2737886575 learned_addr learned my addr 172.21.15.18:0/2737886575 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.789+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 0x7f9f40071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f3f400640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 0x7f9f40144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 -- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 msgr2=0x7f9f4015ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 -- 172.21.15.18:0/2737886575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 msgr2=0x7f9f40144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f3fe00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:19.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 0x7f9f40144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 -- 172.21.15.18:0/2737886575 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4015af40 con 0x7f9f4015aa20 2024-04-25T10:04:19.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f44e00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 0x7f9f40071480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0af000 tx=0x7f9f2c01b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f3f400640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 0x7f9f40144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:19.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0c0070 con 0x7f9f4015aa20 2024-04-25T10:04:19.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c0b0780 con 0x7f9f4015aa20 2024-04-25T10:04:19.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0b5040 con 0x7f9f4015aa20 2024-04-25T10:04:19.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f46e00640 1 -- 172.21.15.18:0/2737886575 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f4015b200 con 0x7f9f4015aa20 2024-04-25T10:04:19.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.793+0000 7f9f46e00640 1 -- 172.21.15.18:0/2737886575 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4015b7c0 con 0x7f9f4015aa20 2024-04-25T10:04:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.797+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f2c0b0b30 con 0x7f9f4015aa20 2024-04-25T10:04:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.797+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4006bba0 con 0x7f9f4015aa20 2024-04-25T10:04:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.797+0000 7f9f37e00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 0x7f9f20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.797+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f9f2c122560 con 0x7f9f4015aa20 2024-04-25T10:04:19.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.801+0000 7f9f3fe00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 0x7f9f20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.801+0000 7f9f3fe00640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 0x7f9f20069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f300099f0 tx=0x7f9f30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.805+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f400b15f0 con 0x7f9f4015aa20 2024-04-25T10:04:19.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 Processor -- start 2024-04-25T10:04:19.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 -- start start 2024-04-25T10:04:19.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07580501b0 0x7f0758006540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0758054120 con 0x7f0758033d00 2024-04-25T10:04:19.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0758054400 con 0x7f07580df2b0 2024-04-25T10:04:19.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0768600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580df690 con 0x7f07580501b0 2024-04-25T10:04:19.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0765200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07580501b0 0x7f0758006540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0766600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0758033d00 0x7f0758006a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59150/0 (socket says 172.21.15.18:59150) 2024-04-25T10:04:19.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0766600640 1 -- 172.21.15.18:0/1447034044 learned_addr learned my addr 172.21.15.18:0/1447034044 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0765200640 1 -- 172.21.15.18:0/1447034044 >> v1:172.21.15.167:6789/0 conn(0x7f07580df2b0 legacy=0x7f075804faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0765200640 1 -- 172.21.15.18:0/1447034044 >> v1:172.21.15.18:6789/0 conn(0x7f0758033d00 legacy=0x7f0758006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.833+0000 7f0765200640 1 -- 172.21.15.18:0/1447034044 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580546e0 con 0x7f07580501b0 2024-04-25T10:04:19.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 Processor -- start 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 -- start start 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb654163420 0x7fb6540b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65406dc80 con 0x7fb65406d6b0 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540712e0 con 0x7fb654163420 2024-04-25T10:04:19.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7fb653e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb654071530 con 0x7fb654162cb0 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.837+0000 7efe1e800640 1 Processor -- start 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 -- start start 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb654163420 0x7fb6540b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57786/0 (socket says 172.21.15.18:57786) 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 -- 172.21.15.18:0/2583952408 learned_addr learned my addr 172.21.15.18:0/2583952408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb653400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb65406d6b0 0x7fb654072010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47892/0 (socket says 172.21.15.18:47892) 2024-04-25T10:04:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 -- 172.21.15.18:0/2583952408 >> v2:172.21.15.167:3300/0 conn(0x7fb654163420 msgr2=0x7fb6540b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb651600640 1 -- 172.21.15.18:0/2583952408 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508964437 0 0) 0x7fb65406dc80 con 0x7fb65406d6b0 2024-04-25T10:04:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 --2- 172.21.15.18:0/2583952408 >> v2:172.21.15.167:3300/0 conn(0x7fb654163420 0x7fb6540b25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 -- 172.21.15.18:0/2583952408 >> v1:172.21.15.167:6789/0 conn(0x7fb65406d6b0 legacy=0x7fb654072010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efe1806f290 0x7efe1806f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe180ce120 con 0x7efe181598a0 2024-04-25T10:04:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1806e810 con 0x7efe1806f290 2024-04-25T10:04:19.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe1e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe180b3610 con 0x7efe18159c80 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7fb652a00640 1 -- 172.21.15.18:0/2583952408 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb654071810 con 0x7fb654162cb0 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0765200640 1 --2- 172.21.15.18:0/1447034044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580501b0 0x7f0758006540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0760000b70 tx=0x7f0760097410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc84fe87ccb627f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f075fe00640 1 -- 172.21.15.18:0/1447034044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076012b070 con 0x7f07580501b0 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f075fe00640 1 -- 172.21.15.18:0/1447034044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760126640 con 0x7f07580501b0 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0768600640 1 -- 172.21.15.18:0/1447034044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580501b0 msgr2=0x7f0758006540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f075fe00640 1 -- 172.21.15.18:0/1447034044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076012b070 con 0x7f07580501b0 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0768600640 1 --2- 172.21.15.18:0/1447034044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580501b0 0x7f0758006540 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0760000b70 tx=0x7f0760097410 comp rx=0 tx=0).stop 2024-04-25T10:04:19.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0768600640 1 -- 172.21.15.18:0/1447034044 shutdown_connections 2024-04-25T10:04:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0768600640 1 --2- 172.21.15.18:0/1447034044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580501b0 0x7f0758006540 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7f0768600640 1 -- 172.21.15.18:0/1447034044 >> 172.21.15.18:0/1447034044 conn(0x7f0758009fc0 msgr2=0x7f075800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe16a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f0768600640 1 -- 172.21.15.18:0/1447034044 shutdown_connections 2024-04-25T10:04:19.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f0768600640 1 -- 172.21.15.18:0/1447034044 wait complete. 2024-04-25T10:04:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.841+0000 7efe16a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57794/0 (socket says 172.21.15.18:57794) 2024-04-25T10:04:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efe1806f290 0x7efe1806f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efe1806f290 0x7efe1806f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38748/0 (socket says 172.21.15.18:38748) 2024-04-25T10:04:19.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 -- 172.21.15.18:0/3462047128 learned_addr learned my addr 172.21.15.18:0/3462047128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efe181598a0 0x7efe180cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59166/0 (socket says 172.21.15.18:59166) 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 -- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 msgr2=0x7efe1806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 -- 172.21.15.18:0/3462047128 >> v1:172.21.15.18:6789/0 conn(0x7efe181598a0 legacy=0x7efe180cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe16000640 1 -- 172.21.15.18:0/3462047128 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262782139 0 0) 0x7efe180ce120 con 0x7efe181598a0 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe17e00640 1 -- 172.21.15.18:0/3462047128 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe180ce400 con 0x7efe1806f290 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7efe16a00640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f96b5400640 1 Processor -- start 2024-04-25T10:04:19.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f96b5400640 1 -- start start 2024-04-25T10:04:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f0768600640 1 Processor -- start 2024-04-25T10:04:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7f0768600640 1 -- start start 2024-04-25T10:04:19.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7fb652a00640 1 --2- 172.21.15.18:0/2583952408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009870 tx=0x7fb63c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbd64d67f59165ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7fb651600640 1 -- 172.21.15.18:0/2583952408 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0ab640 con 0x7fb654162cb0 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7fb651600640 1 -- 172.21.15.18:0/2583952408 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c0b0070 con 0x7fb654162cb0 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.845+0000 7fb651600640 1 -- 172.21.15.18:0/2583952408 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0aba00 con 0x7fb654162cb0 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96b5400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96b0162cb0 0x7f96b006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96b5400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b006dc80 con 0x7f96b0163420 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96b5400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b0071530 con 0x7f96b00b2cd0 2024-04-25T10:04:19.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96b5400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b00712e0 con 0x7f96b0162cb0 2024-04-25T10:04:19.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0758033d00 0x7f07580d3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96b0162cb0 0x7f96b006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 0x7f075804e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 0x7f0758034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075804f7e0 con 0x7f07580df2b0 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075804f660 con 0x7f07580501b0 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0768600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580ed060 con 0x7f0758033d00 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0766600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 0x7f0758034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96b0162cb0 0x7f96b006d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41254/0 (socket says 172.21.15.18:41254) 2024-04-25T10:04:19.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 -- 172.21.15.18:0/420808006 learned_addr learned my addr 172.21.15.18:0/420808006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0766600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 0x7f0758034cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41264/0 (socket says 172.21.15.18:41264) 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0766600640 1 -- 172.21.15.18:0/3767898871 learned_addr learned my addr 172.21.15.18:0/3767898871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 0x7f075804e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 -- 172.21.15.18:0/420808006 >> v1:172.21.15.167:6789/0 conn(0x7f96b00b2cd0 legacy=0x7f96b00cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 -- 172.21.15.18:0/420808006 >> v1:172.21.15.18:6789/0 conn(0x7f96b0163420 legacy=0x7f96b00b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f96afe00640 1 -- 172.21.15.18:0/420808006 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0071810 con 0x7f96b0162cb0 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 -- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0758033d00 msgr2=0x7f07580d3c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0758033d00 0x7f07580d3c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 -- 172.21.15.18:0/3767898871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 msgr2=0x7f0758034cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 0x7f0758034cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 -- 172.21.15.18:0/3767898871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075804e9a0 con 0x7f07580501b0 2024-04-25T10:04:19.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7efe17e00640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe1806f290 0x7efe1806f720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe04008870 tx=0x7efe0401ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0cc9b9b0ee4648 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7efe16000640 1 -- 172.21.15.18:0/3462047128 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040ad070 con 0x7efe1806f290 2024-04-25T10:04:19.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7efe16000640 1 -- 172.21.15.18:0/3462047128 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe040a7a30 con 0x7efe1806f290 2024-04-25T10:04:19.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7efe16000640 1 -- 172.21.15.18:0/3462047128 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040a7e00 con 0x7efe1806f290 2024-04-25T10:04:19.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f5b24a00640 1 Processor -- start 2024-04-25T10:04:19.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f0765200640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 0x7f075804e460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f076004fd80 tx=0x7f0760095c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f5b24a00640 1 -- start start 2024-04-25T10:04:19.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f5646a00640 1 Processor -- start 2024-04-25T10:04:19.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076012b040 con 0x7f07580501b0 2024-04-25T10:04:19.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 -- start start 2024-04-25T10:04:19.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0760125750 con 0x7f07580501b0 2024-04-25T10:04:19.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 -- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe1806f290 msgr2=0x7efe1806f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe1806f290 0x7efe1806f720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7efe04008870 tx=0x7efe0401ea70 comp rx=0 tx=0).stop 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.849+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0760125b00 con 0x7f07580501b0 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07580d5dc0 con 0x7f07580501b0 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075804b010 con 0x7f07580501b0 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 -- 172.21.15.18:0/3462047128 shutdown_connections 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe1806f290 0x7efe1806f720 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 --2- 172.21.15.18:0/3462047128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1806e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 -- 172.21.15.18:0/3462047128 >> 172.21.15.18:0/3462047128 conn(0x7efe1806b010 msgr2=0x7efe1806b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 -- 172.21.15.18:0/2583952408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 msgr2=0x7fb65406d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 --2- 172.21.15.18:0/2583952408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009870 tx=0x7fb63c01c530 comp rx=0 tx=0).stop 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 -- 172.21.15.18:0/2583952408 shutdown_connections 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 --2- 172.21.15.18:0/2583952408 >> v2:172.21.15.167:3300/0 conn(0x7fb654163420 0x7fb6540b25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 --2- 172.21.15.18:0/2583952408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb654162cb0 0x7fb65406d170 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7fb653e00640 1 -- 172.21.15.18:0/2583952408 >> 172.21.15.18:0/2583952408 conn(0x7fb654066fa0 msgr2=0x7fb65406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 -- 172.21.15.18:0/3462047128 shutdown_connections 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07580089e0 con 0x7f07580501b0 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7efe1e800640 1 -- 172.21.15.18:0/3462047128 wait complete. 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f564015d0e0 0x7f56400ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5640072410 0x7f56400716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564015d4c0 con 0x7f5640072410 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400b3c90 con 0x7f564015d0e0 2024-04-25T10:04:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5646a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56400b3f50 con 0x7f56400b2ab0 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b24a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 0x7f5b2015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b24a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5b200ccbf0 0x7f5b2015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b24a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b2015bc40 con 0x7f5b2015ee60 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b24a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2015e490 con 0x7f5b20144120 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b24a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b2015b3a0 con 0x7f5b200ccbf0 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f564015d0e0 0x7f56400ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57814/0 (socket says 172.21.15.18:57814) 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 -- 172.21.15.18:0/927519785 learned_addr learned my addr 172.21.15.18:0/927519785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5644a00640 1 --2- 172.21.15.18:0/927519785 >> v2:172.21.15.18:3300/0 conn(0x7f5640072410 0x7f56400716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 -- 172.21.15.18:0/927519785 >> v2:172.21.15.167:3300/0 conn(0x7f564015d0e0 msgr2=0x7f56400ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 --2- 172.21.15.18:0/927519785 >> v2:172.21.15.167:3300/0 conn(0x7f564015d0e0 0x7f56400ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 -- 172.21.15.18:0/927519785 >> v2:172.21.15.18:3300/0 conn(0x7f5640072410 msgr2=0x7f56400716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 --2- 172.21.15.18:0/927519785 >> v2:172.21.15.18:3300/0 conn(0x7f5640072410 0x7f56400716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f563f400640 1 -- 172.21.15.18:0/927519785 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400b4230 con 0x7f56400b2ab0 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b1de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 0x7f5b2015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b1de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 0x7f5b2015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41278/0 (socket says 172.21.15.18:41278) 2024-04-25T10:04:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b1de00640 1 -- 172.21.15.18:0/4158703918 learned_addr learned my addr 172.21.15.18:0/4158703918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f5b1d400640 1 --2- 172.21.15.18:0/4158703918 >> v2:172.21.15.167:3300/0 conn(0x7f5b200ccbf0 0x7f5b2015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.853+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0760136030 con 0x7f07580501b0 2024-04-25T10:04:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 Processor -- start 2024-04-25T10:04:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f075d600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 0x7f0740069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0760199880 con 0x7f07580501b0 2024-04-25T10:04:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f0765c00640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 0x7f0740069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7fb653e00640 1 -- 172.21.15.18:0/2583952408 shutdown_connections 2024-04-25T10:04:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7fb653e00640 1 -- 172.21.15.18:0/2583952408 wait complete. 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f96afe00640 1 --2- 172.21.15.18:0/420808006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b0162cb0 0x7f96b006d170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96b0071460 tx=0x7f96a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3355ae8d2f1753b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f5b1d400640 1 -- 172.21.15.18:0/4158703918 >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 msgr2=0x7f5b2015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f5b1d400640 1 --2- 172.21.15.18:0/4158703918 >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 0x7f5b2015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f5b1d400640 1 -- 172.21.15.18:0/4158703918 >> v1:172.21.15.18:6789/0 conn(0x7f5b2015ee60 legacy=0x7f5b200b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f5b1d400640 1 -- 172.21.15.18:0/4158703918 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2015b680 con 0x7f5b200ccbf0 2024-04-25T10:04:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f1fe0e00640 1 Processor -- start 2024-04-25T10:04:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 -- start start 2024-04-25T10:04:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f1fe0e00640 1 -- start start 2024-04-25T10:04:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f0765c00640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 0x7f0740069470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0754000f70 tx=0x7f07540079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 0x7efe18140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181598a0 0x7efe1813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1813e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180cf1c0 con 0x7efe1806f290 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe180b2e10 con 0x7efe181598a0 2024-04-25T10:04:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7efe1e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1814ee00 con 0x7efe18159c80 2024-04-25T10:04:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.857+0000 7f563f400640 1 --2- 172.21.15.18:0/927519785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5640073090 tx=0x7f562c020810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=973744a4fe1cad59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 0x7efe18140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 Processor -- start 2024-04-25T10:04:19.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 0x7efe18140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41294/0 (socket says 172.21.15.18:41294) 2024-04-25T10:04:19.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17400640 1 -- 172.21.15.18:0/2877657036 learned_addr learned my addr 172.21.15.18:0/2877657036 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1813e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 -- start start 2024-04-25T10:04:19.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5b1d400640 1 --2- 172.21.15.18:0/4158703918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015e920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b2006b870 tx=0x7f5b0c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4214ea05ce045fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe16a00640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181598a0 0x7efe1813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96af400640 1 -- 172.21.15.18:0/420808006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00aa650 con 0x7f96b0162cb0 2024-04-25T10:04:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96af400640 1 -- 172.21.15.18:0/420808006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00af070 con 0x7f96b0162cb0 2024-04-25T10:04:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f563ea00640 1 -- 172.21.15.18:0/927519785 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0b0070 con 0x7f56400b2ab0 2024-04-25T10:04:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96af400640 1 -- 172.21.15.18:0/420808006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00aaa10 con 0x7f96b0162cb0 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f563ea00640 1 -- 172.21.15.18:0/927519785 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562c0aa630 con 0x7f56400b2ab0 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f563ea00640 1 -- 172.21.15.18:0/927519785 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562c0aaa00 con 0x7f56400b2ab0 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 -- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181598a0 msgr2=0x7efe1813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181598a0 0x7efe1813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 -- 172.21.15.18:0/2877657036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 msgr2=0x7efe18140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 0x7efe18140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 -- 172.21.15.18:0/2877657036 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18151970 con 0x7efe18159c80 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f076013d020 con 0x7f07580501b0 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb65406d6b0 0x7fb65413d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 0x7fb6541638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416cc20 con 0x7fb654163420 2024-04-25T10:04:19.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416caa0 con 0x7fb654162cb0 2024-04-25T10:04:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65416cda0 con 0x7fb65406d6b0 2024-04-25T10:04:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 -- 172.21.15.18:0/420808006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b0162cb0 msgr2=0x7f96b006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 --2- 172.21.15.18:0/420808006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b0162cb0 0x7f96b006d170 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96b0071460 tx=0x7f96a001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 -- 172.21.15.18:0/927519785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 msgr2=0x7f56400cd2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 --2- 172.21.15.18:0/927519785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5640073090 tx=0x7f562c020810 comp rx=0 tx=0).stop 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 -- 172.21.15.18:0/420808006 shutdown_connections 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 --2- 172.21.15.18:0/420808006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b0162cb0 0x7f96b006d170 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 -- 172.21.15.18:0/420808006 >> 172.21.15.18:0/420808006 conn(0x7f96b0066fa0 msgr2=0x7f96b006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 -- 172.21.15.18:0/927519785 shutdown_connections 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 --2- 172.21.15.18:0/927519785 >> v2:172.21.15.18:3300/0 conn(0x7f5640072410 0x7f56400716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 --2- 172.21.15.18:0/927519785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56400b2ab0 0x7f56400cd2e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 --2- 172.21.15.18:0/927519785 >> v2:172.21.15.167:3300/0 conn(0x7f564015d0e0 0x7f56400ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 -- 172.21.15.18:0/927519785 >> 172.21.15.18:0/927519785 conn(0x7f56400b17b0 msgr2=0x7f56400b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38778/0 (socket says 172.21.15.18:38778) 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 -- 172.21.15.18:0/1109510296 learned_addr learned my addr 172.21.15.18:0/1109510296 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652a00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb65406d6b0 0x7fb65413d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 -- 172.21.15.18:0/420808006 shutdown_connections 2024-04-25T10:04:19.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653400640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 0x7fb6541638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 -- 172.21.15.18:0/927519785 shutdown_connections 2024-04-25T10:04:19.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fe0e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc06b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe17e00640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1813e200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe040af000 tx=0x7efe0401d2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040c0070 con 0x7efe18159c80 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe04008bf0 con 0x7efe18159c80 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040ad040 con 0x7efe18159c80 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe18151c50 con 0x7efe18159c80 2024-04-25T10:04:19.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fe0e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1fdc15bc60 0x7f1fdc15f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 -- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb65406d6b0 msgr2=0x7fb65413d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb65406d6b0 0x7fb65413d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 -- 172.21.15.18:0/1109510296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 msgr2=0x7fb6541638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 0x7fb6541638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 -- 172.21.15.18:0/1109510296 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65413dd60 con 0x7fb654162cb0 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb653400640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 0x7fb6541638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:19.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe18152210 con 0x7efe18159c80 2024-04-25T10:04:19.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f96b5400640 1 -- 172.21.15.18:0/420808006 wait complete. 2024-04-25T10:04:19.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f5646a00640 1 -- 172.21.15.18:0/927519785 wait complete. 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fd3e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1fdc15bc60 0x7f1fdc15f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fd3e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1fdc15bc60 0x7f1fdc15f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38784/0 (socket says 172.21.15.18:38784) 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fd3e00640 1 -- 172.21.15.18:0/163993117 learned_addr learned my addr 172.21.15.18:0/163993117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0cc450 con 0x7f1fdc15f750 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0cc730 con 0x7f1fdc15bc60 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0cca10 con 0x7f1fdc145110 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.861+0000 7fb652000640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb64400d5f0 tx=0x7fb64400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fdb400640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc06b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fd3e00640 1 -- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 msgr2=0x7f1fdc06b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96b5400640 1 Processor -- start 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fdaa00640 1 -- 172.21.15.18:0/163993117 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3745747228 0 0) 0x7f1fdc0cc450 con 0x7f1fdc15f750 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fd3e00640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc06b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fd3e00640 1 -- 172.21.15.18:0/163993117 >> v1:172.21.15.167:6789/0 conn(0x7f1fdc15f750 legacy=0x7f1fdc0cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fd3e00640 1 -- 172.21.15.18:0/163993117 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0cccf0 con 0x7f1fdc15bc60 2024-04-25T10:04:19.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96b5400640 1 -- start start 2024-04-25T10:04:19.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f1fdb400640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc06b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:19.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe180745d0 con 0x7efe18159c80 2024-04-25T10:04:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440125f0 con 0x7fb654162cb0 2024-04-25T10:04:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644019070 con 0x7fb654162cb0 2024-04-25T10:04:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440129b0 con 0x7fb654162cb0 2024-04-25T10:04:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5646a00640 1 Processor -- start 2024-04-25T10:04:19.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb65413e040 con 0x7fb654162cb0 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb65413e600 con 0x7fb654162cb0 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96b5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96b5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b0163420 0x7f96b00cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96afe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96afe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57852/0 (socket says 172.21.15.18:57852) 2024-04-25T10:04:19.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96afe00640 1 -- 172.21.15.18:0/3102402702 learned_addr learned my addr 172.21.15.18:0/3102402702 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b1ca00640 1 -- 172.21.15.18:0/4158703918 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0b0070 con 0x7f5b200ccbf0 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b1ca00640 1 -- 172.21.15.18:0/4158703918 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0ab600 con 0x7f5b200ccbf0 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b1ca00640 1 -- 172.21.15.18:0/4158703918 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0ab9d0 con 0x7f5b200ccbf0 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 -- 172.21.15.18:0/4158703918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 msgr2=0x7f5b2015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 --2- 172.21.15.18:0/4158703918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015e920 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5b2006b870 tx=0x7f5b0c01c410 comp rx=0 tx=0).stop 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 -- 172.21.15.18:0/4158703918 shutdown_connections 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 --2- 172.21.15.18:0/4158703918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015e920 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 --2- 172.21.15.18:0/4158703918 >> v2:172.21.15.18:3300/0 conn(0x7f5b20144120 0x7f5b2015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5b24a00640 1 -- 172.21.15.18:0/4158703918 >> 172.21.15.18:0/4158703918 conn(0x7f5b20067080 msgr2=0x7f5b2006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe040c3070 con 0x7efe18159c80 2024-04-25T10:04:19.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6540745d0 con 0x7fb654162cb0 2024-04-25T10:04:19.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 0x7f96b015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.865+0000 7f5646a00640 1 -- start start 2024-04-25T10:04:19.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5b24a00640 1 -- 172.21.15.18:0/4158703918 shutdown_connections 2024-04-25T10:04:19.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b016fc40 con 0x7f96b00ce020 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b016fac0 con 0x7f96b0163420 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b016fdc0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96a7e00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b0163420 0x7f96b00cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96b4a00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 0x7f96b015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 -- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b0163420 msgr2=0x7f96b00cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7efe0f400640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 0x7efdf80694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b0163420 0x7f96b00cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 -- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 msgr2=0x7f96b015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 0x7f96b015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b0149c10 con 0x7f96b00b2cd0 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96b4a00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 0x7f96b015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5640072410 0x7f56401489f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56400b2ab0 0x7f5640152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564006d720 con 0x7f56400b2ab0 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640072010 con 0x7f564015d0e0 2024-04-25T10:04:19.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5646a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564006d8a0 con 0x7f5640072410 2024-04-25T10:04:19.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7efe0411f180 con 0x7efe18159c80 2024-04-25T10:04:19.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb644012b50 con 0x7fb654162cb0 2024-04-25T10:04:19.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f1fd3e00640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc15f210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009870 tx=0x7f1fcc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b006265e078fd9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f96afe00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96a001a100 tx=0x7f96a001ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7efe17400640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 0x7efdf80694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38800/0 (socket says 172.21.15.18:38800) 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 -- 172.21.15.18:0/3694481443 learned_addr learned my addr 172.21.15.18:0/3694481443 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f563f400640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56400b2ab0 0x7f5640152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f563fe00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5640072410 0x7f56401489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5b24a00640 1 -- 172.21.15.18:0/4158703918 wait complete. 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 -- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5640072410 msgr2=0x7f56401489f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5640072410 0x7f56401489f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 -- 172.21.15.18:0/3694481443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56400b2ab0 msgr2=0x7f5640152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56400b2ab0 0x7f5640152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 -- 172.21.15.18:0/3694481443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5640148f30 con 0x7f564015d0e0 2024-04-25T10:04:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7efe17400640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 0x7efdf80694f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe100019d0 tx=0x7efe10001960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7f5644a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f563000d620 tx=0x7f563000dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7fb64aa00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 0x7fb630069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.869+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb644085530 con 0x7fb654162cb0 2024-04-25T10:04:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7fb652a00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 0x7fb630069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 Processor -- start 2024-04-25T10:04:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00bd5f0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 -- start start 2024-04-25T10:04:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7fb652a00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 0x7fb630069470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0af000 tx=0x7fb63c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00a6040 con 0x7f96b00b2cd0 2024-04-25T10:04:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00bd9f0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b0149ef0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b014a4b0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe04018660 con 0x7efe18159c80 2024-04-25T10:04:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96880052a0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f1fdaa00640 1 -- 172.21.15.18:0/163993117 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b2070 con 0x7f1fdc15bc60 2024-04-25T10:04:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f1fdaa00640 1 -- 172.21.15.18:0/163993117 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0a9070 con 0x7f1fdc15bc60 2024-04-25T10:04:19.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f1fdaa00640 1 -- 172.21.15.18:0/163993117 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b2070 con 0x7f1fdc15bc60 2024-04-25T10:04:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300125f0 con 0x7f564015d0e0 2024-04-25T10:04:19.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96a00b33f0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 0x7f5b200af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 0x7f5b200cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2006dc60 con 0x7f5b2015ee60 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2006dae0 con 0x7f5b200ccbf0 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b24a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2006dde0 con 0x7f5b20144120 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 0x7f5b200cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 0x7f5b200cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41336/0 (socket says 172.21.15.18:41336) 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1e800640 1 -- 172.21.15.18:0/3832081253 learned_addr learned my addr 172.21.15.18:0/3832081253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 0x7f5b200af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 -- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 msgr2=0x7f5b2015a140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:04:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015a140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 -- 172.21.15.18:0/3832081253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 msgr2=0x7f5b200cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 0x7f5b200cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.873+0000 7f5b1d400640 1 -- 172.21.15.18:0/3832081253 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200b09c0 con 0x7f5b20144120 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5b1d400640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 0x7f5b200af110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0ab000 tx=0x7f5b0c0191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb644056370 con 0x7fb654162cb0 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564015c790 con 0x7f564015d0e0 2024-04-25T10:04:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564015b9d0 con 0x7f564015d0e0 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 msgr2=0x7f1fdc15f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc15f210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009870 tx=0x7f1fcc01c560 comp rx=0 tx=0).stop 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 shutdown_connections 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc15f210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/163993117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc06b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 >> 172.21.15.18:0/163993117 conn(0x7f1fdc06ac10 msgr2=0x7f1fdc06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630019070 con 0x7f564015d0e0 2024-04-25T10:04:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56300129d0 con 0x7f564015d0e0 2024-04-25T10:04:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 shutdown_connections 2024-04-25T10:04:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56180052a0 con 0x7f564015d0e0 2024-04-25T10:04:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 -- 172.21.15.18:0/163993117 wait complete. 2024-04-25T10:04:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f1fe0e00640 1 Processor -- start 2024-04-25T10:04:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f96acc00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 0x7f968c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.877+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f96a011eda0 con 0x7f96b00b2cd0 2024-04-25T10:04:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- start start 2024-04-25T10:04:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f96a7e00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 0x7f968c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5630012b70 con 0x7f564015d0e0 2024-04-25T10:04:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0b9070 con 0x7f5b20144120 2024-04-25T10:04:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc206520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0b5680 con 0x7f5b20144120 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41352/0 (socket says 172.21.15.18:41352) 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 -- 172.21.15.18:0/398752484 learned_addr learned my addr 172.21.15.18:0/398752484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0ce190 con 0x7f1fdc15f750 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0ce010 con 0x7f1fdc15bc60 2024-04-25T10:04:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0cbfe0 con 0x7f1fdc145110 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c0b0040 con 0x7f5b20144120 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b200af650 con 0x7f5b20144120 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b200afc00 con 0x7f5b20144120 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5637e00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 0x7f5620069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5630085740 con 0x7f564015d0e0 2024-04-25T10:04:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f563fe00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 0x7f5620069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 -- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 msgr2=0x7f1fdc16a040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc16a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 -- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 msgr2=0x7f1fdc206520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc206520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc16a970 con 0x7f1fdc15f750 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fdbe00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c780 tx=0x7f1fd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4003db0 con 0x7f1fdc15f750 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400ce30 con 0x7f1fdc15f750 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd4005290 con 0x7f1fdc15f750 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc16ac50 con 0x7f1fdc15f750 2024-04-25T10:04:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.881+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc16b210 con 0x7f1fdc15f750 2024-04-25T10:04:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96a00c5060 con 0x7f96b00b2cd0 2024-04-25T10:04:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f96a7e00640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 0x7f968c069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96b014b9b0 tx=0x7f9698009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5640148f30 con 0x7f564015d0e0 2024-04-25T10:04:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc0745d0 con 0x7f1fdc15f750 2024-04-25T10:04:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1fd4005430 con 0x7f1fdc15f750 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5b0c0bc070 con 0x7f5b20144120 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f5b16000640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 0x7f5b00069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b200745d0 con 0x7f5b20144120 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f563fe00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 0x7f5620069450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5638003ab0 tx=0x7f5638009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f1fd3400640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 0x7f1fb8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:19.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.885+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1fd40851b0 con 0x7f1fdc15f750 2024-04-25T10:04:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f1fdb400640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 0x7f1fb8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f5b1de00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 0x7f5b00069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:19.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f1fdb400640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 0x7f1fb8069470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400a8d0 tx=0x7f1fc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5b0c11f580 con 0x7f5b20144120 2024-04-25T10:04:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.889+0000 7f5b1de00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 0x7f5b00069520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b240 tx=0x7f5b10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.893+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1fd4055ef0 con 0x7f1fdc15f750 2024-04-25T10:04:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:19.897+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5b0c016090 con 0x7f5b20144120 2024-04-25T10:04:20.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.149+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9f400745d0 con 0x7f9f4015aa20 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f37e00640 1 -- 172.21.15.18:0/2737886575 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f2c0a87e0 con 0x7f9f4015aa20 2024-04-25T10:04:20.164 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-25T10:04:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 msgr2=0x7f9f20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 0x7f9f20069420 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f300099f0 tx=0x7f9f30008040 comp rx=0 tx=0).stop 2024-04-25T10:04:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 msgr2=0x7f9f40071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 0x7f9f40071480 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0af000 tx=0x7f9f2c01b8f0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 shutdown_connections 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.157+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f20066f60 0x7f9f20069420 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f4015aa20 0x7f9f40071480 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f400b0ca0 0x7f9f40144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 --2- 172.21.15.18:0/2737886575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f4006f150 0x7f9f4015ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 >> 172.21.15.18:0/2737886575 conn(0x7f9f40066dd0 msgr2=0x7f9f4015d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 shutdown_connections 2024-04-25T10:04:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.161+0000 7f9f35600640 1 -- 172.21.15.18:0/2737886575 wait complete. 2024-04-25T10:04:20.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-04-25T10:04:20.200 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.205+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb6540b0a80 con 0x7fb654162cb0 2024-04-25T10:04:20.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb64aa00640 1 -- 172.21.15.18:0/1109510296 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb644055c70 con 0x7fb654162cb0 2024-04-25T10:04:20.217 INFO:teuthology.orchestra.run.smithi018.stdout:64424509451 2024-04-25T10:04:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 msgr2=0x7fb630069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 0x7fb630069470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0af000 tx=0x7fb63c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 msgr2=0x7fb654135470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb64400d5f0 tx=0x7fb64400dab0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 shutdown_connections 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb654163420 0x7fb6541638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb654162cb0 0x7fb654135470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb630066fb0 0x7fb630069470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 --2- 172.21.15.18:0/1109510296 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb65406d6b0 0x7fb65413d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.209+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 >> 172.21.15.18:0/1109510296 conn(0x7fb654066fa0 msgr2=0x7fb654072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.213+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 shutdown_connections 2024-04-25T10:04:20.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.213+0000 7fb653e00640 1 -- 172.21.15.18:0/1109510296 wait complete. 2024-04-25T10:04:20.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.213+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f07580053a0 con 0x7f07580501b0 2024-04-25T10:04:20.223 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:20.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.213+0000 7f075d600640 1 -- 172.21.15.18:0/3767898871 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0760091250 con 0x7f07580501b0 2024-04-25T10:04:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 msgr2=0x7f0740069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 0x7f0740069470 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0754000f70 tx=0x7f07540079c0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 msgr2=0x7f075804e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 0x7f075804e460 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f076004fd80 tx=0x7f0760095c50 comp rx=0 tx=0).stop 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 shutdown_connections 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07580df2b0 0x7f0758034cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f07580501b0 0x7f075804e460 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0740066fb0 0x7f0740069470 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 --2- 172.21.15.18:0/3767898871 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0758033d00 0x7f07580d3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 >> 172.21.15.18:0/3767898871 conn(0x7f0758009fc0 msgr2=0x7f07580d7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 shutdown_connections 2024-04-25T10:04:20.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.217+0000 7f0768600640 1 -- 172.21.15.18:0/3767898871 wait complete. 2024-04-25T10:04:20.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.225+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efe18072250 con 0x7efe18159c80 2024-04-25T10:04:20.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.225+0000 7efe0f400640 1 -- 172.21.15.18:0/2877657036 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe040ef900 con 0x7efe18159c80 2024-04-25T10:04:20.235 INFO:teuthology.orchestra.run.smithi018.stdout:64424509450 2024-04-25T10:04:20.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 msgr2=0x7efdf80694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 0x7efdf80694f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe100019d0 tx=0x7efe10001960 comp rx=0 tx=0).stop 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 msgr2=0x7efe1813e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1813e200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe040af000 tx=0x7efe0401d2b0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 shutdown_connections 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf8067030 0x7efdf80694f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1fdc06c100 con 0x7f1fdc15f750 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe18159c80 0x7efe1813e200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181598a0 0x7efe1813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 --2- 172.21.15.18:0/2877657036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1806f290 0x7efe18140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 >> 172.21.15.18:0/2877657036 conn(0x7efe1806b010 msgr2=0x7efe180cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5618005860 con 0x7f564015d0e0 2024-04-25T10:04:20.242 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 shutdown_connections 2024-04-25T10:04:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7efe1e800640 1 -- 172.21.15.18:0/2877657036 wait complete. 2024-04-25T10:04:20.243 INFO:teuthology.orchestra.run.smithi018.stdout:60129542153 2024-04-25T10:04:20.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7f5637e00640 1 -- 172.21.15.18:0/3694481443 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5630055e30 con 0x7f564015d0e0 2024-04-25T10:04:20.243 INFO:teuthology.orchestra.run.smithi018.stdout:64424509452 2024-04-25T10:04:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.229+0000 7f1fd3400640 1 -- 172.21.15.18:0/398752484 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1fd40557f0 con 0x7f1fdc15f750 2024-04-25T10:04:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f9688005590 con 0x7f96b00b2cd0 2024-04-25T10:04:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 msgr2=0x7f5620069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 0x7f5620069450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5638003ab0 tx=0x7f5638009830 comp rx=0 tx=0).stop 2024-04-25T10:04:20.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 msgr2=0x7f5640154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f563000d620 tx=0x7f563000dae0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 shutdown_connections 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f564015d0e0 0x7f5640154650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56400b2ab0 0x7f5640152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5620066f90 0x7f5620069450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 --2- 172.21.15.18:0/3694481443 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5640072410 0x7f56401489f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 >> 172.21.15.18:0/3694481443 conn(0x7f56400b17b0 msgr2=0x7f56400af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 shutdown_connections 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f5646a00640 1 -- 172.21.15.18:0/3694481443 wait complete. 2024-04-25T10:04:20.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.233+0000 7f96acc00640 1 -- 172.21.15.18:0/3102402702 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96a00160f0 con 0x7f96b00b2cd0 2024-04-25T10:04:20.246 INFO:teuthology.orchestra.run.smithi018.stdout:60129542155 2024-04-25T10:04:20.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 msgr2=0x7f1fb8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 0x7f1fb8069470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400a8d0 tx=0x7f1fc4008040 comp rx=0 tx=0).stop 2024-04-25T10:04:20.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 msgr2=0x7f1fdc206a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1fd400c780 tx=0x7f1fd400cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 shutdown_connections 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1fdc15f750 0x7f1fdc206a60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1fdc15bc60 0x7f1fdc206520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fb8066fb0 0x7f1fb8069470 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 --2- 172.21.15.18:0/398752484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1fdc145110 0x7f1fdc16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 >> 172.21.15.18:0/398752484 conn(0x7f1fdc06ac10 msgr2=0x7f1fdc06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.251 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.7 2024-04-25T10:04:20.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 shutdown_connections 2024-04-25T10:04:20.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.241+0000 7f1fe0e00640 1 -- 172.21.15.18:0/398752484 wait complete. 2024-04-25T10:04:20.251 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 msgr2=0x7f968c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 0x7f968c069420 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96b014b9b0 tx=0x7f9698009060 comp rx=0 tx=0).stop 2024-04-25T10:04:20.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b201641e0 con 0x7f5b20144120 2024-04-25T10:04:20.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 msgr2=0x7f96b0142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96a001a100 tx=0x7f96a001ad10 comp rx=0 tx=0).stop 2024-04-25T10:04:20.254 INFO:teuthology.orchestra.run.smithi018.stdout:64424509449 2024-04-25T10:04:20.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f5b16000640 1 -- 172.21.15.18:0/3832081253 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5b0c0efbe0 con 0x7f5b20144120 2024-04-25T10:04:20.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 shutdown_connections 2024-04-25T10:04:20.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96b00ce020 0x7f96b015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b0163420 0x7f96b00cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f968c066f60 0x7f968c069420 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 --2- 172.21.15.18:0/3102402702 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96b00b2cd0 0x7f96b0142360 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 >> 172.21.15.18:0/3102402702 conn(0x7f96b0066fa0 msgr2=0x7f96b0072010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 shutdown_connections 2024-04-25T10:04:20.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.245+0000 7f96b5400640 1 -- 172.21.15.18:0/3102402702 wait complete. 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 msgr2=0x7f5b00069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 0x7f5b00069520 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000b240 tx=0x7f5b10008040 comp rx=0 tx=0).stop 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 msgr2=0x7f5b200af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 0x7f5b200af110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0ab000 tx=0x7f5b0c0191b0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 shutdown_connections 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2015ee60 0x7f5b200cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5b00067060 0x7f5b00069520 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5b20144120 0x7f5b200af110 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0ab000 tx=0x7f5b0c0191b0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 --2- 172.21.15.18:0/3832081253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b200ccbf0 0x7f5b2015a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.249+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 >> 172.21.15.18:0/3832081253 conn(0x7f5b20067080 msgr2=0x7f5b20138550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.253+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 shutdown_connections 2024-04-25T10:04:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.253+0000 7f5b24a00640 1 -- 172.21.15.18:0/3832081253 wait complete. 2024-04-25T10:04:20.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-04-25T10:04:20.265 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.5 2024-04-25T10:04:20.274 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2024-04-25T10:04:20.276 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.6 2024-04-25T10:04:20.285 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2024-04-25T10:04:20.288 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.288 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509449 for osd.4 2024-04-25T10:04:20.288 DEBUG:teuthology.parallel:result is None 2024-04-25T10:04:20.288 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:04:20.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 Processor -- start 2024-04-25T10:04:20.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 -- start start 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc448145270 0x7fc44815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc4480cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480cc4e0 con 0x7fc4480cd4d0 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc448145650 con 0x7fc448145270 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc44de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4480ce040 con 0x7fc4480b1e60 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc446a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc448145270 0x7fc44815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc43e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4480cd4d0 0x7fc4480b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59194/0 (socket says 172.21.15.18:59194) 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc43e000640 1 -- 172.21.15.18:0/1894577616 learned_addr learned my addr 172.21.15.18:0/1894577616 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:20.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.461+0000 7fc447400640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc4480cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446a00640 1 -- 172.21.15.18:0/1894577616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 msgr2=0x7fc4480cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446a00640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc4480cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446a00640 1 -- 172.21.15.18:0/1894577616 >> v1:172.21.15.18:6789/0 conn(0x7fc4480cd4d0 legacy=0x7fc4480b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446a00640 1 -- 172.21.15.18:0/1894577616 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4480ce320 con 0x7fc448145270 2024-04-25T10:04:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc447400640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc4480cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446a00640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc448145270 0x7fc44815fe50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc43801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb1fa67f2980863 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446000640 1 -- 172.21.15.18:0/1894577616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380b2070 con 0x7fc448145270 2024-04-25T10:04:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446000640 1 -- 172.21.15.18:0/1894577616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380ad640 con 0x7fc448145270 2024-04-25T10:04:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc446000640 1 -- 172.21.15.18:0/1894577616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ada10 con 0x7fc448145270 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 -- 172.21.15.18:0/1894577616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc448145270 msgr2=0x7fc44815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc448145270 0x7fc44815fe50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc4380097c0 tx=0x7fc43801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 -- 172.21.15.18:0/1894577616 shutdown_connections 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc4480cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 --2- 172.21.15.18:0/1894577616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc448145270 0x7fc44815fe50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 -- 172.21.15.18:0/1894577616 >> 172.21.15.18:0/1894577616 conn(0x7fc448066fa0 msgr2=0x7fc44806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 -- 172.21.15.18:0/1894577616 shutdown_connections 2024-04-25T10:04:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.465+0000 7fc44de00640 1 -- 172.21.15.18:0/1894577616 wait complete. 2024-04-25T10:04:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 Processor -- start 2024-04-25T10:04:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- start start 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc448140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448145270 0x7fc44813e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815c710 con 0x7fc4480cd4d0 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815c590 con 0x7fc448145270 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc44815c890 con 0x7fc4480b1e60 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41372/0 (socket says 172.21.15.18:41372) 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 -- 172.21.15.18:0/4168162385 learned_addr learned my addr 172.21.15.18:0/4168162385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 -- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 msgr2=0x7fc448140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc448140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 -- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448145270 msgr2=0x7fc44813e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448145270 0x7fc44813e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 -- 172.21.15.18:0/4168162385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44813ee90 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43e000640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c450 tx=0x7fc43000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430017070 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc430005cf0 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc430007290 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc448142140 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.469+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448142700 con 0x7fc4480cd4d0 2024-04-25T10:04:20.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4480745d0 con 0x7fc4480cd4d0 2024-04-25T10:04:20.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc43001a070 con 0x7fc4480cd4d0 2024-04-25T10:04:20.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc43fe00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 0x7fc424069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc430084660 con 0x7fc4480cd4d0 2024-04-25T10:04:20.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc446a00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 0x7fc424069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.473+0000 7fc446a00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 0x7fc424069420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4380af000 tx=0x7fc438004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.477+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc430055330 con 0x7fc4480cd4d0 2024-04-25T10:04:20.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.637+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc448141ee0 con 0x7fc424066f60 2024-04-25T10:04:20.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc43fe00640 1 -- 172.21.15.18:0/4168162385 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332538 (secure 0 0 0) 0x7fc43810d310 con 0x7fc424066f60 2024-04-25T10:04:20.659 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:20.662 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 msgr2=0x7fc424069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 0x7fc424069420 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc4380af000 tx=0x7fc438004740 comp rx=0 tx=0).stop 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 msgr2=0x7fc4481419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc43000c450 tx=0x7fc43000c910 comp rx=0 tx=0).stop 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 shutdown_connections 2024-04-25T10:04:20.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc448145270 0x7fc44813e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4480cd4d0 0x7fc4481419a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc424066f60 0x7fc424069420 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 --2- 172.21.15.18:0/4168162385 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4480b1e60 0x7fc448140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 >> 172.21.15.18:0/4168162385 conn(0x7fc448066fa0 msgr2=0x7fc44806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 shutdown_connections 2024-04-25T10:04:20.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.649+0000 7fc44de00640 1 -- 172.21.15.18:0/4168162385 wait complete. 2024-04-25T10:04:20.679 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T10:04:19.399826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227920,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746800,"statfs":{"total":773094113280,"available":772860723200,"internally_reserved":0,"allocated":3514368,"data_stored":2103992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003274"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.267071+0000","last_change":"2024-04-25T10:03:55.768315+0000","last_active":"2024-04-25T10:04:03.267071+0000","last_peered":"2024-04-25T10:04:03.267071+0000","last_clean":"2024-04-25T10:04:03.267071+0000","last_became_active":"2024-04-25T10:03:55.768048+0000","last_became_peered":"2024-04-25T10:03:55.768048+0000","last_unstale":"2024-04-25T10:04:03.267071+0000","last_undegraded":"2024-04-25T10:04:03.267071+0000","last_fullsized":"2024-04-25T10:04:03.267071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:28.383096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793497+0000","last_change":"2024-04-25T10:03:56.758112+0000","last_active":"2024-04-25T10:04:02.793497+0000","last_peered":"2024-04-25T10:04:02.793497+0000","last_clean":"2024-04-25T10:04:02.793497+0000","last_became_active":"2024-04-25T10:03:56.757744+0000","last_became_peered":"2024-04-25T10:03:56.757744+0000","last_unstale":"2024-04-25T10:04:02.793497+0000","last_undegraded":"2024-04-25T10:04:02.793497+0000","last_fullsized":"2024-04-25T10:04:02.793497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:36.379846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792515+0000","last_change":"2024-04-25T10:04:01.286170+0000","last_active":"2024-04-25T10:04:02.792515+0000","last_peered":"2024-04-25T10:04:02.792515+0000","last_clean":"2024-04-25T10:04:02.792515+0000","last_became_active":"2024-04-25T10:04:01.285749+0000","last_became_peered":"2024-04-25T10:04:01.285749+0000","last_unstale":"2024-04-25T10:04:02.792515+0000","last_undegraded":"2024-04-25T10:04:02.792515+0000","last_fullsized":"2024-04-25T10:04:02.792515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:24.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793621+0000","last_change":"2024-04-25T10:03:55.757705+0000","last_active":"2024-04-25T10:04:02.793621+0000","last_peered":"2024-04-25T10:04:02.793621+0000","last_clean":"2024-04-25T10:04:02.793621+0000","last_became_active":"2024-04-25T10:03:55.757106+0000","last_became_peered":"2024-04-25T10:03:55.757106+0000","last_unstale":"2024-04-25T10:04:02.793621+0000","last_undegraded":"2024-04-25T10:04:02.793621+0000","last_fullsized":"2024-04-25T10:04:02.793621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:28.451018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266707+0000","last_change":"2024-04-25T10:03:56.772870+0000","last_active":"2024-04-25T10:04:03.266707+0000","last_peered":"2024-04-25T10:04:03.266707+0000","last_clean":"2024-04-25T10:04:03.266707+0000","last_became_active":"2024-04-25T10:03:56.771205+0000","last_became_peered":"2024-04-25T10:03:56.771205+0000","last_unstale":"2024-04-25T10:04:03.266707+0000","last_undegraded":"2024-04-25T10:04:03.266707+0000","last_fullsized":"2024-04-25T10:04:03.266707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:44.754772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276672+0000","last_change":"2024-04-25T10:04:00.804531+0000","last_active":"2024-04-25T10:04:03.276672+0000","last_peered":"2024-04-25T10:04:03.276672+0000","last_clean":"2024-04-25T10:04:03.276672+0000","last_became_active":"2024-04-25T10:04:00.804099+0000","last_became_peered":"2024-04-25T10:04:00.804099+0000","last_unstale":"2024-04-25T10:04:03.276672+0000","last_undegraded":"2024-04-25T10:04:03.276672+0000","last_fullsized":"2024-04-25T10:04:03.276672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277581+0000","last_change":"2024-04-25T10:03:55.774735+0000","last_active":"2024-04-25T10:04:03.277581+0000","last_peered":"2024-04-25T10:04:03.277581+0000","last_clean":"2024-04-25T10:04:03.277581+0000","last_became_active":"2024-04-25T10:03:55.774388+0000","last_became_peered":"2024-04-25T10:03:55.774388+0000","last_unstale":"2024-04-25T10:04:03.277581+0000","last_undegraded":"2024-04-25T10:04:03.277581+0000","last_fullsized":"2024-04-25T10:04:03.277581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796791+0000","last_change":"2024-04-25T10:03:56.773291+0000","last_active":"2024-04-25T10:04:02.796791+0000","last_peered":"2024-04-25T10:04:02.796791+0000","last_clean":"2024-04-25T10:04:02.796791+0000","last_became_active":"2024-04-25T10:03:56.772811+0000","last_became_peered":"2024-04-25T10:03:56.772811+0000","last_unstale":"2024-04-25T10:04:02.796791+0000","last_undegraded":"2024-04-25T10:04:02.796791+0000","last_fullsized":"2024-04-25T10:04:02.796791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278159+0000","last_change":"2024-04-25T10:04:00.809365+0000","last_active":"2024-04-25T10:04:03.278159+0000","last_peered":"2024-04-25T10:04:03.278159+0000","last_clean":"2024-04-25T10:04:03.278159+0000","last_became_active":"2024-04-25T10:04:00.808889+0000","last_became_peered":"2024-04-25T10:04:00.808889+0000","last_unstale":"2024-04-25T10:04:03.278159+0000","last_undegraded":"2024-04-25T10:04:03.278159+0000","last_fullsized":"2024-04-25T10:04:03.278159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277444+0000","last_change":"2024-04-25T10:03:55.773956+0000","last_active":"2024-04-25T10:04:03.277444+0000","last_peered":"2024-04-25T10:04:03.277444+0000","last_clean":"2024-04-25T10:04:03.277444+0000","last_became_active":"2024-04-25T10:03:55.770709+0000","last_became_peered":"2024-04-25T10:03:55.770709+0000","last_unstale":"2024-04-25T10:04:03.277444+0000","last_undegraded":"2024-04-25T10:04:03.277444+0000","last_fullsized":"2024-04-25T10:04:03.277444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796965+0000","last_change":"2024-04-25T10:03:56.773544+0000","last_active":"2024-04-25T10:04:02.796965+0000","last_peered":"2024-04-25T10:04:02.796965+0000","last_clean":"2024-04-25T10:04:02.796965+0000","last_became_active":"2024-04-25T10:03:56.773246+0000","last_became_peered":"2024-04-25T10:03:56.773246+0000","last_unstale":"2024-04-25T10:04:02.796965+0000","last_undegraded":"2024-04-25T10:04:02.796965+0000","last_fullsized":"2024-04-25T10:04:02.796965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277083+0000","last_change":"2024-04-25T10:04:00.809357+0000","last_active":"2024-04-25T10:04:03.277083+0000","last_peered":"2024-04-25T10:04:03.277083+0000","last_clean":"2024-04-25T10:04:03.277083+0000","last_became_active":"2024-04-25T10:04:00.808905+0000","last_became_peered":"2024-04-25T10:04:00.808905+0000","last_unstale":"2024-04-25T10:04:03.277083+0000","last_undegraded":"2024-04-25T10:04:03.277083+0000","last_fullsized":"2024-04-25T10:04:03.277083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796173+0000","last_change":"2024-04-25T10:03:56.774064+0000","last_active":"2024-04-25T10:04:02.796173+0000","last_peered":"2024-04-25T10:04:02.796173+0000","last_clean":"2024-04-25T10:04:02.796173+0000","last_became_active":"2024-04-25T10:03:56.773617+0000","last_became_peered":"2024-04-25T10:03:56.773617+0000","last_unstale":"2024-04-25T10:04:02.796173+0000","last_undegraded":"2024-04-25T10:04:02.796173+0000","last_fullsized":"2024-04-25T10:04:02.796173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277648+0000","last_change":"2024-04-25T10:03:55.771542+0000","last_active":"2024-04-25T10:04:03.277648+0000","last_peered":"2024-04-25T10:04:03.277648+0000","last_clean":"2024-04-25T10:04:03.277648+0000","last_became_active":"2024-04-25T10:03:55.771100+0000","last_became_peered":"2024-04-25T10:03:55.771100+0000","last_unstale":"2024-04-25T10:04:03.277648+0000","last_undegraded":"2024-04-25T10:04:03.277648+0000","last_fullsized":"2024-04-25T10:04:03.277648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278167+0000","last_change":"2024-04-25T10:04:00.797932+0000","last_active":"2024-04-25T10:04:03.278167+0000","last_peered":"2024-04-25T10:04:03.278167+0000","last_clean":"2024-04-25T10:04:03.278167+0000","last_became_active":"2024-04-25T10:04:00.797547+0000","last_became_peered":"2024-04-25T10:04:00.797547+0000","last_unstale":"2024-04-25T10:04:03.278167+0000","last_undegraded":"2024-04-25T10:04:03.278167+0000","last_fullsized":"2024-04-25T10:04:03.278167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793017+0000","last_change":"2024-04-25T10:03:56.763110+0000","last_active":"2024-04-25T10:04:02.793017+0000","last_peered":"2024-04-25T10:04:02.793017+0000","last_clean":"2024-04-25T10:04:02.793017+0000","last_became_active":"2024-04-25T10:03:56.759036+0000","last_became_peered":"2024-04-25T10:03:56.759036+0000","last_unstale":"2024-04-25T10:04:02.793017+0000","last_undegraded":"2024-04-25T10:04:02.793017+0000","last_fullsized":"2024-04-25T10:04:02.793017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:09.264916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275006+0000","last_change":"2024-04-25T10:03:55.760284+0000","last_active":"2024-04-25T10:04:03.275006+0000","last_peered":"2024-04-25T10:04:03.275006+0000","last_clean":"2024-04-25T10:04:03.275006+0000","last_became_active":"2024-04-25T10:03:55.757931+0000","last_became_peered":"2024-04-25T10:03:55.757931+0000","last_unstale":"2024-04-25T10:04:03.275006+0000","last_undegraded":"2024-04-25T10:04:03.275006+0000","last_fullsized":"2024-04-25T10:04:03.275006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277167+0000","last_change":"2024-04-25T10:04:00.805760+0000","last_active":"2024-04-25T10:04:03.277167+0000","last_peered":"2024-04-25T10:04:03.277167+0000","last_clean":"2024-04-25T10:04:03.277167+0000","last_became_active":"2024-04-25T10:04:00.805409+0000","last_became_peered":"2024-04-25T10:04:00.805409+0000","last_unstale":"2024-04-25T10:04:03.277167+0000","last_undegraded":"2024-04-25T10:04:03.277167+0000","last_fullsized":"2024-04-25T10:04:03.277167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792681+0000","last_change":"2024-04-25T10:03:56.755762+0000","last_active":"2024-04-25T10:04:02.792681+0000","last_peered":"2024-04-25T10:04:02.792681+0000","last_clean":"2024-04-25T10:04:02.792681+0000","last_became_active":"2024-04-25T10:03:56.755497+0000","last_became_peered":"2024-04-25T10:03:56.755497+0000","last_unstale":"2024-04-25T10:04:02.792681+0000","last_undegraded":"2024-04-25T10:04:02.792681+0000","last_fullsized":"2024-04-25T10:04:02.792681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:39.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274613+0000","last_change":"2024-04-25T10:03:55.768303+0000","last_active":"2024-04-25T10:04:03.274613+0000","last_peered":"2024-04-25T10:04:03.274613+0000","last_clean":"2024-04-25T10:04:03.274613+0000","last_became_active":"2024-04-25T10:03:55.767994+0000","last_became_peered":"2024-04-25T10:03:55.767994+0000","last_unstale":"2024-04-25T10:04:03.274613+0000","last_undegraded":"2024-04-25T10:04:03.274613+0000","last_fullsized":"2024-04-25T10:04:03.274613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275339+0000","last_change":"2024-04-25T10:04:01.284089+0000","last_active":"2024-04-25T10:04:03.275339+0000","last_peered":"2024-04-25T10:04:03.275339+0000","last_clean":"2024-04-25T10:04:03.275339+0000","last_became_active":"2024-04-25T10:04:01.283683+0000","last_became_peered":"2024-04-25T10:04:01.283683+0000","last_unstale":"2024-04-25T10:04:03.275339+0000","last_undegraded":"2024-04-25T10:04:03.275339+0000","last_fullsized":"2024-04-25T10:04:03.275339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278023+0000","last_change":"2024-04-25T10:03:56.763149+0000","last_active":"2024-04-25T10:04:03.278023+0000","last_peered":"2024-04-25T10:04:03.278023+0000","last_clean":"2024-04-25T10:04:03.278023+0000","last_became_active":"2024-04-25T10:03:56.762775+0000","last_became_peered":"2024-04-25T10:03:56.762775+0000","last_unstale":"2024-04-25T10:04:03.278023+0000","last_undegraded":"2024-04-25T10:04:03.278023+0000","last_fullsized":"2024-04-25T10:04:03.278023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:40.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276548+0000","last_change":"2024-04-25T10:03:55.769495+0000","last_active":"2024-04-25T10:04:03.276548+0000","last_peered":"2024-04-25T10:04:03.276548+0000","last_clean":"2024-04-25T10:04:03.276548+0000","last_became_active":"2024-04-25T10:03:55.769215+0000","last_became_peered":"2024-04-25T10:03:55.769215+0000","last_unstale":"2024-04-25T10:04:03.276548+0000","last_undegraded":"2024-04-25T10:04:03.276548+0000","last_fullsized":"2024-04-25T10:04:03.276548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278249+0000","last_change":"2024-04-25T10:04:00.809196+0000","last_active":"2024-04-25T10:04:03.278249+0000","last_peered":"2024-04-25T10:04:03.278249+0000","last_clean":"2024-04-25T10:04:03.278249+0000","last_became_active":"2024-04-25T10:04:00.808831+0000","last_became_peered":"2024-04-25T10:04:00.808831+0000","last_unstale":"2024-04-25T10:04:03.278249+0000","last_undegraded":"2024-04-25T10:04:03.278249+0000","last_fullsized":"2024-04-25T10:04:03.278249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266867+0000","last_change":"2024-04-25T10:03:56.758244+0000","last_active":"2024-04-25T10:04:03.266867+0000","last_peered":"2024-04-25T10:04:03.266867+0000","last_clean":"2024-04-25T10:04:03.266867+0000","last_became_active":"2024-04-25T10:03:56.757968+0000","last_became_peered":"2024-04-25T10:03:56.757968+0000","last_unstale":"2024-04-25T10:04:03.266867+0000","last_undegraded":"2024-04-25T10:04:03.266867+0000","last_fullsized":"2024-04-25T10:04:03.266867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:01.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797119+0000","last_change":"2024-04-25T10:03:55.771510+0000","last_active":"2024-04-25T10:04:02.797119+0000","last_peered":"2024-04-25T10:04:02.797119+0000","last_clean":"2024-04-25T10:04:02.797119+0000","last_became_active":"2024-04-25T10:03:55.771339+0000","last_became_peered":"2024-04-25T10:03:55.771339+0000","last_unstale":"2024-04-25T10:04:02.797119+0000","last_undegraded":"2024-04-25T10:04:02.797119+0000","last_fullsized":"2024-04-25T10:04:02.797119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277693+0000","last_change":"2024-04-25T10:04:01.287169+0000","last_active":"2024-04-25T10:04:03.277693+0000","last_peered":"2024-04-25T10:04:03.277693+0000","last_clean":"2024-04-25T10:04:03.277693+0000","last_became_active":"2024-04-25T10:04:01.286796+0000","last_became_peered":"2024-04-25T10:04:01.286796+0000","last_unstale":"2024-04-25T10:04:03.277693+0000","last_undegraded":"2024-04-25T10:04:03.277693+0000","last_fullsized":"2024-04-25T10:04:03.277693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:30.474221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793347+0000","last_change":"2024-04-25T10:03:56.780820+0000","last_active":"2024-04-25T10:04:02.793347+0000","last_peered":"2024-04-25T10:04:02.793347+0000","last_clean":"2024-04-25T10:04:02.793347+0000","last_became_active":"2024-04-25T10:03:56.780475+0000","last_became_peered":"2024-04-25T10:03:56.780475+0000","last_unstale":"2024-04-25T10:04:02.793347+0000","last_undegraded":"2024-04-25T10:04:02.793347+0000","last_fullsized":"2024-04-25T10:04:02.793347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:31.014597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275213+0000","last_change":"2024-04-25T10:03:55.767628+0000","last_active":"2024-04-25T10:04:03.275213+0000","last_peered":"2024-04-25T10:04:03.275213+0000","last_clean":"2024-04-25T10:04:03.275213+0000","last_became_active":"2024-04-25T10:03:55.767120+0000","last_became_peered":"2024-04-25T10:03:55.767120+0000","last_unstale":"2024-04-25T10:04:03.275213+0000","last_undegraded":"2024-04-25T10:04:03.275213+0000","last_fullsized":"2024-04-25T10:04:03.275213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792464+0000","last_change":"2024-04-25T10:04:01.283339+0000","last_active":"2024-04-25T10:04:02.792464+0000","last_peered":"2024-04-25T10:04:02.792464+0000","last_clean":"2024-04-25T10:04:02.792464+0000","last_became_active":"2024-04-25T10:04:01.282887+0000","last_became_peered":"2024-04-25T10:04:01.282887+0000","last_unstale":"2024-04-25T10:04:02.792464+0000","last_undegraded":"2024-04-25T10:04:02.792464+0000","last_fullsized":"2024-04-25T10:04:02.792464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:12.942551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274964+0000","last_change":"2024-04-25T10:03:56.756195+0000","last_active":"2024-04-25T10:04:03.274964+0000","last_peered":"2024-04-25T10:04:03.274964+0000","last_clean":"2024-04-25T10:04:03.274964+0000","last_became_active":"2024-04-25T10:03:56.755888+0000","last_became_peered":"2024-04-25T10:03:56.755888+0000","last_unstale":"2024-04-25T10:04:03.274964+0000","last_undegraded":"2024-04-25T10:04:03.274964+0000","last_fullsized":"2024-04-25T10:04:03.274964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277826+0000","last_change":"2024-04-25T10:03:55.774206+0000","last_active":"2024-04-25T10:04:03.277826+0000","last_peered":"2024-04-25T10:04:03.277826+0000","last_clean":"2024-04-25T10:04:03.277826+0000","last_became_active":"2024-04-25T10:03:55.773820+0000","last_became_peered":"2024-04-25T10:03:55.773820+0000","last_unstale":"2024-04-25T10:04:03.277826+0000","last_undegraded":"2024-04-25T10:04:03.277826+0000","last_fullsized":"2024-04-25T10:04:03.277826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:37.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266562+0000","last_change":"2024-04-25T10:04:01.284399+0000","last_active":"2024-04-25T10:04:03.266562+0000","last_peered":"2024-04-25T10:04:03.266562+0000","last_clean":"2024-04-25T10:04:03.266562+0000","last_became_active":"2024-04-25T10:04:01.283878+0000","last_became_peered":"2024-04-25T10:04:01.283878+0000","last_unstale":"2024-04-25T10:04:03.266562+0000","last_undegraded":"2024-04-25T10:04:03.266562+0000","last_fullsized":"2024-04-25T10:04:03.266562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797072+0000","last_change":"2024-04-25T10:03:56.792726+0000","last_active":"2024-04-25T10:04:02.797072+0000","last_peered":"2024-04-25T10:04:02.797072+0000","last_clean":"2024-04-25T10:04:02.797072+0000","last_became_active":"2024-04-25T10:03:56.792471+0000","last_became_peered":"2024-04-25T10:03:56.792471+0000","last_unstale":"2024-04-25T10:04:02.797072+0000","last_undegraded":"2024-04-25T10:04:02.797072+0000","last_fullsized":"2024-04-25T10:04:02.797072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275057+0000","last_change":"2024-04-25T10:03:55.757369+0000","last_active":"2024-04-25T10:04:03.275057+0000","last_peered":"2024-04-25T10:04:03.275057+0000","last_clean":"2024-04-25T10:04:03.275057+0000","last_became_active":"2024-04-25T10:03:55.756884+0000","last_became_peered":"2024-04-25T10:03:55.756884+0000","last_unstale":"2024-04-25T10:04:03.275057+0000","last_undegraded":"2024-04-25T10:04:03.275057+0000","last_fullsized":"2024-04-25T10:04:03.275057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274691+0000","last_change":"2024-04-25T10:04:00.803156+0000","last_active":"2024-04-25T10:04:03.274691+0000","last_peered":"2024-04-25T10:04:03.274691+0000","last_clean":"2024-04-25T10:04:03.274691+0000","last_became_active":"2024-04-25T10:04:00.802652+0000","last_became_peered":"2024-04-25T10:04:00.802652+0000","last_unstale":"2024-04-25T10:04:03.274691+0000","last_undegraded":"2024-04-25T10:04:03.274691+0000","last_fullsized":"2024-04-25T10:04:03.274691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278393+0000","last_change":"2024-04-25T10:03:56.770389+0000","last_active":"2024-04-25T10:04:03.278393+0000","last_peered":"2024-04-25T10:04:03.278393+0000","last_clean":"2024-04-25T10:04:03.278393+0000","last_became_active":"2024-04-25T10:03:56.769936+0000","last_became_peered":"2024-04-25T10:03:56.769936+0000","last_unstale":"2024-04-25T10:04:03.278393+0000","last_undegraded":"2024-04-25T10:04:03.278393+0000","last_fullsized":"2024-04-25T10:04:03.278393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:45.815606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796171+0000","last_change":"2024-04-25T10:03:55.761355+0000","last_active":"2024-04-25T10:04:02.796171+0000","last_peered":"2024-04-25T10:04:02.796171+0000","last_clean":"2024-04-25T10:04:02.796171+0000","last_became_active":"2024-04-25T10:03:55.759914+0000","last_became_peered":"2024-04-25T10:03:55.759914+0000","last_unstale":"2024-04-25T10:04:02.796171+0000","last_undegraded":"2024-04-25T10:04:02.796171+0000","last_fullsized":"2024-04-25T10:04:02.796171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274995+0000","last_change":"2024-04-25T10:04:00.806848+0000","last_active":"2024-04-25T10:04:03.274995+0000","last_peered":"2024-04-25T10:04:03.274995+0000","last_clean":"2024-04-25T10:04:03.274995+0000","last_became_active":"2024-04-25T10:04:00.805433+0000","last_became_peered":"2024-04-25T10:04:00.805433+0000","last_unstale":"2024-04-25T10:04:03.274995+0000","last_undegraded":"2024-04-25T10:04:03.274995+0000","last_fullsized":"2024-04-25T10:04:03.274995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274628+0000","last_change":"2024-04-25T10:03:56.755931+0000","last_active":"2024-04-25T10:04:03.274628+0000","last_peered":"2024-04-25T10:04:03.274628+0000","last_clean":"2024-04-25T10:04:03.274628+0000","last_became_active":"2024-04-25T10:03:56.755452+0000","last_became_peered":"2024-04-25T10:03:56.755452+0000","last_unstale":"2024-04-25T10:04:03.274628+0000","last_undegraded":"2024-04-25T10:04:03.274628+0000","last_fullsized":"2024-04-25T10:04:03.274628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230585+0000","last_change":"2024-04-25T10:03:55.762333+0000","last_active":"2024-04-25T10:04:03.230585+0000","last_peered":"2024-04-25T10:04:03.230585+0000","last_clean":"2024-04-25T10:04:03.230585+0000","last_became_active":"2024-04-25T10:03:55.758957+0000","last_became_peered":"2024-04-25T10:03:55.758957+0000","last_unstale":"2024-04-25T10:04:03.230585+0000","last_undegraded":"2024-04-25T10:04:03.230585+0000","last_fullsized":"2024-04-25T10:04:03.230585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275382+0000","last_change":"2024-04-25T10:04:00.805357+0000","last_active":"2024-04-25T10:04:03.275382+0000","last_peered":"2024-04-25T10:04:03.275382+0000","last_clean":"2024-04-25T10:04:03.275382+0000","last_became_active":"2024-04-25T10:04:00.804893+0000","last_became_peered":"2024-04-25T10:04:00.804893+0000","last_unstale":"2024-04-25T10:04:03.275382+0000","last_undegraded":"2024-04-25T10:04:03.275382+0000","last_fullsized":"2024-04-25T10:04:03.275382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266268+0000","last_change":"2024-04-25T10:03:56.780512+0000","last_active":"2024-04-25T10:04:03.266268+0000","last_peered":"2024-04-25T10:04:03.266268+0000","last_clean":"2024-04-25T10:04:03.266268+0000","last_became_active":"2024-04-25T10:03:56.779316+0000","last_became_peered":"2024-04-25T10:03:56.779316+0000","last_unstale":"2024-04-25T10:04:03.266268+0000","last_undegraded":"2024-04-25T10:04:03.266268+0000","last_fullsized":"2024-04-25T10:04:03.266268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276680+0000","last_change":"2024-04-25T10:03:55.773928+0000","last_active":"2024-04-25T10:04:03.276680+0000","last_peered":"2024-04-25T10:04:03.276680+0000","last_clean":"2024-04-25T10:04:03.276680+0000","last_became_active":"2024-04-25T10:03:55.773501+0000","last_became_peered":"2024-04-25T10:03:55.773501+0000","last_unstale":"2024-04-25T10:04:03.276680+0000","last_undegraded":"2024-04-25T10:04:03.276680+0000","last_fullsized":"2024-04-25T10:04:03.276680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266794+0000","last_change":"2024-04-25T10:04:01.283753+0000","last_active":"2024-04-25T10:04:03.266794+0000","last_peered":"2024-04-25T10:04:03.266794+0000","last_clean":"2024-04-25T10:04:03.266794+0000","last_became_active":"2024-04-25T10:04:01.283221+0000","last_became_peered":"2024-04-25T10:04:01.283221+0000","last_unstale":"2024-04-25T10:04:03.266794+0000","last_undegraded":"2024-04-25T10:04:03.266794+0000","last_fullsized":"2024-04-25T10:04:03.266794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:18.295693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792932+0000","last_change":"2024-04-25T10:03:56.766943+0000","last_active":"2024-04-25T10:04:02.792932+0000","last_peered":"2024-04-25T10:04:02.792932+0000","last_clean":"2024-04-25T10:04:02.792932+0000","last_became_active":"2024-04-25T10:03:56.766550+0000","last_became_peered":"2024-04-25T10:03:56.766550+0000","last_unstale":"2024-04-25T10:04:02.792932+0000","last_undegraded":"2024-04-25T10:04:02.792932+0000","last_fullsized":"2024-04-25T10:04:02.792932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:05.977869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796601+0000","last_change":"2024-04-25T10:03:55.764614+0000","last_active":"2024-04-25T10:04:02.796601+0000","last_peered":"2024-04-25T10:04:02.796601+0000","last_clean":"2024-04-25T10:04:02.796601+0000","last_became_active":"2024-04-25T10:03:55.763995+0000","last_became_peered":"2024-04-25T10:03:55.763995+0000","last_unstale":"2024-04-25T10:04:02.796601+0000","last_undegraded":"2024-04-25T10:04:02.796601+0000","last_fullsized":"2024-04-25T10:04:02.796601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276800+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:04:03.276800+0000","last_peered":"2024-04-25T10:04:03.276800+0000","last_clean":"2024-04-25T10:04:03.276800+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:04:03.276800+0000","last_undegraded":"2024-04-25T10:04:03.276800+0000","last_fullsized":"2024-04-25T10:04:03.276800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797001+0000","last_change":"2024-04-25T10:04:01.285814+0000","last_active":"2024-04-25T10:04:02.797001+0000","last_peered":"2024-04-25T10:04:02.797001+0000","last_clean":"2024-04-25T10:04:02.797001+0000","last_became_active":"2024-04-25T10:04:01.285361+0000","last_became_peered":"2024-04-25T10:04:01.285361+0000","last_unstale":"2024-04-25T10:04:02.797001+0000","last_undegraded":"2024-04-25T10:04:02.797001+0000","last_fullsized":"2024-04-25T10:04:02.797001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277347+0000","last_change":"2024-04-25T10:03:56.796054+0000","last_active":"2024-04-25T10:04:03.277347+0000","last_peered":"2024-04-25T10:04:03.277347+0000","last_clean":"2024-04-25T10:04:03.277347+0000","last_became_active":"2024-04-25T10:03:56.795756+0000","last_became_peered":"2024-04-25T10:03:56.795756+0000","last_unstale":"2024-04-25T10:04:03.277347+0000","last_undegraded":"2024-04-25T10:04:03.277347+0000","last_fullsized":"2024-04-25T10:04:03.277347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230858+0000","last_change":"2024-04-25T10:03:55.760034+0000","last_active":"2024-04-25T10:04:03.230858+0000","last_peered":"2024-04-25T10:04:03.230858+0000","last_clean":"2024-04-25T10:04:03.230858+0000","last_became_active":"2024-04-25T10:03:55.757148+0000","last_became_peered":"2024-04-25T10:03:55.757148+0000","last_unstale":"2024-04-25T10:04:03.230858+0000","last_undegraded":"2024-04-25T10:04:03.230858+0000","last_fullsized":"2024-04-25T10:04:03.230858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796177+0000","last_change":"2024-04-25T10:04:01.285490+0000","last_active":"2024-04-25T10:04:02.796177+0000","last_peered":"2024-04-25T10:04:02.796177+0000","last_clean":"2024-04-25T10:04:02.796177+0000","last_became_active":"2024-04-25T10:04:01.285082+0000","last_became_peered":"2024-04-25T10:04:01.285082+0000","last_unstale":"2024-04-25T10:04:02.796177+0000","last_undegraded":"2024-04-25T10:04:02.796177+0000","last_fullsized":"2024-04-25T10:04:02.796177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796963+0000","last_change":"2024-04-25T10:03:56.767947+0000","last_active":"2024-04-25T10:04:02.796963+0000","last_peered":"2024-04-25T10:04:02.796963+0000","last_clean":"2024-04-25T10:04:02.796963+0000","last_became_active":"2024-04-25T10:03:56.767392+0000","last_became_peered":"2024-04-25T10:03:56.767392+0000","last_unstale":"2024-04-25T10:04:02.796963+0000","last_undegraded":"2024-04-25T10:04:02.796963+0000","last_fullsized":"2024-04-25T10:04:02.796963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274971+0000","last_change":"2024-04-25T10:03:55.756201+0000","last_active":"2024-04-25T10:04:03.274971+0000","last_peered":"2024-04-25T10:04:03.274971+0000","last_clean":"2024-04-25T10:04:03.274971+0000","last_became_active":"2024-04-25T10:03:55.755298+0000","last_became_peered":"2024-04-25T10:03:55.755298+0000","last_unstale":"2024-04-25T10:04:03.274971+0000","last_undegraded":"2024-04-25T10:04:03.274971+0000","last_fullsized":"2024-04-25T10:04:03.274971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266768+0000","last_change":"2024-04-25T10:04:00.799071+0000","last_active":"2024-04-25T10:04:03.266768+0000","last_peered":"2024-04-25T10:04:03.266768+0000","last_clean":"2024-04-25T10:04:03.266768+0000","last_became_active":"2024-04-25T10:04:00.798641+0000","last_became_peered":"2024-04-25T10:04:00.798641+0000","last_unstale":"2024-04-25T10:04:03.266768+0000","last_undegraded":"2024-04-25T10:04:03.266768+0000","last_fullsized":"2024-04-25T10:04:03.266768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277674+0000","last_change":"2024-04-25T10:03:56.794134+0000","last_active":"2024-04-25T10:04:03.277674+0000","last_peered":"2024-04-25T10:04:03.277674+0000","last_clean":"2024-04-25T10:04:03.277674+0000","last_became_active":"2024-04-25T10:03:56.793845+0000","last_became_peered":"2024-04-25T10:03:56.793845+0000","last_unstale":"2024-04-25T10:04:03.277674+0000","last_undegraded":"2024-04-25T10:04:03.277674+0000","last_fullsized":"2024-04-25T10:04:03.277674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230962+0000","last_change":"2024-04-25T10:03:55.758720+0000","last_active":"2024-04-25T10:04:03.230962+0000","last_peered":"2024-04-25T10:04:03.230962+0000","last_clean":"2024-04-25T10:04:03.230962+0000","last_became_active":"2024-04-25T10:03:55.758417+0000","last_became_peered":"2024-04-25T10:03:55.758417+0000","last_unstale":"2024-04-25T10:04:03.230962+0000","last_undegraded":"2024-04-25T10:04:03.230962+0000","last_fullsized":"2024-04-25T10:04:03.230962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795441+0000","last_change":"2024-04-25T10:04:01.285580+0000","last_active":"2024-04-25T10:04:02.795441+0000","last_peered":"2024-04-25T10:04:02.795441+0000","last_clean":"2024-04-25T10:04:02.795441+0000","last_became_active":"2024-04-25T10:04:01.285212+0000","last_became_peered":"2024-04-25T10:04:01.285212+0000","last_unstale":"2024-04-25T10:04:02.795441+0000","last_undegraded":"2024-04-25T10:04:02.795441+0000","last_fullsized":"2024-04-25T10:04:02.795441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277394+0000","last_change":"2024-04-25T10:03:56.787338+0000","last_active":"2024-04-25T10:04:03.277394+0000","last_peered":"2024-04-25T10:04:03.277394+0000","last_clean":"2024-04-25T10:04:03.277394+0000","last_became_active":"2024-04-25T10:03:56.787066+0000","last_became_peered":"2024-04-25T10:03:56.787066+0000","last_unstale":"2024-04-25T10:04:03.277394+0000","last_undegraded":"2024-04-25T10:04:03.277394+0000","last_fullsized":"2024-04-25T10:04:03.277394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278632+0000","last_change":"2024-04-25T10:03:55.755120+0000","last_active":"2024-04-25T10:04:03.278632+0000","last_peered":"2024-04-25T10:04:03.278632+0000","last_clean":"2024-04-25T10:04:03.278632+0000","last_became_active":"2024-04-25T10:03:55.754636+0000","last_became_peered":"2024-04-25T10:03:55.754636+0000","last_unstale":"2024-04-25T10:04:03.278632+0000","last_undegraded":"2024-04-25T10:04:03.278632+0000","last_fullsized":"2024-04-25T10:04:03.278632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:44.495603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276603+0000","last_change":"2024-04-25T10:04:00.808408+0000","last_active":"2024-04-25T10:04:03.276603+0000","last_peered":"2024-04-25T10:04:03.276603+0000","last_clean":"2024-04-25T10:04:03.276603+0000","last_became_active":"2024-04-25T10:04:00.808024+0000","last_became_peered":"2024-04-25T10:04:00.808024+0000","last_unstale":"2024-04-25T10:04:03.276603+0000","last_undegraded":"2024-04-25T10:04:03.276603+0000","last_fullsized":"2024-04-25T10:04:03.276603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277668+0000","last_change":"2024-04-25T10:03:56.783068+0000","last_active":"2024-04-25T10:04:03.277668+0000","last_peered":"2024-04-25T10:04:03.277668+0000","last_clean":"2024-04-25T10:04:03.277668+0000","last_became_active":"2024-04-25T10:03:56.782782+0000","last_became_peered":"2024-04-25T10:03:56.782782+0000","last_unstale":"2024-04-25T10:04:03.277668+0000","last_undegraded":"2024-04-25T10:04:03.277668+0000","last_fullsized":"2024-04-25T10:04:03.277668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230449+0000","last_change":"2024-04-25T10:03:55.764472+0000","last_active":"2024-04-25T10:04:03.230449+0000","last_peered":"2024-04-25T10:04:03.230449+0000","last_clean":"2024-04-25T10:04:03.230449+0000","last_became_active":"2024-04-25T10:03:55.763968+0000","last_became_peered":"2024-04-25T10:03:55.763968+0000","last_unstale":"2024-04-25T10:04:03.230449+0000","last_undegraded":"2024-04-25T10:04:03.230449+0000","last_fullsized":"2024-04-25T10:04:03.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266626+0000","last_change":"2024-04-25T10:04:00.807342+0000","last_active":"2024-04-25T10:04:03.266626+0000","last_peered":"2024-04-25T10:04:03.266626+0000","last_clean":"2024-04-25T10:04:03.266626+0000","last_became_active":"2024-04-25T10:04:00.806899+0000","last_became_peered":"2024-04-25T10:04:00.806899+0000","last_unstale":"2024-04-25T10:04:03.266626+0000","last_undegraded":"2024-04-25T10:04:03.266626+0000","last_fullsized":"2024-04-25T10:04:03.266626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797285+0000","last_change":"2024-04-25T10:03:56.759704+0000","last_active":"2024-04-25T10:04:02.797285+0000","last_peered":"2024-04-25T10:04:02.797285+0000","last_clean":"2024-04-25T10:04:02.797285+0000","last_became_active":"2024-04-25T10:03:56.758730+0000","last_became_peered":"2024-04-25T10:03:56.758730+0000","last_unstale":"2024-04-25T10:04:02.797285+0000","last_undegraded":"2024-04-25T10:04:02.797285+0000","last_fullsized":"2024-04-25T10:04:02.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796361+0000","last_change":"2024-04-25T10:03:55.753914+0000","last_active":"2024-04-25T10:04:02.796361+0000","last_peered":"2024-04-25T10:04:02.796361+0000","last_clean":"2024-04-25T10:04:02.796361+0000","last_became_active":"2024-04-25T10:03:55.752892+0000","last_became_peered":"2024-04-25T10:03:55.752892+0000","last_unstale":"2024-04-25T10:04:02.796361+0000","last_undegraded":"2024-04-25T10:04:02.796361+0000","last_fullsized":"2024-04-25T10:04:02.796361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793148+0000","last_change":"2024-04-25T10:04:01.283999+0000","last_active":"2024-04-25T10:04:02.793148+0000","last_peered":"2024-04-25T10:04:02.793148+0000","last_clean":"2024-04-25T10:04:02.793148+0000","last_became_active":"2024-04-25T10:04:01.283582+0000","last_became_peered":"2024-04-25T10:04:01.283582+0000","last_unstale":"2024-04-25T10:04:02.793148+0000","last_undegraded":"2024-04-25T10:04:02.793148+0000","last_fullsized":"2024-04-25T10:04:02.793148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:49.714373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277636+0000","last_change":"2024-04-25T10:03:56.783331+0000","last_active":"2024-04-25T10:04:03.277636+0000","last_peered":"2024-04-25T10:04:03.277636+0000","last_clean":"2024-04-25T10:04:03.277636+0000","last_became_active":"2024-04-25T10:03:56.782448+0000","last_became_peered":"2024-04-25T10:03:56.782448+0000","last_unstale":"2024-04-25T10:04:03.277636+0000","last_undegraded":"2024-04-25T10:04:03.277636+0000","last_fullsized":"2024-04-25T10:04:03.277636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:00.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796126+0000","last_change":"2024-04-25T10:03:55.761416+0000","last_active":"2024-04-25T10:04:02.796126+0000","last_peered":"2024-04-25T10:04:02.796126+0000","last_clean":"2024-04-25T10:04:02.796126+0000","last_became_active":"2024-04-25T10:03:55.760610+0000","last_became_peered":"2024-04-25T10:03:55.760610+0000","last_unstale":"2024-04-25T10:04:02.796126+0000","last_undegraded":"2024-04-25T10:04:02.796126+0000","last_fullsized":"2024-04-25T10:04:02.796126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793073+0000","last_change":"2024-04-25T10:04:01.287382+0000","last_active":"2024-04-25T10:04:02.793073+0000","last_peered":"2024-04-25T10:04:02.793073+0000","last_clean":"2024-04-25T10:04:02.793073+0000","last_became_active":"2024-04-25T10:04:01.285777+0000","last_became_peered":"2024-04-25T10:04:01.285777+0000","last_unstale":"2024-04-25T10:04:02.793073+0000","last_undegraded":"2024-04-25T10:04:02.793073+0000","last_fullsized":"2024-04-25T10:04:02.793073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:21.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266469+0000","last_change":"2024-04-25T10:03:56.772446+0000","last_active":"2024-04-25T10:04:03.266469+0000","last_peered":"2024-04-25T10:04:03.266469+0000","last_clean":"2024-04-25T10:04:03.266469+0000","last_became_active":"2024-04-25T10:03:56.772029+0000","last_became_peered":"2024-04-25T10:03:56.772029+0000","last_unstale":"2024-04-25T10:04:03.266469+0000","last_undegraded":"2024-04-25T10:04:03.266469+0000","last_fullsized":"2024-04-25T10:04:03.266469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266991+0000","last_change":"2024-04-25T10:03:55.747987+0000","last_active":"2024-04-25T10:04:03.266991+0000","last_peered":"2024-04-25T10:04:03.266991+0000","last_clean":"2024-04-25T10:04:03.266991+0000","last_became_active":"2024-04-25T10:03:55.747631+0000","last_became_peered":"2024-04-25T10:03:55.747631+0000","last_unstale":"2024-04-25T10:04:03.266991+0000","last_undegraded":"2024-04-25T10:04:03.266991+0000","last_fullsized":"2024-04-25T10:04:03.266991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:44.719385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796909+0000","last_change":"2024-04-25T10:04:01.286318+0000","last_active":"2024-04-25T10:04:02.796909+0000","last_peered":"2024-04-25T10:04:02.796909+0000","last_clean":"2024-04-25T10:04:02.796909+0000","last_became_active":"2024-04-25T10:04:01.285907+0000","last_became_peered":"2024-04-25T10:04:01.285907+0000","last_unstale":"2024-04-25T10:04:02.796909+0000","last_undegraded":"2024-04-25T10:04:02.796909+0000","last_fullsized":"2024-04-25T10:04:02.796909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277610+0000","last_change":"2024-04-25T10:03:56.781752+0000","last_active":"2024-04-25T10:04:03.277610+0000","last_peered":"2024-04-25T10:04:03.277610+0000","last_clean":"2024-04-25T10:04:03.277610+0000","last_became_active":"2024-04-25T10:03:56.781491+0000","last_became_peered":"2024-04-25T10:03:56.781491+0000","last_unstale":"2024-04-25T10:04:03.277610+0000","last_undegraded":"2024-04-25T10:04:03.277610+0000","last_fullsized":"2024-04-25T10:04:03.277610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:11.993610+0000","last_change":"2024-04-25T10:03:55.766431+0000","last_active":"2024-04-25T10:04:11.993610+0000","last_peered":"2024-04-25T10:04:11.993610+0000","last_clean":"2024-04-25T10:04:11.993610+0000","last_became_active":"2024-04-25T10:03:55.761777+0000","last_became_peered":"2024-04-25T10:03:55.761777+0000","last_unstale":"2024-04-25T10:04:11.993610+0000","last_undegraded":"2024-04-25T10:04:11.993610+0000","last_fullsized":"2024-04-25T10:04:11.993610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275114+0000","last_change":"2024-04-25T10:04:00.801843+0000","last_active":"2024-04-25T10:04:03.275114+0000","last_peered":"2024-04-25T10:04:03.275114+0000","last_clean":"2024-04-25T10:04:03.275114+0000","last_became_active":"2024-04-25T10:04:00.801403+0000","last_became_peered":"2024-04-25T10:04:00.801403+0000","last_unstale":"2024-04-25T10:04:03.275114+0000","last_undegraded":"2024-04-25T10:04:03.275114+0000","last_fullsized":"2024-04-25T10:04:03.275114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277428+0000","last_change":"2024-04-25T10:03:56.782319+0000","last_active":"2024-04-25T10:04:03.277428+0000","last_peered":"2024-04-25T10:04:03.277428+0000","last_clean":"2024-04-25T10:04:03.277428+0000","last_became_active":"2024-04-25T10:03:56.781988+0000","last_became_peered":"2024-04-25T10:03:56.781988+0000","last_unstale":"2024-04-25T10:04:03.277428+0000","last_undegraded":"2024-04-25T10:04:03.277428+0000","last_fullsized":"2024-04-25T10:04:03.277428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274941+0000","last_change":"2024-04-25T10:03:55.767225+0000","last_active":"2024-04-25T10:04:03.274941+0000","last_peered":"2024-04-25T10:04:03.274941+0000","last_clean":"2024-04-25T10:04:03.274941+0000","last_became_active":"2024-04-25T10:03:55.766947+0000","last_became_peered":"2024-04-25T10:03:55.766947+0000","last_unstale":"2024-04-25T10:04:03.274941+0000","last_undegraded":"2024-04-25T10:04:03.274941+0000","last_fullsized":"2024-04-25T10:04:03.274941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278424+0000","last_change":"2024-04-25T10:04:00.797613+0000","last_active":"2024-04-25T10:04:03.278424+0000","last_peered":"2024-04-25T10:04:03.278424+0000","last_clean":"2024-04-25T10:04:03.278424+0000","last_became_active":"2024-04-25T10:04:00.797207+0000","last_became_peered":"2024-04-25T10:04:00.797207+0000","last_unstale":"2024-04-25T10:04:03.278424+0000","last_undegraded":"2024-04-25T10:04:03.278424+0000","last_fullsized":"2024-04-25T10:04:03.278424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266976+0000","last_change":"2024-04-25T10:03:56.774964+0000","last_active":"2024-04-25T10:04:03.266976+0000","last_peered":"2024-04-25T10:04:03.266976+0000","last_clean":"2024-04-25T10:04:03.266976+0000","last_became_active":"2024-04-25T10:03:56.770623+0000","last_became_peered":"2024-04-25T10:03:56.770623+0000","last_unstale":"2024-04-25T10:04:03.266976+0000","last_undegraded":"2024-04-25T10:04:03.266976+0000","last_fullsized":"2024-04-25T10:04:03.266976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797269+0000","last_change":"2024-04-25T10:03:55.772282+0000","last_active":"2024-04-25T10:04:02.797269+0000","last_peered":"2024-04-25T10:04:02.797269+0000","last_clean":"2024-04-25T10:04:02.797269+0000","last_became_active":"2024-04-25T10:03:55.771984+0000","last_became_peered":"2024-04-25T10:03:55.771984+0000","last_unstale":"2024-04-25T10:04:02.797269+0000","last_undegraded":"2024-04-25T10:04:02.797269+0000","last_fullsized":"2024-04-25T10:04:02.797269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792604+0000","last_change":"2024-04-25T10:04:00.802185+0000","last_active":"2024-04-25T10:04:02.792604+0000","last_peered":"2024-04-25T10:04:02.792604+0000","last_clean":"2024-04-25T10:04:02.792604+0000","last_became_active":"2024-04-25T10:04:00.801810+0000","last_became_peered":"2024-04-25T10:04:00.801810+0000","last_unstale":"2024-04-25T10:04:02.792604+0000","last_undegraded":"2024-04-25T10:04:02.792604+0000","last_fullsized":"2024-04-25T10:04:02.792604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:47.336597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797055+0000","last_change":"2024-04-25T10:03:56.786962+0000","last_active":"2024-04-25T10:04:02.797055+0000","last_peered":"2024-04-25T10:04:02.797055+0000","last_clean":"2024-04-25T10:04:02.797055+0000","last_became_active":"2024-04-25T10:03:56.786671+0000","last_became_peered":"2024-04-25T10:03:56.786671+0000","last_unstale":"2024-04-25T10:04:02.797055+0000","last_undegraded":"2024-04-25T10:04:02.797055+0000","last_fullsized":"2024-04-25T10:04:02.797055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796832+0000","last_change":"2024-04-25T10:03:55.769399+0000","last_active":"2024-04-25T10:04:02.796832+0000","last_peered":"2024-04-25T10:04:02.796832+0000","last_clean":"2024-04-25T10:04:02.796832+0000","last_became_active":"2024-04-25T10:03:55.769076+0000","last_became_peered":"2024-04-25T10:03:55.769076+0000","last_unstale":"2024-04-25T10:04:02.796832+0000","last_undegraded":"2024-04-25T10:04:02.796832+0000","last_fullsized":"2024-04-25T10:04:02.796832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792653+0000","last_change":"2024-04-25T10:04:01.284799+0000","last_active":"2024-04-25T10:04:02.792653+0000","last_peered":"2024-04-25T10:04:02.792653+0000","last_clean":"2024-04-25T10:04:02.792653+0000","last_became_active":"2024-04-25T10:04:01.283596+0000","last_became_peered":"2024-04-25T10:04:01.283596+0000","last_unstale":"2024-04-25T10:04:02.792653+0000","last_undegraded":"2024-04-25T10:04:02.792653+0000","last_fullsized":"2024-04-25T10:04:02.792653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:41.435837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266621+0000","last_change":"2024-04-25T10:04:01.286375+0000","last_active":"2024-04-25T10:04:03.266621+0000","last_peered":"2024-04-25T10:04:03.266621+0000","last_clean":"2024-04-25T10:04:03.266621+0000","last_became_active":"2024-04-25T10:04:01.285832+0000","last_became_peered":"2024-04-25T10:04:01.285832+0000","last_unstale":"2024-04-25T10:04:03.266621+0000","last_undegraded":"2024-04-25T10:04:03.266621+0000","last_fullsized":"2024-04-25T10:04:03.266621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274484+0000","last_change":"2024-04-25T10:03:56.760165+0000","last_active":"2024-04-25T10:04:03.274484+0000","last_peered":"2024-04-25T10:04:03.274484+0000","last_clean":"2024-04-25T10:04:03.274484+0000","last_became_active":"2024-04-25T10:03:56.759886+0000","last_became_peered":"2024-04-25T10:03:56.759886+0000","last_unstale":"2024-04-25T10:04:03.274484+0000","last_undegraded":"2024-04-25T10:04:03.274484+0000","last_fullsized":"2024-04-25T10:04:03.274484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795508+0000","last_change":"2024-04-25T10:03:55.759342+0000","last_active":"2024-04-25T10:04:02.795508+0000","last_peered":"2024-04-25T10:04:02.795508+0000","last_clean":"2024-04-25T10:04:02.795508+0000","last_became_active":"2024-04-25T10:03:55.758902+0000","last_became_peered":"2024-04-25T10:03:55.758902+0000","last_unstale":"2024-04-25T10:04:02.795508+0000","last_undegraded":"2024-04-25T10:04:02.795508+0000","last_fullsized":"2024-04-25T10:04:02.795508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796847+0000","last_change":"2024-04-25T10:04:00.800413+0000","last_active":"2024-04-25T10:04:02.796847+0000","last_peered":"2024-04-25T10:04:02.796847+0000","last_clean":"2024-04-25T10:04:02.796847+0000","last_became_active":"2024-04-25T10:04:00.800005+0000","last_became_peered":"2024-04-25T10:04:00.800005+0000","last_unstale":"2024-04-25T10:04:02.796847+0000","last_undegraded":"2024-04-25T10:04:02.796847+0000","last_fullsized":"2024-04-25T10:04:02.796847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792578+0000","last_change":"2024-04-25T10:03:56.754790+0000","last_active":"2024-04-25T10:04:02.792578+0000","last_peered":"2024-04-25T10:04:02.792578+0000","last_clean":"2024-04-25T10:04:02.792578+0000","last_became_active":"2024-04-25T10:03:56.753655+0000","last_became_peered":"2024-04-25T10:03:56.753655+0000","last_unstale":"2024-04-25T10:04:02.792578+0000","last_undegraded":"2024-04-25T10:04:02.792578+0000","last_fullsized":"2024-04-25T10:04:02.792578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:39.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792770+0000","last_change":"2024-04-25T10:03:55.761647+0000","last_active":"2024-04-25T10:04:02.792770+0000","last_peered":"2024-04-25T10:04:02.792770+0000","last_clean":"2024-04-25T10:04:02.792770+0000","last_became_active":"2024-04-25T10:03:55.761495+0000","last_became_peered":"2024-04-25T10:03:55.761495+0000","last_unstale":"2024-04-25T10:04:02.792770+0000","last_undegraded":"2024-04-25T10:04:02.792770+0000","last_fullsized":"2024-04-25T10:04:02.792770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:24.436084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796295+0000","last_change":"2024-04-25T10:03:55.765920+0000","last_active":"2024-04-25T10:04:02.796295+0000","last_peered":"2024-04-25T10:04:02.796295+0000","last_clean":"2024-04-25T10:04:02.796295+0000","last_became_active":"2024-04-25T10:03:55.765626+0000","last_became_peered":"2024-04-25T10:03:55.765626+0000","last_unstale":"2024-04-25T10:04:02.796295+0000","last_undegraded":"2024-04-25T10:04:02.796295+0000","last_fullsized":"2024-04-25T10:04:02.796295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266888+0000","last_change":"2024-04-25T10:03:56.780813+0000","last_active":"2024-04-25T10:04:03.266888+0000","last_peered":"2024-04-25T10:04:03.266888+0000","last_clean":"2024-04-25T10:04:03.266888+0000","last_became_active":"2024-04-25T10:03:56.774414+0000","last_became_peered":"2024-04-25T10:03:56.774414+0000","last_unstale":"2024-04-25T10:04:03.266888+0000","last_undegraded":"2024-04-25T10:04:03.266888+0000","last_fullsized":"2024-04-25T10:04:03.266888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230710+0000","last_change":"2024-04-25T10:04:00.805747+0000","last_active":"2024-04-25T10:04:03.230710+0000","last_peered":"2024-04-25T10:04:03.230710+0000","last_clean":"2024-04-25T10:04:03.230710+0000","last_became_active":"2024-04-25T10:04:00.804310+0000","last_became_peered":"2024-04-25T10:04:00.804310+0000","last_unstale":"2024-04-25T10:04:03.230710+0000","last_undegraded":"2024-04-25T10:04:03.230710+0000","last_fullsized":"2024-04-25T10:04:03.230710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:05.811588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793053+0000","last_change":"2024-04-25T10:03:55.768990+0000","last_active":"2024-04-25T10:04:02.793053+0000","last_peered":"2024-04-25T10:04:02.793053+0000","last_clean":"2024-04-25T10:04:02.793053+0000","last_became_active":"2024-04-25T10:03:55.767518+0000","last_became_peered":"2024-04-25T10:03:55.767518+0000","last_unstale":"2024-04-25T10:04:02.793053+0000","last_undegraded":"2024-04-25T10:04:02.793053+0000","last_fullsized":"2024-04-25T10:04:02.793053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:11.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277092+0000","last_change":"2024-04-25T10:03:56.770753+0000","last_active":"2024-04-25T10:04:03.277092+0000","last_peered":"2024-04-25T10:04:03.277092+0000","last_clean":"2024-04-25T10:04:03.277092+0000","last_became_active":"2024-04-25T10:03:56.770399+0000","last_became_peered":"2024-04-25T10:03:56.770399+0000","last_unstale":"2024-04-25T10:04:03.277092+0000","last_undegraded":"2024-04-25T10:04:03.277092+0000","last_fullsized":"2024-04-25T10:04:03.277092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:12.633520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793274+0000","last_change":"2024-04-25T10:04:00.810546+0000","last_active":"2024-04-25T10:04:02.793274+0000","last_peered":"2024-04-25T10:04:02.793274+0000","last_clean":"2024-04-25T10:04:02.793274+0000","last_became_active":"2024-04-25T10:04:00.809965+0000","last_became_peered":"2024-04-25T10:04:00.809965+0000","last_unstale":"2024-04-25T10:04:02.793274+0000","last_undegraded":"2024-04-25T10:04:02.793274+0000","last_fullsized":"2024-04-25T10:04:02.793274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:25.609318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796086+0000","last_change":"2024-04-25T10:03:56.759410+0000","last_active":"2024-04-25T10:04:02.796086+0000","last_peered":"2024-04-25T10:04:02.796086+0000","last_clean":"2024-04-25T10:04:02.796086+0000","last_became_active":"2024-04-25T10:03:56.759063+0000","last_became_peered":"2024-04-25T10:03:56.759063+0000","last_unstale":"2024-04-25T10:04:02.796086+0000","last_undegraded":"2024-04-25T10:04:02.796086+0000","last_fullsized":"2024-04-25T10:04:02.796086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230579+0000","last_change":"2024-04-25T10:03:56.775592+0000","last_active":"2024-04-25T10:04:03.230579+0000","last_peered":"2024-04-25T10:04:03.230579+0000","last_clean":"2024-04-25T10:04:03.230579+0000","last_became_active":"2024-04-25T10:03:56.775251+0000","last_became_peered":"2024-04-25T10:03:56.775251+0000","last_unstale":"2024-04-25T10:04:03.230579+0000","last_undegraded":"2024-04-25T10:04:03.230579+0000","last_fullsized":"2024-04-25T10:04:03.230579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796019+0000","last_change":"2024-04-25T10:03:56.767847+0000","last_active":"2024-04-25T10:04:02.796019+0000","last_peered":"2024-04-25T10:04:02.796019+0000","last_clean":"2024-04-25T10:04:02.796019+0000","last_became_active":"2024-04-25T10:03:56.767543+0000","last_became_peered":"2024-04-25T10:03:56.767543+0000","last_unstale":"2024-04-25T10:04:02.796019+0000","last_undegraded":"2024-04-25T10:04:02.796019+0000","last_fullsized":"2024-04-25T10:04:02.796019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266882+0000","last_change":"2024-04-25T10:03:56.767650+0000","last_active":"2024-04-25T10:04:03.266882+0000","last_peered":"2024-04-25T10:04:03.266882+0000","last_clean":"2024-04-25T10:04:03.266882+0000","last_became_active":"2024-04-25T10:03:56.767362+0000","last_became_peered":"2024-04-25T10:03:56.767362+0000","last_unstale":"2024-04-25T10:04:03.266882+0000","last_undegraded":"2024-04-25T10:04:03.266882+0000","last_fullsized":"2024-04-25T10:04:03.266882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793258+0000","last_change":"2024-04-25T10:03:56.776617+0000","last_active":"2024-04-25T10:04:02.793258+0000","last_peered":"2024-04-25T10:04:02.793258+0000","last_clean":"2024-04-25T10:04:02.793258+0000","last_became_active":"2024-04-25T10:03:56.776219+0000","last_became_peered":"2024-04-25T10:03:56.776219+0000","last_unstale":"2024-04-25T10:04:02.793258+0000","last_undegraded":"2024-04-25T10:04:02.793258+0000","last_fullsized":"2024-04-25T10:04:02.793258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.744805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274831+0000","last_change":"2024-04-25T10:03:56.759677+0000","last_active":"2024-04-25T10:04:03.274831+0000","last_peered":"2024-04-25T10:04:03.274831+0000","last_clean":"2024-04-25T10:04:03.274831+0000","last_became_active":"2024-04-25T10:03:56.759375+0000","last_became_peered":"2024-04-25T10:03:56.759375+0000","last_unstale":"2024-04-25T10:04:03.274831+0000","last_undegraded":"2024-04-25T10:04:03.274831+0000","last_fullsized":"2024-04-25T10:04:03.274831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797482+0000","last_change":"2024-04-25T10:03:56.780048+0000","last_active":"2024-04-25T10:04:02.797482+0000","last_peered":"2024-04-25T10:04:02.797482+0000","last_clean":"2024-04-25T10:04:02.797482+0000","last_became_active":"2024-04-25T10:03:56.779166+0000","last_became_peered":"2024-04-25T10:03:56.779166+0000","last_unstale":"2024-04-25T10:04:02.797482+0000","last_undegraded":"2024-04-25T10:04:02.797482+0000","last_fullsized":"2024-04-25T10:04:02.797482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793245+0000","last_change":"2024-04-25T10:03:56.772146+0000","last_active":"2024-04-25T10:04:02.793245+0000","last_peered":"2024-04-25T10:04:02.793245+0000","last_clean":"2024-04-25T10:04:02.793245+0000","last_became_active":"2024-04-25T10:03:56.770243+0000","last_became_peered":"2024-04-25T10:03:56.770243+0000","last_unstale":"2024-04-25T10:04:02.793245+0000","last_undegraded":"2024-04-25T10:04:02.793245+0000","last_fullsized":"2024-04-25T10:04:02.793245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:14.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795467+0000","last_change":"2024-04-25T10:03:56.771691+0000","last_active":"2024-04-25T10:04:02.795467+0000","last_peered":"2024-04-25T10:04:02.795467+0000","last_clean":"2024-04-25T10:04:02.795467+0000","last_became_active":"2024-04-25T10:03:56.771315+0000","last_became_peered":"2024-04-25T10:03:56.771315+0000","last_unstale":"2024-04-25T10:04:02.795467+0000","last_undegraded":"2024-04-25T10:04:02.795467+0000","last_fullsized":"2024-04-25T10:04:02.795467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792766+0000","last_change":"2024-04-25T10:03:56.776434+0000","last_active":"2024-04-25T10:04:02.792766+0000","last_peered":"2024-04-25T10:04:02.792766+0000","last_clean":"2024-04-25T10:04:02.792766+0000","last_became_active":"2024-04-25T10:03:56.776138+0000","last_became_peered":"2024-04-25T10:03:56.776138+0000","last_unstale":"2024-04-25T10:04:02.792766+0000","last_undegraded":"2024-04-25T10:04:02.792766+0000","last_fullsized":"2024-04-25T10:04:02.792766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796045+0000","last_change":"2024-04-25T10:03:56.787227+0000","last_active":"2024-04-25T10:04:02.796045+0000","last_peered":"2024-04-25T10:04:02.796045+0000","last_clean":"2024-04-25T10:04:02.796045+0000","last_became_active":"2024-04-25T10:03:56.786628+0000","last_became_peered":"2024-04-25T10:03:56.786628+0000","last_unstale":"2024-04-25T10:04:02.796045+0000","last_undegraded":"2024-04-25T10:04:02.796045+0000","last_fullsized":"2024-04-25T10:04:02.796045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266770+0000","last_change":"2024-04-25T10:03:56.781525+0000","last_active":"2024-04-25T10:04:03.266770+0000","last_peered":"2024-04-25T10:04:03.266770+0000","last_clean":"2024-04-25T10:04:03.266770+0000","last_became_active":"2024-04-25T10:03:56.781186+0000","last_became_peered":"2024-04-25T10:03:56.781186+0000","last_unstale":"2024-04-25T10:04:03.266770+0000","last_undegraded":"2024-04-25T10:04:03.266770+0000","last_fullsized":"2024-04-25T10:04:03.266770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796586+0000","last_change":"2024-04-25T10:03:56.772909+0000","last_active":"2024-04-25T10:04:02.796586+0000","last_peered":"2024-04-25T10:04:02.796586+0000","last_clean":"2024-04-25T10:04:02.796586+0000","last_became_active":"2024-04-25T10:03:56.772651+0000","last_became_peered":"2024-04-25T10:03:56.772651+0000","last_unstale":"2024-04-25T10:04:02.796586+0000","last_undegraded":"2024-04-25T10:04:02.796586+0000","last_fullsized":"2024-04-25T10:04:02.796586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277718+0000","last_change":"2024-04-25T10:03:56.786914+0000","last_active":"2024-04-25T10:04:03.277718+0000","last_peered":"2024-04-25T10:04:03.277718+0000","last_clean":"2024-04-25T10:04:03.277718+0000","last_became_active":"2024-04-25T10:03:56.786624+0000","last_became_peered":"2024-04-25T10:03:56.786624+0000","last_unstale":"2024-04-25T10:04:03.277718+0000","last_undegraded":"2024-04-25T10:04:03.277718+0000","last_fullsized":"2024-04-25T10:04:03.277718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230883+0000","last_change":"2024-04-25T10:03:56.756870+0000","last_active":"2024-04-25T10:04:03.230883+0000","last_peered":"2024-04-25T10:04:03.230883+0000","last_clean":"2024-04-25T10:04:03.230883+0000","last_became_active":"2024-04-25T10:03:56.756588+0000","last_became_peered":"2024-04-25T10:03:56.756588+0000","last_unstale":"2024-04-25T10:04:03.230883+0000","last_undegraded":"2024-04-25T10:04:03.230883+0000","last_fullsized":"2024-04-25T10:04:03.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797271+0000","last_change":"2024-04-25T10:03:56.787720+0000","last_active":"2024-04-25T10:04:02.797271+0000","last_peered":"2024-04-25T10:04:02.797271+0000","last_clean":"2024-04-25T10:04:02.797271+0000","last_became_active":"2024-04-25T10:03:56.786712+0000","last_became_peered":"2024-04-25T10:03:56.786712+0000","last_unstale":"2024-04-25T10:04:02.797271+0000","last_undegraded":"2024-04-25T10:04:02.797271+0000","last_fullsized":"2024-04-25T10:04:02.797271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795363+0000","last_change":"2024-04-25T10:03:56.772050+0000","last_active":"2024-04-25T10:04:02.795363+0000","last_peered":"2024-04-25T10:04:02.795363+0000","last_clean":"2024-04-25T10:04:02.795363+0000","last_became_active":"2024-04-25T10:03:56.771788+0000","last_became_peered":"2024-04-25T10:03:56.771788+0000","last_unstale":"2024-04-25T10:04:02.795363+0000","last_undegraded":"2024-04-25T10:04:02.795363+0000","last_fullsized":"2024-04-25T10:04:02.795363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274557+0000","last_change":"2024-04-25T10:03:56.776805+0000","last_active":"2024-04-25T10:04:03.274557+0000","last_peered":"2024-04-25T10:04:03.274557+0000","last_clean":"2024-04-25T10:04:03.274557+0000","last_became_active":"2024-04-25T10:03:56.776521+0000","last_became_peered":"2024-04-25T10:03:56.776521+0000","last_unstale":"2024-04-25T10:04:03.274557+0000","last_undegraded":"2024-04-25T10:04:03.274557+0000","last_fullsized":"2024-04-25T10:04:03.274557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266435+0000","last_change":"2024-04-25T10:03:56.756971+0000","last_active":"2024-04-25T10:04:03.266435+0000","last_peered":"2024-04-25T10:04:03.266435+0000","last_clean":"2024-04-25T10:04:03.266435+0000","last_became_active":"2024-04-25T10:03:56.756615+0000","last_became_peered":"2024-04-25T10:03:56.756615+0000","last_unstale":"2024-04-25T10:04:03.266435+0000","last_undegraded":"2024-04-25T10:04:03.266435+0000","last_fullsized":"2024-04-25T10:04:03.266435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:37.191982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792947+0000","last_change":"2024-04-25T10:03:56.764011+0000","last_active":"2024-04-25T10:04:02.792947+0000","last_peered":"2024-04-25T10:04:02.792947+0000","last_clean":"2024-04-25T10:04:02.792947+0000","last_became_active":"2024-04-25T10:03:56.759567+0000","last_became_peered":"2024-04-25T10:03:56.759567+0000","last_unstale":"2024-04-25T10:04:02.792947+0000","last_undegraded":"2024-04-25T10:04:02.792947+0000","last_fullsized":"2024-04-25T10:04:02.792947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:44.595374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277339+0000","last_change":"2024-04-25T10:03:56.770314+0000","last_active":"2024-04-25T10:04:03.277339+0000","last_peered":"2024-04-25T10:04:03.277339+0000","last_clean":"2024-04-25T10:04:03.277339+0000","last_became_active":"2024-04-25T10:03:56.769983+0000","last_became_peered":"2024-04-25T10:03:56.769983+0000","last_unstale":"2024-04-25T10:04:03.277339+0000","last_undegraded":"2024-04-25T10:04:03.277339+0000","last_fullsized":"2024-04-25T10:04:03.277339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797467+0000","last_change":"2024-04-25T10:03:56.776383+0000","last_active":"2024-04-25T10:04:02.797467+0000","last_peered":"2024-04-25T10:04:02.797467+0000","last_clean":"2024-04-25T10:04:02.797467+0000","last_became_active":"2024-04-25T10:03:56.775871+0000","last_became_peered":"2024-04-25T10:03:56.775871+0000","last_unstale":"2024-04-25T10:04:02.797467+0000","last_undegraded":"2024-04-25T10:04:02.797467+0000","last_fullsized":"2024-04-25T10:04:02.797467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797420+0000","last_change":"2024-04-25T10:03:56.767888+0000","last_active":"2024-04-25T10:04:02.797420+0000","last_peered":"2024-04-25T10:04:02.797420+0000","last_clean":"2024-04-25T10:04:02.797420+0000","last_became_active":"2024-04-25T10:03:56.767620+0000","last_became_peered":"2024-04-25T10:03:56.767620+0000","last_unstale":"2024-04-25T10:04:02.797420+0000","last_undegraded":"2024-04-25T10:04:02.797420+0000","last_fullsized":"2024-04-25T10:04:02.797420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277564+0000","last_change":"2024-04-25T10:03:56.796106+0000","last_active":"2024-04-25T10:04:03.277564+0000","last_peered":"2024-04-25T10:04:03.277564+0000","last_clean":"2024-04-25T10:04:03.277564+0000","last_became_active":"2024-04-25T10:03:56.795843+0000","last_became_peered":"2024-04-25T10:03:56.795843+0000","last_unstale":"2024-04-25T10:04:03.277564+0000","last_undegraded":"2024-04-25T10:04:03.277564+0000","last_fullsized":"2024-04-25T10:04:03.277564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792478+0000","last_change":"2024-04-25T10:03:56.766481+0000","last_active":"2024-04-25T10:04:02.792478+0000","last_peered":"2024-04-25T10:04:02.792478+0000","last_clean":"2024-04-25T10:04:02.792478+0000","last_became_active":"2024-04-25T10:03:56.766169+0000","last_became_peered":"2024-04-25T10:03:56.766169+0000","last_unstale":"2024-04-25T10:04:02.792478+0000","last_undegraded":"2024-04-25T10:04:02.792478+0000","last_fullsized":"2024-04-25T10:04:02.792478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:58.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277557+0000","last_change":"2024-04-25T10:03:56.778866+0000","last_active":"2024-04-25T10:04:03.277557+0000","last_peered":"2024-04-25T10:04:03.277557+0000","last_clean":"2024-04-25T10:04:03.277557+0000","last_became_active":"2024-04-25T10:03:56.778491+0000","last_became_peered":"2024-04-25T10:03:56.778491+0000","last_unstale":"2024-04-25T10:04:03.277557+0000","last_undegraded":"2024-04-25T10:04:03.277557+0000","last_fullsized":"2024-04-25T10:04:03.277557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795905+0000","last_change":"2024-04-25T10:03:56.793303+0000","last_active":"2024-04-25T10:04:02.795905+0000","last_peered":"2024-04-25T10:04:02.795905+0000","last_clean":"2024-04-25T10:04:02.795905+0000","last_became_active":"2024-04-25T10:03:56.792743+0000","last_became_peered":"2024-04-25T10:03:56.792743+0000","last_unstale":"2024-04-25T10:04:02.795905+0000","last_undegraded":"2024-04-25T10:04:02.795905+0000","last_fullsized":"2024-04-25T10:04:02.795905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277067+0000","last_change":"2024-04-25T10:03:56.787411+0000","last_active":"2024-04-25T10:04:03.277067+0000","last_peered":"2024-04-25T10:04:03.277067+0000","last_clean":"2024-04-25T10:04:03.277067+0000","last_became_active":"2024-04-25T10:03:56.786639+0000","last_became_peered":"2024-04-25T10:03:56.786639+0000","last_unstale":"2024-04-25T10:04:03.277067+0000","last_undegraded":"2024-04-25T10:04:03.277067+0000","last_fullsized":"2024-04-25T10:04:03.277067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796676+0000","last_change":"2024-04-25T10:03:56.768181+0000","last_active":"2024-04-25T10:04:02.796676+0000","last_peered":"2024-04-25T10:04:02.796676+0000","last_clean":"2024-04-25T10:04:02.796676+0000","last_became_active":"2024-04-25T10:03:56.767723+0000","last_became_peered":"2024-04-25T10:03:56.767723+0000","last_unstale":"2024-04-25T10:04:02.796676+0000","last_undegraded":"2024-04-25T10:04:02.796676+0000","last_fullsized":"2024-04-25T10:04:02.796676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266736+0000","last_change":"2024-04-25T10:03:56.761621+0000","last_active":"2024-04-25T10:04:03.266736+0000","last_peered":"2024-04-25T10:04:03.266736+0000","last_clean":"2024-04-25T10:04:03.266736+0000","last_became_active":"2024-04-25T10:03:56.761220+0000","last_became_peered":"2024-04-25T10:03:56.761220+0000","last_unstale":"2024-04-25T10:04:03.266736+0000","last_undegraded":"2024-04-25T10:04:03.266736+0000","last_fullsized":"2024-04-25T10:04:03.266736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:35.367003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275178+0000","last_change":"2024-04-25T10:03:56.753004+0000","last_active":"2024-04-25T10:04:03.275178+0000","last_peered":"2024-04-25T10:04:03.275178+0000","last_clean":"2024-04-25T10:04:03.275178+0000","last_became_active":"2024-04-25T10:03:56.752524+0000","last_became_peered":"2024-04-25T10:03:56.752524+0000","last_unstale":"2024-04-25T10:04:03.275178+0000","last_undegraded":"2024-04-25T10:04:03.275178+0000","last_fullsized":"2024-04-25T10:04:03.275178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277772+0000","last_change":"2024-04-25T10:03:56.788107+0000","last_active":"2024-04-25T10:04:03.277772+0000","last_peered":"2024-04-25T10:04:03.277772+0000","last_clean":"2024-04-25T10:04:03.277772+0000","last_became_active":"2024-04-25T10:03:56.787837+0000","last_became_peered":"2024-04-25T10:03:56.787837+0000","last_unstale":"2024-04-25T10:04:03.277772+0000","last_undegraded":"2024-04-25T10:04:03.277772+0000","last_fullsized":"2024-04-25T10:04:03.277772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":114337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":114247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":888832,"data_stored":705253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:20.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:04:20.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.857+0000 7ff4c3600640 1 Processor -- start 2024-04-25T10:04:20.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.857+0000 7ff4c3600640 1 -- start start 2024-04-25T10:04:20.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c3600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc15f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c3600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff4bc15f990 0x7ff4bc0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c3600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc0cd4c0 con 0x7ff4bc145100 2024-04-25T10:04:20.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c3600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc15c2f0 con 0x7ff4bc15f990 2024-04-25T10:04:20.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c3600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0cd7a0 con 0x7ff4bc15be90 2024-04-25T10:04:20.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c0c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff4bc145100 0x7ff4bc070570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59196/0 (socket says 172.21.15.18:59196) 2024-04-25T10:04:20.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c0c00640 1 -- 172.21.15.18:0/3749465178 learned_addr learned my addr 172.21.15.18:0/3749465178 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:20.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c1600640 1 --2- 172.21.15.18:0/3749465178 >> v2:172.21.15.167:3300/0 conn(0x7ff4bc15f990 0x7ff4bc0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4043970540 0 0) 0x7ff4bc0cd4c0 con 0x7ff4bc145100 2024-04-25T10:04:20.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a4003530 con 0x7ff4bc145100 2024-04-25T10:04:20.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108547509 0 0) 0x7ff4a4003530 con 0x7ff4bc145100 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 msgr2=0x7ff4bc15f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc15f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 >> v2:172.21.15.167:3300/0 conn(0x7ff4bc15f990 msgr2=0x7ff4bc0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 --2- 172.21.15.18:0/3749465178 >> v2:172.21.15.167:3300/0 conn(0x7ff4bc15f990 0x7ff4bc0ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc0cda80 con 0x7ff4bc145100 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff4b0001680 con 0x7ff4bc145100 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 >> v1:172.21.15.18:6789/0 conn(0x7ff4bc145100 legacy=0x7ff4bc070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a40039c0 0x7ff4a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a4004d50 0x7ff4a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc15c2f0 con 0x7ff4a40039c0 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0cd7a0 con 0x7ff4a4004d50 2024-04-25T10:04:20.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a400b9d0 con 0x7ff4bc15be90 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c0c00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a40039c0 0x7ff4a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c1600640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a4004d50 0x7ff4a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 -- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a4004d50 msgr2=0x7ff4a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4a4004d50 0x7ff4a40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 -- 172.21.15.18:0/3749465178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a40039c0 msgr2=0x7ff4a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a40039c0 0x7ff4a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4bbe00640 1 -- 172.21.15.18:0/3749465178 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4003530 con 0x7ff4bc15be90 2024-04-25T10:04:20.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.861+0000 7ff4c0c00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4a40039c0 0x7ff4a4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:20.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4a4004810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ae0 tx=0x7ff4a801cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74be06c37c65bf01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80096b0 con 0x7ff4bc15be90 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80a6490 con 0x7ff4bc15be90 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4bb400640 1 -- 172.21.15.18:0/3749465178 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80a6880 con 0x7ff4bc15be90 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 -- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 msgr2=0x7ff4a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 --2- 172.21.15.18:0/3749465178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4a4004810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ae0 tx=0x7ff4a801cab0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c1600640 1 -- 172.21.15.18:0/3749465178 reap_dead start 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 -- 172.21.15.18:0/3749465178 shutdown_connections 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 -- 172.21.15.18:0/3749465178 >> 172.21.15.18:0/3749465178 conn(0x7ff4bc0b2400 msgr2=0x7ff4bc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 -- 172.21.15.18:0/3749465178 shutdown_connections 2024-04-25T10:04:20.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.865+0000 7ff4c3600640 1 -- 172.21.15.18:0/3749465178 wait complete. 2024-04-25T10:04:20.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 Processor -- start 2024-04-25T10:04:20.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- start start 2024-04-25T10:04:20.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc14e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc143c90 0x7ff4bc150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc1454e0 con 0x7ff4bc1fa650 2024-04-25T10:04:20.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0cd0e0 con 0x7ff4bc143c90 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc14e7e0 con 0x7ff4bc15be90 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41392/0 (socket says 172.21.15.18:41392) 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 -- 172.21.15.18:0/1224256949 learned_addr learned my addr 172.21.15.18:0/1224256949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 -- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 msgr2=0x7ff4bc14e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc14e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 -- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc143c90 msgr2=0x7ff4bc150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc143c90 0x7ff4bc150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 -- 172.21.15.18:0/1224256949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc1fabf0 con 0x7ff4bc1fa650 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4bbe00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff4a801cf90 tx=0x7ff4a4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a800f000 con 0x7ff4bc1fa650 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80a6b20 con 0x7ff4bc1fa650 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc1faed0 con 0x7ff4bc1fa650 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a80a7470 con 0x7ff4bc1fa650 2024-04-25T10:04:20.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.869+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc1fb490 con 0x7ff4bc1fa650 2024-04-25T10:04:20.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc1440b0 con 0x7ff4bc1fa650 2024-04-25T10:04:20.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff4a80a7610 con 0x7ff4bc1fa650 2024-04-25T10:04:20.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4b8c00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 0x7ff49c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:20.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff4a811f5b0 con 0x7ff4bc1fa650 2024-04-25T10:04:20.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4c0c00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 0x7ff49c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:20.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.873+0000 7ff4c0c00640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 0x7ff49c069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0001bc0 tx=0x7ff4b0001b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:20.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:20.877+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4a80ac020 con 0x7ff4bc1fa650 2024-04-25T10:04:21.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.037+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4bc0745d0 con 0x7ff49c066f60 2024-04-25T10:04:21.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.045+0000 7ff4b8c00640 1 -- 172.21.15.18:0/1224256949 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332538 (secure 0 0 0) 0x7ff4bc0745d0 con 0x7ff49c066f60 2024-04-25T10:04:21.060 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:21.062 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:04:21.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.049+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 msgr2=0x7ff49c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.049+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 0x7ff49c069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0001bc0 tx=0x7ff4b0001b50 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.049+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 msgr2=0x7ff4bc143750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.049+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff4a801cf90 tx=0x7ff4a4005840 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 shutdown_connections 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4bc143c90 0x7ff4bc150d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4bc1fa650 0x7ff4bc143750 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff49c066f60 0x7ff49c069420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 --2- 172.21.15.18:0/1224256949 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4bc15be90 0x7ff4bc14e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 >> 172.21.15.18:0/1224256949 conn(0x7ff4bc0b2400 msgr2=0x7ff4bc140880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 shutdown_connections 2024-04-25T10:04:21.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.053+0000 7ff4c3600640 1 -- 172.21.15.18:0/1224256949 wait complete. 2024-04-25T10:04:21.080 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T10:04:19.399826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227920,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754746800,"statfs":{"total":773094113280,"available":772860723200,"internally_reserved":0,"allocated":3514368,"data_stored":2103992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003274"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.267071+0000","last_change":"2024-04-25T10:03:55.768315+0000","last_active":"2024-04-25T10:04:03.267071+0000","last_peered":"2024-04-25T10:04:03.267071+0000","last_clean":"2024-04-25T10:04:03.267071+0000","last_became_active":"2024-04-25T10:03:55.768048+0000","last_became_peered":"2024-04-25T10:03:55.768048+0000","last_unstale":"2024-04-25T10:04:03.267071+0000","last_undegraded":"2024-04-25T10:04:03.267071+0000","last_fullsized":"2024-04-25T10:04:03.267071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:28.383096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793497+0000","last_change":"2024-04-25T10:03:56.758112+0000","last_active":"2024-04-25T10:04:02.793497+0000","last_peered":"2024-04-25T10:04:02.793497+0000","last_clean":"2024-04-25T10:04:02.793497+0000","last_became_active":"2024-04-25T10:03:56.757744+0000","last_became_peered":"2024-04-25T10:03:56.757744+0000","last_unstale":"2024-04-25T10:04:02.793497+0000","last_undegraded":"2024-04-25T10:04:02.793497+0000","last_fullsized":"2024-04-25T10:04:02.793497+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:36.379846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792515+0000","last_change":"2024-04-25T10:04:01.286170+0000","last_active":"2024-04-25T10:04:02.792515+0000","last_peered":"2024-04-25T10:04:02.792515+0000","last_clean":"2024-04-25T10:04:02.792515+0000","last_became_active":"2024-04-25T10:04:01.285749+0000","last_became_peered":"2024-04-25T10:04:01.285749+0000","last_unstale":"2024-04-25T10:04:02.792515+0000","last_undegraded":"2024-04-25T10:04:02.792515+0000","last_fullsized":"2024-04-25T10:04:02.792515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:24.050198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793621+0000","last_change":"2024-04-25T10:03:55.757705+0000","last_active":"2024-04-25T10:04:02.793621+0000","last_peered":"2024-04-25T10:04:02.793621+0000","last_clean":"2024-04-25T10:04:02.793621+0000","last_became_active":"2024-04-25T10:03:55.757106+0000","last_became_peered":"2024-04-25T10:03:55.757106+0000","last_unstale":"2024-04-25T10:04:02.793621+0000","last_undegraded":"2024-04-25T10:04:02.793621+0000","last_fullsized":"2024-04-25T10:04:02.793621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:28.451018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266707+0000","last_change":"2024-04-25T10:03:56.772870+0000","last_active":"2024-04-25T10:04:03.266707+0000","last_peered":"2024-04-25T10:04:03.266707+0000","last_clean":"2024-04-25T10:04:03.266707+0000","last_became_active":"2024-04-25T10:03:56.771205+0000","last_became_peered":"2024-04-25T10:03:56.771205+0000","last_unstale":"2024-04-25T10:04:03.266707+0000","last_undegraded":"2024-04-25T10:04:03.266707+0000","last_fullsized":"2024-04-25T10:04:03.266707+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:44.754772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276672+0000","last_change":"2024-04-25T10:04:00.804531+0000","last_active":"2024-04-25T10:04:03.276672+0000","last_peered":"2024-04-25T10:04:03.276672+0000","last_clean":"2024-04-25T10:04:03.276672+0000","last_became_active":"2024-04-25T10:04:00.804099+0000","last_became_peered":"2024-04-25T10:04:00.804099+0000","last_unstale":"2024-04-25T10:04:03.276672+0000","last_undegraded":"2024-04-25T10:04:03.276672+0000","last_fullsized":"2024-04-25T10:04:03.276672+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277581+0000","last_change":"2024-04-25T10:03:55.774735+0000","last_active":"2024-04-25T10:04:03.277581+0000","last_peered":"2024-04-25T10:04:03.277581+0000","last_clean":"2024-04-25T10:04:03.277581+0000","last_became_active":"2024-04-25T10:03:55.774388+0000","last_became_peered":"2024-04-25T10:03:55.774388+0000","last_unstale":"2024-04-25T10:04:03.277581+0000","last_undegraded":"2024-04-25T10:04:03.277581+0000","last_fullsized":"2024-04-25T10:04:03.277581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796791+0000","last_change":"2024-04-25T10:03:56.773291+0000","last_active":"2024-04-25T10:04:02.796791+0000","last_peered":"2024-04-25T10:04:02.796791+0000","last_clean":"2024-04-25T10:04:02.796791+0000","last_became_active":"2024-04-25T10:03:56.772811+0000","last_became_peered":"2024-04-25T10:03:56.772811+0000","last_unstale":"2024-04-25T10:04:02.796791+0000","last_undegraded":"2024-04-25T10:04:02.796791+0000","last_fullsized":"2024-04-25T10:04:02.796791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278159+0000","last_change":"2024-04-25T10:04:00.809365+0000","last_active":"2024-04-25T10:04:03.278159+0000","last_peered":"2024-04-25T10:04:03.278159+0000","last_clean":"2024-04-25T10:04:03.278159+0000","last_became_active":"2024-04-25T10:04:00.808889+0000","last_became_peered":"2024-04-25T10:04:00.808889+0000","last_unstale":"2024-04-25T10:04:03.278159+0000","last_undegraded":"2024-04-25T10:04:03.278159+0000","last_fullsized":"2024-04-25T10:04:03.278159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277444+0000","last_change":"2024-04-25T10:03:55.773956+0000","last_active":"2024-04-25T10:04:03.277444+0000","last_peered":"2024-04-25T10:04:03.277444+0000","last_clean":"2024-04-25T10:04:03.277444+0000","last_became_active":"2024-04-25T10:03:55.770709+0000","last_became_peered":"2024-04-25T10:03:55.770709+0000","last_unstale":"2024-04-25T10:04:03.277444+0000","last_undegraded":"2024-04-25T10:04:03.277444+0000","last_fullsized":"2024-04-25T10:04:03.277444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796965+0000","last_change":"2024-04-25T10:03:56.773544+0000","last_active":"2024-04-25T10:04:02.796965+0000","last_peered":"2024-04-25T10:04:02.796965+0000","last_clean":"2024-04-25T10:04:02.796965+0000","last_became_active":"2024-04-25T10:03:56.773246+0000","last_became_peered":"2024-04-25T10:03:56.773246+0000","last_unstale":"2024-04-25T10:04:02.796965+0000","last_undegraded":"2024-04-25T10:04:02.796965+0000","last_fullsized":"2024-04-25T10:04:02.796965+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277083+0000","last_change":"2024-04-25T10:04:00.809357+0000","last_active":"2024-04-25T10:04:03.277083+0000","last_peered":"2024-04-25T10:04:03.277083+0000","last_clean":"2024-04-25T10:04:03.277083+0000","last_became_active":"2024-04-25T10:04:00.808905+0000","last_became_peered":"2024-04-25T10:04:00.808905+0000","last_unstale":"2024-04-25T10:04:03.277083+0000","last_undegraded":"2024-04-25T10:04:03.277083+0000","last_fullsized":"2024-04-25T10:04:03.277083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796173+0000","last_change":"2024-04-25T10:03:56.774064+0000","last_active":"2024-04-25T10:04:02.796173+0000","last_peered":"2024-04-25T10:04:02.796173+0000","last_clean":"2024-04-25T10:04:02.796173+0000","last_became_active":"2024-04-25T10:03:56.773617+0000","last_became_peered":"2024-04-25T10:03:56.773617+0000","last_unstale":"2024-04-25T10:04:02.796173+0000","last_undegraded":"2024-04-25T10:04:02.796173+0000","last_fullsized":"2024-04-25T10:04:02.796173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277648+0000","last_change":"2024-04-25T10:03:55.771542+0000","last_active":"2024-04-25T10:04:03.277648+0000","last_peered":"2024-04-25T10:04:03.277648+0000","last_clean":"2024-04-25T10:04:03.277648+0000","last_became_active":"2024-04-25T10:03:55.771100+0000","last_became_peered":"2024-04-25T10:03:55.771100+0000","last_unstale":"2024-04-25T10:04:03.277648+0000","last_undegraded":"2024-04-25T10:04:03.277648+0000","last_fullsized":"2024-04-25T10:04:03.277648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278167+0000","last_change":"2024-04-25T10:04:00.797932+0000","last_active":"2024-04-25T10:04:03.278167+0000","last_peered":"2024-04-25T10:04:03.278167+0000","last_clean":"2024-04-25T10:04:03.278167+0000","last_became_active":"2024-04-25T10:04:00.797547+0000","last_became_peered":"2024-04-25T10:04:00.797547+0000","last_unstale":"2024-04-25T10:04:03.278167+0000","last_undegraded":"2024-04-25T10:04:03.278167+0000","last_fullsized":"2024-04-25T10:04:03.278167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793017+0000","last_change":"2024-04-25T10:03:56.763110+0000","last_active":"2024-04-25T10:04:02.793017+0000","last_peered":"2024-04-25T10:04:02.793017+0000","last_clean":"2024-04-25T10:04:02.793017+0000","last_became_active":"2024-04-25T10:03:56.759036+0000","last_became_peered":"2024-04-25T10:03:56.759036+0000","last_unstale":"2024-04-25T10:04:02.793017+0000","last_undegraded":"2024-04-25T10:04:02.793017+0000","last_fullsized":"2024-04-25T10:04:02.793017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:47:09.264916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275006+0000","last_change":"2024-04-25T10:03:55.760284+0000","last_active":"2024-04-25T10:04:03.275006+0000","last_peered":"2024-04-25T10:04:03.275006+0000","last_clean":"2024-04-25T10:04:03.275006+0000","last_became_active":"2024-04-25T10:03:55.757931+0000","last_became_peered":"2024-04-25T10:03:55.757931+0000","last_unstale":"2024-04-25T10:04:03.275006+0000","last_undegraded":"2024-04-25T10:04:03.275006+0000","last_fullsized":"2024-04-25T10:04:03.275006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277167+0000","last_change":"2024-04-25T10:04:00.805760+0000","last_active":"2024-04-25T10:04:03.277167+0000","last_peered":"2024-04-25T10:04:03.277167+0000","last_clean":"2024-04-25T10:04:03.277167+0000","last_became_active":"2024-04-25T10:04:00.805409+0000","last_became_peered":"2024-04-25T10:04:00.805409+0000","last_unstale":"2024-04-25T10:04:03.277167+0000","last_undegraded":"2024-04-25T10:04:03.277167+0000","last_fullsized":"2024-04-25T10:04:03.277167+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792681+0000","last_change":"2024-04-25T10:03:56.755762+0000","last_active":"2024-04-25T10:04:02.792681+0000","last_peered":"2024-04-25T10:04:02.792681+0000","last_clean":"2024-04-25T10:04:02.792681+0000","last_became_active":"2024-04-25T10:03:56.755497+0000","last_became_peered":"2024-04-25T10:03:56.755497+0000","last_unstale":"2024-04-25T10:04:02.792681+0000","last_undegraded":"2024-04-25T10:04:02.792681+0000","last_fullsized":"2024-04-25T10:04:02.792681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:39.903548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274613+0000","last_change":"2024-04-25T10:03:55.768303+0000","last_active":"2024-04-25T10:04:03.274613+0000","last_peered":"2024-04-25T10:04:03.274613+0000","last_clean":"2024-04-25T10:04:03.274613+0000","last_became_active":"2024-04-25T10:03:55.767994+0000","last_became_peered":"2024-04-25T10:03:55.767994+0000","last_unstale":"2024-04-25T10:04:03.274613+0000","last_undegraded":"2024-04-25T10:04:03.274613+0000","last_fullsized":"2024-04-25T10:04:03.274613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275339+0000","last_change":"2024-04-25T10:04:01.284089+0000","last_active":"2024-04-25T10:04:03.275339+0000","last_peered":"2024-04-25T10:04:03.275339+0000","last_clean":"2024-04-25T10:04:03.275339+0000","last_became_active":"2024-04-25T10:04:01.283683+0000","last_became_peered":"2024-04-25T10:04:01.283683+0000","last_unstale":"2024-04-25T10:04:03.275339+0000","last_undegraded":"2024-04-25T10:04:03.275339+0000","last_fullsized":"2024-04-25T10:04:03.275339+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278023+0000","last_change":"2024-04-25T10:03:56.763149+0000","last_active":"2024-04-25T10:04:03.278023+0000","last_peered":"2024-04-25T10:04:03.278023+0000","last_clean":"2024-04-25T10:04:03.278023+0000","last_became_active":"2024-04-25T10:03:56.762775+0000","last_became_peered":"2024-04-25T10:03:56.762775+0000","last_unstale":"2024-04-25T10:04:03.278023+0000","last_undegraded":"2024-04-25T10:04:03.278023+0000","last_fullsized":"2024-04-25T10:04:03.278023+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:40.560200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276548+0000","last_change":"2024-04-25T10:03:55.769495+0000","last_active":"2024-04-25T10:04:03.276548+0000","last_peered":"2024-04-25T10:04:03.276548+0000","last_clean":"2024-04-25T10:04:03.276548+0000","last_became_active":"2024-04-25T10:03:55.769215+0000","last_became_peered":"2024-04-25T10:03:55.769215+0000","last_unstale":"2024-04-25T10:04:03.276548+0000","last_undegraded":"2024-04-25T10:04:03.276548+0000","last_fullsized":"2024-04-25T10:04:03.276548+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278249+0000","last_change":"2024-04-25T10:04:00.809196+0000","last_active":"2024-04-25T10:04:03.278249+0000","last_peered":"2024-04-25T10:04:03.278249+0000","last_clean":"2024-04-25T10:04:03.278249+0000","last_became_active":"2024-04-25T10:04:00.808831+0000","last_became_peered":"2024-04-25T10:04:00.808831+0000","last_unstale":"2024-04-25T10:04:03.278249+0000","last_undegraded":"2024-04-25T10:04:03.278249+0000","last_fullsized":"2024-04-25T10:04:03.278249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266867+0000","last_change":"2024-04-25T10:03:56.758244+0000","last_active":"2024-04-25T10:04:03.266867+0000","last_peered":"2024-04-25T10:04:03.266867+0000","last_clean":"2024-04-25T10:04:03.266867+0000","last_became_active":"2024-04-25T10:03:56.757968+0000","last_became_peered":"2024-04-25T10:03:56.757968+0000","last_unstale":"2024-04-25T10:04:03.266867+0000","last_undegraded":"2024-04-25T10:04:03.266867+0000","last_fullsized":"2024-04-25T10:04:03.266867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:01.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797119+0000","last_change":"2024-04-25T10:03:55.771510+0000","last_active":"2024-04-25T10:04:02.797119+0000","last_peered":"2024-04-25T10:04:02.797119+0000","last_clean":"2024-04-25T10:04:02.797119+0000","last_became_active":"2024-04-25T10:03:55.771339+0000","last_became_peered":"2024-04-25T10:03:55.771339+0000","last_unstale":"2024-04-25T10:04:02.797119+0000","last_undegraded":"2024-04-25T10:04:02.797119+0000","last_fullsized":"2024-04-25T10:04:02.797119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277693+0000","last_change":"2024-04-25T10:04:01.287169+0000","last_active":"2024-04-25T10:04:03.277693+0000","last_peered":"2024-04-25T10:04:03.277693+0000","last_clean":"2024-04-25T10:04:03.277693+0000","last_became_active":"2024-04-25T10:04:01.286796+0000","last_became_peered":"2024-04-25T10:04:01.286796+0000","last_unstale":"2024-04-25T10:04:03.277693+0000","last_undegraded":"2024-04-25T10:04:03.277693+0000","last_fullsized":"2024-04-25T10:04:03.277693+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:30.474221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793347+0000","last_change":"2024-04-25T10:03:56.780820+0000","last_active":"2024-04-25T10:04:02.793347+0000","last_peered":"2024-04-25T10:04:02.793347+0000","last_clean":"2024-04-25T10:04:02.793347+0000","last_became_active":"2024-04-25T10:03:56.780475+0000","last_became_peered":"2024-04-25T10:03:56.780475+0000","last_unstale":"2024-04-25T10:04:02.793347+0000","last_undegraded":"2024-04-25T10:04:02.793347+0000","last_fullsized":"2024-04-25T10:04:02.793347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:31.014597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275213+0000","last_change":"2024-04-25T10:03:55.767628+0000","last_active":"2024-04-25T10:04:03.275213+0000","last_peered":"2024-04-25T10:04:03.275213+0000","last_clean":"2024-04-25T10:04:03.275213+0000","last_became_active":"2024-04-25T10:03:55.767120+0000","last_became_peered":"2024-04-25T10:03:55.767120+0000","last_unstale":"2024-04-25T10:04:03.275213+0000","last_undegraded":"2024-04-25T10:04:03.275213+0000","last_fullsized":"2024-04-25T10:04:03.275213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792464+0000","last_change":"2024-04-25T10:04:01.283339+0000","last_active":"2024-04-25T10:04:02.792464+0000","last_peered":"2024-04-25T10:04:02.792464+0000","last_clean":"2024-04-25T10:04:02.792464+0000","last_became_active":"2024-04-25T10:04:01.282887+0000","last_became_peered":"2024-04-25T10:04:01.282887+0000","last_unstale":"2024-04-25T10:04:02.792464+0000","last_undegraded":"2024-04-25T10:04:02.792464+0000","last_fullsized":"2024-04-25T10:04:02.792464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:12.942551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274964+0000","last_change":"2024-04-25T10:03:56.756195+0000","last_active":"2024-04-25T10:04:03.274964+0000","last_peered":"2024-04-25T10:04:03.274964+0000","last_clean":"2024-04-25T10:04:03.274964+0000","last_became_active":"2024-04-25T10:03:56.755888+0000","last_became_peered":"2024-04-25T10:03:56.755888+0000","last_unstale":"2024-04-25T10:04:03.274964+0000","last_undegraded":"2024-04-25T10:04:03.274964+0000","last_fullsized":"2024-04-25T10:04:03.274964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277826+0000","last_change":"2024-04-25T10:03:55.774206+0000","last_active":"2024-04-25T10:04:03.277826+0000","last_peered":"2024-04-25T10:04:03.277826+0000","last_clean":"2024-04-25T10:04:03.277826+0000","last_became_active":"2024-04-25T10:03:55.773820+0000","last_became_peered":"2024-04-25T10:03:55.773820+0000","last_unstale":"2024-04-25T10:04:03.277826+0000","last_undegraded":"2024-04-25T10:04:03.277826+0000","last_fullsized":"2024-04-25T10:04:03.277826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:37.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266562+0000","last_change":"2024-04-25T10:04:01.284399+0000","last_active":"2024-04-25T10:04:03.266562+0000","last_peered":"2024-04-25T10:04:03.266562+0000","last_clean":"2024-04-25T10:04:03.266562+0000","last_became_active":"2024-04-25T10:04:01.283878+0000","last_became_peered":"2024-04-25T10:04:01.283878+0000","last_unstale":"2024-04-25T10:04:03.266562+0000","last_undegraded":"2024-04-25T10:04:03.266562+0000","last_fullsized":"2024-04-25T10:04:03.266562+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797072+0000","last_change":"2024-04-25T10:03:56.792726+0000","last_active":"2024-04-25T10:04:02.797072+0000","last_peered":"2024-04-25T10:04:02.797072+0000","last_clean":"2024-04-25T10:04:02.797072+0000","last_became_active":"2024-04-25T10:03:56.792471+0000","last_became_peered":"2024-04-25T10:03:56.792471+0000","last_unstale":"2024-04-25T10:04:02.797072+0000","last_undegraded":"2024-04-25T10:04:02.797072+0000","last_fullsized":"2024-04-25T10:04:02.797072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275057+0000","last_change":"2024-04-25T10:03:55.757369+0000","last_active":"2024-04-25T10:04:03.275057+0000","last_peered":"2024-04-25T10:04:03.275057+0000","last_clean":"2024-04-25T10:04:03.275057+0000","last_became_active":"2024-04-25T10:03:55.756884+0000","last_became_peered":"2024-04-25T10:03:55.756884+0000","last_unstale":"2024-04-25T10:04:03.275057+0000","last_undegraded":"2024-04-25T10:04:03.275057+0000","last_fullsized":"2024-04-25T10:04:03.275057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274691+0000","last_change":"2024-04-25T10:04:00.803156+0000","last_active":"2024-04-25T10:04:03.274691+0000","last_peered":"2024-04-25T10:04:03.274691+0000","last_clean":"2024-04-25T10:04:03.274691+0000","last_became_active":"2024-04-25T10:04:00.802652+0000","last_became_peered":"2024-04-25T10:04:00.802652+0000","last_unstale":"2024-04-25T10:04:03.274691+0000","last_undegraded":"2024-04-25T10:04:03.274691+0000","last_fullsized":"2024-04-25T10:04:03.274691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:36:42.928561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278393+0000","last_change":"2024-04-25T10:03:56.770389+0000","last_active":"2024-04-25T10:04:03.278393+0000","last_peered":"2024-04-25T10:04:03.278393+0000","last_clean":"2024-04-25T10:04:03.278393+0000","last_became_active":"2024-04-25T10:03:56.769936+0000","last_became_peered":"2024-04-25T10:03:56.769936+0000","last_unstale":"2024-04-25T10:04:03.278393+0000","last_undegraded":"2024-04-25T10:04:03.278393+0000","last_fullsized":"2024-04-25T10:04:03.278393+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:45.815606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796171+0000","last_change":"2024-04-25T10:03:55.761355+0000","last_active":"2024-04-25T10:04:02.796171+0000","last_peered":"2024-04-25T10:04:02.796171+0000","last_clean":"2024-04-25T10:04:02.796171+0000","last_became_active":"2024-04-25T10:03:55.759914+0000","last_became_peered":"2024-04-25T10:03:55.759914+0000","last_unstale":"2024-04-25T10:04:02.796171+0000","last_undegraded":"2024-04-25T10:04:02.796171+0000","last_fullsized":"2024-04-25T10:04:02.796171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274995+0000","last_change":"2024-04-25T10:04:00.806848+0000","last_active":"2024-04-25T10:04:03.274995+0000","last_peered":"2024-04-25T10:04:03.274995+0000","last_clean":"2024-04-25T10:04:03.274995+0000","last_became_active":"2024-04-25T10:04:00.805433+0000","last_became_peered":"2024-04-25T10:04:00.805433+0000","last_unstale":"2024-04-25T10:04:03.274995+0000","last_undegraded":"2024-04-25T10:04:03.274995+0000","last_fullsized":"2024-04-25T10:04:03.274995+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:41:14.603789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274628+0000","last_change":"2024-04-25T10:03:56.755931+0000","last_active":"2024-04-25T10:04:03.274628+0000","last_peered":"2024-04-25T10:04:03.274628+0000","last_clean":"2024-04-25T10:04:03.274628+0000","last_became_active":"2024-04-25T10:03:56.755452+0000","last_became_peered":"2024-04-25T10:03:56.755452+0000","last_unstale":"2024-04-25T10:04:03.274628+0000","last_undegraded":"2024-04-25T10:04:03.274628+0000","last_fullsized":"2024-04-25T10:04:03.274628+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230585+0000","last_change":"2024-04-25T10:03:55.762333+0000","last_active":"2024-04-25T10:04:03.230585+0000","last_peered":"2024-04-25T10:04:03.230585+0000","last_clean":"2024-04-25T10:04:03.230585+0000","last_became_active":"2024-04-25T10:03:55.758957+0000","last_became_peered":"2024-04-25T10:03:55.758957+0000","last_unstale":"2024-04-25T10:04:03.230585+0000","last_undegraded":"2024-04-25T10:04:03.230585+0000","last_fullsized":"2024-04-25T10:04:03.230585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275382+0000","last_change":"2024-04-25T10:04:00.805357+0000","last_active":"2024-04-25T10:04:03.275382+0000","last_peered":"2024-04-25T10:04:03.275382+0000","last_clean":"2024-04-25T10:04:03.275382+0000","last_became_active":"2024-04-25T10:04:00.804893+0000","last_became_peered":"2024-04-25T10:04:00.804893+0000","last_unstale":"2024-04-25T10:04:03.275382+0000","last_undegraded":"2024-04-25T10:04:03.275382+0000","last_fullsized":"2024-04-25T10:04:03.275382+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266268+0000","last_change":"2024-04-25T10:03:56.780512+0000","last_active":"2024-04-25T10:04:03.266268+0000","last_peered":"2024-04-25T10:04:03.266268+0000","last_clean":"2024-04-25T10:04:03.266268+0000","last_became_active":"2024-04-25T10:03:56.779316+0000","last_became_peered":"2024-04-25T10:03:56.779316+0000","last_unstale":"2024-04-25T10:04:03.266268+0000","last_undegraded":"2024-04-25T10:04:03.266268+0000","last_fullsized":"2024-04-25T10:04:03.266268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276680+0000","last_change":"2024-04-25T10:03:55.773928+0000","last_active":"2024-04-25T10:04:03.276680+0000","last_peered":"2024-04-25T10:04:03.276680+0000","last_clean":"2024-04-25T10:04:03.276680+0000","last_became_active":"2024-04-25T10:03:55.773501+0000","last_became_peered":"2024-04-25T10:03:55.773501+0000","last_unstale":"2024-04-25T10:04:03.276680+0000","last_undegraded":"2024-04-25T10:04:03.276680+0000","last_fullsized":"2024-04-25T10:04:03.276680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266794+0000","last_change":"2024-04-25T10:04:01.283753+0000","last_active":"2024-04-25T10:04:03.266794+0000","last_peered":"2024-04-25T10:04:03.266794+0000","last_clean":"2024-04-25T10:04:03.266794+0000","last_became_active":"2024-04-25T10:04:01.283221+0000","last_became_peered":"2024-04-25T10:04:01.283221+0000","last_unstale":"2024-04-25T10:04:03.266794+0000","last_undegraded":"2024-04-25T10:04:03.266794+0000","last_fullsized":"2024-04-25T10:04:03.266794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:18.295693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792932+0000","last_change":"2024-04-25T10:03:56.766943+0000","last_active":"2024-04-25T10:04:02.792932+0000","last_peered":"2024-04-25T10:04:02.792932+0000","last_clean":"2024-04-25T10:04:02.792932+0000","last_became_active":"2024-04-25T10:03:56.766550+0000","last_became_peered":"2024-04-25T10:03:56.766550+0000","last_unstale":"2024-04-25T10:04:02.792932+0000","last_undegraded":"2024-04-25T10:04:02.792932+0000","last_fullsized":"2024-04-25T10:04:02.792932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:05:05.977869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796601+0000","last_change":"2024-04-25T10:03:55.764614+0000","last_active":"2024-04-25T10:04:02.796601+0000","last_peered":"2024-04-25T10:04:02.796601+0000","last_clean":"2024-04-25T10:04:02.796601+0000","last_became_active":"2024-04-25T10:03:55.763995+0000","last_became_peered":"2024-04-25T10:03:55.763995+0000","last_unstale":"2024-04-25T10:04:02.796601+0000","last_undegraded":"2024-04-25T10:04:02.796601+0000","last_fullsized":"2024-04-25T10:04:02.796601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":179,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276800+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:04:03.276800+0000","last_peered":"2024-04-25T10:04:03.276800+0000","last_clean":"2024-04-25T10:04:03.276800+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:04:03.276800+0000","last_undegraded":"2024-04-25T10:04:03.276800+0000","last_fullsized":"2024-04-25T10:04:03.276800+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797001+0000","last_change":"2024-04-25T10:04:01.285814+0000","last_active":"2024-04-25T10:04:02.797001+0000","last_peered":"2024-04-25T10:04:02.797001+0000","last_clean":"2024-04-25T10:04:02.797001+0000","last_became_active":"2024-04-25T10:04:01.285361+0000","last_became_peered":"2024-04-25T10:04:01.285361+0000","last_unstale":"2024-04-25T10:04:02.797001+0000","last_undegraded":"2024-04-25T10:04:02.797001+0000","last_fullsized":"2024-04-25T10:04:02.797001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:04.695089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277347+0000","last_change":"2024-04-25T10:03:56.796054+0000","last_active":"2024-04-25T10:04:03.277347+0000","last_peered":"2024-04-25T10:04:03.277347+0000","last_clean":"2024-04-25T10:04:03.277347+0000","last_became_active":"2024-04-25T10:03:56.795756+0000","last_became_peered":"2024-04-25T10:03:56.795756+0000","last_unstale":"2024-04-25T10:04:03.277347+0000","last_undegraded":"2024-04-25T10:04:03.277347+0000","last_fullsized":"2024-04-25T10:04:03.277347+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230858+0000","last_change":"2024-04-25T10:03:55.760034+0000","last_active":"2024-04-25T10:04:03.230858+0000","last_peered":"2024-04-25T10:04:03.230858+0000","last_clean":"2024-04-25T10:04:03.230858+0000","last_became_active":"2024-04-25T10:03:55.757148+0000","last_became_peered":"2024-04-25T10:03:55.757148+0000","last_unstale":"2024-04-25T10:04:03.230858+0000","last_undegraded":"2024-04-25T10:04:03.230858+0000","last_fullsized":"2024-04-25T10:04:03.230858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796177+0000","last_change":"2024-04-25T10:04:01.285490+0000","last_active":"2024-04-25T10:04:02.796177+0000","last_peered":"2024-04-25T10:04:02.796177+0000","last_clean":"2024-04-25T10:04:02.796177+0000","last_became_active":"2024-04-25T10:04:01.285082+0000","last_became_peered":"2024-04-25T10:04:01.285082+0000","last_unstale":"2024-04-25T10:04:02.796177+0000","last_undegraded":"2024-04-25T10:04:02.796177+0000","last_fullsized":"2024-04-25T10:04:02.796177+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:30.354999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796963+0000","last_change":"2024-04-25T10:03:56.767947+0000","last_active":"2024-04-25T10:04:02.796963+0000","last_peered":"2024-04-25T10:04:02.796963+0000","last_clean":"2024-04-25T10:04:02.796963+0000","last_became_active":"2024-04-25T10:03:56.767392+0000","last_became_peered":"2024-04-25T10:03:56.767392+0000","last_unstale":"2024-04-25T10:04:02.796963+0000","last_undegraded":"2024-04-25T10:04:02.796963+0000","last_fullsized":"2024-04-25T10:04:02.796963+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274971+0000","last_change":"2024-04-25T10:03:55.756201+0000","last_active":"2024-04-25T10:04:03.274971+0000","last_peered":"2024-04-25T10:04:03.274971+0000","last_clean":"2024-04-25T10:04:03.274971+0000","last_became_active":"2024-04-25T10:03:55.755298+0000","last_became_peered":"2024-04-25T10:03:55.755298+0000","last_unstale":"2024-04-25T10:04:03.274971+0000","last_undegraded":"2024-04-25T10:04:03.274971+0000","last_fullsized":"2024-04-25T10:04:03.274971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:57.713888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266768+0000","last_change":"2024-04-25T10:04:00.799071+0000","last_active":"2024-04-25T10:04:03.266768+0000","last_peered":"2024-04-25T10:04:03.266768+0000","last_clean":"2024-04-25T10:04:03.266768+0000","last_became_active":"2024-04-25T10:04:00.798641+0000","last_became_peered":"2024-04-25T10:04:00.798641+0000","last_unstale":"2024-04-25T10:04:03.266768+0000","last_undegraded":"2024-04-25T10:04:03.266768+0000","last_fullsized":"2024-04-25T10:04:03.266768+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277674+0000","last_change":"2024-04-25T10:03:56.794134+0000","last_active":"2024-04-25T10:04:03.277674+0000","last_peered":"2024-04-25T10:04:03.277674+0000","last_clean":"2024-04-25T10:04:03.277674+0000","last_became_active":"2024-04-25T10:03:56.793845+0000","last_became_peered":"2024-04-25T10:03:56.793845+0000","last_unstale":"2024-04-25T10:04:03.277674+0000","last_undegraded":"2024-04-25T10:04:03.277674+0000","last_fullsized":"2024-04-25T10:04:03.277674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:26.317715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230962+0000","last_change":"2024-04-25T10:03:55.758720+0000","last_active":"2024-04-25T10:04:03.230962+0000","last_peered":"2024-04-25T10:04:03.230962+0000","last_clean":"2024-04-25T10:04:03.230962+0000","last_became_active":"2024-04-25T10:03:55.758417+0000","last_became_peered":"2024-04-25T10:03:55.758417+0000","last_unstale":"2024-04-25T10:04:03.230962+0000","last_undegraded":"2024-04-25T10:04:03.230962+0000","last_fullsized":"2024-04-25T10:04:03.230962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795441+0000","last_change":"2024-04-25T10:04:01.285580+0000","last_active":"2024-04-25T10:04:02.795441+0000","last_peered":"2024-04-25T10:04:02.795441+0000","last_clean":"2024-04-25T10:04:02.795441+0000","last_became_active":"2024-04-25T10:04:01.285212+0000","last_became_peered":"2024-04-25T10:04:01.285212+0000","last_unstale":"2024-04-25T10:04:02.795441+0000","last_undegraded":"2024-04-25T10:04:02.795441+0000","last_fullsized":"2024-04-25T10:04:02.795441+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277394+0000","last_change":"2024-04-25T10:03:56.787338+0000","last_active":"2024-04-25T10:04:03.277394+0000","last_peered":"2024-04-25T10:04:03.277394+0000","last_clean":"2024-04-25T10:04:03.277394+0000","last_became_active":"2024-04-25T10:03:56.787066+0000","last_became_peered":"2024-04-25T10:03:56.787066+0000","last_unstale":"2024-04-25T10:04:03.277394+0000","last_undegraded":"2024-04-25T10:04:03.277394+0000","last_fullsized":"2024-04-25T10:04:03.277394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278632+0000","last_change":"2024-04-25T10:03:55.755120+0000","last_active":"2024-04-25T10:04:03.278632+0000","last_peered":"2024-04-25T10:04:03.278632+0000","last_clean":"2024-04-25T10:04:03.278632+0000","last_became_active":"2024-04-25T10:03:55.754636+0000","last_became_peered":"2024-04-25T10:03:55.754636+0000","last_unstale":"2024-04-25T10:04:03.278632+0000","last_undegraded":"2024-04-25T10:04:03.278632+0000","last_fullsized":"2024-04-25T10:04:03.278632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:44.495603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.276603+0000","last_change":"2024-04-25T10:04:00.808408+0000","last_active":"2024-04-25T10:04:03.276603+0000","last_peered":"2024-04-25T10:04:03.276603+0000","last_clean":"2024-04-25T10:04:03.276603+0000","last_became_active":"2024-04-25T10:04:00.808024+0000","last_became_peered":"2024-04-25T10:04:00.808024+0000","last_unstale":"2024-04-25T10:04:03.276603+0000","last_undegraded":"2024-04-25T10:04:03.276603+0000","last_fullsized":"2024-04-25T10:04:03.276603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:14.698273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277668+0000","last_change":"2024-04-25T10:03:56.783068+0000","last_active":"2024-04-25T10:04:03.277668+0000","last_peered":"2024-04-25T10:04:03.277668+0000","last_clean":"2024-04-25T10:04:03.277668+0000","last_became_active":"2024-04-25T10:03:56.782782+0000","last_became_peered":"2024-04-25T10:03:56.782782+0000","last_unstale":"2024-04-25T10:04:03.277668+0000","last_undegraded":"2024-04-25T10:04:03.277668+0000","last_fullsized":"2024-04-25T10:04:03.277668+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230449+0000","last_change":"2024-04-25T10:03:55.764472+0000","last_active":"2024-04-25T10:04:03.230449+0000","last_peered":"2024-04-25T10:04:03.230449+0000","last_clean":"2024-04-25T10:04:03.230449+0000","last_became_active":"2024-04-25T10:03:55.763968+0000","last_became_peered":"2024-04-25T10:03:55.763968+0000","last_unstale":"2024-04-25T10:04:03.230449+0000","last_undegraded":"2024-04-25T10:04:03.230449+0000","last_fullsized":"2024-04-25T10:04:03.230449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266626+0000","last_change":"2024-04-25T10:04:00.807342+0000","last_active":"2024-04-25T10:04:03.266626+0000","last_peered":"2024-04-25T10:04:03.266626+0000","last_clean":"2024-04-25T10:04:03.266626+0000","last_became_active":"2024-04-25T10:04:00.806899+0000","last_became_peered":"2024-04-25T10:04:00.806899+0000","last_unstale":"2024-04-25T10:04:03.266626+0000","last_undegraded":"2024-04-25T10:04:03.266626+0000","last_fullsized":"2024-04-25T10:04:03.266626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797285+0000","last_change":"2024-04-25T10:03:56.759704+0000","last_active":"2024-04-25T10:04:02.797285+0000","last_peered":"2024-04-25T10:04:02.797285+0000","last_clean":"2024-04-25T10:04:02.797285+0000","last_became_active":"2024-04-25T10:03:56.758730+0000","last_became_peered":"2024-04-25T10:03:56.758730+0000","last_unstale":"2024-04-25T10:04:02.797285+0000","last_undegraded":"2024-04-25T10:04:02.797285+0000","last_fullsized":"2024-04-25T10:04:02.797285+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796361+0000","last_change":"2024-04-25T10:03:55.753914+0000","last_active":"2024-04-25T10:04:02.796361+0000","last_peered":"2024-04-25T10:04:02.796361+0000","last_clean":"2024-04-25T10:04:02.796361+0000","last_became_active":"2024-04-25T10:03:55.752892+0000","last_became_peered":"2024-04-25T10:03:55.752892+0000","last_unstale":"2024-04-25T10:04:02.796361+0000","last_undegraded":"2024-04-25T10:04:02.796361+0000","last_fullsized":"2024-04-25T10:04:02.796361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:54.841791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793148+0000","last_change":"2024-04-25T10:04:01.283999+0000","last_active":"2024-04-25T10:04:02.793148+0000","last_peered":"2024-04-25T10:04:02.793148+0000","last_clean":"2024-04-25T10:04:02.793148+0000","last_became_active":"2024-04-25T10:04:01.283582+0000","last_became_peered":"2024-04-25T10:04:01.283582+0000","last_unstale":"2024-04-25T10:04:02.793148+0000","last_undegraded":"2024-04-25T10:04:02.793148+0000","last_fullsized":"2024-04-25T10:04:02.793148+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:49.714373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277636+0000","last_change":"2024-04-25T10:03:56.783331+0000","last_active":"2024-04-25T10:04:03.277636+0000","last_peered":"2024-04-25T10:04:03.277636+0000","last_clean":"2024-04-25T10:04:03.277636+0000","last_became_active":"2024-04-25T10:03:56.782448+0000","last_became_peered":"2024-04-25T10:03:56.782448+0000","last_unstale":"2024-04-25T10:04:03.277636+0000","last_undegraded":"2024-04-25T10:04:03.277636+0000","last_fullsized":"2024-04-25T10:04:03.277636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:54:00.657805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796126+0000","last_change":"2024-04-25T10:03:55.761416+0000","last_active":"2024-04-25T10:04:02.796126+0000","last_peered":"2024-04-25T10:04:02.796126+0000","last_clean":"2024-04-25T10:04:02.796126+0000","last_became_active":"2024-04-25T10:03:55.760610+0000","last_became_peered":"2024-04-25T10:03:55.760610+0000","last_unstale":"2024-04-25T10:04:02.796126+0000","last_undegraded":"2024-04-25T10:04:02.796126+0000","last_fullsized":"2024-04-25T10:04:02.796126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:39.552682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793073+0000","last_change":"2024-04-25T10:04:01.287382+0000","last_active":"2024-04-25T10:04:02.793073+0000","last_peered":"2024-04-25T10:04:02.793073+0000","last_clean":"2024-04-25T10:04:02.793073+0000","last_became_active":"2024-04-25T10:04:01.285777+0000","last_became_peered":"2024-04-25T10:04:01.285777+0000","last_unstale":"2024-04-25T10:04:02.793073+0000","last_undegraded":"2024-04-25T10:04:02.793073+0000","last_fullsized":"2024-04-25T10:04:02.793073+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:21.867135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266469+0000","last_change":"2024-04-25T10:03:56.772446+0000","last_active":"2024-04-25T10:04:03.266469+0000","last_peered":"2024-04-25T10:04:03.266469+0000","last_clean":"2024-04-25T10:04:03.266469+0000","last_became_active":"2024-04-25T10:03:56.772029+0000","last_became_peered":"2024-04-25T10:03:56.772029+0000","last_unstale":"2024-04-25T10:04:03.266469+0000","last_undegraded":"2024-04-25T10:04:03.266469+0000","last_fullsized":"2024-04-25T10:04:03.266469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:09.280433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266991+0000","last_change":"2024-04-25T10:03:55.747987+0000","last_active":"2024-04-25T10:04:03.266991+0000","last_peered":"2024-04-25T10:04:03.266991+0000","last_clean":"2024-04-25T10:04:03.266991+0000","last_became_active":"2024-04-25T10:03:55.747631+0000","last_became_peered":"2024-04-25T10:03:55.747631+0000","last_unstale":"2024-04-25T10:04:03.266991+0000","last_undegraded":"2024-04-25T10:04:03.266991+0000","last_fullsized":"2024-04-25T10:04:03.266991+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:44.719385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796909+0000","last_change":"2024-04-25T10:04:01.286318+0000","last_active":"2024-04-25T10:04:02.796909+0000","last_peered":"2024-04-25T10:04:02.796909+0000","last_clean":"2024-04-25T10:04:02.796909+0000","last_became_active":"2024-04-25T10:04:01.285907+0000","last_became_peered":"2024-04-25T10:04:01.285907+0000","last_unstale":"2024-04-25T10:04:02.796909+0000","last_undegraded":"2024-04-25T10:04:02.796909+0000","last_fullsized":"2024-04-25T10:04:02.796909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:04.689327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277610+0000","last_change":"2024-04-25T10:03:56.781752+0000","last_active":"2024-04-25T10:04:03.277610+0000","last_peered":"2024-04-25T10:04:03.277610+0000","last_clean":"2024-04-25T10:04:03.277610+0000","last_became_active":"2024-04-25T10:03:56.781491+0000","last_became_peered":"2024-04-25T10:03:56.781491+0000","last_unstale":"2024-04-25T10:04:03.277610+0000","last_undegraded":"2024-04-25T10:04:03.277610+0000","last_fullsized":"2024-04-25T10:04:03.277610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:11.993610+0000","last_change":"2024-04-25T10:03:55.766431+0000","last_active":"2024-04-25T10:04:11.993610+0000","last_peered":"2024-04-25T10:04:11.993610+0000","last_clean":"2024-04-25T10:04:11.993610+0000","last_became_active":"2024-04-25T10:03:55.761777+0000","last_became_peered":"2024-04-25T10:03:55.761777+0000","last_unstale":"2024-04-25T10:04:11.993610+0000","last_undegraded":"2024-04-25T10:04:11.993610+0000","last_fullsized":"2024-04-25T10:04:11.993610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:11.626002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275114+0000","last_change":"2024-04-25T10:04:00.801843+0000","last_active":"2024-04-25T10:04:03.275114+0000","last_peered":"2024-04-25T10:04:03.275114+0000","last_clean":"2024-04-25T10:04:03.275114+0000","last_became_active":"2024-04-25T10:04:00.801403+0000","last_became_peered":"2024-04-25T10:04:00.801403+0000","last_unstale":"2024-04-25T10:04:03.275114+0000","last_undegraded":"2024-04-25T10:04:03.275114+0000","last_fullsized":"2024-04-25T10:04:03.275114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277428+0000","last_change":"2024-04-25T10:03:56.782319+0000","last_active":"2024-04-25T10:04:03.277428+0000","last_peered":"2024-04-25T10:04:03.277428+0000","last_clean":"2024-04-25T10:04:03.277428+0000","last_became_active":"2024-04-25T10:03:56.781988+0000","last_became_peered":"2024-04-25T10:03:56.781988+0000","last_unstale":"2024-04-25T10:04:03.277428+0000","last_undegraded":"2024-04-25T10:04:03.277428+0000","last_fullsized":"2024-04-25T10:04:03.277428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274941+0000","last_change":"2024-04-25T10:03:55.767225+0000","last_active":"2024-04-25T10:04:03.274941+0000","last_peered":"2024-04-25T10:04:03.274941+0000","last_clean":"2024-04-25T10:04:03.274941+0000","last_became_active":"2024-04-25T10:03:55.766947+0000","last_became_peered":"2024-04-25T10:03:55.766947+0000","last_unstale":"2024-04-25T10:04:03.274941+0000","last_undegraded":"2024-04-25T10:04:03.274941+0000","last_fullsized":"2024-04-25T10:04:03.274941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.278424+0000","last_change":"2024-04-25T10:04:00.797613+0000","last_active":"2024-04-25T10:04:03.278424+0000","last_peered":"2024-04-25T10:04:03.278424+0000","last_clean":"2024-04-25T10:04:03.278424+0000","last_became_active":"2024-04-25T10:04:00.797207+0000","last_became_peered":"2024-04-25T10:04:00.797207+0000","last_unstale":"2024-04-25T10:04:03.278424+0000","last_undegraded":"2024-04-25T10:04:03.278424+0000","last_fullsized":"2024-04-25T10:04:03.278424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:59.832013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266976+0000","last_change":"2024-04-25T10:03:56.774964+0000","last_active":"2024-04-25T10:04:03.266976+0000","last_peered":"2024-04-25T10:04:03.266976+0000","last_clean":"2024-04-25T10:04:03.266976+0000","last_became_active":"2024-04-25T10:03:56.770623+0000","last_became_peered":"2024-04-25T10:03:56.770623+0000","last_unstale":"2024-04-25T10:04:03.266976+0000","last_undegraded":"2024-04-25T10:04:03.266976+0000","last_fullsized":"2024-04-25T10:04:03.266976+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797269+0000","last_change":"2024-04-25T10:03:55.772282+0000","last_active":"2024-04-25T10:04:02.797269+0000","last_peered":"2024-04-25T10:04:02.797269+0000","last_clean":"2024-04-25T10:04:02.797269+0000","last_became_active":"2024-04-25T10:03:55.771984+0000","last_became_peered":"2024-04-25T10:03:55.771984+0000","last_unstale":"2024-04-25T10:04:02.797269+0000","last_undegraded":"2024-04-25T10:04:02.797269+0000","last_fullsized":"2024-04-25T10:04:02.797269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:44.808087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792604+0000","last_change":"2024-04-25T10:04:00.802185+0000","last_active":"2024-04-25T10:04:02.792604+0000","last_peered":"2024-04-25T10:04:02.792604+0000","last_clean":"2024-04-25T10:04:02.792604+0000","last_became_active":"2024-04-25T10:04:00.801810+0000","last_became_peered":"2024-04-25T10:04:00.801810+0000","last_unstale":"2024-04-25T10:04:02.792604+0000","last_undegraded":"2024-04-25T10:04:02.792604+0000","last_fullsized":"2024-04-25T10:04:02.792604+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:47.336597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797055+0000","last_change":"2024-04-25T10:03:56.786962+0000","last_active":"2024-04-25T10:04:02.797055+0000","last_peered":"2024-04-25T10:04:02.797055+0000","last_clean":"2024-04-25T10:04:02.797055+0000","last_became_active":"2024-04-25T10:03:56.786671+0000","last_became_peered":"2024-04-25T10:03:56.786671+0000","last_unstale":"2024-04-25T10:04:02.797055+0000","last_undegraded":"2024-04-25T10:04:02.797055+0000","last_fullsized":"2024-04-25T10:04:02.797055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:36.240977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796832+0000","last_change":"2024-04-25T10:03:55.769399+0000","last_active":"2024-04-25T10:04:02.796832+0000","last_peered":"2024-04-25T10:04:02.796832+0000","last_clean":"2024-04-25T10:04:02.796832+0000","last_became_active":"2024-04-25T10:03:55.769076+0000","last_became_peered":"2024-04-25T10:03:55.769076+0000","last_unstale":"2024-04-25T10:04:02.796832+0000","last_undegraded":"2024-04-25T10:04:02.796832+0000","last_fullsized":"2024-04-25T10:04:02.796832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:04.631249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792653+0000","last_change":"2024-04-25T10:04:01.284799+0000","last_active":"2024-04-25T10:04:02.792653+0000","last_peered":"2024-04-25T10:04:02.792653+0000","last_clean":"2024-04-25T10:04:02.792653+0000","last_became_active":"2024-04-25T10:04:01.283596+0000","last_became_peered":"2024-04-25T10:04:01.283596+0000","last_unstale":"2024-04-25T10:04:02.792653+0000","last_undegraded":"2024-04-25T10:04:02.792653+0000","last_fullsized":"2024-04-25T10:04:02.792653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:41.435837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266621+0000","last_change":"2024-04-25T10:04:01.286375+0000","last_active":"2024-04-25T10:04:03.266621+0000","last_peered":"2024-04-25T10:04:03.266621+0000","last_clean":"2024-04-25T10:04:03.266621+0000","last_became_active":"2024-04-25T10:04:01.285832+0000","last_became_peered":"2024-04-25T10:04:01.285832+0000","last_unstale":"2024-04-25T10:04:03.266621+0000","last_undegraded":"2024-04-25T10:04:03.266621+0000","last_fullsized":"2024-04-25T10:04:03.266621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:15.304354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274484+0000","last_change":"2024-04-25T10:03:56.760165+0000","last_active":"2024-04-25T10:04:03.274484+0000","last_peered":"2024-04-25T10:04:03.274484+0000","last_clean":"2024-04-25T10:04:03.274484+0000","last_became_active":"2024-04-25T10:03:56.759886+0000","last_became_peered":"2024-04-25T10:03:56.759886+0000","last_unstale":"2024-04-25T10:04:03.274484+0000","last_undegraded":"2024-04-25T10:04:03.274484+0000","last_fullsized":"2024-04-25T10:04:03.274484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795508+0000","last_change":"2024-04-25T10:03:55.759342+0000","last_active":"2024-04-25T10:04:02.795508+0000","last_peered":"2024-04-25T10:04:02.795508+0000","last_clean":"2024-04-25T10:04:02.795508+0000","last_became_active":"2024-04-25T10:03:55.758902+0000","last_became_peered":"2024-04-25T10:03:55.758902+0000","last_unstale":"2024-04-25T10:04:02.795508+0000","last_undegraded":"2024-04-25T10:04:02.795508+0000","last_fullsized":"2024-04-25T10:04:02.795508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796847+0000","last_change":"2024-04-25T10:04:00.800413+0000","last_active":"2024-04-25T10:04:02.796847+0000","last_peered":"2024-04-25T10:04:02.796847+0000","last_clean":"2024-04-25T10:04:02.796847+0000","last_became_active":"2024-04-25T10:04:00.800005+0000","last_became_peered":"2024-04-25T10:04:00.800005+0000","last_unstale":"2024-04-25T10:04:02.796847+0000","last_undegraded":"2024-04-25T10:04:02.796847+0000","last_fullsized":"2024-04-25T10:04:02.796847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:13.938807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792578+0000","last_change":"2024-04-25T10:03:56.754790+0000","last_active":"2024-04-25T10:04:02.792578+0000","last_peered":"2024-04-25T10:04:02.792578+0000","last_clean":"2024-04-25T10:04:02.792578+0000","last_became_active":"2024-04-25T10:03:56.753655+0000","last_became_peered":"2024-04-25T10:03:56.753655+0000","last_unstale":"2024-04-25T10:04:02.792578+0000","last_undegraded":"2024-04-25T10:04:02.792578+0000","last_fullsized":"2024-04-25T10:04:02.792578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:39.193422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792770+0000","last_change":"2024-04-25T10:03:55.761647+0000","last_active":"2024-04-25T10:04:02.792770+0000","last_peered":"2024-04-25T10:04:02.792770+0000","last_clean":"2024-04-25T10:04:02.792770+0000","last_became_active":"2024-04-25T10:03:55.761495+0000","last_became_peered":"2024-04-25T10:03:55.761495+0000","last_unstale":"2024-04-25T10:04:02.792770+0000","last_undegraded":"2024-04-25T10:04:02.792770+0000","last_fullsized":"2024-04-25T10:04:02.792770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:24.436084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796295+0000","last_change":"2024-04-25T10:03:55.765920+0000","last_active":"2024-04-25T10:04:02.796295+0000","last_peered":"2024-04-25T10:04:02.796295+0000","last_clean":"2024-04-25T10:04:02.796295+0000","last_became_active":"2024-04-25T10:03:55.765626+0000","last_became_peered":"2024-04-25T10:03:55.765626+0000","last_unstale":"2024-04-25T10:04:02.796295+0000","last_undegraded":"2024-04-25T10:04:02.796295+0000","last_fullsized":"2024-04-25T10:04:02.796295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:33:23.712323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266888+0000","last_change":"2024-04-25T10:03:56.780813+0000","last_active":"2024-04-25T10:04:03.266888+0000","last_peered":"2024-04-25T10:04:03.266888+0000","last_clean":"2024-04-25T10:04:03.266888+0000","last_became_active":"2024-04-25T10:03:56.774414+0000","last_became_peered":"2024-04-25T10:03:56.774414+0000","last_unstale":"2024-04-25T10:04:03.266888+0000","last_undegraded":"2024-04-25T10:04:03.266888+0000","last_fullsized":"2024-04-25T10:04:03.266888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230710+0000","last_change":"2024-04-25T10:04:00.805747+0000","last_active":"2024-04-25T10:04:03.230710+0000","last_peered":"2024-04-25T10:04:03.230710+0000","last_clean":"2024-04-25T10:04:03.230710+0000","last_became_active":"2024-04-25T10:04:00.804310+0000","last_became_peered":"2024-04-25T10:04:00.804310+0000","last_unstale":"2024-04-25T10:04:03.230710+0000","last_undegraded":"2024-04-25T10:04:03.230710+0000","last_fullsized":"2024-04-25T10:04:03.230710+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:05.811588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793053+0000","last_change":"2024-04-25T10:03:55.768990+0000","last_active":"2024-04-25T10:04:02.793053+0000","last_peered":"2024-04-25T10:04:02.793053+0000","last_clean":"2024-04-25T10:04:02.793053+0000","last_became_active":"2024-04-25T10:03:55.767518+0000","last_became_peered":"2024-04-25T10:03:55.767518+0000","last_unstale":"2024-04-25T10:04:02.793053+0000","last_undegraded":"2024-04-25T10:04:02.793053+0000","last_fullsized":"2024-04-25T10:04:02.793053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:54.722549+0000","last_clean_scrub_stamp":"2024-04-25T10:03:54.722549+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:25:11.150681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277092+0000","last_change":"2024-04-25T10:03:56.770753+0000","last_active":"2024-04-25T10:04:03.277092+0000","last_peered":"2024-04-25T10:04:03.277092+0000","last_clean":"2024-04-25T10:04:03.277092+0000","last_became_active":"2024-04-25T10:03:56.770399+0000","last_became_peered":"2024-04-25T10:03:56.770399+0000","last_unstale":"2024-04-25T10:04:03.277092+0000","last_undegraded":"2024-04-25T10:04:03.277092+0000","last_fullsized":"2024-04-25T10:04:03.277092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:02:12.633520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793274+0000","last_change":"2024-04-25T10:04:00.810546+0000","last_active":"2024-04-25T10:04:02.793274+0000","last_peered":"2024-04-25T10:04:02.793274+0000","last_clean":"2024-04-25T10:04:02.793274+0000","last_became_active":"2024-04-25T10:04:00.809965+0000","last_became_peered":"2024-04-25T10:04:00.809965+0000","last_unstale":"2024-04-25T10:04:02.793274+0000","last_undegraded":"2024-04-25T10:04:02.793274+0000","last_fullsized":"2024-04-25T10:04:02.793274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:59.767351+0000","last_clean_scrub_stamp":"2024-04-25T10:03:59.767351+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:25.609318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796086+0000","last_change":"2024-04-25T10:03:56.759410+0000","last_active":"2024-04-25T10:04:02.796086+0000","last_peered":"2024-04-25T10:04:02.796086+0000","last_clean":"2024-04-25T10:04:02.796086+0000","last_became_active":"2024-04-25T10:03:56.759063+0000","last_became_peered":"2024-04-25T10:03:56.759063+0000","last_unstale":"2024-04-25T10:04:02.796086+0000","last_undegraded":"2024-04-25T10:04:02.796086+0000","last_fullsized":"2024-04-25T10:04:02.796086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230579+0000","last_change":"2024-04-25T10:03:56.775592+0000","last_active":"2024-04-25T10:04:03.230579+0000","last_peered":"2024-04-25T10:04:03.230579+0000","last_clean":"2024-04-25T10:04:03.230579+0000","last_became_active":"2024-04-25T10:03:56.775251+0000","last_became_peered":"2024-04-25T10:03:56.775251+0000","last_unstale":"2024-04-25T10:04:03.230579+0000","last_undegraded":"2024-04-25T10:04:03.230579+0000","last_fullsized":"2024-04-25T10:04:03.230579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796019+0000","last_change":"2024-04-25T10:03:56.767847+0000","last_active":"2024-04-25T10:04:02.796019+0000","last_peered":"2024-04-25T10:04:02.796019+0000","last_clean":"2024-04-25T10:04:02.796019+0000","last_became_active":"2024-04-25T10:03:56.767543+0000","last_became_peered":"2024-04-25T10:03:56.767543+0000","last_unstale":"2024-04-25T10:04:02.796019+0000","last_undegraded":"2024-04-25T10:04:02.796019+0000","last_fullsized":"2024-04-25T10:04:02.796019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:25.509782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266882+0000","last_change":"2024-04-25T10:03:56.767650+0000","last_active":"2024-04-25T10:04:03.266882+0000","last_peered":"2024-04-25T10:04:03.266882+0000","last_clean":"2024-04-25T10:04:03.266882+0000","last_became_active":"2024-04-25T10:03:56.767362+0000","last_became_peered":"2024-04-25T10:03:56.767362+0000","last_unstale":"2024-04-25T10:04:03.266882+0000","last_undegraded":"2024-04-25T10:04:03.266882+0000","last_fullsized":"2024-04-25T10:04:03.266882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793258+0000","last_change":"2024-04-25T10:03:56.776617+0000","last_active":"2024-04-25T10:04:02.793258+0000","last_peered":"2024-04-25T10:04:02.793258+0000","last_clean":"2024-04-25T10:04:02.793258+0000","last_became_active":"2024-04-25T10:03:56.776219+0000","last_became_peered":"2024-04-25T10:03:56.776219+0000","last_unstale":"2024-04-25T10:04:02.793258+0000","last_undegraded":"2024-04-25T10:04:02.793258+0000","last_fullsized":"2024-04-25T10:04:02.793258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.744805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274831+0000","last_change":"2024-04-25T10:03:56.759677+0000","last_active":"2024-04-25T10:04:03.274831+0000","last_peered":"2024-04-25T10:04:03.274831+0000","last_clean":"2024-04-25T10:04:03.274831+0000","last_became_active":"2024-04-25T10:03:56.759375+0000","last_became_peered":"2024-04-25T10:03:56.759375+0000","last_unstale":"2024-04-25T10:04:03.274831+0000","last_undegraded":"2024-04-25T10:04:03.274831+0000","last_fullsized":"2024-04-25T10:04:03.274831+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797482+0000","last_change":"2024-04-25T10:03:56.780048+0000","last_active":"2024-04-25T10:04:02.797482+0000","last_peered":"2024-04-25T10:04:02.797482+0000","last_clean":"2024-04-25T10:04:02.797482+0000","last_became_active":"2024-04-25T10:03:56.779166+0000","last_became_peered":"2024-04-25T10:03:56.779166+0000","last_unstale":"2024-04-25T10:04:02.797482+0000","last_undegraded":"2024-04-25T10:04:02.797482+0000","last_fullsized":"2024-04-25T10:04:02.797482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.793245+0000","last_change":"2024-04-25T10:03:56.772146+0000","last_active":"2024-04-25T10:04:02.793245+0000","last_peered":"2024-04-25T10:04:02.793245+0000","last_clean":"2024-04-25T10:04:02.793245+0000","last_became_active":"2024-04-25T10:03:56.770243+0000","last_became_peered":"2024-04-25T10:03:56.770243+0000","last_unstale":"2024-04-25T10:04:02.793245+0000","last_undegraded":"2024-04-25T10:04:02.793245+0000","last_fullsized":"2024-04-25T10:04:02.793245+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:14.837075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795467+0000","last_change":"2024-04-25T10:03:56.771691+0000","last_active":"2024-04-25T10:04:02.795467+0000","last_peered":"2024-04-25T10:04:02.795467+0000","last_clean":"2024-04-25T10:04:02.795467+0000","last_became_active":"2024-04-25T10:03:56.771315+0000","last_became_peered":"2024-04-25T10:03:56.771315+0000","last_unstale":"2024-04-25T10:04:02.795467+0000","last_undegraded":"2024-04-25T10:04:02.795467+0000","last_fullsized":"2024-04-25T10:04:02.795467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792766+0000","last_change":"2024-04-25T10:03:56.776434+0000","last_active":"2024-04-25T10:04:02.792766+0000","last_peered":"2024-04-25T10:04:02.792766+0000","last_clean":"2024-04-25T10:04:02.792766+0000","last_became_active":"2024-04-25T10:03:56.776138+0000","last_became_peered":"2024-04-25T10:03:56.776138+0000","last_unstale":"2024-04-25T10:04:02.792766+0000","last_undegraded":"2024-04-25T10:04:02.792766+0000","last_fullsized":"2024-04-25T10:04:02.792766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:47.871125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796045+0000","last_change":"2024-04-25T10:03:56.787227+0000","last_active":"2024-04-25T10:04:02.796045+0000","last_peered":"2024-04-25T10:04:02.796045+0000","last_clean":"2024-04-25T10:04:02.796045+0000","last_became_active":"2024-04-25T10:03:56.786628+0000","last_became_peered":"2024-04-25T10:03:56.786628+0000","last_unstale":"2024-04-25T10:04:02.796045+0000","last_undegraded":"2024-04-25T10:04:02.796045+0000","last_fullsized":"2024-04-25T10:04:02.796045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:11.480274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266770+0000","last_change":"2024-04-25T10:03:56.781525+0000","last_active":"2024-04-25T10:04:03.266770+0000","last_peered":"2024-04-25T10:04:03.266770+0000","last_clean":"2024-04-25T10:04:03.266770+0000","last_became_active":"2024-04-25T10:03:56.781186+0000","last_became_peered":"2024-04-25T10:03:56.781186+0000","last_unstale":"2024-04-25T10:04:03.266770+0000","last_undegraded":"2024-04-25T10:04:03.266770+0000","last_fullsized":"2024-04-25T10:04:03.266770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:47:05.551896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796586+0000","last_change":"2024-04-25T10:03:56.772909+0000","last_active":"2024-04-25T10:04:02.796586+0000","last_peered":"2024-04-25T10:04:02.796586+0000","last_clean":"2024-04-25T10:04:02.796586+0000","last_became_active":"2024-04-25T10:03:56.772651+0000","last_became_peered":"2024-04-25T10:03:56.772651+0000","last_unstale":"2024-04-25T10:04:02.796586+0000","last_undegraded":"2024-04-25T10:04:02.796586+0000","last_fullsized":"2024-04-25T10:04:02.796586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277718+0000","last_change":"2024-04-25T10:03:56.786914+0000","last_active":"2024-04-25T10:04:03.277718+0000","last_peered":"2024-04-25T10:04:03.277718+0000","last_clean":"2024-04-25T10:04:03.277718+0000","last_became_active":"2024-04-25T10:03:56.786624+0000","last_became_peered":"2024-04-25T10:03:56.786624+0000","last_unstale":"2024-04-25T10:04:03.277718+0000","last_undegraded":"2024-04-25T10:04:03.277718+0000","last_fullsized":"2024-04-25T10:04:03.277718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:57:56.790795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.230883+0000","last_change":"2024-04-25T10:03:56.756870+0000","last_active":"2024-04-25T10:04:03.230883+0000","last_peered":"2024-04-25T10:04:03.230883+0000","last_clean":"2024-04-25T10:04:03.230883+0000","last_became_active":"2024-04-25T10:03:56.756588+0000","last_became_peered":"2024-04-25T10:03:56.756588+0000","last_unstale":"2024-04-25T10:04:03.230883+0000","last_undegraded":"2024-04-25T10:04:03.230883+0000","last_fullsized":"2024-04-25T10:04:03.230883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:38.870572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797271+0000","last_change":"2024-04-25T10:03:56.787720+0000","last_active":"2024-04-25T10:04:02.797271+0000","last_peered":"2024-04-25T10:04:02.797271+0000","last_clean":"2024-04-25T10:04:02.797271+0000","last_became_active":"2024-04-25T10:03:56.786712+0000","last_became_peered":"2024-04-25T10:03:56.786712+0000","last_unstale":"2024-04-25T10:04:02.797271+0000","last_undegraded":"2024-04-25T10:04:02.797271+0000","last_fullsized":"2024-04-25T10:04:02.797271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795363+0000","last_change":"2024-04-25T10:03:56.772050+0000","last_active":"2024-04-25T10:04:02.795363+0000","last_peered":"2024-04-25T10:04:02.795363+0000","last_clean":"2024-04-25T10:04:02.795363+0000","last_became_active":"2024-04-25T10:03:56.771788+0000","last_became_peered":"2024-04-25T10:03:56.771788+0000","last_unstale":"2024-04-25T10:04:02.795363+0000","last_undegraded":"2024-04-25T10:04:02.795363+0000","last_fullsized":"2024-04-25T10:04:02.795363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:59:50.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.274557+0000","last_change":"2024-04-25T10:03:56.776805+0000","last_active":"2024-04-25T10:04:03.274557+0000","last_peered":"2024-04-25T10:04:03.274557+0000","last_clean":"2024-04-25T10:04:03.274557+0000","last_became_active":"2024-04-25T10:03:56.776521+0000","last_became_peered":"2024-04-25T10:03:56.776521+0000","last_unstale":"2024-04-25T10:04:03.274557+0000","last_undegraded":"2024-04-25T10:04:03.274557+0000","last_fullsized":"2024-04-25T10:04:03.274557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:04.052879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266435+0000","last_change":"2024-04-25T10:03:56.756971+0000","last_active":"2024-04-25T10:04:03.266435+0000","last_peered":"2024-04-25T10:04:03.266435+0000","last_clean":"2024-04-25T10:04:03.266435+0000","last_became_active":"2024-04-25T10:03:56.756615+0000","last_became_peered":"2024-04-25T10:03:56.756615+0000","last_unstale":"2024-04-25T10:04:03.266435+0000","last_undegraded":"2024-04-25T10:04:03.266435+0000","last_fullsized":"2024-04-25T10:04:03.266435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:37.191982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792947+0000","last_change":"2024-04-25T10:03:56.764011+0000","last_active":"2024-04-25T10:04:02.792947+0000","last_peered":"2024-04-25T10:04:02.792947+0000","last_clean":"2024-04-25T10:04:02.792947+0000","last_became_active":"2024-04-25T10:03:56.759567+0000","last_became_peered":"2024-04-25T10:03:56.759567+0000","last_unstale":"2024-04-25T10:04:02.792947+0000","last_undegraded":"2024-04-25T10:04:02.792947+0000","last_fullsized":"2024-04-25T10:04:02.792947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:44.595374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277339+0000","last_change":"2024-04-25T10:03:56.770314+0000","last_active":"2024-04-25T10:04:03.277339+0000","last_peered":"2024-04-25T10:04:03.277339+0000","last_clean":"2024-04-25T10:04:03.277339+0000","last_became_active":"2024-04-25T10:03:56.769983+0000","last_became_peered":"2024-04-25T10:03:56.769983+0000","last_unstale":"2024-04-25T10:04:03.277339+0000","last_undegraded":"2024-04-25T10:04:03.277339+0000","last_fullsized":"2024-04-25T10:04:03.277339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:58.721406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797467+0000","last_change":"2024-04-25T10:03:56.776383+0000","last_active":"2024-04-25T10:04:02.797467+0000","last_peered":"2024-04-25T10:04:02.797467+0000","last_clean":"2024-04-25T10:04:02.797467+0000","last_became_active":"2024-04-25T10:03:56.775871+0000","last_became_peered":"2024-04-25T10:03:56.775871+0000","last_unstale":"2024-04-25T10:04:02.797467+0000","last_undegraded":"2024-04-25T10:04:02.797467+0000","last_fullsized":"2024-04-25T10:04:02.797467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:09.535569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.797420+0000","last_change":"2024-04-25T10:03:56.767888+0000","last_active":"2024-04-25T10:04:02.797420+0000","last_peered":"2024-04-25T10:04:02.797420+0000","last_clean":"2024-04-25T10:04:02.797420+0000","last_became_active":"2024-04-25T10:03:56.767620+0000","last_became_peered":"2024-04-25T10:03:56.767620+0000","last_unstale":"2024-04-25T10:04:02.797420+0000","last_undegraded":"2024-04-25T10:04:02.797420+0000","last_fullsized":"2024-04-25T10:04:02.797420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277564+0000","last_change":"2024-04-25T10:03:56.796106+0000","last_active":"2024-04-25T10:04:03.277564+0000","last_peered":"2024-04-25T10:04:03.277564+0000","last_clean":"2024-04-25T10:04:03.277564+0000","last_became_active":"2024-04-25T10:03:56.795843+0000","last_became_peered":"2024-04-25T10:03:56.795843+0000","last_unstale":"2024-04-25T10:04:03.277564+0000","last_undegraded":"2024-04-25T10:04:03.277564+0000","last_fullsized":"2024-04-25T10:04:03.277564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:39:10.660989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.792478+0000","last_change":"2024-04-25T10:03:56.766481+0000","last_active":"2024-04-25T10:04:02.792478+0000","last_peered":"2024-04-25T10:04:02.792478+0000","last_clean":"2024-04-25T10:04:02.792478+0000","last_became_active":"2024-04-25T10:03:56.766169+0000","last_became_peered":"2024-04-25T10:03:56.766169+0000","last_unstale":"2024-04-25T10:04:02.792478+0000","last_undegraded":"2024-04-25T10:04:02.792478+0000","last_fullsized":"2024-04-25T10:04:02.792478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:58.107863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277557+0000","last_change":"2024-04-25T10:03:56.778866+0000","last_active":"2024-04-25T10:04:03.277557+0000","last_peered":"2024-04-25T10:04:03.277557+0000","last_clean":"2024-04-25T10:04:03.277557+0000","last_became_active":"2024-04-25T10:03:56.778491+0000","last_became_peered":"2024-04-25T10:03:56.778491+0000","last_unstale":"2024-04-25T10:04:03.277557+0000","last_undegraded":"2024-04-25T10:04:03.277557+0000","last_fullsized":"2024-04-25T10:04:03.277557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.795905+0000","last_change":"2024-04-25T10:03:56.793303+0000","last_active":"2024-04-25T10:04:02.795905+0000","last_peered":"2024-04-25T10:04:02.795905+0000","last_clean":"2024-04-25T10:04:02.795905+0000","last_became_active":"2024-04-25T10:03:56.792743+0000","last_became_peered":"2024-04-25T10:03:56.792743+0000","last_unstale":"2024-04-25T10:04:02.795905+0000","last_undegraded":"2024-04-25T10:04:02.795905+0000","last_fullsized":"2024-04-25T10:04:02.795905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:51.749510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277067+0000","last_change":"2024-04-25T10:03:56.787411+0000","last_active":"2024-04-25T10:04:03.277067+0000","last_peered":"2024-04-25T10:04:03.277067+0000","last_clean":"2024-04-25T10:04:03.277067+0000","last_became_active":"2024-04-25T10:03:56.786639+0000","last_became_peered":"2024-04-25T10:03:56.786639+0000","last_unstale":"2024-04-25T10:04:03.277067+0000","last_undegraded":"2024-04-25T10:04:03.277067+0000","last_fullsized":"2024-04-25T10:04:03.277067+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:07:09.901523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:02.796676+0000","last_change":"2024-04-25T10:03:56.768181+0000","last_active":"2024-04-25T10:04:02.796676+0000","last_peered":"2024-04-25T10:04:02.796676+0000","last_clean":"2024-04-25T10:04:02.796676+0000","last_became_active":"2024-04-25T10:03:56.767723+0000","last_became_peered":"2024-04-25T10:03:56.767723+0000","last_unstale":"2024-04-25T10:04:02.796676+0000","last_undegraded":"2024-04-25T10:04:02.796676+0000","last_fullsized":"2024-04-25T10:04:02.796676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:35.449956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.266736+0000","last_change":"2024-04-25T10:03:56.761621+0000","last_active":"2024-04-25T10:04:03.266736+0000","last_peered":"2024-04-25T10:04:03.266736+0000","last_clean":"2024-04-25T10:04:03.266736+0000","last_became_active":"2024-04-25T10:03:56.761220+0000","last_became_peered":"2024-04-25T10:03:56.761220+0000","last_unstale":"2024-04-25T10:04:03.266736+0000","last_undegraded":"2024-04-25T10:04:03.266736+0000","last_fullsized":"2024-04-25T10:04:03.266736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:35.367003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.275178+0000","last_change":"2024-04-25T10:03:56.753004+0000","last_active":"2024-04-25T10:04:03.275178+0000","last_peered":"2024-04-25T10:04:03.275178+0000","last_clean":"2024-04-25T10:04:03.275178+0000","last_became_active":"2024-04-25T10:03:56.752524+0000","last_became_peered":"2024-04-25T10:03:56.752524+0000","last_unstale":"2024-04-25T10:04:03.275178+0000","last_undegraded":"2024-04-25T10:04:03.275178+0000","last_fullsized":"2024-04-25T10:04:03.275178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:12:43.339018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T10:04:03.277772+0000","last_change":"2024-04-25T10:03:56.788107+0000","last_active":"2024-04-25T10:04:03.277772+0000","last_peered":"2024-04-25T10:04:03.277772+0000","last_clean":"2024-04-25T10:04:03.277772+0000","last_became_active":"2024-04-25T10:03:56.787837+0000","last_became_peered":"2024-04-25T10:03:56.787837+0000","last_unstale":"2024-04-25T10:04:03.277772+0000","last_undegraded":"2024-04-25T10:04:03.277772+0000","last_fullsized":"2024-04-25T10:04:03.277772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:55.730067+0000","last_clean_scrub_stamp":"2024-04-25T10:03:55.730067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:36.544681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":705197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":114337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31464,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340376,"statfs":{"total":96636764160,"available":96604545024,"internally_reserved":0,"allocated":294912,"data_stored":118089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":282624,"data_stored":114247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":888832,"data_stored":705253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:04:21.085 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:04:21.085 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T10:04:21.085 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T10:04:21.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:04:21.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 Processor -- start 2024-04-25T10:04:21.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 -- start start 2024-04-25T10:04:21.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 0x7fd234099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23415ee00 0x7fd23406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23409a380 con 0x7fd2341616a0 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23406c650 con 0x7fd23415ee00 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd23b600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23406c930 con 0x7fd234099a60 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd22be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23415ee00 0x7fd23406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd22be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23415ee00 0x7fd23406bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41406/0 (socket says 172.21.15.18:41406) 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd22be00640 1 -- 172.21.15.18:0/4246927468 learned_addr learned my addr 172.21.15.18:0/4246927468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.253+0000 7fd238c00640 1 --2- 172.21.15.18:0/4246927468 >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 0x7fd234099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd22be00640 1 -- 172.21.15.18:0/4246927468 >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 msgr2=0x7fd234099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd22be00640 1 --2- 172.21.15.18:0/4246927468 >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 0x7fd234099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd22be00640 1 -- 172.21.15.18:0/4246927468 >> v1:172.21.15.167:6789/0 conn(0x7fd2341616a0 legacy=0x7fd234161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd22be00640 1 -- 172.21.15.18:0/4246927468 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23406cc10 con 0x7fd23415ee00 2024-04-25T10:04:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd238c00640 1 --2- 172.21.15.18:0/4246927468 >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 0x7fd234099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd22be00640 1 --2- 172.21.15.18:0/4246927468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23415ee00 0x7fd23406bd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd234072740 tx=0x7fd21c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13565feeca3699d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd233e00640 1 -- 172.21.15.18:0/4246927468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0b1070 con 0x7fd23415ee00 2024-04-25T10:04:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd233e00640 1 -- 172.21.15.18:0/4246927468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0ac630 con 0x7fd23415ee00 2024-04-25T10:04:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd233e00640 1 -- 172.21.15.18:0/4246927468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0a8050 con 0x7fd23415ee00 2024-04-25T10:04:21.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd23b600640 1 -- 172.21.15.18:0/4246927468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23415ee00 msgr2=0x7fd23406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.257+0000 7fd23b600640 1 --2- 172.21.15.18:0/4246927468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23415ee00 0x7fd23406bd20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd234072740 tx=0x7fd21c01c520 comp rx=0 tx=0).stop 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- 172.21.15.18:0/4246927468 shutdown_connections 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 --2- 172.21.15.18:0/4246927468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23415ee00 0x7fd23406bd20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 --2- 172.21.15.18:0/4246927468 >> v2:172.21.15.167:3300/0 conn(0x7fd234099a60 0x7fd234099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- 172.21.15.18:0/4246927468 >> 172.21.15.18:0/4246927468 conn(0x7fd2340d17a0 msgr2=0x7fd2340d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- 172.21.15.18:0/4246927468 shutdown_connections 2024-04-25T10:04:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- 172.21.15.18:0/4246927468 wait complete. 2024-04-25T10:04:21.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 Processor -- start 2024-04-25T10:04:21.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- start start 2024-04-25T10:04:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23415ee00 0x7fd23414fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 0x7fd23414ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23406c3e0 con 0x7fd234099a60 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23406c260 con 0x7fd2341616a0 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd23b600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23416b210 con 0x7fd23415ee00 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41410/0 (socket says 172.21.15.18:41410) 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 -- 172.21.15.18:0/1663559765 learned_addr learned my addr 172.21.15.18:0/1663559765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd22be00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23415ee00 0x7fd23414fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd239600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 0x7fd23414ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 -- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23415ee00 msgr2=0x7fd23414fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23415ee00 0x7fd23414fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 -- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 msgr2=0x7fd23414ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 0x7fd23414ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 -- 172.21.15.18:0/1663559765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2341603d0 con 0x7fd234099a60 2024-04-25T10:04:21.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd239600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 0x7fd23414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.261+0000 7fd238c00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d800 tx=0x7fd22400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224018020 con 0x7fd234099a60 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240096c0 con 0x7fd234099a60 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2341606b0 con 0x7fd234099a60 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224009ab0 con 0x7fd234099a60 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23414ff60 con 0x7fd234099a60 2024-04-25T10:04:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd234160b60 con 0x7fd234099a60 2024-04-25T10:04:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd22401b020 con 0x7fd234099a60 2024-04-25T10:04:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd224085770 con 0x7fd234099a60 2024-04-25T10:04:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.265+0000 7fd22be00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.269+0000 7fd22be00640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0ae000 tx=0x7fd21c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.269+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd224022020 con 0x7fd234099a60 2024-04-25T10:04:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd2340745d0 con 0x7fd234099a60 2024-04-25T10:04:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd231600640 1 -- 172.21.15.18:0/1663559765 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd2240564d0 con 0x7fd234099a60 2024-04-25T10:04:21.477 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:21.477 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:04:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 msgr2=0x7fd210069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd21c0ae000 tx=0x7fd21c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 msgr2=0x7fd23415d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd22400d800 tx=0x7fd22400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 shutdown_connections 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2341616a0 0x7fd23414ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23415ee00 0x7fd23414fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 --2- 172.21.15.18:0/1663559765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd234099a60 0x7fd23415d020 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 >> 172.21.15.18:0/1663559765 conn(0x7fd2340d17a0 msgr2=0x7fd2341513e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 shutdown_connections 2024-04-25T10:04:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.469+0000 7fd23b600640 1 -- 172.21.15.18:0/1663559765 wait complete. 2024-04-25T10:04:21.498 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T10:04:21.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 Processor -- start 2024-04-25T10:04:21.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 -- start start 2024-04-25T10:04:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f508015ee00 0x7f508006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508006c650 con 0x7f5080099a60 2024-04-25T10:04:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508006c930 con 0x7f50800cff30 2024-04-25T10:04:21.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.629+0000 7f5085800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508006cc10 con 0x7f508015ee00 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f507ea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5080099a60 0x7f5080099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60544/0 (socket says 172.21.15.18:60544) 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f507ea00640 1 -- 172.21.15.18:0/4195270317 learned_addr learned my addr 172.21.15.18:0/4195270317 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f5076000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f508015ee00 0x7f508006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f5076000640 1 -- 172.21.15.18:0/4195270317 >> v1:172.21.15.167:6789/0 conn(0x7f50800cff30 legacy=0x7f50800d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f5076000640 1 -- 172.21.15.18:0/4195270317 >> v1:172.21.15.18:6789/0 conn(0x7f5080099a60 legacy=0x7f5080099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f5076000640 1 -- 172.21.15.18:0/4195270317 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508006cef0 con 0x7f508015ee00 2024-04-25T10:04:21.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f5076000640 1 --2- 172.21.15.18:0/4195270317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508006bd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50680097c0 tx=0x7f506801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc19ff6b2d3aa5b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f507e000640 1 -- 172.21.15.18:0/4195270317 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680b0070 con 0x7f508015ee00 2024-04-25T10:04:21.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f507e000640 1 -- 172.21.15.18:0/4195270317 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680ab600 con 0x7f508015ee00 2024-04-25T10:04:21.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.633+0000 7f507e000640 1 -- 172.21.15.18:0/4195270317 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680ab9d0 con 0x7f508015ee00 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- 172.21.15.18:0/4195270317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 msgr2=0x7f508006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 --2- 172.21.15.18:0/4195270317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508006bd20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f50680097c0 tx=0x7f506801c330 comp rx=0 tx=0).stop 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- 172.21.15.18:0/4195270317 shutdown_connections 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 --2- 172.21.15.18:0/4195270317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508006bd20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- 172.21.15.18:0/4195270317 >> 172.21.15.18:0/4195270317 conn(0x7f50800d17a0 msgr2=0x7f50800d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- 172.21.15.18:0/4195270317 shutdown_connections 2024-04-25T10:04:21.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- 172.21.15.18:0/4195270317 wait complete. 2024-04-25T10:04:21.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 Processor -- start 2024-04-25T10:04:21.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- start start 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5080099a60 0x7f5080154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50800cff30 0x7f508015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508016bb90 con 0x7f508015ee00 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508016ba10 con 0x7f5080099a60 2024-04-25T10:04:21.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5085800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508016bd10 con 0x7f50800cff30 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36742/0 (socket says 172.21.15.18:36742) 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 -- 172.21.15.18:0/1132156828 learned_addr learned my addr 172.21.15.18:0/1132156828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507ea00640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5080099a60 0x7f5080154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f5076000640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50800cff30 0x7f508015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 -- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50800cff30 msgr2=0x7f508015c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50800cff30 0x7f508015c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 -- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5080099a60 msgr2=0x7f5080154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5080099a60 0x7f5080154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.637+0000 7f507f400640 1 -- 172.21.15.18:0/1132156828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800c5840 con 0x7f508015ee00 2024-04-25T10:04:21.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f507f400640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f507800c430 tx=0x7f507800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078005220 con 0x7f508015ee00 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50780053c0 con 0x7f508015ee00 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078007270 con 0x7f508015ee00 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50800c5b20 con 0x7f508015ee00 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50800c60e0 con 0x7f508015ee00 2024-04-25T10:04:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50800745d0 con 0x7f508015ee00 2024-04-25T10:04:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5078019020 con 0x7f508015ee00 2024-04-25T10:04:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 0x7f505c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5078084640 con 0x7f508015ee00 2024-04-25T10:04:21.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.641+0000 7f507ea00640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 0x7f505c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.645+0000 7f507ea00640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 0x7f505c069420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50700012f0 tx=0x7f50700018c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.645+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5078054c20 con 0x7f508015ee00 2024-04-25T10:04:21.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.809+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f508009ae10 con 0x7f508015ee00 2024-04-25T10:04:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.809+0000 7f5077400640 1 -- 172.21.15.18:0/1132156828 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f5078058cc0 con 0x7f508015ee00 2024-04-25T10:04:21.819 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:21.819 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 msgr2=0x7f505c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 0x7f505c069420 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f50700012f0 tx=0x7f50700018c0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 msgr2=0x7f508015cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f507800c430 tx=0x7f507800c8f0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 shutdown_connections 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f508015ee00 0x7f508015cb40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f505c066f60 0x7f505c069420 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f50800cff30 0x7f508015c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 --2- 172.21.15.18:0/1132156828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5080099a60 0x7f5080154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 >> 172.21.15.18:0/1132156828 conn(0x7f50800d17a0 msgr2=0x7f50800cc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 shutdown_connections 2024-04-25T10:04:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.813+0000 7f5085800640 1 -- 172.21.15.18:0/1132156828 wait complete. 2024-04-25T10:04:21.840 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:21.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.973+0000 7f240b000640 1 Processor -- start 2024-04-25T10:04:21.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 -- start start 2024-04-25T10:04:21.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f240415f440 0x7f240406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240415fc00 con 0x7f240406e010 2024-04-25T10:04:21.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f240406d640 con 0x7f240415f440 2024-04-25T10:04:21.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f240b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240415fee0 con 0x7f2404159320 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f2403e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f2403e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:52864/0 (socket says 172.21.15.18:52864) 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f2403e00640 1 -- 172.21.15.18:0/4026209618 learned_addr learned my addr 172.21.15.18:0/4026209618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f23fb400640 1 --2- 172.21.15.18:0/4026209618 >> v2:172.21.15.167:3300/0 conn(0x7f240415f440 0x7f240406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f23fb400640 1 -- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 msgr2=0x7f240415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f23fb400640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f23fb400640 1 -- 172.21.15.18:0/4026209618 >> v1:172.21.15.167:6789/0 conn(0x7f240406e010 legacy=0x7f240406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f23fb400640 1 -- 172.21.15.18:0/4026209618 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24041601c0 con 0x7f240415f440 2024-04-25T10:04:21.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.977+0000 7f2403e00640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:21.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f23fb400640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f240415f440 0x7f240406dad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0097c0 tx=0x7f23ec01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8572dcaeda236a5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f2403400640 1 -- 172.21.15.18:0/4026209618 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0ab600 con 0x7f240415f440 2024-04-25T10:04:21.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f2403400640 1 -- 172.21.15.18:0/4026209618 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ec0b0070 con 0x7f240415f440 2024-04-25T10:04:21.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f2403400640 1 -- 172.21.15.18:0/4026209618 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ec0ab9c0 con 0x7f240415f440 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 -- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f240415f440 msgr2=0x7f240406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f240415f440 0x7f240406dad0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0097c0 tx=0x7f23ec01c3e0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 -- 172.21.15.18:0/4026209618 shutdown_connections 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f240415f440 0x7f240406dad0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 --2- 172.21.15.18:0/4026209618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2404159320 0x7f240415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 -- 172.21.15.18:0/4026209618 >> 172.21.15.18:0/4026209618 conn(0x7f2404067080 msgr2=0x7f240406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 -- 172.21.15.18:0/4026209618 shutdown_connections 2024-04-25T10:04:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 -- 172.21.15.18:0/4026209618 wait complete. 2024-04-25T10:04:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.981+0000 7f240b000640 1 Processor -- start 2024-04-25T10:04:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- start start 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2404159320 0x7f240413de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f240415f440 0x7f24041409c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404071c00 con 0x7f240406e010 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404071a80 con 0x7f2404159320 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240406ebb0 con 0x7f240415f440 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36758/0 (socket says 172.21.15.18:36758) 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 -- 172.21.15.18:0/2838915632 learned_addr learned my addr 172.21.15.18:0/2838915632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2409000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f240415f440 0x7f24041409c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f23fb400640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2404159320 0x7f240413de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 -- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f240415f440 msgr2=0x7f24041409c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f240415f440 0x7f24041409c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 -- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2404159320 msgr2=0x7f240413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2404159320 0x7f240413de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 -- 172.21.15.18:0/2838915632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240415ea10 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2403e00640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009e80 tx=0x7f23f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f400ce60 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f4019070 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f4014680 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f240413e350 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f240413f3a0 con 0x7f240406e010 2024-04-25T10:04:21.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.985+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24040745d0 con 0x7f240406e010 2024-04-25T10:04:21.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.989+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f23f4012050 con 0x7f240406e010 2024-04-25T10:04:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.989+0000 7f2400c00640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 0x7f23e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.989+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f23f40856c0 con 0x7f240406e010 2024-04-25T10:04:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.989+0000 7f23fb400640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 0x7f23e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.989+0000 7f23fb400640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 0x7f23e0069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0af000 tx=0x7f23ec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:21.993+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f23f4010040 con 0x7f240406e010 2024-04-25T10:04:22.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.157+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f240415b7b0 con 0x7f240406e010 2024-04-25T10:04:22.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.157+0000 7f2400c00640 1 -- 172.21.15.18:0/2838915632 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23f4055d30 con 0x7f240406e010 2024-04-25T10:04:22.168 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 msgr2=0x7f23e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 0x7f23e0069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23ec0af000 tx=0x7f23ec0a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 msgr2=0x7f2404142270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f23f4009e80 tx=0x7f23f400c490 comp rx=0 tx=0).stop 2024-04-25T10:04:22.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 shutdown_connections 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f23e0066f60 0x7f23e0069420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f240415f440 0x7f24041409c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2404159320 0x7f240413de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 --2- 172.21.15.18:0/2838915632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f240406e010 0x7f2404142270 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 >> 172.21.15.18:0/2838915632 conn(0x7f2404067080 msgr2=0x7f240406e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 shutdown_connections 2024-04-25T10:04:22.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.161+0000 7f240b000640 1 -- 172.21.15.18:0/2838915632 wait complete. 2024-04-25T10:04:22.189 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.321+0000 7fbee0c00640 1 Processor -- start 2024-04-25T10:04:22.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.321+0000 7fbee0c00640 1 -- start start 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbee0c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbedc15f860 0x7fbedc0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbee0c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc09ade0 con 0x7fbedc15f3b0 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbee0c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc099a60 con 0x7fbedc15b9e0 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbee0c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc099d40 con 0x7fbedc15f860 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbedbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbedc15f860 0x7fbedc0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbed2a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbedc15f3b0 0x7fbedc0cc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60558/0 (socket says 172.21.15.18:60558) 2024-04-25T10:04:22.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbed2a00640 1 -- 172.21.15.18:0/591736694 learned_addr learned my addr 172.21.15.18:0/591736694 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbedbe00640 1 -- 172.21.15.18:0/591736694 >> v1:172.21.15.167:6789/0 conn(0x7fbedc15b9e0 legacy=0x7fbedc0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbedbe00640 1 -- 172.21.15.18:0/591736694 >> v1:172.21.15.18:6789/0 conn(0x7fbedc15f3b0 legacy=0x7fbedc0cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.325+0000 7fbedbe00640 1 -- 172.21.15.18:0/591736694 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc09a020 con 0x7fbedc15f860 2024-04-25T10:04:22.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedbe00640 1 --2- 172.21.15.18:0/591736694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15f860 0x7fbedc0cc760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8487be65c97c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedaa00640 1 -- 172.21.15.18:0/591736694 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40a7070 con 0x7fbedc15f860 2024-04-25T10:04:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedaa00640 1 -- 172.21.15.18:0/591736694 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed40b0070 con 0x7fbedc15f860 2024-04-25T10:04:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedaa00640 1 -- 172.21.15.18:0/591736694 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40ab890 con 0x7fbedc15f860 2024-04-25T10:04:22.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- 172.21.15.18:0/591736694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15f860 msgr2=0x7fbedc0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 --2- 172.21.15.18:0/591736694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15f860 0x7fbedc0cc760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401c470 comp rx=0 tx=0).stop 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- 172.21.15.18:0/591736694 shutdown_connections 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 --2- 172.21.15.18:0/591736694 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15f860 0x7fbedc0cc760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- 172.21.15.18:0/591736694 >> 172.21.15.18:0/591736694 conn(0x7fbedc0b3030 msgr2=0x7fbedc0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- 172.21.15.18:0/591736694 shutdown_connections 2024-04-25T10:04:22.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- 172.21.15.18:0/591736694 wait complete. 2024-04-25T10:04:22.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 Processor -- start 2024-04-25T10:04:22.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- start start 2024-04-25T10:04:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbedc15f3b0 0x7fbedc0b6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc15f860 0x7fbedc153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0d0250 con 0x7fbedc15b9e0 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc15fc40 con 0x7fbedc15f860 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbee0c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0d03d0 con 0x7fbedc15f3b0 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36764/0 (socket says 172.21.15.18:36764) 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.329+0000 7fbedb400640 1 -- 172.21.15.18:0/2024830118 learned_addr learned my addr 172.21.15.18:0/2024830118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed2a00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbedc15f3b0 0x7fbedc0b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedbe00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc15f860 0x7fbedc153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 -- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbedc15f3b0 msgr2=0x7fbedc0b6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbedc15f3b0 0x7fbedc0b6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 -- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc15f860 msgr2=0x7fbedc153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc15f860 0x7fbedc153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 -- 172.21.15.18:0/2024830118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0cb460 con 0x7fbedc15b9e0 2024-04-25T10:04:22.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbedb400640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c790 tx=0x7fbecc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc016020 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc006d60 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0b5770 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc003bc0 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0b5d30 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc0745d0 con 0x7fbedc15b9e0 2024-04-25T10:04:22.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbecc00a7f0 con 0x7fbedc15b9e0 2024-04-25T10:04:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 0x7fbeb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.333+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbecc084ee0 con 0x7fbedc15b9e0 2024-04-25T10:04:22.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.337+0000 7fbed2a00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 0x7fbeb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.337+0000 7fbed2a00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 0x7fbeb8069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0700f0 tx=0x7fbec4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.337+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbecc020020 con 0x7fbedc15b9e0 2024-04-25T10:04:22.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbedc0d1320 con 0x7fbedc15b9e0 2024-04-25T10:04:22.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbed3e00640 1 -- 172.21.15.18:0/2024830118 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbedc0cb460 con 0x7fbedc15b9e0 2024-04-25T10:04:22.513 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:22.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 msgr2=0x7fbeb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 0x7fbeb8069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0700f0 tx=0x7fbec4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:22.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 msgr2=0x7fbedc0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00c790 tx=0x7fbecc00cc50 comp rx=0 tx=0).stop 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 shutdown_connections 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbedc15f860 0x7fbedc153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbeb8066f60 0x7fbeb8069420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbedc15f3b0 0x7fbedc0b6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 --2- 172.21.15.18:0/2024830118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbedc15b9e0 0x7fbedc0caf20 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 >> 172.21.15.18:0/2024830118 conn(0x7fbedc0b3030 msgr2=0x7fbedc0b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 shutdown_connections 2024-04-25T10:04:22.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.505+0000 7fbee0c00640 1 -- 172.21.15.18:0/2024830118 wait complete. 2024-04-25T10:04:22.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:22.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 Processor -- start 2024-04-25T10:04:22.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 -- start start 2024-04-25T10:04:22.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a015b910 0x7fc3a00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3a00cd370 0x7fc3a0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a00d02a0 con 0x7fc3a015b910 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a00cc350 con 0x7fc3a00cd370 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc3a5e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a00cc630 con 0x7fc3a00cf3c0 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a015b910 0x7fc3a00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a015b910 0x7fc3a00cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36770/0 (socket says 172.21.15.18:36770) 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 -- 172.21.15.18:0/3985211290 learned_addr learned my addr 172.21.15.18:0/3985211290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc396000640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39f400640 1 --2- 172.21.15.18:0/3985211290 >> v2:172.21.15.167:3300/0 conn(0x7fc3a00cd370 0x7fc3a0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 -- 172.21.15.18:0/3985211290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 msgr2=0x7fc3a00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 -- 172.21.15.18:0/3985211290 >> v2:172.21.15.167:3300/0 conn(0x7fc3a00cd370 msgr2=0x7fc3a0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:22.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 --2- 172.21.15.18:0/3985211290 >> v2:172.21.15.167:3300/0 conn(0x7fc3a00cd370 0x7fc3a0099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.669+0000 7fc39ea00640 1 -- 172.21.15.18:0/3985211290 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00cc910 con 0x7fc3a015b910 2024-04-25T10:04:22.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc39ea00640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a015b910 0x7fc3a00cf9a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0072fa0 tx=0x7fc39001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa1f5bbc59414b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc39e000640 1 -- 172.21.15.18:0/3985211290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900ab5f0 con 0x7fc3a015b910 2024-04-25T10:04:22.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc39e000640 1 -- 172.21.15.18:0/3985211290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900b0070 con 0x7fc3a015b910 2024-04-25T10:04:22.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc39e000640 1 -- 172.21.15.18:0/3985211290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900ab9b0 con 0x7fc3a015b910 2024-04-25T10:04:22.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 -- 172.21.15.18:0/3985211290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a015b910 msgr2=0x7fc3a00cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a015b910 0x7fc3a00cf9a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0072fa0 tx=0x7fc39001c520 comp rx=0 tx=0).stop 2024-04-25T10:04:22.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 -- 172.21.15.18:0/3985211290 shutdown_connections 2024-04-25T10:04:22.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/3985211290 >> v2:172.21.15.167:3300/0 conn(0x7fc3a00cd370 0x7fc3a0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/3985211290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a015b910 0x7fc3a00cf9a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 -- 172.21.15.18:0/3985211290 >> 172.21.15.18:0/3985211290 conn(0x7fc3a00b3200 msgr2=0x7fc3a00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 -- 172.21.15.18:0/3985211290 shutdown_connections 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.673+0000 7fc3a5e00640 1 -- 172.21.15.18:0/3985211290 wait complete. 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 Processor -- start 2024-04-25T10:04:22.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- start start 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3a015b910 0x7fc3a015a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015f660 con 0x7fc3a00cd370 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a009a3b0 con 0x7fc3a015b910 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a015f7e0 con 0x7fc3a00cf3c0 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36772/0 (socket says 172.21.15.18:36772) 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 -- 172.21.15.18:0/1087693476 learned_addr learned my addr 172.21.15.18:0/1087693476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:22.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc396000640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39f400640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3a015b910 0x7fc3a015a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 -- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 msgr2=0x7fc3a00b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 -- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3a015b910 msgr2=0x7fc3a015a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3a015b910 0x7fc3a015a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 -- 172.21.15.18:0/1087693476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a00b4d40 con 0x7fc3a00cd370 2024-04-25T10:04:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc39ea00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc39001abd0 tx=0x7fc39001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900be3f0 con 0x7fc3a00cd370 2024-04-25T10:04:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900be590 con 0x7fc3a00cd370 2024-04-25T10:04:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3900be980 con 0x7fc3a00cd370 2024-04-25T10:04:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a00b5020 con 0x7fc3a00cd370 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.677+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a015c200 con 0x7fc3a00cd370 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a00745d0 con 0x7fc3a00cd370 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc3900b43f0 con 0x7fc3a00cd370 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc397e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 0x7fc37c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fc39011ef40 con 0x7fc3a00cd370 2024-04-25T10:04:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc396000640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 0x7fc37c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.681+0000 7fc396000640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 0x7fc37c069450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3a015f4e0 tx=0x7fc388009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.685+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc390016110 con 0x7fc3a00cd370 2024-04-25T10:04:22.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.845+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3a00cdcd0 con 0x7fc3a00cd370 2024-04-25T10:04:22.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc397e00640 1 -- 172.21.15.18:0/1087693476 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3900ef640 con 0x7fc3a00cd370 2024-04-25T10:04:22.857 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 msgr2=0x7fc37c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 0x7fc37c069450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3a015f4e0 tx=0x7fc388009190 comp rx=0 tx=0).stop 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 msgr2=0x7fc3a0156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc39001abd0 tx=0x7fc39001ad60 comp rx=0 tx=0).stop 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 shutdown_connections 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3a015b910 0x7fc3a015a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc37c066f90 0x7fc37c069450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3a00cf3c0 0x7fc3a00b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 --2- 172.21.15.18:0/1087693476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a00cd370 0x7fc3a0156bf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 >> 172.21.15.18:0/1087693476 conn(0x7fc3a00b3200 msgr2=0x7fc3a0159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 shutdown_connections 2024-04-25T10:04:22.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:22.849+0000 7fc3a5e00640 1 -- 172.21.15.18:0/1087693476 wait complete. 2024-04-25T10:04:22.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:23.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.013+0000 7f5dd6a00640 1 Processor -- start 2024-04-25T10:04:23.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.013+0000 7f5dd6a00640 1 -- start start 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5dd006cb10 0x7f5dd00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd0099dd0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd009a0b0 con 0x7f5dd006c730 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd009a9e0 con 0x7f5dd006cb10 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd4c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5dd006cb10 0x7f5dd00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5dd00cfcc0 0x7f5dd00d0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60568/0 (socket says 172.21.15.18:60568) 2024-04-25T10:04:23.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd6000640 1 -- 172.21.15.18:0/3822516692 learned_addr learned my addr 172.21.15.18:0/3822516692 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:23.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd4c00640 1 -- 172.21.15.18:0/3822516692 >> v1:172.21.15.167:6789/0 conn(0x7f5dd006c730 legacy=0x7f5dd015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd4c00640 1 -- 172.21.15.18:0/3822516692 >> v1:172.21.15.18:6789/0 conn(0x7f5dd00cfcc0 legacy=0x7f5dd00d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.017+0000 7f5dd4c00640 1 -- 172.21.15.18:0/3822516692 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd009a390 con 0x7f5dd006cb10 2024-04-25T10:04:23.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd4c00640 1 --2- 172.21.15.18:0/3822516692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd006cb10 0x7f5dd00cf780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0097c0 tx=0x7f5dbc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afca73f16a04161 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dcfe00640 1 -- 172.21.15.18:0/3822516692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0b0070 con 0x7f5dd006cb10 2024-04-25T10:04:23.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dcfe00640 1 -- 172.21.15.18:0/3822516692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dbc004230 con 0x7f5dd006cb10 2024-04-25T10:04:23.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dcfe00640 1 -- 172.21.15.18:0/3822516692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc003620 con 0x7f5dd006cb10 2024-04-25T10:04:23.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- 172.21.15.18:0/3822516692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd006cb10 msgr2=0x7f5dd00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/3822516692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd006cb10 0x7f5dd00cf780 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc0097c0 tx=0x7f5dbc01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- 172.21.15.18:0/3822516692 shutdown_connections 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/3822516692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd006cb10 0x7f5dd00cf780 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- 172.21.15.18:0/3822516692 >> 172.21.15.18:0/3822516692 conn(0x7f5dd00b3030 msgr2=0x7f5dd00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- 172.21.15.18:0/3822516692 shutdown_connections 2024-04-25T10:04:23.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- 172.21.15.18:0/3822516692 wait complete. 2024-04-25T10:04:23.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 Processor -- start 2024-04-25T10:04:23.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- start start 2024-04-25T10:04:23.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 0x7f5dd00c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 0x7f5dd00b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00b08a0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00b0720 con 0x7f5dd006cb10 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.021+0000 7f5dd6a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd006cf50 con 0x7f5dd006c730 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36778/0 (socket says 172.21.15.18:36778) 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 -- 172.21.15.18:0/784508719 learned_addr learned my addr 172.21.15.18:0/784508719 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd4c00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 0x7f5dd00b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd5600640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 0x7f5dd00c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 -- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 msgr2=0x7f5dd00c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 0x7f5dd00c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 -- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 msgr2=0x7f5dd00b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 0x7f5dd00b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 -- 172.21.15.18:0/784508719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00b69b0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd4c00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 0x7f5dd00b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd5600640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 0x7f5dd00c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6000640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800cbc0 tx=0x7f5dc800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8017070 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc800ad40 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc8012600 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd0155580 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd009bf60 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0155aa0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.025+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5dc801a070 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.029+0000 7f5dcd600640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 0x7f5db0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.029+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5dc8084fe0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.029+0000 7f5dd5600640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 0x7f5db0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.029+0000 7f5dd5600640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 0x7f5db0069470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000f70 tx=0x7f5dc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.033+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5dc80556a0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.193+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5dd00745d0 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.193+0000 7f5dcd600640 1 -- 172.21.15.18:0/784508719 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5dc8059740 con 0x7f5dd00cfcc0 2024-04-25T10:04:23.204 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:23.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 msgr2=0x7f5db0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 0x7f5db0069470 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4000f70 tx=0x7f5dc4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 msgr2=0x7f5dd00b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5dc800cbc0 tx=0x7f5dc800a430 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 shutdown_connections 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd00cfcc0 0x7f5dd00b58f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5dd006cb10 0x7f5dd00b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5db0066fb0 0x7f5db0069470 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 --2- 172.21.15.18:0/784508719 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5dd006c730 0x7f5dd00c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 >> 172.21.15.18:0/784508719 conn(0x7f5dd00b3030 msgr2=0x7f5dd00700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 shutdown_connections 2024-04-25T10:04:23.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.197+0000 7f5dd6a00640 1 -- 172.21.15.18:0/784508719 wait complete. 2024-04-25T10:04:23.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:23.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 Processor -- start 2024-04-25T10:04:23.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 -- start start 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda440cef30 0x7fda4406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 0x7fda440b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4415ac60 con 0x7fda44144140 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4406ed50 con 0x7fda440cef30 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda440cf3e0 con 0x7fda4406e900 2024-04-25T10:04:23.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda48e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda440cef30 0x7fda4406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda49800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda44144140 0x7fda440ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60570/0 (socket says 172.21.15.18:60570) 2024-04-25T10:04:23.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda49800640 1 -- 172.21.15.18:0/217025927 learned_addr learned my addr 172.21.15.18:0/217025927 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:23.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda48e00640 1 -- 172.21.15.18:0/217025927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 msgr2=0x7fda440b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4a200640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 0x7fda440b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda43e00640 1 -- 172.21.15.18:0/217025927 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309232987 0 0) 0x7fda4415ac60 con 0x7fda44144140 2024-04-25T10:04:23.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda48e00640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 0x7fda440b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda48e00640 1 -- 172.21.15.18:0/217025927 >> v1:172.21.15.18:6789/0 conn(0x7fda44144140 legacy=0x7fda440ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda48e00640 1 -- 172.21.15.18:0/217025927 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4415af20 con 0x7fda440cef30 2024-04-25T10:04:23.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.357+0000 7fda4a200640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 0x7fda440b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda48e00640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda440cef30 0x7fda4406e3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda300097c0 tx=0x7fda3001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6929e1d454ac7765 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda43e00640 1 -- 172.21.15.18:0/217025927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300b0070 con 0x7fda440cef30 2024-04-25T10:04:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda43e00640 1 -- 172.21.15.18:0/217025927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300ab600 con 0x7fda440cef30 2024-04-25T10:04:23.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda43e00640 1 -- 172.21.15.18:0/217025927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300ab9d0 con 0x7fda440cef30 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 -- 172.21.15.18:0/217025927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda440cef30 msgr2=0x7fda4406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda440cef30 0x7fda4406e3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fda300097c0 tx=0x7fda3001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 -- 172.21.15.18:0/217025927 shutdown_connections 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda4406e900 0x7fda440b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 --2- 172.21.15.18:0/217025927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda440cef30 0x7fda4406e3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 -- 172.21.15.18:0/217025927 >> 172.21.15.18:0/217025927 conn(0x7fda44066fa0 msgr2=0x7fda4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 -- 172.21.15.18:0/217025927 shutdown_connections 2024-04-25T10:04:23.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.361+0000 7fda4c200640 1 -- 172.21.15.18:0/217025927 wait complete. 2024-04-25T10:04:23.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 Processor -- start 2024-04-25T10:04:23.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- start start 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 0x7fda440b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda44144140 0x7fda44137420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415ba00 con 0x7fda4406e900 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44144520 con 0x7fda440cef30 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4415bb80 con 0x7fda44144140 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36800/0 (socket says 172.21.15.18:36800) 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 -- 172.21.15.18:0/3232311990 learned_addr learned my addr 172.21.15.18:0/3232311990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4a200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda44144140 0x7fda44137420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda48e00640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 0x7fda440b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 -- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda44144140 msgr2=0x7fda44137420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda44144140 0x7fda44137420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 -- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 msgr2=0x7fda440b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 0x7fda440b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 -- 172.21.15.18:0/3232311990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440b3f90 con 0x7fda4406e900 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda48e00640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 0x7fda440b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda49800640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c480 tx=0x7fda3800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38018070 con 0x7fda4406e900 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda38007500 con 0x7fda4406e900 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda441524c0 con 0x7fda4406e900 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda38004a30 con 0x7fda4406e900 2024-04-25T10:04:23.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.365+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda44152d60 con 0x7fda4406e900 2024-04-25T10:04:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda441528b0 con 0x7fda4406e900 2024-04-25T10:04:23.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda3801b070 con 0x7fda4406e900 2024-04-25T10:04:23.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda41600640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fda38084710 con 0x7fda4406e900 2024-04-25T10:04:23.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda48e00640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.369+0000 7fda48e00640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 0x7fda24069450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda300ad000 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.373+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda380553d0 con 0x7fda4406e900 2024-04-25T10:04:23.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.573+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda440745d0 con 0x7fda4406e900 2024-04-25T10:04:23.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.573+0000 7fda41600640 1 -- 172.21.15.18:0/3232311990 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fda3805b0d0 con 0x7fda4406e900 2024-04-25T10:04:23.583 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:23.583 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 msgr2=0x7fda24069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 0x7fda24069450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fda300ad000 tx=0x7fda30008040 comp rx=0 tx=0).stop 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 msgr2=0x7fda440b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fda3800c480 tx=0x7fda3800c940 comp rx=0 tx=0).stop 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 shutdown_connections 2024-04-25T10:04:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda24066f90 0x7fda24069450 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda44144140 0x7fda44137420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda440cef30 0x7fda440b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 --2- 172.21.15.18:0/3232311990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda4406e900 0x7fda440b47d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 >> 172.21.15.18:0/3232311990 conn(0x7fda44066fa0 msgr2=0x7fda440ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 shutdown_connections 2024-04-25T10:04:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.577+0000 7fda4c200640 1 -- 172.21.15.18:0/3232311990 wait complete. 2024-04-25T10:04:23.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 Processor -- start 2024-04-25T10:04:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 -- start start 2024-04-25T10:04:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36900af840 0x7f36900b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36900aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900b23e0 con 0x7f3690146740 2024-04-25T10:04:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369006d9c0 con 0x7f36900af840 2024-04-25T10:04:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3695400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3690146b20 con 0x7f36900b1f20 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36900af840 0x7f36900b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36900af840 0x7f36900b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36806/0 (socket says 172.21.15.18:36806) 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 -- 172.21.15.18:0/235938354 learned_addr learned my addr 172.21.15.18:0/235938354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f368f200640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36900aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 -- 172.21.15.18:0/235938354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 msgr2=0x7f36900aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36900aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 -- 172.21.15.18:0/235938354 >> v1:172.21.15.167:6789/0 conn(0x7f3690146740 legacy=0x7f369006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f3685e00640 1 -- 172.21.15.18:0/235938354 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36900acb80 con 0x7f36900af840 2024-04-25T10:04:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.737+0000 7f368f200640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36900aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3685e00640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900af840 0x7f36900b19e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3678009870 tx=0x7f367801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f733af4567a50a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f368de00640 1 -- 172.21.15.18:0/235938354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780ab640 con 0x7f36900af840 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f368de00640 1 -- 172.21.15.18:0/235938354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36780b0070 con 0x7f36900af840 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f368de00640 1 -- 172.21.15.18:0/235938354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36780aba00 con 0x7f36900af840 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 -- 172.21.15.18:0/235938354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900af840 msgr2=0x7f36900b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900af840 0x7f36900b19e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3678009870 tx=0x7f367801c530 comp rx=0 tx=0).stop 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 -- 172.21.15.18:0/235938354 shutdown_connections 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36900aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 --2- 172.21.15.18:0/235938354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36900af840 0x7f36900b19e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 -- 172.21.15.18:0/235938354 >> 172.21.15.18:0/235938354 conn(0x7f3690066fa0 msgr2=0x7f369006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 -- 172.21.15.18:0/235938354 shutdown_connections 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.741+0000 7f3695400640 1 -- 172.21.15.18:0/235938354 wait complete. 2024-04-25T10:04:23.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 Processor -- start 2024-04-25T10:04:23.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- start start 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36900af840 0x7f369015da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 0x7f369015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900ae2d0 con 0x7f3690146740 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900ae150 con 0x7f36900af840 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369016a920 con 0x7f36900b1f20 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 0x7f369015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3685e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3685e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:52934/0 (socket says 172.21.15.18:52934) 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3685e00640 1 -- 172.21.15.18:0/3084393375 learned_addr learned my addr 172.21.15.18:0/3084393375 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368e800640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36900af840 0x7f369015da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 -- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 msgr2=0x7f36901409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 -- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36900af840 msgr2=0x7f369015da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36900af840 0x7f369015da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 -- 172.21.15.18:0/3084393375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690141500 con 0x7f3690146740 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3685e00640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f368f200640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 0x7f369015fa60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3688007e30 tx=0x7f368800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368801a070 con 0x7f3690146740 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688015400 con 0x7f3690146740 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36901417a0 con 0x7f3690146740 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688015810 con 0x7f3690146740 2024-04-25T10:04:23.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3690141d60 con 0x7f3690146740 2024-04-25T10:04:23.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.745+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36900745d0 con 0x7f3690146740 2024-04-25T10:04:23.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.749+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f368801d070 con 0x7f3690146740 2024-04-25T10:04:23.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.749+0000 7f3687400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 0x7f366c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:23.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.749+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3688085510 con 0x7f3690146740 2024-04-25T10:04:23.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.749+0000 7f368e800640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 0x7f366c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:23.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.749+0000 7f368e800640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 0x7f366c069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3690140200 tx=0x7f3680009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:23.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.753+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3688010070 con 0x7f3690146740 2024-04-25T10:04:23.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.917+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f369006b870 con 0x7f3690146740 2024-04-25T10:04:23.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3687400640 1 -- 172.21.15.18:0/3084393375 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f3688055b80 con 0x7f3690146740 2024-04-25T10:04:23.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:23.929 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:23.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 msgr2=0x7f366c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 0x7f366c069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3690140200 tx=0x7f3680009040 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 msgr2=0x7f369015fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 0x7f369015fa60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3688007e30 tx=0x7f368800d4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 shutdown_connections 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3690146740 0x7f369015fa60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f366c066f60 0x7f366c069420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f36900b1f20 0x7f36901409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 --2- 172.21.15.18:0/3084393375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f36900af840 0x7f369015da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 >> 172.21.15.18:0/3084393375 conn(0x7f3690066fa0 msgr2=0x7f36900736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 shutdown_connections 2024-04-25T10:04:23.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:23.921+0000 7f3695400640 1 -- 172.21.15.18:0/3084393375 wait complete. 2024-04-25T10:04:23.950 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:23.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 Processor -- start 2024-04-25T10:04:24.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 -- start start 2024-04-25T10:04:24.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f90159320 0x7f3f9015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 0x7f3f9006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006e010 0x7f3f9006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9006d640 con 0x7f3f90159320 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f9015fc00 con 0x7f3f9015f440 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f95000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9015fee0 con 0x7f3f9006e010 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f90159320 0x7f3f9015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f90159320 0x7f3f9015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36826/0 (socket says 172.21.15.18:36826) 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 -- 172.21.15.18:0/1520302190 learned_addr learned my addr 172.21.15.18:0/1520302190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8e800640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006e010 0x7f3f9006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f85400640 1 --2- 172.21.15.18:0/1520302190 >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 0x7f3f9006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 -- 172.21.15.18:0/1520302190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006e010 msgr2=0x7f3f9006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006e010 0x7f3f9006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 -- 172.21.15.18:0/1520302190 >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 msgr2=0x7f3f9006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1520302190 >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 0x7f3f9006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f8de00640 1 -- 172.21.15.18:0/1520302190 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f901601c0 con 0x7f3f90159320 2024-04-25T10:04:24.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.085+0000 7f3f85400640 1 --2- 172.21.15.18:0/1520302190 >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 0x7f3f9006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f9015c9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b4b50 tx=0x7f3f8001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48332ff3107f0a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f8d400640 1 -- 172.21.15.18:0/1520302190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800a56c0 con 0x7f3f90159320 2024-04-25T10:04:24.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f8d400640 1 -- 172.21.15.18:0/1520302190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f800a5860 con 0x7f3f90159320 2024-04-25T10:04:24.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f8d400640 1 -- 172.21.15.18:0/1520302190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800a5c30 con 0x7f3f90159320 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 -- 172.21.15.18:0/1520302190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 msgr2=0x7f3f9015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f9015c9b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3f900b4b50 tx=0x7f3f8001c930 comp rx=0 tx=0).stop 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 -- 172.21.15.18:0/1520302190 shutdown_connections 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9006e010 0x7f3f9006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 --2- 172.21.15.18:0/1520302190 >> v2:172.21.15.167:3300/0 conn(0x7f3f9015f440 0x7f3f9006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 --2- 172.21.15.18:0/1520302190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f9015c9b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 -- 172.21.15.18:0/1520302190 >> 172.21.15.18:0/1520302190 conn(0x7f3f90067080 msgr2=0x7f3f9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 -- 172.21.15.18:0/1520302190 shutdown_connections 2024-04-25T10:04:24.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.089+0000 7f3f95000640 1 -- 172.21.15.18:0/1520302190 wait complete. 2024-04-25T10:04:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 Processor -- start 2024-04-25T10:04:24.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- start start 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f9006e010 0x7f3f90149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9015f440 0x7f3f90151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900cc440 con 0x7f3f90159320 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900cc2c0 con 0x7f3f9006e010 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f900cc5c0 con 0x7f3f9015f440 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36828/0 (socket says 172.21.15.18:36828) 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 -- 172.21.15.18:0/1235088047 learned_addr learned my addr 172.21.15.18:0/1235088047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f8e800640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9015f440 0x7f3f90151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f9006e010 0x7f3f90149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 -- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9015f440 msgr2=0x7f3f90151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9015f440 0x7f3f90151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 -- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f9006e010 msgr2=0x7f3f90149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f9006e010 0x7f3f90149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 -- 172.21.15.18:0/1235088047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9014f030 con 0x7f3f90159320 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f85400640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c7f0 tx=0x7f3f7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78015070 con 0x7f3f90159320 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78007820 con 0x7f3f90159320 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78007c10 con 0x7f3f90159320 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f901535c0 con 0x7f3f90159320 2024-04-25T10:04:24.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.093+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f90153b80 con 0x7f3f90159320 2024-04-25T10:04:24.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f900b07d0 con 0x7f3f90159320 2024-04-25T10:04:24.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f78018070 con 0x7f3f90159320 2024-04-25T10:04:24.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f86a00640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 0x7f3f6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3f78085420 con 0x7f3f90159320 2024-04-25T10:04:24.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 0x7f3f6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.097+0000 7f3f8de00640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 0x7f3f6c069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f800ae000 tx=0x7f3f800a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.101+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f9014f030 con 0x7f3f90159320 2024-04-25T10:04:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f90166360 con 0x7f3f90159320 2024-04-25T10:04:24.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f86a00640 1 -- 172.21.15.18:0/1235088047 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f78055a00 con 0x7f3f90159320 2024-04-25T10:04:24.273 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:24.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 msgr2=0x7f3f6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 0x7f3f6c069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3f800ae000 tx=0x7f3f800a7070 comp rx=0 tx=0).stop 2024-04-25T10:04:24.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 msgr2=0x7f3f90152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c7f0 tx=0x7f3f7800ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 shutdown_connections 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f6c066f60 0x7f3f6c069420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f9015f440 0x7f3f90151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f90159320 0x7f3f90152b70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 --2- 172.21.15.18:0/1235088047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f9006e010 0x7f3f90149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 >> 172.21.15.18:0/1235088047 conn(0x7f3f90067080 msgr2=0x7f3f900ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 shutdown_connections 2024-04-25T10:04:24.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.265+0000 7f3f95000640 1 -- 172.21.15.18:0/1235088047 wait complete. 2024-04-25T10:04:24.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:24.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 Processor -- start 2024-04-25T10:04:24.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 -- start start 2024-04-25T10:04:24.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f421015dc60 0x7f42100d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421009a170 0x7f42100cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f421015e040 con 0x7f421006bf30 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42100cff80 con 0x7f421015dc60 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f4215000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100d0260 con 0x7f421009a170 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f421015dc60 0x7f42100d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f421015dc60 0x7f42100d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36842/0 (socket says 172.21.15.18:36842) 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 -- 172.21.15.18:0/358119662 learned_addr learned my addr 172.21.15.18:0/358119662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420e800640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421009a170 0x7f42100cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 -- 172.21.15.18:0/358119662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421009a170 msgr2=0x7f42100cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421009a170 0x7f42100cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 -- 172.21.15.18:0/358119662 >> v1:172.21.15.167:6789/0 conn(0x7f421006bf30 legacy=0x7f4210099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.429+0000 7f420de00640 1 -- 172.21.15.18:0/358119662 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100d0540 con 0x7f421015dc60 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f420de00640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421015dc60 0x7f42100d1020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4200009870 tx=0x7f420001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4759e6f9a164526 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f420ca00640 1 -- 172.21.15.18:0/358119662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000aa600 con 0x7f421015dc60 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f420ca00640 1 -- 172.21.15.18:0/358119662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000af070 con 0x7f421015dc60 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f420ca00640 1 -- 172.21.15.18:0/358119662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000aa9c0 con 0x7f421015dc60 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 -- 172.21.15.18:0/358119662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421015dc60 msgr2=0x7f42100d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421015dc60 0x7f42100d1020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4200009870 tx=0x7f420001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 -- 172.21.15.18:0/358119662 shutdown_connections 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421009a170 0x7f42100cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 --2- 172.21.15.18:0/358119662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421015dc60 0x7f42100d1020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 -- 172.21.15.18:0/358119662 >> 172.21.15.18:0/358119662 conn(0x7f42100b3200 msgr2=0x7f42100b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 -- 172.21.15.18:0/358119662 shutdown_connections 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.433+0000 7f4215000640 1 -- 172.21.15.18:0/358119662 wait complete. 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 Processor -- start 2024-04-25T10:04:24.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- start start 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 0x7f4210155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 0x7f4210155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cc6f0 con 0x7f421006bf30 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cc570 con 0x7f421009a170 2024-04-25T10:04:24.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42100cc870 con 0x7f421015dc60 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36854/0 (socket says 172.21.15.18:36854) 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 -- 172.21.15.18:0/2316438546 learned_addr learned my addr 172.21.15.18:0/2316438546 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420d400640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 0x7f4210155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 -- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 msgr2=0x7f4210155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420e800640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 0x7f4210155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 0x7f4210155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 -- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 msgr2=0x7f4210155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 0x7f4210155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 -- 172.21.15.18:0/2316438546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42100ca420 con 0x7f421006bf30 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420d400640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 0x7f4210155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420e800640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 0x7f4210155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f420de00640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f420001a0d0 tx=0x7f420001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000bd5f0 con 0x7f421006bf30 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42000bd7b0 con 0x7f421006bf30 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42000bdba0 con 0x7f421006bf30 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42100cabf0 con 0x7f421006bf30 2024-04-25T10:04:24.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42100cb1b0 con 0x7f421006bf30 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.437+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42100745d0 con 0x7f421006bf30 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.441+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f42000a9070 con 0x7f421006bf30 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.441+0000 7f4206000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 0x7f41f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.441+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f420011fc10 con 0x7f421006bf30 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.441+0000 7f420d400640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 0x7f41f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.441+0000 7f420d400640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 0x7f41f0069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0016f0 tx=0x7f41fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.445+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4200016150 con 0x7f421006bf30 2024-04-25T10:04:24.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.605+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4210155150 con 0x7f421006bf30 2024-04-25T10:04:24.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.605+0000 7f4206000640 1 -- 172.21.15.18:0/2316438546 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f42000f08d0 con 0x7f421006bf30 2024-04-25T10:04:24.615 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:24.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 msgr2=0x7f41f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 0x7f41f0069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0016f0 tx=0x7f41fc009040 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 msgr2=0x7f42100c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f420001a0d0 tx=0x7f420001ace0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 shutdown_connections 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f41f0066f60 0x7f41f0069420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f421015dc60 0x7f4210155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f421009a170 0x7f4210155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 --2- 172.21.15.18:0/2316438546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f421006bf30 0x7f42100c9ee0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 >> 172.21.15.18:0/2316438546 conn(0x7f42100b3200 msgr2=0x7f421015a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 shutdown_connections 2024-04-25T10:04:24.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.609+0000 7f4215000640 1 -- 172.21.15.18:0/2316438546 wait complete. 2024-04-25T10:04:24.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.769+0000 7f7b50600640 1 Processor -- start 2024-04-25T10:04:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.769+0000 7f7b50600640 1 -- start start 2024-04-25T10:04:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b50600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7b4815dc00 0x7f7b480af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b50600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 0x7f7b480c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b50600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b480b30d0 con 0x7f7b480d0150 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b50600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480cd860 con 0x7f7b4815dc00 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b50600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480ccf30 con 0x7f7b480c72a0 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4d200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7b480d0150 0x7f7b480c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60578/0 (socket says 172.21.15.18:60578) 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4d200640 1 -- 172.21.15.18:0/817427641 learned_addr learned my addr 172.21.15.18:0/817427641 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4e600640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 0x7f7b480c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/817427641 >> v2:172.21.15.167:3300/0 conn(0x7f7b4815dc00 0x7f7b480af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b47e00640 1 -- 172.21.15.18:0/817427641 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895966421 0 0) 0x7f7b480b30d0 con 0x7f7b480d0150 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b47e00640 1 -- 172.21.15.18:0/817427641 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b30003530 con 0x7f7b480d0150 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4dc00640 1 -- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 msgr2=0x7f7b480c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 0x7f7b480c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4dc00640 1 -- 172.21.15.18:0/817427641 >> v1:172.21.15.18:6789/0 conn(0x7f7b480d0150 legacy=0x7f7b480c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4dc00640 1 -- 172.21.15.18:0/817427641 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b480cd210 con 0x7f7b4815dc00 2024-04-25T10:04:24.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.773+0000 7f7b4e600640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 0x7f7b480c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:24.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b4815dc00 0x7f7b480af770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0097c0 tx=0x7f7b3c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77efdbb668f03b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b47e00640 1 -- 172.21.15.18:0/817427641 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0b0070 con 0x7f7b4815dc00 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b47e00640 1 -- 172.21.15.18:0/817427641 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0ab600 con 0x7f7b4815dc00 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b47e00640 1 -- 172.21.15.18:0/817427641 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0ab9d0 con 0x7f7b4815dc00 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b4815dc00 msgr2=0x7f7b480af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b4815dc00 0x7f7b480af770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0097c0 tx=0x7f7b3c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- 172.21.15.18:0/817427641 shutdown_connections 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b480c72a0 0x7f7b480c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 --2- 172.21.15.18:0/817427641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b4815dc00 0x7f7b480af770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- 172.21.15.18:0/817427641 >> 172.21.15.18:0/817427641 conn(0x7f7b480b2240 msgr2=0x7f7b480b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- 172.21.15.18:0/817427641 shutdown_connections 2024-04-25T10:04:24.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- 172.21.15.18:0/817427641 wait complete. 2024-04-25T10:04:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 Processor -- start 2024-04-25T10:04:24.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.777+0000 7f7b50600640 1 -- start start 2024-04-25T10:04:24.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480c72a0 0x7f7b4814de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b4815dc00 0x7f7b480b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4816a640 con 0x7f7b480d0150 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480cdf00 con 0x7f7b480c72a0 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4816a7c0 con 0x7f7b4815dc00 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36862/0 (socket says 172.21.15.18:36862) 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 -- 172.21.15.18:0/1058446880 learned_addr learned my addr 172.21.15.18:0/1058446880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4e600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b4815dc00 0x7f7b480b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480c72a0 0x7f7b4814de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 -- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b4815dc00 msgr2=0x7f7b480b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b4815dc00 0x7f7b480b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 -- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480c72a0 msgr2=0x7f7b4814de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480c72a0 0x7f7b4814de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 -- 172.21.15.18:0/1058446880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4809a630 con 0x7f7b480d0150 2024-04-25T10:04:24.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b4d200640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c450 tx=0x7f7b3400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34017070 con 0x7f7b480d0150 2024-04-25T10:04:24.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34005cf0 con 0x7f7b480d0150 2024-04-25T10:04:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34007290 con 0x7f7b480d0150 2024-04-25T10:04:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4814e3c0 con 0x7f7b480d0150 2024-04-25T10:04:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4809a8f0 con 0x7f7b480d0150 2024-04-25T10:04:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b480745d0 con 0x7f7b480d0150 2024-04-25T10:04:24.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.781+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b3401a070 con 0x7f7b480d0150 2024-04-25T10:04:24.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.785+0000 7f7b45600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 0x7f7b28069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:24.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.785+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7b340847d0 con 0x7f7b480d0150 2024-04-25T10:04:24.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.785+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 0x7f7b28069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:24.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.785+0000 7f7b4dc00640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 0x7f7b28069450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0ad000 tx=0x7f7b3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:24.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.789+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b34055400 con 0x7f7b480d0150 2024-04-25T10:04:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b480b28e0 con 0x7f7b480d0150 2024-04-25T10:04:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b45600640 1 -- 172.21.15.18:0/1058446880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b34054d00 con 0x7f7b480d0150 2024-04-25T10:04:24.965 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:24.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 msgr2=0x7f7b28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 0x7f7b28069450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c0ad000 tx=0x7f7b3c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:24.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 msgr2=0x7f7b480b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400c450 tx=0x7f7b3400c910 comp rx=0 tx=0).stop 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 shutdown_connections 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7b28066f90 0x7f7b28069450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7b4815dc00 0x7f7b480b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b480d0150 0x7f7b480b1720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 --2- 172.21.15.18:0/1058446880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b480c72a0 0x7f7b4814de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 >> 172.21.15.18:0/1058446880 conn(0x7f7b480b2240 msgr2=0x7f7b480ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 shutdown_connections 2024-04-25T10:04:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:24.957+0000 7f7b50600640 1 -- 172.21.15.18:0/1058446880 wait complete. 2024-04-25T10:04:24.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:25.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 Processor -- start 2024-04-25T10:04:25.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 -- start start 2024-04-25T10:04:25.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2ad815f440 0x7f2ad806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad815fc00 con 0x7f2ad806e010 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad806d640 con 0x7f2ad815f440 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ade200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad815fee0 con 0x7f2ad8159320 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2ad815f440 0x7f2ad806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2ad815f440 0x7f2ad806dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36876/0 (socket says 172.21.15.18:36876) 2024-04-25T10:04:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 -- 172.21.15.18:0/2206717944 learned_addr learned my addr 172.21.15.18:0/2206717944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2ad7400640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 -- 172.21.15.18:0/2206717944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 msgr2=0x7f2ad815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 -- 172.21.15.18:0/2206717944 >> v1:172.21.15.167:6789/0 conn(0x7f2ad806e010 legacy=0x7f2ad806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.121+0000 7f2acfe00640 1 -- 172.21.15.18:0/2206717944 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad81601c0 con 0x7f2ad815f440 2024-04-25T10:04:25.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2acfe00640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad806dad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009870 tx=0x7f2ac001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824551f220fad71f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ad6a00640 1 -- 172.21.15.18:0/2206717944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ab640 con 0x7f2ad815f440 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ad6a00640 1 -- 172.21.15.18:0/2206717944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac00b0070 con 0x7f2ad815f440 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ad6a00640 1 -- 172.21.15.18:0/2206717944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00aba00 con 0x7f2ad815f440 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 -- 172.21.15.18:0/2206717944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 msgr2=0x7f2ad806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad806dad0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0009870 tx=0x7f2ac001c460 comp rx=0 tx=0).stop 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 -- 172.21.15.18:0/2206717944 shutdown_connections 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad806dad0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 --2- 172.21.15.18:0/2206717944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 -- 172.21.15.18:0/2206717944 >> 172.21.15.18:0/2206717944 conn(0x7f2ad8067080 msgr2=0x7f2ad806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 -- 172.21.15.18:0/2206717944 shutdown_connections 2024-04-25T10:04:25.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.125+0000 7f2ade200640 1 -- 172.21.15.18:0/2206717944 wait complete. 2024-04-25T10:04:25.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 Processor -- start 2024-04-25T10:04:25.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- start start 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad806e010 0x7f2ad80b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad8159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad8071c00 con 0x7f2ad815f440 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad8071a80 con 0x7f2ad806e010 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad806ebb0 con 0x7f2ad8159320 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36884/0 (socket says 172.21.15.18:36884) 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 -- 172.21.15.18:0/3727175758 learned_addr learned my addr 172.21.15.18:0/3727175758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7400640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad806e010 0x7f2ad80b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2acfe00640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad8159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 -- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 msgr2=0x7f2ad8159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad8159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 -- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad806e010 msgr2=0x7f2ad80b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad806e010 0x7f2ad80b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 -- 172.21.15.18:0/3727175758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad80b2de0 con 0x7f2ad815f440 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2acfe00640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad8159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ad7e00640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c780 tx=0x7f2ad000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad0016020 con 0x7f2ad815f440 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad000aa90 con 0x7f2ad815f440 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad000ce30 con 0x7f2ad815f440 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad80b2b00 con 0x7f2ad815f440 2024-04-25T10:04:25.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.129+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad80b0700 con 0x7f2ad815f440 2024-04-25T10:04:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad80b14a0 con 0x7f2ad815f440 2024-04-25T10:04:25.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ad0019020 con 0x7f2ad815f440 2024-04-25T10:04:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2acf400640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2ad00852e0 con 0x7f2ad815f440 2024-04-25T10:04:25.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2ad7400640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.133+0000 7f2ad7400640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 0x7f2ab4069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80cde30 tx=0x7f2ac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.137+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ad0020030 con 0x7f2ad815f440 2024-04-25T10:04:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.301+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2ad806f040 con 0x7f2ad815f440 2024-04-25T10:04:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.301+0000 7f2acf400640 1 -- 172.21.15.18:0/3727175758 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2ad0055950 con 0x7f2ad815f440 2024-04-25T10:04:25.315 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:25.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 msgr2=0x7f2ab4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 0x7f2ab4069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2ad80cde30 tx=0x7f2ac8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 msgr2=0x7f2ad80b2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000c780 tx=0x7f2ad000cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 shutdown_connections 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ad815f440 0x7f2ad80b2080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2ad8159320 0x7f2ad8159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 --2- 172.21.15.18:0/3727175758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ad806e010 0x7f2ad80b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 >> 172.21.15.18:0/3727175758 conn(0x7f2ad8067080 msgr2=0x7f2ad8144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 shutdown_connections 2024-04-25T10:04:25.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.305+0000 7f2ade200640 1 -- 172.21.15.18:0/3727175758 wait complete. 2024-04-25T10:04:25.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:25.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 Processor -- start 2024-04-25T10:04:25.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 -- start start 2024-04-25T10:04:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb94c145270 0x7fb94c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0cd4d0 0x7fb94c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 0x7fb94c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0b20e0 con 0x7fb94c145270 2024-04-25T10:04:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c145650 con 0x7fb94c0b1750 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb953a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0cc4e0 con 0x7fb94c0cd4d0 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb94c145270 0x7fb94c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb94c145270 0x7fb94c15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36900/0 (socket says 172.21.15.18:36900) 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 -- 172.21.15.18:0/3810091906 learned_addr learned my addr 172.21.15.18:0/3810091906 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb94be00640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0cd4d0 0x7fb94c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951a00640 1 --2- 172.21.15.18:0/3810091906 >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 0x7fb94c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 -- 172.21.15.18:0/3810091906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0cd4d0 msgr2=0x7fb94c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0cd4d0 0x7fb94c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 -- 172.21.15.18:0/3810091906 >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 msgr2=0x7fb94c0b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 --2- 172.21.15.18:0/3810091906 >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 0x7fb94c0b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951000640 1 -- 172.21.15.18:0/3810091906 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0ce040 con 0x7fb94c145270 2024-04-25T10:04:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.465+0000 7fb951a00640 1 --2- 172.21.15.18:0/3810091906 >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 0x7fb94c0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb951000640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c15fe50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb94c06b5f0 tx=0x7fb94001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2161488070a52d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb94b400640 1 -- 172.21.15.18:0/3810091906 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400b1070 con 0x7fb94c145270 2024-04-25T10:04:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb94b400640 1 -- 172.21.15.18:0/3810091906 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9400ac630 con 0x7fb94c145270 2024-04-25T10:04:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb94b400640 1 -- 172.21.15.18:0/3810091906 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9400a8050 con 0x7fb94c145270 2024-04-25T10:04:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 -- 172.21.15.18:0/3810091906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 msgr2=0x7fb94c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c15fe50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb94c06b5f0 tx=0x7fb94001c520 comp rx=0 tx=0).stop 2024-04-25T10:04:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 -- 172.21.15.18:0/3810091906 shutdown_connections 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 --2- 172.21.15.18:0/3810091906 >> v2:172.21.15.167:3300/0 conn(0x7fb94c0b1750 0x7fb94c0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0cd4d0 0x7fb94c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 --2- 172.21.15.18:0/3810091906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c15fe50 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 -- 172.21.15.18:0/3810091906 >> 172.21.15.18:0/3810091906 conn(0x7fb94c066fa0 msgr2=0x7fb94c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.469+0000 7fb953a00640 1 -- 172.21.15.18:0/3810091906 shutdown_connections 2024-04-25T10:04:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- 172.21.15.18:0/3810091906 wait complete. 2024-04-25T10:04:25.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 Processor -- start 2024-04-25T10:04:25.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- start start 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0b1750 0x7fb94c0b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 0x7fb94c13bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15c590 con 0x7fb94c145270 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15f930 con 0x7fb94c0cd4d0 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15c710 con 0x7fb94c0b1750 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36908/0 (socket says 172.21.15.18:36908) 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 -- 172.21.15.18:0/4110626687 learned_addr learned my addr 172.21.15.18:0/4110626687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951000640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0b1750 0x7fb94c0b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb94be00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 0x7fb94c13bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 -- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0b1750 msgr2=0x7fb94c0b3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0b1750 0x7fb94c0b3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 -- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 msgr2=0x7fb94c13bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 0x7fb94c13bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 -- 172.21.15.18:0/4110626687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c13ddc0 con 0x7fb94c145270 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb94be00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 0x7fb94c13bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb951a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb94400cf20 tx=0x7fb94400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94401a070 con 0x7fb94c145270 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94400d840 con 0x7fb94c145270 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c13e100 con 0x7fb94c145270 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.473+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400dc30 con 0x7fb94c145270 2024-04-25T10:04:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c13e940 con 0x7fb94c145270 2024-04-25T10:04:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c13eb40 con 0x7fb94c145270 2024-04-25T10:04:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb94401d070 con 0x7fb94c145270 2024-04-25T10:04:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb948c00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 0x7fb92c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb944085b50 con 0x7fb94c145270 2024-04-25T10:04:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb951000640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 0x7fb92c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.477+0000 7fb951000640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 0x7fb92c069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9400ae000 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.481+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb94c13eb40 con 0x7fb94c145270 2024-04-25T10:04:25.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb94c0aed70 con 0x7fb94c145270 2024-04-25T10:04:25.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb948c00640 1 -- 172.21.15.18:0/4110626687 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fb94c13e100 con 0x7fb94c145270 2024-04-25T10:04:25.686 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:25.686 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:25.686 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:25.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 msgr2=0x7fb92c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 0x7fb92c069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb9400ae000 tx=0x7fb940009040 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 msgr2=0x7fb94c13aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb94400cf20 tx=0x7fb94400a710 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 shutdown_connections 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb94c145270 0x7fb94c13aee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb94c0cd4d0 0x7fb94c13bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb92c066f60 0x7fb92c069420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 --2- 172.21.15.18:0/4110626687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb94c0b1750 0x7fb94c0b3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 >> 172.21.15.18:0/4110626687 conn(0x7fb94c066fa0 msgr2=0x7fb94c15cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 shutdown_connections 2024-04-25T10:04:25.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.677+0000 7fb953a00640 1 -- 172.21.15.18:0/4110626687 wait complete. 2024-04-25T10:04:25.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:25.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.837+0000 7f4861000640 1 Processor -- start 2024-04-25T10:04:25.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.837+0000 7f4861000640 1 -- start start 2024-04-25T10:04:25.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4861000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f485c144140 0x7f485c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4861000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f485c0ced60 0x7f485c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4861000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c15ac60 con 0x7f485c06e900 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4861000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c06ed30 con 0x7f485c0ced60 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4861000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0cf3e0 con 0x7f485c144140 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f485c0ced60 0x7f485c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f485c0ced60 0x7f485c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36916/0 (socket says 172.21.15.18:36916) 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 -- 172.21.15.18:0/2887590386 learned_addr learned my addr 172.21.15.18:0/2887590386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859e00640 1 --2- 172.21.15.18:0/2887590386 >> v2:172.21.15.167:3300/0 conn(0x7f485c144140 0x7f485c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 -- 172.21.15.18:0/2887590386 >> v2:172.21.15.167:3300/0 conn(0x7f485c144140 msgr2=0x7f485c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 --2- 172.21.15.18:0/2887590386 >> v2:172.21.15.167:3300/0 conn(0x7f485c144140 0x7f485c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 -- 172.21.15.18:0/2887590386 >> v1:172.21.15.167:6789/0 conn(0x7f485c06e900 legacy=0x7f485c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.841+0000 7f4859400640 1 -- 172.21.15.18:0/2887590386 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c15af20 con 0x7f485c0ced60 2024-04-25T10:04:25.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4859400640 1 --2- 172.21.15.18:0/2887590386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c06e3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f485c06eef0 tx=0x7f484801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebd44037c853dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4858a00640 1 -- 172.21.15.18:0/2887590386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480b0070 con 0x7f485c0ced60 2024-04-25T10:04:25.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4858a00640 1 -- 172.21.15.18:0/2887590386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480ab600 con 0x7f485c0ced60 2024-04-25T10:04:25.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4858a00640 1 -- 172.21.15.18:0/2887590386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480ab9d0 con 0x7f485c0ced60 2024-04-25T10:04:25.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- 172.21.15.18:0/2887590386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 msgr2=0x7f485c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- 172.21.15.18:0/2887590386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c06e3c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f485c06eef0 tx=0x7f484801c520 comp rx=0 tx=0).stop 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- 172.21.15.18:0/2887590386 shutdown_connections 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- 172.21.15.18:0/2887590386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c06e3c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- 172.21.15.18:0/2887590386 >> v2:172.21.15.167:3300/0 conn(0x7f485c144140 0x7f485c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- 172.21.15.18:0/2887590386 >> 172.21.15.18:0/2887590386 conn(0x7f485c066fa0 msgr2=0x7f485c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- 172.21.15.18:0/2887590386 shutdown_connections 2024-04-25T10:04:25.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- 172.21.15.18:0/2887590386 wait complete. 2024-04-25T10:04:25.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 Processor -- start 2024-04-25T10:04:25.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- start start 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f485c06e900 0x7f485c167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c144140 0x7f485c159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15ba00 con 0x7f485c0ced60 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c144520 con 0x7f485c144140 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.845+0000 7f4861000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15bb80 con 0x7f485c06e900 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f485c06e900 0x7f485c167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f485a800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c144140 0x7f485c159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36924/0 (socket says 172.21.15.18:36924) 2024-04-25T10:04:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 -- 172.21.15.18:0/864009667 learned_addr learned my addr 172.21.15.18:0/864009667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 -- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f485c06e900 msgr2=0x7f485c167d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f485c06e900 0x7f485c167d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 -- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c144140 msgr2=0x7f485c159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c144140 0x7f485c159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 -- 172.21.15.18:0/864009667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c1439c0 con 0x7f485c0ced60 2024-04-25T10:04:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4859400640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48480ae040 tx=0x7f48480192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480ba070 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48480b4420 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c167330 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48480b0040 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c1678b0 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0745d0 con 0x7f485c0ced60 2024-04-25T10:04:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.849+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f48480bd070 con 0x7f485c0ced60 2024-04-25T10:04:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.853+0000 7f4852000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 0x7f483c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.853+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f484811e340 con 0x7f485c0ced60 2024-04-25T10:04:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.853+0000 7f4859e00640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 0x7f483c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:25.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.853+0000 7f4859e00640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 0x7f483c069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f484c009ac0 tx=0x7f484c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:25.857+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4848016110 con 0x7f485c0ced60 2024-04-25T10:04:26.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.021+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f485c167af0 con 0x7f485c0ced60 2024-04-25T10:04:26.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.021+0000 7f4852000640 1 -- 172.21.15.18:0/864009667 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f48480eea40 con 0x7f485c0ced60 2024-04-25T10:04:26.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:26.031 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 msgr2=0x7f483c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 0x7f483c069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f484c009ac0 tx=0x7f484c009190 comp rx=0 tx=0).stop 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 msgr2=0x7f485c166df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f48480ae040 tx=0x7f48480192c0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 shutdown_connections 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f485c144140 0x7f485c159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f485c0ced60 0x7f485c166df0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f483c066f60 0x7f483c069420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 --2- 172.21.15.18:0/864009667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f485c06e900 0x7f485c167d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 >> 172.21.15.18:0/864009667 conn(0x7f485c066fa0 msgr2=0x7f485c15d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 shutdown_connections 2024-04-25T10:04:26.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.025+0000 7f4861000640 1 -- 172.21.15.18:0/864009667 wait complete. 2024-04-25T10:04:26.052 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:26.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 Processor -- start 2024-04-25T10:04:26.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 -- start start 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71c4161510 0x7f71c4143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c41435c0 0x7f71c415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c406d090 con 0x7f71c4070fe0 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c4071ad0 con 0x7f71c4161510 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4162390 con 0x7f71c41435c0 2024-04-25T10:04:26.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f71c4070fe0 0x7f71c40713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60592/0 (socket says 172.21.15.18:60592) 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2a00640 1 -- 172.21.15.18:0/2203517004 learned_addr learned my addr 172.21.15.18:0/2203517004 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2000640 1 --2- 172.21.15.18:0/2203517004 >> v2:172.21.15.18:3300/0 conn(0x7f71c4161510 0x7f71c4143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c3400640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c41435c0 0x7f71c415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2000640 1 -- 172.21.15.18:0/2203517004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c41435c0 msgr2=0x7f71c415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c1600640 1 -- 172.21.15.18:0/2203517004 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221321680 0 0) 0x7f71b4001120 con 0x7f71c4070fe0 2024-04-25T10:04:26.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2000640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c41435c0 0x7f71c415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2000640 1 -- 172.21.15.18:0/2203517004 >> v1:172.21.15.18:6789/0 conn(0x7f71c4070fe0 legacy=0x7f71c40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.185+0000 7f71c2000640 1 -- 172.21.15.18:0/2203517004 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4161af0 con 0x7f71c4161510 2024-04-25T10:04:26.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c2000640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4161510 0x7f71c4143080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d68ea9690602901 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c1600640 1 -- 172.21.15.18:0/2203517004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00b2070 con 0x7f71c4161510 2024-04-25T10:04:26.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c1600640 1 -- 172.21.15.18:0/2203517004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00ad680 con 0x7f71c4161510 2024-04-25T10:04:26.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c1600640 1 -- 172.21.15.18:0/2203517004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00ada50 con 0x7f71c4161510 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 -- 172.21.15.18:0/2203517004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4161510 msgr2=0x7f71c4143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4161510 0x7f71c4143080 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71b00097c0 tx=0x7f71b001c470 comp rx=0 tx=0).stop 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 -- 172.21.15.18:0/2203517004 shutdown_connections 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c41435c0 0x7f71c415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2203517004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4161510 0x7f71c4143080 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 -- 172.21.15.18:0/2203517004 >> 172.21.15.18:0/2203517004 conn(0x7f71c40b3390 msgr2=0x7f71c40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 -- 172.21.15.18:0/2203517004 shutdown_connections 2024-04-25T10:04:26.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 -- 172.21.15.18:0/2203517004 wait complete. 2024-04-25T10:04:26.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.189+0000 7f71c9a00640 1 Processor -- start 2024-04-25T10:04:26.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- start start 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 0x7f71c40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4161510 0x7f71c4155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b06c0 con 0x7f71c41435c0 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b0540 con 0x7f71c4161510 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40b0840 con 0x7f71c4070fe0 2024-04-25T10:04:26.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36940/0 (socket says 172.21.15.18:36940) 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 -- 172.21.15.18:0/2043073473 learned_addr learned my addr 172.21.15.18:0/2043073473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 0x7f71c40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c3400640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4161510 0x7f71c4155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 -- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 msgr2=0x7f71c40b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 0x7f71c40b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 -- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4161510 msgr2=0x7f71c4155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4161510 0x7f71c4155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 -- 172.21.15.18:0/2043073473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40b1240 con 0x7f71c41435c0 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 0x7f71c40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:26.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c2000640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71b001a0a0 tx=0x7f71b0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00b2040 con 0x7f71c41435c0 2024-04-25T10:04:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b00c0070 con 0x7f71c41435c0 2024-04-25T10:04:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b00add30 con 0x7f71c41435c0 2024-04-25T10:04:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c40b1520 con 0x7f71c41435c0 2024-04-25T10:04:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40b1ae0 con 0x7f71c41435c0 2024-04-25T10:04:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.193+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c40745d0 con 0x7f71c41435c0 2024-04-25T10:04:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.197+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f71b00b5040 con 0x7f71c41435c0 2024-04-25T10:04:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.197+0000 7f71baa00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 0x7f71a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.197+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f71b011f360 con 0x7f71c41435c0 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.197+0000 7f71c2a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 0x7f71a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.197+0000 7f71c2a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 0x7f71a4069470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000f70 tx=0x7f71b4007a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.201+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f71b0016090 con 0x7f71c41435c0 2024-04-25T10:04:26.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.397+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71c40cef80 con 0x7f71c41435c0 2024-04-25T10:04:26.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.397+0000 7f71baa00640 1 -- 172.21.15.18:0/2043073473 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f71b00ac3e0 con 0x7f71c41435c0 2024-04-25T10:04:26.407 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:26.407 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:26.408 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 msgr2=0x7f71a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 0x7f71a4069470 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f71b4000f70 tx=0x7f71b4007a20 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 msgr2=0x7f71c413d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71b001a0a0 tx=0x7f71b0019210 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 shutdown_connections 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4161510 0x7f71c4155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c41435c0 0x7f71c413d440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a4066fb0 0x7f71a4069470 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2043073473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4070fe0 0x7f71c40b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 >> 172.21.15.18:0/2043073473 conn(0x7f71c40b3390 msgr2=0x7f71c40caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 shutdown_connections 2024-04-25T10:04:26.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.401+0000 7f71c9a00640 1 -- 172.21.15.18:0/2043073473 wait complete. 2024-04-25T10:04:26.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:03:56.137194+0000', 'modified': '2024-04-25T10:04:14.230428+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34181}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34181': {'gid': 34181, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/1802921745', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 1802921745}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1802921745}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:04:26.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:04:26.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:04:26.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 Processor -- start 2024-04-25T10:04:26.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 -- start start 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61d815f440 0x7f61d806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61d806e010 0x7f61d806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d806d640 con 0x7f61d806e010 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d815fc00 con 0x7f61d815f440 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.969+0000 7f61de200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d815fee0 con 0x7f61d8159320 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61d806e010 0x7f61d806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61d806e010 0x7f61d806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36956/0 (socket says 172.21.15.18:36956) 2024-04-25T10:04:26.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 -- 172.21.15.18:0/588088716 learned_addr learned my addr 172.21.15.18:0/588088716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61cea00640 1 --2- 172.21.15.18:0/588088716 >> v2:172.21.15.167:3300/0 conn(0x7f61d815f440 0x7f61d806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7400640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 -- 172.21.15.18:0/588088716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 msgr2=0x7f61d815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 -- 172.21.15.18:0/588088716 >> v2:172.21.15.167:3300/0 conn(0x7f61d815f440 msgr2=0x7f61d806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 --2- 172.21.15.18:0/588088716 >> v2:172.21.15.167:3300/0 conn(0x7f61d815f440 0x7f61d806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 -- 172.21.15.18:0/588088716 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d81601c0 con 0x7f61d806e010 2024-04-25T10:04:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d7e00640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d806e010 0x7f61d806e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b4b00 tx=0x7f61d001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad36caf11bcad68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d6a00640 1 -- 172.21.15.18:0/588088716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b0070 con 0x7f61d806e010 2024-04-25T10:04:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d6a00640 1 -- 172.21.15.18:0/588088716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00ab600 con 0x7f61d806e010 2024-04-25T10:04:26.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.973+0000 7f61d6a00640 1 -- 172.21.15.18:0/588088716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00ab9d0 con 0x7f61d806e010 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- 172.21.15.18:0/588088716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d806e010 msgr2=0x7f61d806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d806e010 0x7f61d806e4a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61d80b4b00 tx=0x7f61d001c460 comp rx=0 tx=0).stop 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- 172.21.15.18:0/588088716 shutdown_connections 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d806e010 0x7f61d806e4a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- 172.21.15.18:0/588088716 >> v2:172.21.15.167:3300/0 conn(0x7f61d815f440 0x7f61d806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- 172.21.15.18:0/588088716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- 172.21.15.18:0/588088716 >> 172.21.15.18:0/588088716 conn(0x7f61d8067080 msgr2=0x7f61d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- 172.21.15.18:0/588088716 shutdown_connections 2024-04-25T10:04:26.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- 172.21.15.18:0/588088716 wait complete. 2024-04-25T10:04:26.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 Processor -- start 2024-04-25T10:04:26.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- start start 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d806e010 0x7f61d812ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d8139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cc440 con 0x7f61d815f440 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cc2c0 con 0x7f61d806e010 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61de200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cc5c0 con 0x7f61d8159320 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36966/0 (socket says 172.21.15.18:36966) 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 -- 172.21.15.18:0/2622577369 learned_addr learned my addr 172.21.15.18:0/2622577369 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7400640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d806e010 0x7f61d812ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61cea00640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d8139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 -- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 msgr2=0x7f61d8139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d8139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 -- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d806e010 msgr2=0x7f61d812ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d806e010 0x7f61d812ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.977+0000 7f61d7e00640 1 -- 172.21.15.18:0/2622577369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d812b1b0 con 0x7f61d815f440 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61d7e00640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61d001cd00 tx=0x7f61d0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 -- 172.21.15.18:0/2622577369 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b0040 con 0x7f61d815f440 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 -- 172.21.15.18:0/2622577369 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d00b4420 con 0x7f61d815f440 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d813f770 con 0x7f61d815f440 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 -- 172.21.15.18:0/2622577369 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00b47f0 con 0x7f61d815f440 2024-04-25T10:04:26.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d8139430 con 0x7f61d815f440 2024-04-25T10:04:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 -- 172.21.15.18:0/2622577369 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f61d00b4990 con 0x7f61d815f440 2024-04-25T10:04:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 0x7f61b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61cfe00640 1 -- 172.21.15.18:0/2622577369 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f61d011ef30 con 0x7f61d815f440 2024-04-25T10:04:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61e178a000 1 Processor -- start 2024-04-25T10:04:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61e178a000 1 -- start start 2024-04-25T10:04:26.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.981+0000 7f61d7400640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 0x7f61b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61d7400640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 0x7f61b4069450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61c8011360 tx=0x7f61c800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6d44160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6cfab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6bdd5f0 con 0x5625c6d446a0 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6b44da0 con 0x5625c6d43d80 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625c6acd150 con 0x5625c6cfa720 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36968/0 (socket says 172.21.15.18:36968) 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 -- 172.21.15.18:0/1229122549 learned_addr learned my addr 172.21.15.18:0/1229122549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61d7400640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6d44160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61d7e00640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6cfab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 -- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 msgr2=0x5625c6cfab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6cfab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 -- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 msgr2=0x5625c6d44160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6d44160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 -- 172.21.15.18:0/1229122549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c6ae6ca0 con 0x5625c6d446a0 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61d7e00640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6cfab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:26.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61cea00640 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f61d8138eb0 tx=0x7f61c0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76d3048c548cdfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61c7e00640 1 -- 172.21.15.18:0/1229122549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0019070 con 0x5625c6d446a0 2024-04-25T10:04:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61c7e00640 1 -- 172.21.15.18:0/1229122549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0011ae0 con 0x5625c6d446a0 2024-04-25T10:04:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61c7e00640 1 -- 172.21.15.18:0/1229122549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0011e90 con 0x5625c6d446a0 2024-04-25T10:04:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- 172.21.15.18:0/1229122549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 msgr2=0x5625c6cfa1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:26.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f61d8138eb0 tx=0x7f61c0009190 comp rx=0 tx=0).stop 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- 172.21.15.18:0/1229122549 shutdown_connections 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6cfab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d446a0 0x5625c6cfa1e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 --2- 172.21.15.18:0/1229122549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6d44160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- 172.21.15.18:0/1229122549 >> 172.21.15.18:0/1229122549 conn(0x5625c6cf66d0 msgr2=0x5625c6cf8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- 172.21.15.18:0/1229122549 shutdown_connections 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- 172.21.15.18:0/1229122549 wait complete. 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 -- start start 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.985+0000 7f61e178a000 1 Processor -- start 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d4b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6d03270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6aff990 con 0x5625c6d43d80 2024-04-25T10:04:26.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6b40e40 con 0x5625c6d446a0 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625c6b440b0 con 0x5625c6cfa720 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 10 client.0 _ll_register_callbacks cb 0x5625c6bf81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36984/0 (socket says 172.21.15.18:36984) 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 -- 172.21.15.18:0/2310372453 learned_addr learned my addr 172.21.15.18:0/2310372453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61d7e00640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6d03270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61d7400640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d4b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 -- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 msgr2=0x5625c6d4b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d4b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 -- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 msgr2=0x5625c6d03270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6d03270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:26.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 -- 172.21.15.18:0/2310372453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625c6afd630 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61cea00640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f61c0008010 tx=0x7f61c0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbea233d21b97639 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c002d060 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61c0011ae0 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f61c00118e0 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c0019050 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 10 client.4788 fetch_fsmap learned FSMap version 9 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5625c6acd3a0 con 0x5625c6d43d80 2024-04-25T10:04:27.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0011ae0 con 0x5625c6d43d80 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f61c002e260 con 0x5625c6d43d80 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 10 client.4788 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 10 client.4788 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 20 client.4788 populate_metadata read hostname 'smithi018' 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6d53310 0x5625c6d55700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 4 client.4788 mds_command: new command op to 34181 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 --> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625c6ae0a50 con 0x5625c6d53310 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61d7400640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6d53310 0x5625c6d55700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61d7400640 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6d53310 0x5625c6d55700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c78c8ffa9c68fdd server_cookie=80311c8bafcff1dc in_seq=0 out_seq=0 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.989+0000 7f61c4c00640 10 client.4788 ms_handle_connect on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61c4c00640 1 -- 172.21.15.18:0/2310372453 <== mds.0 v2:172.21.15.167:6835/1802921745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5625c6ae0a50 con 0x5625c6d53310 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61c4c00640 10 client.4788 handle_command_reply: tid=0 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 client.4788 shutdown 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 msgr2=0x5625c6d4b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f61c0008010 tx=0x7f61c0004740 comp rx=0 tx=0).stop 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 shutdown_connections 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6d53310 0x5625c6d55700 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6d03270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6d4b800 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 --2- 172.21.15.18:0/2310372453 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d4b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61c4c00640 0 client.4788 ms_handle_reset on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 >> 172.21.15.18:0/2310372453 conn(0x5625c6cf66d0 msgr2=0x5625c6cfb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 shutdown_connections 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 1 -- 172.21.15.18:0/2310372453 wait complete. 2024-04-25T10:04:27.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:26.993+0000 7f61e178a000 20 client.4788 trim_cache size 0 max 16384 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 Processor -- start 2024-04-25T10:04:27.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- start start 2024-04-25T10:04:27.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d9ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6da0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81ff450 con 0x5625c6d43d80 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81fe850 con 0x5625c6d446a0 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d81fee50 con 0x5625c6cfa720 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36988/0 (socket says 172.21.15.18:36988) 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 -- 172.21.15.18:0/2493485687 learned_addr learned my addr 172.21.15.18:0/2493485687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61d7400640 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d9ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61d7e00640 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6da0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 -- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 msgr2=0x5625c6d9ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d9ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 -- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 msgr2=0x5625c6da0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6da0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 -- 172.21.15.18:0/2493485687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c6d444d0 con 0x5625c6d43d80 2024-04-25T10:04:27.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61cea00640 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61c0000c10 tx=0x7f61c0020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579f9a09fff7055e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61c7400640 1 -- 172.21.15.18:0/2493485687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c002d020 con 0x5625c6d43d80 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61c7400640 1 -- 172.21.15.18:0/2493485687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c002ea30 con 0x5625c6d43d80 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61c7400640 1 -- 172.21.15.18:0/2493485687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0009300 con 0x5625c6d43d80 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- 172.21.15.18:0/2493485687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 msgr2=0x5625c6da0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f61c0000c10 tx=0x7f61c0020070 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- 172.21.15.18:0/2493485687 shutdown_connections 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d446a0 0x5625c6da0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6d43d80 0x5625c6da0510 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 --2- 172.21.15.18:0/2493485687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6cfa720 0x5625c6d9ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- 172.21.15.18:0/2493485687 >> 172.21.15.18:0/2493485687 conn(0x5625c6cf66d0 msgr2=0x5625c6cf8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- 172.21.15.18:0/2493485687 shutdown_connections 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.009+0000 7f61e178a000 1 -- 172.21.15.18:0/2493485687 wait complete. 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- start start 2024-04-25T10:04:27.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 Processor -- start 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6da5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6d446a0 0x5625c6da1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6add750 con 0x5625c6cfa720 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c6b493d0 con 0x5625c6d43d80 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625c6aea4b0 con 0x5625c6d446a0 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 10 client.0 _ll_register_callbacks cb 0x7f61c00094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36998/0 (socket says 172.21.15.18:36998) 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 -- 172.21.15.18:0/769412378 learned_addr learned my addr 172.21.15.18:0/769412378 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 -- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6d446a0 msgr2=0x5625c6da1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6d446a0 0x5625c6da1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 -- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 msgr2=0x5625c6da5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6da5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 -- 172.21.15.18:0/769412378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625c6bc6600 con 0x5625c6cfa720 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61d7400640 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5625c6b50f70 tx=0x7f61c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df54f89209c6476c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8028460 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f61c8028600 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625c6b522e0 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61c8035050 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 10 client.4794 fetch_fsmap learned FSMap version 9 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5625c6ad99b0 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625c6b522e0 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f61c8038020 con 0x5625c6cfa720 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 10 client.4794 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 20 client.4794 populate_metadata read hostname 'smithi018' 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6da1940 0x5625c6da1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 4 client.4794 mds_command: new command op to 34181 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:04:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 --> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5625c6b4c630 con 0x5625c6da1940 2024-04-25T10:04:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.013+0000 7f61cea00640 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6da1940 0x5625c6da1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61cea00640 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6da1940 0x5625c6da1d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b125a0a17615d615 server_cookie=d3e711ee7efba44a in_seq=0 out_seq=0 2024-04-25T10:04:27.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61c4c00640 10 client.4794 ms_handle_connect on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61c4c00640 1 -- 172.21.15.18:0/769412378 <== mds.0 v2:172.21.15.167:6835/1802921745 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5625c6b4c630 con 0x5625c6da1940 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61c4c00640 10 client.4794 handle_command_reply: tid=0 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 client.4794 shutdown 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 msgr2=0x5625c6da4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x5625c6b50f70 tx=0x7f61c800b040 comp rx=0 tx=0).stop 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 shutdown_connections 2024-04-25T10:04:27.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:6835/1802921745,v1:172.21.15.167:6837/1802921745] conn(0x5625c6da1940 0x5625c6da1d20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5625c6d446a0 0x5625c6da1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61c4c00640 0 client.4794 ms_handle_reset on v2:172.21.15.167:6835/1802921745 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5625c6d43d80 0x5625c6da5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 --2- 172.21.15.18:0/769412378 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5625c6cfa720 0x5625c6da4e40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 >> 172.21.15.18:0/769412378 conn(0x5625c6cf66d0 msgr2=0x5625c6cf9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 shutdown_connections 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 1 -- 172.21.15.18:0/769412378 wait complete. 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61e178a000 20 client.4794 trim_cache size 0 max 16384 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:04:27.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 34181, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 30.278577043999999, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 9, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 27, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 27, 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 37.569482977 2024-04-25T10:04:27.030 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 msgr2=0x7f61b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 0x7f61b4069450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61c8011360 tx=0x7f61c800d040 comp rx=0 tx=0).stop 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 msgr2=0x7f61d813ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f61d001cd00 tx=0x7f61d0019200 comp rx=0 tx=0).stop 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 shutdown_connections 2024-04-25T10:04:27.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61d815f440 0x7f61d813ec90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61b4066f90 0x7f61b4069450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61d8159320 0x7f61d8139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 --2- 172.21.15.18:0/2622577369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61d806e010 0x7f61d812ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 >> 172.21.15.18:0/2622577369 conn(0x7f61d8067080 msgr2=0x7f61d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 shutdown_connections 2024-04-25T10:04:27.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.017+0000 7f61de200640 1 -- 172.21.15.18:0/2622577369 wait complete. 2024-04-25T10:04:27.045 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T10:04:27.059 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T10:04:27.059 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T10:04:27.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.059 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:04:27.068 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T10:04:27.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T10:04:27.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-25T10:04:27.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.299 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:04:27.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-25T10:04:27.374 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-04-25T10:04:27.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:04:27.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.376 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:04:27.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T10:04:27.452 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T10:04:27.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:04:27.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.455 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:04:27.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.505 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T10:04:27.572 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T10:04:27.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:04:27.574 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-25T10:04:27.575 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:04:27.575 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:27.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:27.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.705+0000 7f2b51000640 1 Processor -- start 2024-04-25T10:04:27.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.705+0000 7f2b51000640 1 -- start start 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c099a60 0x7f2b4c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b4c15ee00 0x7f2b4c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2b4c1616a0 0x7f2b4c161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c09a380 con 0x7f2b4c15ee00 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4c06c650 con 0x7f2b4c1616a0 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b51000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c06c930 con 0x7f2b4c099a60 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b4c15ee00 0x7f2b4c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b4c15ee00 0x7f2b4c06bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37004/0 (socket says 172.21.15.18:37004) 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 -- 172.21.15.18:0/1711904168 learned_addr learned my addr 172.21.15.18:0/1711904168 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 -- 172.21.15.18:0/1711904168 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c099a60 msgr2=0x7f2b4c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 --2- 172.21.15.18:0/1711904168 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c099a60 0x7f2b4c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 -- 172.21.15.18:0/1711904168 >> v2:172.21.15.167:3300/0 conn(0x7f2b4c1616a0 msgr2=0x7f2b4c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:27.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 --2- 172.21.15.18:0/1711904168 >> v2:172.21.15.167:3300/0 conn(0x7f2b4c1616a0 0x7f2b4c161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.709+0000 7f2b41400640 1 -- 172.21.15.18:0/1711904168 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c06cc10 con 0x7f2b4c15ee00 2024-04-25T10:04:27.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b41400640 1 --2- 172.21.15.18:0/1711904168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c06bd20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c06dd30 tx=0x7f2b3401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8903c1468734a0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b49400640 1 -- 172.21.15.18:0/1711904168 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340ab5f0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b49400640 1 -- 172.21.15.18:0/1711904168 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340b0070 con 0x7f2b4c15ee00 2024-04-25T10:04:27.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b49400640 1 -- 172.21.15.18:0/1711904168 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340ab9b0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- 172.21.15.18:0/1711904168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 msgr2=0x7f2b4c06bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 --2- 172.21.15.18:0/1711904168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c06bd20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c06dd30 tx=0x7f2b3401c520 comp rx=0 tx=0).stop 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- 172.21.15.18:0/1711904168 shutdown_connections 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 --2- 172.21.15.18:0/1711904168 >> v2:172.21.15.167:3300/0 conn(0x7f2b4c1616a0 0x7f2b4c161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 --2- 172.21.15.18:0/1711904168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c06bd20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 --2- 172.21.15.18:0/1711904168 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c099a60 0x7f2b4c099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- 172.21.15.18:0/1711904168 >> 172.21.15.18:0/1711904168 conn(0x7f2b4c0d17a0 msgr2=0x7f2b4c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- 172.21.15.18:0/1711904168 shutdown_connections 2024-04-25T10:04:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- 172.21.15.18:0/1711904168 wait complete. 2024-04-25T10:04:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 Processor -- start 2024-04-25T10:04:27.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.713+0000 7f2b51000640 1 -- start start 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b4c099a60 0x7f2b4c151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c1616a0 0x7f2b4c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c15e000 con 0x7f2b4c15ee00 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c15de80 con 0x7f2b4c099a60 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c06c260 con 0x7f2b4c1616a0 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37018/0 (socket says 172.21.15.18:37018) 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 -- 172.21.15.18:0/4117691775 learned_addr learned my addr 172.21.15.18:0/4117691775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b49e00640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b4c099a60 0x7f2b4c151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b4a800640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c1616a0 0x7f2b4c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 -- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c1616a0 msgr2=0x7f2b4c155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c1616a0 0x7f2b4c155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 -- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b4c099a60 msgr2=0x7f2b4c151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b4c099a60 0x7f2b4c151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 -- 172.21.15.18:0/4117691775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4c157cd0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b41400640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b3401abd0 tx=0x7f2b3401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340be5f0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340be7b0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c158250 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340beba0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c157f70 con 0x7f2b4c15ee00 2024-04-25T10:04:27.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c0745d0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.717+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2b340b43f0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.721+0000 7f2b42a00640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 0x7f2b28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.721+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2b3411fdf0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.721+0000 7f2b49e00640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 0x7f2b28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:27.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.721+0000 7f2b49e00640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 0x7f2b28069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c1facd0 tx=0x7f2b3c006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:27.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.725+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b340c4060 con 0x7f2b4c15ee00 2024-04-25T10:04:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2b4c0d23d0 con 0x7f2b4c15ee00 2024-04-25T10:04:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b42a00640 1 -- 172.21.15.18:0/4117691775 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2b34016110 con 0x7f2b4c15ee00 2024-04-25T10:04:27.934 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 msgr2=0x7f2b28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 0x7f2b28069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c1facd0 tx=0x7f2b3c006f90 comp rx=0 tx=0).stop 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 msgr2=0x7f2b4c154fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2b3401abd0 tx=0x7f2b3401ad60 comp rx=0 tx=0).stop 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 shutdown_connections 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2b28066f60 0x7f2b28069420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2b4c1616a0 0x7f2b4c155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b4c15ee00 0x7f2b4c154fc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 --2- 172.21.15.18:0/4117691775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b4c099a60 0x7f2b4c151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 >> 172.21.15.18:0/4117691775 conn(0x7f2b4c0d17a0 msgr2=0x7f2b4c06f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 shutdown_connections 2024-04-25T10:04:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:27.925+0000 7f2b51000640 1 -- 172.21.15.18:0/4117691775 wait complete. 2024-04-25T10:04:27.954 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:04:27.954 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:27.955 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:27.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.955 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:27.965 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42437sec preferred_lft 42437sec 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:27.966 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:27.967 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:04:27.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:27.967 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:27.967 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:27.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:04:27.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-04-25T10:04:27.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-04-25T10:04:27.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:04:27.968 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:28.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.076 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:28.094 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:04:28.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.096 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:04:28.149 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:04:28.149 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:04:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:04:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:04:28.150 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:28.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.150 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:28.150 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:28.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:28.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:28.151 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:28.151 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.246 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:04:28.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.255 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-25T10:04:28.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.305 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:28.305 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:28.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:04:28.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T10:04:28.305 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:28.388 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T10:04:28.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.388 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:28.388 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T10:04:28.389 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:28.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.524 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:28.524 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:28.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:04:28.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:04:28.524 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:28.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:28.563 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:28.616 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:04:28.617 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:28.617 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:28.672 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:04:28.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:28.672 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:28.766 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:28.766 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:29.350 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:29.351 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:29.351 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:04:29.351 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:04:29.351 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:04:29.354 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:29.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:29.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:04:29.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:29.375 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:29.430 INFO:teuthology.orchestra.run.smithi018.stdout:client4798 2024-04-25T10:04:29.431 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:29.431 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:29.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:29.481 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:29.535 INFO:teuthology.orchestra.run.smithi018.stdout:client4798 2024-04-25T10:04:29.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:29.535 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:29.592 INFO:teuthology.orchestra.run.smithi018.stdout:client4798 2024-04-25T10:04:29.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:29.593 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a742dcf2-a420-4fc2-9137-18bf23968324.client4798/status') 2024-04-25T10:04:29.659 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4798 (3)172.21.15.18:0/226916665 2024-04-25T10:04:29.660 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-04-25T10:04:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-04-25T10:04:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-04-25T10:04:29.660 INFO:teuthology.orchestra.run.smithi018.stderr:69 bytes copied, 5.3963e-05 s, 1.3 MB/s 2024-04-25T10:04:29.662 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-25T10:04:29.662 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:04:29.662 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T10:04:29.662 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:29.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 Processor -- start 2024-04-25T10:04:29.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 -- start start 2024-04-25T10:04:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faa780b1950 0x7faa78166390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa780cf5c0 con 0x7faa780b0590 2024-04-25T10:04:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa781668d0 con 0x7faa780cba50 2024-04-25T10:04:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa7d600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780b0100 con 0x7faa780b1950 2024-04-25T10:04:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa77400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa780b0590 0x7faa7806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60594/0 (socket says 172.21.15.18:60594) 2024-04-25T10:04:29.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa77400640 1 -- 172.21.15.18:0/1211108274 learned_addr learned my addr 172.21.15.18:0/1211108274 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa76a00640 1 --2- 172.21.15.18:0/1211108274 >> v2:172.21.15.167:3300/0 conn(0x7faa780b1950 0x7faa78166390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757615308 0 0) 0x7faa780cf5c0 con 0x7faa780b0590 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.837+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa5c003530 con 0x7faa780b0590 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690056756 0 0) 0x7faa781668d0 con 0x7faa780cba50 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa780cf5c0 con 0x7faa780cba50 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 233081890 0 0) 0x7faa5c003530 con 0x7faa780b0590 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 >> v2:172.21.15.167:3300/0 conn(0x7faa780b1950 msgr2=0x7faa78166390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 --2- 172.21.15.18:0/1211108274 >> v2:172.21.15.167:3300/0 conn(0x7faa780b1950 0x7faa78166390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 >> v1:172.21.15.167:6789/0 conn(0x7faa780cba50 legacy=0x7faa780b1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780af1e0 con 0x7faa780b0590 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7faa70001a00 con 0x7faa780b0590 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 >> v1:172.21.15.18:6789/0 conn(0x7faa780b0590 legacy=0x7faa7806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c003b50 0x7faa5c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa5c004810 0x7faa5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 0x7faa5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b0100 con 0x7faa5c0051d0 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c00c050 con 0x7faa5c004810 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c00c250 con 0x7faa5c003b50 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76a00640 1 --2- 172.21.15.18:0/1211108274 >> v2:172.21.15.167:3300/0 conn(0x7faa780b1950 0x7faa78166390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 0x7faa5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa6fe00640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa5c004810 0x7faa5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa76a00640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c003b50 0x7faa5c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 -- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c003b50 msgr2=0x7faa5c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c003b50 0x7faa5c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 -- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa5c004810 msgr2=0x7faa5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa5c004810 0x7faa5c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 -- 172.21.15.18:0/1211108274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c003530 con 0x7faa5c0051d0 2024-04-25T10:04:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 -- 172.21.15.18:0/1211108274 reap_dead start 2024-04-25T10:04:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.841+0000 7faa77400640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 0x7faa5c00b9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa7000a7f0 tx=0x7faa7001fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dccd0e24c52cf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000a410 con 0x7faa5c0051d0 2024-04-25T10:04:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa700aa6d0 con 0x7faa5c0051d0 2024-04-25T10:04:29.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa76000640 1 -- 172.21.15.18:0/1211108274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700aaac0 con 0x7faa5c0051d0 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 msgr2=0x7faa5c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 0x7faa5c00b9d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7faa7000a7f0 tx=0x7faa7001fa60 comp rx=0 tx=0).stop 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- 172.21.15.18:0/1211108274 shutdown_connections 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 --2- 172.21.15.18:0/1211108274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa5c0051d0 0x7faa5c00b9d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- 172.21.15.18:0/1211108274 >> 172.21.15.18:0/1211108274 conn(0x7faa78066fa0 msgr2=0x7faa7806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- 172.21.15.18:0/1211108274 shutdown_connections 2024-04-25T10:04:29.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- 172.21.15.18:0/1211108274 wait complete. 2024-04-25T10:04:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 Processor -- start 2024-04-25T10:04:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- start start 2024-04-25T10:04:29.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c0051d0 0x7faa7815e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa780ab3a0 0x7faa781f8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780cc1c0 con 0x7faa780ac6a0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780afd90 con 0x7faa780ab3a0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.845+0000 7faa7d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780cbe40 con 0x7faa5c0051d0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37026/0 (socket says 172.21.15.18:37026) 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 -- 172.21.15.18:0/3792394695 learned_addr learned my addr 172.21.15.18:0/3792394695 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6fe00640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa780ab3a0 0x7faa781f8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa76a00640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c0051d0 0x7faa7815e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 -- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c0051d0 msgr2=0x7faa7815e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c0051d0 0x7faa7815e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 -- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa780ab3a0 msgr2=0x7faa781f8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa780ab3a0 0x7faa781f8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 -- 172.21.15.18:0/3792394695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780acf00 con 0x7faa780ac6a0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa77400640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa70020300 tx=0x7faa5c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700b9070 con 0x7faa780ac6a0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa70001800 con 0x7faa780ac6a0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000a410 con 0x7faa780ac6a0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa780a8810 con 0x7faa780ac6a0 2024-04-25T10:04:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780a8500 con 0x7faa780ac6a0 2024-04-25T10:04:29.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa780745d0 con 0x7faa780ac6a0 2024-04-25T10:04:29.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa700bc070 con 0x7faa780ac6a0 2024-04-25T10:04:29.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.849+0000 7faa6ea00640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 0x7faa54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:29.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.853+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faa70122070 con 0x7faa780ac6a0 2024-04-25T10:04:29.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.853+0000 7faa76a00640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 0x7faa54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:29.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.853+0000 7faa76a00640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 0x7faa54069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa68009b40 tx=0x7faa68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:29.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:29.853+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa70019770 con 0x7faa780ac6a0 2024-04-25T10:04:30.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.053+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7faa780b1730 con 0x7faa780ac6a0 2024-04-25T10:04:30.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.053+0000 7faa6ea00640 1 -- 172.21.15.18:0/3792394695 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7faa700f2ca0 con 0x7faa780ac6a0 2024-04-25T10:04:30.064 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 msgr2=0x7faa54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 0x7faa54069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa68009b40 tx=0x7faa68008040 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 msgr2=0x7faa780adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7faa70020300 tx=0x7faa5c005840 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 shutdown_connections 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa780ac6a0 0x7faa780adcb0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa780ab3a0 0x7faa781f8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa54066f60 0x7faa54069420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 --2- 172.21.15.18:0/3792394695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa5c0051d0 0x7faa7815e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:30.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 >> 172.21.15.18:0/3792394695 conn(0x7faa78066fa0 msgr2=0x7faa780b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:30.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 shutdown_connections 2024-04-25T10:04:30.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:30.057+0000 7faa7d600640 1 -- 172.21.15.18:0/3792394695 wait complete. 2024-04-25T10:04:30.084 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:04:30.084 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:30.085 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T10:04:30.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.085 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:30.095 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42435sec preferred_lft 42435sec 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:04:30.096 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:04:30.097 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:04:30.098 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.098 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:30.158 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:04:30.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.160 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:04:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:30.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:04:30.214 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:30.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.305 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:04:30.315 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:04:30.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.315 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-04-25T10:04:30.368 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T10:04:30.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.369 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:30.369 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:30.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:04:30.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T10:04:30.369 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:30.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T10:04:30.520 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 8e:55:74:ee:80:e4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8c55:74ff:feee:80e4/64 scope link 2024-04-25T10:04:30.521 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T10:04:30.588 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:30.588 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:30.588 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 8e:55:74:ee:80:e4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::8c55:74ff:feee:80e4/64 scope link 2024-04-25T10:04:30.589 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:30.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T10:04:30.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T10:04:30.591 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:30.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.728 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:04:30.728 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:04:30.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2024-04-25T10:04:30.728 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T10:04:30.728 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:04:30.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:30.767 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T10:04:30.820 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T10:04:30.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:30.820 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T10:04:30.875 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-25T10:04:30.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.875 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:30.965 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:30.965 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:30.978 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:30.978 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:30.978 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:04:30.978 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 2@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:04:30.978 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:04:30.982 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:30.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:30.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T10:04:31.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.002 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:31.059 INFO:teuthology.orchestra.run.smithi018.stdout:client4809 2024-04-25T10:04:31.059 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:31.059 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:31.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.112 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:31.167 INFO:teuthology.orchestra.run.smithi018.stdout:client4809 2024-04-25T10:04:31.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.168 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:31.219 INFO:teuthology.orchestra.run.smithi018.stdout:client4809 2024-04-25T10:04:31.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.220 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a742dcf2-a420-4fc2-9137-18bf23968324.client4809/status') 2024-04-25T10:04:31.284 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4809 (3)192.168.0.2:0/1902595148 2024-04-25T10:04:31.284 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-04-25T10:04:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-04-25T10:04:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-04-25T10:04:31.284 INFO:teuthology.orchestra.run.smithi018.stderr:69 bytes copied, 5.7098e-05 s, 1.2 MB/s 2024-04-25T10:04:31.286 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-25T10:04:31.286 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:04:31.286 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T10:04:31.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:31.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 Processor -- start 2024-04-25T10:04:31.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 -- start start 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91bc15b890 0x7f91bc0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91bc0cc260 0x7f91bc0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15bc70 0x7f91bc0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc15c1f0 con 0x7f91bc0cc260 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91bc15c4d0 con 0x7f91bc15b890 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91c0c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc15c7b0 con 0x7f91bc15bc70 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91bc0cc260 0x7f91bc0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91bc0cc260 0x7f91bc0ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37040/0 (socket says 172.21.15.18:37040) 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 -- 172.21.15.18:0/3482630649 learned_addr learned my addr 172.21.15.18:0/3482630649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91bb400640 1 --2- 172.21.15.18:0/3482630649 >> v2:172.21.15.167:3300/0 conn(0x7f91bc15b890 0x7f91bc0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91bbe00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15bc70 0x7f91bc0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 -- 172.21.15.18:0/3482630649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15bc70 msgr2=0x7f91bc0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15bc70 0x7f91bc0acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 -- 172.21.15.18:0/3482630649 >> v2:172.21.15.167:3300/0 conn(0x7f91bc15b890 msgr2=0x7f91bc0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 --2- 172.21.15.18:0/3482630649 >> v2:172.21.15.167:3300/0 conn(0x7f91bc15b890 0x7f91bc0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.461+0000 7f91baa00640 1 -- 172.21.15.18:0/3482630649 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc15ca90 con 0x7f91bc0cc260 2024-04-25T10:04:31.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91baa00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc0ae500 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91bc050040 tx=0x7f91a801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb255b50168b60c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91ba000640 1 -- 172.21.15.18:0/3482630649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80ab640 con 0x7f91bc0cc260 2024-04-25T10:04:31.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91ba000640 1 -- 172.21.15.18:0/3482630649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a80b0070 con 0x7f91bc0cc260 2024-04-25T10:04:31.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91ba000640 1 -- 172.21.15.18:0/3482630649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a80aba00 con 0x7f91bc0cc260 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- 172.21.15.18:0/3482630649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 msgr2=0x7f91bc0ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc0ae500 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f91bc050040 tx=0x7f91a801c460 comp rx=0 tx=0).stop 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- 172.21.15.18:0/3482630649 shutdown_connections 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15bc70 0x7f91bc0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 --2- 172.21.15.18:0/3482630649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc0ae500 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 --2- 172.21.15.18:0/3482630649 >> v2:172.21.15.167:3300/0 conn(0x7f91bc15b890 0x7f91bc0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- 172.21.15.18:0/3482630649 >> 172.21.15.18:0/3482630649 conn(0x7f91bc0726f0 msgr2=0x7f91bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- 172.21.15.18:0/3482630649 shutdown_connections 2024-04-25T10:04:31.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- 172.21.15.18:0/3482630649 wait complete. 2024-04-25T10:04:31.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 Processor -- start 2024-04-25T10:04:31.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.465+0000 7f91c0c00640 1 -- start start 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 0x7f91bc0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc15bc70 0x7f91bc0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc06dea0 con 0x7f91bc0cc260 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc06dd20 con 0x7f91bc15bc70 2024-04-25T10:04:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91bc06e020 con 0x7f91bc15b890 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37042/0 (socket says 172.21.15.18:37042) 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 -- 172.21.15.18:0/242090188 learned_addr learned my addr 172.21.15.18:0/242090188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bbe00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc15bc70 0x7f91bc0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91baa00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 0x7f91bc0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 -- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 msgr2=0x7f91bc0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 0x7f91bc0cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 -- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc15bc70 msgr2=0x7f91bc0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc15bc70 0x7f91bc0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 -- 172.21.15.18:0/242090188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc0b3b40 con 0x7f91bc0cc260 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91baa00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 0x7f91bc0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91bb400640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d800 tx=0x7f91ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac018020 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac0096a0 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc0b3e20 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac009a50 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91bc0b43e0 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.469+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91bc04efa0 con 0x7f91bc0cc260 2024-04-25T10:04:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.473+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91ac01b020 con 0x7f91bc0cc260 2024-04-25T10:04:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.473+0000 7f91b3400640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 0x7f919c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.473+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f91ac085860 con 0x7f91bc0cc260 2024-04-25T10:04:31.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.473+0000 7f91baa00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 0x7f919c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:31.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.473+0000 7f91baa00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 0x7f919c069450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91a80af000 tx=0x7f91a80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.477+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91ac022020 con 0x7f91bc0cc260 2024-04-25T10:04:31.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91bc06c010 con 0x7f91bc0cc260 2024-04-25T10:04:31.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91b3400640 1 -- 172.21.15.18:0/242090188 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f91ac056530 con 0x7f91bc0cc260 2024-04-25T10:04:31.682 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:04:31.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 msgr2=0x7f919c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 0x7f919c069450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f91a80af000 tx=0x7f91a80a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 msgr2=0x7f91bc09d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00d800 tx=0x7f91ac00dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 shutdown_connections 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc15bc70 0x7f91bc0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f919c066f90 0x7f919c069450 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f91bc15b890 0x7f91bc0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 --2- 172.21.15.18:0/242090188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91bc0cc260 0x7f91bc09d1a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 >> 172.21.15.18:0/242090188 conn(0x7f91bc0726f0 msgr2=0x7f91bc15d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 shutdown_connections 2024-04-25T10:04:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:31.673+0000 7f91c0c00640 1 -- 172.21.15.18:0/242090188 wait complete. 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:31.703 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T10:04:31.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.703 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-04-25T10:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:31.713 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:31.714 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:4d:d9:79:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:04:31.715 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:31.716 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T10:04:31.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.716 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:31.716 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:31.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add name ceph-brx type bridge 2024-04-25T10:04:31.716 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr flush dev ceph-brx 2024-04-25T10:04:31.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set ceph-brx up 2024-04-25T10:04:31.717 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T10:04:31.717 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:31.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.832 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:31.850 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T10:04:31.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.853 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:31.930 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:31.931 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:31.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T10:04:31.931 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:32.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.022 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:04:32.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.031 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-04-25T10:04:32.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.081 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:32.081 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:32.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T10:04:32.081 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T10:04:32.081 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:32.167 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T10:04:32.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T10:04:32.168 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:32.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.328 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:32.328 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:32.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.0 up 2024-04-25T10:04:32.329 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T10:04:32.329 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:32.368 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:32.368 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T10:04:32.421 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T10:04:32.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:32.421 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T10:04:32.472 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-25T10:04:32.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:32.472 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:32.559 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:32.560 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with new device syntax: 1@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:04:33.121 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:04:33.125 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:33.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.125 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T10:04:33.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.144 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:33.209 INFO:teuthology.orchestra.run.smithi167.stdout:client34598 2024-04-25T10:04:33.209 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:33.210 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:33.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.261 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:33.319 INFO:teuthology.orchestra.run.smithi167.stdout:client34598 2024-04-25T10:04:33.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.320 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:33.375 INFO:teuthology.orchestra.run.smithi167.stdout:client34598 2024-04-25T10:04:33.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.375 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a742dcf2-a420-4fc2-9137-18bf23968324.client34598/status') 2024-04-25T10:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.34598 (3)192.168.0.1:0/673613504 2024-04-25T10:04:33.440 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-04-25T10:04:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-04-25T10:04:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-04-25T10:04:33.440 INFO:teuthology.orchestra.run.smithi167.stderr:69 bytes copied, 4.8676e-05 s, 1.4 MB/s 2024-04-25T10:04:33.442 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-25T10:04:33.442 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T10:04:33.442 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T10:04:33.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:04:33.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 Processor -- start 2024-04-25T10:04:33.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 -- start start 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4648099a60 0x7f4648099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464809a380 con 0x7f464815ee00 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464806c430 con 0x7f4648099a60 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464806c650 con 0x7f46480cff30 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464d000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4648099a60 0x7f4648099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f464da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f4647e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f464815ee00 0x7f464806bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:50352/0 (socket says 172.21.15.18:50352) 2024-04-25T10:04:33.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.585+0000 7f4647e00640 1 -- 172.21.15.18:0/4200071648 learned_addr learned my addr 172.21.15.18:0/4200071648 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:33.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464d000640 1 -- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 msgr2=0x7f46480d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:33.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464d000640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464d000640 1 -- 172.21.15.18:0/4200071648 >> v1:172.21.15.167:6789/0 conn(0x7f464815ee00 legacy=0x7f464806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464d000640 1 -- 172.21.15.18:0/4200071648 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464806c930 con 0x7f4648099a60 2024-04-25T10:04:33.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464da00640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:33.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f4647400640 1 -- 172.21.15.18:0/4200071648 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219933728 0 0) 0x7f464809a380 con 0x7f464815ee00 2024-04-25T10:04:33.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f464d000640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f4648099e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f463c0097c0 tx=0x7f463c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de3beca4e76e4b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f4647400640 1 -- 172.21.15.18:0/4200071648 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0b2070 con 0x7f4648099a60 2024-04-25T10:04:33.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f4647400640 1 -- 172.21.15.18:0/4200071648 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c0ad640 con 0x7f4648099a60 2024-04-25T10:04:33.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.589+0000 7f4647400640 1 -- 172.21.15.18:0/4200071648 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0ada10 con 0x7f4648099a60 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 msgr2=0x7f4648099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f4648099e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f463c0097c0 tx=0x7f463c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- 172.21.15.18:0/4200071648 shutdown_connections 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- 172.21.15.18:0/4200071648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f4648099e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- 172.21.15.18:0/4200071648 >> 172.21.15.18:0/4200071648 conn(0x7f46480d17a0 msgr2=0x7f46480d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- 172.21.15.18:0/4200071648 shutdown_connections 2024-04-25T10:04:33.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- 172.21.15.18:0/4200071648 wait complete. 2024-04-25T10:04:33.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 Processor -- start 2024-04-25T10:04:33.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- start start 2024-04-25T10:04:33.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f464815b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464815e000 con 0x7f464815ee00 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464815de80 con 0x7f4648099a60 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464816aa00 con 0x7f46480cff30 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40964/0 (socket says 172.21.15.18:40964) 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 -- 172.21.15.18:0/3307182652 learned_addr learned my addr 172.21.15.18:0/3307182652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464d000640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f464815b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f4647e00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 -- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 msgr2=0x7f46480cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 -- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 msgr2=0x7f464815b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f464815b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.593+0000 7f464da00640 1 -- 172.21.15.18:0/3307182652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46480cb530 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f464da00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f464000efc0 tx=0x7f464000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640018030 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464000cdf0 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464815c350 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640003bc0 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464815c910 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46480745d0 con 0x7f464815ee00 2024-04-25T10:04:33.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f464001b070 con 0x7f464815ee00 2024-04-25T10:04:33.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:33.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4640085c60 con 0x7f464815ee00 2024-04-25T10:04:33.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.597+0000 7f464d000640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:33.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.601+0000 7f464d000640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 0x7f4628069420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f463c0af000 tx=0x7f463c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:33.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.601+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4640022070 con 0x7f464815ee00 2024-04-25T10:04:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f464809ae10 con 0x7f464815ee00 2024-04-25T10:04:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f4644c00640 1 -- 172.21.15.18:0/3307182652 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f4640010040 con 0x7f464815ee00 2024-04-25T10:04:33.814 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 msgr2=0x7f4628069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 0x7f4628069420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f463c0af000 tx=0x7f463c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 msgr2=0x7f46480ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f464000efc0 tx=0x7f464000c490 comp rx=0 tx=0).stop 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 shutdown_connections 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f464815ee00 0x7f46480ccbb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4628066f60 0x7f4628069420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46480cff30 0x7f46480cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 --2- 172.21.15.18:0/3307182652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4648099a60 0x7f464815b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 >> 172.21.15.18:0/3307182652 conn(0x7f46480d17a0 msgr2=0x7f4648070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 shutdown_connections 2024-04-25T10:04:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:33.805+0000 7f464fa00640 1 -- 172.21.15.18:0/3307182652 wait complete. 2024-04-25T10:04:33.833 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi167.front.sepia.ceph.com 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:04:33.834 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T10:04:33.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.834 DEBUG:teuthology.orchestra.run.smithi167:> ip addr 2024-04-25T10:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:33.843 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e6 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f0 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:d9:35:e7 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: altname enp7s0f1 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:08 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0c:c4:7a:88:73:09 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.844 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.21.15.167/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft 42441sec preferred_lft 42441sec 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::ec4:7aff:fe88:7309/64 scope link 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 02:42:4d:d9:79:d6 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2024-04-25T10:04:33.845 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T10:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:04:33.846 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:33.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.847 DEBUG:teuthology.orchestra.run.smithi167:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:04:33.907 INFO:teuthology.orchestra.run.smithi167.stdout:1 2024-04-25T10:04:33.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.910 DEBUG:teuthology.orchestra.run.smithi167:> route 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:Kernel IP routing table 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:33.965 INFO:teuthology.orchestra.run.smithi167.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T10:04:33.966 INFO:teuthology.orchestra.run.smithi167.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:04:33.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T10:04:33.966 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:34.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.060 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:04:34.068 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T10:04:34.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.069 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list-id 2024-04-25T10:04:34.120 INFO:teuthology.orchestra.run.smithi167.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T10:04:34.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.121 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:34.121 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:34.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T10:04:34.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T10:04:34.122 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:34.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T10:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:34.268 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 6e:fb:70:8c:2f:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::6cfb:70ff:fe8c:2f78/64 scope link 2024-04-25T10:04:34.269 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.271 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 ::1/128 scope host 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:04:34.336 INFO:teuthology.orchestra.run.smithi167.stdout: link/ether 6e:fb:70:8c:2f:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T10:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T10:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout: inet6 fe80::6cfb:70ff:fe8c:2f78/64 scope link 2024-04-25T10:04:34.337 INFO:teuthology.orchestra.run.smithi167.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:04:34.338 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T10:04:34.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.338 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:34.338 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:34.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T10:04:34.338 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T10:04:34.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T10:04:34.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T10:04:34.339 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T10:04:34.339 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:34.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.477 DEBUG:teuthology.orchestra.run.smithi167:> (cd / && exec bash -c ' 2024-04-25T10:04:34.477 DEBUG:teuthology.orchestra.run.smithi167:> set -e 2024-04-25T10:04:34.477 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set brx.1 up 2024-04-25T10:04:34.478 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T10:04:34.478 DEBUG:teuthology.orchestra.run.smithi167:> ') 2024-04-25T10:04:34.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:34.515 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T10:04:34.565 INFO:teuthology.orchestra.run.smithi167.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T10:04:34.565 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:04:34.565 DEBUG:teuthology.orchestra.run.smithi167:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T10:04:34.616 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-25T10:04:34.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.616 DEBUG:teuthology.orchestra.run.smithi167:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:34.705 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: trying mount with new device syntax: 3@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:04:34.718 INFO:teuthology.orchestra.run.smithi167.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:04:34.722 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:04:34.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.722 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T10:04:34.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.741 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:34.795 INFO:teuthology.orchestra.run.smithi167.stdout:client4825 2024-04-25T10:04:34.796 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:34.796 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:34.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.845 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:34.899 INFO:teuthology.orchestra.run.smithi167.stdout:client4825 2024-04-25T10:04:34.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.899 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:04:34.955 INFO:teuthology.orchestra.run.smithi167.stdout:client4825 2024-04-25T10:04:34.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:34.956 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/a742dcf2-a420-4fc2-9137-18bf23968324.client4825/status') 2024-04-25T10:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:instance: client.4825 (3)192.168.0.2:0/1472611161 2024-04-25T10:04:35.019 INFO:teuthology.orchestra.run.smithi167.stdout:blocklisted: false 2024-04-25T10:04:35.020 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records in 2024-04-25T10:04:35.020 INFO:teuthology.orchestra.run.smithi167.stderr:0+1 records out 2024-04-25T10:04:35.020 INFO:teuthology.orchestra.run.smithi167.stderr:69 bytes copied, 5.2699e-05 s, 1.3 MB/s 2024-04-25T10:04:35.021 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T10:04:35.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:35.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 Processor -- start 2024-04-25T10:04:35.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 -- start start 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7984099a60 0x7f798415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79840cf370 0x7f7984099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f798415f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840d0410 con 0x7f79840cf370 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798415c310 con 0x7f7984099a60 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7988c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798409a380 con 0x7f798409a600 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79840cf370 0x7f7984099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79840cf370 0x7f7984099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40978/0 (socket says 172.21.15.18:40978) 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 -- 172.21.15.18:0/864384714 learned_addr learned my addr 172.21.15.18:0/864384714 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7982800640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f798415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f7981e00640 1 --2- 172.21.15.18:0/864384714 >> v2:172.21.15.167:3300/0 conn(0x7f7984099a60 0x7f798415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 -- 172.21.15.18:0/864384714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 msgr2=0x7f798415f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:35.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f798415f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 -- 172.21.15.18:0/864384714 >> v2:172.21.15.167:3300/0 conn(0x7f7984099a60 msgr2=0x7f798415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:35.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 --2- 172.21.15.18:0/864384714 >> v2:172.21.15.167:3300/0 conn(0x7f7984099a60 0x7f798415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.185+0000 7f797be00640 1 -- 172.21.15.18:0/864384714 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840cf800 con 0x7f79840cf370 2024-04-25T10:04:35.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f797be00640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79840cf370 0x7f7984099e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7984072740 tx=0x7f796c01c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbb72fab8086f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7981400640 1 -- 172.21.15.18:0/864384714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0b0070 con 0x7f79840cf370 2024-04-25T10:04:35.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7981400640 1 -- 172.21.15.18:0/864384714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0ab600 con 0x7f79840cf370 2024-04-25T10:04:35.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7981400640 1 -- 172.21.15.18:0/864384714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab9d0 con 0x7f79840cf370 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 -- 172.21.15.18:0/864384714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79840cf370 msgr2=0x7f7984099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79840cf370 0x7f7984099e40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7984072740 tx=0x7f796c01c1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 -- 172.21.15.18:0/864384714 shutdown_connections 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f798415f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 --2- 172.21.15.18:0/864384714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79840cf370 0x7f7984099e40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 --2- 172.21.15.18:0/864384714 >> v2:172.21.15.167:3300/0 conn(0x7f7984099a60 0x7f798415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 -- 172.21.15.18:0/864384714 >> 172.21.15.18:0/864384714 conn(0x7f79840d17a0 msgr2=0x7f79840d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 -- 172.21.15.18:0/864384714 shutdown_connections 2024-04-25T10:04:35.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.189+0000 7f7988c00640 1 -- 172.21.15.18:0/864384714 wait complete. 2024-04-25T10:04:35.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 Processor -- start 2024-04-25T10:04:35.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- start start 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7984099a60 0x7f798414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f79840b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cc430 con 0x7f7984152f50 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cc2b0 con 0x7f7984099a60 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cc5b0 con 0x7f798409a600 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40990/0 (socket says 172.21.15.18:40990) 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 -- 172.21.15.18:0/3841418140 learned_addr learned my addr 172.21.15.18:0/3841418140 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7981e00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7984099a60 0x7f798414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f797be00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f79840b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 -- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 msgr2=0x7f79840b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f79840b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 -- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7984099a60 msgr2=0x7f798414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7984099a60 0x7f798414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 -- 172.21.15.18:0/3841418140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79841598b0 con 0x7f7984152f50 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7982800640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f797c009e30 tx=0x7f797c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c018020 con 0x7f7984152f50 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c014480 con 0x7f7984152f50 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c014870 con 0x7f7984152f50 2024-04-25T10:04:35.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79841534a0 con 0x7f7984152f50 2024-04-25T10:04:35.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.193+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7984153a60 con 0x7f7984152f50 2024-04-25T10:04:35.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7984159a80 con 0x7f7984152f50 2024-04-25T10:04:35.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f797c01b020 con 0x7f7984152f50 2024-04-25T10:04:35.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f797a000640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 0x7f7960069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f797c086110 con 0x7f7984152f50 2024-04-25T10:04:35.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f7981e00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 0x7f7960069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.197+0000 7f7981e00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 0x7f7960069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7984074fe0 tx=0x7f7974009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.201+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f797c022030 con 0x7f7984152f50 2024-04-25T10:04:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.365+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79840745d0 con 0x7f7984152f50 2024-04-25T10:04:35.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.365+0000 7f797a000640 1 -- 172.21.15.18:0/3841418140 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18490 (secure 0 0 0) 0x7f797c010040 con 0x7f7984152f50 2024-04-25T10:04:35.379 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:35.379 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":27,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:02.788518+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:35.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 msgr2=0x7f7960069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 0x7f7960069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7984074fe0 tx=0x7f7974009190 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 msgr2=0x7f79840b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f797c009e30 tx=0x7f797c00c490 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 shutdown_connections 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7984152f50 0x7f79840b1a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7960066f60 0x7f7960069420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f798409a600 0x7f79840b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 --2- 172.21.15.18:0/3841418140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7984099a60 0x7f798414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 >> 172.21.15.18:0/3841418140 conn(0x7f79840d17a0 msgr2=0x7f7984154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 shutdown_connections 2024-04-25T10:04:35.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.369+0000 7f7988c00640 1 -- 172.21.15.18:0/3841418140 wait complete. 2024-04-25T10:04:35.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:35.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:35.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.533+0000 7f57c8600640 1 Processor -- start 2024-04-25T10:04:35.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.533+0000 7f57c8600640 1 -- start start 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c0144120 0x7f57c015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c8600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57c00ccbf0 0x7f57c015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c8600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c015bc40 con 0x7f57c015ee60 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c8600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c015e490 con 0x7f57c00ccbf0 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c015b3a0 con 0x7f57c0144120 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57c00ccbf0 0x7f57c015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57c00ccbf0 0x7f57c015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41004/0 (socket says 172.21.15.18:41004) 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 -- 172.21.15.18:0/3948707091 learned_addr learned my addr 172.21.15.18:0/3948707091 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5c00640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c0144120 0x7f57c015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 -- 172.21.15.18:0/3948707091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c0144120 msgr2=0x7f57c015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:35.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c0144120 0x7f57c015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 -- 172.21.15.18:0/3948707091 >> v1:172.21.15.167:6789/0 conn(0x7f57c015ee60 legacy=0x7f57c00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.537+0000 7f57c5200640 1 -- 172.21.15.18:0/3948707091 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c015b680 con 0x7f57c00ccbf0 2024-04-25T10:04:35.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c5200640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c00ccbf0 0x7f57c015e920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2cb9c9f401757c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57bfe00640 1 -- 172.21.15.18:0/3948707091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0b0070 con 0x7f57c00ccbf0 2024-04-25T10:04:35.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57bfe00640 1 -- 172.21.15.18:0/3948707091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac0ab600 con 0x7f57c00ccbf0 2024-04-25T10:04:35.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57bfe00640 1 -- 172.21.15.18:0/3948707091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0ab9d0 con 0x7f57c00ccbf0 2024-04-25T10:04:35.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- 172.21.15.18:0/3948707091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c00ccbf0 msgr2=0x7f57c015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c00ccbf0 0x7f57c015e920 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009870 tx=0x7f57ac01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- 172.21.15.18:0/3948707091 shutdown_connections 2024-04-25T10:04:35.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c00ccbf0 0x7f57c015e920 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 --2- 172.21.15.18:0/3948707091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c0144120 0x7f57c015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- 172.21.15.18:0/3948707091 >> 172.21.15.18:0/3948707091 conn(0x7f57c0067080 msgr2=0x7f57c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- 172.21.15.18:0/3948707091 shutdown_connections 2024-04-25T10:04:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- 172.21.15.18:0/3948707091 wait complete. 2024-04-25T10:04:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 Processor -- start 2024-04-25T10:04:35.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.541+0000 7f57c8600640 1 -- start start 2024-04-25T10:04:35.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c00ccbf0 0x7f57c0159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 0x7f57c012e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 0x7f57c013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01675c0 con 0x7f57c015ee60 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0167440 con 0x7f57c0144120 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0167740 con 0x7f57c00ccbf0 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 0x7f57c012e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 0x7f57c013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c00ccbf0 0x7f57c0159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 0x7f57c012e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:39496/0 (socket says 172.21.15.18:39496) 2024-04-25T10:04:35.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c5200640 1 -- 172.21.15.18:0/3786382549 learned_addr learned my addr 172.21.15.18:0/3786382549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 -- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c00ccbf0 msgr2=0x7f57c0159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c00ccbf0 0x7f57c0159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 -- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 msgr2=0x7f57c012e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 0x7f57c012e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 -- 172.21.15.18:0/3786382549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00b1080 con 0x7f57c015ee60 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c6600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 0x7f57c013eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c700 tx=0x7f57b800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8003b80 con 0x7f57c015ee60 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8003d20 con 0x7f57c015ee60 2024-04-25T10:04:35.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8005310 con 0x7f57c015ee60 2024-04-25T10:04:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c0141b80 con 0x7f57c015ee60 2024-04-25T10:04:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0142420 con 0x7f57c015ee60 2024-04-25T10:04:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c00745d0 con 0x7f57c015ee60 2024-04-25T10:04:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.545+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57b80054b0 con 0x7f57c015ee60 2024-04-25T10:04:35.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.549+0000 7f57bd600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 0x7f57a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.549+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f57b80850c0 con 0x7f57c015ee60 2024-04-25T10:04:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.549+0000 7f57c5c00640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 0x7f57a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.549+0000 7f57c5c00640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 0x7f57a0069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57b4007a60 tx=0x7f57b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.553+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f57b80556a0 con 0x7f57c015ee60 2024-04-25T10:04:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.713+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57c00cc070 con 0x7f57c015ee60 2024-04-25T10:04:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.713+0000 7f57bd600640 1 -- 172.21.15.18:0/3786382549 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57b8059740 con 0x7f57c015ee60 2024-04-25T10:04:35.723 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:35.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 msgr2=0x7f57a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 0x7f57a0069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f57b4007a60 tx=0x7f57b4008040 comp rx=0 tx=0).stop 2024-04-25T10:04:35.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 msgr2=0x7f57c013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 0x7f57c013eef0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c700 tx=0x7f57b800cbc0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 shutdown_connections 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57c015ee60 0x7f57c013eef0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57c0144120 0x7f57c012e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57a0066f60 0x7f57a0069420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 --2- 172.21.15.18:0/3786382549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57c00ccbf0 0x7f57c0159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 >> 172.21.15.18:0/3786382549 conn(0x7f57c0067080 msgr2=0x7f57c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 shutdown_connections 2024-04-25T10:04:35.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.717+0000 7f57c8600640 1 -- 172.21.15.18:0/3786382549 wait complete. 2024-04-25T10:04:35.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:35.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 Processor -- start 2024-04-25T10:04:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 -- start start 2024-04-25T10:04:35.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 0x7f4f380cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3809ade0 con 0x7f4f380d0080 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f38099a60 con 0x7f4f3815fac0 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f3d000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f38099d40 con 0x7f4f3815b9e0 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f2fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4f380d0080 0x7f4f3815f3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46360/0 (socket says 172.21.15.18:46360) 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f2fe00640 1 -- 172.21.15.18:0/4114998028 learned_addr learned my addr 172.21.15.18:0/4114998028 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:35.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f37400640 1 --2- 172.21.15.18:0/4114998028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 0x7f4f380cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954725989 0 0) 0x7f4f20001120 con 0x7f4f380d0080 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f1c003530 con 0x7f4f380d0080 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f37400640 1 -- 172.21.15.18:0/4114998028 >> v1:172.21.15.167:6789/0 conn(0x7f4f3815fac0 legacy=0x7f4f380cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 76121409 0 0) 0x7f4f38099a60 con 0x7f4f3815fac0 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f37400640 1 -- 172.21.15.18:0/4114998028 >> v1:172.21.15.18:6789/0 conn(0x7f4f380d0080 legacy=0x7f4f3815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.881+0000 7f4f37400640 1 -- 172.21.15.18:0/4114998028 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3809a020 con 0x7f4f3815b9e0 2024-04-25T10:04:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f37400640 1 --2- 172.21.15.18:0/4114998028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 0x7f4f380cfb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f280097f0 tx=0x7f4f2801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5680f1c6fd35f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280a6040 con 0x7f4f3815b9e0 2024-04-25T10:04:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280af070 con 0x7f4f3815b9e0 2024-04-25T10:04:35.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f36a00640 1 -- 172.21.15.18:0/4114998028 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280aa840 con 0x7f4f3815b9e0 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 -- 172.21.15.18:0/4114998028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 msgr2=0x7f4f380cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 --2- 172.21.15.18:0/4114998028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 0x7f4f380cfb40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f280097f0 tx=0x7f4f2801c4e0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 -- 172.21.15.18:0/4114998028 shutdown_connections 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 --2- 172.21.15.18:0/4114998028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815b9e0 0x7f4f380cfb40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 -- 172.21.15.18:0/4114998028 >> 172.21.15.18:0/4114998028 conn(0x7f4f380b3030 msgr2=0x7f4f380b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 -- 172.21.15.18:0/4114998028 shutdown_connections 2024-04-25T10:04:35.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.885+0000 7f4f3d000640 1 -- 172.21.15.18:0/4114998028 wait complete. 2024-04-25T10:04:35.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 Processor -- start 2024-04-25T10:04:35.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- start start 2024-04-25T10:04:35.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f3815b9e0 0x7f4f38157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815fac0 0x7f4f38157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380cd0f0 con 0x7f4f380d0080 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380ccf70 con 0x7f4f3815b9e0 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380cd270 con 0x7f4f3815fac0 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41018/0 (socket says 172.21.15.18:41018) 2024-04-25T10:04:35.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 -- 172.21.15.18:0/1637346276 learned_addr learned my addr 172.21.15.18:0/1637346276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:35.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 -- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815fac0 msgr2=0x7f4f38157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815fac0 0x7f4f38157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 -- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f3815b9e0 msgr2=0x7f4f38157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f3815b9e0 0x7f4f38157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 -- 172.21.15.18:0/1637346276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f381faaf0 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f37400640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c10 tx=0x7f4f2801ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28006e20 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280bd3f0 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280bd7a0 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f381fad90 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38165520 con 0x7f4f380d0080 2024-04-25T10:04:35.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.889+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f380745d0 con 0x7f4f380d0080 2024-04-25T10:04:35.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.893+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f280b33f0 con 0x7f4f380d0080 2024-04-25T10:04:35.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.893+0000 7f4f2f400640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 0x7f4f14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:35.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.893+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4f2811f1e0 con 0x7f4f380d0080 2024-04-25T10:04:35.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.893+0000 7f4f2fe00640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 0x7f4f14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:35.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.893+0000 7f4f2fe00640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 0x7f4f14069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000f70 tx=0x7f4f20001120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:35.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:35.897+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f280160d0 con 0x7f4f380d0080 2024-04-25T10:04:36.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f380d1320 con 0x7f4f380d0080 2024-04-25T10:04:36.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f2f400640 1 -- 172.21.15.18:0/1637346276 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f280ef7c0 con 0x7f4f380d0080 2024-04-25T10:04:36.074 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 msgr2=0x7f4f14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 0x7f4f14069420 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000f70 tx=0x7f4f20001120 comp rx=0 tx=0).stop 2024-04-25T10:04:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 msgr2=0x7f4f38152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f28000c10 tx=0x7f4f2801ad20 comp rx=0 tx=0).stop 2024-04-25T10:04:36.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 shutdown_connections 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f14066f60 0x7f4f14069420 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f3815fac0 0x7f4f38157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f3815b9e0 0x7f4f38157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 --2- 172.21.15.18:0/1637346276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f380d0080 0x7f4f38152100 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 >> 172.21.15.18:0/1637346276 conn(0x7f4f380b3030 msgr2=0x7f4f3806c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 shutdown_connections 2024-04-25T10:04:36.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.065+0000 7f4f3d000640 1 -- 172.21.15.18:0/1637346276 wait complete. 2024-04-25T10:04:36.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:36.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 Processor -- start 2024-04-25T10:04:36.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 -- start start 2024-04-25T10:04:36.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14b006bf30 0x7f14b00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b015e040 con 0x7f14b009a170 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b00cff80 con 0x7f14b015dc60 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14b6600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b00d0260 con 0x7f14b006bf30 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14a6a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f14b009a170 0x7f14b00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46366/0 (socket says 172.21.15.18:46366) 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14a6a00640 1 -- 172.21.15.18:0/1104236492 learned_addr learned my addr 172.21.15.18:0/1104236492 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14afe00640 1 --2- 172.21.15.18:0/1104236492 >> v2:172.21.15.18:3300/0 conn(0x7f14b006bf30 0x7f14b00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14afe00640 1 -- 172.21.15.18:0/1104236492 >> v1:172.21.15.167:6789/0 conn(0x7f14b015dc60 legacy=0x7f14b0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14afe00640 1 -- 172.21.15.18:0/1104236492 >> v1:172.21.15.18:6789/0 conn(0x7f14b009a170 legacy=0x7f14b00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.229+0000 7f14afe00640 1 -- 172.21.15.18:0/1104236492 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00d0540 con 0x7f14b006bf30 2024-04-25T10:04:36.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14afe00640 1 --2- 172.21.15.18:0/1104236492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b006bf30 0x7f14b00d1020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009d90 tx=0x7f14a801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181c79120a2f8f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14aea00640 1 -- 172.21.15.18:0/1104236492 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80b2070 con 0x7f14b006bf30 2024-04-25T10:04:36.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14aea00640 1 -- 172.21.15.18:0/1104236492 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a80a58e0 con 0x7f14b006bf30 2024-04-25T10:04:36.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14aea00640 1 -- 172.21.15.18:0/1104236492 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80a5cb0 con 0x7f14b006bf30 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 -- 172.21.15.18:0/1104236492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b006bf30 msgr2=0x7f14b00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 --2- 172.21.15.18:0/1104236492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b006bf30 0x7f14b00d1020 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009d90 tx=0x7f14a801c820 comp rx=0 tx=0).stop 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 -- 172.21.15.18:0/1104236492 shutdown_connections 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 --2- 172.21.15.18:0/1104236492 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b006bf30 0x7f14b00d1020 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 -- 172.21.15.18:0/1104236492 >> 172.21.15.18:0/1104236492 conn(0x7f14b00b3200 msgr2=0x7f14b00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 -- 172.21.15.18:0/1104236492 shutdown_connections 2024-04-25T10:04:36.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.233+0000 7f14b6600640 1 -- 172.21.15.18:0/1104236492 wait complete. 2024-04-25T10:04:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 Processor -- start 2024-04-25T10:04:36.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- start start 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 0x7f14b00b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14b009a170 0x7f14b00ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b006cfa0 con 0x7f14b015dc60 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00cc880 con 0x7f14b009a170 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00b6d90 con 0x7f14b006bf30 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41026/0 (socket says 172.21.15.18:41026) 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 -- 172.21.15.18:0/1109659211 learned_addr learned my addr 172.21.15.18:0/1109659211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:36.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14a6a00640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14b009a170 0x7f14b00ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14af400640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 0x7f14b00b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 -- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 msgr2=0x7f14b00b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 0x7f14b00b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 -- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14b009a170 msgr2=0x7f14b00ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14b009a170 0x7f14b00ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 -- 172.21.15.18:0/1109659211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00b6180 con 0x7f14b015dc60 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14af400640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 0x7f14b00b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14afe00640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a80b0040 tx=0x7f14a80195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80bd020 con 0x7f14b015dc60 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a80ad6c0 con 0x7f14b015dc60 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a80b2040 con 0x7f14b015dc60 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b00b6460 con 0x7f14b015dc60 2024-04-25T10:04:36.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00b6a20 con 0x7f14b015dc60 2024-04-25T10:04:36.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.237+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b00745d0 con 0x7f14b015dc60 2024-04-25T10:04:36.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.241+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f14a80c0020 con 0x7f14b015dc60 2024-04-25T10:04:36.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.241+0000 7f14a7e00640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.241+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f14a8120510 con 0x7f14b015dc60 2024-04-25T10:04:36.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.241+0000 7f14af400640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.241+0000 7f14af400640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 0x7f148c069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14b00c8600 tx=0x7f14a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.245+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14a80c7030 con 0x7f14b015dc60 2024-04-25T10:04:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f14b00b7590 con 0x7f14b015dc60 2024-04-25T10:04:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14a7e00640 1 -- 172.21.15.18:0/1109659211 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f14a8016560 con 0x7f14b015dc60 2024-04-25T10:04:36.414 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 msgr2=0x7f148c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 0x7f148c069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f14b00c8600 tx=0x7f14a0009040 comp rx=0 tx=0).stop 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 msgr2=0x7f14b00c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f14a80b0040 tx=0x7f14a80195c0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 shutdown_connections 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14b015dc60 0x7f14b00c87e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14b009a170 0x7f14b00ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f148c066f60 0x7f148c069420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 --2- 172.21.15.18:0/1109659211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f14b006bf30 0x7f14b00b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 >> 172.21.15.18:0/1109659211 conn(0x7f14b00b3200 msgr2=0x7f14b00b43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 shutdown_connections 2024-04-25T10:04:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.405+0000 7f14b6600640 1 -- 172.21.15.18:0/1109659211 wait complete. 2024-04-25T10:04:36.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:36.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.569+0000 7f3461000640 1 Processor -- start 2024-04-25T10:04:36.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.569+0000 7f3461000640 1 -- start start 2024-04-25T10:04:36.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3461000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c15b910 0x7f345c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3461000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f345c15bcf0 0x7f345c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3461000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345c0d02a0 con 0x7f345c0cf3c0 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3461000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f345c0cc350 con 0x7f345c15bcf0 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3461000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c0cc630 con 0x7f345c15b910 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f345c15bcf0 0x7f345c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f345c15bcf0 0x7f345c099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41036/0 (socket says 172.21.15.18:41036) 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 -- 172.21.15.18:0/1050911016 learned_addr learned my addr 172.21.15.18:0/1050911016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:36.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f3459e00640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c15b910 0x7f345c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 -- 172.21.15.18:0/1050911016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c15b910 msgr2=0x7f345c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:36.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c15b910 0x7f345c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 -- 172.21.15.18:0/1050911016 >> v1:172.21.15.167:6789/0 conn(0x7f345c0cf3c0 legacy=0x7f345c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:36.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.573+0000 7f345a800640 1 -- 172.21.15.18:0/1050911016 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c0cc910 con 0x7f345c15bcf0 2024-04-25T10:04:36.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f345a800640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15bcf0 0x7f345c099a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3454009e50 tx=0x7f345401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24964c997ca559b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3459400640 1 -- 172.21.15.18:0/1050911016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540a57e0 con 0x7f345c15bcf0 2024-04-25T10:04:36.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3459400640 1 -- 172.21.15.18:0/1050911016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34540a5980 con 0x7f345c15bcf0 2024-04-25T10:04:36.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3459400640 1 -- 172.21.15.18:0/1050911016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540a5d50 con 0x7f345c15bcf0 2024-04-25T10:04:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- 172.21.15.18:0/1050911016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15bcf0 msgr2=0x7f345c099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15bcf0 0x7f345c099a60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3454009e50 tx=0x7f345401ca00 comp rx=0 tx=0).stop 2024-04-25T10:04:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- 172.21.15.18:0/1050911016 shutdown_connections 2024-04-25T10:04:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15bcf0 0x7f345c099a60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 --2- 172.21.15.18:0/1050911016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c15b910 0x7f345c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- 172.21.15.18:0/1050911016 >> 172.21.15.18:0/1050911016 conn(0x7f345c0b3200 msgr2=0x7f345c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- 172.21.15.18:0/1050911016 shutdown_connections 2024-04-25T10:04:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- 172.21.15.18:0/1050911016 wait complete. 2024-04-25T10:04:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 Processor -- start 2024-04-25T10:04:36.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 -- start start 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c0cf3c0 0x7f345c0b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.577+0000 7f3461000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f345c15bcf0 0x7f345c0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c168b20 con 0x7f345c15b910 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345c1689a0 con 0x7f345c15bcf0 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f345c168ca0 con 0x7f345c0cf3c0 2024-04-25T10:04:36.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41044/0 (socket says 172.21.15.18:41044) 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 -- 172.21.15.18:0/4079996356 learned_addr learned my addr 172.21.15.18:0/4079996356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3459e00640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c0cf3c0 0x7f345c0b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f345a800640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f345c15bcf0 0x7f345c0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 -- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c0cf3c0 msgr2=0x7f345c0b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c0cf3c0 0x7f345c0b46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 -- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f345c15bcf0 msgr2=0x7f345c0b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f345c15bcf0 0x7f345c0b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 -- 172.21.15.18:0/4079996356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f345c158db0 con 0x7f345c15b910 2024-04-25T10:04:36.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3451400640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f344400c460 tx=0x7f344400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444016020 con 0x7f345c15b910 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34440052d0 con 0x7f345c15b910 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444007260 con 0x7f345c15b910 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f345c15ab00 con 0x7f345c15b910 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f345c0b7040 con 0x7f345c15b910 2024-04-25T10:04:36.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345c0745d0 con 0x7f345c15b910 2024-04-25T10:04:36.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.581+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3444007400 con 0x7f345c15b910 2024-04-25T10:04:36.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.585+0000 7f3452a00640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 0x7f3438069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.585+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3444084cc0 con 0x7f345c15b910 2024-04-25T10:04:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.585+0000 7f3459e00640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 0x7f3438069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.585+0000 7f3459e00640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 0x7f3438069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f344c007a60 tx=0x7f344c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.589+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f344408b080 con 0x7f345c15b910 2024-04-25T10:04:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f345c0cdcd0 con 0x7f345c15b910 2024-04-25T10:04:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3452a00640 1 -- 172.21.15.18:0/4079996356 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3444020020 con 0x7f345c15b910 2024-04-25T10:04:36.758 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 msgr2=0x7f3438069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 0x7f3438069420 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f344c007a60 tx=0x7f344c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 msgr2=0x7f345c0b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f344400c460 tx=0x7f344400c920 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 shutdown_connections 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f345c15bcf0 0x7f345c0b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f345c15b910 0x7f345c0b61a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3438066f60 0x7f3438069420 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 --2- 172.21.15.18:0/4079996356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f345c0cf3c0 0x7f345c0b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 >> 172.21.15.18:0/4079996356 conn(0x7f345c0b3200 msgr2=0x7f345c0c66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.749+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 shutdown_connections 2024-04-25T10:04:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.753+0000 7f3461000640 1 -- 172.21.15.18:0/4079996356 wait complete. 2024-04-25T10:04:36.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:36.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.913+0000 7f3154800640 1 Processor -- start 2024-04-25T10:04:36.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.913+0000 7f3154800640 1 -- start start 2024-04-25T10:04:36.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3154800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f314c15be90 0x7f314c15f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3154800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c15f990 0x7f314c0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3154800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314c0cd4c0 con 0x7f314c145100 2024-04-25T10:04:36.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3154800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314c0cd7a0 con 0x7f314c15be90 2024-04-25T10:04:36.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3154800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0cda80 con 0x7f314c15f990 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f314c15be90 0x7f314c15f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f314c15be90 0x7f314c15f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41060/0 (socket says 172.21.15.18:41060) 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 -- 172.21.15.18:0/4090743507 learned_addr learned my addr 172.21.15.18:0/4090743507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3152800640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c15f990 0x7f314c0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 -- 172.21.15.18:0/4090743507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c15f990 msgr2=0x7f314c0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c15f990 0x7f314c0ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 -- 172.21.15.18:0/4090743507 >> v1:172.21.15.18:6789/0 conn(0x7f314c145100 legacy=0x7f314c070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:36.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.917+0000 7f3151400640 1 -- 172.21.15.18:0/4090743507 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0cdd60 con 0x7f314c15be90 2024-04-25T10:04:36.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3151400640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15be90 0x7f314c15f450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f313c009870 tx=0x7f313c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf0e229215e026e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3150a00640 1 -- 172.21.15.18:0/4090743507 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0b0070 con 0x7f314c15be90 2024-04-25T10:04:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3150a00640 1 -- 172.21.15.18:0/4090743507 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c0ab600 con 0x7f314c15be90 2024-04-25T10:04:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3150a00640 1 -- 172.21.15.18:0/4090743507 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0ab9d0 con 0x7f314c15be90 2024-04-25T10:04:36.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 -- 172.21.15.18:0/4090743507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15be90 msgr2=0x7f314c15f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15be90 0x7f314c15f450 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f313c009870 tx=0x7f313c01c520 comp rx=0 tx=0).stop 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 -- 172.21.15.18:0/4090743507 shutdown_connections 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c15f990 0x7f314c0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 --2- 172.21.15.18:0/4090743507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15be90 0x7f314c15f450 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 -- 172.21.15.18:0/4090743507 >> 172.21.15.18:0/4090743507 conn(0x7f314c0b2400 msgr2=0x7f314c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:36.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 -- 172.21.15.18:0/4090743507 shutdown_connections 2024-04-25T10:04:36.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.921+0000 7f3154800640 1 -- 172.21.15.18:0/4090743507 wait complete. 2024-04-25T10:04:36.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.925+0000 7f3154800640 1 Processor -- start 2024-04-25T10:04:36.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.925+0000 7f3154800640 1 -- start start 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f314c15be90 0x7f314c15aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 0x7f314c13a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0cd260 con 0x7f314c15f990 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c0cd0e0 con 0x7f314c15be90 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314c1687d0 con 0x7f314c145100 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57514/0 (socket says 172.21.15.18:57514) 2024-04-25T10:04:36.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 -- 172.21.15.18:0/1147379065 learned_addr learned my addr 172.21.15.18:0/1147379065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:36.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151400640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f314c15be90 0x7f314c15aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3152800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 0x7f314c13a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 -- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f314c15be90 msgr2=0x7f314c15aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f314c15be90 0x7f314c15aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 -- 172.21.15.18:0/1147379065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 msgr2=0x7f314c13a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 0x7f314c13a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 -- 172.21.15.18:0/1147379065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c15d0e0 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3152800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 0x7f314c13a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3151e00640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f314000c480 tx=0x7f314000c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140012830 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3140017070 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3140012c30 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c15d3c0 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.929+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c139b20 con 0x7f314c145100 2024-04-25T10:04:36.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c139650 con 0x7f314c145100 2024-04-25T10:04:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f314001c460 con 0x7f314c145100 2024-04-25T10:04:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3146000640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 0x7f3130069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3140085210 con 0x7f314c145100 2024-04-25T10:04:36.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3151400640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 0x7f3130069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:36.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.933+0000 7f3151400640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 0x7f3130069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f313c0ad000 tx=0x7f313c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:36.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:36.937+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3140055e10 con 0x7f314c145100 2024-04-25T10:04:37.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.101+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f314c0745d0 con 0x7f314c145100 2024-04-25T10:04:37.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3146000640 1 -- 172.21.15.18:0/1147379065 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f3140055710 con 0x7f314c145100 2024-04-25T10:04:37.113 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 msgr2=0x7f3130069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 0x7f3130069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f313c0ad000 tx=0x7f313c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 msgr2=0x7f314c156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f314000c480 tx=0x7f314000c940 comp rx=0 tx=0).stop 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 shutdown_connections 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f314c15f990 0x7f314c13a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f314c15be90 0x7f314c15aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3130066f60 0x7f3130069420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 --2- 172.21.15.18:0/1147379065 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f314c145100 0x7f314c156900 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 >> 172.21.15.18:0/1147379065 conn(0x7f314c0b2400 msgr2=0x7f314c06fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 shutdown_connections 2024-04-25T10:04:37.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.105+0000 7f3154800640 1 -- 172.21.15.18:0/1147379065 wait complete. 2024-04-25T10:04:37.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:37.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:37.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 Processor -- start 2024-04-25T10:04:37.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 -- start start 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7560144120 0x7f756015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75600ccbf0 0x7f756015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f756015bc40 con 0x7f756015ee60 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756015e490 con 0x7f7560144120 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7567e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f756015b3a0 con 0x7f75600ccbf0 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7560144120 0x7f756015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f756015ee60 0x7f75600b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46384/0 (socket says 172.21.15.18:46384) 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565e00640 1 -- 172.21.15.18:0/1116057554 learned_addr learned my addr 172.21.15.18:0/1116057554 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565400640 1 -- 172.21.15.18:0/1116057554 >> v2:172.21.15.167:3300/0 conn(0x7f75600ccbf0 msgr2=0x7f756015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:37.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565400640 1 --2- 172.21.15.18:0/1116057554 >> v2:172.21.15.167:3300/0 conn(0x7f75600ccbf0 0x7f756015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565400640 1 -- 172.21.15.18:0/1116057554 >> v1:172.21.15.18:6789/0 conn(0x7f756015ee60 legacy=0x7f75600b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f7565400640 1 -- 172.21.15.18:0/1116057554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756015b680 con 0x7f7560144120 2024-04-25T10:04:37.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.269+0000 7f755fe00640 1 -- 172.21.15.18:0/1116057554 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837136128 0 0) 0x7f756015bc40 con 0x7f756015ee60 2024-04-25T10:04:37.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7565400640 1 --2- 172.21.15.18:0/1116057554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7560144120 0x7f756015acd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f756006b870 tx=0x7f755401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297f4771a05a692c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f755fe00640 1 -- 172.21.15.18:0/1116057554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540b0070 con 0x7f7560144120 2024-04-25T10:04:37.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f755fe00640 1 -- 172.21.15.18:0/1116057554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75540ab600 con 0x7f7560144120 2024-04-25T10:04:37.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f755fe00640 1 -- 172.21.15.18:0/1116057554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540ab9d0 con 0x7f7560144120 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 -- 172.21.15.18:0/1116057554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7560144120 msgr2=0x7f756015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 --2- 172.21.15.18:0/1116057554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7560144120 0x7f756015acd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f756006b870 tx=0x7f755401c3f0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 -- 172.21.15.18:0/1116057554 shutdown_connections 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 --2- 172.21.15.18:0/1116057554 >> v2:172.21.15.167:3300/0 conn(0x7f75600ccbf0 0x7f756015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 --2- 172.21.15.18:0/1116057554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7560144120 0x7f756015acd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 -- 172.21.15.18:0/1116057554 >> 172.21.15.18:0/1116057554 conn(0x7f7560067080 msgr2=0x7f756006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 -- 172.21.15.18:0/1116057554 shutdown_connections 2024-04-25T10:04:37.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.273+0000 7f7567e00640 1 -- 172.21.15.18:0/1116057554 wait complete. 2024-04-25T10:04:37.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 Processor -- start 2024-04-25T10:04:37.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- start start 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 0x7f756006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f756015ee60 0x7f756006d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75601675c0 con 0x7f75600ccbf0 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7560167440 con 0x7f7560144120 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7560167740 con 0x7f756015ee60 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41106/0 (socket says 172.21.15.18:41106) 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 -- 172.21.15.18:0/2960996725 learned_addr learned my addr 172.21.15.18:0/2960996725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7564a00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 0x7f756006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f756015ee60 0x7f756006d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 -- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f756015ee60 msgr2=0x7f756006d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f756015ee60 0x7f756006d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 -- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 msgr2=0x7f756006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 0x7f756006d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 -- 172.21.15.18:0/2960996725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756013e7a0 con 0x7f75600ccbf0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7564a00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 0x7f756006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7565400640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f755401a020 tx=0x7f755401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540b0040 con 0x7f75600ccbf0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554004020 con 0x7f75600ccbf0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75540043d0 con 0x7f75600ccbf0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756015cec0 con 0x7f75600ccbf0 2024-04-25T10:04:37.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.277+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756015d480 con 0x7f75600ccbf0 2024-04-25T10:04:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75600745d0 con 0x7f75600ccbf0 2024-04-25T10:04:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75540bf060 con 0x7f75600ccbf0 2024-04-25T10:04:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f755d600640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 0x7f7540069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f755411f090 con 0x7f75600ccbf0 2024-04-25T10:04:37.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f7564a00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 0x7f7540069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.281+0000 7f7564a00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 0x7f7540069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f754c006fd0 tx=0x7f754c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.285+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7554016070 con 0x7f75600ccbf0 2024-04-25T10:04:37.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.449+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f756015b0e0 con 0x7f75600ccbf0 2024-04-25T10:04:37.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.449+0000 7f755d600640 1 -- 172.21.15.18:0/2960996725 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75540b4370 con 0x7f75600ccbf0 2024-04-25T10:04:37.459 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.449+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 msgr2=0x7f7540069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.449+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 0x7f7540069420 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f754c006fd0 tx=0x7f754c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 msgr2=0x7f75601592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f755401a020 tx=0x7f755401ac30 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 shutdown_connections 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7540066f60 0x7f7540069420 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f756015ee60 0x7f756006d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7560144120 0x7f756006d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 --2- 172.21.15.18:0/2960996725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75600ccbf0 0x7f75601592e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 >> 172.21.15.18:0/2960996725 conn(0x7f7560067080 msgr2=0x7f75600cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 shutdown_connections 2024-04-25T10:04:37.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.453+0000 7f7567e00640 1 -- 172.21.15.18:0/2960996725 wait complete. 2024-04-25T10:04:37.479 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:37.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.613+0000 7f2ce4400640 1 Processor -- start 2024-04-25T10:04:37.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.613+0000 7f2ce4400640 1 -- start start 2024-04-25T10:04:37.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce4400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2cdc144120 0x7f2cdc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce4400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 0x7f2cdc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce4400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc15bc40 con 0x7f2cdc0ccbf0 2024-04-25T10:04:37.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce4400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc15e490 con 0x7f2cdc144120 2024-04-25T10:04:37.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce4400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc15b3a0 con 0x7f2cdc0b3090 2024-04-25T10:04:37.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2cdc0ccbf0 0x7f2cdc15e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46386/0 (socket says 172.21.15.18:46386) 2024-04-25T10:04:37.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1000640 1 -- 172.21.15.18:0/3501391072 learned_addr learned my addr 172.21.15.18:0/3501391072 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/3501391072 >> v2:172.21.15.167:3300/0 conn(0x7f2cdc144120 0x7f2cdc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce2400640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 0x7f2cdc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2cdbe00640 1 -- 172.21.15.18:0/3501391072 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388438991 0 0) 0x7f2cdc15bc40 con 0x7f2cdc0ccbf0 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2cdbe00640 1 -- 172.21.15.18:0/3501391072 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc4003530 con 0x7f2cdc0ccbf0 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1a00640 1 -- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 msgr2=0x7f2cdc0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 0x7f2cdc0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1a00640 1 -- 172.21.15.18:0/3501391072 >> v1:172.21.15.18:6789/0 conn(0x7f2cdc0ccbf0 legacy=0x7f2cdc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce1a00640 1 -- 172.21.15.18:0/3501391072 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc15b680 con 0x7f2cdc144120 2024-04-25T10:04:37.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.617+0000 7f2ce2400640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 0x7f2cdc0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:37.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc144120 0x7f2cdc15acd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097c0 tx=0x7f2cd001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac160d1f0743f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2cdbe00640 1 -- 172.21.15.18:0/3501391072 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00b0070 con 0x7f2cdc144120 2024-04-25T10:04:37.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2cdbe00640 1 -- 172.21.15.18:0/3501391072 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd00ab600 con 0x7f2cdc144120 2024-04-25T10:04:37.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2cdbe00640 1 -- 172.21.15.18:0/3501391072 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd00ab9d0 con 0x7f2cdc144120 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc144120 msgr2=0x7f2cdc15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc144120 0x7f2cdc15acd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00097c0 tx=0x7f2cd001c410 comp rx=0 tx=0).stop 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- 172.21.15.18:0/3501391072 shutdown_connections 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0b3090 0x7f2cdc0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- 172.21.15.18:0/3501391072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc144120 0x7f2cdc15acd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- 172.21.15.18:0/3501391072 >> 172.21.15.18:0/3501391072 conn(0x7f2cdc067080 msgr2=0x7f2cdc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- 172.21.15.18:0/3501391072 shutdown_connections 2024-04-25T10:04:37.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- 172.21.15.18:0/3501391072 wait complete. 2024-04-25T10:04:37.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 Processor -- start 2024-04-25T10:04:37.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- start start 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc0b3090 0x7f2cdc159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0ccbf0 0x7f2cdc13cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc1675c0 con 0x7f2cdc144120 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc167440 con 0x7f2cdc0b3090 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce4400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc167740 con 0x7f2cdc0ccbf0 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41110/0 (socket says 172.21.15.18:41110) 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.621+0000 7f2ce2400640 1 -- 172.21.15.18:0/143777244 learned_addr learned my addr 172.21.15.18:0/143777244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:37.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc0b3090 0x7f2cdc159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce1000640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0ccbf0 0x7f2cdc13cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 -- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0ccbf0 msgr2=0x7f2cdc13cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0ccbf0 0x7f2cdc13cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 -- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc0b3090 msgr2=0x7f2cdc159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc0b3090 0x7f2cdc159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 -- 172.21.15.18:0/143777244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0afb20 con 0x7f2cdc144120 2024-04-25T10:04:37.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce2400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009f00 tx=0x7f2cd400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4018030 con 0x7f2cdc144120 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400ce50 con 0x7f2cdc144120 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4003bc0 con 0x7f2cdc144120 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc13c5b0 con 0x7f2cdc144120 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc13cb70 con 0x7f2cdc144120 2024-04-25T10:04:37.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc0745d0 con 0x7f2cdc144120 2024-04-25T10:04:37.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2cd401b070 con 0x7f2cdc144120 2024-04-25T10:04:37.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 0x7f2cbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.625+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f2cd4085db0 con 0x7f2cdc144120 2024-04-25T10:04:37.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.629+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 0x7f2cbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.629+0000 7f2ce1a00640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 0x7f2cbc069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00ad000 tx=0x7f2cd00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.629+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2cd408a070 con 0x7f2cdc144120 2024-04-25T10:04:37.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.789+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2cdc13d4d0 con 0x7f2cdc144120 2024-04-25T10:04:37.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.789+0000 7f2cd9600640 1 -- 172.21.15.18:0/143777244 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2cd4022070 con 0x7f2cdc144120 2024-04-25T10:04:37.800 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:37.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 msgr2=0x7f2cbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 0x7f2cbc069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2cd00ad000 tx=0x7f2cd00a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 msgr2=0x7f2cdc0b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4009f00 tx=0x7f2cd400c490 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 shutdown_connections 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cdc144120 0x7f2cdc0b05c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2cbc066f60 0x7f2cbc069420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2cdc0ccbf0 0x7f2cdc13cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 --2- 172.21.15.18:0/143777244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cdc0b3090 0x7f2cdc159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 >> 172.21.15.18:0/143777244 conn(0x7f2cdc067080 msgr2=0x7f2cdc141230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 shutdown_connections 2024-04-25T10:04:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.793+0000 7f2ce4400640 1 -- 172.21.15.18:0/143777244 wait complete. 2024-04-25T10:04:37.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:37.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 Processor -- start 2024-04-25T10:04:37.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 -- start start 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e815bc40 con 0x7f27e815ee60 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e815e490 con 0x7f27e8144120 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27ece00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e815b3a0 con 0x7f27e80ccbf0 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27e5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27e5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:39584/0 (socket says 172.21.15.18:39584) 2024-04-25T10:04:37.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27e5e00640 1 -- 172.21.15.18:0/3983335701 learned_addr learned my addr 172.21.15.18:0/3983335701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:57542/0 (socket says 172.21.15.18:57542) 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 -- 172.21.15.18:0/3983335701 >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 msgr2=0x7f27e815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 --2- 172.21.15.18:0/3983335701 >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 -- 172.21.15.18:0/3983335701 >> v1:172.21.15.167:6789/0 conn(0x7f27e815ee60 legacy=0x7f27e80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27dd400640 1 -- 172.21.15.18:0/3983335701 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e815b680 con 0x7f27e80ccbf0 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27e5e00640 1 --2- 172.21.15.18:0/3983335701 >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:37.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.957+0000 7f27e5400640 1 -- 172.21.15.18:0/3983335701 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 175700368 0 0) 0x7f27e815bc40 con 0x7f27e815ee60 2024-04-25T10:04:37.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27dd400640 1 --2- 172.21.15.18:0/3983335701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27d000ba60 tx=0x7f27d001eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ffbce2af978978 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27e5400640 1 -- 172.21.15.18:0/3983335701 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00b4070 con 0x7f27e80ccbf0 2024-04-25T10:04:37.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27e5400640 1 -- 172.21.15.18:0/3983335701 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d00a79b0 con 0x7f27e80ccbf0 2024-04-25T10:04:37.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27e5400640 1 -- 172.21.15.18:0/3983335701 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00a7d80 con 0x7f27e80ccbf0 2024-04-25T10:04:37.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 -- 172.21.15.18:0/3983335701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 msgr2=0x7f27e815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 --2- 172.21.15.18:0/3983335701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f27d000ba60 tx=0x7f27d001eae0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 -- 172.21.15.18:0/3983335701 shutdown_connections 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 --2- 172.21.15.18:0/3983335701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e815e920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 --2- 172.21.15.18:0/3983335701 >> v2:172.21.15.167:3300/0 conn(0x7f27e8144120 0x7f27e815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 -- 172.21.15.18:0/3983335701 >> 172.21.15.18:0/3983335701 conn(0x7f27e8067080 msgr2=0x7f27e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 -- 172.21.15.18:0/3983335701 shutdown_connections 2024-04-25T10:04:37.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.961+0000 7f27ece00640 1 -- 172.21.15.18:0/3983335701 wait complete. 2024-04-25T10:04:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 Processor -- start 2024-04-25T10:04:37.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- start start 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e813b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8144120 0x7f27e8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e806dc60 con 0x7f27e815ee60 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e806dae0 con 0x7f27e8144120 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e806dde0 con 0x7f27e80ccbf0 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41118/0 (socket says 172.21.15.18:41118) 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 -- 172.21.15.18:0/3646039992 learned_addr learned my addr 172.21.15.18:0/3646039992 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27dd400640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8144120 0x7f27e8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e5e00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e813b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 -- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 msgr2=0x7f27e813b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e813b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 -- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8144120 msgr2=0x7f27e8159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8144120 0x7f27e8159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:37.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 -- 172.21.15.18:0/3646039992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e815a280 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27e6800640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c780 tx=0x7f27e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0003db0 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e000ce30 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0005290 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e8158ca0 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.965+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e8159260 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e80745d0 con 0x7f27e815ee60 2024-04-25T10:04:37.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27e0005430 con 0x7f27e815ee60 2024-04-25T10:04:37.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27dea00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 0x7f27c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:37.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f27e00851e0 con 0x7f27e815ee60 2024-04-25T10:04:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27e5e00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 0x7f27c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:37.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.969+0000 7f27e5e00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 0x7f27c4069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f27d8006cb0 tx=0x7f27d8009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:37.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:37.973+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27e0055700 con 0x7f27e815ee60 2024-04-25T10:04:38.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.133+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27e80b3f20 con 0x7f27e815ee60 2024-04-25T10:04:38.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.133+0000 7f27dea00640 1 -- 172.21.15.18:0/3646039992 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27e00597a0 con 0x7f27e815ee60 2024-04-25T10:04:38.143 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 msgr2=0x7f27c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 0x7f27c4069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f27d8006cb0 tx=0x7f27d8009240 comp rx=0 tx=0).stop 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 msgr2=0x7f27e8158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f27e000c780 tx=0x7f27e000cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 shutdown_connections 2024-04-25T10:04:38.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27e815ee60 0x7f27e8158470 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27e8144120 0x7f27e8159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27c4066f60 0x7f27c4069420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 --2- 172.21.15.18:0/3646039992 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27e80ccbf0 0x7f27e813b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 >> 172.21.15.18:0/3646039992 conn(0x7f27e8067080 msgr2=0x7f27e80b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 shutdown_connections 2024-04-25T10:04:38.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.137+0000 7f27ece00640 1 -- 172.21.15.18:0/3646039992 wait complete. 2024-04-25T10:04:38.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:38.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.297+0000 7f4fcd800640 1 Processor -- start 2024-04-25T10:04:38.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.297+0000 7f4fcd800640 1 -- start start 2024-04-25T10:04:38.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fcd800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4fc815acd0 0x7f4fc815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fcd800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc815bc40 con 0x7f4fc8144120 2024-04-25T10:04:38.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fcd800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fc815b3a0 con 0x7f4fc815ee60 2024-04-25T10:04:38.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fcd800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fc815e490 con 0x7f4fc815acd0 2024-04-25T10:04:38.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fc6a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4fc8144120 0x7f4fc80ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46392/0 (socket says 172.21.15.18:46392) 2024-04-25T10:04:38.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fc6a00640 1 -- 172.21.15.18:0/234862791 learned_addr learned my addr 172.21.15.18:0/234862791 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:38.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fbfe00640 1 --2- 172.21.15.18:0/234862791 >> v2:172.21.15.167:3300/0 conn(0x7f4fc815acd0 0x7f4fc815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fc6000640 1 -- 172.21.15.18:0/234862791 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754433301 0 0) 0x7f4fc815bc40 con 0x7f4fc8144120 2024-04-25T10:04:38.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fc6000640 1 -- 172.21.15.18:0/234862791 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fac003530 con 0x7f4fc8144120 2024-04-25T10:04:38.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fbfe00640 1 -- 172.21.15.18:0/234862791 >> v1:172.21.15.167:6789/0 conn(0x7f4fc815ee60 legacy=0x7f4fc80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fbfe00640 1 -- 172.21.15.18:0/234862791 >> v1:172.21.15.18:6789/0 conn(0x7f4fc8144120 legacy=0x7f4fc80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.301+0000 7f4fbfe00640 1 -- 172.21.15.18:0/234862791 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc815b680 con 0x7f4fc815acd0 2024-04-25T10:04:38.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fbfe00640 1 --2- 172.21.15.18:0/234862791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc815acd0 0x7f4fc815e920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00097c0 tx=0x7f4fb001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a6a1741cc9396f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fc6000640 1 -- 172.21.15.18:0/234862791 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00b0070 con 0x7f4fc815acd0 2024-04-25T10:04:38.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fc6000640 1 -- 172.21.15.18:0/234862791 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb00ab600 con 0x7f4fc815acd0 2024-04-25T10:04:38.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fc6000640 1 -- 172.21.15.18:0/234862791 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00ab9b0 con 0x7f4fc815acd0 2024-04-25T10:04:38.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- 172.21.15.18:0/234862791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc815acd0 msgr2=0x7f4fc815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 --2- 172.21.15.18:0/234862791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc815acd0 0x7f4fc815e920 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00097c0 tx=0x7f4fb001c410 comp rx=0 tx=0).stop 2024-04-25T10:04:38.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- 172.21.15.18:0/234862791 shutdown_connections 2024-04-25T10:04:38.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 --2- 172.21.15.18:0/234862791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc815acd0 0x7f4fc815e920 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- 172.21.15.18:0/234862791 >> 172.21.15.18:0/234862791 conn(0x7f4fc8067080 msgr2=0x7f4fc806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- 172.21.15.18:0/234862791 shutdown_connections 2024-04-25T10:04:38.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- 172.21.15.18:0/234862791 wait complete. 2024-04-25T10:04:38.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 Processor -- start 2024-04-25T10:04:38.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.305+0000 7f4fcd800640 1 -- start start 2024-04-25T10:04:38.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc8144120 0x7f4fc80aa6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fc815ee60 0x7f4fc813f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc8168660 con 0x7f4fc815acd0 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc815b150 con 0x7f4fc8144120 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81687e0 con 0x7f4fc815ee60 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41126/0 (socket says 172.21.15.18:41126) 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 -- 172.21.15.18:0/2286494251 learned_addr learned my addr 172.21.15.18:0/2286494251 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fc6a00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc8144120 0x7f4fc80aa6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fc7400640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fc815ee60 0x7f4fc813f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 -- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fc815ee60 msgr2=0x7f4fc813f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fc815ee60 0x7f4fc813f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 -- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc8144120 msgr2=0x7f4fc80aa6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc8144120 0x7f4fc80aa6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 -- 172.21.15.18:0/2286494251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc80aac10 con 0x7f4fc815acd0 2024-04-25T10:04:38.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbfe00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ae040 tx=0x7f4fb001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00b0040 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0004030 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0006e20 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc815a610 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc81404e0 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc80745d0 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.309+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4fb0003620 con 0x7f4fc815acd0 2024-04-25T10:04:38.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.313+0000 7f4fbea00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 0x7f4fa4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.313+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4fb011fdb0 con 0x7f4fc815acd0 2024-04-25T10:04:38.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.313+0000 7f4fc6a00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 0x7f4fa4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.313+0000 7f4fc6a00640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 0x7f4fa4069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80011f0 tx=0x7f4fb8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.317+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4fb0124070 con 0x7f4fc815acd0 2024-04-25T10:04:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.477+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4fc80b1d70 con 0x7f4fc815acd0 2024-04-25T10:04:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fbea00640 1 -- 172.21.15.18:0/2286494251 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4fb0016090 con 0x7f4fc815acd0 2024-04-25T10:04:38.489 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 msgr2=0x7f4fa4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 0x7f4fa4069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4fb80011f0 tx=0x7f4fb8007d40 comp rx=0 tx=0).stop 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 msgr2=0x7f4fc815a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4fb00ae040 tx=0x7f4fb001ac50 comp rx=0 tx=0).stop 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 shutdown_connections 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4fa4066f60 0x7f4fa4069420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4fc815ee60 0x7f4fc813f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fc815acd0 0x7f4fc815a0d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 --2- 172.21.15.18:0/2286494251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fc8144120 0x7f4fc80aa6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 >> 172.21.15.18:0/2286494251 conn(0x7f4fc8067080 msgr2=0x7f4fc80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 shutdown_connections 2024-04-25T10:04:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.481+0000 7f4fcd800640 1 -- 172.21.15.18:0/2286494251 wait complete. 2024-04-25T10:04:38.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 Processor -- start 2024-04-25T10:04:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 -- start start 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806ead0 0x7f08b80b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b815ac60 con 0x7f08b80ced60 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80cf3e0 con 0x7f08b806ead0 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.641+0000 7f08bcc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815af20 con 0x7f08b8144140 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806ead0 0x7f08b80b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806ead0 0x7f08b80b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41134/0 (socket says 172.21.15.18:41134) 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08ad400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f08b80ced60 0x7f08b806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46394/0 (socket says 172.21.15.18:46394) 2024-04-25T10:04:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 -- 172.21.15.18:0/3262354720 learned_addr learned my addr 172.21.15.18:0/3262354720 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5e00640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 -- 172.21.15.18:0/3262354720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 msgr2=0x7f08b80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 -- 172.21.15.18:0/3262354720 >> v1:172.21.15.18:6789/0 conn(0x7f08b80ced60 legacy=0x7f08b806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5400640 1 -- 172.21.15.18:0/3262354720 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1938625844 0 0) 0x7f08b815ac60 con 0x7f08b80ced60 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 -- 172.21.15.18:0/3262354720 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b815b200 con 0x7f08b806ead0 2024-04-25T10:04:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5e00640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b6800640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80b0760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ada07675506d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5400640 1 -- 172.21.15.18:0/3262354720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00b0070 con 0x7f08b806ead0 2024-04-25T10:04:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5400640 1 -- 172.21.15.18:0/3262354720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00ab600 con 0x7f08b806ead0 2024-04-25T10:04:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.645+0000 7f08b5400640 1 -- 172.21.15.18:0/3262354720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00ab9d0 con 0x7f08b806ead0 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- 172.21.15.18:0/3262354720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 msgr2=0x7f08b80b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80b0760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009870 tx=0x7f08b001c560 comp rx=0 tx=0).stop 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- 172.21.15.18:0/3262354720 shutdown_connections 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80b0760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- 172.21.15.18:0/3262354720 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- 172.21.15.18:0/3262354720 >> 172.21.15.18:0/3262354720 conn(0x7f08b8066fa0 msgr2=0x7f08b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- 172.21.15.18:0/3262354720 shutdown_connections 2024-04-25T10:04:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- 172.21.15.18:0/3262354720 wait complete. 2024-04-25T10:04:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 Processor -- start 2024-04-25T10:04:38.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- start start 2024-04-25T10:04:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b80ced60 0x7f08b80c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815bb80 con 0x7f08b806ead0 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815ba00 con 0x7f08b80ced60 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08bcc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81653d0 con 0x7f08b8144140 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41140/0 (socket says 172.21.15.18:41140) 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08b5e00640 1 -- 172.21.15.18:0/2261883213 learned_addr learned my addr 172.21.15.18:0/2261883213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08ad400640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b80ced60 0x7f08b80c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.649+0000 7f08b6800640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 -- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 msgr2=0x7f08b815da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b815da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 -- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b80ced60 msgr2=0x7f08b80c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b80ced60 0x7f08b80c5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 -- 172.21.15.18:0/2261883213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b81f6b60 con 0x7f08b806ead0 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b6800640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:38.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08b5e00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08a800d800 tx=0x7f08a800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800b6c0 con 0x7f08b806ead0 2024-04-25T10:04:38.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8019070 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a800baa0 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b81f6e40 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b81f7400 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b81f68b0 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08a800bc40 con 0x7f08b806ead0 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.653+0000 7f08aea00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 0x7f0894069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:38.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.657+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f08a80858e0 con 0x7f08b806ead0 2024-04-25T10:04:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.657+0000 7f08ad400640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 0x7f0894069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:38.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.657+0000 7f08ad400640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 0x7f0894069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08a0007fd0 tx=0x7f08a0007ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:38.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.661+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08a8056450 con 0x7f08b806ead0 2024-04-25T10:04:38.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.821+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b80745d0 con 0x7f08b806ead0 2024-04-25T10:04:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08aea00640 1 -- 172.21.15.18:0/2261883213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f08a8055d50 con 0x7f08b806ead0 2024-04-25T10:04:38.833 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:38.833 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 msgr2=0x7f0894069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 0x7f0894069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08a0007fd0 tx=0x7f08a0007ee0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 msgr2=0x7f08b80c47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f08a800d800 tx=0x7f08a800dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 shutdown_connections 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f60 0x7f0894069420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8144140 0x7f08b815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b80ced60 0x7f08b80c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 --2- 172.21.15.18:0/2261883213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806ead0 0x7f08b80c47d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:38.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 >> 172.21.15.18:0/2261883213 conn(0x7f08b8066fa0 msgr2=0x7f08b81677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:38.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 shutdown_connections 2024-04-25T10:04:38.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.825+0000 7f08bcc00640 1 -- 172.21.15.18:0/2261883213 wait complete. 2024-04-25T10:04:38.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:38.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 Processor -- start 2024-04-25T10:04:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 -- start start 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9c88159320 0x7f9c8815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c8806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 0x7f9c8806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8806d640 con 0x7f9c88159320 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8815fc00 con 0x7f9c8806e010 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c90400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8815fee0 con 0x7f9c8815f440 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.989+0000 7f9c8da00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9c88159320 0x7f9c8815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9c88159320 0x7f9c8815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41154/0 (socket says 172.21.15.18:41154) 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 -- 172.21.15.18:0/3311941164 learned_addr learned my addr 172.21.15.18:0/3311941164 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8d000640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c8806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8e400640 1 --2- 172.21.15.18:0/3311941164 >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 0x7f9c8806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 -- 172.21.15.18:0/3311941164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 msgr2=0x7f9c8806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c8806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 -- 172.21.15.18:0/3311941164 >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 msgr2=0x7f9c8806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 --2- 172.21.15.18:0/3311941164 >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 0x7f9c8806e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 -- 172.21.15.18:0/3311941164 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c881601c0 con 0x7f9c88159320 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8d000640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c8806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8e400640 1 --2- 172.21.15.18:0/3311941164 >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 0x7f9c8806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:39.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c8da00640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c88159320 0x7f9c8815c9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c881604a0 tx=0x7f9c7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d93b8f9c45faf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c87e00640 1 -- 172.21.15.18:0/3311941164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0b0070 con 0x7f9c88159320 2024-04-25T10:04:39.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c87e00640 1 -- 172.21.15.18:0/3311941164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0ab600 con 0x7f9c88159320 2024-04-25T10:04:39.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.993+0000 7f9c87e00640 1 -- 172.21.15.18:0/3311941164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0ab9d0 con 0x7f9c88159320 2024-04-25T10:04:39.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- 172.21.15.18:0/3311941164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c88159320 msgr2=0x7f9c8815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c88159320 0x7f9c8815c9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9c881604a0 tx=0x7f9c7c01c460 comp rx=0 tx=0).stop 2024-04-25T10:04:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- 172.21.15.18:0/3311941164 shutdown_connections 2024-04-25T10:04:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- 172.21.15.18:0/3311941164 >> v2:172.21.15.167:3300/0 conn(0x7f9c8806e010 0x7f9c8806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c8806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- 172.21.15.18:0/3311941164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c88159320 0x7f9c8815c9b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- 172.21.15.18:0/3311941164 >> 172.21.15.18:0/3311941164 conn(0x7f9c88067080 msgr2=0x7f9c8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- 172.21.15.18:0/3311941164 shutdown_connections 2024-04-25T10:04:39.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- 172.21.15.18:0/3311941164 wait complete. 2024-04-25T10:04:39.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 Processor -- start 2024-04-25T10:04:39.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- start start 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 0x7f9c88141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c88157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880cc440 con 0x7f9c8806e010 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880cc2c0 con 0x7f9c88159320 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c90400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880cc5c0 con 0x7f9c8815f440 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41164/0 (socket says 172.21.15.18:41164) 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 -- 172.21.15.18:0/103932667 learned_addr learned my addr 172.21.15.18:0/103932667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:39.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8d000640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 0x7f9c88141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 -- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 msgr2=0x7f9c88157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c88157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 -- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 msgr2=0x7f9c88141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 0x7f9c88141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8da00640 1 -- 172.21.15.18:0/103932667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88141e50 con 0x7f9c8806e010 2024-04-25T10:04:39.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:38.997+0000 7f9c8d000640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 0x7f9c88141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c8da00640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ae040 tx=0x7f9c7c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0b0040 con 0x7f9c8806e010 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c0b9070 con 0x7f9c8806e010 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c0b4680 con 0x7f9c8806e010 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c881443c0 con 0x7f9c8806e010 2024-04-25T10:04:39.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c88144980 con 0x7f9c8806e010 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c880745d0 con 0x7f9c8806e010 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9c7c0b4820 con 0x7f9c8806e010 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 0x7f9c68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9c7c11f1e0 con 0x7f9c8806e010 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.001+0000 7f9c8d000640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 0x7f9c68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.005+0000 7f9c8d000640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 0x7f9c68069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c88137760 tx=0x7f9c74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.005+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9c7c016110 con 0x7f9c8806e010 2024-04-25T10:04:39.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.165+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c8815e230 con 0x7f9c8806e010 2024-04-25T10:04:39.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.165+0000 7f9c85600640 1 -- 172.21.15.18:0/103932667 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c7c0b2300 con 0x7f9c8806e010 2024-04-25T10:04:39.175 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:39.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 msgr2=0x7f9c68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 0x7f9c68069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9c88137760 tx=0x7f9c74008040 comp rx=0 tx=0).stop 2024-04-25T10:04:39.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 msgr2=0x7f9c88143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c0ae040 tx=0x7f9c7c019200 comp rx=0 tx=0).stop 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 shutdown_connections 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c68066f60 0x7f9c68069420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9c8815f440 0x7f9c88157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9c88159320 0x7f9c88141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 --2- 172.21.15.18:0/103932667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c8806e010 0x7f9c88143da0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 >> 172.21.15.18:0/103932667 conn(0x7f9c88067080 msgr2=0x7f9c8815a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 shutdown_connections 2024-04-25T10:04:39.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.169+0000 7f9c90400640 1 -- 172.21.15.18:0/103932667 wait complete. 2024-04-25T10:04:39.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:39.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 Processor -- start 2024-04-25T10:04:39.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 -- start start 2024-04-25T10:04:39.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facd80c72a0 0x7facd80af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80b30d0 con 0x7facd80d0150 2024-04-25T10:04:39.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd80ccf30 con 0x7facd815dc00 2024-04-25T10:04:39.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7face0800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd80cd860 con 0x7facd80c72a0 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7facde800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7facd80c72a0 0x7facd80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7facdd400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7facd80d0150 0x7facd80c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46400/0 (socket says 172.21.15.18:46400) 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.329+0000 7facdd400640 1 -- 172.21.15.18:0/2001191464 learned_addr learned my addr 172.21.15.18:0/2001191464 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facde800640 1 -- 172.21.15.18:0/2001191464 >> v1:172.21.15.167:6789/0 conn(0x7facd815dc00 legacy=0x7facd80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facde800640 1 -- 172.21.15.18:0/2001191464 >> v1:172.21.15.18:6789/0 conn(0x7facd80d0150 legacy=0x7facd80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facde800640 1 -- 172.21.15.18:0/2001191464 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd80cd210 con 0x7facd80c72a0 2024-04-25T10:04:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facde800640 1 --2- 172.21.15.18:0/2001191464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80c72a0 0x7facd80af770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d90 tx=0x7facd401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf46a481f09ce4f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facdca00640 1 -- 172.21.15.18:0/2001191464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40b2070 con 0x7facd80c72a0 2024-04-25T10:04:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facdca00640 1 -- 172.21.15.18:0/2001191464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facd40a5740 con 0x7facd80c72a0 2024-04-25T10:04:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7facdca00640 1 -- 172.21.15.18:0/2001191464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facd40a5b10 con 0x7facd80c72a0 2024-04-25T10:04:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 -- 172.21.15.18:0/2001191464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80c72a0 msgr2=0x7facd80af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 --2- 172.21.15.18:0/2001191464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80c72a0 0x7facd80af770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7facd4009d90 tx=0x7facd401c970 comp rx=0 tx=0).stop 2024-04-25T10:04:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 -- 172.21.15.18:0/2001191464 shutdown_connections 2024-04-25T10:04:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 --2- 172.21.15.18:0/2001191464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80c72a0 0x7facd80af770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 -- 172.21.15.18:0/2001191464 >> 172.21.15.18:0/2001191464 conn(0x7facd80b2240 msgr2=0x7facd80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 -- 172.21.15.18:0/2001191464 shutdown_connections 2024-04-25T10:04:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.333+0000 7face0800640 1 -- 172.21.15.18:0/2001191464 wait complete. 2024-04-25T10:04:39.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 Processor -- start 2024-04-25T10:04:39.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- start start 2024-04-25T10:04:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 0x7facd81f6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facd815dc00 0x7facd80b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd816b7d0 con 0x7facd80d0150 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd816b650 con 0x7facd80c72a0 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd816b950 con 0x7facd815dc00 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41188/0 (socket says 172.21.15.18:41188) 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 -- 172.21.15.18:0/2901670741 learned_addr learned my addr 172.21.15.18:0/2901670741 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdde00640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 0x7facd81f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facde800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facd815dc00 0x7facd80b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 -- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facd815dc00 msgr2=0x7facd80b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facd815dc00 0x7facd80b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 -- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 msgr2=0x7facd81f6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 0x7facd81f6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 -- 172.21.15.18:0/2901670741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd8152870 con 0x7facd80d0150 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdde00640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 0x7facd81f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facdd400640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facc800c500 tx=0x7facc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8017070 con 0x7facd80d0150 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8005cf0 con 0x7facd80d0150 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd809bc40 con 0x7facd80d0150 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc80072f0 con 0x7facd80d0150 2024-04-25T10:04:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.337+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd809c200 con 0x7facd80d0150 2024-04-25T10:04:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd806ccb0 con 0x7facd80d0150 2024-04-25T10:04:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7facc801a070 con 0x7facd80d0150 2024-04-25T10:04:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7facd2000640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 0x7facbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7facc8084640 con 0x7facd80d0150 2024-04-25T10:04:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7facdde00640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 0x7facbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.341+0000 7facdde00640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 0x7facbc069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7facd8155060 tx=0x7faccc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.345+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7facc8054c90 con 0x7facd80d0150 2024-04-25T10:04:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facd80745d0 con 0x7facd80d0150 2024-04-25T10:04:39.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7facd2000640 1 -- 172.21.15.18:0/2901670741 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7facc8058d30 con 0x7facd80d0150 2024-04-25T10:04:39.517 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:39.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 msgr2=0x7facbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 0x7facbc069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7facd8155060 tx=0x7faccc009040 comp rx=0 tx=0).stop 2024-04-25T10:04:39.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 msgr2=0x7facd8156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7facc800c500 tx=0x7facc800c9c0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 shutdown_connections 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7facbc066f60 0x7facbc069420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7facd815dc00 0x7facd80b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7facd80d0150 0x7facd8156040 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 --2- 172.21.15.18:0/2901670741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7facd80c72a0 0x7facd81f6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 >> 172.21.15.18:0/2901670741 conn(0x7facd80b2240 msgr2=0x7facd80c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 shutdown_connections 2024-04-25T10:04:39.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.509+0000 7face0800640 1 -- 172.21.15.18:0/2901670741 wait complete. 2024-04-25T10:04:39.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 Processor -- start 2024-04-25T10:04:39.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 -- start start 2024-04-25T10:04:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 0x7f0f580d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0f5806bf30 0x7f0f580cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5815e040 con 0x7f0f58099a60 2024-04-25T10:04:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580cff80 con 0x7f0f5806bf30 2024-04-25T10:04:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.673+0000 7f0f5d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580d0260 con 0x7f0f5815dc60 2024-04-25T10:04:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0f5806bf30 0x7f0f580cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f56a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 0x7f0f580d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f57400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f0f58099a60 0x7f0f580cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:50416/0 (socket says 172.21.15.18:50416) 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f57400640 1 -- 172.21.15.18:0/3159536225 learned_addr learned my addr 172.21.15.18:0/3159536225 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f56000640 1 -- 172.21.15.18:0/3159536225 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680148848 0 0) 0x7f0f5815e040 con 0x7f0f58099a60 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f56000640 1 -- 172.21.15.18:0/3159536225 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f3c003530 con 0x7f0f58099a60 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 -- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 msgr2=0x7f0f580d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 0x7f0f580d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 -- 172.21.15.18:0/3159536225 >> v1:172.21.15.167:6789/0 conn(0x7f0f58099a60 legacy=0x7f0f580cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 -- 172.21.15.18:0/3159536225 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580d0540 con 0x7f0f5806bf30 2024-04-25T10:04:39.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f56a00640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 0x7f0f580d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.677+0000 7f0f4e000640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5806bf30 0x7f0f580cf8a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f400097c0 tx=0x7f0f4001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=886ef64238194c91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f56000640 1 -- 172.21.15.18:0/3159536225 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400b1070 con 0x7f0f5806bf30 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f56000640 1 -- 172.21.15.18:0/3159536225 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f400a8050 con 0x7f0f5806bf30 2024-04-25T10:04:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f56000640 1 -- 172.21.15.18:0/3159536225 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f400ac840 con 0x7f0f5806bf30 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5806bf30 msgr2=0x7f0f580cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5806bf30 0x7f0f580cf8a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0f400097c0 tx=0x7f0f4001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- 172.21.15.18:0/3159536225 shutdown_connections 2024-04-25T10:04:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5806bf30 0x7f0f580cf8a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- 172.21.15.18:0/3159536225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5815dc60 0x7f0f580d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- 172.21.15.18:0/3159536225 >> 172.21.15.18:0/3159536225 conn(0x7f0f580b3200 msgr2=0x7f0f580b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- 172.21.15.18:0/3159536225 shutdown_connections 2024-04-25T10:04:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- 172.21.15.18:0/3159536225 wait complete. 2024-04-25T10:04:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 Processor -- start 2024-04-25T10:04:39.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- start start 2024-04-25T10:04:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5806bf30 0x7f0f58158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f58099a60 0x7f0f58155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5809a280 con 0x7f0f5815dc60 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580cc880 con 0x7f0f58099a60 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f5d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580c8c50 con 0x7f0f5806bf30 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f57400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f57400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41198/0 (socket says 172.21.15.18:41198) 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f57400640 1 -- 172.21.15.18:0/2696343339 learned_addr learned my addr 172.21.15.18:0/2696343339 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f56a00640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5806bf30 0x7f0f58158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.681+0000 7f0f4e000640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f58099a60 0x7f0f58155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 -- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5806bf30 msgr2=0x7f0f58158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5806bf30 0x7f0f58158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 -- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f58099a60 msgr2=0x7f0f58155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f58099a60 0x7f0f58155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 -- 172.21.15.18:0/2696343339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f580c8f30 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f57400640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c450 tx=0x7f0f5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50017070 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f50005cf0 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500072b0 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580c9270 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f58159340 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f580745d0 con 0x7f0f5815dc60 2024-04-25T10:04:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f5001a070 con 0x7f0f5815dc60 2024-04-25T10:04:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 0x7f0f34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.685+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0f50084630 con 0x7f0f5815dc60 2024-04-25T10:04:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.689+0000 7f0f56a00640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 0x7f0f34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:39.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.689+0000 7f0f56a00640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 0x7f0f34069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009bd0 tx=0x7f0f4800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:39.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.693+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f580c9270 con 0x7f0f5815dc60 2024-04-25T10:04:39.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.853+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f580ca6a0 con 0x7f0f5815dc60 2024-04-25T10:04:39.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.853+0000 7f0f4f400640 1 -- 172.21.15.18:0/2696343339 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f50054bf0 con 0x7f0f5815dc60 2024-04-25T10:04:39.863 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:39.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 msgr2=0x7f0f34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 0x7f0f34069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009bd0 tx=0x7f0f4800b040 comp rx=0 tx=0).stop 2024-04-25T10:04:39.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 msgr2=0x7f0f580b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c450 tx=0x7f0f5000c910 comp rx=0 tx=0).stop 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 shutdown_connections 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f5815dc60 0x7f0f580b62d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f58099a60 0x7f0f58155530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0f34066f60 0x7f0f34069420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 --2- 172.21.15.18:0/2696343339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0f5806bf30 0x7f0f58158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 >> 172.21.15.18:0/2696343339 conn(0x7f0f580b3200 msgr2=0x7f0f58070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 shutdown_connections 2024-04-25T10:04:39.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:39.857+0000 7f0f5d600640 1 -- 172.21.15.18:0/2696343339 wait complete. 2024-04-25T10:04:39.885 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 Processor -- start 2024-04-25T10:04:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 -- start start 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f169c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f169c0cf3c0 0x7f169c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0d02a0 con 0x7f169c0cd370 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0cc350 con 0x7f169c0cf3c0 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a4800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0cc630 con 0x7f169c15b910 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a2800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f169c0cd370 0x7f169c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46408/0 (socket says 172.21.15.18:46408) 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.021+0000 7f16a2800640 1 -- 172.21.15.18:0/2828060904 learned_addr learned my addr 172.21.15.18:0/2828060904 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:40.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1e00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f169c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 --2- 172.21.15.18:0/2828060904 >> v2:172.21.15.167:3300/0 conn(0x7f169c0cf3c0 0x7f169c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854845784 0 0) 0x7f169c0d02a0 con 0x7f169c0cd370 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1684003530 con 0x7f169c0cd370 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1000517977 0 0) 0x7f1684003530 con 0x7f169c0cd370 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 msgr2=0x7f169c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f169c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 >> v2:172.21.15.167:3300/0 conn(0x7f169c0cf3c0 msgr2=0x7f169c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 --2- 172.21.15.18:0/2828060904 >> v2:172.21.15.167:3300/0 conn(0x7f169c0cf3c0 0x7f169c0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0cc910 con 0x7f169c0cd370 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f1698001a00 con 0x7f169c0cd370 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 >> v1:172.21.15.18:6789/0 conn(0x7f169c0cd370 legacy=0x7f169c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16840039c0 0x7f1684003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1684004810 0x7f1684004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f16840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0cc350 con 0x7f1684004810 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c0cc630 con 0x7f16840039c0 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168400b9d0 con 0x7f169c15b910 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1684004810 0x7f1684004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1e00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16840039c0 0x7f1684003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a2800640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f16840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 -- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 msgr2=0x7f16840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c15b910 0x7f16840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 -- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16840039c0 msgr2=0x7f1684003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16840039c0 0x7f1684003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1400640 1 -- 172.21.15.18:0/2828060904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1684003530 con 0x7f1684004810 2024-04-25T10:04:40.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.025+0000 7f16a1e00640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16840039c0 0x7f1684003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:40.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a1400640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1684004810 0x7f1684004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f168c009ab0 tx=0x7f168c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a73a047509c9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0096b0 con 0x7f1684004810 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c0a64a0 con 0x7f1684004810 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a0a00640 1 -- 172.21.15.18:0/2828060904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c0a6890 con 0x7f1684004810 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- 172.21.15.18:0/2828060904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1684004810 msgr2=0x7f1684004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 --2- 172.21.15.18:0/2828060904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1684004810 0x7f1684004c90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f168c009ab0 tx=0x7f168c01ca90 comp rx=0 tx=0).stop 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a2800640 1 -- 172.21.15.18:0/2828060904 reap_dead start 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- 172.21.15.18:0/2828060904 shutdown_connections 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- 172.21.15.18:0/2828060904 >> 172.21.15.18:0/2828060904 conn(0x7f169c0b3200 msgr2=0x7f169c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- 172.21.15.18:0/2828060904 shutdown_connections 2024-04-25T10:04:40.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- 172.21.15.18:0/2828060904 wait complete. 2024-04-25T10:04:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 Processor -- start 2024-04-25T10:04:40.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 -- start start 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.029+0000 7f16a4800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1684004810 0x7f169c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c0b4330 0x7f169c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c09a2f0 con 0x7f169c06be20 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c09a170 con 0x7f1684004810 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c15bcf0 con 0x7f169c0b4330 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41216/0 (socket says 172.21.15.18:41216) 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 -- 172.21.15.18:0/520632488 learned_addr learned my addr 172.21.15.18:0/520632488 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a1e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1684004810 0x7f169c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a1400640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c0b4330 0x7f169c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 -- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c0b4330 msgr2=0x7f169c0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c0b4330 0x7f169c0b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 -- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1684004810 msgr2=0x7f169c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1684004810 0x7f169c159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 -- 172.21.15.18:0/520632488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c06cba0 con 0x7f169c06be20 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a2800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b77c0 tx=0x7f1698011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698010040 con 0x7f169c06be20 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169801a070 con 0x7f169c06be20 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16980139e0 con 0x7f169c06be20 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c06ce80 con 0x7f169c06be20 2024-04-25T10:04:40.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c06d440 con 0x7f169c06be20 2024-04-25T10:04:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c0745d0 con 0x7f169c06be20 2024-04-25T10:04:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.033+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1698013b80 con 0x7f169c06be20 2024-04-25T10:04:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.037+0000 7f1696000640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.037+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1698087fa0 con 0x7f169c06be20 2024-04-25T10:04:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.037+0000 7f16a1e00640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.037+0000 7f16a1e00640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 0x7f1680069450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1690009a80 tx=0x7f1690008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.037+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1698058540 con 0x7f169c06be20 2024-04-25T10:04:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f169c15b240 con 0x7f169c06be20 2024-04-25T10:04:40.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f1696000640 1 -- 172.21.15.18:0/520632488 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f169805c5e0 con 0x7f169c06be20 2024-04-25T10:04:40.209 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 msgr2=0x7f1680069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 0x7f1680069450 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1690009a80 tx=0x7f1690008040 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 msgr2=0x7f169c06c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b77c0 tx=0x7f1698011a10 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 shutdown_connections 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f169c06be20 0x7f169c06c2a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1680066f90 0x7f1680069450 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f169c0b4330 0x7f169c0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 --2- 172.21.15.18:0/520632488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1684004810 0x7f169c159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 >> 172.21.15.18:0/520632488 conn(0x7f169c0b3200 msgr2=0x7f169c15a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 shutdown_connections 2024-04-25T10:04:40.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.201+0000 7f16a4800640 1 -- 172.21.15.18:0/520632488 wait complete. 2024-04-25T10:04:40.231 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 Processor -- start 2024-04-25T10:04:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 -- start start 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcde406ac10 0x7fcde406b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde40b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde41454d0 con 0x7fcde41450f0 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde406b5b0 con 0x7fcde406ac10 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40b4a20 con 0x7fcde40b4eb0 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcddbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcde406ac10 0x7fcde406b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde2a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcde41450f0 0x7fcde40b33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46420/0 (socket says 172.21.15.18:46420) 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde2a00640 1 -- 172.21.15.18:0/3987473290 learned_addr learned my addr 172.21.15.18:0/3987473290 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:40.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3400640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde40b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcddbe00640 1 -- 172.21.15.18:0/3987473290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 msgr2=0x7fcde40b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcddbe00640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde40b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcddbe00640 1 -- 172.21.15.18:0/3987473290 >> v1:172.21.15.18:6789/0 conn(0x7fcde41450f0 legacy=0x7fcde40b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcddbe00640 1 -- 172.21.15.18:0/3987473290 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40b3e10 con 0x7fcde406ac10 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde3400640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde40b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.365+0000 7fcde2000640 1 -- 172.21.15.18:0/3987473290 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2608144114 0 0) 0x7fcde41454d0 con 0x7fcde41450f0 2024-04-25T10:04:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcddbe00640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde406b070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0097c0 tx=0x7fcdcc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b111d0174ca4f01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde2000640 1 -- 172.21.15.18:0/3987473290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0a7070 con 0x7fcde406ac10 2024-04-25T10:04:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde2000640 1 -- 172.21.15.18:0/3987473290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc0b0070 con 0x7fcde406ac10 2024-04-25T10:04:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde2000640 1 -- 172.21.15.18:0/3987473290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc0ab890 con 0x7fcde406ac10 2024-04-25T10:04:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- 172.21.15.18:0/3987473290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 msgr2=0x7fcde406b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde406b070 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0097c0 tx=0x7fcdcc01c470 comp rx=0 tx=0).stop 2024-04-25T10:04:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- 172.21.15.18:0/3987473290 shutdown_connections 2024-04-25T10:04:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde40b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3987473290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde406b070 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- 172.21.15.18:0/3987473290 >> 172.21.15.18:0/3987473290 conn(0x7fcde4099a60 msgr2=0x7fcde40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- 172.21.15.18:0/3987473290 shutdown_connections 2024-04-25T10:04:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- 172.21.15.18:0/3987473290 wait complete. 2024-04-25T10:04:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 Processor -- start 2024-04-25T10:04:40.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.369+0000 7fcde3e00640 1 -- start start 2024-04-25T10:04:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde4140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 0x7fcde41413d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40cd030 con 0x7fcde406ac10 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40b3ad0 con 0x7fcde41450f0 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40cd1b0 con 0x7fcde40b4eb0 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41242/0 (socket says 172.21.15.18:41242) 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 -- 172.21.15.18:0/3651708608 learned_addr learned my addr 172.21.15.18:0/3651708608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3400640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 0x7fcde41413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcddbe00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde4140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 -- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 msgr2=0x7fcde4140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde4140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 -- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 msgr2=0x7fcde41413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 0x7fcde41413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 -- 172.21.15.18:0/3651708608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde4141c00 con 0x7fcde406ac10 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3400640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 0x7fcde41413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:40.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde2a00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c480 tx=0x7fcdd400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4018070 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd4007500 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4004a30 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde4141ee0 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde4142780 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde41420b0 con 0x7fcde406ac10 2024-04-25T10:04:40.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.373+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcdd401b070 con 0x7fcde406ac10 2024-04-25T10:04:40.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.377+0000 7fcddaa00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 0x7fcdc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.377+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcdd4084770 con 0x7fcde406ac10 2024-04-25T10:04:40.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.377+0000 7fcddbe00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 0x7fcdc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.377+0000 7fcddbe00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 0x7fcdc0069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0af000 tx=0x7fcdcc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.381+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcdd4055410 con 0x7fcde406ac10 2024-04-25T10:04:40.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.541+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcde404efa0 con 0x7fcde406ac10 2024-04-25T10:04:40.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.541+0000 7fcddaa00640 1 -- 172.21.15.18:0/3651708608 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7fcdd4054d10 con 0x7fcde406ac10 2024-04-25T10:04:40.552 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:40.552 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:40.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 msgr2=0x7fcdc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 0x7fcdc0069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc0af000 tx=0x7fcdcc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:40.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 msgr2=0x7fcde40c9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c480 tx=0x7fcdd400c940 comp rx=0 tx=0).stop 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 shutdown_connections 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde41450f0 0x7fcde41413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcdc0066f60 0x7fcdc0069420 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcde40b4eb0 0x7fcde4140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 --2- 172.21.15.18:0/3651708608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde406ac10 0x7fcde40c9a00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 >> 172.21.15.18:0/3651708608 conn(0x7fcde4099a60 msgr2=0x7fcde413bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 shutdown_connections 2024-04-25T10:04:40.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.545+0000 7fcde3e00640 1 -- 172.21.15.18:0/3651708608 wait complete. 2024-04-25T10:04:40.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:40.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 Processor -- start 2024-04-25T10:04:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 -- start start 2024-04-25T10:04:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f194015c9b0 0x7f194006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f194006e010 0x7f194006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194015fc00 con 0x7f1940159320 2024-04-25T10:04:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194006d640 con 0x7f194006e010 2024-04-25T10:04:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1947e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194015fee0 con 0x7f194015c9b0 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f194006e010 0x7f194006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f194006e010 0x7f194006e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41252/0 (socket says 172.21.15.18:41252) 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1940159320 0x7f194015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:50418/0 (socket says 172.21.15.18:50418) 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 -- 172.21.15.18:0/1972086299 learned_addr learned my addr 172.21.15.18:0/1972086299 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1944a00640 1 --2- 172.21.15.18:0/1972086299 >> v2:172.21.15.167:3300/0 conn(0x7f194015c9b0 0x7f194006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 -- 172.21.15.18:0/1972086299 >> v2:172.21.15.167:3300/0 conn(0x7f194015c9b0 msgr2=0x7f194006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 --2- 172.21.15.18:0/1972086299 >> v2:172.21.15.167:3300/0 conn(0x7f194015c9b0 0x7f194006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 -- 172.21.15.18:0/1972086299 >> v1:172.21.15.167:6789/0 conn(0x7f1940159320 legacy=0x7f194015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f1945e00640 1 -- 172.21.15.18:0/1972086299 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19401601c0 con 0x7f194006e010 2024-04-25T10:04:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.709+0000 7f193fe00640 1 -- 172.21.15.18:0/1972086299 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881638324 0 0) 0x7f194015fc00 con 0x7f1940159320 2024-04-25T10:04:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1945e00640 1 --2- 172.21.15.18:0/1972086299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194006e010 0x7f194006e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19400b4b50 tx=0x7f193801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374b6a741346dd8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f193fe00640 1 -- 172.21.15.18:0/1972086299 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380a56c0 con 0x7f194006e010 2024-04-25T10:04:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f193fe00640 1 -- 172.21.15.18:0/1972086299 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19380a5860 con 0x7f194006e010 2024-04-25T10:04:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f193fe00640 1 -- 172.21.15.18:0/1972086299 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380a5c30 con 0x7f194006e010 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 -- 172.21.15.18:0/1972086299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194006e010 msgr2=0x7f194006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 --2- 172.21.15.18:0/1972086299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194006e010 0x7f194006e4a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f19400b4b50 tx=0x7f193801c9f0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 -- 172.21.15.18:0/1972086299 shutdown_connections 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 --2- 172.21.15.18:0/1972086299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194006e010 0x7f194006e4a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 --2- 172.21.15.18:0/1972086299 >> v2:172.21.15.167:3300/0 conn(0x7f194015c9b0 0x7f194006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 -- 172.21.15.18:0/1972086299 >> 172.21.15.18:0/1972086299 conn(0x7f1940067080 msgr2=0x7f194006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 -- 172.21.15.18:0/1972086299 shutdown_connections 2024-04-25T10:04:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.713+0000 7f1947e00640 1 -- 172.21.15.18:0/1972086299 wait complete. 2024-04-25T10:04:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 Processor -- start 2024-04-25T10:04:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- start start 2024-04-25T10:04:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 0x7f194013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 0x7f19400b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940168920 con 0x7f194015c9b0 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19401687a0 con 0x7f194006e010 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1940168aa0 con 0x7f1940159320 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41266/0 (socket says 172.21.15.18:41266) 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 -- 172.21.15.18:0/4290409934 learned_addr learned my addr 172.21.15.18:0/4290409934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1944a00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 0x7f19400b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945400640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 0x7f194013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 -- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 msgr2=0x7f19400b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 0x7f19400b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 -- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 msgr2=0x7f194013ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 0x7f194013ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 -- 172.21.15.18:0/4290409934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400b0f10 con 0x7f194015c9b0 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945400640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 0x7f194013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1944a00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 0x7f19400b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1945e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f193801b0a0 tx=0x7f1938019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380b8470 con 0x7f194015c9b0 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19380b8630 con 0x7f194015c9b0 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19380b8a20 con 0x7f194015c9b0 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19400b11f0 con 0x7f194015c9b0 2024-04-25T10:04:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.717+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19400b17b0 con 0x7f194015c9b0 2024-04-25T10:04:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19400745d0 con 0x7f194015c9b0 2024-04-25T10:04:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19380c0020 con 0x7f194015c9b0 2024-04-25T10:04:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f193d600640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 0x7f1920069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f193811fb70 con 0x7f194015c9b0 2024-04-25T10:04:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f1945400640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 0x7f1920069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.721+0000 7f1945400640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 0x7f1920069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1934007fd0 tx=0x7f1934007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:40.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.725+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f19380c7020 con 0x7f194015c9b0 2024-04-25T10:04:40.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.889+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f194015b1a0 con 0x7f194015c9b0 2024-04-25T10:04:40.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.889+0000 7f193d600640 1 -- 172.21.15.18:0/4290409934 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19380165e0 con 0x7f194015c9b0 2024-04-25T10:04:40.900 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:40.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 msgr2=0x7f1920069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 0x7f1920069420 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1934007fd0 tx=0x7f1934007c20 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 msgr2=0x7f194015d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f193801b0a0 tx=0x7f1938019790 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 shutdown_connections 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f194015c9b0 0x7f194015d010 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1920066f60 0x7f1920069420 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1940159320 0x7f19400b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 --2- 172.21.15.18:0/4290409934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f194006e010 0x7f194013ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 >> 172.21.15.18:0/4290409934 conn(0x7f1940067080 msgr2=0x7f1940144ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 shutdown_connections 2024-04-25T10:04:40.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:40.893+0000 7f1947e00640 1 -- 172.21.15.18:0/4290409934 wait complete. 2024-04-25T10:04:40.922 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:41.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 Processor -- start 2024-04-25T10:04:41.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 -- start start 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c34159320 0x7f0c3415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c3415f440 0x7f0c3406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3415fc00 con 0x7f0c3406e010 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3406d640 con 0x7f0c3415f440 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c3aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3415fee0 con 0x7f0c34159320 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c3415f440 0x7f0c3406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c38a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0c3406e010 0x7f0c3406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46430/0 (socket says 172.21.15.18:46430) 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c3415f440 0x7f0c3406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41274/0 (socket says 172.21.15.18:41274) 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c38a00640 1 -- 172.21.15.18:0/2154522458 learned_addr learned my addr 172.21.15.18:0/2154522458 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c33e00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c34159320 0x7f0c3415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 -- 172.21.15.18:0/2154522458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c34159320 msgr2=0x7f0c3415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:41.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c34159320 0x7f0c3415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 -- 172.21.15.18:0/2154522458 >> v1:172.21.15.18:6789/0 conn(0x7f0c3406e010 legacy=0x7f0c3406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.057+0000 7f0c2be00640 1 -- 172.21.15.18:0/2154522458 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c341601c0 con 0x7f0c3415f440 2024-04-25T10:04:41.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c2be00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3415f440 0x7f0c3406dad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0097c0 tx=0x7f0c1c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698127df16be57ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c33400640 1 -- 172.21.15.18:0/2154522458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0ab600 con 0x7f0c3415f440 2024-04-25T10:04:41.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c33400640 1 -- 172.21.15.18:0/2154522458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c0b0070 con 0x7f0c3415f440 2024-04-25T10:04:41.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c33400640 1 -- 172.21.15.18:0/2154522458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c0ab9c0 con 0x7f0c3415f440 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 -- 172.21.15.18:0/2154522458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3415f440 msgr2=0x7f0c3406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3415f440 0x7f0c3406dad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0097c0 tx=0x7f0c1c01c3e0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 -- 172.21.15.18:0/2154522458 shutdown_connections 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3415f440 0x7f0c3406dad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/2154522458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c34159320 0x7f0c3415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 -- 172.21.15.18:0/2154522458 >> 172.21.15.18:0/2154522458 conn(0x7f0c34067080 msgr2=0x7f0c3406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 -- 172.21.15.18:0/2154522458 shutdown_connections 2024-04-25T10:04:41.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.061+0000 7f0c3aa00640 1 -- 172.21.15.18:0/2154522458 wait complete. 2024-04-25T10:04:41.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 Processor -- start 2024-04-25T10:04:41.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- start start 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 0x7f0c340af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c3415f440 0x7f0c34164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34071c00 con 0x7f0c3406e010 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c34071a80 con 0x7f0c34159320 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3406ebb0 con 0x7f0c3415f440 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41282/0 (socket says 172.21.15.18:41282) 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 -- 172.21.15.18:0/1491498196 learned_addr learned my addr 172.21.15.18:0/1491498196 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c38a00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c3415f440 0x7f0c34164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c2be00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 0x7f0c340af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 -- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c3415f440 msgr2=0x7f0c34164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c3415f440 0x7f0c34164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 -- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 msgr2=0x7f0c340af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 0x7f0c340af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 -- 172.21.15.18:0/1491498196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c341f6540 con 0x7f0c3406e010 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c2be00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 0x7f0c340af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c33e00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400d830 tx=0x7f0c2400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400b6c0 con 0x7f0c3406e010 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c24019070 con 0x7f0c3406e010 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400ba60 con 0x7f0c3406e010 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c341f6820 con 0x7f0c3406e010 2024-04-25T10:04:41.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.065+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c341f6de0 con 0x7f0c3406e010 2024-04-25T10:04:41.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.069+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c340afb50 con 0x7f0c3406e010 2024-04-25T10:04:41.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.069+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c2401e460 con 0x7f0c3406e010 2024-04-25T10:04:41.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.069+0000 7f0c30c00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 0x7f0c10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.069+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0c24085bb0 con 0x7f0c3406e010 2024-04-25T10:04:41.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.069+0000 7f0c2be00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 0x7f0c10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.073+0000 7f0c2be00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 0x7f0c10069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0af000 tx=0x7f0c1c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.073+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c24056720 con 0x7f0c3406e010 2024-04-25T10:04:41.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.233+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c340745d0 con 0x7f0c3406e010 2024-04-25T10:04:41.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.233+0000 7f0c30c00640 1 -- 172.21.15.18:0/1491498196 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c24056020 con 0x7f0c3406e010 2024-04-25T10:04:41.245 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:41.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 msgr2=0x7f0c10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 0x7f0c10069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c0af000 tx=0x7f0c1c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 msgr2=0x7f0c34158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400d830 tx=0x7f0c2400dcf0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 shutdown_connections 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c10066f60 0x7f0c10069420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c3415f440 0x7f0c34164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c34159320 0x7f0c340af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 --2- 172.21.15.18:0/1491498196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c3406e010 0x7f0c34158090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 >> 172.21.15.18:0/1491498196 conn(0x7f0c34067080 msgr2=0x7f0c340cd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 shutdown_connections 2024-04-25T10:04:41.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.237+0000 7f0c3aa00640 1 -- 172.21.15.18:0/1491498196 wait complete. 2024-04-25T10:04:41.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:41.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 Processor -- start 2024-04-25T10:04:41.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 -- start start 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f87fc06bf30 0x7f87fc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc15e040 con 0x7f87fc09a170 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0cff80 con 0x7f87fc15dc60 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f8801400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc0d0260 con 0x7f87fc06bf30 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.401+0000 7f87fb200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f87fc06bf30 0x7f87fc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87f3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f87fc09a170 0x7f87fc0cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46434/0 (socket says 172.21.15.18:46434) 2024-04-25T10:04:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87f3e00640 1 -- 172.21.15.18:0/2491509842 learned_addr learned my addr 172.21.15.18:0/2491509842 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87fb200640 1 -- 172.21.15.18:0/2491509842 >> v1:172.21.15.167:6789/0 conn(0x7f87fc15dc60 legacy=0x7f87fc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87fb200640 1 -- 172.21.15.18:0/2491509842 >> v1:172.21.15.18:6789/0 conn(0x7f87fc09a170 legacy=0x7f87fc0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87fb200640 1 -- 172.21.15.18:0/2491509842 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0d0540 con 0x7f87fc06bf30 2024-04-25T10:04:41.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87fb200640 1 --2- 172.21.15.18:0/2491509842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc0d1020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009d90 tx=0x7f87f401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ad4711a37738be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87f9e00640 1 -- 172.21.15.18:0/2491509842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40b2070 con 0x7f87fc06bf30 2024-04-25T10:04:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87f9e00640 1 -- 172.21.15.18:0/2491509842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f40a58e0 con 0x7f87fc06bf30 2024-04-25T10:04:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.405+0000 7f87f9e00640 1 -- 172.21.15.18:0/2491509842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40a5cb0 con 0x7f87fc06bf30 2024-04-25T10:04:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- 172.21.15.18:0/2491509842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 msgr2=0x7f87fc0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 --2- 172.21.15.18:0/2491509842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc0d1020 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009d90 tx=0x7f87f401c820 comp rx=0 tx=0).stop 2024-04-25T10:04:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- 172.21.15.18:0/2491509842 shutdown_connections 2024-04-25T10:04:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 --2- 172.21.15.18:0/2491509842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc0d1020 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- 172.21.15.18:0/2491509842 >> 172.21.15.18:0/2491509842 conn(0x7f87fc0b3200 msgr2=0x7f87fc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- 172.21.15.18:0/2491509842 shutdown_connections 2024-04-25T10:04:41.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- 172.21.15.18:0/2491509842 wait complete. 2024-04-25T10:04:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 Processor -- start 2024-04-25T10:04:41.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- start start 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87fc09a170 0x7f87fc0ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87fc15dc60 0x7f87fc1525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc06cfa0 con 0x7f87fc06bf30 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0cc880 con 0x7f87fc09a170 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f8801400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0cae80 con 0x7f87fc15dc60 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41286/0 (socket says 172.21.15.18:41286) 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 -- 172.21.15.18:0/3398235030 learned_addr learned my addr 172.21.15.18:0/3398235030 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87f3e00640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87fc09a170 0x7f87fc0ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fb200640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87fc15dc60 0x7f87fc1525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 -- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87fc15dc60 msgr2=0x7f87fc1525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87fc15dc60 0x7f87fc1525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 -- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87fc09a170 msgr2=0x7f87fc0ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87fc09a170 0x7f87fc0ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 -- 172.21.15.18:0/3398235030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc156d50 con 0x7f87fc06bf30 2024-04-25T10:04:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.409+0000 7f87fa800640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c370 tx=0x7f87ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec0052d0 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec005470 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec007260 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc157030 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc1575f0 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc0745d0 con 0x7f87fc06bf30 2024-04-25T10:04:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87ec007400 con 0x7f87fc06bf30 2024-04-25T10:04:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 0x7f87d8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f87ec084860 con 0x7f87fc06bf30 2024-04-25T10:04:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.413+0000 7f87f3e00640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 0x7f87d8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.417+0000 7f87f3e00640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 0x7f87d8069470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1694c0 tx=0x7f87e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.417+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87ec0554e0 con 0x7f87fc06bf30 2024-04-25T10:04:41.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87fc0b7590 con 0x7f87fc06bf30 2024-04-25T10:04:41.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f87f2a00640 1 -- 172.21.15.18:0/3398235030 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87ec054de0 con 0x7f87fc06bf30 2024-04-25T10:04:41.590 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 msgr2=0x7f87d8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 0x7f87d8069470 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87fc1694c0 tx=0x7f87e4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 msgr2=0x7f87fc14fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f87ec00c370 tx=0x7f87ec00c830 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 shutdown_connections 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87d8066fb0 0x7f87d8069470 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f87fc15dc60 0x7f87fc1525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87fc09a170 0x7f87fc0ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 --2- 172.21.15.18:0/3398235030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87fc06bf30 0x7f87fc14fc80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 >> 172.21.15.18:0/3398235030 conn(0x7f87fc0b3200 msgr2=0x7f87fc0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 shutdown_connections 2024-04-25T10:04:41.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.581+0000 7f8801400640 1 -- 172.21.15.18:0/3398235030 wait complete. 2024-04-25T10:04:41.611 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:41.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.745+0000 7f0965800640 1 Processor -- start 2024-04-25T10:04:41.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.745+0000 7f0965800640 1 -- start start 2024-04-25T10:04:41.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.745+0000 7f0965800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 0x7f096015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.745+0000 7f0965800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f096006e4a0 0x7f096006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.745+0000 7f0965800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096015fc00 con 0x7f096015f440 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f0965800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096006d640 con 0x7f096006e4a0 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f0965800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096015fee0 con 0x7f0960159320 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f096006e4a0 0x7f096006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f0957e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f096015f440 0x7f096006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60868/0 (socket says 172.21.15.18:60868) 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f0957e00640 1 -- 172.21.15.18:0/525173395 learned_addr learned my addr 172.21.15.18:0/525173395 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:41.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095ea00640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 0x7f096015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 -- 172.21.15.18:0/525173395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 msgr2=0x7f096015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 0x7f096015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 -- 172.21.15.18:0/525173395 >> v1:172.21.15.18:6789/0 conn(0x7f096015f440 legacy=0x7f096006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 -- 172.21.15.18:0/525173395 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09601601c0 con 0x7f096006e4a0 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095ea00640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 0x7f096015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095e000640 1 -- 172.21.15.18:0/525173395 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3278850738 0 0) 0x7f096015fc00 con 0x7f096015f440 2024-04-25T10:04:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095f400640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f096006e4a0 0x7f096006e930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9048928857f89480 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095e000640 1 -- 172.21.15.18:0/525173395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580b2070 con 0x7f096006e4a0 2024-04-25T10:04:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095e000640 1 -- 172.21.15.18:0/525173395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09580a5830 con 0x7f096006e4a0 2024-04-25T10:04:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.749+0000 7f095e000640 1 -- 172.21.15.18:0/525173395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09580a5c00 con 0x7f096006e4a0 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- 172.21.15.18:0/525173395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f096006e4a0 msgr2=0x7f096006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f096006e4a0 0x7f096006e930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0958009d90 tx=0x7f095801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- 172.21.15.18:0/525173395 shutdown_connections 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f096006e4a0 0x7f096006e930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- 172.21.15.18:0/525173395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0960159320 0x7f096015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- 172.21.15.18:0/525173395 >> 172.21.15.18:0/525173395 conn(0x7f0960067080 msgr2=0x7f096006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- 172.21.15.18:0/525173395 shutdown_connections 2024-04-25T10:04:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- 172.21.15.18:0/525173395 wait complete. 2024-04-25T10:04:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 Processor -- start 2024-04-25T10:04:41.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- start start 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f096006e4a0 0x7f096013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 0x7f09600afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096015f9e0 con 0x7f0960159320 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096015f860 con 0x7f096015f440 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0965800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0960168590 con 0x7f096006e4a0 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48416/0 (socket says 172.21.15.18:48416) 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 -- 172.21.15.18:0/3396522699 learned_addr learned my addr 172.21.15.18:0/3396522699 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f095ea00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f096006e4a0 0x7f096013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f095f400640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 0x7f09600afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 -- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f096006e4a0 msgr2=0x7f096013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f096006e4a0 0x7f096013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 -- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 msgr2=0x7f09600afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 0x7f09600afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f0957e00640 1 -- 172.21.15.18:0/3396522699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09601403e0 con 0x7f0960159320 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.753+0000 7f095f400640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 0x7f09600afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0957e00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09480011f0 tx=0x7f094800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948018070 con 0x7f0960159320 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09480074e0 con 0x7f0960159320 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960144640 con 0x7f0960159320 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0948004a10 con 0x7f0960159320 2024-04-25T10:04:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0960141fd0 con 0x7f0960159320 2024-04-25T10:04:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09600745d0 con 0x7f0960159320 2024-04-25T10:04:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f094801b070 con 0x7f0960159320 2024-04-25T10:04:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 0x7f093c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f0948084780 con 0x7f0960159320 2024-04-25T10:04:41.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.757+0000 7f095ea00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 0x7f093c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:41.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.761+0000 7f095ea00640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 0x7f093c069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f095000c900 tx=0x7f0950008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.761+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0948055380 con 0x7f0960159320 2024-04-25T10:04:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.929+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0960072410 con 0x7f0960159320 2024-04-25T10:04:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.929+0000 7f0956a00640 1 -- 172.21.15.18:0/3396522699 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0948054c80 con 0x7f0960159320 2024-04-25T10:04:41.940 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 msgr2=0x7f093c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 0x7f093c069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f095000c900 tx=0x7f0950008040 comp rx=0 tx=0).stop 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 msgr2=0x7f0960142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f09480011f0 tx=0x7f094800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 shutdown_connections 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f096015f440 0x7f09600afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0960159320 0x7f0960142ab0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f093c066f60 0x7f093c069420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 --2- 172.21.15.18:0/3396522699 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f096006e4a0 0x7f096013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:41.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 >> 172.21.15.18:0/3396522699 conn(0x7f0960067080 msgr2=0x7f096006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:41.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 shutdown_connections 2024-04-25T10:04:41.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:41.933+0000 7f0965800640 1 -- 172.21.15.18:0/3396522699 wait complete. 2024-04-25T10:04:41.970 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:04:41.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.101+0000 7fcf33000640 1 Processor -- start 2024-04-25T10:04:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.101+0000 7fcf33000640 1 -- start start 2024-04-25T10:04:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf33000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf2c15da10 0x7fcf2c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf33000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf2c0d11b0 0x7fcf2c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf33000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c15ddf0 con 0x7fcf2c0b4210 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf33000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c06b480 con 0x7fcf2c15da10 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf33000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0d06d0 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf2c15da10 0x7fcf2c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf2c15da10 0x7fcf2c0afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48430/0 (socket says 172.21.15.18:48430) 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 -- 172.21.15.18:0/1110707970 learned_addr learned my addr 172.21.15.18:0/1110707970 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:42.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 -- 172.21.15.18:0/1110707970 >> v2:172.21.15.167:3300/0 conn(0x7fcf2c0d11b0 msgr2=0x7fcf2c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 --2- 172.21.15.18:0/1110707970 >> v2:172.21.15.167:3300/0 conn(0x7fcf2c0d11b0 0x7fcf2c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 -- 172.21.15.18:0/1110707970 >> v1:172.21.15.167:6789/0 conn(0x7fcf2c0b4210 legacy=0x7fcf2c0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 -- 172.21.15.18:0/1110707970 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0d09b0 con 0x7fcf2c15da10 2024-04-25T10:04:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.105+0000 7fcf2be00640 1 --2- 172.21.15.18:0/1110707970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c15da10 0x7fcf2c0afe20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c071d40 tx=0x7fcf1c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945e0262fe67bd59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf2b400640 1 -- 172.21.15.18:0/1110707970 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0b0070 con 0x7fcf2c15da10 2024-04-25T10:04:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf2b400640 1 -- 172.21.15.18:0/1110707970 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c0ab600 con 0x7fcf2c15da10 2024-04-25T10:04:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf2b400640 1 -- 172.21.15.18:0/1110707970 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0ab9d0 con 0x7fcf2c15da10 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- 172.21.15.18:0/1110707970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c15da10 msgr2=0x7fcf2c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- 172.21.15.18:0/1110707970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c15da10 0x7fcf2c0afe20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c071d40 tx=0x7fcf1c01c450 comp rx=0 tx=0).stop 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- 172.21.15.18:0/1110707970 shutdown_connections 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- 172.21.15.18:0/1110707970 >> v2:172.21.15.167:3300/0 conn(0x7fcf2c0d11b0 0x7fcf2c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- 172.21.15.18:0/1110707970 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c15da10 0x7fcf2c0afe20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- 172.21.15.18:0/1110707970 >> 172.21.15.18:0/1110707970 conn(0x7fcf2c0b2400 msgr2=0x7fcf2c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- 172.21.15.18:0/1110707970 shutdown_connections 2024-04-25T10:04:42.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- 172.21.15.18:0/1110707970 wait complete. 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 Processor -- start 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- start start 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 0x7fcf2c145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 0x7fcf2c151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c162190 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c162010 con 0x7fcf2c0b4210 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf33000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c162310 con 0x7fcf2c15da10 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48432/0 (socket says 172.21.15.18:48432) 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf23e00640 1 -- 172.21.15.18:0/3679868090 learned_addr learned my addr 172.21.15.18:0/3679868090 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.109+0000 7fcf2be00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 0x7fcf2c145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 -- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 msgr2=0x7fcf2c151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf31000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 0x7fcf2c151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 0x7fcf2c151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 -- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 msgr2=0x7fcf2c145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 0x7fcf2c145a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 -- 172.21.15.18:0/3679868090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c145f80 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf2be00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 0x7fcf2c145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf31000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 0x7fcf2c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf23e00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400b440 tx=0x7fcf1400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14015020 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140118b0 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14011ca0 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c146390 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c146950 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0745d0 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf14018020 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 0x7fcf08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcf140856a0 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.113+0000 7fcf2be00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 0x7fcf08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.117+0000 7fcf2be00640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 0x7fcf08069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0ad000 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.117+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf1401f020 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.281+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf2c072860 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf28c00640 1 -- 172.21.15.18:0/3679868090 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7fcf2c145f80 con 0x7fcf2c0d11b0 2024-04-25T10:04:42.294 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:42.294 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:42.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 msgr2=0x7fcf08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 0x7fcf08069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0ad000 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 msgr2=0x7fcf2c151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fcf1400b440 tx=0x7fcf1400b900 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 shutdown_connections 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf08066f60 0x7fcf08069420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf2c15da10 0x7fcf2c151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf2c0d11b0 0x7fcf2c151a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 --2- 172.21.15.18:0/3679868090 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf2c0b4210 0x7fcf2c145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 >> 172.21.15.18:0/3679868090 conn(0x7fcf2c0b2400 msgr2=0x7fcf2c1605f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 shutdown_connections 2024-04-25T10:04:42.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.285+0000 7fcf33000640 1 -- 172.21.15.18:0/3679868090 wait complete. 2024-04-25T10:04:42.315 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:42.316 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:42.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 Processor -- start 2024-04-25T10:04:42.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 -- start start 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3de406bf30 0x7f3de40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3de415e040 con 0x7f3de4099a60 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3de40cff80 con 0x7f3de406bf30 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3dea600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40d0260 con 0x7f3de415dc60 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3de406bf30 0x7f3de40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3de406bf30 0x7f3de40cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48448/0 (socket says 172.21.15.18:48448) 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 -- 172.21.15.18:0/3583792923 learned_addr learned my addr 172.21.15.18:0/3583792923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de3400640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 -- 172.21.15.18:0/3583792923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 msgr2=0x7f3de40d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de40d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 -- 172.21.15.18:0/3583792923 >> v1:172.21.15.167:6789/0 conn(0x7f3de4099a60 legacy=0x7f3de40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.453+0000 7f3de2a00640 1 -- 172.21.15.18:0/3583792923 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de40d0540 con 0x7f3de406bf30 2024-04-25T10:04:42.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3de2a00640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de40cf8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009870 tx=0x7f3dd001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db96ea74b39d168e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3de2000640 1 -- 172.21.15.18:0/3583792923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00aa600 con 0x7f3de406bf30 2024-04-25T10:04:42.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3de2000640 1 -- 172.21.15.18:0/3583792923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd00af070 con 0x7f3de406bf30 2024-04-25T10:04:42.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3de2000640 1 -- 172.21.15.18:0/3583792923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd00aa9c0 con 0x7f3de406bf30 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 -- 172.21.15.18:0/3583792923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 msgr2=0x7f3de40cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de40cf8a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3dd0009870 tx=0x7f3dd001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 -- 172.21.15.18:0/3583792923 shutdown_connections 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de40cf8a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 --2- 172.21.15.18:0/3583792923 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de40d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 -- 172.21.15.18:0/3583792923 >> 172.21.15.18:0/3583792923 conn(0x7f3de40b3200 msgr2=0x7f3de40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 -- 172.21.15.18:0/3583792923 shutdown_connections 2024-04-25T10:04:42.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 -- 172.21.15.18:0/3583792923 wait complete. 2024-04-25T10:04:42.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.457+0000 7f3dea600640 1 Processor -- start 2024-04-25T10:04:42.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- start start 2024-04-25T10:04:42.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4099a60 0x7f3de4152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de4158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de409a280 con 0x7f3de406bf30 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3de40cc880 con 0x7f3de4099a60 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3de4157ef0 con 0x7f3de415dc60 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48456/0 (socket says 172.21.15.18:48456) 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 -- 172.21.15.18:0/4288264881 learned_addr learned my addr 172.21.15.18:0/4288264881 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3e00640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de4158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de2a00640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4099a60 0x7f3de4152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 -- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 msgr2=0x7f3de4158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de4158cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 -- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4099a60 msgr2=0x7f3de4152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4099a60 0x7f3de4152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 -- 172.21.15.18:0/4288264881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de41581d0 con 0x7f3de406bf30 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3de3400640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d5f0 tx=0x7f3dd400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40125f0 con 0x7f3de406bf30 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dd4019070 con 0x7f3de406bf30 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40129d0 con 0x7f3de406bf30 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de41584b0 con 0x7f3de406bf30 2024-04-25T10:04:42.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3de4154a40 con 0x7f3de406bf30 2024-04-25T10:04:42.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.461+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3de40745d0 con 0x7f3de406bf30 2024-04-25T10:04:42.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.465+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3dd4012b70 con 0x7f3de406bf30 2024-04-25T10:04:42.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.465+0000 7f3ddb400640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.465+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3dd4085830 con 0x7f3de406bf30 2024-04-25T10:04:42.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.465+0000 7f3de2a00640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.465+0000 7f3de2a00640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 0x7f3dc4069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00ae000 tx=0x7f3dd00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.469+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3dd4055d50 con 0x7f3de406bf30 2024-04-25T10:04:42.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3de40cd450 con 0x7f3de406bf30 2024-04-25T10:04:42.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3ddb400640 1 -- 172.21.15.18:0/4288264881 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3dd4059df0 con 0x7f3de406bf30 2024-04-25T10:04:42.642 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 msgr2=0x7f3dc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 0x7f3dc4069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00ae000 tx=0x7f3dd00a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 msgr2=0x7f3de4154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400d5f0 tx=0x7f3dd400dab0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 shutdown_connections 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3dc4066f60 0x7f3dc4069420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3de415dc60 0x7f3de4158cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3de4099a60 0x7f3de4152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 --2- 172.21.15.18:0/4288264881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de406bf30 0x7f3de4154140 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 >> 172.21.15.18:0/4288264881 conn(0x7f3de40b3200 msgr2=0x7f3de4155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 shutdown_connections 2024-04-25T10:04:42.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.633+0000 7f3dea600640 1 -- 172.21.15.18:0/4288264881 wait complete. 2024-04-25T10:04:42.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:42.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 Processor -- start 2024-04-25T10:04:42.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 -- start start 2024-04-25T10:04:42.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 0x7f22e806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e815fc00 con 0x7f22e8159320 2024-04-25T10:04:42.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e815fee0 con 0x7f22e815c9b0 2024-04-25T10:04:42.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ef000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e806ee50 con 0x7f22e806e4a0 2024-04-25T10:04:42.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f22e8159320 0x7f22e815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60874/0 (socket says 172.21.15.18:60874) 2024-04-25T10:04:42.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7e00640 1 -- 172.21.15.18:0/2731616883 learned_addr learned my addr 172.21.15.18:0/2731616883 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ed000640 1 --2- 172.21.15.18:0/2731616883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 0x7f22e806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115359402 0 0) 0x7f22e815fc00 con 0x7f22e8159320 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22cc003530 con 0x7f22e8159320 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591283403 0 0) 0x7f22e815fee0 con 0x7f22e815c9b0 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22e815fc00 con 0x7f22e815c9b0 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ed000640 1 -- 172.21.15.18:0/2731616883 >> v1:172.21.15.167:6789/0 conn(0x7f22e815c9b0 legacy=0x7f22e806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192000368 0 0) 0x7f22cc003530 con 0x7f22e8159320 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ed000640 1 -- 172.21.15.18:0/2731616883 >> v1:172.21.15.18:6789/0 conn(0x7f22e8159320 legacy=0x7f22e815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.797+0000 7f22ed000640 1 -- 172.21.15.18:0/2731616883 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e81601c0 con 0x7f22e806e4a0 2024-04-25T10:04:42.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ed000640 1 --2- 172.21.15.18:0/2731616883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 0x7f22e806e910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009dc0 tx=0x7f22e001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e019eba00b276ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00b2070 con 0x7f22e806e4a0 2024-04-25T10:04:42.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00a5850 con 0x7f22e806e4a0 2024-04-25T10:04:42.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22e7400640 1 -- 172.21.15.18:0/2731616883 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00a5c00 con 0x7f22e806e4a0 2024-04-25T10:04:42.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 -- 172.21.15.18:0/2731616883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 msgr2=0x7f22e806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 --2- 172.21.15.18:0/2731616883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 0x7f22e806e910 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009dc0 tx=0x7f22e001c990 comp rx=0 tx=0).stop 2024-04-25T10:04:42.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 -- 172.21.15.18:0/2731616883 shutdown_connections 2024-04-25T10:04:42.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 --2- 172.21.15.18:0/2731616883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e806e4a0 0x7f22e806e910 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 -- 172.21.15.18:0/2731616883 >> 172.21.15.18:0/2731616883 conn(0x7f22e8067080 msgr2=0x7f22e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 -- 172.21.15.18:0/2731616883 shutdown_connections 2024-04-25T10:04:42.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.801+0000 7f22ef000640 1 -- 172.21.15.18:0/2731616883 wait complete. 2024-04-25T10:04:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 Processor -- start 2024-04-25T10:04:42.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- start start 2024-04-25T10:04:42.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22e806e4a0 0x7f22e8158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 0x7f22e80b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e8169720 con 0x7f22e815c9b0 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81695a0 con 0x7f22e806e4a0 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e81698a0 con 0x7f22e8159320 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48472/0 (socket says 172.21.15.18:48472) 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 -- 172.21.15.18:0/1414177144 learned_addr learned my addr 172.21.15.18:0/1414177144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22e7e00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22e806e4a0 0x7f22e8158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22dfe00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 0x7f22e80b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 -- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 msgr2=0x7f22e80b1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 0x7f22e80b1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 -- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22e806e4a0 msgr2=0x7f22e8158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22e806e4a0 0x7f22e8158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 -- 172.21.15.18:0/1414177144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8067e70 con 0x7f22e815c9b0 2024-04-25T10:04:42.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22dfe00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 0x7f22e80b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:42.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ed000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22e001a5c0 tx=0x7f22e0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00b2050 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e00be070 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e00ad870 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e80b3420 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.805+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e80b39e0 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.809+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e80745d0 con 0x7f22e815c9b0 2024-04-25T10:04:42.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.809+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f22e00ada10 con 0x7f22e815c9b0 2024-04-25T10:04:42.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.809+0000 7f22e4c00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 0x7f22c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:42.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.809+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f22e0120720 con 0x7f22e815c9b0 2024-04-25T10:04:42.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.809+0000 7f22e7e00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 0x7f22c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:42.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.813+0000 7f22e7e00640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 0x7f22c4069420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005890 tx=0x7f22d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:42.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.813+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22e0016580 con 0x7f22e815c9b0 2024-04-25T10:04:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.977+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22e80b4680 con 0x7f22e815c9b0 2024-04-25T10:04:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.977+0000 7f22e4c00640 1 -- 172.21.15.18:0/1414177144 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22e00add00 con 0x7f22e815c9b0 2024-04-25T10:04:42.987 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:42.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 msgr2=0x7f22c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 0x7f22c4069420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005890 tx=0x7f22d8009040 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 msgr2=0x7f22e8142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f22e001a5c0 tx=0x7f22e0019730 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 shutdown_connections 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22e815c9b0 0x7f22e8142ab0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f22c4066f60 0x7f22c4069420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f22e8159320 0x7f22e80b1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 --2- 172.21.15.18:0/1414177144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22e806e4a0 0x7f22e8158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 >> 172.21.15.18:0/1414177144 conn(0x7f22e8067080 msgr2=0x7f22e806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 shutdown_connections 2024-04-25T10:04:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:42.981+0000 7f22ef000640 1 -- 172.21.15.18:0/1414177144 wait complete. 2024-04-25T10:04:43.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.141+0000 7f4adb400640 1 Processor -- start 2024-04-25T10:04:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.141+0000 7f4adb400640 1 -- start start 2024-04-25T10:04:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4adb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 0x7f4ad40d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4adb400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4ad406e0f0 0x7f4ad40b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4adb400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad406e5f0 con 0x7f4ad40b4810 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4adb400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad406e8d0 con 0x7f4ad406e0f0 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4adb400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad406ebb0 con 0x7f4ad4161cf0 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad8a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4ad40b4810 0x7f4ad41615e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60878/0 (socket says 172.21.15.18:60878) 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad8a00640 1 -- 172.21.15.18:0/3105034080 learned_addr learned my addr 172.21.15.18:0/3105034080 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad3e00640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 0x7f4ad40d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad9400640 1 --2- 172.21.15.18:0/3105034080 >> v2:172.21.15.167:3300/0 conn(0x7f4ad406e0f0 0x7f4ad40b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad3400640 1 -- 172.21.15.18:0/3105034080 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503286905 0 0) 0x7f4ad406e5f0 con 0x7f4ad40b4810 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad3400640 1 -- 172.21.15.18:0/3105034080 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4abc003530 con 0x7f4ad40b4810 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad9400640 1 -- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 msgr2=0x7f4ad40d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad9400640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 0x7f4ad40d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad9400640 1 -- 172.21.15.18:0/3105034080 >> v1:172.21.15.18:6789/0 conn(0x7f4ad40b4810 legacy=0x7f4ad41615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad9400640 1 -- 172.21.15.18:0/3105034080 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad406ee90 con 0x7f4ad406e0f0 2024-04-25T10:04:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.145+0000 7f4ad3e00640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 0x7f4ad40d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4ad9400640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad406e0f0 0x7f4ad40b2d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009d90 tx=0x7f4acc01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2df163934dbbf590 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4ad3400640 1 -- 172.21.15.18:0/3105034080 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0b2070 con 0x7f4ad406e0f0 2024-04-25T10:04:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4ad3400640 1 -- 172.21.15.18:0/3105034080 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc0a57c0 con 0x7f4ad406e0f0 2024-04-25T10:04:43.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4ad3400640 1 -- 172.21.15.18:0/3105034080 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0a5b90 con 0x7f4ad406e0f0 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 -- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad406e0f0 msgr2=0x7f4ad40b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad406e0f0 0x7f4ad40b2d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009d90 tx=0x7f4acc01c8e0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 -- 172.21.15.18:0/3105034080 shutdown_connections 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad406e0f0 0x7f4ad40b2d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 --2- 172.21.15.18:0/3105034080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad4161cf0 0x7f4ad40d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 -- 172.21.15.18:0/3105034080 >> 172.21.15.18:0/3105034080 conn(0x7f4ad40cf9c0 msgr2=0x7f4ad40cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 -- 172.21.15.18:0/3105034080 shutdown_connections 2024-04-25T10:04:43.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 -- 172.21.15.18:0/3105034080 wait complete. 2024-04-25T10:04:43.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.149+0000 7f4adb400640 1 Processor -- start 2024-04-25T10:04:43.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- start start 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad406e0f0 0x7f4ad414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad4161cf0 0x7f4ad40acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40b3e20 con 0x7f4ad40b4810 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40b3ca0 con 0x7f4ad4161cf0 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad40b3fa0 con 0x7f4ad406e0f0 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48478/0 (socket says 172.21.15.18:48478) 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 -- 172.21.15.18:0/2385593943 learned_addr learned my addr 172.21.15.18:0/2385593943 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 -- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad406e0f0 msgr2=0x7f4ad414d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad406e0f0 0x7f4ad414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 -- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad4161cf0 msgr2=0x7f4ad40acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad4161cf0 0x7f4ad40acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 -- 172.21.15.18:0/2385593943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad414d9f0 con 0x7f4ad40b4810 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad3e00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000ec10 tx=0x7f4ac000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0017070 con 0x7f4ad40b4810 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac000cc30 con 0x7f4ad40b4810 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac0013470 con 0x7f4ad40b4810 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad414dc90 con 0x7f4ad40b4810 2024-04-25T10:04:43.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad40af160 con 0x7f4ad40b4810 2024-04-25T10:04:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.153+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad40745d0 con 0x7f4ad40b4810 2024-04-25T10:04:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.157+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ac001a070 con 0x7f4ad40b4810 2024-04-25T10:04:43.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.157+0000 7f4ad0c00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 0x7f4ab4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.157+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4ac0085300 con 0x7f4ad40b4810 2024-04-25T10:04:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.157+0000 7f4ad8a00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 0x7f4ab4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.157+0000 7f4ad8a00640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 0x7f4ab4069450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8007fd0 tx=0x7f4ac8007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.161+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ac0055fa0 con 0x7f4ad40b4810 2024-04-25T10:04:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.321+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ad40cbe00 con 0x7f4ad40b4810 2024-04-25T10:04:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.321+0000 7f4ad0c00640 1 -- 172.21.15.18:0/2385593943 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ac00558a0 con 0x7f4ad40b4810 2024-04-25T10:04:43.331 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.321+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 msgr2=0x7f4ab4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 0x7f4ab4069450 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8007fd0 tx=0x7f4ac8007900 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 msgr2=0x7f4ad413b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000ec10 tx=0x7f4ac000c520 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 shutdown_connections 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad4161cf0 0x7f4ad40acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ad40b4810 0x7f4ad413b390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4ab4066f90 0x7f4ab4069450 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 --2- 172.21.15.18:0/2385593943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4ad406e0f0 0x7f4ad414d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 >> 172.21.15.18:0/2385593943 conn(0x7f4ad40cf9c0 msgr2=0x7f4ad40cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 shutdown_connections 2024-04-25T10:04:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.325+0000 7f4adb400640 1 -- 172.21.15.18:0/2385593943 wait complete. 2024-04-25T10:04:43.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:43.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.489+0000 7f8fe3e00640 1 Processor -- start 2024-04-25T10:04:43.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.489+0000 7f8fe3e00640 1 -- start start 2024-04-25T10:04:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8fe415f3b0 0x7f8fe415f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8fe40cc050 0x7f8fe40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe409ade0 con 0x7f8fe415b9e0 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe4099a60 con 0x7f8fe40cc050 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe4099d40 con 0x7f8fe415f3b0 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8fe40cc050 0x7f8fe40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8fe40cc050 0x7f8fe40cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48488/0 (socket says 172.21.15.18:48488) 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 -- 172.21.15.18:0/2069788179 learned_addr learned my addr 172.21.15.18:0/2069788179 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fda000640 1 --2- 172.21.15.18:0/2069788179 >> v2:172.21.15.167:3300/0 conn(0x7f8fe415f3b0 0x7f8fe415f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 -- 172.21.15.18:0/2069788179 >> v2:172.21.15.167:3300/0 conn(0x7f8fe415f3b0 msgr2=0x7f8fe415f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 --2- 172.21.15.18:0/2069788179 >> v2:172.21.15.167:3300/0 conn(0x7f8fe415f3b0 0x7f8fe415f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 -- 172.21.15.18:0/2069788179 >> v1:172.21.15.167:6789/0 conn(0x7f8fe415b9e0 legacy=0x7f8fe40cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.493+0000 7f8fe3400640 1 -- 172.21.15.18:0/2069788179 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe409a020 con 0x7f8fe40cc050 2024-04-25T10:04:43.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3400640 1 --2- 172.21.15.18:0/2069788179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe40cc430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b75c0 tx=0x7f8fdc01c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63af68419343a64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2000640 1 -- 172.21.15.18:0/2069788179 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0a5560 con 0x7f8fe40cc050 2024-04-25T10:04:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2000640 1 -- 172.21.15.18:0/2069788179 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc0a5700 con 0x7f8fe40cc050 2024-04-25T10:04:43.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2000640 1 -- 172.21.15.18:0/2069788179 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0a5ad0 con 0x7f8fe40cc050 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- 172.21.15.18:0/2069788179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 msgr2=0x7f8fe40cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/2069788179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe40cc430 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b75c0 tx=0x7f8fdc01c7b0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- 172.21.15.18:0/2069788179 shutdown_connections 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/2069788179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe40cc430 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/2069788179 >> v2:172.21.15.167:3300/0 conn(0x7f8fe415f3b0 0x7f8fe415f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- 172.21.15.18:0/2069788179 >> 172.21.15.18:0/2069788179 conn(0x7f8fe40b3030 msgr2=0x7f8fe40b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- 172.21.15.18:0/2069788179 shutdown_connections 2024-04-25T10:04:43.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- 172.21.15.18:0/2069788179 wait complete. 2024-04-25T10:04:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 Processor -- start 2024-04-25T10:04:43.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- start start 2024-04-25T10:04:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe415b9e0 0x7f8fe415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe415f3b0 0x7f8fe415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40d03d0 con 0x7f8fe40cc050 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe40d0250 con 0x7f8fe415b9e0 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe41686f0 con 0x7f8fe415f3b0 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48500/0 (socket says 172.21.15.18:48500) 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.497+0000 7f8fe2a00640 1 -- 172.21.15.18:0/767844520 learned_addr learned my addr 172.21.15.18:0/767844520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fda000640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe415b9e0 0x7f8fe415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe3400640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe415f3b0 0x7f8fe415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 -- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe415f3b0 msgr2=0x7f8fe415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe415f3b0 0x7f8fe415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 -- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe415b9e0 msgr2=0x7f8fe415db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe415b9e0 0x7f8fe415db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 -- 172.21.15.18:0/767844520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe414be90 con 0x7f8fe40cc050 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe2a00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b410 tx=0x7f8fd400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4015030 con 0x7f8fe40cc050 2024-04-25T10:04:43.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd4004020 con 0x7f8fe40cc050 2024-04-25T10:04:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4004450 con 0x7f8fe40cc050 2024-04-25T10:04:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe415e800 con 0x7f8fe40cc050 2024-04-25T10:04:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe40c97a0 con 0x7f8fe40cc050 2024-04-25T10:04:43.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe40745d0 con 0x7f8fe40cc050 2024-04-25T10:04:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.501+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8fd4018070 con 0x7f8fe40cc050 2024-04-25T10:04:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.505+0000 7f8fdbe00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 0x7f8fc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.505+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8fd4084e80 con 0x7f8fe40cc050 2024-04-25T10:04:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.505+0000 7f8fda000640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 0x7f8fc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.505+0000 7f8fda000640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 0x7f8fc0069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b1c90 tx=0x7f8fcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.509+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8fd40553a0 con 0x7f8fe40cc050 2024-04-25T10:04:43.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8fe40d1320 con 0x7f8fe40cc050 2024-04-25T10:04:43.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fdbe00640 1 -- 172.21.15.18:0/767844520 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8fd4059440 con 0x7f8fe40cc050 2024-04-25T10:04:43.681 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 msgr2=0x7f8fc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 0x7f8fc0069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b1c90 tx=0x7f8fcc008040 comp rx=0 tx=0).stop 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 msgr2=0x7f8fe414b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400b410 tx=0x7f8fd400b8d0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 shutdown_connections 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8fc0066f60 0x7f8fc0069420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8fe415f3b0 0x7f8fe415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8fe415b9e0 0x7f8fe415db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 --2- 172.21.15.18:0/767844520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8fe40cc050 0x7f8fe414b950 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 >> 172.21.15.18:0/767844520 conn(0x7f8fe40b3030 msgr2=0x7f8fe415a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 shutdown_connections 2024-04-25T10:04:43.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.673+0000 7f8fe3e00640 1 -- 172.21.15.18:0/767844520 wait complete. 2024-04-25T10:04:43.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T10:04:43.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.833+0000 7f7f0e200640 1 Processor -- start 2024-04-25T10:04:43.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 -- start start 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f08144140 0x7f7f080ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7f0806ead0 0x7f7f080b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0815ac60 con 0x7f7f080ced60 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f080cf3e0 con 0x7f7f08144140 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f0e200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0815af20 con 0x7f7f0806ead0 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f08144140 0x7f7f080ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f08144140 0x7f7f080ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48510/0 (socket says 172.21.15.18:48510) 2024-04-25T10:04:43.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 -- 172.21.15.18:0/1501192062 learned_addr learned my addr 172.21.15.18:0/1501192062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 -- 172.21.15.18:0/1501192062 >> v2:172.21.15.167:3300/0 conn(0x7f7f0806ead0 msgr2=0x7f7f080b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 --2- 172.21.15.18:0/1501192062 >> v2:172.21.15.167:3300/0 conn(0x7f7f0806ead0 0x7f7f080b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 -- 172.21.15.18:0/1501192062 >> v1:172.21.15.167:6789/0 conn(0x7f7f080ced60 legacy=0x7f7f0806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:43.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.837+0000 7f7f07400640 1 -- 172.21.15.18:0/1501192062 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0815b200 con 0x7f7f08144140 2024-04-25T10:04:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f07400640 1 --2- 172.21.15.18:0/1501192062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f08144140 0x7f7f080ce820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f080cc520 tx=0x7f7ef801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3112837aa8d5f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f06a00640 1 -- 172.21.15.18:0/1501192062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80b1070 con 0x7f7f08144140 2024-04-25T10:04:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f06a00640 1 -- 172.21.15.18:0/1501192062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef80ac440 con 0x7f7f08144140 2024-04-25T10:04:43.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f06a00640 1 -- 172.21.15.18:0/1501192062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80ac810 con 0x7f7f08144140 2024-04-25T10:04:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- 172.21.15.18:0/1501192062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f08144140 msgr2=0x7f7f080ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 --2- 172.21.15.18:0/1501192062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f08144140 0x7f7f080ce820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7f080cc520 tx=0x7f7ef801c4e0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- 172.21.15.18:0/1501192062 shutdown_connections 2024-04-25T10:04:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 --2- 172.21.15.18:0/1501192062 >> v2:172.21.15.167:3300/0 conn(0x7f7f0806ead0 0x7f7f080b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 --2- 172.21.15.18:0/1501192062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f08144140 0x7f7f080ce820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- 172.21.15.18:0/1501192062 >> 172.21.15.18:0/1501192062 conn(0x7f7f08066fa0 msgr2=0x7f7f0806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:43.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- 172.21.15.18:0/1501192062 shutdown_connections 2024-04-25T10:04:43.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- 172.21.15.18:0/1501192062 wait complete. 2024-04-25T10:04:43.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 Processor -- start 2024-04-25T10:04:43.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.841+0000 7f7f0e200640 1 -- start start 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f0806ead0 0x7f7f080cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f08144140 0x7f7f08159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0815bb80 con 0x7f7f080ced60 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0815ba00 con 0x7f7f08144140 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081673e0 con 0x7f7f0806ead0 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48526/0 (socket says 172.21.15.18:48526) 2024-04-25T10:04:43.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 -- 172.21.15.18:0/4045190038 learned_addr learned my addr 172.21.15.18:0/4045190038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f07400640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f0806ead0 0x7f7f080cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f07e00640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f08144140 0x7f7f08159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 -- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f0806ead0 msgr2=0x7f7f080cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f0806ead0 0x7f7f080cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 -- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f08144140 msgr2=0x7f7f08159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f08144140 0x7f7f08159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 -- 172.21.15.18:0/4045190038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f081f75a0 con 0x7f7f080ced60 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7effe00640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c490 tx=0x7f7ef0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0017070 con 0x7f7f080ced60 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef0003600 con 0x7f7f080ced60 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f081fa040 con 0x7f7f080ced60 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00039f0 con 0x7f7f080ced60 2024-04-25T10:04:43.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f081fab20 con 0x7f7f080ced60 2024-04-25T10:04:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f080745d0 con 0x7f7f080ced60 2024-04-25T10:04:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.845+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ef001a070 con 0x7f7f080ced60 2024-04-25T10:04:43.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.849+0000 7f7eff400640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 0x7f7ee4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.849+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7ef00847e0 con 0x7f7f080ced60 2024-04-25T10:04:43.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.849+0000 7f7f07400640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 0x7f7ee4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.849+0000 7f7f07400640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 0x7f7ee4069420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80ae000 tx=0x7f7ef8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:43.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:43.853+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ef0054d00 con 0x7f7f080ced60 2024-04-25T10:04:44.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.077+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f7f0815ce00 con 0x7f7f080ced60 2024-04-25T10:04:44.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.941+0000 7f7eff400640 1 -- 172.21.15.18:0/4045190038 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v69) v1 ==== 145+0+0 (secure 0 0 0) 0x7f7ef0058da0 con 0x7f7f080ced60 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 msgr2=0x7f7ee4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 0x7f7ee4069420 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80ae000 tx=0x7f7ef8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 msgr2=0x7f7f08159700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ef000c490 tx=0x7f7ef0001e80 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 shutdown_connections 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f08144140 0x7f7f08159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f080ced60 0x7f7f08159700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee4066f60 0x7f7ee4069420 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 --2- 172.21.15.18:0/4045190038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f0806ead0 0x7f7f080cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:44.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 >> 172.21.15.18:0/4045190038 conn(0x7f7f08066fa0 msgr2=0x7f7f080b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 shutdown_connections 2024-04-25T10:04:44.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:44.945+0000 7f7f0e200640 1 -- 172.21.15.18:0/4045190038 wait complete. 2024-04-25T10:04:44.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:04:45.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 Processor -- start 2024-04-25T10:04:45.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 -- start start 2024-04-25T10:04:45.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 0x7fdce015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce015bc40 con 0x7fdce015ee60 2024-04-25T10:04:45.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce015e490 con 0x7fdce00ccbf0 2024-04-25T10:04:45.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce8400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce015b3a0 con 0x7fdce0144120 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 0x7fdce015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce6400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fdce015ee60 0x7fdce00b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42694/0 (socket says 172.21.15.18:42694) 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce6400640 1 -- 172.21.15.18:0/115579175 learned_addr learned my addr 172.21.15.18:0/115579175 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdcdfe00640 1 -- 172.21.15.18:0/115579175 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056465357 0 0) 0x7fdce015bc40 con 0x7fdce015ee60 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5a00640 1 -- 172.21.15.18:0/115579175 >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 msgr2=0x7fdce015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5a00640 1 --2- 172.21.15.18:0/115579175 >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 0x7fdce015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5a00640 1 -- 172.21.15.18:0/115579175 >> v1:172.21.15.167:6789/0 conn(0x7fdce015ee60 legacy=0x7fdce00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5a00640 1 -- 172.21.15.18:0/115579175 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce015b680 con 0x7fdce0144120 2024-04-25T10:04:45.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.117+0000 7fdce5000640 1 --2- 172.21.15.18:0/115579175 >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 0x7fdce015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:45.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce5a00640 1 --2- 172.21.15.18:0/115579175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce015acd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40097c0 tx=0x7fdcd401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4e1f2692887396 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdcdfe00640 1 -- 172.21.15.18:0/115579175 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b0070 con 0x7fdce0144120 2024-04-25T10:04:45.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdcdfe00640 1 -- 172.21.15.18:0/115579175 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40ab600 con 0x7fdce0144120 2024-04-25T10:04:45.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdcdfe00640 1 -- 172.21.15.18:0/115579175 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40ab9d0 con 0x7fdce0144120 2024-04-25T10:04:45.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 -- 172.21.15.18:0/115579175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 msgr2=0x7fdce015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 --2- 172.21.15.18:0/115579175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce015acd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40097c0 tx=0x7fdcd401c410 comp rx=0 tx=0).stop 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 -- 172.21.15.18:0/115579175 shutdown_connections 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 --2- 172.21.15.18:0/115579175 >> v2:172.21.15.167:3300/0 conn(0x7fdce00ccbf0 0x7fdce015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 --2- 172.21.15.18:0/115579175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce015acd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 -- 172.21.15.18:0/115579175 >> 172.21.15.18:0/115579175 conn(0x7fdce0067080 msgr2=0x7fdce006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 -- 172.21.15.18:0/115579175 shutdown_connections 2024-04-25T10:04:45.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.121+0000 7fdce8400640 1 -- 172.21.15.18:0/115579175 wait complete. 2024-04-25T10:04:45.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 Processor -- start 2024-04-25T10:04:45.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- start start 2024-04-25T10:04:45.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce01596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 0x7fdce0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce01675c0 con 0x7fdce00ccbf0 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0167440 con 0x7fdce015ee60 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce0167740 con 0x7fdce0144120 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48534/0 (socket says 172.21.15.18:48534) 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 -- 172.21.15.18:0/1225191462 learned_addr learned my addr 172.21.15.18:0/1225191462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5000640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce01596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce6400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 0x7fdce0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 -- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 msgr2=0x7fdce01596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce01596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 -- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 msgr2=0x7fdce0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 0x7fdce0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 -- 172.21.15.18:0/1225191462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00af360 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce6400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 0x7fdce0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce5a00640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ae040 tx=0x7fdcd401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b0050 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd40bc070 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b5870 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce00af640 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.125+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce00afc00 con 0x7fdce00ccbf0 2024-04-25T10:04:45.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce00745d0 con 0x7fdce00ccbf0 2024-04-25T10:04:45.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdcd40b5a10 con 0x7fdce00ccbf0 2024-04-25T10:04:45.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdcdd600640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 0x7fdcc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fdcd411fbf0 con 0x7fdce00ccbf0 2024-04-25T10:04:45.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdce5000640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 0x7fdcc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.129+0000 7fdce5000640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 0x7fdcc0069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009580 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.133+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdcd4016090 con 0x7fdce00ccbf0 2024-04-25T10:04:45.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.301+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdce00afe40 con 0x7fdce00ccbf0 2024-04-25T10:04:45.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.301+0000 7fdcdd600640 1 -- 172.21.15.18:0/1225191462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdce00afe40 con 0x7fdce00ccbf0 2024-04-25T10:04:45.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 msgr2=0x7fdcc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 0x7fdcc0069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009580 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 msgr2=0x7fdce0163a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40ae040 tx=0x7fdcd401ac50 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 shutdown_connections 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdce015ee60 0x7fdce0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdcc0066f60 0x7fdcc0069420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdce0144120 0x7fdce01596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 --2- 172.21.15.18:0/1225191462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdce00ccbf0 0x7fdce0163a50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 >> 172.21.15.18:0/1225191462 conn(0x7fdce0067080 msgr2=0x7fdce006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 shutdown_connections 2024-04-25T10:04:45.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.305+0000 7fdce8400640 1 -- 172.21.15.18:0/1225191462 wait complete. 2024-04-25T10:04:45.333 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:04:45.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:45.391 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:04:45.464 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:04:45.464 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:45.464 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:45.473 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:45.474 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:45.524 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:45.524 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:45.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:45.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 Processor -- start 2024-04-25T10:04:45.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 -- start start 2024-04-25T10:04:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f367c15b5a0 0x7f367c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f367c15b980 0x7f367c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0ce7f0 con 0x7f367c071970 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c0cfcd0 con 0x7f367c15b980 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3683c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c0cead0 con 0x7f367c15b5a0 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3673e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f367c15b980 0x7f367c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3681c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f367c071970 0x7f367c15f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60888/0 (socket says 172.21.15.18:60888) 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3681c00640 1 -- 172.21.15.18:0/3098717760 learned_addr learned my addr 172.21.15.18:0/3098717760 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3681200640 1 --2- 172.21.15.18:0/3098717760 >> v2:172.21.15.167:3300/0 conn(0x7f367c15b5a0 0x7f367c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3673e00640 1 -- 172.21.15.18:0/3098717760 >> v2:172.21.15.167:3300/0 conn(0x7f367c15b5a0 msgr2=0x7f367c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3673e00640 1 --2- 172.21.15.18:0/3098717760 >> v2:172.21.15.167:3300/0 conn(0x7f367c15b5a0 0x7f367c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3673e00640 1 -- 172.21.15.18:0/3098717760 >> v1:172.21.15.18:6789/0 conn(0x7f367c071970 legacy=0x7f367c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f3673e00640 1 -- 172.21.15.18:0/3098717760 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0cf960 con 0x7f367c15b980 2024-04-25T10:04:45.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.753+0000 7f367be00640 1 -- 172.21.15.18:0/3098717760 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755367125 0 0) 0x7f367c0ce7f0 con 0x7f367c071970 2024-04-25T10:04:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3673e00640 1 --2- 172.21.15.18:0/3098717760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c15b980 0x7f367c0cbd30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f367c072e00 tx=0x7f366401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e541f3e3063de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f367be00640 1 -- 172.21.15.18:0/3098717760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640b1070 con 0x7f367c15b980 2024-04-25T10:04:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f367be00640 1 -- 172.21.15.18:0/3098717760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36640ac5f0 con 0x7f367c15b980 2024-04-25T10:04:45.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f367be00640 1 -- 172.21.15.18:0/3098717760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36640ac9c0 con 0x7f367c15b980 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 -- 172.21.15.18:0/3098717760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c15b980 msgr2=0x7f367c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 --2- 172.21.15.18:0/3098717760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c15b980 0x7f367c0cbd30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f367c072e00 tx=0x7f366401c480 comp rx=0 tx=0).stop 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 -- 172.21.15.18:0/3098717760 shutdown_connections 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 --2- 172.21.15.18:0/3098717760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c15b980 0x7f367c0cbd30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 --2- 172.21.15.18:0/3098717760 >> v2:172.21.15.167:3300/0 conn(0x7f367c15b5a0 0x7f367c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 -- 172.21.15.18:0/3098717760 >> 172.21.15.18:0/3098717760 conn(0x7f367c0b3390 msgr2=0x7f367c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 -- 172.21.15.18:0/3098717760 shutdown_connections 2024-04-25T10:04:45.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.757+0000 7f3683c00640 1 -- 172.21.15.18:0/3098717760 wait complete. 2024-04-25T10:04:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 Processor -- start 2024-04-25T10:04:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- start start 2024-04-25T10:04:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 0x7f367c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367c15b980 0x7f367c0b5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c168ad0 con 0x7f367c071970 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c168950 con 0x7f367c15b5a0 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c168c50 con 0x7f367c15b980 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48546/0 (socket says 172.21.15.18:48546) 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 -- 172.21.15.18:0/1890254680 learned_addr learned my addr 172.21.15.18:0/1890254680 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3673e00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 0x7f367c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367c15b980 0x7f367c0b5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 -- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367c15b980 msgr2=0x7f367c0b5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367c15b980 0x7f367c0b5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 -- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 msgr2=0x7f367c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 0x7f367c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 -- 172.21.15.18:0/1890254680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c1517d0 con 0x7f367c071970 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3673e00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 0x7f367c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3681200640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f366c00d800 tx=0x7f366c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00b6c0 con 0x7f367c071970 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c019070 con 0x7f367c071970 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c0b4d50 con 0x7f367c071970 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00ba60 con 0x7f367c071970 2024-04-25T10:04:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c0b55f0 con 0x7f367c071970 2024-04-25T10:04:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.761+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c0745d0 con 0x7f367c071970 2024-04-25T10:04:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.765+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f366c00bc00 con 0x7f367c071970 2024-04-25T10:04:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.765+0000 7f3679600640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 0x7f3658069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.765+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f366c0859b0 con 0x7f367c071970 2024-04-25T10:04:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.765+0000 7f3673e00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 0x7f3658069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:45.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.765+0000 7f3673e00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 0x7f3658069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36640ae000 tx=0x7f36640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.769+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f366c056520 con 0x7f367c071970 2024-04-25T10:04:45.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.932+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f367c0cc960 con 0x7f367c071970 2024-04-25T10:04:45.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.932+0000 7f3679600640 1 -- 172.21.15.18:0/1890254680 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f366c055e20 con 0x7f367c071970 2024-04-25T10:04:45.944 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:45.944 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:45.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 msgr2=0x7f3658069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 0x7f3658069420 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f36640ae000 tx=0x7f36640a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:45.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 msgr2=0x7f367c15c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:45.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f366c00d800 tx=0x7f366c00dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 shutdown_connections 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3658066f60 0x7f3658069420 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367c15b980 0x7f367c0b5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f367c15b5a0 0x7f367c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 --2- 172.21.15.18:0/1890254680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f367c071970 0x7f367c15c7f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 >> 172.21.15.18:0/1890254680 conn(0x7f367c0b3390 msgr2=0x7f367c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 shutdown_connections 2024-04-25T10:04:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:45.936+0000 7f3683c00640 1 -- 172.21.15.18:0/1890254680 wait complete. 2024-04-25T10:04:45.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:45.966 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:46.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 Processor -- start 2024-04-25T10:04:46.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 -- start start 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d1c15e770 0x7f6d1c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d1c06d2d0 0x7f6d1c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d1c06db20 con 0x7f6d1c071270 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c15f090 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d23800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1c06de00 con 0x7f6d1c15e770 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d1c06d2d0 0x7f6d1c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d1c06d2d0 0x7f6d1c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48548/0 (socket says 172.21.15.18:48548) 2024-04-25T10:04:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 -- 172.21.15.18:0/1773285526 learned_addr learned my addr 172.21.15.18:0/1773285526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 -- 172.21.15.18:0/1773285526 >> v2:172.21.15.167:3300/0 conn(0x7f6d1c15e770 msgr2=0x7f6d1c15eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 --2- 172.21.15.18:0/1773285526 >> v2:172.21.15.167:3300/0 conn(0x7f6d1c15e770 0x7f6d1c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 -- 172.21.15.18:0/1773285526 >> v1:172.21.15.167:6789/0 conn(0x7f6d1c071270 legacy=0x7f6d1c0ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.100+0000 7f6d1be00640 1 -- 172.21.15.18:0/1773285526 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c06e0e0 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d1be00640 1 --2- 172.21.15.18:0/1773285526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c15f230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c06e600 tx=0x7f6d0801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3859f9345488a3c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d1b400640 1 -- 172.21.15.18:0/1773285526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080b2070 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d1b400640 1 -- 172.21.15.18:0/1773285526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080a9070 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d1b400640 1 -- 172.21.15.18:0/1773285526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d080ad880 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 -- 172.21.15.18:0/1773285526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c06d2d0 msgr2=0x7f6d1c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 --2- 172.21.15.18:0/1773285526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c15f230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c06e600 tx=0x7f6d0801c450 comp rx=0 tx=0).stop 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 -- 172.21.15.18:0/1773285526 shutdown_connections 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 --2- 172.21.15.18:0/1773285526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c15f230 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 --2- 172.21.15.18:0/1773285526 >> v2:172.21.15.167:3300/0 conn(0x7f6d1c15e770 0x7f6d1c15eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 -- 172.21.15.18:0/1773285526 >> 172.21.15.18:0/1773285526 conn(0x7f6d1c067080 msgr2=0x7f6d1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 -- 172.21.15.18:0/1773285526 shutdown_connections 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.104+0000 7f6d23800640 1 -- 172.21.15.18:0/1773285526 wait complete. 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 Processor -- start 2024-04-25T10:04:46.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- start start 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c0af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 0x7f6d1c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c06d760 con 0x7f6d1c15e770 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c071ab0 con 0x7f6d1c06d2d0 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d1c06d8e0 con 0x7f6d1c071270 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48552/0 (socket says 172.21.15.18:48552) 2024-04-25T10:04:46.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 -- 172.21.15.18:0/1515711845 learned_addr learned my addr 172.21.15.18:0/1515711845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d20e00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c0af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d1be00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 0x7f6d1c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 -- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 msgr2=0x7f6d1c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 0x7f6d1c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 -- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 msgr2=0x7f6d1c0af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c0af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 -- 172.21.15.18:0/1515711845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1c156d90 con 0x7f6d1c15e770 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d1be00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 0x7f6d1c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d20e00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:46.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d21800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400b9c0 tx=0x7f6d1400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14019070 con 0x7f6d1c15e770 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1400cba0 con 0x7f6d1c15e770 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d14014440 con 0x7f6d1c15e770 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d1c157070 con 0x7f6d1c15e770 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d1c157630 con 0x7f6d1c15e770 2024-04-25T10:04:46.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.108+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c0745d0 con 0x7f6d1c15e770 2024-04-25T10:04:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.112+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d1401c070 con 0x7f6d1c15e770 2024-04-25T10:04:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.112+0000 7f6d18c00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 0x7f6cfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.112+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6d140851a0 con 0x7f6d1c15e770 2024-04-25T10:04:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.112+0000 7f6d20e00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 0x7f6cfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.112+0000 7f6d20e00640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 0x7f6cfc069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8b0 tx=0x7f6d10008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.116+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d14055da0 con 0x7f6d1c15e770 2024-04-25T10:04:46.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d1c06e8d0 con 0x7f6d1c15e770 2024-04-25T10:04:46.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d18c00640 1 -- 172.21.15.18:0/1515711845 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d140556a0 con 0x7f6d1c15e770 2024-04-25T10:04:46.289 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 msgr2=0x7f6cfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 0x7f6cfc069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000a8b0 tx=0x7f6d10008040 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 msgr2=0x7f6d1c13c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400b9c0 tx=0x7f6d1400be80 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 shutdown_connections 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d1c15e770 0x7f6d1c13c180 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6cfc066f60 0x7f6cfc069420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d1c071270 0x7f6d1c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 --2- 172.21.15.18:0/1515711845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d1c06d2d0 0x7f6d1c0af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 >> 172.21.15.18:0/1515711845 conn(0x7f6d1c067080 msgr2=0x7f6d1c15d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 shutdown_connections 2024-04-25T10:04:46.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.280+0000 7f6d23800640 1 -- 172.21.15.18:0/1515711845 wait complete. 2024-04-25T10:04:46.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 Processor -- start 2024-04-25T10:04:46.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 -- start start 2024-04-25T10:04:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c15e040 con 0x7f8e9c06bf30 2024-04-25T10:04:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cff80 con 0x7f8e9c09a170 2024-04-25T10:04:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.444+0000 7f8ea2e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0d0260 con 0x7f8e9c15dc60 2024-04-25T10:04:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8ea0e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:56930/0 (socket says 172.21.15.18:56930) 2024-04-25T10:04:46.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e93e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f8e9c06bf30 0x7f8e9c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42706/0 (socket says 172.21.15.18:42706) 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8ea0e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:60836/0 (socket says 172.21.15.18:60836) 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 -- 172.21.15.18:0/2123668977 learned_addr learned my addr 172.21.15.18:0/2123668977 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 -- 172.21.15.18:0/2123668977 >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 msgr2=0x7f8e9c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 --2- 172.21.15.18:0/2123668977 >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 -- 172.21.15.18:0/2123668977 >> v1:172.21.15.167:6789/0 conn(0x7f8e9c06bf30 legacy=0x7f8e9c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 -- 172.21.15.18:0/2123668977 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0d0540 con 0x7f8e9c15dc60 2024-04-25T10:04:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8ea0e00640 1 --2- 172.21.15.18:0/2123668977 >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9be00640 1 --2- 172.21.15.18:0/2123668977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009870 tx=0x7f8e8c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd6f2243a0ac89c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.448+0000 7f8e9b400640 1 -- 172.21.15.18:0/2123668977 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0aa600 con 0x7f8e9c15dc60 2024-04-25T10:04:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e9b400640 1 -- 172.21.15.18:0/2123668977 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0af070 con 0x7f8e9c15dc60 2024-04-25T10:04:46.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e9b400640 1 -- 172.21.15.18:0/2123668977 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0aa9c0 con 0x7f8e9c15dc60 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- 172.21.15.18:0/2123668977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 msgr2=0x7f8e9c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/2123668977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009870 tx=0x7f8e8c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- 172.21.15.18:0/2123668977 shutdown_connections 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/2123668977 >> v2:172.21.15.167:3300/0 conn(0x7f8e9c09a170 0x7f8e9c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/2123668977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c0d1020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- 172.21.15.18:0/2123668977 >> 172.21.15.18:0/2123668977 conn(0x7f8e9c0b3200 msgr2=0x7f8e9c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- 172.21.15.18:0/2123668977 shutdown_connections 2024-04-25T10:04:46.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- 172.21.15.18:0/2123668977 wait complete. 2024-04-25T10:04:46.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 Processor -- start 2024-04-25T10:04:46.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- start start 2024-04-25T10:04:46.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 0x7f8e9c15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cc6f0 con 0x7f8e9c09a170 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cc570 con 0x7f8e9c06bf30 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea2e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0cc870 con 0x7f8e9c15dc60 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e9be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 0x7f8e9c15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e93e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48564/0 (socket says 172.21.15.18:48564) 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8e93e00640 1 -- 172.21.15.18:0/697603364 learned_addr learned my addr 172.21.15.18:0/697603364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.452+0000 7f8ea0e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 -- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 msgr2=0x7f8e9c15b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c15b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 -- 172.21.15.18:0/697603364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 msgr2=0x7f8e9c0cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 -- 172.21.15.18:0/697603364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c0c9d70 con 0x7f8e9c06bf30 2024-04-25T10:04:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e93e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e9be00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 0x7f8e9c15cc40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ab000 tx=0x7f8e8c01ace0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0bd5f0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0bd7d0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0bdbc0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c15d180 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0c94d0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0745d0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e8c0a9070 con 0x7f8e9c06bf30 2024-04-25T10:04:46.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.456+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8e8c11fdb0 con 0x7f8e9c06bf30 2024-04-25T10:04:46.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.460+0000 7f8e93e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.460+0000 7f8e93e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 0x7f8e78069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cb950 tx=0x7f8e84007f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.464+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e8c0c3060 con 0x7f8e9c06bf30 2024-04-25T10:04:46.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.624+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e9c0b7590 con 0x7f8e9c06bf30 2024-04-25T10:04:46.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.624+0000 7f8e98c00640 1 -- 172.21.15.18:0/697603364 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e8c016150 con 0x7f8e9c06bf30 2024-04-25T10:04:46.636 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:46.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 msgr2=0x7f8e78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 0x7f8e78069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0cb950 tx=0x7f8e84007f20 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 msgr2=0x7f8e9c15cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 0x7f8e9c15cc40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ab000 tx=0x7f8e8c01ace0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 shutdown_connections 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8e9c15dc60 0x7f8e9c15b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8e9c09a170 0x7f8e9c0cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 --2- 172.21.15.18:0/697603364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e9c06bf30 0x7f8e9c15cc40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 >> 172.21.15.18:0/697603364 conn(0x7f8e9c0b3200 msgr2=0x7f8e9c06c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 shutdown_connections 2024-04-25T10:04:46.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.628+0000 7f8ea2e00640 1 -- 172.21.15.18:0/697603364 wait complete. 2024-04-25T10:04:46.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.788+0000 7f6a5c800640 1 Processor -- start 2024-04-25T10:04:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 -- start start 2024-04-25T10:04:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a54144120 0x7f6a5415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 0x7f6a5415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a540b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5415e490 con 0x7f6a54144120 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a5415bc40 con 0x7f6a540ccbf0 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5415b3a0 con 0x7f6a5415ee60 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a54144120 0x7f6a5415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6a54144120 0x7f6a5415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48578/0 (socket says 172.21.15.18:48578) 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 -- 172.21.15.18:0/3351333343 learned_addr learned my addr 172.21.15.18:0/3351333343 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59400640 1 --2- 172.21.15.18:0/3351333343 >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 0x7f6a5415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5a800640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a540b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 -- 172.21.15.18:0/3351333343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 msgr2=0x7f6a540b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a540b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 -- 172.21.15.18:0/3351333343 >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 msgr2=0x7f6a5415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 --2- 172.21.15.18:0/3351333343 >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 0x7f6a5415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59e00640 1 -- 172.21.15.18:0/3351333343 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a5415b680 con 0x7f6a54144120 2024-04-25T10:04:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a59400640 1 --2- 172.21.15.18:0/3351333343 >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 0x7f6a5415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.792+0000 7f6a5a800640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a540b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a59e00640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5415acd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a5406b870 tx=0x7f6a4801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad17ffaf50dd34f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a58a00640 1 -- 172.21.15.18:0/3351333343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480b2070 con 0x7f6a54144120 2024-04-25T10:04:46.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a58a00640 1 -- 172.21.15.18:0/3351333343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480a9070 con 0x7f6a54144120 2024-04-25T10:04:46.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a58a00640 1 -- 172.21.15.18:0/3351333343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480ad880 con 0x7f6a54144120 2024-04-25T10:04:46.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- 172.21.15.18:0/3351333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 msgr2=0x7f6a5415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5415acd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a5406b870 tx=0x7f6a4801c490 comp rx=0 tx=0).stop 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- 172.21.15.18:0/3351333343 shutdown_connections 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a540b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 --2- 172.21.15.18:0/3351333343 >> v2:172.21.15.167:3300/0 conn(0x7f6a540ccbf0 0x7f6a5415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 --2- 172.21.15.18:0/3351333343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5415acd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- 172.21.15.18:0/3351333343 >> 172.21.15.18:0/3351333343 conn(0x7f6a54067080 msgr2=0x7f6a5406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- 172.21.15.18:0/3351333343 shutdown_connections 2024-04-25T10:04:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- 172.21.15.18:0/3351333343 wait complete. 2024-04-25T10:04:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 Processor -- start 2024-04-25T10:04:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.796+0000 7f6a5c800640 1 -- start start 2024-04-25T10:04:46.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a540ccbf0 0x7f6a54160010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a5415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a54071640 con 0x7f6a54144120 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540714c0 con 0x7f6a540ccbf0 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540717c0 con 0x7f6a5415ee60 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48590/0 (socket says 172.21.15.18:48590) 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 -- 172.21.15.18:0/2293574997 learned_addr learned my addr 172.21.15.18:0/2293574997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59e00640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a540ccbf0 0x7f6a54160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5a800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a5415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 -- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 msgr2=0x7f6a5415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a5415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 -- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a540ccbf0 msgr2=0x7f6a54160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a540ccbf0 0x7f6a54160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 -- 172.21.15.18:0/2293574997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a54163670 con 0x7f6a54144120 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5a800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a5415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a59400640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c7c0 tx=0x7f6a4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44015070 con 0x7f6a54144120 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44007a30 con 0x7f6a54144120 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44007e00 con 0x7f6a54144120 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a54163950 con 0x7f6a54144120 2024-04-25T10:04:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a54163370 con 0x7f6a54144120 2024-04-25T10:04:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.800+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540745d0 con 0x7f6a54144120 2024-04-25T10:04:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.804+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a44018070 con 0x7f6a54144120 2024-04-25T10:04:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.804+0000 7f6a4e000640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 0x7f6a38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.804+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6a44085320 con 0x7f6a54144120 2024-04-25T10:04:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.804+0000 7f6a59e00640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 0x7f6a38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.804+0000 7f6a59e00640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 0x7f6a38069420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a480af000 tx=0x7f6a480a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:46.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.808+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a44055840 con 0x7f6a54144120 2024-04-25T10:04:46.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.968+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a540b2150 con 0x7f6a54144120 2024-04-25T10:04:46.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.968+0000 7f6a4e000640 1 -- 172.21.15.18:0/2293574997 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a440598e0 con 0x7f6a54144120 2024-04-25T10:04:46.980 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 msgr2=0x7f6a38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 0x7f6a38069420 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a480af000 tx=0x7f6a480a7000 comp rx=0 tx=0).stop 2024-04-25T10:04:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 msgr2=0x7f6a5413fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6a4400c7c0 tx=0x7f6a4400cc80 comp rx=0 tx=0).stop 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 shutdown_connections 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a38066f60 0x7f6a38069420 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a5415ee60 0x7f6a5415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a54144120 0x7f6a5413fc00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 --2- 172.21.15.18:0/2293574997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a540ccbf0 0x7f6a54160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 >> 172.21.15.18:0/2293574997 conn(0x7f6a54067080 msgr2=0x7f6a540b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 shutdown_connections 2024-04-25T10:04:46.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:46.972+0000 7f6a5c800640 1 -- 172.21.15.18:0/2293574997 wait complete. 2024-04-25T10:04:47.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 Processor -- start 2024-04-25T10:04:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 -- start start 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 0x7f1ddc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ddc15e040 con 0x7f1ddc06bf30 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ddc0cff80 con 0x7f1ddc09a170 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de3800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0d0260 con 0x7f1ddc15dc60 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48600/0 (socket says 172.21.15.18:48600) 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 -- 172.21.15.18:0/995374140 learned_addr learned my addr 172.21.15.18:0/995374140 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de0e00640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 0x7f1ddc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 -- 172.21.15.18:0/995374140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 msgr2=0x7f1ddc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 0x7f1ddc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 -- 172.21.15.18:0/995374140 >> v1:172.21.15.167:6789/0 conn(0x7f1ddc06bf30 legacy=0x7f1ddc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de1800640 1 -- 172.21.15.18:0/995374140 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc0d0540 con 0x7f1ddc09a170 2024-04-25T10:04:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.136+0000 7f1de0e00640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 0x7f1ddc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de1800640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009e50 tx=0x7f1dd401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6007b97bb65fe5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1ddb400640 1 -- 172.21.15.18:0/995374140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40a57b0 con 0x7f1ddc09a170 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1ddb400640 1 -- 172.21.15.18:0/995374140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd40a5950 con 0x7f1ddc09a170 2024-04-25T10:04:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1ddb400640 1 -- 172.21.15.18:0/995374140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd40a5d20 con 0x7f1ddc09a170 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 -- 172.21.15.18:0/995374140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 msgr2=0x7f1ddc0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4009e50 tx=0x7f1dd401c930 comp rx=0 tx=0).stop 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 -- 172.21.15.18:0/995374140 shutdown_connections 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0cf8a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 --2- 172.21.15.18:0/995374140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc15dc60 0x7f1ddc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 -- 172.21.15.18:0/995374140 >> 172.21.15.18:0/995374140 conn(0x7f1ddc0b3200 msgr2=0x7f1ddc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 -- 172.21.15.18:0/995374140 shutdown_connections 2024-04-25T10:04:47.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.140+0000 7f1de3800640 1 -- 172.21.15.18:0/995374140 wait complete. 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 Processor -- start 2024-04-25T10:04:47.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- start start 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc06bf30 0x7f1ddc09e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ddc15dc60 0x7f1ddc0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0cc6f0 con 0x7f1ddc09a170 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0cc570 con 0x7f1ddc15dc60 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ddc0cc870 con 0x7f1ddc06bf30 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48616/0 (socket says 172.21.15.18:48616) 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 -- 172.21.15.18:0/2583961610 learned_addr learned my addr 172.21.15.18:0/2583961610 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de0e00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc06bf30 0x7f1ddc09e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de1800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ddc15dc60 0x7f1ddc0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 -- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc06bf30 msgr2=0x7f1ddc09e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc06bf30 0x7f1ddc09e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 -- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ddc15dc60 msgr2=0x7f1ddc0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ddc15dc60 0x7f1ddc0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 -- 172.21.15.18:0/2583961610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ddc09d400 con 0x7f1ddc09a170 2024-04-25T10:04:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1ddbe00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b410 tx=0x7f1dc800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8015030 con 0x7f1ddc09a170 2024-04-25T10:04:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc8004020 con 0x7f1ddc09a170 2024-04-25T10:04:47.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8004450 con 0x7f1ddc09a170 2024-04-25T10:04:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ddc09d6e0 con 0x7f1ddc09a170 2024-04-25T10:04:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.144+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ddc09dca0 con 0x7f1ddc09a170 2024-04-25T10:04:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ddc0745d0 con 0x7f1ddc09a170 2024-04-25T10:04:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1dc8018070 con 0x7f1ddc09a170 2024-04-25T10:04:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1dd8c00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 0x7f1dbc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1dc8084df0 con 0x7f1ddc09a170 2024-04-25T10:04:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1de0e00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 0x7f1dbc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.148+0000 7f1de0e00640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 0x7f1dbc069450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000ab60 tx=0x7f1dd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.152+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1dc8055420 con 0x7f1ddc09a170 2024-04-25T10:04:47.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1ddc0b7590 con 0x7f1ddc09a170 2024-04-25T10:04:47.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1dd8c00640 1 -- 172.21.15.18:0/2583961610 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1dc80594c0 con 0x7f1ddc09a170 2024-04-25T10:04:47.326 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 msgr2=0x7f1dbc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 0x7f1dbc069450 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1dd000ab60 tx=0x7f1dd0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 msgr2=0x7f1ddc0b60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800b410 tx=0x7f1dc800b8d0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 shutdown_connections 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ddc15dc60 0x7f1ddc0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc09a170 0x7f1ddc0b60c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1dbc066f90 0x7f1dbc069450 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 --2- 172.21.15.18:0/2583961610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ddc06bf30 0x7f1ddc09e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 >> 172.21.15.18:0/2583961610 conn(0x7f1ddc0b3200 msgr2=0x7f1ddc0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 shutdown_connections 2024-04-25T10:04:47.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.316+0000 7f1de3800640 1 -- 172.21.15.18:0/2583961610 wait complete. 2024-04-25T10:04:47.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 Processor -- start 2024-04-25T10:04:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 -- start start 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cf3c0 0x7ffa180cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa180cd370 0x7ffa18099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa180d02a0 con 0x7ffa1815b910 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa180cc350 con 0x7ffa180cd370 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa1d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa180cc630 con 0x7ffa180cf3c0 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa180cd370 0x7ffa18099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa180cd370 0x7ffa18099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48626/0 (socket says 172.21.15.18:48626) 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 -- 172.21.15.18:0/1722739563 learned_addr learned my addr 172.21.15.18:0/1722739563 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa0fe00640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cf3c0 0x7ffa180cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 -- 172.21.15.18:0/1722739563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cf3c0 msgr2=0x7ffa180cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cf3c0 0x7ffa180cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 -- 172.21.15.18:0/1722739563 >> v1:172.21.15.167:6789/0 conn(0x7ffa1815b910 legacy=0x7ffa180cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.480+0000 7ffa17400640 1 -- 172.21.15.18:0/1722739563 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180cc910 con 0x7ffa180cd370 2024-04-25T10:04:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa17400640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa180cd370 0x7ffa18099a60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009e50 tx=0x7ffa1001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fc61e929123a16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa16000640 1 -- 172.21.15.18:0/1722739563 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a5810 con 0x7ffa180cd370 2024-04-25T10:04:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa16000640 1 -- 172.21.15.18:0/1722739563 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100a59b0 con 0x7ffa180cd370 2024-04-25T10:04:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa16000640 1 -- 172.21.15.18:0/1722739563 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100a5d80 con 0x7ffa180cd370 2024-04-25T10:04:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 -- 172.21.15.18:0/1722739563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa180cd370 msgr2=0x7ffa18099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa180cd370 0x7ffa18099a60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009e50 tx=0x7ffa1001ca30 comp rx=0 tx=0).stop 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 -- 172.21.15.18:0/1722739563 shutdown_connections 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa180cd370 0x7ffa18099a60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 --2- 172.21.15.18:0/1722739563 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cf3c0 0x7ffa180cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 -- 172.21.15.18:0/1722739563 >> 172.21.15.18:0/1722739563 conn(0x7ffa180b3200 msgr2=0x7ffa180b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 -- 172.21.15.18:0/1722739563 shutdown_connections 2024-04-25T10:04:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.484+0000 7ffa1d600640 1 -- 172.21.15.18:0/1722739563 wait complete. 2024-04-25T10:04:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 Processor -- start 2024-04-25T10:04:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- start start 2024-04-25T10:04:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cd370 0x7ffa181fa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 0x7ffa180cae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18168d30 con 0x7ffa1815b910 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18168bb0 con 0x7ffa180cf3c0 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18168eb0 con 0x7ffa180cd370 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48630/0 (socket says 172.21.15.18:48630) 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa16a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cd370 0x7ffa181fa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 -- 172.21.15.18:0/5782158 learned_addr learned my addr 172.21.15.18:0/5782158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa0fe00640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 0x7ffa180cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 -- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cd370 msgr2=0x7ffa181fa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cd370 0x7ffa181fa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 -- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 msgr2=0x7ffa180cae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 0x7ffa180cae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 -- 172.21.15.18:0/5782158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa180c9890 con 0x7ffa1815b910 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa0fe00640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 0x7ffa180cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa17400640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa100af040 tx=0x7ffa100197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100b8670 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa100be070 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa100b8a70 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa180ca040 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa180ca600 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.488+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa180745d0 con 0x7ffa1815b910 2024-04-25T10:04:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.492+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa100b8c10 con 0x7ffa1815b910 2024-04-25T10:04:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.492+0000 7ffa0ea00640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 0x7ff9f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.492+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ffa101206e0 con 0x7ffa1815b910 2024-04-25T10:04:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.492+0000 7ffa16a00640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 0x7ff9f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.492+0000 7ffa16a00640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 0x7ff9f4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001770 tx=0x7ffa08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:47.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.496+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa10016620 con 0x7ffa1815b910 2024-04-25T10:04:47.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.672+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa180c4ff0 con 0x7ffa1815b910 2024-04-25T10:04:47.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.672+0000 7ffa0ea00640 1 -- 172.21.15.18:0/5782158 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa100f1370 con 0x7ffa1815b910 2024-04-25T10:04:47.683 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 msgr2=0x7ff9f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 0x7ff9f4069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa08001770 tx=0x7ffa08009040 comp rx=0 tx=0).stop 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 msgr2=0x7ffa1806cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa100af040 tx=0x7ffa100197d0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 shutdown_connections 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1815b910 0x7ffa1806cd10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa180cf3c0 0x7ffa180cae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9f4066f60 0x7ff9f4069420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 --2- 172.21.15.18:0/5782158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa180cd370 0x7ffa181fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 >> 172.21.15.18:0/5782158 conn(0x7ffa180b3200 msgr2=0x7ffa1809a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 shutdown_connections 2024-04-25T10:04:47.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:47.676+0000 7ffa1d600640 1 -- 172.21.15.18:0/5782158 wait complete. 2024-04-25T10:04:47.704 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:04:47.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:47.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T10:04:47.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:04:47.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:47.737 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:04:47.795 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:47.795 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:47.804 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:47.804 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:47.857 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:47.857 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:47.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 Processor -- start 2024-04-25T10:04:48.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 -- start start 2024-04-25T10:04:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd28145270 0x7fcd2815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcd280cd4d0 0x7fcd280cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd280cc4e0 con 0x7fcd280b1750 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd28145650 con 0x7fcd28145270 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2f400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd280ce040 con 0x7fcd280cd4d0 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2ca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd28145270 0x7fcd2815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcd280b1750 0x7fcd280b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60896/0 (socket says 172.21.15.18:60896) 2024-04-25T10:04:48.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2d400640 1 -- 172.21.15.18:0/2921085256 learned_addr learned my addr 172.21.15.18:0/2921085256 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd27e00640 1 --2- 172.21.15.18:0/2921085256 >> v2:172.21.15.167:3300/0 conn(0x7fcd280cd4d0 0x7fcd280cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2ca00640 1 -- 172.21.15.18:0/2921085256 >> v2:172.21.15.167:3300/0 conn(0x7fcd280cd4d0 msgr2=0x7fcd280cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2921085256 >> v2:172.21.15.167:3300/0 conn(0x7fcd280cd4d0 0x7fcd280cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2ca00640 1 -- 172.21.15.18:0/2921085256 >> v1:172.21.15.18:6789/0 conn(0x7fcd280b1750 legacy=0x7fcd280b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.040+0000 7fcd2ca00640 1 -- 172.21.15.18:0/2921085256 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280ce320 con 0x7fcd28145270 2024-04-25T10:04:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2921085256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28145270 0x7fcd2815fe50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b24b0 tx=0x7fcd1c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba5755b88e45b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd27400640 1 -- 172.21.15.18:0/2921085256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0b0070 con 0x7fcd28145270 2024-04-25T10:04:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd27400640 1 -- 172.21.15.18:0/2921085256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c0ab600 con 0x7fcd28145270 2024-04-25T10:04:48.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd27400640 1 -- 172.21.15.18:0/2921085256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c0ab9d0 con 0x7fcd28145270 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 -- 172.21.15.18:0/2921085256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28145270 msgr2=0x7fcd2815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2921085256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28145270 0x7fcd2815fe50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b24b0 tx=0x7fcd1c01c480 comp rx=0 tx=0).stop 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 -- 172.21.15.18:0/2921085256 shutdown_connections 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2921085256 >> v2:172.21.15.167:3300/0 conn(0x7fcd280cd4d0 0x7fcd280cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2921085256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28145270 0x7fcd2815fe50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 -- 172.21.15.18:0/2921085256 >> 172.21.15.18:0/2921085256 conn(0x7fcd28066fa0 msgr2=0x7fcd2806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 -- 172.21.15.18:0/2921085256 shutdown_connections 2024-04-25T10:04:48.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.044+0000 7fcd2f400640 1 -- 172.21.15.18:0/2921085256 wait complete. 2024-04-25T10:04:48.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 Processor -- start 2024-04-25T10:04:48.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- start start 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 0x7fcd2813aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 0x7fcd28135780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2815c710 con 0x7fcd280cd4d0 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2815c590 con 0x7fcd280b1750 2024-04-25T10:04:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2815c890 con 0x7fcd28145270 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48658/0 (socket says 172.21.15.18:48658) 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 -- 172.21.15.18:0/2347265222 learned_addr learned my addr 172.21.15.18:0/2347265222 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2d400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 0x7fcd28135780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 -- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 msgr2=0x7fcd28135780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 0x7fcd2813aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 0x7fcd28135780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 -- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 msgr2=0x7fcd2813aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 0x7fcd2813aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 -- 172.21.15.18:0/2347265222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28143320 con 0x7fcd280cd4d0 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 0x7fcd2813aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2d400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 0x7fcd28135780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd27e00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400d800 tx=0x7fcd1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400b6c0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd14019070 con 0x7fcd280cd4d0 2024-04-25T10:04:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1400ba60 con 0x7fcd280cd4d0 2024-04-25T10:04:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd28143600 con 0x7fcd280cd4d0 2024-04-25T10:04:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.048+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd28143bc0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd280745d0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd1400bc00 con 0x7fcd280cd4d0 2024-04-25T10:04:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd24c00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fcd140858d0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.052+0000 7fcd2ca00640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 0x7fcd08069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0ad000 tx=0x7fcd1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.056+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd140564d0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.220+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd2806b8e0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.220+0000 7fcd24c00640 1 -- 172.21.15.18:0/2347265222 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7fcd14055dd0 con 0x7fcd280cd4d0 2024-04-25T10:04:48.232 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:48.232 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 msgr2=0x7fcd08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 0x7fcd08069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0ad000 tx=0x7fcd1c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 msgr2=0x7fcd28135240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400d800 tx=0x7fcd1400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 shutdown_connections 2024-04-25T10:04:48.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd08066f60 0x7fcd08069420 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28145270 0x7fcd28135780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280cd4d0 0x7fcd28135240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 --2- 172.21.15.18:0/2347265222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd280b1750 0x7fcd2813aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 >> 172.21.15.18:0/2347265222 conn(0x7fcd28066fa0 msgr2=0x7fcd28144530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 shutdown_connections 2024-04-25T10:04:48.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.224+0000 7fcd2f400640 1 -- 172.21.15.18:0/2347265222 wait complete. 2024-04-25T10:04:48.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:48.254 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 Processor -- start 2024-04-25T10:04:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 -- start start 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82ec06bf30 0x7f82ec0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec15e040 con 0x7f82ec15dc60 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82ec0cff80 con 0x7f82ec09a170 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f3e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82ec0d0260 con 0x7f82ec06bf30 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82ec06bf30 0x7f82ec0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f82ec15dc60 0x7f82ec099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60900/0 (socket says 172.21.15.18:60900) 2024-04-25T10:04:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1400640 1 -- 172.21.15.18:0/1045230280 learned_addr learned my addr 172.21.15.18:0/1045230280 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1e00640 1 -- 172.21.15.18:0/1045230280 >> v1:172.21.15.167:6789/0 conn(0x7f82ec09a170 legacy=0x7f82ec0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1e00640 1 -- 172.21.15.18:0/1045230280 >> v1:172.21.15.18:6789/0 conn(0x7f82ec15dc60 legacy=0x7f82ec099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82f1e00640 1 -- 172.21.15.18:0/1045230280 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec0d0540 con 0x7f82ec06bf30 2024-04-25T10:04:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.388+0000 7f82ebe00640 1 -- 172.21.15.18:0/1045230280 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783786518 0 0) 0x7f82ec15e040 con 0x7f82ec15dc60 2024-04-25T10:04:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f1e00640 1 --2- 172.21.15.18:0/1045230280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec06bf30 0x7f82ec0d1020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009d90 tx=0x7f82e401c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6532e17f4a1adbc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82ebe00640 1 -- 172.21.15.18:0/1045230280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e40b2070 con 0x7f82ec06bf30 2024-04-25T10:04:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82ebe00640 1 -- 172.21.15.18:0/1045230280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e40a58a0 con 0x7f82ec06bf30 2024-04-25T10:04:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82ebe00640 1 -- 172.21.15.18:0/1045230280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e40a5c70 con 0x7f82ec06bf30 2024-04-25T10:04:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- 172.21.15.18:0/1045230280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec06bf30 msgr2=0x7f82ec0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 --2- 172.21.15.18:0/1045230280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec06bf30 0x7f82ec0d1020 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009d90 tx=0x7f82e401c7e0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- 172.21.15.18:0/1045230280 shutdown_connections 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 --2- 172.21.15.18:0/1045230280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec06bf30 0x7f82ec0d1020 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- 172.21.15.18:0/1045230280 >> 172.21.15.18:0/1045230280 conn(0x7f82ec0b3200 msgr2=0x7f82ec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- 172.21.15.18:0/1045230280 shutdown_connections 2024-04-25T10:04:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- 172.21.15.18:0/1045230280 wait complete. 2024-04-25T10:04:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 Processor -- start 2024-04-25T10:04:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.392+0000 7f82f3e00640 1 -- start start 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82ec06bf30 0x7f82ec15e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82ec15dc60 0x7f82ec152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec06cfa0 con 0x7f82ec09a170 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec0cc880 con 0x7f82ec06bf30 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec161360 con 0x7f82ec15dc60 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48688/0 (socket says 172.21.15.18:48688) 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 -- 172.21.15.18:0/473710914 learned_addr learned my addr 172.21.15.18:0/473710914 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f1400640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82ec06bf30 0x7f82ec15e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f1e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82ec15dc60 0x7f82ec152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 -- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82ec15dc60 msgr2=0x7f82ec152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82ec15dc60 0x7f82ec152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 -- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82ec06bf30 msgr2=0x7f82ec15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82ec06bf30 0x7f82ec15e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 -- 172.21.15.18:0/473710914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec161080 con 0x7f82ec09a170 2024-04-25T10:04:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f0a00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c450 tx=0x7f82d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012830 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d8017070 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d8012c30 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec15afd0 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec154c50 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.396+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec0745d0 con 0x7f82ec09a170 2024-04-25T10:04:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.400+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f82d801c460 con 0x7f82ec09a170 2024-04-25T10:04:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.400+0000 7f82e9600640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 0x7f82cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.400+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f82d8085040 con 0x7f82ec09a170 2024-04-25T10:04:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.400+0000 7f82f1400640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 0x7f82cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.400+0000 7f82f1400640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 0x7f82cc069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82e0007fd0 tx=0x7f82e0007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.404+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82d8055690 con 0x7f82ec09a170 2024-04-25T10:04:48.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.564+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82ec0b7590 con 0x7f82ec09a170 2024-04-25T10:04:48.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.564+0000 7f82e9600640 1 -- 172.21.15.18:0/473710914 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82d8059730 con 0x7f82ec09a170 2024-04-25T10:04:48.576 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:48.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 msgr2=0x7f82cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 0x7f82cc069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82e0007fd0 tx=0x7f82e0007d60 comp rx=0 tx=0).stop 2024-04-25T10:04:48.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 msgr2=0x7f82ec151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f82d800c450 tx=0x7f82d800c910 comp rx=0 tx=0).stop 2024-04-25T10:04:48.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 shutdown_connections 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82cc066f60 0x7f82cc069420 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82ec15dc60 0x7f82ec152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82ec09a170 0x7f82ec151c30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 --2- 172.21.15.18:0/473710914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82ec06bf30 0x7f82ec15e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 >> 172.21.15.18:0/473710914 conn(0x7f82ec0b3200 msgr2=0x7f82ec1555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 shutdown_connections 2024-04-25T10:04:48.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.568+0000 7f82f3e00640 1 -- 172.21.15.18:0/473710914 wait complete. 2024-04-25T10:04:48.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:48.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 Processor -- start 2024-04-25T10:04:48.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 -- start start 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f200009a170 0x7f20000d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f200006bf30 0x7f20000cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200015e040 con 0x7f200015dc60 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000cff80 con 0x7f200009a170 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2007600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000d0260 con 0x7f200006bf30 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f200009a170 0x7f20000d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f200009a170 0x7f20000d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48694/0 (socket says 172.21.15.18:48694) 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 -- 172.21.15.18:0/465251683 learned_addr learned my addr 172.21.15.18:0/465251683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:48.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f2005600640 1 --2- 172.21.15.18:0/465251683 >> v2:172.21.15.167:3300/0 conn(0x7f200006bf30 0x7f20000cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 -- 172.21.15.18:0/465251683 >> v2:172.21.15.167:3300/0 conn(0x7f200006bf30 msgr2=0x7f20000cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/465251683 >> v2:172.21.15.167:3300/0 conn(0x7f200006bf30 0x7f20000cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 -- 172.21.15.18:0/465251683 >> v1:172.21.15.167:6789/0 conn(0x7f200015dc60 legacy=0x7f2000099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:48.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.732+0000 7f1ff7e00640 1 -- 172.21.15.18:0/465251683 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000d0540 con 0x7f200009a170 2024-04-25T10:04:48.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/465251683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200009a170 0x7f20000d1020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2000071e60 tx=0x7f1fe801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6397d8818171ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f1fffe00640 1 -- 172.21.15.18:0/465251683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80b2070 con 0x7f200009a170 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f1fffe00640 1 -- 172.21.15.18:0/465251683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80ad640 con 0x7f200009a170 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f1fffe00640 1 -- 172.21.15.18:0/465251683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80ada10 con 0x7f200009a170 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 -- 172.21.15.18:0/465251683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200009a170 msgr2=0x7f20000d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 --2- 172.21.15.18:0/465251683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200009a170 0x7f20000d1020 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2000071e60 tx=0x7f1fe801c390 comp rx=0 tx=0).stop 2024-04-25T10:04:48.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 -- 172.21.15.18:0/465251683 shutdown_connections 2024-04-25T10:04:48.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 --2- 172.21.15.18:0/465251683 >> v2:172.21.15.167:3300/0 conn(0x7f200006bf30 0x7f20000cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 --2- 172.21.15.18:0/465251683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200009a170 0x7f20000d1020 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 -- 172.21.15.18:0/465251683 >> 172.21.15.18:0/465251683 conn(0x7f20000b3200 msgr2=0x7f20000b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 -- 172.21.15.18:0/465251683 shutdown_connections 2024-04-25T10:04:48.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.736+0000 7f2007600640 1 -- 172.21.15.18:0/465251683 wait complete. 2024-04-25T10:04:48.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 Processor -- start 2024-04-25T10:04:48.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- start start 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 0x7f2000154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 0x7f20000b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cc6f0 con 0x7f200006bf30 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cc570 con 0x7f200015dc60 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000cc870 con 0x7f200009a170 2024-04-25T10:04:48.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48702/0 (socket says 172.21.15.18:48702) 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 -- 172.21.15.18:0/26043138 learned_addr learned my addr 172.21.15.18:0/26043138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 0x7f2000154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2005600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 0x7f20000b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 -- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 msgr2=0x7f2000154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 0x7f2000154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 -- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 msgr2=0x7f20000b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 0x7f20000b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 -- 172.21.15.18:0/26043138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2000159540 con 0x7f200006bf30 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2005600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 0x7f20000b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 0x7f2000154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2004c00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c480 tx=0x7f1ff000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0012830 con 0x7f200006bf30 2024-04-25T10:04:48.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff0017070 con 0x7f200006bf30 2024-04-25T10:04:48.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20000c8da0 con 0x7f200006bf30 2024-04-25T10:04:48.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0012c30 con 0x7f200006bf30 2024-04-25T10:04:48.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000c9360 con 0x7f200006bf30 2024-04-25T10:04:48.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.740+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20000745d0 con 0x7f200006bf30 2024-04-25T10:04:48.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.744+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ff001c460 con 0x7f200006bf30 2024-04-25T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.744+0000 7f1ffd600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 0x7f1fdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.744+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f1ff0085240 con 0x7f200006bf30 2024-04-25T10:04:48.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.744+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 0x7f1fdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:48.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.744+0000 7f1ff7e00640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 0x7f1fdc069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80af000 tx=0x7f1fe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:48.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.748+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ff0055e40 con 0x7f200006bf30 2024-04-25T10:04:48.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20000b7590 con 0x7f200006bf30 2024-04-25T10:04:48.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f1ffd600640 1 -- 172.21.15.18:0/26043138 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ff0055740 con 0x7f200006bf30 2024-04-25T10:04:48.925 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:48.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 msgr2=0x7f1fdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 0x7f1fdc069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1fe80af000 tx=0x7f1fe8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:48.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 msgr2=0x7f2000159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:48.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000c480 tx=0x7f1ff000c940 comp rx=0 tx=0).stop 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 shutdown_connections 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f200015dc60 0x7f20000b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1fdc066f60 0x7f1fdc069420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f200009a170 0x7f2000154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 --2- 172.21.15.18:0/26043138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f200006bf30 0x7f2000159000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 >> 172.21.15.18:0/26043138 conn(0x7f20000b3200 msgr2=0x7f20000ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 shutdown_connections 2024-04-25T10:04:48.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:48.916+0000 7f2007600640 1 -- 172.21.15.18:0/26043138 wait complete. 2024-04-25T10:04:48.947 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:49.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 Processor -- start 2024-04-25T10:04:49.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 -- start start 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbbf415c9b0 0x7fbbf406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf415fc00 con 0x7fbbf4159320 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf415fee0 con 0x7fbbf406e010 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbfb800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf406d640 con 0x7fbbf415c9b0 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbbf415c9b0 0x7fbbf406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf8e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbbf4159320 0x7fbbf415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60902/0 (socket says 172.21.15.18:60902) 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf8e00640 1 -- 172.21.15.18:0/1954661632 learned_addr learned my addr 172.21.15.18:0/1954661632 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf3e00640 1 -- 172.21.15.18:0/1954661632 >> v1:172.21.15.167:6789/0 conn(0x7fbbf406e010 legacy=0x7fbbf406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf3e00640 1 -- 172.21.15.18:0/1954661632 >> v1:172.21.15.18:6789/0 conn(0x7fbbf4159320 legacy=0x7fbbf415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf3e00640 1 -- 172.21.15.18:0/1954661632 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf41601c0 con 0x7fbbf415c9b0 2024-04-25T10:04:49.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.080+0000 7fbbf3400640 1 -- 172.21.15.18:0/1954661632 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578982752 0 0) 0x7fbbf415fc00 con 0x7fbbf4159320 2024-04-25T10:04:49.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbf3e00640 1 --2- 172.21.15.18:0/1954661632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf415c9b0 0x7fbbf406dad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae3a502233f0bfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbf3400640 1 -- 172.21.15.18:0/1954661632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b1070 con 0x7fbbf415c9b0 2024-04-25T10:04:49.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbf3400640 1 -- 172.21.15.18:0/1954661632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00ac410 con 0x7fbbf415c9b0 2024-04-25T10:04:49.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbf3400640 1 -- 172.21.15.18:0/1954661632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00ac7e0 con 0x7fbbf415c9b0 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 -- 172.21.15.18:0/1954661632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf415c9b0 msgr2=0x7fbbf406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 --2- 172.21.15.18:0/1954661632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf415c9b0 0x7fbbf406dad0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 -- 172.21.15.18:0/1954661632 shutdown_connections 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 --2- 172.21.15.18:0/1954661632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf415c9b0 0x7fbbf406dad0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 -- 172.21.15.18:0/1954661632 >> 172.21.15.18:0/1954661632 conn(0x7fbbf4067080 msgr2=0x7fbbf406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 -- 172.21.15.18:0/1954661632 shutdown_connections 2024-04-25T10:04:49.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.084+0000 7fbbfb800640 1 -- 172.21.15.18:0/1954661632 wait complete. 2024-04-25T10:04:49.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 Processor -- start 2024-04-25T10:04:49.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- start start 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 0x7fbbf413ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 0x7fbbf4143340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf406ed30 con 0x7fbbf4159320 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf406ebb0 con 0x7fbbf406e010 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf41695a0 con 0x7fbbf415c9b0 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48726/0 (socket says 172.21.15.18:48726) 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 -- 172.21.15.18:0/456408744 learned_addr learned my addr 172.21.15.18:0/456408744 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf8e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 0x7fbbf413ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf9800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 0x7fbbf4143340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 -- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 msgr2=0x7fbbf4143340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 0x7fbbf4143340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 -- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 msgr2=0x7fbbf413ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 0x7fbbf413ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 -- 172.21.15.18:0/456408744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf413b390 con 0x7fbbf4159320 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf8e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 0x7fbbf413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf9800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 0x7fbbf4143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf3e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe0019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00bc070 con 0x7fbbf4159320 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe00acda0 con 0x7fbbf4159320 2024-04-25T10:04:49.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00b1040 con 0x7fbbf4159320 2024-04-25T10:04:49.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf4156a90 con 0x7fbbf4159320 2024-04-25T10:04:49.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.088+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf4157050 con 0x7fbbf4159320 2024-04-25T10:04:49.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.092+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40745d0 con 0x7fbbf4159320 2024-04-25T10:04:49.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.092+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbe00bf070 con 0x7fbbf4159320 2024-04-25T10:04:49.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.092+0000 7fbbf0c00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 0x7fbbd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.092+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbbe011e3e0 con 0x7fbbf4159320 2024-04-25T10:04:49.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.092+0000 7fbbf8e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 0x7fbbd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.096+0000 7fbbf8e00640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 0x7fbbd4069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f70 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.096+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbe0016090 con 0x7fbbf4159320 2024-04-25T10:04:49.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.260+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbf415ef60 con 0x7fbbf4159320 2024-04-25T10:04:49.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.260+0000 7fbbf0c00640 1 -- 172.21.15.18:0/456408744 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbe00eef50 con 0x7fbbf4159320 2024-04-25T10:04:49.275 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 msgr2=0x7fbbd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 0x7fbbd4069420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f70 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 msgr2=0x7fbbf40b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00097c0 tx=0x7fbbe0019240 comp rx=0 tx=0).stop 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 shutdown_connections 2024-04-25T10:04:49.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbd4066f60 0x7fbbd4069420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbbf415c9b0 0x7fbbf4143340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbf4159320 0x7fbbf40b1d60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 --2- 172.21.15.18:0/456408744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbbf406e010 0x7fbbf413ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 >> 172.21.15.18:0/456408744 conn(0x7fbbf4067080 msgr2=0x7fbbf406e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 shutdown_connections 2024-04-25T10:04:49.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.264+0000 7fbbfb800640 1 -- 172.21.15.18:0/456408744 wait complete. 2024-04-25T10:04:49.293 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 Processor -- start 2024-04-25T10:04:49.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 -- start start 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8b80d0150 0x7fc8b80af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80b30d0 con 0x7fc8b815dc00 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b80ccf30 con 0x7fc8b80c72a0 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8bd000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b80cd860 con 0x7fc8b80d0150 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc8b815dc00 0x7fc8b80c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60906/0 (socket says 172.21.15.18:60906) 2024-04-25T10:04:49.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5e00640 1 -- 172.21.15.18:0/3543844050 learned_addr learned my addr 172.21.15.18:0/3543844050 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:49.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8afe00640 1 --2- 172.21.15.18:0/3543844050 >> v2:172.21.15.167:3300/0 conn(0x7fc8b80d0150 0x7fc8b80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257357442 0 0) 0x7fc8b80b30d0 con 0x7fc8b815dc00 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc89c003530 con 0x7fc8b815dc00 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663222245 0 0) 0x7fc89c003530 con 0x7fc8b815dc00 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 >> v2:172.21.15.167:3300/0 conn(0x7fc8b80d0150 msgr2=0x7fc8b80af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 --2- 172.21.15.18:0/3543844050 >> v2:172.21.15.167:3300/0 conn(0x7fc8b80d0150 0x7fc8b80af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 >> v1:172.21.15.167:6789/0 conn(0x7fc8b80c72a0 legacy=0x7fc8b80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80cd210 con 0x7fc8b815dc00 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fc8a8001680 con 0x7fc8b815dc00 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.428+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 >> v1:172.21.15.18:6789/0 conn(0x7fc8b815dc00 legacy=0x7fc8b80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc89c0039c0 0x7fc89c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c004810 0x7fc89c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 0x7fc89c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cd860 con 0x7fc89c0051d0 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c00c070 con 0x7fc89c0039c0 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c00c270 con 0x7fc89c004810 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 0x7fc89c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8afe00640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c004810 0x7fc89c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5e00640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc89c0039c0 0x7fc89c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 -- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c004810 msgr2=0x7fc89c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c004810 0x7fc89c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 -- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc89c0039c0 msgr2=0x7fc89c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc89c0039c0 0x7fc89c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 -- 172.21.15.18:0/3543844050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c003530 con 0x7fc89c0051d0 2024-04-25T10:04:49.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 -- 172.21.15.18:0/3543844050 reap_dead start 2024-04-25T10:04:49.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b6800640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 0x7fc89c00b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001e40 tx=0x7fc8b001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4e7cd3029163e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0001a90 con 0x7fc89c0051d0 2024-04-25T10:04:49.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b0003b80 con 0x7fc89c0051d0 2024-04-25T10:04:49.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.432+0000 7fc8b5400640 1 -- 172.21.15.18:0/3543844050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b0005020 con 0x7fc89c0051d0 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 msgr2=0x7fc89c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 0x7fc89c00b9d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0001e40 tx=0x7fc8b001c760 comp rx=0 tx=0).stop 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- 172.21.15.18:0/3543844050 shutdown_connections 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3543844050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc89c0051d0 0x7fc89c00b9d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- 172.21.15.18:0/3543844050 >> 172.21.15.18:0/3543844050 conn(0x7fc8b80b2240 msgr2=0x7fc8b80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- 172.21.15.18:0/3543844050 shutdown_connections 2024-04-25T10:04:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- 172.21.15.18:0/3543844050 wait complete. 2024-04-25T10:04:49.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 Processor -- start 2024-04-25T10:04:49.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- start start 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c0051d0 0x7fc8b814abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b80b5990 0x7fc8b80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b2ee0 con 0x7fc8b8157570 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80b2d60 con 0x7fc8b80b5990 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8bd000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b80cdcf0 con 0x7fc89c0051d0 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48754/0 (socket says 172.21.15.18:48754) 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 -- 172.21.15.18:0/3173151213 learned_addr learned my addr 172.21.15.18:0/3173151213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8b5e00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c0051d0 0x7fc8b814abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8b6800640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b80b5990 0x7fc8b80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 -- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c0051d0 msgr2=0x7fc8b814abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c0051d0 0x7fc8b814abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 -- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b80b5990 msgr2=0x7fc8b80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b80b5990 0x7fc8b80b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.436+0000 7fc8afe00640 1 -- 172.21.15.18:0/3173151213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b814e3f0 con 0x7fc8b8157570 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8afe00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0011990 tx=0x7fc8a0011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000f9d0 con 0x7fc8b8157570 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000fb70 con 0x7fc8b8157570 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0014440 con 0x7fc8b8157570 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b814de30 con 0x7fc8b8157570 2024-04-25T10:04:49.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b814b4f0 con 0x7fc8b8157570 2024-04-25T10:04:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b806ccb0 con 0x7fc8b8157570 2024-04-25T10:04:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8a0012040 con 0x7fc8b8157570 2024-04-25T10:04:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 0x7fc894069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc8a0085a40 con 0x7fc8b8157570 2024-04-25T10:04:49.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.440+0000 7fc8b5e00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 0x7fc894069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.444+0000 7fc8b5e00640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 0x7fc894069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c10 tx=0x7fc8a8000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.444+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8a0019030 con 0x7fc8b8157570 2024-04-25T10:04:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc8b80b29a0 con 0x7fc8b8157570 2024-04-25T10:04:49.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8ae000640 1 -- 172.21.15.18:0/3173151213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc8a0056520 con 0x7fc8b8157570 2024-04-25T10:04:49.617 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 msgr2=0x7fc894069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 0x7fc894069420 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8000c10 tx=0x7fc8a8000ee0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 msgr2=0x7fc8b814d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0011990 tx=0x7fc8a0011d90 comp rx=0 tx=0).stop 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 shutdown_connections 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b80b5990 0x7fc8b80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8157570 0x7fc8b814d4e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc894066f60 0x7fc894069420 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 --2- 172.21.15.18:0/3173151213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc89c0051d0 0x7fc8b814abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 >> 172.21.15.18:0/3173151213 conn(0x7fc8b80b2240 msgr2=0x7fc8b80ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 shutdown_connections 2024-04-25T10:04:49.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.608+0000 7fc8bd000640 1 -- 172.21.15.18:0/3173151213 wait complete. 2024-04-25T10:04:49.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:49.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.768+0000 7f82a3200640 1 Processor -- start 2024-04-25T10:04:49.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.768+0000 7f82a3200640 1 -- start start 2024-04-25T10:04:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a3200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82a40b22b0 0x7f82a4161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a3200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a40b2760 con 0x7f82a4161570 2024-04-25T10:04:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a3200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a406c860 con 0x7f82a4161e90 2024-04-25T10:04:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a3200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a406d100 con 0x7f82a40b22b0 2024-04-25T10:04:49.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f829be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f82a40b22b0 0x7f82a4161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a1e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f82a4161570 0x7f82a40b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60910/0 (socket says 172.21.15.18:60910) 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a1e00640 1 -- 172.21.15.18:0/305108030 learned_addr learned my addr 172.21.15.18:0/305108030 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f829be00640 1 -- 172.21.15.18:0/305108030 >> v1:172.21.15.167:6789/0 conn(0x7f82a4161e90 legacy=0x7f82a40d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f829be00640 1 -- 172.21.15.18:0/305108030 >> v1:172.21.15.18:6789/0 conn(0x7f82a4161570 legacy=0x7f82a40b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f82a1400640 1 -- 172.21.15.18:0/305108030 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2601090569 0 0) 0x7f82a40b2760 con 0x7f82a4161570 2024-04-25T10:04:49.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.772+0000 7f829be00640 1 -- 172.21.15.18:0/305108030 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a406cb40 con 0x7f82a40b22b0 2024-04-25T10:04:49.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f829be00640 1 --2- 172.21.15.18:0/305108030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a40b22b0 0x7f82a4161950 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097c0 tx=0x7f828c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ef27eb9a90cab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a1400640 1 -- 172.21.15.18:0/305108030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a7070 con 0x7f82a40b22b0 2024-04-25T10:04:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a1400640 1 -- 172.21.15.18:0/305108030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0b0070 con 0x7f82a40b22b0 2024-04-25T10:04:49.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a1400640 1 -- 172.21.15.18:0/305108030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0ab890 con 0x7f82a40b22b0 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- 172.21.15.18:0/305108030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a40b22b0 msgr2=0x7f82a4161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 --2- 172.21.15.18:0/305108030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a40b22b0 0x7f82a4161950 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097c0 tx=0x7f828c01c470 comp rx=0 tx=0).stop 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- 172.21.15.18:0/305108030 shutdown_connections 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 --2- 172.21.15.18:0/305108030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a40b22b0 0x7f82a4161950 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- 172.21.15.18:0/305108030 >> 172.21.15.18:0/305108030 conn(0x7f82a40d1640 msgr2=0x7f82a40d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- 172.21.15.18:0/305108030 shutdown_connections 2024-04-25T10:04:49.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- 172.21.15.18:0/305108030 wait complete. 2024-04-25T10:04:49.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 Processor -- start 2024-04-25T10:04:49.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- start start 2024-04-25T10:04:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82a40b22b0 0x7f82a415a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 0x7f82a4144be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b2b70 con 0x7f82a4161570 2024-04-25T10:04:49.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40cf7b0 con 0x7f82a4161e90 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.776+0000 7f82a3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41622a0 con 0x7f82a40b22b0 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48770/0 (socket says 172.21.15.18:48770) 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 -- 172.21.15.18:0/1576182891 learned_addr learned my addr 172.21.15.18:0/1576182891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a1e00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82a40b22b0 0x7f82a415a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a2800640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 0x7f82a4144be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 -- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82a40b22b0 msgr2=0x7f82a415a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82a40b22b0 0x7f82a415a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 -- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 msgr2=0x7f82a4144be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 0x7f82a4144be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 -- 172.21.15.18:0/1576182891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40cd920 con 0x7f82a4161570 2024-04-25T10:04:49.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a2800640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 0x7f82a4144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:49.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829be00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f828c019080 tx=0x7f828c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0bf610 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0bf7d0 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0bfbc0 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40cdc00 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40ce1c0 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a40745d0 con 0x7f82a4161570 2024-04-25T10:04:49.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.780+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f828c0bd020 con 0x7f82a4161570 2024-04-25T10:04:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.784+0000 7f829a000640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.784+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f828c11fa90 con 0x7f82a4161570 2024-04-25T10:04:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.784+0000 7f82a1e00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:49.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.784+0000 7f82a1e00640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 0x7f8280069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8294007fd0 tx=0x7f8294007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.788+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f828c0c6030 con 0x7f82a4161570 2024-04-25T10:04:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82a40d0e80 con 0x7f82a4161570 2024-04-25T10:04:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f829a000640 1 -- 172.21.15.18:0/1576182891 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f828c016090 con 0x7f82a4161570 2024-04-25T10:04:49.973 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:49.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 msgr2=0x7f8280069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 0x7f8280069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8294007fd0 tx=0x7f8294007ba0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 msgr2=0x7f82a41446a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:49.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f828c019080 tx=0x7f828c01acb0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 shutdown_connections 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f82a4161e90 0x7f82a4144be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f82a4161570 0x7f82a41446a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8280066f60 0x7f8280069420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 --2- 172.21.15.18:0/1576182891 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f82a40b22b0 0x7f82a415a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 >> 172.21.15.18:0/1576182891 conn(0x7f82a40d1640 msgr2=0x7f82a406bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 shutdown_connections 2024-04-25T10:04:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:49.964+0000 7f82a3200640 1 -- 172.21.15.18:0/1576182891 wait complete. 2024-04-25T10:04:49.994 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T10:04:49.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:49.995 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T10:04:50.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:04:50.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:50.036 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T10:04:50.092 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:50.093 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:50.102 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:50.102 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:50.152 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:04:50.152 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:50.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:50.301 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:50.305 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:04:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 Processor -- start 2024-04-25T10:04:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 -- start start 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 0x7f67380b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67380cdb70 0x7f67380b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67380cd6c0 con 0x7f673815efa0 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380b3fe0 con 0x7f67380cdb70 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6737200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67380cce20 con 0x7f673809a170 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67380cdb70 0x7f67380b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67380cdb70 0x7f67380b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48784/0 (socket says 172.21.15.18:48784) 2024-04-25T10:04:50.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 -- 172.21.15.18:0/220237802 learned_addr learned my addr 172.21.15.18:0/220237802 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:50.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6735400640 1 --2- 172.21.15.18:0/220237802 >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 0x7f67380b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 -- 172.21.15.18:0/220237802 >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 msgr2=0x7f67380b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:50.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 --2- 172.21.15.18:0/220237802 >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 0x7f67380b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 -- 172.21.15.18:0/220237802 >> v1:172.21.15.167:6789/0 conn(0x7f673815efa0 legacy=0x7f6738099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:50.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6736800640 1 -- 172.21.15.18:0/220237802 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380cd100 con 0x7f67380cdb70 2024-04-25T10:04:50.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.388+0000 7f6735400640 1 --2- 172.21.15.18:0/220237802 >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 0x7f67380b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:50.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6736800640 1 --2- 172.21.15.18:0/220237802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f67380b16e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67380728d0 tx=0x7f673001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837499192a0e5e9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6734a00640 1 -- 172.21.15.18:0/220237802 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300a5670 con 0x7f67380cdb70 2024-04-25T10:04:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6734a00640 1 -- 172.21.15.18:0/220237802 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67300a5810 con 0x7f67380cdb70 2024-04-25T10:04:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6734a00640 1 -- 172.21.15.18:0/220237802 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67300a5be0 con 0x7f67380cdb70 2024-04-25T10:04:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- 172.21.15.18:0/220237802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 msgr2=0x7f67380b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 --2- 172.21.15.18:0/220237802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f67380b16e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f67380728d0 tx=0x7f673001c9b0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- 172.21.15.18:0/220237802 shutdown_connections 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 --2- 172.21.15.18:0/220237802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f67380b16e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 --2- 172.21.15.18:0/220237802 >> v2:172.21.15.167:3300/0 conn(0x7f673809a170 0x7f67380b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- 172.21.15.18:0/220237802 >> 172.21.15.18:0/220237802 conn(0x7f67380b3050 msgr2=0x7f67380b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- 172.21.15.18:0/220237802 shutdown_connections 2024-04-25T10:04:50.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- 172.21.15.18:0/220237802 wait complete. 2024-04-25T10:04:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 Processor -- start 2024-04-25T10:04:50.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.392+0000 7f6737200640 1 -- start start 2024-04-25T10:04:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f673809a170 0x7f673806cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673815efa0 0x7f67381657b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67381686a0 con 0x7f67380cdb70 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67380b3dc0 con 0x7f673815efa0 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6738168820 con 0x7f673809a170 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48792/0 (socket says 172.21.15.18:48792) 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 -- 172.21.15.18:0/3305595883 learned_addr learned my addr 172.21.15.18:0/3305595883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 -- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f673809a170 msgr2=0x7f673806cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f673809a170 0x7f673806cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 -- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673815efa0 msgr2=0x7f67381657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673815efa0 0x7f67381657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 -- 172.21.15.18:0/3305595883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738163b70 con 0x7f67380cdb70 2024-04-25T10:04:50.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6735400640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f672400c7f0 tx=0x7f672400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724015070 con 0x7f67380cdb70 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724007820 con 0x7f67380cdb70 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724007c10 con 0x7f67380cdb70 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6738163e50 con 0x7f67380cdb70 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6738164410 con 0x7f67380cdb70 2024-04-25T10:04:50.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673804efa0 con 0x7f67380cdb70 2024-04-25T10:04:50.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.396+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6724018070 con 0x7f67380cdb70 2024-04-25T10:04:50.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.400+0000 7f672e000640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 0x7f6718069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.400+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6724085640 con 0x7f67380cdb70 2024-04-25T10:04:50.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.400+0000 7f6735e00640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 0x7f6718069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.400+0000 7f6735e00640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 0x7f6718069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6728003cf0 tx=0x7f67280079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.404+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67240561b0 con 0x7f67380cdb70 2024-04-25T10:04:50.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f67380cc570 con 0x7f67380cdb70 2024-04-25T10:04:50.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f672e000640 1 -- 172.21.15.18:0/3305595883 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f6724055ab0 con 0x7f67380cdb70 2024-04-25T10:04:50.582 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:50.582 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:50.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 msgr2=0x7f6718069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 0x7f6718069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6728003cf0 tx=0x7f67280079c0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 msgr2=0x7f6738165270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f672400c7f0 tx=0x7f672400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 shutdown_connections 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f673815efa0 0x7f67381657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67380cdb70 0x7f6738165270 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6718066f60 0x7f6718069420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 --2- 172.21.15.18:0/3305595883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f673809a170 0x7f673806cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 >> 172.21.15.18:0/3305595883 conn(0x7f67380b3050 msgr2=0x7f67380ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 shutdown_connections 2024-04-25T10:04:50.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.572+0000 7f6737200640 1 -- 172.21.15.18:0/3305595883 wait complete. 2024-04-25T10:04:50.605 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:50.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 Processor -- start 2024-04-25T10:04:50.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 -- start start 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8fc144120 0x7fc8fc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc15bc40 con 0x7fc8fc0b3090 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8fc15b3a0 con 0x7fc8fc0ccbf0 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc903c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8fc15e490 con 0x7fc8fc144120 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8fc144120 0x7fc8fc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc8fc0b3090 0x7fc8fc06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60926/0 (socket says 172.21.15.18:60926) 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8fc144120 0x7fc8fc15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48796/0 (socket says 172.21.15.18:48796) 2024-04-25T10:04:50.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901c00640 1 -- 172.21.15.18:0/2613431041 learned_addr learned my addr 172.21.15.18:0/2613431041 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:50.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901200640 1 -- 172.21.15.18:0/2613431041 >> v1:172.21.15.167:6789/0 conn(0x7fc8fc0ccbf0 legacy=0x7fc8fc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:50.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901200640 1 -- 172.21.15.18:0/2613431041 >> v1:172.21.15.18:6789/0 conn(0x7fc8fc0b3090 legacy=0x7fc8fc06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.740+0000 7fc901200640 1 -- 172.21.15.18:0/2613431041 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc15b680 con 0x7fc8fc144120 2024-04-25T10:04:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc901200640 1 --2- 172.21.15.18:0/2613431041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc144120 0x7fc8fc15acd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0097c0 tx=0x7fc8ec01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20746f4076968d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc8fbe00640 1 -- 172.21.15.18:0/2613431041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0b0070 con 0x7fc8fc144120 2024-04-25T10:04:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc8fbe00640 1 -- 172.21.15.18:0/2613431041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0ab600 con 0x7fc8fc144120 2024-04-25T10:04:50.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc8fbe00640 1 -- 172.21.15.18:0/2613431041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0ab9d0 con 0x7fc8fc144120 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 -- 172.21.15.18:0/2613431041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc144120 msgr2=0x7fc8fc15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 --2- 172.21.15.18:0/2613431041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc144120 0x7fc8fc15acd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0097c0 tx=0x7fc8ec01c3d0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 -- 172.21.15.18:0/2613431041 shutdown_connections 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 --2- 172.21.15.18:0/2613431041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc144120 0x7fc8fc15acd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 -- 172.21.15.18:0/2613431041 >> 172.21.15.18:0/2613431041 conn(0x7fc8fc067080 msgr2=0x7fc8fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 -- 172.21.15.18:0/2613431041 shutdown_connections 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.744+0000 7fc903c00640 1 -- 172.21.15.18:0/2613431041 wait complete. 2024-04-25T10:04:50.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 Processor -- start 2024-04-25T10:04:50.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- start start 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc0ccbf0 0x7fc8fc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 0x7fc8fc13ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06ec70 con 0x7fc8fc0b3090 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc06eaf0 con 0x7fc8fc144120 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8fc0b34a0 con 0x7fc8fc0ccbf0 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48812/0 (socket says 172.21.15.18:48812) 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 -- 172.21.15.18:0/325148125 learned_addr learned my addr 172.21.15.18:0/325148125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 0x7fc8fc13ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc8f3e00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc0ccbf0 0x7fc8fc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 -- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc0ccbf0 msgr2=0x7fc8fc141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc0ccbf0 0x7fc8fc141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 -- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 msgr2=0x7fc8fc13ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 0x7fc8fc13ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 -- 172.21.15.18:0/325148125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8fc141f90 con 0x7fc8fc0b3090 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 0x7fc8fc13ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:50.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc901200640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0ae040 tx=0x7fc8ec01ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0b0050 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ec0bc070 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec0b5a70 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8fc0a9d30 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8fc13c700 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.748+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8fc0745d0 con 0x7fc8fc0b3090 2024-04-25T10:04:50.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.752+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8ec0ab4c0 con 0x7fc8fc0b3090 2024-04-25T10:04:50.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.752+0000 7fc8f9600640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 0x7fc8d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:50.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.752+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc8ec11fd30 con 0x7fc8fc0b3090 2024-04-25T10:04:50.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.752+0000 7fc8f3e00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 0x7fc8d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:50.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.752+0000 7fc8f3e00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 0x7fc8d8069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0cbb40 tx=0x7fc8e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:50.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.756+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8ec016050 con 0x7fc8fc0b3090 2024-04-25T10:04:50.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc8fc13f320 con 0x7fc8fc0b3090 2024-04-25T10:04:50.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc8f9600640 1 -- 172.21.15.18:0/325148125 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8ec0f0a50 con 0x7fc8fc0b3090 2024-04-25T10:04:50.930 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 msgr2=0x7fc8d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 0x7fc8d8069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc0cbb40 tx=0x7fc8e4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 msgr2=0x7fc8fc1f61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec0ae040 tx=0x7fc8ec01ac10 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 shutdown_connections 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8fc144120 0x7fc8fc13ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc8d8066f60 0x7fc8d8069420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8fc0ccbf0 0x7fc8fc141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 --2- 172.21.15.18:0/325148125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8fc0b3090 0x7fc8fc1f61b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 >> 172.21.15.18:0/325148125 conn(0x7fc8fc067080 msgr2=0x7fc8fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 shutdown_connections 2024-04-25T10:04:50.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:50.920+0000 7fc903c00640 1 -- 172.21.15.18:0/325148125 wait complete. 2024-04-25T10:04:50.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:51.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.084+0000 7f3807600640 1 Processor -- start 2024-04-25T10:04:51.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.084+0000 7f3807600640 1 -- start start 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3807600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f380015dc00 0x7f38000af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3807600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f38000c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3807600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000b30d0 con 0x7f38000d0150 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3807600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000cd860 con 0x7f380015dc00 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3807600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000ccf30 con 0x7f38000c72a0 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37f7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f38000d0150 0x7f38000c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60940/0 (socket says 172.21.15.18:60940) 2024-04-25T10:04:51.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37f7e00640 1 -- 172.21.15.18:0/434846240 learned_addr learned my addr 172.21.15.18:0/434846240 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> v2:172.21.15.167:3300/0 conn(0x7f380015dc00 0x7f38000af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3805600640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f38000c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617094581 0 0) 0x7f38000b30d0 con 0x7f38000d0150 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e4003530 con 0x7f38000d0150 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111177169 0 0) 0x7f37e4003530 con 0x7f38000d0150 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 msgr2=0x7f38000c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f38000c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 >> v2:172.21.15.167:3300/0 conn(0x7f380015dc00 msgr2=0x7f38000af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 --2- 172.21.15.18:0/434846240 >> v2:172.21.15.167:3300/0 conn(0x7f380015dc00 0x7f38000af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000cd210 con 0x7f38000d0150 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f37e8001680 con 0x7f38000d0150 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> v2:172.21.15.167:3300/0 conn(0x7f380015dc00 0x7f38000af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 >> v1:172.21.15.18:6789/0 conn(0x7f38000d0150 legacy=0x7f38000c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e40039c0 0x7f37e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37e4004810 0x7f37e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f37e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000cd860 con 0x7f37e40039c0 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000ccf30 con 0x7f37e4004810 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e400b9d0 con 0x7f38000c72a0 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e40039c0 0x7f37e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3805600640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f37e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f37f7e00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37e4004810 0x7f37e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 -- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 msgr2=0x7f37e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38000c72a0 0x7f37e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 -- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37e4004810 msgr2=0x7f37e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f37e4004810 0x7f37e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.088+0000 7f3804c00640 1 -- 172.21.15.18:0/434846240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4003530 con 0x7f37e40039c0 2024-04-25T10:04:51.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3804c00640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e40039c0 0x7f37e4003de0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009cb0 tx=0x7f37f001cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2a7889fdf94dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f00b2070 con 0x7f37e40039c0 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00a5650 con 0x7f37e40039c0 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f37ffe00640 1 -- 172.21.15.18:0/434846240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0009880 con 0x7f37e40039c0 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 -- 172.21.15.18:0/434846240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e40039c0 msgr2=0x7f37e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 --2- 172.21.15.18:0/434846240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37e40039c0 0x7f37e4003de0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009cb0 tx=0x7f37f001cc90 comp rx=0 tx=0).stop 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3805600640 1 -- 172.21.15.18:0/434846240 reap_dead start 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 -- 172.21.15.18:0/434846240 shutdown_connections 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 -- 172.21.15.18:0/434846240 >> 172.21.15.18:0/434846240 conn(0x7f38000b2240 msgr2=0x7f38000b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 -- 172.21.15.18:0/434846240 shutdown_connections 2024-04-25T10:04:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 -- 172.21.15.18:0/434846240 wait complete. 2024-04-25T10:04:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.092+0000 7f3807600640 1 Processor -- start 2024-04-25T10:04:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- start start 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37e40039c0 0x7f380015ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3800150110 0x7f380014f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c5cc0 con 0x7f380015ed00 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000cdee0 con 0x7f3800150110 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c5e40 con 0x7f37e40039c0 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48824/0 (socket says 172.21.15.18:48824) 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 -- 172.21.15.18:0/2176867201 learned_addr learned my addr 172.21.15.18:0/2176867201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f37f7e00640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3800150110 0x7f380014f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3804c00640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37e40039c0 0x7f380015ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 -- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37e40039c0 msgr2=0x7f380015ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37e40039c0 0x7f380015ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 -- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3800150110 msgr2=0x7f380014f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3800150110 0x7f380014f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 -- 172.21.15.18:0/2176867201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380015ff50 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3805600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3800072330 tx=0x7f37f80115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8011db0 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f801b070 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380015e220 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f80039a0 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380015fbe0 con 0x7f380015ed00 2024-04-25T10:04:51.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.096+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380006ccb0 con 0x7f380015ed00 2024-04-25T10:04:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.100+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f37f8003b40 con 0x7f380015ed00 2024-04-25T10:04:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.100+0000 7f37fd600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 0x7f37dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.100+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f37f80859b0 con 0x7f380015ed00 2024-04-25T10:04:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.100+0000 7f3804c00640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 0x7f37dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.100+0000 7f3804c00640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 0x7f37dc069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37f00af000 tx=0x7f37f00046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.104+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37f8055f60 con 0x7f380015ed00 2024-04-25T10:04:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.264+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38000745d0 con 0x7f380015ed00 2024-04-25T10:04:51.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.264+0000 7f37fd600640 1 -- 172.21.15.18:0/2176867201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37f805a000 con 0x7f380015ed00 2024-04-25T10:04:51.276 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 msgr2=0x7f37dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 0x7f37dc069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f37f00af000 tx=0x7f37f00046d0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 msgr2=0x7f38000b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3800072330 tx=0x7f37f80115a0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 shutdown_connections 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f380015ed00 0x7f38000b11e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3800150110 0x7f380014f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37dc066f60 0x7f37dc069420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 --2- 172.21.15.18:0/2176867201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f37e40039c0 0x7f380015ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 >> 172.21.15.18:0/2176867201 conn(0x7f38000b2240 msgr2=0x7f38000b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 shutdown_connections 2024-04-25T10:04:51.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.268+0000 7f3807600640 1 -- 172.21.15.18:0/2176867201 wait complete. 2024-04-25T10:04:51.296 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:51.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 Processor -- start 2024-04-25T10:04:51.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 -- start start 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc840669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc840cc400 0x7fbc840ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840cfb90 con 0x7fbc840aed90 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8415cc30 con 0x7fbc840cc400 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc8a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840acfb0 con 0x7fbc84070020 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbc840aed90 0x7fbc8415f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60942/0 (socket says 172.21.15.18:60942) 2024-04-25T10:04:51.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 -- 172.21.15.18:0/4253901671 learned_addr learned my addr 172.21.15.18:0/4253901671 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:51.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82a00640 1 --2- 172.21.15.18:0/4253901671 >> v2:172.21.15.167:3300/0 conn(0x7fbc840cc400 0x7fbc840ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83400640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc840669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016958777 0 0) 0x7fbc840cfb90 con 0x7fbc840aed90 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc68003530 con 0x7fbc840aed90 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4219259833 0 0) 0x7fbc68003530 con 0x7fbc840aed90 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 msgr2=0x7fbc840669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc840669a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 >> v2:172.21.15.167:3300/0 conn(0x7fbc840cc400 msgr2=0x7fbc840ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 --2- 172.21.15.18:0/4253901671 >> v2:172.21.15.167:3300/0 conn(0x7fbc840cc400 0x7fbc840ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840cf670 con 0x7fbc840aed90 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fbc7c001a00 con 0x7fbc840aed90 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82a00640 1 --2- 172.21.15.18:0/4253901671 >> v2:172.21.15.167:3300/0 conn(0x7fbc840cc400 0x7fbc840ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 >> v1:172.21.15.18:6789/0 conn(0x7fbc840aed90 legacy=0x7fbc8415f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680039c0 0x7fbc68003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415cc30 con 0x7fbc68004d50 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840acfb0 con 0x7fbc680039c0 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6800b9d0 con 0x7fbc84070020 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc82a00640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83400640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680039c0 0x7fbc68003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 -- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 msgr2=0x7fbc68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc84070020 0x7fbc68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 -- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680039c0 msgr2=0x7fbc68003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc680039c0 0x7fbc68003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.432+0000 7fbc83e00640 1 -- 172.21.15.18:0/4253901671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68003530 con 0x7fbc68004d50 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc83e00640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc680051d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00a920 tx=0x7fbc7c01d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06d562d52b6a1c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00a4c0 con 0x7fbc68004d50 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0072f0 con 0x7fbc68004d50 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc82000640 1 -- 172.21.15.18:0/4253901671 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0076e0 con 0x7fbc68004d50 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 -- 172.21.15.18:0/4253901671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 msgr2=0x7fbc680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 --2- 172.21.15.18:0/4253901671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc680051d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00a920 tx=0x7fbc7c01d440 comp rx=0 tx=0).stop 2024-04-25T10:04:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc83e00640 1 -- 172.21.15.18:0/4253901671 reap_dead start 2024-04-25T10:04:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 -- 172.21.15.18:0/4253901671 shutdown_connections 2024-04-25T10:04:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 -- 172.21.15.18:0/4253901671 >> 172.21.15.18:0/4253901671 conn(0x7fbc840cc830 msgr2=0x7fbc840ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 -- 172.21.15.18:0/4253901671 shutdown_connections 2024-04-25T10:04:51.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.436+0000 7fbc8a400640 1 -- 172.21.15.18:0/4253901671 wait complete. 2024-04-25T10:04:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 Processor -- start 2024-04-25T10:04:51.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- start start 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc841584e0 0x7fbc841f4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 0x7fbc841f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84070400 con 0x7fbc68004d50 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840cecc0 con 0x7fbc84158940 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415c8c0 con 0x7fbc841584e0 2024-04-25T10:04:51.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48846/0 (socket says 172.21.15.18:48846) 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 -- 172.21.15.18:0/1314818511 learned_addr learned my addr 172.21.15.18:0/1314818511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc82a00640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc841584e0 0x7fbc841f4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83e00640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 0x7fbc841f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 -- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc841584e0 msgr2=0x7fbc841f4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc841584e0 0x7fbc841f4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 -- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 msgr2=0x7fbc841f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 0x7fbc841f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 -- 172.21.15.18:0/1314818511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc84155660 con 0x7fbc68004d50 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83e00640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 0x7fbc841f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc83400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc740119c0 tx=0x7fbc74011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7400faf0 con 0x7fbc68004d50 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7400fc90 con 0x7fbc68004d50 2024-04-25T10:04:51.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74014440 con 0x7fbc68004d50 2024-04-25T10:04:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc841525c0 con 0x7fbc68004d50 2024-04-25T10:04:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.440+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84155380 con 0x7fbc68004d50 2024-04-25T10:04:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc840745d0 con 0x7fbc68004d50 2024-04-25T10:04:51.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbc74012040 con 0x7fbc68004d50 2024-04-25T10:04:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc7b400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 0x7fbc64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbc74085aa0 con 0x7fbc68004d50 2024-04-25T10:04:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc82a00640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 0x7fbc64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.444+0000 7fbc82a00640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 0x7fbc64069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc84155e50 tx=0x7fbc70008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.448+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc74019030 con 0x7fbc68004d50 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc840b5e90 con 0x7fbc68004d50 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc7b400640 1 -- 172.21.15.18:0/1314818511 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc74056610 con 0x7fbc68004d50 2024-04-25T10:04:51.621 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 msgr2=0x7fbc64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 0x7fbc64069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbc84155e50 tx=0x7fbc70008040 comp rx=0 tx=0).stop 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 msgr2=0x7fbc8415a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbc740119c0 tx=0x7fbc74011e80 comp rx=0 tx=0).stop 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 shutdown_connections 2024-04-25T10:04:51.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc84158940 0x7fbc841f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc64066f60 0x7fbc64069420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc841584e0 0x7fbc841f4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 --2- 172.21.15.18:0/1314818511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc68004d50 0x7fbc8415a0d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 >> 172.21.15.18:0/1314818511 conn(0x7fbc840cc830 msgr2=0x7fbc8415f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 shutdown_connections 2024-04-25T10:04:51.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.612+0000 7fbc8a400640 1 -- 172.21.15.18:0/1314818511 wait complete. 2024-04-25T10:04:51.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:51.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 Processor -- start 2024-04-25T10:04:51.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 -- start start 2024-04-25T10:04:51.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b00d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b0099dd0 con 0x7fc8b006c730 2024-04-25T10:04:51.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b009a9e0 con 0x7fc8b006cb10 2024-04-25T10:04:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b009ae70 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b00d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b4e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b4e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44458/0 (socket says 172.21.15.18:44458) 2024-04-25T10:04:51.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.776+0000 7fc8b4e00640 1 -- 172.21.15.18:0/3778377297 learned_addr learned my addr 172.21.15.18:0/3778377297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:51.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6200640 1 -- 172.21.15.18:0/3778377297 >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 msgr2=0x7fc8b00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:51.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6200640 1 --2- 172.21.15.18:0/3778377297 >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6200640 1 -- 172.21.15.18:0/3778377297 >> v1:172.21.15.167:6789/0 conn(0x7fc8b006c730 legacy=0x7fc8b015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6200640 1 -- 172.21.15.18:0/3778377297 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b009a0b0 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b4e00640 1 --2- 172.21.15.18:0/3778377297 >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:51.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6200640 1 --2- 172.21.15.18:0/3778377297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b00d0150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009d90 tx=0x7fc8a801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=226fe3be35e2b58b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8afe00640 1 -- 172.21.15.18:0/3778377297 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80b2070 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8afe00640 1 -- 172.21.15.18:0/3778377297 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a80a5a00 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8afe00640 1 -- 172.21.15.18:0/3778377297 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80a5dd0 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3778377297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 msgr2=0x7fc8b00d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3778377297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b00d0150 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009d90 tx=0x7fc8a801c940 comp rx=0 tx=0).stop 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3778377297 shutdown_connections 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3778377297 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b00d0150 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3778377297 >> v2:172.21.15.167:3300/0 conn(0x7fc8b006cb10 0x7fc8b00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.780+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3778377297 >> 172.21.15.18:0/3778377297 conn(0x7fc8b00b3030 msgr2=0x7fc8b00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3778377297 shutdown_connections 2024-04-25T10:04:51.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3778377297 wait complete. 2024-04-25T10:04:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 Processor -- start 2024-04-25T10:04:51.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- start start 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 0x7fc8b0151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b006fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b0720 con 0x7fc8b006cb10 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b0099a60 con 0x7fc8b006c730 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b00b08a0 con 0x7fc8b00cfcc0 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41202/0 (socket says 172.21.15.18:41202) 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 -- 172.21.15.18:0/3075283892 learned_addr learned my addr 172.21.15.18:0/3075283892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b5800640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 0x7fc8b0151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b6200640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b006fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 -- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 msgr2=0x7fc8b006fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b006fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 -- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 msgr2=0x7fc8b0151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 0x7fc8b0151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 -- 172.21.15.18:0/3075283892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b01536e0 con 0x7fc8b006cb10 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b5800640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 0x7fc8b0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:51.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8b4e00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00e930 tx=0x7fc89c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.784+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c017070 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89c00ca00 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b0152e40 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89c00cdd0 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b0153400 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b009d0a0 con 0x7fc8b006cb10 2024-04-25T10:04:51.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc89c01a070 con 0x7fc8b006cb10 2024-04-25T10:04:51.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8ad600640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 0x7fc890069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:51.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fc89c085220 con 0x7fc8b006cb10 2024-04-25T10:04:51.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.788+0000 7fc8b5800640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 0x7fc890069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:51.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.792+0000 7fc8b5800640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 0x7fc890069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00afc80 tx=0x7fc8a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:51.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.792+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc89c055870 con 0x7fc8b006cb10 2024-04-25T10:04:51.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.952+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc8b00745d0 con 0x7fc8b006cb10 2024-04-25T10:04:51.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.952+0000 7fc8ad600640 1 -- 172.21.15.18:0/3075283892 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc89c059910 con 0x7fc8b006cb10 2024-04-25T10:04:51.964 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 msgr2=0x7fc890069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 0x7fc890069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc8b00afc80 tx=0x7fc8a4009040 comp rx=0 tx=0).stop 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 msgr2=0x7fc8b009b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc89c00e930 tx=0x7fc89c00edf0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 shutdown_connections 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc890066f60 0x7fc890069420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc8b00cfcc0 0x7fc8b006fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b006cb10 0x7fc8b009b3d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 --2- 172.21.15.18:0/3075283892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8b006c730 0x7fc8b0151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:51.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 >> 172.21.15.18:0/3075283892 conn(0x7fc8b00b3030 msgr2=0x7fc8b015f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:51.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 shutdown_connections 2024-04-25T10:04:51.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:51.956+0000 7fc8b6c00640 1 -- 172.21.15.18:0/3075283892 wait complete. 2024-04-25T10:04:51.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:52.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.116+0000 7f21c8a00640 1 Processor -- start 2024-04-25T10:04:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.116+0000 7f21c8a00640 1 -- start start 2024-04-25T10:04:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c8a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21c415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c8a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f21c40ccbf0 0x7f21c415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c8a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c415bc40 con 0x7f21c415ee60 2024-04-25T10:04:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c8a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c415e490 con 0x7f21c40ccbf0 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c8a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415b3a0 con 0x7f21c4144120 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c2800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f21c415ee60 0x7f21c40b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54708/0 (socket says 172.21.15.18:54708) 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c2800640 1 -- 172.21.15.18:0/2967661439 learned_addr learned my addr 172.21.15.18:0/2967661439 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21bbe00640 1 --2- 172.21.15.18:0/2967661439 >> v2:172.21.15.167:3300/0 conn(0x7f21c40ccbf0 0x7f21c415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21c415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3510476251 0 0) 0x7f21c415bc40 con 0x7f21c415ee60 2024-04-25T10:04:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a8003530 con 0x7f21c415ee60 2024-04-25T10:04:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936662616 0 0) 0x7f21a8003530 con 0x7f21c415ee60 2024-04-25T10:04:52.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 msgr2=0x7f21c415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21c415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 >> v2:172.21.15.167:3300/0 conn(0x7f21c40ccbf0 msgr2=0x7f21c415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 --2- 172.21.15.18:0/2967661439 >> v2:172.21.15.167:3300/0 conn(0x7f21c40ccbf0 0x7f21c415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c415b680 con 0x7f21c415ee60 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f21bc001a00 con 0x7f21c415ee60 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 >> v1:172.21.15.18:6789/0 conn(0x7f21c415ee60 legacy=0x7f21c40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415e490 con 0x7f21a8004810 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c415b3a0 con 0x7f21a80039c0 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a800ba20 con 0x7f21c4144120 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21bbe00640 1 --2- 172.21.15.18:0/2967661439 >> v2:172.21.15.167:3300/0 conn(0x7f21c40ccbf0 0x7f21c415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21bbe00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c2800640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 -- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 msgr2=0x7f21a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4144120 0x7f21a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 -- 172.21.15.18:0/2967661439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a8004810 msgr2=0x7f21a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21c1e00640 1 -- 172.21.15.18:0/2967661439 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a8003530 con 0x7f21a80039c0 2024-04-25T10:04:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.120+0000 7f21bbe00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a8004810 0x7f21a8004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c1e00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009ae0 tx=0x7f21b401ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b15385faffb6eea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40096b0 con 0x7f21a80039c0 2024-04-25T10:04:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40a9470 con 0x7f21a80039c0 2024-04-25T10:04:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c1400640 1 -- 172.21.15.18:0/2967661439 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40a9860 con 0x7f21a80039c0 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 -- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a80039c0 msgr2=0x7f21a8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 --2- 172.21.15.18:0/2967661439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21a80039c0 0x7f21a8003de0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009ae0 tx=0x7f21b401ca70 comp rx=0 tx=0).stop 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c2800640 1 -- 172.21.15.18:0/2967661439 reap_dead start 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 -- 172.21.15.18:0/2967661439 shutdown_connections 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 -- 172.21.15.18:0/2967661439 >> 172.21.15.18:0/2967661439 conn(0x7f21c4067080 msgr2=0x7f21c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 -- 172.21.15.18:0/2967661439 shutdown_connections 2024-04-25T10:04:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.124+0000 7f21c8a00640 1 -- 172.21.15.18:0/2967661439 wait complete. 2024-04-25T10:04:52.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 Processor -- start 2024-04-25T10:04:52.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- start start 2024-04-25T10:04:52.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4159fd0 0x7f21c4164060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4166f00 0x7f21c41673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40b3920 con 0x7f21a80039c0 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c40b37a0 con 0x7f21c4166f00 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c4165c40 con 0x7f21c4159fd0 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41226/0 (socket says 172.21.15.18:41226) 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 -- 172.21.15.18:0/1485383939 learned_addr learned my addr 172.21.15.18:0/1485383939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 -- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4159fd0 msgr2=0x7f21c4164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4159fd0 0x7f21c4164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 -- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4166f00 msgr2=0x7f21c41673b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4166f00 0x7f21c41673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 -- 172.21.15.18:0/1485383939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40b02c0 con 0x7f21a80039c0 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c1e00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009a00 tx=0x7f21a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40c0070 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40a9ba0 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40ba3f0 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c40b05a0 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c4166700 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.128+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c40745d0 con 0x7f21a80039c0 2024-04-25T10:04:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21b40c3070 con 0x7f21a80039c0 2024-04-25T10:04:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21ba000640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 0x7f21a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f21b411fbb0 con 0x7f21a80039c0 2024-04-25T10:04:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21bbe00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 0x7f21a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21bbe00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 0x7f21a0069420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006e90 tx=0x7f21ac006e20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.132+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21b40ca070 con 0x7f21a80039c0 2024-04-25T10:04:52.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.308+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21c40b4550 con 0x7f21a80039c0 2024-04-25T10:04:52.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.308+0000 7f21ba000640 1 -- 172.21.15.18:0/1485383939 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21b40ad020 con 0x7f21a80039c0 2024-04-25T10:04:52.319 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 msgr2=0x7f21a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 0x7f21a0069420 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f21ac006e90 tx=0x7f21ac006e20 comp rx=0 tx=0).stop 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 msgr2=0x7f21c40ae620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009a00 tx=0x7f21a8005840 comp rx=0 tx=0).stop 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 shutdown_connections 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4166f00 0x7f21c41673b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21a0066f60 0x7f21a0069420 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c4159fd0 0x7f21c4164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 --2- 172.21.15.18:0/1485383939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21a80039c0 0x7f21c40ae620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 >> 172.21.15.18:0/1485383939 conn(0x7f21c4067080 msgr2=0x7f21c406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 shutdown_connections 2024-04-25T10:04:52.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.312+0000 7f21c8a00640 1 -- 172.21.15.18:0/1485383939 wait complete. 2024-04-25T10:04:52.340 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T10:04:52.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T10:04:52.364 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:04:52.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:52.364 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T10:04:52.417 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:52.417 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:52.426 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:52.427 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:52.477 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:04:52.477 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:04:52.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:52.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 Processor -- start 2024-04-25T10:04:52.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 -- start start 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8ab015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8ab00cd4d0 0x7f8ab00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00cc4e0 con 0x7f8ab00b1750 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab0145650 con 0x7f8ab00cd4d0 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8ab4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00ce040 con 0x7f8ab0145270 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aae800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8ab00b1750 0x7f8ab015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54712/0 (socket says 172.21.15.18:54712) 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aae800640 1 -- 172.21.15.18:0/2241110727 learned_addr learned my addr 172.21.15.18:0/2241110727 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aade00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8ab015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> v2:172.21.15.167:3300/0 conn(0x7f8ab00cd4d0 0x7f8ab00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363223261 0 0) 0x7f8ab00cc4e0 con 0x7f8ab00b1750 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.664+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a94003530 con 0x7f8ab00b1750 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2734395916 0 0) 0x7f8a94003530 con 0x7f8ab00b1750 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 msgr2=0x7f8ab015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8ab015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 >> v2:172.21.15.167:3300/0 conn(0x7f8ab00cd4d0 msgr2=0x7f8ab00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 --2- 172.21.15.18:0/2241110727 >> v2:172.21.15.167:3300/0 conn(0x7f8ab00cd4d0 0x7f8ab00cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00ce320 con 0x7f8ab00b1750 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f8aa8001a00 con 0x7f8ab00b1750 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> v2:172.21.15.167:3300/0 conn(0x7f8ab00cd4d0 0x7f8ab00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 >> v1:172.21.15.18:6789/0 conn(0x7f8ab00b1750 legacy=0x7f8ab015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8a940039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a94003f90 0x7f8a94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a94004d50 0x7f8a940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab0145650 con 0x7f8a94003f90 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00ce040 con 0x7f8a94004d50 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9400b9d0 con 0x7f8ab0145270 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a94003f90 0x7f8a94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aae800640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a94004d50 0x7f8a940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aade00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8a940039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 msgr2=0x7f8a940039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ab0145270 0x7f8a940039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a94004d50 msgr2=0x7f8a940051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a94004d50 0x7f8a940051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.668+0000 7f8aa7e00640 1 -- 172.21.15.18:0/2241110727 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94003530 con 0x7f8a94003f90 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a94003f90 0x7f8a94004810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009ce0 tx=0x7f8a9801cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab542b9d98dd82f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a980b2070 con 0x7f8a94003f90 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a980a5930 con 0x7f8a94003f90 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aad400640 1 -- 172.21.15.18:0/2241110727 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98009880 con 0x7f8a94003f90 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- 172.21.15.18:0/2241110727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a94003f90 msgr2=0x7f8a94004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/2241110727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a94003f90 0x7f8a94004810 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009ce0 tx=0x7f8a9801cc70 comp rx=0 tx=0).stop 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aae800640 1 -- 172.21.15.18:0/2241110727 reap_dead start 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- 172.21.15.18:0/2241110727 shutdown_connections 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- 172.21.15.18:0/2241110727 >> 172.21.15.18:0/2241110727 conn(0x7f8ab0066fa0 msgr2=0x7f8ab006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- 172.21.15.18:0/2241110727 shutdown_connections 2024-04-25T10:04:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- 172.21.15.18:0/2241110727 wait complete. 2024-04-25T10:04:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 Processor -- start 2024-04-25T10:04:52.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- start start 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 0x7f8ab0141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab01e5100 0x7f8ab01e5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab015f930 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab015f650 con 0x7f8ab01e5100 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8ab4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab015fe50 con 0x7f8a94003f90 2024-04-25T10:04:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41250/0 (socket says 172.21.15.18:41250) 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aae800640 1 -- 172.21.15.18:0/941391349 learned_addr learned my addr 172.21.15.18:0/941391349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.672+0000 7f8aa7e00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab01e5100 0x7f8ab01e5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aade00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 0x7f8ab0141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 -- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 msgr2=0x7f8ab0141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 0x7f8ab0141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 -- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab01e5100 msgr2=0x7f8ab01e5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab01e5100 0x7f8ab01e5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 -- 172.21.15.18:0/941391349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab01e56a0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aade00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 0x7f8ab0141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aae800640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00b4b90 tx=0x7f8aa8012630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8007070 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa8007210 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab0141aa0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa8016660 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01417a0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab00745d0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8aa801e020 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 0x7f8a8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.676+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f8aa8088d20 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.680+0000 7f8aade00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 0x7f8a8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.680+0000 7f8aade00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 0x7f8a8c069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009a10 tx=0x7f8aa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:52.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.680+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8aa80592e0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.852+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ab006b2d0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.852+0000 7f8aa6000640 1 -- 172.21.15.18:0/941391349 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f8ab006b2d0 con 0x7f8ab01f6fd0 2024-04-25T10:04:52.864 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:52.864 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 msgr2=0x7f8a8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 0x7f8a8c069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0009a10 tx=0x7f8aa0008040 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 msgr2=0x7f8ab01f7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8ab00b4b90 tx=0x7f8aa8012630 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 shutdown_connections 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ab01f6fd0 0x7f8ab01f7450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ab01e5100 0x7f8ab01e5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8a8c066f60 0x7f8a8c069420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 --2- 172.21.15.18:0/941391349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8a94003f90 0x7f8ab0141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 >> 172.21.15.18:0/941391349 conn(0x7f8ab0066fa0 msgr2=0x7f8ab015dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 shutdown_connections 2024-04-25T10:04:52.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:52.856+0000 7f8ab4c00640 1 -- 172.21.15.18:0/941391349 wait complete. 2024-04-25T10:04:52.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:52.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:53.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.020+0000 7f5a92e00640 1 Processor -- start 2024-04-25T10:04:53.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.020+0000 7f5a92e00640 1 -- start start 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5a8c144120 0x7f5a8c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c0ccbf0 0x7f5a8c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a8c15ee60 0x7f5a8c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c15e490 con 0x7f5a8c15ee60 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c15bc40 con 0x7f5a8c144120 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a92e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c15b3a0 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a8c15ee60 0x7f5a8c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a8c15ee60 0x7f5a8c0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41256/0 (socket says 172.21.15.18:41256) 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 -- 172.21.15.18:0/480379480 learned_addr learned my addr 172.21.15.18:0/480379480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a83400640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c0ccbf0 0x7f5a8c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a8be00640 1 --2- 172.21.15.18:0/480379480 >> v2:172.21.15.167:3300/0 conn(0x7f5a8c144120 0x7f5a8c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 -- 172.21.15.18:0/480379480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c0ccbf0 msgr2=0x7f5a8c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c0ccbf0 0x7f5a8c15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 -- 172.21.15.18:0/480379480 >> v2:172.21.15.167:3300/0 conn(0x7f5a8c144120 msgr2=0x7f5a8c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 --2- 172.21.15.18:0/480379480 >> v2:172.21.15.167:3300/0 conn(0x7f5a8c144120 0x7f5a8c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.024+0000 7f5a90e00640 1 -- 172.21.15.18:0/480379480 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c15b680 con 0x7f5a8c15ee60 2024-04-25T10:04:53.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a90e00640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c15ee60 0x7f5a8c0b3090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c06b9b0 tx=0x7f5a8401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a040d50b819f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a8b400640 1 -- 172.21.15.18:0/480379480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8400b2d0 con 0x7f5a8c15ee60 2024-04-25T10:04:53.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a8b400640 1 -- 172.21.15.18:0/480379480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8400b470 con 0x7f5a8c15ee60 2024-04-25T10:04:53.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a8b400640 1 -- 172.21.15.18:0/480379480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a840a7a10 con 0x7f5a8c15ee60 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- 172.21.15.18:0/480379480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c15ee60 msgr2=0x7f5a8c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c15ee60 0x7f5a8c0b3090 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c06b9b0 tx=0x7f5a8401eb60 comp rx=0 tx=0).stop 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- 172.21.15.18:0/480379480 shutdown_connections 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c15ee60 0x7f5a8c0b3090 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- 172.21.15.18:0/480379480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c0ccbf0 0x7f5a8c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- 172.21.15.18:0/480379480 >> v2:172.21.15.167:3300/0 conn(0x7f5a8c144120 0x7f5a8c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- 172.21.15.18:0/480379480 >> 172.21.15.18:0/480379480 conn(0x7f5a8c067080 msgr2=0x7f5a8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- 172.21.15.18:0/480379480 shutdown_connections 2024-04-25T10:04:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- 172.21.15.18:0/480379480 wait complete. 2024-04-25T10:04:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 Processor -- start 2024-04-25T10:04:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- start start 2024-04-25T10:04:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a8c144120 0x7f5a8c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 0x7f5a8c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c071e10 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c071c90 con 0x7f5a8c144120 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.028+0000 7f5a92e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c071f90 con 0x7f5a8c15ee60 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41258/0 (socket says 172.21.15.18:41258) 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 -- 172.21.15.18:0/4259009637 learned_addr learned my addr 172.21.15.18:0/4259009637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a83400640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a8c144120 0x7f5a8c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a90e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 0x7f5a8c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 -- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 msgr2=0x7f5a8c0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 0x7f5a8c0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 -- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a8c144120 msgr2=0x7f5a8c15a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a8c144120 0x7f5a8c15a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 -- 172.21.15.18:0/4259009637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c13f270 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a90e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 0x7f5a8c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a8be00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00d800 tx=0x7f5a7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00b6c0 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c019070 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c13ecb0 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00ba60 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c0b1380 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c0745d0 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a7c00bc00 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.032+0000 7f5a88c00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 0x7f5a68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.036+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f5a7c085880 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.036+0000 7f5a83400640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 0x7f5a68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.036+0000 7f5a83400640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 0x7f5a68069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c13f570 tx=0x7f5a74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.036+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a7c056480 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.200+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a8c0cc700 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a88c00640 1 -- 172.21.15.18:0/4259009637 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a7c055d80 con 0x7f5a8c0ccbf0 2024-04-25T10:04:53.213 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:53.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 msgr2=0x7f5a68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 0x7f5a68069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c13f570 tx=0x7f5a74008040 comp rx=0 tx=0).stop 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 msgr2=0x7f5a8c13e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00d800 tx=0x7f5a7c00dcc0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 shutdown_connections 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a68066f60 0x7f5a68069420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a8c15ee60 0x7f5a8c0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a8c144120 0x7f5a8c15a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 --2- 172.21.15.18:0/4259009637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8c0ccbf0 0x7f5a8c13e6d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 >> 172.21.15.18:0/4259009637 conn(0x7f5a8c067080 msgr2=0x7f5a8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 shutdown_connections 2024-04-25T10:04:53.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.204+0000 7f5a92e00640 1 -- 172.21.15.18:0/4259009637 wait complete. 2024-04-25T10:04:53.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 Processor -- start 2024-04-25T10:04:53.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 -- start start 2024-04-25T10:04:53.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94c015b910 0x7f94c00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cf3c0 0x7f94c00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94c00d02a0 con 0x7f94c00cd370 2024-04-25T10:04:53.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94c00cc350 con 0x7f94c015b910 2024-04-25T10:04:53.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.368+0000 7f94c5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c00cc630 con 0x7f94c00cf3c0 2024-04-25T10:04:53.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94b6000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cf3c0 0x7f94c00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94c015b910 0x7f94c00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94c015b910 0x7f94c00cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44548/0 (socket says 172.21.15.18:44548) 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 -- 172.21.15.18:0/2359742623 learned_addr learned my addr 172.21.15.18:0/2359742623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bf400640 1 --1- 172.21.15.18:0/2359742623 >> v1:172.21.15.167:6789/0 conn(0x7f94c00cd370 0x7f94c0099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42820/0 (socket says 172.21.15.18:42820) 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 -- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cf3c0 msgr2=0x7f94c00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:53.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 --2- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cf3c0 0x7f94c00cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 -- 172.21.15.18:0/2359742623 >> v1:172.21.15.167:6789/0 conn(0x7f94c00cd370 legacy=0x7f94c0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 -- 172.21.15.18:0/2359742623 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c00cc910 con 0x7f94c015b910 2024-04-25T10:04:53.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.372+0000 7f94bea00640 1 --2- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c00cf9a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2af5ea09c1d9329c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94be000640 1 -- 172.21.15.18:0/2359742623 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5810 con 0x7f94c015b910 2024-04-25T10:04:53.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94be000640 1 -- 172.21.15.18:0/2359742623 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b00a59b0 con 0x7f94c015b910 2024-04-25T10:04:53.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94be000640 1 -- 172.21.15.18:0/2359742623 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5d80 con 0x7f94c015b910 2024-04-25T10:04:53.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 msgr2=0x7f94c00cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c00cf9a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009e50 tx=0x7f94b001ca30 comp rx=0 tx=0).stop 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- 172.21.15.18:0/2359742623 shutdown_connections 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cf3c0 0x7f94c00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- 172.21.15.18:0/2359742623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c00cf9a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- 172.21.15.18:0/2359742623 >> 172.21.15.18:0/2359742623 conn(0x7f94c00b3200 msgr2=0x7f94c00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- 172.21.15.18:0/2359742623 shutdown_connections 2024-04-25T10:04:53.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- 172.21.15.18:0/2359742623 wait complete. 2024-04-25T10:04:53.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 Processor -- start 2024-04-25T10:04:53.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- start start 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 0x7f94c015a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c009ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c009a2f0 con 0x7f94c00cf3c0 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c009a170 con 0x7f94c015b910 2024-04-25T10:04:53.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94c5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c015bcf0 con 0x7f94c00cd370 2024-04-25T10:04:53.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41262/0 (socket says 172.21.15.18:41262) 2024-04-25T10:04:53.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94b6000640 1 -- 172.21.15.18:0/1719521531 learned_addr learned my addr 172.21.15.18:0/1719521531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:53.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94bf400640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c009ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.376+0000 7f94bea00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 0x7f94c015a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 -- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 msgr2=0x7f94c015a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 0x7f94c015a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 -- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 msgr2=0x7f94c009ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c009ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 -- 172.21.15.18:0/1719521531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c015afd0 con 0x7f94c00cf3c0 2024-04-25T10:04:53.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94bea00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 0x7f94c015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b6000640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e900 tx=0x7f94a800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8017070 con 0x7f94c00cf3c0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a800c9a0 con 0x7f94c00cf3c0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800cd90 con 0x7f94c00cf3c0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c00b4d40 con 0x7f94c00cf3c0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c00b5300 con 0x7f94c00cf3c0 2024-04-25T10:04:53.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c00745d0 con 0x7f94c00cf3c0 2024-04-25T10:04:53.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94a801a070 con 0x7f94c00cf3c0 2024-04-25T10:04:53.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 0x7f949c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.380+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f94a8085820 con 0x7f94c00cf3c0 2024-04-25T10:04:53.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.384+0000 7f94bea00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 0x7f949c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.384+0000 7f94bea00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 0x7f949c069450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94b00ae000 tx=0x7f94b00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.384+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94a8056390 con 0x7f94c00cf3c0 2024-04-25T10:04:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.548+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94c00b69d0 con 0x7f94c00cf3c0 2024-04-25T10:04:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.548+0000 7f94b7400640 1 -- 172.21.15.18:0/1719521531 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94a8055c90 con 0x7f94c00cf3c0 2024-04-25T10:04:53.559 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 msgr2=0x7f949c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 0x7f949c069450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f94b00ae000 tx=0x7f94b00a7070 comp rx=0 tx=0).stop 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 msgr2=0x7f94c00b6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f94a800e900 tx=0x7f94a800edc0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 shutdown_connections 2024-04-25T10:04:53.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94c015b910 0x7f94c009ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94c00cf3c0 0x7f94c00b6bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f949c066f90 0x7f949c069450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 --2- 172.21.15.18:0/1719521531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94c00cd370 0x7f94c015a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 >> 172.21.15.18:0/1719521531 conn(0x7f94c00b3200 msgr2=0x7f94c015e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 shutdown_connections 2024-04-25T10:04:53.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.552+0000 7f94c5c00640 1 -- 172.21.15.18:0/1719521531 wait complete. 2024-04-25T10:04:53.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:53.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.712+0000 7efe17e00640 1 Processor -- start 2024-04-25T10:04:53.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.712+0000 7efe17e00640 1 -- start start 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe17e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 0x7efe100af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe17e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe100c72a0 0x7efe100c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe17e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe100b30d0 con 0x7efe1015dc00 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe17e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100cd860 con 0x7efe100c72a0 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe17e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100ccf30 con 0x7efe100d0150 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe100c72a0 0x7efe100c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efe1015dc00 0x7efe100c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54722/0 (socket says 172.21.15.18:54722) 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15400640 1 -- 172.21.15.18:0/2129674265 learned_addr learned my addr 172.21.15.18:0/2129674265 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe14a00640 1 --2- 172.21.15.18:0/2129674265 >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 0x7efe100af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15e00640 1 -- 172.21.15.18:0/2129674265 >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 msgr2=0x7efe100af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15e00640 1 --2- 172.21.15.18:0/2129674265 >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 0x7efe100af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15e00640 1 -- 172.21.15.18:0/2129674265 >> v1:172.21.15.18:6789/0 conn(0x7efe1015dc00 legacy=0x7efe100c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe15e00640 1 -- 172.21.15.18:0/2129674265 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100cd210 con 0x7efe100c72a0 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe14a00640 1 --2- 172.21.15.18:0/2129674265 >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 0x7efe100af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.716+0000 7efe0fe00640 1 -- 172.21.15.18:0/2129674265 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106651524 0 0) 0x7efe100b30d0 con 0x7efe1015dc00 2024-04-25T10:04:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe15e00640 1 --2- 172.21.15.18:0/2129674265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe100c72a0 0x7efe100c54b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe10072850 tx=0x7efe0801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e247e2be335fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe0fe00640 1 -- 172.21.15.18:0/2129674265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080ad070 con 0x7efe100c72a0 2024-04-25T10:04:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe0fe00640 1 -- 172.21.15.18:0/2129674265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080a9640 con 0x7efe100c72a0 2024-04-25T10:04:53.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe0fe00640 1 -- 172.21.15.18:0/2129674265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080a9a10 con 0x7efe100c72a0 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- 172.21.15.18:0/2129674265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe100c72a0 msgr2=0x7efe100c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 --2- 172.21.15.18:0/2129674265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe100c72a0 0x7efe100c54b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe10072850 tx=0x7efe0801c930 comp rx=0 tx=0).stop 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- 172.21.15.18:0/2129674265 shutdown_connections 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 --2- 172.21.15.18:0/2129674265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe100c72a0 0x7efe100c54b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 --2- 172.21.15.18:0/2129674265 >> v2:172.21.15.167:3300/0 conn(0x7efe100d0150 0x7efe100af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- 172.21.15.18:0/2129674265 >> 172.21.15.18:0/2129674265 conn(0x7efe100b2240 msgr2=0x7efe100b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- 172.21.15.18:0/2129674265 shutdown_connections 2024-04-25T10:04:53.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- 172.21.15.18:0/2129674265 wait complete. 2024-04-25T10:04:53.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 Processor -- start 2024-04-25T10:04:53.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.720+0000 7efe17e00640 1 -- start start 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe100c72a0 0x7efe10151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe100d0150 0x7efe1009b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1016a7c0 con 0x7efe1015dc00 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1016a640 con 0x7efe100c72a0 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1016a940 con 0x7efe100d0150 2024-04-25T10:04:53.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe100c72a0 0x7efe10151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41280/0 (socket says 172.21.15.18:41280) 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 -- 172.21.15.18:0/1330886577 learned_addr learned my addr 172.21.15.18:0/1330886577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe14a00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe100d0150 0x7efe1009b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 -- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe100d0150 msgr2=0x7efe1009b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe100d0150 0x7efe1009b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 -- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe100c72a0 msgr2=0x7efe10151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe100c72a0 0x7efe10151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 -- 172.21.15.18:0/1330886577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe101530f0 con 0x7efe1015dc00 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe15e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe0801afe0 tx=0x7efe080196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080ad040 con 0x7efe1015dc00 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080039a0 con 0x7efe1015dc00 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe10152570 con 0x7efe1015dc00 2024-04-25T10:04:53.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe08003d90 con 0x7efe1015dc00 2024-04-25T10:04:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe10152b30 con 0x7efe1015dc00 2024-04-25T10:04:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe100745d0 con 0x7efe1015dc00 2024-04-25T10:04:53.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.724+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe080b0070 con 0x7efe1015dc00 2024-04-25T10:04:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.728+0000 7efe0d600640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 0x7efdf0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.728+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7efe0811f700 con 0x7efe1015dc00 2024-04-25T10:04:53.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.728+0000 7efe15400640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 0x7efdf0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:53.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.728+0000 7efe15400640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 0x7efdf0069450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe04000f70 tx=0x7efe04007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:53.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.732+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe08016520 con 0x7efe1015dc00 2024-04-25T10:04:53.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe1006fa30 con 0x7efe1015dc00 2024-04-25T10:04:53.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe0d600640 1 -- 172.21.15.18:0/1330886577 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe080efcb0 con 0x7efe1015dc00 2024-04-25T10:04:53.902 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 msgr2=0x7efdf0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 0x7efdf0069450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efe04000f70 tx=0x7efe04007df0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 msgr2=0x7efe101515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efe0801afe0 tx=0x7efe080196d0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 shutdown_connections 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe1015dc00 0x7efe101515f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efdf0066f90 0x7efdf0069450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe100d0150 0x7efe1009b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 --2- 172.21.15.18:0/1330886577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe100c72a0 0x7efe10151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 >> 172.21.15.18:0/1330886577 conn(0x7efe100b2240 msgr2=0x7efe100c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 shutdown_connections 2024-04-25T10:04:53.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:53.892+0000 7efe17e00640 1 -- 172.21.15.18:0/1330886577 wait complete. 2024-04-25T10:04:53.924 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 Processor -- start 2024-04-25T10:04:54.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 -- start start 2024-04-25T10:04:54.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff42006e4a0 0x7ff42006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42015fc00 con 0x7ff420159320 2024-04-25T10:04:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42015fee0 con 0x7ff42015c9b0 2024-04-25T10:04:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff427800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42006d640 con 0x7ff42006e4a0 2024-04-25T10:04:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff424e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff420159320 0x7ff42015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54732/0 (socket says 172.21.15.18:54732) 2024-04-25T10:04:54.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff424e00640 1 -- 172.21.15.18:0/1461761848 learned_addr learned my addr 172.21.15.18:0/1461761848 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff425800640 1 --2- 172.21.15.18:0/1461761848 >> v2:172.21.15.167:3300/0 conn(0x7ff42006e4a0 0x7ff42006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979176062 0 0) 0x7ff42015fc00 con 0x7ff420159320 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff408003530 con 0x7ff420159320 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3722104655 0 0) 0x7ff408003530 con 0x7ff420159320 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 >> v2:172.21.15.167:3300/0 conn(0x7ff42006e4a0 msgr2=0x7ff42006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 --2- 172.21.15.18:0/1461761848 >> v2:172.21.15.167:3300/0 conn(0x7ff42006e4a0 0x7ff42006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 >> v1:172.21.15.167:6789/0 conn(0x7ff42015c9b0 legacy=0x7ff42006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4201601c0 con 0x7ff420159320 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff414001680 con 0x7ff420159320 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 >> v1:172.21.15.18:6789/0 conn(0x7ff420159320 legacy=0x7ff42015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4080039c0 0x7ff408003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff408004810 0x7ff408004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 0x7ff40800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006d640 con 0x7ff4080051d0 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40800c0a0 con 0x7ff408004810 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40800c2a0 con 0x7ff4080039c0 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff425800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 0x7ff40800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff424e00640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4080039c0 0x7ff408003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.060+0000 7ff41fe00640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff408004810 0x7ff408004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 -- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4080039c0 msgr2=0x7ff408003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4080039c0 0x7ff408003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 -- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff408004810 msgr2=0x7ff408004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff408004810 0x7ff408004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 -- 172.21.15.18:0/1461761848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff408003530 con 0x7ff4080051d0 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 -- 172.21.15.18:0/1461761848 reap_dead start 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff425800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 0x7ff40800b9d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff418009fc0 tx=0x7ff41801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba5c79ad313340 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418009c10 con 0x7ff4080051d0 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180a5d10 con 0x7ff4080051d0 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff41f400640 1 -- 172.21.15.18:0/1461761848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418003be0 con 0x7ff4080051d0 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 -- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 msgr2=0x7ff40800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 0x7ff40800b9d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff418009fc0 tx=0x7ff41801ccc0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 -- 172.21.15.18:0/1461761848 shutdown_connections 2024-04-25T10:04:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 --2- 172.21.15.18:0/1461761848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4080051d0 0x7ff40800b9d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 -- 172.21.15.18:0/1461761848 >> 172.21.15.18:0/1461761848 conn(0x7ff420067080 msgr2=0x7ff42006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 -- 172.21.15.18:0/1461761848 shutdown_connections 2024-04-25T10:04:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.064+0000 7ff427800640 1 -- 172.21.15.18:0/1461761848 wait complete. 2024-04-25T10:04:54.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 Processor -- start 2024-04-25T10:04:54.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 -- start start 2024-04-25T10:04:54.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4080051d0 0x7ff42013d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4200ad6d0 0x7ff4201576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006e8d0 con 0x7ff420071270 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420159700 con 0x7ff4080051d0 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff427800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42006ea50 con 0x7ff4200ad6d0 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41294/0 (socket says 172.21.15.18:41294) 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 -- 172.21.15.18:0/4002117572 learned_addr learned my addr 172.21.15.18:0/4002117572 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff424e00640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4080051d0 0x7ff42013d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff41fe00640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4200ad6d0 0x7ff4201576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 -- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4200ad6d0 msgr2=0x7ff4201576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4200ad6d0 0x7ff4201576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 -- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4080051d0 msgr2=0x7ff42013d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4080051d0 0x7ff42013d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 -- 172.21.15.18:0/4002117572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420157c30 con 0x7ff420071270 2024-04-25T10:04:54.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff425800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff4180987f0 tx=0x7ff418009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418009c10 con 0x7ff420071270 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180bd070 con 0x7ff420071270 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.068+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180aeec0 con 0x7ff420071270 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4200acc30 con 0x7ff420071270 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4200aced0 con 0x7ff420071270 2024-04-25T10:04:54.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4200745d0 con 0x7ff420071270 2024-04-25T10:04:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff4180039a0 con 0x7ff420071270 2024-04-25T10:04:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff41cc00640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 0x7ff4000695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7ff418120d20 con 0x7ff420071270 2024-04-25T10:04:54.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.072+0000 7ff424e00640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 0x7ff4000695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.076+0000 7ff424e00640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 0x7ff4000695c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff414001060 tx=0x7ff414007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.076+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4180169d0 con 0x7ff420071270 2024-04-25T10:04:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff42006e230 con 0x7ff420071270 2024-04-25T10:04:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff41cc00640 1 -- 172.21.15.18:0/4002117572 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff4180f19c0 con 0x7ff420071270 2024-04-25T10:04:54.246 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:54.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 msgr2=0x7ff4000695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 0x7ff4000695c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff414001060 tx=0x7ff414007900 comp rx=0 tx=0).stop 2024-04-25T10:04:54.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 msgr2=0x7ff420071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff4180987f0 tx=0x7ff418009750 comp rx=0 tx=0).stop 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 shutdown_connections 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff420071270 0x7ff420071700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff400067100 0x7ff4000695c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff4200ad6d0 0x7ff4201576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 --2- 172.21.15.18:0/4002117572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff4080051d0 0x7ff42013d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 >> 172.21.15.18:0/4002117572 conn(0x7ff420067080 msgr2=0x7ff42015e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 shutdown_connections 2024-04-25T10:04:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.236+0000 7ff427800640 1 -- 172.21.15.18:0/4002117572 wait complete. 2024-04-25T10:04:54.267 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:04:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 Processor -- start 2024-04-25T10:04:54.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 -- start start 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 0x7f6ae8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ae8072040 0x7f6ae8161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 0x7f6ae8162130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80b2dc0 con 0x7f6ae8072040 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae8072460 con 0x7f6ae8161cc0 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6aed400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae806ac10 con 0x7f6ae815dd90 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ae8072040 0x7f6ae8161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ae8072040 0x7f6ae8161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41296/0 (socket says 172.21.15.18:41296) 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 -- 172.21.15.18:0/3438759681 learned_addr learned my addr 172.21.15.18:0/3438759681 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6ae6800640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 0x7f6ae8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6ae7200640 1 --2- 172.21.15.18:0/3438759681 >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 0x7f6ae8162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 -- 172.21.15.18:0/3438759681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 msgr2=0x7f6ae8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 0x7f6ae8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 -- 172.21.15.18:0/3438759681 >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 msgr2=0x7f6ae8162130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 --2- 172.21.15.18:0/3438759681 >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 0x7f6ae8162130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6adfe00640 1 -- 172.21.15.18:0/3438759681 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae806aeb0 con 0x7f6ae8072040 2024-04-25T10:04:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6ae7200640 1 --2- 172.21.15.18:0/3438759681 >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 0x7f6ae8162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:54.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.400+0000 7f6ae6800640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 0x7f6ae8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:54.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6adfe00640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae8072040 0x7f6ae8161780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ae809dec0 tx=0x7f6ad001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09f3b39e9583d11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6ae5e00640 1 -- 172.21.15.18:0/3438759681 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00b2070 con 0x7f6ae8072040 2024-04-25T10:04:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6ae5e00640 1 -- 172.21.15.18:0/3438759681 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00a9070 con 0x7f6ae8072040 2024-04-25T10:04:54.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6ae5e00640 1 -- 172.21.15.18:0/3438759681 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00ad880 con 0x7f6ae8072040 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- 172.21.15.18:0/3438759681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae8072040 msgr2=0x7f6ae8161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae8072040 0x7f6ae8161780 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6ae809dec0 tx=0x7f6ad001c490 comp rx=0 tx=0).stop 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- 172.21.15.18:0/3438759681 shutdown_connections 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 --2- 172.21.15.18:0/3438759681 >> v2:172.21.15.167:3300/0 conn(0x7f6ae8161cc0 0x7f6ae8162130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae8072040 0x7f6ae8161780 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 --2- 172.21.15.18:0/3438759681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae815dd90 0x7f6ae8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- 172.21.15.18:0/3438759681 >> 172.21.15.18:0/3438759681 conn(0x7f6ae80cfd90 msgr2=0x7f6ae80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- 172.21.15.18:0/3438759681 shutdown_connections 2024-04-25T10:04:54.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- 172.21.15.18:0/3438759681 wait complete. 2024-04-25T10:04:54.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 Processor -- start 2024-04-25T10:04:54.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.404+0000 7f6aed400640 1 -- start start 2024-04-25T10:04:54.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 0x7f6ae8149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae8161cc0 0x7f6ae8147880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ce620 con 0x7f6ae815dd90 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ce4a0 con 0x7f6ae8072040 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80ce7a0 con 0x7f6ae8161cc0 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41300/0 (socket says 172.21.15.18:41300) 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 -- 172.21.15.18:0/2399128855 learned_addr learned my addr 172.21.15.18:0/2399128855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6ae6800640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 0x7f6ae8149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6ae7200640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae8161cc0 0x7f6ae8147880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 -- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae8161cc0 msgr2=0x7f6ae8147880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae8161cc0 0x7f6ae8147880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 -- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 msgr2=0x7f6ae8149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 0x7f6ae8149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 -- 172.21.15.18:0/2399128855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae8154270 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6ae6800640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 0x7f6ae8149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adfe00640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ad001ab40 tx=0x7f6ad001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00bc020 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00b8420 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00b2040 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae8148ca0 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae8149260 con 0x7f6ae815dd90 2024-04-25T10:04:54.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80745d0 con 0x7f6ae815dd90 2024-04-25T10:04:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.408+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ad00bf020 con 0x7f6ae815dd90 2024-04-25T10:04:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.412+0000 7f6adea00640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 0x7f6ac4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.412+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6ad011f750 con 0x7f6ae815dd90 2024-04-25T10:04:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.412+0000 7f6ae6800640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 0x7f6ac4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.412+0000 7f6ae6800640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 0x7f6ac4069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006fd0 tx=0x7f6ad8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.416+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ad00c6030 con 0x7f6ae815dd90 2024-04-25T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ae8157180 con 0x7f6ae815dd90 2024-04-25T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6adea00640 1 -- 172.21.15.18:0/2399128855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ad0016110 con 0x7f6ae815dd90 2024-04-25T10:04:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:04:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 msgr2=0x7f6ac4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 0x7f6ac4069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8006fd0 tx=0x7f6ad8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 msgr2=0x7f6ae80aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6ad001ab40 tx=0x7f6ad001acd0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 shutdown_connections 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ac4066f60 0x7f6ac4069420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6ae8161cc0 0x7f6ae8147880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ae815dd90 0x7f6ae80aeb20 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 --2- 172.21.15.18:0/2399128855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ae8072040 0x7f6ae8149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 >> 172.21.15.18:0/2399128855 conn(0x7f6ae80cfd90 msgr2=0x7f6ae80d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 shutdown_connections 2024-04-25T10:04:54.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.592+0000 7f6aed400640 1 -- 172.21.15.18:0/2399128855 wait complete. 2024-04-25T10:04:54.623 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T10:04:54.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:54.624 DEBUG:teuthology.orchestra.run.smithi167:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T10:04:54.650 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:04:54.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:04:54.650 DEBUG:teuthology.orchestra.run.smithi167:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T10:04:54.706 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:04:54.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:54.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 Processor -- start 2024-04-25T10:04:54.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 -- start start 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f60780d11b0 0x7f60780afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607815ddf0 con 0x7f607815da10 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607806b480 con 0x7f60780b4210 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607f600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780d06d0 con 0x7f60780d11b0 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f606fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f60780d11b0 0x7f60780afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607cc00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f607815da10 0x7f607806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54742/0 (socket says 172.21.15.18:54742) 2024-04-25T10:04:54.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f607cc00640 1 -- 172.21.15.18:0/2036837312 learned_addr learned my addr 172.21.15.18:0/2036837312 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f606fe00640 1 -- 172.21.15.18:0/2036837312 >> v1:172.21.15.167:6789/0 conn(0x7f60780b4210 legacy=0x7f60780b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f606fe00640 1 -- 172.21.15.18:0/2036837312 >> v1:172.21.15.18:6789/0 conn(0x7f607815da10 legacy=0x7f607806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f6077e00640 1 -- 172.21.15.18:0/2036837312 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795471160 0 0) 0x7f607815ddf0 con 0x7f607815da10 2024-04-25T10:04:54.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.836+0000 7f606fe00640 1 -- 172.21.15.18:0/2036837312 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780d09b0 con 0x7f60780d11b0 2024-04-25T10:04:54.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f606fe00640 1 --2- 172.21.15.18:0/2036837312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60780d11b0 0x7f60780afe20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60600097c0 tx=0x7f606001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a912c59e7a8ff5ef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f6077e00640 1 -- 172.21.15.18:0/2036837312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600b0070 con 0x7f60780d11b0 2024-04-25T10:04:54.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f6077e00640 1 -- 172.21.15.18:0/2036837312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60600ab600 con 0x7f60780d11b0 2024-04-25T10:04:54.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f6077e00640 1 -- 172.21.15.18:0/2036837312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60600ab9d0 con 0x7f60780d11b0 2024-04-25T10:04:54.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 -- 172.21.15.18:0/2036837312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60780d11b0 msgr2=0x7f60780afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 --2- 172.21.15.18:0/2036837312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60780d11b0 0x7f60780afe20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f60600097c0 tx=0x7f606001c3d0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 -- 172.21.15.18:0/2036837312 shutdown_connections 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 --2- 172.21.15.18:0/2036837312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60780d11b0 0x7f60780afe20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 -- 172.21.15.18:0/2036837312 >> 172.21.15.18:0/2036837312 conn(0x7f60780b2400 msgr2=0x7f60780b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 -- 172.21.15.18:0/2036837312 shutdown_connections 2024-04-25T10:04:54.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.840+0000 7f607f600640 1 -- 172.21.15.18:0/2036837312 wait complete. 2024-04-25T10:04:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 Processor -- start 2024-04-25T10:04:54.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- start start 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60780b4210 0x7f607815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60780d11b0 0x7f60780c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607816b900 con 0x7f607815da10 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607816b780 con 0x7f60780b4210 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607816ba80 con 0x7f60780d11b0 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41324/0 (socket says 172.21.15.18:41324) 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 -- 172.21.15.18:0/2417657390 learned_addr learned my addr 172.21.15.18:0/2417657390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607cc00640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60780b4210 0x7f607815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f606fe00640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60780d11b0 0x7f60780c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 -- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60780d11b0 msgr2=0x7f60780c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60780d11b0 0x7f60780c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 -- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60780b4210 msgr2=0x7f607815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60780b4210 0x7f607815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 -- 172.21.15.18:0/2417657390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60780cf520 con 0x7f607815da10 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607d600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f607000c7b0 tx=0x7f607000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6070017070 con 0x7f607815da10 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6070003db0 con 0x7f607815da10 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780cf800 con 0x7f607815da10 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700052b0 con 0x7f607815da10 2024-04-25T10:04:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.844+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607814b6c0 con 0x7f607815da10 2024-04-25T10:04:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780745d0 con 0x7f607815da10 2024-04-25T10:04:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f607001a070 con 0x7f607815da10 2024-04-25T10:04:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f6075600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 0x7f6054069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f6070084a40 con 0x7f607815da10 2024-04-25T10:04:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f607cc00640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 0x7f6054069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.848+0000 7f607cc00640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 0x7f6054069450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6068000f70 tx=0x7f6068007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:54.852+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6070054f60 con 0x7f607815da10 2024-04-25T10:04:55.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.048+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60780b0e80 con 0x7f607815da10 2024-04-25T10:04:55.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.048+0000 7f6075600640 1 -- 172.21.15.18:0/2417657390 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f6070059000 con 0x7f607815da10 2024-04-25T10:04:55.059 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:55.059 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:55.059 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 msgr2=0x7f6054069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 0x7f6054069450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6068000f70 tx=0x7f6068007df0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 msgr2=0x7f60780c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f607000c7b0 tx=0x7f607000cc70 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 shutdown_connections 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607815da10 0x7f60780c9fc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6054066f90 0x7f6054069450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60780d11b0 0x7f60780c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 --2- 172.21.15.18:0/2417657390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60780b4210 0x7f607815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 >> 172.21.15.18:0/2417657390 conn(0x7f60780b2400 msgr2=0x7f60780afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 shutdown_connections 2024-04-25T10:04:55.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.052+0000 7f607f600640 1 -- 172.21.15.18:0/2417657390 wait complete. 2024-04-25T10:04:55.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:55.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.208+0000 7f4c05000640 1 Processor -- start 2024-04-25T10:04:55.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.208+0000 7f4c05000640 1 -- start start 2024-04-25T10:04:55.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4c05000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 0x7f4c000b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4c05000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c000b08a0 0x7f4c0006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4c05000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c0015b240 con 0x7f4c000cee30 2024-04-25T10:04:55.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4c05000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c000b1e20 con 0x7f4c000b08a0 2024-04-25T10:04:55.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4c05000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000ce350 con 0x7f4c0006e980 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c000b08a0 0x7f4c0006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 0x7f4c000b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bf7e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4c000cee30 0x7f4c000b0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42850/0 (socket says 172.21.15.18:42850) 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bf7e00640 1 -- 172.21.15.18:0/1884626072 learned_addr learned my addr 172.21.15.18:0/1884626072 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4c000b08a0 0x7f4c0006d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44636/0 (socket says 172.21.15.18:44636) 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 0x7f4c000b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:53074/0 (socket says 172.21.15.18:53074) 2024-04-25T10:04:55.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 -- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 msgr2=0x7f4c000b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 --2- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 0x7f4c000b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 -- 172.21.15.18:0/1884626072 >> v1:172.21.15.167:6789/0 conn(0x7f4c000cee30 legacy=0x7f4c000b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.212+0000 7f4bfe800640 1 -- 172.21.15.18:0/1884626072 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000ce630 con 0x7f4c000b08a0 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4bfe800640 1 --2- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000b08a0 0x7f4c0006d2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf801c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0c014b8a23685d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4bfd400640 1 -- 172.21.15.18:0/1884626072 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80b2070 con 0x7f4c000b08a0 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4bfd400640 1 -- 172.21.15.18:0/1884626072 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf80a5770 con 0x7f4c000b08a0 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4bfd400640 1 -- 172.21.15.18:0/1884626072 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80a5b40 con 0x7f4c000b08a0 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000b08a0 msgr2=0x7f4c0006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 --2- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000b08a0 0x7f4c0006d2b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8009d90 tx=0x7f4bf801c8b0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- 172.21.15.18:0/1884626072 shutdown_connections 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 --2- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c000b08a0 0x7f4c0006d2b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 --2- 172.21.15.18:0/1884626072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c0006e980 0x7f4c000b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- 172.21.15.18:0/1884626072 >> 172.21.15.18:0/1884626072 conn(0x7f4c00066fa0 msgr2=0x7f4c0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- 172.21.15.18:0/1884626072 shutdown_connections 2024-04-25T10:04:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- 172.21.15.18:0/1884626072 wait complete. 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 Processor -- start 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.216+0000 7f4c05000640 1 -- start start 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 0x7f4c001f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000cee30 0x7f4c001490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0015afe0 con 0x7f4c000b08a0 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0015ae60 con 0x7f4c0006e980 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c000cdf70 con 0x7f4c000cee30 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bfde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 0x7f4c001f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bfde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44644/0 (socket says 172.21.15.18:44644) 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bfde00640 1 -- 172.21.15.18:0/2327665954 learned_addr learned my addr 172.21.15.18:0/2327665954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bfe800640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000cee30 0x7f4c001490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 -- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000cee30 msgr2=0x7f4c001490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000cee30 0x7f4c001490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 -- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 msgr2=0x7f4c0014b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 -- 172.21.15.18:0/2327665954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c001f9420 con 0x7f4c000b08a0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bfde00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf7e00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 0x7f4c001f8a60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c3c0 tx=0x7f4be800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be8017070 con 0x7f4c000b08a0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be8005cf0 con 0x7f4c000b08a0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be80072f0 con 0x7f4c000b08a0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c001f9700 con 0x7f4c000b08a0 2024-04-25T10:04:55.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c00155bc0 con 0x7f4c000b08a0 2024-04-25T10:04:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.220+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c000745d0 con 0x7f4c000b08a0 2024-04-25T10:04:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.224+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4be801a070 con 0x7f4c000b08a0 2024-04-25T10:04:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.224+0000 7f4bf6000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 0x7f4bdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.224+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4be8084690 con 0x7f4c000b08a0 2024-04-25T10:04:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.224+0000 7f4bfde00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 0x7f4bdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.224+0000 7f4bfde00640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 0x7f4bdc069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c00150650 tx=0x7f4bf0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.228+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4be8054c40 con 0x7f4c000b08a0 2024-04-25T10:04:55.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c000b1fc0 con 0x7f4c000b08a0 2024-04-25T10:04:55.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4bf6000640 1 -- 172.21.15.18:0/2327665954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f4be8058ce0 con 0x7f4c000b08a0 2024-04-25T10:04:55.402 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:55.402 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 msgr2=0x7f4bdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 0x7f4bdc069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4c00150650 tx=0x7f4bf0009190 comp rx=0 tx=0).stop 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 msgr2=0x7f4c001f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 0x7f4c001f8a60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4be800c3c0 tx=0x7f4be800c880 comp rx=0 tx=0).stop 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 shutdown_connections 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4bdc066f60 0x7f4bdc069420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c000cee30 0x7f4c001490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c000b08a0 0x7f4c001f8a60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 --2- 172.21.15.18:0/2327665954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c0006e980 0x7f4c0014b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 >> 172.21.15.18:0/2327665954 conn(0x7f4c00066fa0 msgr2=0x7f4c000b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 shutdown_connections 2024-04-25T10:04:55.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.392+0000 7f4c05000640 1 -- 172.21.15.18:0/2327665954 wait complete. 2024-04-25T10:04:55.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:03:54.200629+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:03:55.138581+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T10:03:58.815069+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T10:04:55.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:04:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.556+0000 7fde73e00640 1 Processor -- start 2024-04-25T10:04:55.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.556+0000 7fde73e00640 1 -- start start 2024-04-25T10:04:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde73e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde6c15dad0 0x7fde6c070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde73e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6c15deb0 con 0x7fde6c0711d0 2024-04-25T10:04:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde73e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6c071670 con 0x7fde6c0b58b0 2024-04-25T10:04:55.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde73e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6c0ce4f0 con 0x7fde6c15dad0 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde71400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde6c15dad0 0x7fde6c070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde70a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fde6c0711d0 0x7fde6c0b51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54752/0 (socket says 172.21.15.18:54752) 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde70a00640 1 -- 172.21.15.18:0/3922350148 learned_addr learned my addr 172.21.15.18:0/3922350148 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde71400640 1 -- 172.21.15.18:0/3922350148 >> v1:172.21.15.167:6789/0 conn(0x7fde6c0b58b0 legacy=0x7fde6c06cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde71400640 1 -- 172.21.15.18:0/3922350148 >> v1:172.21.15.18:6789/0 conn(0x7fde6c0711d0 legacy=0x7fde6c0b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde71400640 1 -- 172.21.15.18:0/3922350148 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c06bdc0 con 0x7fde6c15dad0 2024-04-25T10:04:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.560+0000 7fde6be00640 1 -- 172.21.15.18:0/3922350148 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813575610 0 0) 0x7fde6c15deb0 con 0x7fde6c0711d0 2024-04-25T10:04:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde71400640 1 --2- 172.21.15.18:0/3922350148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c15dad0 0x7fde6c070c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde600097c0 tx=0x7fde6001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6371256724da3305 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde6be00640 1 -- 172.21.15.18:0/3922350148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde600b0070 con 0x7fde6c15dad0 2024-04-25T10:04:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde6be00640 1 -- 172.21.15.18:0/3922350148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde60004230 con 0x7fde6c15dad0 2024-04-25T10:04:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde6be00640 1 -- 172.21.15.18:0/3922350148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde60003620 con 0x7fde6c15dad0 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- 172.21.15.18:0/3922350148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c15dad0 msgr2=0x7fde6c070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 --2- 172.21.15.18:0/3922350148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c15dad0 0x7fde6c070c90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde600097c0 tx=0x7fde6001c460 comp rx=0 tx=0).stop 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- 172.21.15.18:0/3922350148 shutdown_connections 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 --2- 172.21.15.18:0/3922350148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c15dad0 0x7fde6c070c90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- 172.21.15.18:0/3922350148 >> 172.21.15.18:0/3922350148 conn(0x7fde6c06f510 msgr2=0x7fde6c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- 172.21.15.18:0/3922350148 shutdown_connections 2024-04-25T10:04:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- 172.21.15.18:0/3922350148 wait complete. 2024-04-25T10:04:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 Processor -- start 2024-04-25T10:04:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- start start 2024-04-25T10:04:55.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 0x7fde6c160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde6c15dad0 0x7fde6c0cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c06dc20 con 0x7fde6c0b58b0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c06daa0 con 0x7fde6c0711d0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.564+0000 7fde73e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6c151380 con 0x7fde6c15dad0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41350/0 (socket says 172.21.15.18:41350) 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 -- 172.21.15.18:0/2687771449 learned_addr learned my addr 172.21.15.18:0/2687771449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde71400640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 0x7fde6c160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde71e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde6c15dad0 0x7fde6c0cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 -- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde6c15dad0 msgr2=0x7fde6c0cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde6c15dad0 0x7fde6c0cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 -- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 msgr2=0x7fde6c160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 0x7fde6c160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 -- 172.21.15.18:0/2687771449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c0cd7d0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde71400640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 0x7fde6c160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde70a00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde580011f0 tx=0x7fde5800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58018070 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde580074e0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6c0cd4f0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde58004a10 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6c0cb170 con 0x7fde6c0b58b0 2024-04-25T10:04:55.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6c0745d0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde5801b070 con 0x7fde6c0b58b0 2024-04-25T10:04:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 0x7fde4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.568+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fde58084830 con 0x7fde6c0b58b0 2024-04-25T10:04:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.572+0000 7fde71400640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 0x7fde4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.572+0000 7fde71400640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 0x7fde4c069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fde600ad000 tx=0x7fde60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.572+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde580553a0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.736+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde6c0ce6a0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.736+0000 7fde69600640 1 -- 172.21.15.18:0/2687771449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde58054ca0 con 0x7fde6c0b58b0 2024-04-25T10:04:55.748 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 msgr2=0x7fde4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 0x7fde4c069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fde600ad000 tx=0x7fde60008040 comp rx=0 tx=0).stop 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 msgr2=0x7fde6c0b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde580011f0 tx=0x7fde5800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 shutdown_connections 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde4c066f60 0x7fde4c069420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde6c15dad0 0x7fde6c0cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde6c0b58b0 0x7fde6c0b28c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 --2- 172.21.15.18:0/2687771449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde6c0711d0 0x7fde6c160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 >> 172.21.15.18:0/2687771449 conn(0x7fde6c06f510 msgr2=0x7fde6c0d1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 shutdown_connections 2024-04-25T10:04:55.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.740+0000 7fde73e00640 1 -- 172.21.15.18:0/2687771449 wait complete. 2024-04-25T10:04:55.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:04:55.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.900+0000 7f38ab000640 1 Processor -- start 2024-04-25T10:04:55.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.900+0000 7f38ab000640 1 -- start start 2024-04-25T10:04:55.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38ab000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a415acd0 0x7f38a415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38ab000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38a415ee60 0x7f38a40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38ab000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a415bc40 con 0x7f38a4144120 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38ab000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a415e490 con 0x7f38a415acd0 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38ab000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a415b150 con 0x7f38a415ee60 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a415acd0 0x7f38a415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38a415acd0 0x7f38a415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41358/0 (socket says 172.21.15.18:41358) 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 -- 172.21.15.18:0/966654030 learned_addr learned my addr 172.21.15.18:0/966654030 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:55.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f38a9000640 1 --2- 172.21.15.18:0/966654030 >> v2:172.21.15.167:3300/0 conn(0x7f38a415ee60 0x7f38a40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 -- 172.21.15.18:0/966654030 >> v2:172.21.15.167:3300/0 conn(0x7f38a415ee60 msgr2=0x7f38a40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:55.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 --2- 172.21.15.18:0/966654030 >> v2:172.21.15.167:3300/0 conn(0x7f38a415ee60 0x7f38a40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 -- 172.21.15.18:0/966654030 >> v1:172.21.15.167:6789/0 conn(0x7f38a4144120 legacy=0x7f38a40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.904+0000 7f389be00640 1 -- 172.21.15.18:0/966654030 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a415b3a0 con 0x7f38a415acd0 2024-04-25T10:04:55.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f389be00640 1 --2- 172.21.15.18:0/966654030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a415acd0 0x7f38a415e920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38a406bb20 tx=0x7f388c01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b33372e1248a82 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38a3400640 1 -- 172.21.15.18:0/966654030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0b4070 con 0x7f38a415acd0 2024-04-25T10:04:55.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38a3400640 1 -- 172.21.15.18:0/966654030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f388c0a7b40 con 0x7f38a415acd0 2024-04-25T10:04:55.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38a3400640 1 -- 172.21.15.18:0/966654030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f388c0af440 con 0x7f38a415acd0 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- 172.21.15.18:0/966654030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a415acd0 msgr2=0x7f38a415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 --2- 172.21.15.18:0/966654030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a415acd0 0x7f38a415e920 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f38a406bb20 tx=0x7f388c01eb60 comp rx=0 tx=0).stop 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- 172.21.15.18:0/966654030 shutdown_connections 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 --2- 172.21.15.18:0/966654030 >> v2:172.21.15.167:3300/0 conn(0x7f38a415ee60 0x7f38a40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 --2- 172.21.15.18:0/966654030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a415acd0 0x7f38a415e920 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- 172.21.15.18:0/966654030 >> 172.21.15.18:0/966654030 conn(0x7f38a4067080 msgr2=0x7f38a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- 172.21.15.18:0/966654030 shutdown_connections 2024-04-25T10:04:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- 172.21.15.18:0/966654030 wait complete. 2024-04-25T10:04:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 Processor -- start 2024-04-25T10:04:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.908+0000 7f38ab000640 1 -- start start 2024-04-25T10:04:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a415acd0 0x7f38a41637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a415ee60 0x7f38a4163d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406de70 con 0x7f38a4144120 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406dcf0 con 0x7f38a415acd0 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406dff0 con 0x7f38a415ee60 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41370/0 (socket says 172.21.15.18:41370) 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 -- 172.21.15.18:0/500844932 learned_addr learned my addr 172.21.15.18:0/500844932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f389be00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a415acd0 0x7f38a41637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a9000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a415ee60 0x7f38a4163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 -- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a415ee60 msgr2=0x7f38a4163d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a415ee60 0x7f38a4163d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 -- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a415acd0 msgr2=0x7f38a41637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a415acd0 0x7f38a41637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 -- 172.21.15.18:0/500844932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40afeb0 con 0x7f38a4144120 2024-04-25T10:04:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a3e00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f389400c420 tx=0x7f389400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38940052d0 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894005470 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894007260 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a40b0190 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a40b0750 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40745d0 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.912+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3894007400 con 0x7f38a4144120 2024-04-25T10:04:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.916+0000 7f38a0c00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 0x7f3880069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:55.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.916+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f3894084920 con 0x7f38a4144120 2024-04-25T10:04:55.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.916+0000 7f389be00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 0x7f3880069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:55.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.916+0000 7f389be00640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 0x7f3880069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f388c0b1000 tx=0x7f388c0a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:55.920+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3894054e40 con 0x7f38a4144120 2024-04-25T10:04:56.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38a4141730 con 0x7f38a4144120 2024-04-25T10:04:56.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38a0c00640 1 -- 172.21.15.18:0/500844932 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3894058ee0 con 0x7f38a4144120 2024-04-25T10:04:56.091 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:56.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 msgr2=0x7f3880069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 0x7f3880069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f388c0b1000 tx=0x7f388c0a9070 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 msgr2=0x7f38a415a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f389400c420 tx=0x7f389400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 shutdown_connections 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3880066f60 0x7f3880069420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38a415ee60 0x7f38a4163d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38a415acd0 0x7f38a41637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 --2- 172.21.15.18:0/500844932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38a4144120 0x7f38a415a2f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 >> 172.21.15.18:0/500844932 conn(0x7f38a4067080 msgr2=0x7f38a40b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 shutdown_connections 2024-04-25T10:04:56.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.080+0000 7f38ab000640 1 -- 172.21.15.18:0/500844932 wait complete. 2024-04-25T10:04:56.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:04:56.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 Processor -- start 2024-04-25T10:04:56.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 -- start start 2024-04-25T10:04:56.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c40c72a0 0x7fd5c40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c40b30d0 con 0x7fd5c40d0150 2024-04-25T10:04:56.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c40cd860 con 0x7fd5c40c72a0 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5cb600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40ccf30 con 0x7fd5c415dc00 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c40c72a0 0x7fd5c40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c40c72a0 0x7fd5c40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41374/0 (socket says 172.21.15.18:41374) 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 -- 172.21.15.18:0/2089299207 learned_addr learned my addr 172.21.15.18:0/2089299207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c8c00640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 -- 172.21.15.18:0/2089299207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 msgr2=0x7fd5c40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c40af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 -- 172.21.15.18:0/2089299207 >> v1:172.21.15.167:6789/0 conn(0x7fd5c40d0150 legacy=0x7fd5c40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.244+0000 7fd5c9600640 1 -- 172.21.15.18:0/2089299207 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40cd210 con 0x7fd5c40c72a0 2024-04-25T10:04:56.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5c9600640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40c72a0 0x7fd5c40c54b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009e80 tx=0x7fd5bc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca1d86558853f55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5c3400640 1 -- 172.21.15.18:0/2089299207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ac070 con 0x7fd5c40c72a0 2024-04-25T10:04:56.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5c3400640 1 -- 172.21.15.18:0/2089299207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0a8400 con 0x7fd5c40c72a0 2024-04-25T10:04:56.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5c3400640 1 -- 172.21.15.18:0/2089299207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0a87d0 con 0x7fd5c40c72a0 2024-04-25T10:04:56.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 -- 172.21.15.18:0/2089299207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40c72a0 msgr2=0x7fd5c40c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40c72a0 0x7fd5c40c54b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009e80 tx=0x7fd5bc01c9d0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 -- 172.21.15.18:0/2089299207 shutdown_connections 2024-04-25T10:04:56.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40c72a0 0x7fd5c40c54b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 --2- 172.21.15.18:0/2089299207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 -- 172.21.15.18:0/2089299207 >> 172.21.15.18:0/2089299207 conn(0x7fd5c40b2240 msgr2=0x7fd5c40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 -- 172.21.15.18:0/2089299207 shutdown_connections 2024-04-25T10:04:56.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.248+0000 7fd5cb600640 1 -- 172.21.15.18:0/2089299207 wait complete. 2024-04-25T10:04:56.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 Processor -- start 2024-04-25T10:04:56.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- start start 2024-04-25T10:04:56.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c40c72a0 0x7fd5c413a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c416a640 con 0x7fd5c40d0150 2024-04-25T10:04:56.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c40cdee0 con 0x7fd5c40c72a0 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c416a7c0 con 0x7fd5c415dc00 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41388/0 (socket says 172.21.15.18:41388) 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 -- 172.21.15.18:0/4103861019 learned_addr learned my addr 172.21.15.18:0/4103861019 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c9600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c8c00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c40c72a0 0x7fd5c413a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 -- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 msgr2=0x7fd5c4151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c4151490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 -- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c40c72a0 msgr2=0x7fd5c413a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c40c72a0 0x7fd5c413a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 -- 172.21.15.18:0/4103861019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c414e250 con 0x7fd5c40d0150 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c3e00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000c450 tx=0x7fd5b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0012830 con 0x7fd5c40d0150 2024-04-25T10:04:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b0017070 con 0x7fd5c40d0150 2024-04-25T10:04:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b0012c30 con 0x7fd5c40d0150 2024-04-25T10:04:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c414e530 con 0x7fd5c40d0150 2024-04-25T10:04:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.252+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c414eaf0 con 0x7fd5c40d0150 2024-04-25T10:04:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c40745d0 con 0x7fd5c40d0150 2024-04-25T10:04:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd5b001c460 con 0x7fd5c40d0150 2024-04-25T10:04:56.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5c0c00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 0x7fd5a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fd5b0085060 con 0x7fd5c40d0150 2024-04-25T10:04:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5c8c00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 0x7fd5a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.256+0000 7fd5c8c00640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 0x7fd5a4069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80079c0 tx=0x7fd5b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.260+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd5b0055610 con 0x7fd5c40d0150 2024-04-25T10:04:56.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5c414ecc0 con 0x7fd5c40d0150 2024-04-25T10:04:56.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5c0c00640 1 -- 172.21.15.18:0/4103861019 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5b00596b0 con 0x7fd5c40d0150 2024-04-25T10:04:56.434 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 msgr2=0x7fd5a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 0x7fd5a4069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80079c0 tx=0x7fd5b8008040 comp rx=0 tx=0).stop 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 msgr2=0x7fd5c4150f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000c450 tx=0x7fd5b000c910 comp rx=0 tx=0).stop 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 shutdown_connections 2024-04-25T10:04:56.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5a4066f60 0x7fd5a4069420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5c415dc00 0x7fd5c4151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c40d0150 0x7fd5c4150f50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 --2- 172.21.15.18:0/4103861019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c40c72a0 0x7fd5c413a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 >> 172.21.15.18:0/4103861019 conn(0x7fd5c40b2240 msgr2=0x7fd5c40c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 shutdown_connections 2024-04-25T10:04:56.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.424+0000 7fd5cb600640 1 -- 172.21.15.18:0/4103861019 wait complete. 2024-04-25T10:04:56.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T10:04:56.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 Processor -- start 2024-04-25T10:04:56.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 -- start start 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 0x7fbf9415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9415f440 0x7fbf9406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf9415fc00 con 0x7fbf9406e010 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf9406d640 con 0x7fbf9415f440 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf9be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9415fee0 con 0x7fbf94159320 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf98a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9415f440 0x7fbf9406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf98a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf9415f440 0x7fbf9406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41402/0 (socket says 172.21.15.18:41402) 2024-04-25T10:04:56.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.588+0000 7fbf98a00640 1 -- 172.21.15.18:0/3230691014 learned_addr learned my addr 172.21.15.18:0/3230691014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:56.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf98a00640 1 -- 172.21.15.18:0/3230691014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 msgr2=0x7fbf9415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf99400640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 0x7fbf9415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf98a00640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 0x7fbf9415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf98a00640 1 -- 172.21.15.18:0/3230691014 >> v1:172.21.15.167:6789/0 conn(0x7fbf9406e010 legacy=0x7fbf9406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf98a00640 1 -- 172.21.15.18:0/3230691014 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf941601c0 con 0x7fbf9415f440 2024-04-25T10:04:56.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf99400640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 0x7fbf9415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:04:56.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf98a00640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf9406dad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009870 tx=0x7fbf8001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4dd7dbaff7bf4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf93e00640 1 -- 172.21.15.18:0/3230691014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800ab640 con 0x7fbf9415f440 2024-04-25T10:04:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf93e00640 1 -- 172.21.15.18:0/3230691014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800b0070 con 0x7fbf9415f440 2024-04-25T10:04:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf93e00640 1 -- 172.21.15.18:0/3230691014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800aba00 con 0x7fbf9415f440 2024-04-25T10:04:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf9be00640 1 -- 172.21.15.18:0/3230691014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 msgr2=0x7fbf9406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.592+0000 7fbf9be00640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf9406dad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009870 tx=0x7fbf8001c460 comp rx=0 tx=0).stop 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- 172.21.15.18:0/3230691014 shutdown_connections 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf9406dad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 --2- 172.21.15.18:0/3230691014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf94159320 0x7fbf9415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- 172.21.15.18:0/3230691014 >> 172.21.15.18:0/3230691014 conn(0x7fbf94067080 msgr2=0x7fbf9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- 172.21.15.18:0/3230691014 shutdown_connections 2024-04-25T10:04:56.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- 172.21.15.18:0/3230691014 wait complete. 2024-04-25T10:04:56.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 Processor -- start 2024-04-25T10:04:56.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- start start 2024-04-25T10:04:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 0x7fbf9413f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 0x7fbf9413fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94071c00 con 0x7fbf9415f440 2024-04-25T10:04:56.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf94071a80 con 0x7fbf94159320 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf9406ebb0 con 0x7fbf9406e010 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41416/0 (socket says 172.21.15.18:41416) 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 -- 172.21.15.18:0/2602726073 learned_addr learned my addr 172.21.15.18:0/2602726073 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99400640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 0x7fbf9413f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf98a00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 0x7fbf9413fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 -- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 msgr2=0x7fbf9413f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 0x7fbf9413f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 -- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 msgr2=0x7fbf9413fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 0x7fbf9413fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 -- 172.21.15.18:0/2602726073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9413f880 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf98a00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 0x7fbf9413fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99400640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 0x7fbf9413f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf99e00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c780 tx=0x7fbf8c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c016020 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8c00aa90 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8c00ce30 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.596+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf9415aa00 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf94140280 con 0x7fbf9415f440 2024-04-25T10:04:56.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf940745d0 con 0x7fbf9415f440 2024-04-25T10:04:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf8c019020 con 0x7fbf9415f440 2024-04-25T10:04:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf91600640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 0x7fbf74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fbf8c0857b0 con 0x7fbf9415f440 2024-04-25T10:04:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.600+0000 7fbf99400640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 0x7fbf74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.604+0000 7fbf99400640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 0x7fbf74069420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006fd0 tx=0x7fbf88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.604+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf8c020020 con 0x7fbf9415f440 2024-04-25T10:04:56.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.764+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbf940ae530 con 0x7fbf9415f440 2024-04-25T10:04:56.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.764+0000 7fbf91600640 1 -- 172.21.15.18:0/2602726073 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbf8c056320 con 0x7fbf9415f440 2024-04-25T10:04:56.775 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 msgr2=0x7fbf74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 0x7fbf74069420 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbf88006fd0 tx=0x7fbf88008040 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 msgr2=0x7fbf94140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c00c780 tx=0x7fbf8c00cc40 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 shutdown_connections 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf9415f440 0x7fbf94140d00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf94159320 0x7fbf9413fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf74066f60 0x7fbf74069420 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 --2- 172.21.15.18:0/2602726073 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf9406e010 0x7fbf9413f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 >> 172.21.15.18:0/2602726073 conn(0x7fbf94067080 msgr2=0x7fbf94144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 shutdown_connections 2024-04-25T10:04:56.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.768+0000 7fbf9be00640 1 -- 172.21.15.18:0/2602726073 wait complete. 2024-04-25T10:04:56.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 Processor -- start 2024-04-25T10:04:56.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 -- start start 2024-04-25T10:04:56.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500d11b0 0x7f4c500afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4c500b4210 0x7f4c500b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5015ddf0 con 0x7f4c5015da10 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500b4bc0 con 0x7f4c500b4210 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c57e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5006b480 con 0x7f4c500d11b0 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4c5015da10 0x7f4c5006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54760/0 (socket says 172.21.15.18:54760) 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55400640 1 -- 172.21.15.18:0/3803965478 learned_addr learned my addr 172.21.15.18:0/3803965478 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3803965478 >> v2:172.21.15.18:3300/0 conn(0x7f4c500b4210 0x7f4c500b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c54a00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500d11b0 0x7f4c500afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c4fe00640 1 -- 172.21.15.18:0/3803965478 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211961118 0 0) 0x7f4c5015ddf0 con 0x7f4c5015da10 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c4fe00640 1 -- 172.21.15.18:0/3803965478 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c38003530 con 0x7f4c5015da10 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55e00640 1 -- 172.21.15.18:0/3803965478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500d11b0 msgr2=0x7f4c500afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500d11b0 0x7f4c500afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55e00640 1 -- 172.21.15.18:0/3803965478 >> v1:172.21.15.18:6789/0 conn(0x7f4c5015da10 legacy=0x7f4c5006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.932+0000 7f4c55e00640 1 -- 172.21.15.18:0/3803965478 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500d06d0 con 0x7f4c500b4210 2024-04-25T10:04:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c500b4210 0x7f4c500b4680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009d90 tx=0x7f4c4801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffbe86fe6c65916 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c4fe00640 1 -- 172.21.15.18:0/3803965478 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b2070 con 0x7f4c500b4210 2024-04-25T10:04:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c4fe00640 1 -- 172.21.15.18:0/3803965478 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480a5890 con 0x7f4c500b4210 2024-04-25T10:04:56.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c4fe00640 1 -- 172.21.15.18:0/3803965478 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480a5c40 con 0x7f4c500b4210 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- 172.21.15.18:0/3803965478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c500b4210 msgr2=0x7f4c500b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c500b4210 0x7f4c500b4680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4c48009d90 tx=0x7f4c4801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- 172.21.15.18:0/3803965478 shutdown_connections 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c500b4210 0x7f4c500b4680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3803965478 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500d11b0 0x7f4c500afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- 172.21.15.18:0/3803965478 >> 172.21.15.18:0/3803965478 conn(0x7f4c500b2400 msgr2=0x7f4c500b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- 172.21.15.18:0/3803965478 shutdown_connections 2024-04-25T10:04:56.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- 172.21.15.18:0/3803965478 wait complete. 2024-04-25T10:04:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 Processor -- start 2024-04-25T10:04:56.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.936+0000 7f4c57e00640 1 -- start start 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 0x7f4c5014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c500d11b0 0x7f4c5015f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50162150 con 0x7f4c5015da10 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c50161fd0 con 0x7f4c500d11b0 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c501622d0 con 0x7f4c500b4210 2024-04-25T10:04:56.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41440/0 (socket says 172.21.15.18:41440) 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 -- 172.21.15.18:0/3149457532 learned_addr learned my addr 172.21.15.18:0/3149457532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55400640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 0x7f4c5014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c54a00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c500d11b0 0x7f4c5015f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 -- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 msgr2=0x7f4c5014f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 0x7f4c5014f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 -- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c500d11b0 msgr2=0x7f4c5015f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c500d11b0 0x7f4c5015f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 -- 172.21.15.18:0/3149457532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c50151060 con 0x7f4c5015da10 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55400640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 0x7f4c5014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:56.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c55e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801af90 tx=0x7f4c48019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480b2050 con 0x7f4c5015da10 2024-04-25T10:04:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480be070 con 0x7f4c5015da10 2024-04-25T10:04:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480ad870 con 0x7f4c5015da10 2024-04-25T10:04:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c50150aa0 con 0x7f4c5015da10 2024-04-25T10:04:56.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c50151d00 con 0x7f4c5015da10 2024-04-25T10:04:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.940+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c500745d0 con 0x7f4c5015da10 2024-04-25T10:04:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.944+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4c480ada10 con 0x7f4c5015da10 2024-04-25T10:04:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.944+0000 7f4c4d600640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 0x7f4c30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.944+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f4c481204e0 con 0x7f4c5015da10 2024-04-25T10:04:56.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.944+0000 7f4c55400640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 0x7f4c30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:56.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.944+0000 7f4c55400640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 0x7f4c30069420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c44005890 tx=0x7f4c44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:56.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:56.948+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c48016560 con 0x7f4c5015da10 2024-04-25T10:04:57.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.144+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c500b2ac0 con 0x7f4c5015da10 2024-04-25T10:04:57.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.144+0000 7f4c4d600640 1 -- 172.21.15.18:0/3149457532 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f4c480add00 con 0x7f4c5015da10 2024-04-25T10:04:57.156 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:57.156 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:57.156 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 msgr2=0x7f4c30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 0x7f4c30069420 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4c44005890 tx=0x7f4c44009040 comp rx=0 tx=0).stop 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 msgr2=0x7f4c50159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c4801af90 tx=0x7f4c48019680 comp rx=0 tx=0).stop 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 shutdown_connections 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c5015da10 0x7f4c50159a90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c500d11b0 0x7f4c5015f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4c30066f60 0x7f4c30069420 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 --2- 172.21.15.18:0/3149457532 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4c500b4210 0x7f4c5014f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 >> 172.21.15.18:0/3149457532 conn(0x7f4c500b2400 msgr2=0x7f4c5015c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 shutdown_connections 2024-04-25T10:04:57.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.148+0000 7f4c57e00640 1 -- 172.21.15.18:0/3149457532 wait complete. 2024-04-25T10:04:57.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.308+0000 7f7323a00640 1 Processor -- start 2024-04-25T10:04:57.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.308+0000 7f7323a00640 1 -- start start 2024-04-25T10:04:57.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7323a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f731c15da10 0x7f731c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7323a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7323a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f731c15ddf0 con 0x7f731c0b4210 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7323a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731c06b480 con 0x7f731c15da10 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7323a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c0d06d0 con 0x7f731c0d11b0 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f731c0b4210 0x7f731c06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54774/0 (socket says 172.21.15.18:54774) 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321a00640 1 -- 172.21.15.18:0/40356669 learned_addr learned my addr 172.21.15.18:0/40356669 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f731c15da10 0x7f731c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7313e00640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f731be00640 1 -- 172.21.15.18:0/40356669 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493232791 0 0) 0x7f731c15ddf0 con 0x7f731c0b4210 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321000640 1 -- 172.21.15.18:0/40356669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 msgr2=0x7f731c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321000640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321000640 1 -- 172.21.15.18:0/40356669 >> v1:172.21.15.18:6789/0 conn(0x7f731c0b4210 legacy=0x7f731c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7321000640 1 -- 172.21.15.18:0/40356669 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0d09b0 con 0x7f731c15da10 2024-04-25T10:04:57.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.312+0000 7f7313e00640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7321000640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c0afe20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097c0 tx=0x7f730c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d90d8183a7316b4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f731be00640 1 -- 172.21.15.18:0/40356669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0b0070 con 0x7f731c15da10 2024-04-25T10:04:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f731be00640 1 -- 172.21.15.18:0/40356669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730c0ab600 con 0x7f731c15da10 2024-04-25T10:04:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f731be00640 1 -- 172.21.15.18:0/40356669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730c0ab9d0 con 0x7f731c15da10 2024-04-25T10:04:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- 172.21.15.18:0/40356669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 msgr2=0x7f731c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c0afe20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f730c0097c0 tx=0x7f730c01c410 comp rx=0 tx=0).stop 2024-04-25T10:04:57.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- 172.21.15.18:0/40356669 shutdown_connections 2024-04-25T10:04:57.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 --2- 172.21.15.18:0/40356669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c0afe20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- 172.21.15.18:0/40356669 >> 172.21.15.18:0/40356669 conn(0x7f731c0b2400 msgr2=0x7f731c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- 172.21.15.18:0/40356669 shutdown_connections 2024-04-25T10:04:57.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- 172.21.15.18:0/40356669 wait complete. 2024-04-25T10:04:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 Processor -- start 2024-04-25T10:04:57.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.316+0000 7f7323a00640 1 -- start start 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731c0b4210 0x7f731c14fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c16aad0 con 0x7f731c15da10 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731c16a950 con 0x7f731c0b4210 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f731c16ac50 con 0x7f731c0d11b0 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41448/0 (socket says 172.21.15.18:41448) 2024-04-25T10:04:57.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 -- 172.21.15.18:0/2275461053 learned_addr learned my addr 172.21.15.18:0/2275461053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321000640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731c0b4210 0x7f731c14fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7313e00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 -- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 msgr2=0x7f731c15ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c15ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 -- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731c0b4210 msgr2=0x7f731c14fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731c0b4210 0x7f731c14fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 -- 172.21.15.18:0/2275461053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c0afbc0 con 0x7f731c15da10 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7321a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f731400c700 tx=0x7f731400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314018070 con 0x7f731c15da10 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731400ce10 con 0x7f731c15da10 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731400a860 con 0x7f731c15da10 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f731c15f1d0 con 0x7f731c15da10 2024-04-25T10:04:57.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f731c15f790 con 0x7f731c15da10 2024-04-25T10:04:57.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731c0745d0 con 0x7f731c15da10 2024-04-25T10:04:57.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.320+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f731401b070 con 0x7f731c15da10 2024-04-25T10:04:57.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.324+0000 7f7319600640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 0x7f72f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.324+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f7314084840 con 0x7f731c15da10 2024-04-25T10:04:57.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.324+0000 7f7321000640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 0x7f72f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.324+0000 7f7321000640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 0x7f72f8069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f730c0ad000 tx=0x7f730c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.328+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7314054e90 con 0x7f731c15da10 2024-04-25T10:04:57.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f731c0afd90 con 0x7f731c15da10 2024-04-25T10:04:57.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7319600640 1 -- 172.21.15.18:0/2275461053 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f7314058f30 con 0x7f731c15da10 2024-04-25T10:04:57.502 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:57.502 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 msgr2=0x7f72f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 0x7f72f8069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f730c0ad000 tx=0x7f730c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 msgr2=0x7f731c14b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f731400c700 tx=0x7f731400cbc0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 shutdown_connections 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f731c15da10 0x7f731c14b820 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72f8066f60 0x7f72f8069420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f731c0d11b0 0x7f731c15ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 --2- 172.21.15.18:0/2275461053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f731c0b4210 0x7f731c14fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 >> 172.21.15.18:0/2275461053 conn(0x7f731c0b2400 msgr2=0x7f731c0cded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 shutdown_connections 2024-04-25T10:04:57.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.492+0000 7f7323a00640 1 -- 172.21.15.18:0/2275461053 wait complete. 2024-04-25T10:04:57.523 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:04:57.524 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:57.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 Processor -- start 2024-04-25T10:04:57.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 -- start start 2024-04-25T10:04:57.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f235c144140 0x7f235c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c15ac60 con 0x7f235c0ced60 2024-04-25T10:04:57.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0cf3e0 con 0x7f235c06ead0 2024-04-25T10:04:57.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2361800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235c15af20 con 0x7f235c144140 2024-04-25T10:04:57.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235a000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f235c0ced60 0x7f235c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54784/0 (socket says 172.21.15.18:54784) 2024-04-25T10:04:57.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235a000640 1 -- 172.21.15.18:0/1522993592 learned_addr learned my addr 172.21.15.18:0/1522993592 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:57.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235aa00640 1 --2- 172.21.15.18:0/1522993592 >> v2:172.21.15.167:3300/0 conn(0x7f235c144140 0x7f235c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147497610 0 0) 0x7f235c15ac60 con 0x7f235c0ced60 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2340005740 con 0x7f235c0ced60 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329927914 0 0) 0x7f235c0cf3e0 con 0x7f235c06ead0 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f235c15ac60 con 0x7f235c06ead0 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235aa00640 1 -- 172.21.15.18:0/1522993592 >> v1:172.21.15.167:6789/0 conn(0x7f235c06ead0 legacy=0x7f235c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235aa00640 1 -- 172.21.15.18:0/1522993592 >> v1:172.21.15.18:6789/0 conn(0x7f235c0ced60 legacy=0x7f235c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.656+0000 7f235aa00640 1 -- 172.21.15.18:0/1522993592 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c15b200 con 0x7f235c144140 2024-04-25T10:04:57.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f235aa00640 1 --2- 172.21.15.18:0/1522993592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c144140 0x7f235c0ce820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f234c0097c0 tx=0x7f234c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8619441e312b5fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c0b0070 con 0x7f235c144140 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c0ab400 con 0x7f235c144140 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2359600640 1 -- 172.21.15.18:0/1522993592 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c0ab7d0 con 0x7f235c144140 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 -- 172.21.15.18:0/1522993592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c144140 msgr2=0x7f235c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 --2- 172.21.15.18:0/1522993592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c144140 0x7f235c0ce820 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f234c0097c0 tx=0x7f234c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 -- 172.21.15.18:0/1522993592 shutdown_connections 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 --2- 172.21.15.18:0/1522993592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c144140 0x7f235c0ce820 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 -- 172.21.15.18:0/1522993592 >> 172.21.15.18:0/1522993592 conn(0x7f235c066fa0 msgr2=0x7f235c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 -- 172.21.15.18:0/1522993592 shutdown_connections 2024-04-25T10:04:57.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.660+0000 7f2361800640 1 -- 172.21.15.18:0/1522993592 wait complete. 2024-04-25T10:04:57.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 Processor -- start 2024-04-25T10:04:57.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- start start 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 0x7f235c165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f235c0ced60 0x7f235c135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c15bb80 con 0x7f235c144140 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c15ba00 con 0x7f235c06ead0 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c06d2b0 con 0x7f235c0ced60 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41456/0 (socket says 172.21.15.18:41456) 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 -- 172.21.15.18:0/3258409184 learned_addr learned my addr 172.21.15.18:0/3258409184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235aa00640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 0x7f235c165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235a000640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f235c0ced60 0x7f235c135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 -- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f235c0ced60 msgr2=0x7f235c135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f235c0ced60 0x7f235c135e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 -- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 msgr2=0x7f235c165400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 0x7f235c165400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 -- 172.21.15.18:0/3258409184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c15ff10 con 0x7f235c144140 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235aa00640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 0x7f235c165400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f235b400640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f235400c790 tx=0x7f235400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354003b80 con 0x7f235c144140 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354003d20 con 0x7f235c144140 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400aa50 con 0x7f235c144140 2024-04-25T10:04:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c162620 con 0x7f235c144140 2024-04-25T10:04:57.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c136390 con 0x7f235c144140 2024-04-25T10:04:57.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.664+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c0745d0 con 0x7f235c144140 2024-04-25T10:04:57.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.668+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f235400abf0 con 0x7f235c144140 2024-04-25T10:04:57.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.668+0000 7f2352a00640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 0x7f233c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:57.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.668+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f23540854b0 con 0x7f235c144140 2024-04-25T10:04:57.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.668+0000 7f235aa00640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 0x7f233c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.668+0000 7f235aa00640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 0x7f233c069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f234c0ad000 tx=0x7f234c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:57.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.672+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2354056020 con 0x7f235c144140 2024-04-25T10:04:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.868+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f235c15ed40 con 0x7f235c144140 2024-04-25T10:04:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.868+0000 7f2352a00640 1 -- 172.21.15.18:0/3258409184 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f2354055920 con 0x7f235c144140 2024-04-25T10:04:57.881 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:57.881 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 msgr2=0x7f233c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 0x7f233c069420 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f234c0ad000 tx=0x7f234c008040 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 msgr2=0x7f235c1609d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f235400c790 tx=0x7f235400cc50 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 shutdown_connections 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f235c144140 0x7f235c1609d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f233c066f60 0x7f233c069420 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f235c0ced60 0x7f235c135e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 --2- 172.21.15.18:0/3258409184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f235c06ead0 0x7f235c165400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 >> 172.21.15.18:0/3258409184 conn(0x7f235c066fa0 msgr2=0x7f235c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 shutdown_connections 2024-04-25T10:04:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:57.872+0000 7f2361800640 1 -- 172.21.15.18:0/3258409184 wait complete. 2024-04-25T10:04:57.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:04:58.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 Processor -- start 2024-04-25T10:04:58.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 -- start start 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 0x7f9ebc15bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ebc0cf370 0x7f9ebc099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc09a600 0x7f9ebc15f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc0d0410 con 0x7f9ebc0cf370 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ebc15c310 con 0x7f9ebc099a60 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ec2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc09a380 con 0x7f9ebc09a600 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ebaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ebc0cf370 0x7f9ebc099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ebaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ebc0cf370 0x7f9ebc099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41468/0 (socket says 172.21.15.18:41468) 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ebaa00640 1 -- 172.21.15.18:0/2922508196 learned_addr learned my addr 172.21.15.18:0/2922508196 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ebbe00640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc09a600 0x7f9ebc15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.032+0000 7f9ebb400640 1 --2- 172.21.15.18:0/2922508196 >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 0x7f9ebc15bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 -- 172.21.15.18:0/2922508196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc09a600 msgr2=0x7f9ebc15f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc09a600 0x7f9ebc15f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 -- 172.21.15.18:0/2922508196 >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 msgr2=0x7f9ebc15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/2922508196 >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 0x7f9ebc15bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 -- 172.21.15.18:0/2922508196 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc0cf800 con 0x7f9ebc0cf370 2024-04-25T10:04:58.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebb400640 1 --2- 172.21.15.18:0/2922508196 >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 0x7f9ebc15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc0cf370 0x7f9ebc099e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc072740 tx=0x7f9ea801c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8466c44cdc66bc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9eba000640 1 -- 172.21.15.18:0/2922508196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80b0070 con 0x7f9ebc0cf370 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9eba000640 1 -- 172.21.15.18:0/2922508196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80ab600 con 0x7f9ebc0cf370 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9eba000640 1 -- 172.21.15.18:0/2922508196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ab9d0 con 0x7f9ebc0cf370 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 -- 172.21.15.18:0/2922508196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc0cf370 msgr2=0x7f9ebc099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc0cf370 0x7f9ebc099e40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc072740 tx=0x7f9ea801c1a0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 -- 172.21.15.18:0/2922508196 shutdown_connections 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc09a600 0x7f9ebc15f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 --2- 172.21.15.18:0/2922508196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc0cf370 0x7f9ebc099e40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.036+0000 7f9ec2800640 1 --2- 172.21.15.18:0/2922508196 >> v2:172.21.15.167:3300/0 conn(0x7f9ebc099a60 0x7f9ebc15bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- 172.21.15.18:0/2922508196 >> 172.21.15.18:0/2922508196 conn(0x7f9ebc0d17a0 msgr2=0x7f9ebc0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- 172.21.15.18:0/2922508196 shutdown_connections 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- 172.21.15.18:0/2922508196 wait complete. 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 Processor -- start 2024-04-25T10:04:58.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- start start 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc099a60 0x7f9ebc09ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ebc14ad40 0x7f9ebc147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0cc430 con 0x7f9ebc09a600 2024-04-25T10:04:58.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0cc2b0 con 0x7f9ebc14ad40 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0cc5b0 con 0x7f9ebc099a60 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41476/0 (socket says 172.21.15.18:41476) 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 -- 172.21.15.18:0/1550752679 learned_addr learned my addr 172.21.15.18:0/1550752679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebb400640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc099a60 0x7f9ebc09ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebbe00640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ebc14ad40 0x7f9ebc147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 -- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc099a60 msgr2=0x7f9ebc09ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc099a60 0x7f9ebc09ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 -- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ebc14ad40 msgr2=0x7f9ebc147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ebc14ad40 0x7f9ebc147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 -- 172.21.15.18:0/1550752679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc06bf70 con 0x7f9ebc09a600 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ebaa00640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae040 tx=0x7f9ea8018f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80ba020 con 0x7f9ebc09a600 2024-04-25T10:04:58.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea80b6420 con 0x7f9ebc09a600 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc06c1f0 con 0x7f9ebc09a600 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.040+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea80b0040 con 0x7f9ebc09a600 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc06c7b0 con 0x7f9ebc09a600 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc0745d0 con 0x7f9ebc09a600 2024-04-25T10:04:58.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ea80bd020 con 0x7f9ebc09a600 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9eb3400640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 0x7f9e9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f9ea811f260 con 0x7f9ebc09a600 2024-04-25T10:04:58.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9ebb400640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 0x7f9e9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.044+0000 7f9ebb400640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 0x7f9e9c069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c880 tx=0x7f9eac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.048+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ebc06bf70 con 0x7f9ebc09a600 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.244+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ebc0d2620 con 0x7f9ebc09a600 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.244+0000 7f9eb3400640 1 -- 172.21.15.18:0/1550752679 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f9ea8016110 con 0x7f9ebc09a600 2024-04-25T10:04:58.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/703689111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":703689111},{"type":"v1","addr":"172.21.15.18:6835","nonce":703689111}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2789445609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2789445609},{"type":"v1","addr":"172.21.15.18:6834","nonce":2789445609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":34178,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3219586900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3219586900},{"type":"v1","addr":"172.21.15.167:6836","nonce":3219586900}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:03:56.137194+0000","modified":"2024-04-25T10:04:14.230428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34181},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34181":{"gid":34181,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/1802921745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1802921745},{"type":"v1","addr":"172.21.15.167:6837","nonce":1802921745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T10:04:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 9 2024-04-25T10:04:58.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 msgr2=0x7f9e9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 0x7f9e9c069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9eac00c880 tx=0x7f9eac008040 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 msgr2=0x7f9ebc06cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9ea80ae040 tx=0x7f9ea8018f40 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 shutdown_connections 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ebc14ad40 0x7f9ebc147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ebc09a600 0x7f9ebc06cfb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e9c066f60 0x7f9e9c069420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 --2- 172.21.15.18:0/1550752679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9ebc099a60 0x7f9ebc09ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 >> 172.21.15.18:0/1550752679 conn(0x7f9ebc0d17a0 msgr2=0x7f9ebc15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 shutdown_connections 2024-04-25T10:04:58.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.248+0000 7f9ec2800640 1 -- 172.21.15.18:0/1550752679 wait complete. 2024-04-25T10:04:58.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 Processor -- start 2024-04-25T10:04:58.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 -- start start 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f63e815dad0 0x7f63e81621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80ce810 con 0x7f63e80d0e80 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80ceaf0 con 0x7f63e815deb0 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63ed200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e80d1be0 con 0x7f63e815dad0 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e6800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63e80d0e80 0x7f63e80d2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54796/0 (socket says 172.21.15.18:54796) 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e6800640 1 -- 172.21.15.18:0/1897633571 learned_addr learned my addr 172.21.15.18:0/1897633571 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 --2- 172.21.15.18:0/1897633571 >> v2:172.21.15.167:3300/0 conn(0x7f63e815dad0 0x7f63e81621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438234801 0 0) 0x7f63e80ce810 con 0x7f63e80d0e80 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63cc003530 con 0x7f63e80d0e80 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855307605 0 0) 0x7f63cc003530 con 0x7f63e80d0e80 2024-04-25T10:04:58.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 >> v2:172.21.15.167:3300/0 conn(0x7f63e815dad0 msgr2=0x7f63e81621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 --2- 172.21.15.18:0/1897633571 >> v2:172.21.15.167:3300/0 conn(0x7f63e815dad0 0x7f63e81621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 >> v1:172.21.15.167:6789/0 conn(0x7f63e815deb0 legacy=0x7f63e80d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80cedd0 con 0x7f63e80d0e80 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f63e0001a00 con 0x7f63e80d0e80 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 >> v1:172.21.15.18:6789/0 conn(0x7f63e80d0e80 legacy=0x7f63e80d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 0x7f63cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63cc004810 0x7f63cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0051d0 0x7f63cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc00c040 con 0x7f63cc0039c0 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc00c1f0 con 0x7f63cc004810 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc014c00 con 0x7f63cc0051d0 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 0x7f63cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e6800640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0051d0 0x7f63cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5400640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63cc004810 0x7f63cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 -- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0051d0 msgr2=0x7f63cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0051d0 0x7f63cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 -- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63cc004810 msgr2=0x7f63cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63cc004810 0x7f63cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5e00640 1 -- 172.21.15.18:0/1897633571 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc003530 con 0x7f63cc0039c0 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e6800640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0051d0 0x7f63cc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:58.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e5400640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63cc004810 0x7f63cc004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:58.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.408+0000 7f63e6800640 1 -- 172.21.15.18:0/1897633571 reap_dead start 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63e5e00640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 0x7f63cc003de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009ae0 tx=0x7f63d801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abff088bb91a9870 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80b2070 con 0x7f63cc0039c0 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d80a5520 con 0x7f63cc0039c0 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63e4a00640 1 -- 172.21.15.18:0/1897633571 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d80096b0 con 0x7f63cc0039c0 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 -- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 msgr2=0x7f63cc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 0x7f63cc003de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63d8009ae0 tx=0x7f63d801ca40 comp rx=0 tx=0).stop 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 -- 172.21.15.18:0/1897633571 shutdown_connections 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 --2- 172.21.15.18:0/1897633571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63cc0039c0 0x7f63cc003de0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 -- 172.21.15.18:0/1897633571 >> 172.21.15.18:0/1897633571 conn(0x7f63e80b5900 msgr2=0x7f63e80b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 -- 172.21.15.18:0/1897633571 shutdown_connections 2024-04-25T10:04:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.412+0000 7f63ed200640 1 -- 172.21.15.18:0/1897633571 wait complete. 2024-04-25T10:04:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 Processor -- start 2024-04-25T10:04:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- start start 2024-04-25T10:04:58.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0039c0 0x7f63e80cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 0x7f63e815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d0b00 con 0x7f63e8160130 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d0980 con 0x7f63e8156130 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80d0c80 con 0x7f63cc0039c0 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41502/0 (socket says 172.21.15.18:41502) 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 -- 172.21.15.18:0/3830076084 learned_addr learned my addr 172.21.15.18:0/3830076084 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e5e00640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0039c0 0x7f63e80cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e5400640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 0x7f63e815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 -- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0039c0 msgr2=0x7f63e80cd540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0039c0 0x7f63e80cd540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 -- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 msgr2=0x7f63e815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 0x7f63e815fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 -- 172.21.15.18:0/3830076084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80ccb60 con 0x7f63e8160130 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e5400640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 0x7f63e815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63e6800640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63e80d4af0 tx=0x7f63e0007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000e9e0 con 0x7f63e8160130 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000eba0 con 0x7f63e8160130 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000ed90 con 0x7f63e8160130 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e80cce40 con 0x7f63e8160130 2024-04-25T10:04:58.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.416+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e81605b0 con 0x7f63e8160130 2024-04-25T10:04:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e80745d0 con 0x7f63e8160130 2024-04-25T10:04:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63e001a020 con 0x7f63e8160130 2024-04-25T10:04:58.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63de000640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 0x7f63c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7f63e0084b40 con 0x7f63e8160130 2024-04-25T10:04:58.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63e5e00640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 0x7f63c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.420+0000 7f63e5e00640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 0x7f63c8069450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63d80af000 tx=0x7f63d80046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.424+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63e0021020 con 0x7f63e8160130 2024-04-25T10:04:58.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63e80d1700 con 0x7f63e8160130 2024-04-25T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63de000640 1 -- 172.21.15.18:0/3830076084 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18877 (secure 0 0 0) 0x7f63e00558a0 con 0x7f63e8160130 2024-04-25T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:04:58.598 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":29,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:04:36.912766+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:03:54.200629+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T10:03:55.138581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T10:03:58.815069+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 msgr2=0x7f63c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 0x7f63c8069450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f63d80af000 tx=0x7f63d80046d0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 msgr2=0x7f63e815a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63e80d4af0 tx=0x7f63e0007af0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 shutdown_connections 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63e8160130 0x7f63e815a580 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8156130 0x7f63e815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f63c8066f90 0x7f63c8069450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 --2- 172.21.15.18:0/3830076084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f63cc0039c0 0x7f63e80cd540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 >> 172.21.15.18:0/3830076084 conn(0x7f63e80b5900 msgr2=0x7f63e80b6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 shutdown_connections 2024-04-25T10:04:58.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.588+0000 7f63ed200640 1 -- 172.21.15.18:0/3830076084 wait complete. 2024-04-25T10:04:58.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:04:58.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 Processor -- start 2024-04-25T10:04:58.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 -- start start 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb29815dc60 0x7fb2980d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb29806bf30 0x7fb2980cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb298099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29815e040 con 0x7fb29815dc60 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980cff80 con 0x7fb29806bf30 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb29dc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980d0260 con 0x7fb298099a60 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb29815dc60 0x7fb2980d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb29815dc60 0x7fb2980d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41518/0 (socket says 172.21.15.18:41518) 2024-04-25T10:04:58.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 -- 172.21.15.18:0/2170141943 learned_addr learned my addr 172.21.15.18:0/2170141943 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb28e000640 1 --2- 172.21.15.18:0/2170141943 >> v2:172.21.15.167:3300/0 conn(0x7fb29806bf30 0x7fb2980cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb297400640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb298099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 -- 172.21.15.18:0/2170141943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 msgr2=0x7fb298099ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb298099ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 -- 172.21.15.18:0/2170141943 >> v2:172.21.15.167:3300/0 conn(0x7fb29806bf30 msgr2=0x7fb2980cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 --2- 172.21.15.18:0/2170141943 >> v2:172.21.15.167:3300/0 conn(0x7fb29806bf30 0x7fb2980cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.752+0000 7fb296a00640 1 -- 172.21.15.18:0/2170141943 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980d0540 con 0x7fb29815dc60 2024-04-25T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb296a00640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980d1020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb2980d2810 tx=0x7fb28801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca067aebb6e9fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb296000640 1 -- 172.21.15.18:0/2170141943 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2880b0070 con 0x7fb29815dc60 2024-04-25T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb296000640 1 -- 172.21.15.18:0/2170141943 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2880ab600 con 0x7fb29815dc60 2024-04-25T10:04:58.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb296000640 1 -- 172.21.15.18:0/2170141943 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2880ab9d0 con 0x7fb29815dc60 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 -- 172.21.15.18:0/2170141943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 msgr2=0x7fb2980d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980d1020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb2980d2810 tx=0x7fb28801c490 comp rx=0 tx=0).stop 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 -- 172.21.15.18:0/2170141943 shutdown_connections 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb298099ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 --2- 172.21.15.18:0/2170141943 >> v2:172.21.15.167:3300/0 conn(0x7fb29806bf30 0x7fb2980cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 --2- 172.21.15.18:0/2170141943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980d1020 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 -- 172.21.15.18:0/2170141943 >> 172.21.15.18:0/2170141943 conn(0x7fb2980b3200 msgr2=0x7fb2980b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 -- 172.21.15.18:0/2170141943 shutdown_connections 2024-04-25T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.756+0000 7fb29dc00640 1 -- 172.21.15.18:0/2170141943 wait complete. 2024-04-25T10:04:58.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 Processor -- start 2024-04-25T10:04:58.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- start start 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb29806bf30 0x7fb2980caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb2980cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980cc6f0 con 0x7fb29815dc60 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980cc570 con 0x7fb29806bf30 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980cc870 con 0x7fb298099a60 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41532/0 (socket says 172.21.15.18:41532) 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 -- 172.21.15.18:0/3683773264 learned_addr learned my addr 172.21.15.18:0/3683773264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb28e000640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb2980cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb296a00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb29806bf30 0x7fb2980caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 -- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 msgr2=0x7fb2980cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb2980cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 -- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb29806bf30 msgr2=0x7fb2980caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb29806bf30 0x7fb2980caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 -- 172.21.15.18:0/3683773264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29814d0a0 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb297400640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb290007e70 tx=0x7fb29000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290014620 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290019070 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29814fe10 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290014a20 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2981503d0 con 0x7fb29815dc60 2024-04-25T10:04:58.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.760+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2980745d0 con 0x7fb29815dc60 2024-04-25T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.764+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb290014bc0 con 0x7fb29815dc60 2024-04-25T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.764+0000 7fb28f400640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 0x7fb274069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.764+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6735+0+0 (secure 0 0 0) 0x7fb290085c20 con 0x7fb29815dc60 2024-04-25T10:04:58.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.764+0000 7fb296a00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 0x7fb274069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:58.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.764+0000 7fb296a00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 0x7fb274069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb29809a6b0 tx=0x7fb288008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:58.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.768+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb29814d0a0 con 0x7fb29815dc60 2024-04-25T10:04:58.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.964+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb2980c8aa0 con 0x7fb29815dc60 2024-04-25T10:04:58.975 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:04:58.964+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb28f400640 1 -- 172.21.15.18:0/3683773264 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb2900561d0 con 0x7fb29815dc60 2024-04-25T10:04:58.977 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 msgr2=0x7fb274069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 0x7fb274069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb29809a6b0 tx=0x7fb288008040 comp rx=0 tx=0).stop 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 msgr2=0x7fb2980cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb290007e70 tx=0x7fb29000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 shutdown_connections 2024-04-25T10:04:58.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb29815dc60 0x7fb2980cb4e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb274066f60 0x7fb274069420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb298099a60 0x7fb2980cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 --2- 172.21.15.18:0/3683773264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb29806bf30 0x7fb2980caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 >> 172.21.15.18:0/3683773264 conn(0x7fb2980b3200 msgr2=0x7fb29806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 shutdown_connections 2024-04-25T10:04:58.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:58.968+0000 7fb29dc00640 1 -- 172.21.15.18:0/3683773264 wait complete. 2024-04-25T10:04:58.992 INFO:tasks.ceph.mds.d.smithi167.stderr: -5233> 2024-04-25T10:04:00.447+0000 7f8613c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:04:58.999 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:04:59.043 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 Processor -- start 2024-04-25T10:04:59.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 -- start start 2024-04-25T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f815dc60 0x7f76f80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76f809a170 0x7f76f80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f815e040 con 0x7f76f806bf30 2024-04-25T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80cff80 con 0x7f76f809a170 2024-04-25T10:04:59.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.132+0000 7f76ffa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80d0260 con 0x7f76f815dc60 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76f809a170 0x7f76f80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fd000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f815dc60 0x7f76f80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f76f809a170 0x7f76f80cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44776/0 (socket says 172.21.15.18:44776) 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 -- 172.21.15.18:0/2749200300 learned_addr learned my addr 172.21.15.18:0/2749200300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 -- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f815dc60 msgr2=0x7f76f80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 --2- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f815dc60 0x7f76f80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 -- 172.21.15.18:0/2749200300 >> v1:172.21.15.167:6789/0 conn(0x7f76f806bf30 legacy=0x7f76f8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 -- 172.21.15.18:0/2749200300 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80d0540 con 0x7f76f809a170 2024-04-25T10:04:59.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76fda00640 1 --2- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f809a170 0x7f76f80cf8a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e50 tx=0x7f76f001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14ef3c2ff8f44d00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76f7e00640 1 -- 172.21.15.18:0/2749200300 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00a5830 con 0x7f76f809a170 2024-04-25T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76f7e00640 1 -- 172.21.15.18:0/2749200300 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00a59d0 con 0x7f76f809a170 2024-04-25T10:04:59.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.136+0000 7f76f7e00640 1 -- 172.21.15.18:0/2749200300 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00a5da0 con 0x7f76f809a170 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f809a170 msgr2=0x7f76f80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f809a170 0x7f76f80cf8a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e50 tx=0x7f76f001c970 comp rx=0 tx=0).stop 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- 172.21.15.18:0/2749200300 shutdown_connections 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f809a170 0x7f76f80cf8a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2749200300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f815dc60 0x7f76f80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- 172.21.15.18:0/2749200300 >> 172.21.15.18:0/2749200300 conn(0x7f76f80b3200 msgr2=0x7f76f80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:04:59.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- 172.21.15.18:0/2749200300 shutdown_connections 2024-04-25T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- 172.21.15.18:0/2749200300 wait complete. 2024-04-25T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 Processor -- start 2024-04-25T10:04:59.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- start start 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f806bf30 0x7f76f80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f815dc60 0x7f76f80ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80cc6f0 con 0x7f76f809a170 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80cc570 con 0x7f76f815dc60 2024-04-25T10:04:59.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76ffa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80cc870 con 0x7f76f806bf30 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41534/0 (socket says 172.21.15.18:41534) 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76efe00640 1 -- 172.21.15.18:0/2466435366 learned_addr learned my addr 172.21.15.18:0/2466435366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76fda00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f815dc60 0x7f76f80ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.140+0000 7f76fd000640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f806bf30 0x7f76f80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 -- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f806bf30 msgr2=0x7f76f80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f806bf30 0x7f76f80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 -- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f815dc60 msgr2=0x7f76f80ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f815dc60 0x7f76f80ca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:04:59.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 -- 172.21.15.18:0/2466435366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80b4cd0 con 0x7f76f809a170 2024-04-25T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76efe00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c420 tx=0x7f76e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00052d0 con 0x7f76f809a170 2024-04-25T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0005470 con 0x7f76f809a170 2024-04-25T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f80cb050 con 0x7f76f809a170 2024-04-25T10:04:59.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0007260 con 0x7f76f809a170 2024-04-25T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f80cb610 con 0x7f76f809a170 2024-04-25T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f80745d0 con 0x7f76f809a170 2024-04-25T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76e0007400 con 0x7f76f809a170 2024-04-25T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:04:59.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f76e0084920 con 0x7f76f809a170 2024-04-25T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.144+0000 7f76fd000640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:04:59.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.148+0000 7f76fd000640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 0x7f76d4069420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009ac0 tx=0x7f76e8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:04:59.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.148+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76e0054e70 con 0x7f76f809a170 2024-04-25T10:04:59.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.344+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76f80b7590 con 0x7f76f809a170 2024-04-25T10:05:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76f5600640 1 -- 172.21.15.18:0/2466435366 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76e0058f10 con 0x7f76f809a170 2024-04-25T10:05:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 msgr2=0x7f76d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 0x7f76d4069420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76e8009ac0 tx=0x7f76e8009190 comp rx=0 tx=0).stop 2024-04-25T10:05:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 msgr2=0x7f76f814cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f76e000c420 tx=0x7f76e000c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 shutdown_connections 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76f815dc60 0x7f76f80ca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76f809a170 0x7f76f814cb50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76d4066f60 0x7f76d4069420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 --2- 172.21.15.18:0/2466435366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76f806bf30 0x7f76f80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:04:59.996+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 >> 172.21.15.18:0/2466435366 conn(0x7f76f80b3200 msgr2=0x7f76f806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.000+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 shutdown_connections 2024-04-25T10:05:00.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.000+0000 7f76ffa00640 1 -- 172.21.15.18:0/2466435366 wait complete. 2024-04-25T10:05:00.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:05:00.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 Processor -- start 2024-04-25T10:05:00.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 -- start start 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 0x7f7d140b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 0x7f7d1406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d1415de90 con 0x7f7d1415dab0 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d14071a70 con 0x7f7d140b0c00 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d1ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d140b57a0 con 0x7f7d140713c0 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d18e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 0x7f7d1406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d0b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 0x7f7d140b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d18e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 0x7f7d1406c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41546/0 (socket says 172.21.15.18:41546) 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d18e00640 1 -- 172.21.15.18:0/3146091726 learned_addr learned my addr 172.21.15.18:0/3146091726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d13e00640 1 --1- 172.21.15.18:0/3146091726 >> v1:172.21.15.167:6789/0 conn(0x7f7d1415dab0 0x7f7d14070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42914/0 (socket says 172.21.15.18:42914) 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d0b400640 1 -- 172.21.15.18:0/3146091726 >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 msgr2=0x7f7d1406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d0b400640 1 --2- 172.21.15.18:0/3146091726 >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 0x7f7d1406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d0b400640 1 -- 172.21.15.18:0/3146091726 >> v1:172.21.15.167:6789/0 conn(0x7f7d1415dab0 legacy=0x7f7d14070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d0b400640 1 -- 172.21.15.18:0/3146091726 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d1406bec0 con 0x7f7d140713c0 2024-04-25T10:05:00.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.172+0000 7f7d13400640 1 -- 172.21.15.18:0/3146091726 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457505291 0 0) 0x7f7d1415de90 con 0x7f7d1415dab0 2024-04-25T10:05:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d0b400640 1 --2- 172.21.15.18:0/3146091726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 0x7f7d140b5110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097c0 tx=0x7f7cfc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8aebd46cd60d627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d13400640 1 -- 172.21.15.18:0/3146091726 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0b2070 con 0x7f7d140713c0 2024-04-25T10:05:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d13400640 1 -- 172.21.15.18:0/3146091726 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0ad680 con 0x7f7d140713c0 2024-04-25T10:05:00.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d13400640 1 -- 172.21.15.18:0/3146091726 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0ada50 con 0x7f7d140713c0 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3146091726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 msgr2=0x7f7d140b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3146091726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 0x7f7d140b5110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0097c0 tx=0x7f7cfc01c470 comp rx=0 tx=0).stop 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3146091726 shutdown_connections 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3146091726 >> v2:172.21.15.18:3300/0 conn(0x7f7d140b0c00 0x7f7d1406c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3146091726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d140713c0 0x7f7d140b5110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3146091726 >> 172.21.15.18:0/3146091726 conn(0x7f7d1406f510 msgr2=0x7f7d1406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3146091726 shutdown_connections 2024-04-25T10:05:00.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.176+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3146091726 wait complete. 2024-04-25T10:05:00.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 Processor -- start 2024-04-25T10:05:00.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- start start 2024-04-25T10:05:00.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d140b0c00 0x7f7d1414f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 0x7f7d141529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406db00 con 0x7f7d140713c0 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406d980 con 0x7f7d140b0c00 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d1406dc80 con 0x7f7d1415dab0 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41562/0 (socket says 172.21.15.18:41562) 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 -- 172.21.15.18:0/3094027370 learned_addr learned my addr 172.21.15.18:0/3094027370 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d0b400640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d140b0c00 0x7f7d1414f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d18e00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 0x7f7d141529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 -- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 msgr2=0x7f7d141529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 0x7f7d141529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 -- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d140b0c00 msgr2=0x7f7d1414f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d140b0c00 0x7f7d1414f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 -- 172.21.15.18:0/3094027370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d14151930 con 0x7f7d140713c0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d18e00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 0x7f7d141529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d13e00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c4a0 tx=0x7f7d0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04018070 con 0x7f7d140713c0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d040074e0 con 0x7f7d140713c0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d14151c10 con 0x7f7d140713c0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d04004a30 con 0x7f7d140713c0 2024-04-25T10:05:00.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.180+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d141521d0 con 0x7f7d140713c0 2024-04-25T10:05:00.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d140745d0 con 0x7f7d140713c0 2024-04-25T10:05:00.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7d0401b070 con 0x7f7d140713c0 2024-04-25T10:05:00.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d10c00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 0x7f7cf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:00.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f7d040846b0 con 0x7f7d140713c0 2024-04-25T10:05:00.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d0b400640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 0x7f7cf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:00.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.184+0000 7f7d0b400640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 0x7f7cf0069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0af000 tx=0x7f7cfc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:00.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.188+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d04054ca0 con 0x7f7d140713c0 2024-04-25T10:05:00.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.352+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d140b1150 con 0x7f7d140713c0 2024-04-25T10:05:01.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:00.996+0000 7f7d10c00640 1 -- 172.21.15.18:0/3094027370 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7d04058d40 con 0x7f7d140713c0 2024-04-25T10:05:01.008 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 msgr2=0x7f7cf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 0x7f7cf0069420 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0af000 tx=0x7f7cfc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 msgr2=0x7f7d14151350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7d0400c4a0 tx=0x7f7d0400c960 comp rx=0 tx=0).stop 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 shutdown_connections 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cf0066f60 0x7f7cf0069420 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7d1415dab0 0x7f7d141529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d140b0c00 0x7f7d1414f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 --2- 172.21.15.18:0/3094027370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d140713c0 0x7f7d14151350 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 >> 172.21.15.18:0/3094027370 conn(0x7f7d1406f510 msgr2=0x7f7d1415c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:01.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 shutdown_connections 2024-04-25T10:05:01.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.000+0000 7f7d1ae00640 1 -- 172.21.15.18:0/3094027370 wait complete. 2024-04-25T10:05:01.037 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:05:01.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 Processor -- start 2024-04-25T10:05:01.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 -- start start 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b415ccc0 con 0x7f56b40cdf90 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56b4160200 con 0x7f56b4071250 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56b9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b415c9e0 con 0x7f56b415c4a0 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56abe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f56b40cdf90 0x7f56b415bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54804/0 (socket says 172.21.15.18:54804) 2024-04-25T10:05:01.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.180+0000 7f56abe00640 1 -- 172.21.15.18:0/4209817771 learned_addr learned my addr 172.21.15.18:0/4209817771 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:01.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b2800640 1 --2- 172.21.15.18:0/4209817771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854497973 0 0) 0x7f56b415ccc0 con 0x7f56b40cdf90 2024-04-25T10:05:01.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5698003530 con 0x7f56b40cdf90 2024-04-25T10:05:01.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3883057203 0 0) 0x7f56b4160200 con 0x7f56b4071250 2024-04-25T10:05:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b2800640 1 -- 172.21.15.18:0/4209817771 >> v1:172.21.15.167:6789/0 conn(0x7f56b4071250 legacy=0x7f56b4071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b2800640 1 -- 172.21.15.18:0/4209817771 >> v1:172.21.15.18:6789/0 conn(0x7f56b40cdf90 legacy=0x7f56b415bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b2800640 1 -- 172.21.15.18:0/4209817771 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b40cd4b0 con 0x7f56b415c4a0 2024-04-25T10:05:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b2800640 1 --2- 172.21.15.18:0/4209817771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b415cee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009dc0 tx=0x7f56ac01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91ff79dd6f37f3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0b2070 con 0x7f56b415c4a0 2024-04-25T10:05:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56ac0a57c0 con 0x7f56b415c4a0 2024-04-25T10:05:01.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.184+0000 7f56b1400640 1 -- 172.21.15.18:0/4209817771 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56ac0a5b90 con 0x7f56b415c4a0 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- 172.21.15.18:0/4209817771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 msgr2=0x7f56b415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 --2- 172.21.15.18:0/4209817771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b415cee0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56ac009dc0 tx=0x7f56ac01c900 comp rx=0 tx=0).stop 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- 172.21.15.18:0/4209817771 shutdown_connections 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 --2- 172.21.15.18:0/4209817771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b415cee0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- 172.21.15.18:0/4209817771 >> 172.21.15.18:0/4209817771 conn(0x7f56b406ac10 msgr2=0x7f56b406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- 172.21.15.18:0/4209817771 shutdown_connections 2024-04-25T10:05:01.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- 172.21.15.18:0/4209817771 wait complete. 2024-04-25T10:05:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 Processor -- start 2024-04-25T10:05:01.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- start start 2024-04-25T10:05:01.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b40cdf90 0x7f56b414ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b40adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b4169840 con 0x7f56b4071250 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41696c0 con 0x7f56b40cdf90 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b41699c0 con 0x7f56b415c4a0 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41570/0 (socket says 172.21.15.18:41570) 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b1e00640 1 -- 172.21.15.18:0/1574657618 learned_addr learned my addr 172.21.15.18:0/1574657618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56abe00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b40cdf90 0x7f56b414ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.188+0000 7f56b2800640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b40adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 -- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 msgr2=0x7f56b40adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b40adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 -- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b40cdf90 msgr2=0x7f56b414ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:01.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b40cdf90 0x7f56b414ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 -- 172.21.15.18:0/1574657618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b414df30 con 0x7f56b4071250 2024-04-25T10:05:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b1e00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001ec0 tx=0x7f56a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a4017070 con 0x7f56b4071250 2024-04-25T10:05:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a4003600 con 0x7f56b4071250 2024-04-25T10:05:01.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b414e210 con 0x7f56b4071250 2024-04-25T10:05:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a40039f0 con 0x7f56b4071250 2024-04-25T10:05:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b414e7d0 con 0x7f56b4071250 2024-04-25T10:05:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b40745d0 con 0x7f56b4071250 2024-04-25T10:05:01.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56a401a070 con 0x7f56b4071250 2024-04-25T10:05:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 0x7f5690069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.192+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f56a4084610 con 0x7f56b4071250 2024-04-25T10:05:01.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.196+0000 7f56abe00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 0x7f5690069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:01.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.196+0000 7f56abe00640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 0x7f5690069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f569c007fd0 tx=0x7f569c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:01.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.196+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56a4054d20 con 0x7f56b4071250 2024-04-25T10:05:01.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:01.364+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56b4150e40 con 0x7f56b4071250 2024-04-25T10:05:02.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.012+0000 7f56aa000640 1 -- 172.21.15.18:0/1574657618 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56a4058dc0 con 0x7f56b4071250 2024-04-25T10:05:02.022 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:05:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 msgr2=0x7f5690069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 0x7f5690069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f569c007fd0 tx=0x7f569c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 msgr2=0x7f56b4149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f56a4001ec0 tx=0x7f56a400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 shutdown_connections 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5690066f60 0x7f5690069420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f56b415c4a0 0x7f56b40adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b40cdf90 0x7f56b414ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 --2- 172.21.15.18:0/1574657618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56b4071250 0x7f56b4149620 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 >> 172.21.15.18:0/1574657618 conn(0x7f56b406ac10 msgr2=0x7f56b4150070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 shutdown_connections 2024-04-25T10:05:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.016+0000 7f56b9200640 1 -- 172.21.15.18:0/1574657618 wait complete. 2024-04-25T10:05:02.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T10:05:02.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.188+0000 7fe8b8800640 1 Processor -- start 2024-04-25T10:05:02.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.188+0000 7fe8b8800640 1 -- start start 2024-04-25T10:05:02.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b8800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe8b015dab0 0x7fe8b00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b8800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b8800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b015de90 con 0x7fe8b00711f0 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b8800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b0071650 con 0x7fe8b015dab0 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b8800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0071a70 con 0x7fe8b00b0c00 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe8b015dab0 0x7fe8b00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:51632/0 (socket says 172.21.15.18:51632) 2024-04-25T10:05:02.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5400640 1 -- 172.21.15.18:0/3356907793 learned_addr learned my addr 172.21.15.18:0/3356907793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5e00640 1 -- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 msgr2=0x7fe8b0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5e00640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5e00640 1 -- 172.21.15.18:0/3356907793 >> v1:172.21.15.167:6789/0 conn(0x7fe8b00711f0 legacy=0x7fe8b0161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5e00640 1 -- 172.21.15.18:0/3356907793 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00b57a0 con 0x7fe8b015dab0 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b5400640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:02.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.192+0000 7fe8b4a00640 1 -- 172.21.15.18:0/3356907793 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259262741 0 0) 0x7fe8b015de90 con 0x7fe8b00711f0 2024-04-25T10:05:02.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b5e00640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b015dab0 0x7fe8b00b5110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097c0 tx=0x7fe8a401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b346b3b101f5d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:02.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b4a00640 1 -- 172.21.15.18:0/3356907793 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b2070 con 0x7fe8b015dab0 2024-04-25T10:05:02.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b4a00640 1 -- 172.21.15.18:0/3356907793 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40ad680 con 0x7fe8b015dab0 2024-04-25T10:05:02.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b4a00640 1 -- 172.21.15.18:0/3356907793 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40ada50 con 0x7fe8b015dab0 2024-04-25T10:05:02.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b015dab0 msgr2=0x7fe8b00b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b015dab0 0x7fe8b00b5110 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097c0 tx=0x7fe8a401c470 comp rx=0 tx=0).stop 2024-04-25T10:05:02.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- 172.21.15.18:0/3356907793 shutdown_connections 2024-04-25T10:05:02.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b00b0c00 0x7fe8b0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 --2- 172.21.15.18:0/3356907793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b015dab0 0x7fe8b00b5110 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- 172.21.15.18:0/3356907793 >> 172.21.15.18:0/3356907793 conn(0x7fe8b006f510 msgr2=0x7fe8b006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:02.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- 172.21.15.18:0/3356907793 shutdown_connections 2024-04-25T10:05:02.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- 172.21.15.18:0/3356907793 wait complete. 2024-04-25T10:05:02.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 Processor -- start 2024-04-25T10:05:02.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.196+0000 7fe8b8800640 1 -- start start 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b00b0c00 0x7fe8b015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b015dab0 0x7fe8b00cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b016aab0 con 0x7fe8b00711f0 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b016a930 con 0x7fe8b00b0c00 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b016ac30 con 0x7fe8b015dab0 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36220/0 (socket says 172.21.15.18:36220) 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 -- 172.21.15.18:0/1044453625 learned_addr learned my addr 172.21.15.18:0/1044453625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5400640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b00b0c00 0x7fe8b015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b6800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b015dab0 0x7fe8b00cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 -- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b015dab0 msgr2=0x7fe8b00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b015dab0 0x7fe8b00cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 -- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b00b0c00 msgr2=0x7fe8b015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:02.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b00b0c00 0x7fe8b015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:02.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 -- 172.21.15.18:0/1044453625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b015eae0 con 0x7fe8b00711f0 2024-04-25T10:05:02.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b5e00640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe8a401ab20 tx=0x7fe8a401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b2050 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a40be070 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a40b9450 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b015edc0 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b015f380 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.200+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b00745d0 con 0x7fe8b00711f0 2024-04-25T10:05:02.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.204+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8a40b95f0 con 0x7fe8b00711f0 2024-04-25T10:05:02.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.204+0000 7fe8aa000640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 0x7fe894069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:02.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.204+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe8a411f540 con 0x7fe8b00711f0 2024-04-25T10:05:02.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.204+0000 7fe8b5400640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 0x7fe894069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:02.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.204+0000 7fe8b5400640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 0x7fe894069450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8b01fa3f0 tx=0x7fe8a0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:02.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.208+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8a4016090 con 0x7fe8b00711f0 2024-04-25T10:05:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:02.372+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe8b00b1150 con 0x7fe8b00711f0 2024-04-25T10:05:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.012+0000 7fe8aa000640 1 -- 172.21.15.18:0/1044453625 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7fe8a40eff80 con 0x7fe8b00711f0 2024-04-25T10:05:03.024 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data_ec' removed 2024-04-25T10:05:03.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 msgr2=0x7fe894069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 0x7fe894069450 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8b01fa3f0 tx=0x7fe8a0009240 comp rx=0 tx=0).stop 2024-04-25T10:05:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 msgr2=0x7fe8b0141160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe8a401ab20 tx=0x7fe8a401acb0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 shutdown_connections 2024-04-25T10:05:03.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe894066f90 0x7fe894069450 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe8b01fa3f0 tx=0x7fe8a0009240 comp rx=0 tx=0).stop 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8b015dab0 0x7fe8b00cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8b00b0c00 0x7fe8b015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 --2- 172.21.15.18:0/1044453625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe8b00711f0 0x7fe8b0141160 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.016+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 >> 172.21.15.18:0/1044453625 conn(0x7fe8b006f510 msgr2=0x7fe8b00cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.020+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 shutdown_connections 2024-04-25T10:05:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.020+0000 7fe8b8800640 1 -- 172.21.15.18:0/1044453625 wait complete. 2024-04-25T10:05:03.056 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:05:03.056 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:05:03.056 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:05:03.056 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:03.057 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:05:03.057 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:05:03.057 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:05:03.057 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:03.057 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:05:03.057 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:05:03.058 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:05:03.058 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:03.058 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:05:03.059 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:05:03.059 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:05:03.059 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:03.070 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:05:03.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:05:03.071 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:05:03.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:05:03.073 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:05:03.073 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:05:03.074 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:05:03.074 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:05:03.115 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:05:03.115 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:03.116 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:05:03.117 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:03.119 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:05:03.119 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:03.121 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:05:03.122 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:03.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:05:03.207 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:05:03.207 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:05:03.210 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:05:03.210 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:05:03.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 Processor -- start 2024-04-25T10:05:03.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 -- start start 2024-04-25T10:05:03.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f210c15dc00 0x7f210c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 0x7f210c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f210c0c70d0 0x7f210c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210c0cd860 con 0x7f210c15dc00 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210c0b30d0 con 0x7f210c0c70d0 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2111600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0ccf30 con 0x7f210c0d0150 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f210c15dc00 0x7f210c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f210c15dc00 0x7f210c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36266/0 (socket says 172.21.15.18:36266) 2024-04-25T10:05:03.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 -- 172.21.15.18:0/3086228451 learned_addr learned my addr 172.21.15.18:0/3086228451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210b400640 1 --2- 172.21.15.18:0/3086228451 >> v2:172.21.15.167:3300/0 conn(0x7f210c0c70d0 0x7f210c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2102000640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 0x7f210c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 -- 172.21.15.18:0/3086228451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 msgr2=0x7f210c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 0x7f210c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 -- 172.21.15.18:0/3086228451 >> v2:172.21.15.167:3300/0 conn(0x7f210c0c70d0 msgr2=0x7f210c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 --2- 172.21.15.18:0/3086228451 >> v2:172.21.15.167:3300/0 conn(0x7f210c0c70d0 0x7f210c06ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f210aa00640 1 -- 172.21.15.18:0/3086228451 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0cd210 con 0x7f210c15dc00 2024-04-25T10:05:03.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.264+0000 7f2102000640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 0x7f210c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f210aa00640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c15dc00 0x7f210c0af770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f210c06f7c0 tx=0x7f20fc01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d349c91f5542aad3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f210a000640 1 -- 172.21.15.18:0/3086228451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0b0070 con 0x7f210c15dc00 2024-04-25T10:05:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f210a000640 1 -- 172.21.15.18:0/3086228451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20fc0ab600 con 0x7f210c15dc00 2024-04-25T10:05:03.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f210a000640 1 -- 172.21.15.18:0/3086228451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc0ab9d0 con 0x7f210c15dc00 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 -- 172.21.15.18:0/3086228451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c15dc00 msgr2=0x7f210c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c15dc00 0x7f210c0af770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f210c06f7c0 tx=0x7f20fc01c260 comp rx=0 tx=0).stop 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 -- 172.21.15.18:0/3086228451 shutdown_connections 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 --2- 172.21.15.18:0/3086228451 >> v2:172.21.15.167:3300/0 conn(0x7f210c0c70d0 0x7f210c06ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0d0150 0x7f210c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 --2- 172.21.15.18:0/3086228451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c15dc00 0x7f210c0af770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 -- 172.21.15.18:0/3086228451 >> 172.21.15.18:0/3086228451 conn(0x7f210c0b2240 msgr2=0x7f210c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:03.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 -- 172.21.15.18:0/3086228451 shutdown_connections 2024-04-25T10:05:03.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.268+0000 7f2111600640 1 -- 172.21.15.18:0/3086228451 wait complete. 2024-04-25T10:05:03.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 Processor -- start 2024-04-25T10:05:03.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- start start 2024-04-25T10:05:03.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0c70d0 0x7f210c13cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c15dc00 0x7f210c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0c74e0 con 0x7f210c0d0150 2024-04-25T10:05:03.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0cdf00 con 0x7f210c15dc00 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210c0c54b0 con 0x7f210c0c70d0 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36270/0 (socket says 172.21.15.18:36270) 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 -- 172.21.15.18:0/135102556 learned_addr learned my addr 172.21.15.18:0/135102556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f210aa00640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0c70d0 0x7f210c13cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f210b400640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c15dc00 0x7f210c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 -- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0c70d0 msgr2=0x7f210c13cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0c70d0 0x7f210c13cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 -- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c15dc00 msgr2=0x7f210c152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c15dc00 0x7f210c152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 -- 172.21.15.18:0/135102556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0b3460 con 0x7f210c0d0150 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2102000640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c7f0 tx=0x7f20f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f4007a30 con 0x7f210c0d0150 2024-04-25T10:05:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f4007bd0 con 0x7f210c0d0150 2024-04-25T10:05:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f40113f0 con 0x7f210c0d0150 2024-04-25T10:05:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f210c0b3700 con 0x7f210c0d0150 2024-04-25T10:05:03.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210c0b3cc0 con 0x7f210c0d0150 2024-04-25T10:05:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.272+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210c0745d0 con 0x7f210c0d0150 2024-04-25T10:05:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.276+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f20f4011590 con 0x7f210c0d0150 2024-04-25T10:05:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.276+0000 7f2103400640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 0x7f20e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.276+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f20f4084f80 con 0x7f210c0d0150 2024-04-25T10:05:03.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.276+0000 7f210aa00640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 0x7f20e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.276+0000 7f210aa00640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 0x7f20e8069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0ad000 tx=0x7f20fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:03.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.280+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f20f4015020 con 0x7f210c0d0150 2024-04-25T10:05:03.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:03.452+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f210c0c6c20 con 0x7f210c0d0150 2024-04-25T10:05:04.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.036+0000 7f2103400640 1 -- 172.21.15.18:0/135102556 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f20f4055b40 con 0x7f210c0d0150 2024-04-25T10:05:04.046 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 msgr2=0x7f20e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 0x7f20e8069420 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f20fc0ad000 tx=0x7f20fc008040 comp rx=0 tx=0).stop 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 msgr2=0x7f210c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f20f400c7f0 tx=0x7f20f400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 shutdown_connections 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f210c15dc00 0x7f210c152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f210c0d0150 0x7f210c156bc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20e8066f60 0x7f20e8069420 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 --2- 172.21.15.18:0/135102556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f210c0c70d0 0x7f210c13cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 >> 172.21.15.18:0/135102556 conn(0x7f210c0b2240 msgr2=0x7f210c0b0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 shutdown_connections 2024-04-25T10:05:04.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.040+0000 7f2111600640 1 -- 172.21.15.18:0/135102556 wait complete. 2024-04-25T10:05:04.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:05:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 Processor -- start 2024-04-25T10:05:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 -- start start 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd015b980 0x7efcd00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 0x7efcd00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00ce7f0 con 0x7efcd015b5a0 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00ce5b0 con 0x7efcd015b980 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd7a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00cfcd0 con 0x7efcd0071970 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd015b980 0x7efcd00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd015b980 0x7efcd00cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36278/0 (socket says 172.21.15.18:36278) 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 -- 172.21.15.18:0/175726154 learned_addr learned my addr 172.21.15.18:0/175726154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd5a00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 0x7efcd00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 -- 172.21.15.18:0/175726154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 msgr2=0x7efcd00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 0x7efcd00cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 -- 172.21.15.18:0/175726154 >> v1:172.21.15.18:6789/0 conn(0x7efcd015b5a0 legacy=0x7efcd00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcc7e00640 1 -- 172.21.15.18:0/175726154 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00cead0 con 0x7efcd015b980 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efcd5a00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 0x7efcd00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.208+0000 7efccfe00640 1 -- 172.21.15.18:0/175726154 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431459075 0 0) 0x7efcd00ce7f0 con 0x7efcd015b5a0 2024-04-25T10:05:04.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcc7e00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd015b980 0x7efcd00cbd30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009870 tx=0x7efcb801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b39fa5969e084ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efccfe00640 1 -- 172.21.15.18:0/175726154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb80a9610 con 0x7efcd015b980 2024-04-25T10:05:04.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efccfe00640 1 -- 172.21.15.18:0/175726154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcb80a97b0 con 0x7efcd015b980 2024-04-25T10:05:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efccfe00640 1 -- 172.21.15.18:0/175726154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb80a9b80 con 0x7efcd015b980 2024-04-25T10:05:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 -- 172.21.15.18:0/175726154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd015b980 msgr2=0x7efcd00cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd015b980 0x7efcd00cbd30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efcb8009870 tx=0x7efcb801c530 comp rx=0 tx=0).stop 2024-04-25T10:05:04.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 -- 172.21.15.18:0/175726154 shutdown_connections 2024-04-25T10:05:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd0071970 0x7efcd00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 --2- 172.21.15.18:0/175726154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd015b980 0x7efcd00cbd30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 -- 172.21.15.18:0/175726154 >> 172.21.15.18:0/175726154 conn(0x7efcd00b3390 msgr2=0x7efcd00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 -- 172.21.15.18:0/175726154 shutdown_connections 2024-04-25T10:05:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.212+0000 7efcd7a00640 1 -- 172.21.15.18:0/175726154 wait complete. 2024-04-25T10:05:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 Processor -- start 2024-04-25T10:05:04.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- start start 2024-04-25T10:05:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd015b5a0 0x7efcd015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 0x7efcd015cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00d0d40 con 0x7efcd0071970 2024-04-25T10:05:04.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00d0bc0 con 0x7efcd015b5a0 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd00d0ec0 con 0x7efcd015b980 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36288/0 (socket says 172.21.15.18:36288) 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 -- 172.21.15.18:0/3602687490 learned_addr learned my addr 172.21.15.18:0/3602687490 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcc7e00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd015b5a0 0x7efcd015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 0x7efcd015cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 -- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 msgr2=0x7efcd015cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 0x7efcd015cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 -- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd015b5a0 msgr2=0x7efcd015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd015b5a0 0x7efcd015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 -- 172.21.15.18:0/3602687490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd015ec70 con 0x7efcd0071970 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 0x7efcd015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:04.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd5000640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c500 tx=0x7efcc000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc0017070 con 0x7efcd0071970 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc0003600 con 0x7efcd0071970 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd014ac90 con 0x7efcd0071970 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc00039f0 con 0x7efcd0071970 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd015d540 con 0x7efcd0071970 2024-04-25T10:05:04.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.216+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd00745d0 con 0x7efcd0071970 2024-04-25T10:05:04.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.220+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efcc001a070 con 0x7efcd0071970 2024-04-25T10:05:04.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.220+0000 7efccd600640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 0x7efcac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.220+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efcc0084220 con 0x7efcd0071970 2024-04-25T10:05:04.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.220+0000 7efcc7e00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 0x7efcac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.220+0000 7efcc7e00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 0x7efcac069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ae000 tx=0x7efcb8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.224+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efcc0054e50 con 0x7efcd0071970 2024-04-25T10:05:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.440+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7efcd00cc960 con 0x7efcd0071970 2024-04-25T10:05:04.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.440+0000 7efccd600640 1 -- 172.21.15.18:0/3602687490 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v5) v1 ==== 80+0+6645 (secure 0 0 0) 0x7efcc0058ef0 con 0x7efcd0071970 2024-04-25T10:05:04.452 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:04.452 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.453 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.454 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.455 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:05:04.456 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:05:04.458 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.460 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.462 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:04.463 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.464 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mds", 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipm1HeWERAARE/a6amDXb1yOdwFvXAalA==", 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipmnYiWERAAf5hSfvrIFJLOOW+T1TEwMQ==", 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.465 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-osd", 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipmZJeWERAAlbHwlbvybKK0x1xxtz6eQA==", 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipmlqaWERAA3E+LGH+znxJ4pRniP/sTiw==", 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipmm7WWERAADjbuoIRslcytClDw2PeRDw==", 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQByKipmw8SWERAAAQA7AaZ6vGW0/uOQUw9qWA==", 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.467 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:05:04.468 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:04.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:04.469 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:05:04.469 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 msgr2=0x7efcac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 0x7efcac069420 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7efcb80ae000 tx=0x7efcb8009040 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 msgr2=0x7efcd015c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c500 tx=0x7efcc000c9c0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 shutdown_connections 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcac066f60 0x7efcac069420 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd015b980 0x7efcd015cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd015b5a0 0x7efcd015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 --2- 172.21.15.18:0/3602687490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd0071970 0x7efcd015c260 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 >> 172.21.15.18:0/3602687490 conn(0x7efcd00b3390 msgr2=0x7efcd00b2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 shutdown_connections 2024-04-25T10:05:04.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.444+0000 7efcd7a00640 1 -- 172.21.15.18:0/3602687490 wait complete. 2024-04-25T10:05:04.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T10:05:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 Processor -- start 2024-04-25T10:05:04.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 -- start start 2024-04-25T10:05:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11500b3090 0x7f11500b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115015bc40 con 0x7f115015acd0 2024-04-25T10:05:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115015b3a0 con 0x7f1150144120 2024-04-25T10:05:04.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.604+0000 7f1157200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115015e490 con 0x7f11500b3090 2024-04-25T10:05:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1147e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f115015acd0 0x7f115015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48620/0 (socket says 172.21.15.18:48620) 2024-04-25T10:05:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1147e00640 1 -- 172.21.15.18:0/2363311038 learned_addr learned my addr 172.21.15.18:0/2363311038 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1155200640 1 --2- 172.21.15.18:0/2363311038 >> v2:172.21.15.18:3300/0 conn(0x7f11500b3090 0x7f11500b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108675992 0 0) 0x7f115015bc40 con 0x7f115015acd0 2024-04-25T10:05:04.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1134005740 con 0x7f115015acd0 2024-04-25T10:05:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995149868 0 0) 0x7f115015b3a0 con 0x7f1150144120 2024-04-25T10:05:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1155200640 1 -- 172.21.15.18:0/2363311038 >> v1:172.21.15.167:6789/0 conn(0x7f1150144120 legacy=0x7f11500ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1155200640 1 -- 172.21.15.18:0/2363311038 >> v1:172.21.15.18:6789/0 conn(0x7f115015acd0 legacy=0x7f115015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1155200640 1 -- 172.21.15.18:0/2363311038 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115015b680 con 0x7f11500b3090 2024-04-25T10:05:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f1155200640 1 --2- 172.21.15.18:0/2363311038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3090 0x7f11500b3520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1148009d90 tx=0x7f114801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674455df51b3a1a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480b2070 con 0x7f11500b3090 2024-04-25T10:05:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11480a5890 con 0x7f11500b3090 2024-04-25T10:05:04.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.608+0000 7f114f400640 1 -- 172.21.15.18:0/2363311038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11480a5c60 con 0x7f11500b3090 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- 172.21.15.18:0/2363311038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3090 msgr2=0x7f11500b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 --2- 172.21.15.18:0/2363311038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3090 0x7f11500b3520 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1148009d90 tx=0x7f114801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- 172.21.15.18:0/2363311038 shutdown_connections 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 --2- 172.21.15.18:0/2363311038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3090 0x7f11500b3520 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- 172.21.15.18:0/2363311038 >> 172.21.15.18:0/2363311038 conn(0x7f1150067080 msgr2=0x7f115006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- 172.21.15.18:0/2363311038 shutdown_connections 2024-04-25T10:05:04.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- 172.21.15.18:0/2363311038 wait complete. 2024-04-25T10:05:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 Processor -- start 2024-04-25T10:05:04.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- start start 2024-04-25T10:05:04.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3090 0x7f1150149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015acd0 0x7f11501f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115006dc60 con 0x7f1150144120 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115006dae0 con 0x7f11500b3090 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1157200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115006dde0 con 0x7f115015acd0 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36306/0 (socket says 172.21.15.18:36306) 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 -- 172.21.15.18:0/2303175353 learned_addr learned my addr 172.21.15.18:0/2303175353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f114fe00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3090 0x7f1150149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1155200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015acd0 0x7f11501f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 -- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015acd0 msgr2=0x7f11501f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015acd0 0x7f11501f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 -- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3090 msgr2=0x7f1150149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3090 0x7f1150149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.612+0000 7f1147e00640 1 -- 172.21.15.18:0/2303175353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500ad6d0 con 0x7f1150144120 2024-04-25T10:05:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f1147e00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f113800c3c0 tx=0x7f113800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138017070 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1138005cf0 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11501f5de0 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380072f0 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11500adc30 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11500745d0 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f113801a070 con 0x7f1150144120 2024-04-25T10:05:04.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 0x7f112c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1138084260 con 0x7f1150144120 2024-04-25T10:05:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.616+0000 7f114fe00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 0x7f112c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.620+0000 7f114fe00640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 0x7f112c069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1140000f70 tx=0x7f1140009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.620+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11500ad6d0 con 0x7f1150144120 2024-04-25T10:05:04.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.844+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f11500b2050 con 0x7f1150144120 2024-04-25T10:05:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.844+0000 7f114cc00640 1 -- 172.21.15.18:0/2303175353 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1138054d40 con 0x7f1150144120 2024-04-25T10:05:04.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 msgr2=0x7f112c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 0x7f112c069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1140000f70 tx=0x7f1140009040 comp rx=0 tx=0).stop 2024-04-25T10:05:04.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 msgr2=0x7f11500ad190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:04.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f113800c3c0 tx=0x7f113800c880 comp rx=0 tx=0).stop 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 shutdown_connections 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f112c066f60 0x7f112c069420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015acd0 0x7f11501f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1150144120 0x7f11500ad190 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 --2- 172.21.15.18:0/2303175353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3090 0x7f1150149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 >> 172.21.15.18:0/2303175353 conn(0x7f1150067080 msgr2=0x7f11500b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 shutdown_connections 2024-04-25T10:05:04.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:04.848+0000 7f1157200640 1 -- 172.21.15.18:0/2303175353 wait complete. 2024-04-25T10:05:04.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T10:05:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.008+0000 7f6158e00640 1 Processor -- start 2024-04-25T10:05:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 -- start start 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f615415acd0 0x7f615415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61540b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615415bc40 con 0x7f6154144120 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f615415e490 con 0x7f615415acd0 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6158e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615415b150 con 0x7f615415ee60 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6154144120 0x7f61540ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48632/0 (socket says 172.21.15.18:48632) 2024-04-25T10:05:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151e00640 1 -- 172.21.15.18:0/1528103015 learned_addr learned my addr 172.21.15.18:0/1528103015 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1236039859 0 0) 0x7f615415bc40 con 0x7f6154144120 2024-04-25T10:05:05.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6138005740 con 0x7f6154144120 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 --2- 172.21.15.18:0/1528103015 >> v2:172.21.15.167:3300/0 conn(0x7f615415acd0 0x7f615415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6152800640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61540b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 372365758 0 0) 0x7f6138005740 con 0x7f6154144120 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 msgr2=0x7f61540b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61540b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 >> v2:172.21.15.167:3300/0 conn(0x7f615415acd0 msgr2=0x7f615415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 --2- 172.21.15.18:0/1528103015 >> v2:172.21.15.167:3300/0 conn(0x7f615415acd0 0x7f615415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615415b3a0 con 0x7f6154144120 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6144001680 con 0x7f6154144120 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 >> v1:172.21.15.18:6789/0 conn(0x7f6154144120 legacy=0x7f61540ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138005bd0 0x7f6138005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6138006a20 0x7f6138006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61380073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615415e490 con 0x7f6138006a20 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615415b150 con 0x7f6138005bd0 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613800dc10 con 0x7f615415ee60 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6138006a20 0x7f6138006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6152800640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61380073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f6151e00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138005bd0 0x7f6138005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 -- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 msgr2=0x7f61380073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f615415ee60 0x7f61380073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 -- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138005bd0 msgr2=0x7f6138005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6138005bd0 0x7f6138005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.012+0000 7f614be00640 1 -- 172.21.15.18:0/1528103015 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6138005740 con 0x7f6138006a20 2024-04-25T10:05:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f614be00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6138006a20 0x7f6138006ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f613c009ae0 tx=0x7f613c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db97d855ad9bfc99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0096b0 con 0x7f6138006a20 2024-04-25T10:05:05.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c0a64c0 con 0x7f6138006a20 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6151400640 1 -- 172.21.15.18:0/1528103015 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a68b0 con 0x7f6138006a20 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 -- 172.21.15.18:0/1528103015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6138006a20 msgr2=0x7f6138006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 --2- 172.21.15.18:0/1528103015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6138006a20 0x7f6138006ea0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f613c009ae0 tx=0x7f613c01ca50 comp rx=0 tx=0).stop 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6152800640 1 -- 172.21.15.18:0/1528103015 reap_dead start 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 -- 172.21.15.18:0/1528103015 shutdown_connections 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 -- 172.21.15.18:0/1528103015 >> 172.21.15.18:0/1528103015 conn(0x7f6154067080 msgr2=0x7f615406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 -- 172.21.15.18:0/1528103015 shutdown_connections 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.016+0000 7f6158e00640 1 -- 172.21.15.18:0/1528103015 wait complete. 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 Processor -- start 2024-04-25T10:05:05.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- start start 2024-04-25T10:05:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6138006a20 0x7f61541500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615413eae0 0x7f615413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615406d660 con 0x7f61540adab0 2024-04-25T10:05:05.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615406d4e0 con 0x7f615413eae0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615406d7e0 con 0x7f6138006a20 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36324/0 (socket says 172.21.15.18:36324) 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 -- 172.21.15.18:0/945372706 learned_addr learned my addr 172.21.15.18:0/945372706 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6151e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6138006a20 0x7f61541500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f614be00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615413eae0 0x7f615413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 -- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6138006a20 msgr2=0x7f61541500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6138006a20 0x7f61541500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 -- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615413eae0 msgr2=0x7f615413ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615413eae0 0x7f615413ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 -- 172.21.15.18:0/945372706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61540ae7e0 con 0x7f61540adab0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6152800640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f614c009e90 tx=0x7f614c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c011e80 con 0x7f61540adab0 2024-04-25T10:05:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c01b070 con 0x7f61540adab0 2024-04-25T10:05:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0039a0 con 0x7f61540adab0 2024-04-25T10:05:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615413b640 con 0x7f61540adab0 2024-04-25T10:05:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615413bc00 con 0x7f61540adab0 2024-04-25T10:05:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.020+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615413be00 con 0x7f61540adab0 2024-04-25T10:05:05.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.024+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f614c003b40 con 0x7f61540adab0 2024-04-25T10:05:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.024+0000 7f614a000640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 0x7f6130069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.024+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f614c085660 con 0x7f61540adab0 2024-04-25T10:05:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.024+0000 7f6151e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 0x7f6130069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.024+0000 7f6151e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 0x7f6130069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6144001ec0 tx=0x7f6144007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.028+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f615413be00 con 0x7f61540adab0 2024-04-25T10:05:05.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.248+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f61540745d0 con 0x7f61540adab0 2024-04-25T10:05:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f614a000640 1 -- 172.21.15.18:0/945372706 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f614c025020 con 0x7f61540adab0 2024-04-25T10:05:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 msgr2=0x7f6130069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 0x7f6130069420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6144001ec0 tx=0x7f6144007040 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 msgr2=0x7f61540adf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f614c009e90 tx=0x7f614c0115a0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 shutdown_connections 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61540adab0 0x7f61540adf30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f615413eae0 0x7f615413ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6130066f60 0x7f6130069420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 --2- 172.21.15.18:0/945372706 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6138006a20 0x7f61541500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 >> 172.21.15.18:0/945372706 conn(0x7f6154067080 msgr2=0x7f61540ccb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 shutdown_connections 2024-04-25T10:05:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.252+0000 7f6158e00640 1 -- 172.21.15.18:0/945372706 wait complete. 2024-04-25T10:05:05.283 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T10:05:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 Processor -- start 2024-04-25T10:05:05.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 -- start start 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4f64144120 0x7f4f6415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f640b3090 0x7f4f640b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6415bc40 con 0x7f4f640ccbf0 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6415e490 con 0x7f4f640b3090 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f6ba00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6415b3a0 con 0x7f4f64144120 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f640b3090 0x7f4f640b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f63e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4f640ccbf0 0x7f4f6415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48648/0 (socket says 172.21.15.18:48648) 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f63e00640 1 -- 172.21.15.18:0/1632962415 learned_addr learned my addr 172.21.15.18:0/1632962415 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69000640 1 --2- 172.21.15.18:0/1632962415 >> v2:172.21.15.167:3300/0 conn(0x7f4f64144120 0x7f4f6415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69a00640 1 -- 172.21.15.18:0/1632962415 >> v2:172.21.15.167:3300/0 conn(0x7f4f64144120 msgr2=0x7f4f6415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69a00640 1 --2- 172.21.15.18:0/1632962415 >> v2:172.21.15.167:3300/0 conn(0x7f4f64144120 0x7f4f6415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69a00640 1 -- 172.21.15.18:0/1632962415 >> v1:172.21.15.18:6789/0 conn(0x7f4f640ccbf0 legacy=0x7f4f6415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.416+0000 7f4f69a00640 1 -- 172.21.15.18:0/1632962415 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6415b680 con 0x7f4f640b3090 2024-04-25T10:05:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f69a00640 1 --2- 172.21.15.18:0/1632962415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f640b3090 0x7f4f640b3520 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f6406b9b0 tx=0x7f4f5c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9345f1fbdd0e4974 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f63400640 1 -- 172.21.15.18:0/1632962415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0b2070 con 0x7f4f640b3090 2024-04-25T10:05:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f63400640 1 -- 172.21.15.18:0/1632962415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0a5770 con 0x7f4f640b3090 2024-04-25T10:05:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f63400640 1 -- 172.21.15.18:0/1632962415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0a5b40 con 0x7f4f640b3090 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 -- 172.21.15.18:0/1632962415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f640b3090 msgr2=0x7f4f640b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/1632962415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f640b3090 0x7f4f640b3520 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4f6406b9b0 tx=0x7f4f5c01c8a0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 -- 172.21.15.18:0/1632962415 shutdown_connections 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/1632962415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f640b3090 0x7f4f640b3520 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/1632962415 >> v2:172.21.15.167:3300/0 conn(0x7f4f64144120 0x7f4f6415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 -- 172.21.15.18:0/1632962415 >> 172.21.15.18:0/1632962415 conn(0x7f4f64067080 msgr2=0x7f4f6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 -- 172.21.15.18:0/1632962415 shutdown_connections 2024-04-25T10:05:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.420+0000 7f4f6ba00640 1 -- 172.21.15.18:0/1632962415 wait complete. 2024-04-25T10:05:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 Processor -- start 2024-04-25T10:05:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- start start 2024-04-25T10:05:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f640b3090 0x7f4f6412b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f640ccbf0 0x7f4f64163c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64165dc0 con 0x7f4f64144120 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64165c40 con 0x7f4f640b3090 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f64165f40 con 0x7f4f640ccbf0 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36336/0 (socket says 172.21.15.18:36336) 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 -- 172.21.15.18:0/2496237866 learned_addr learned my addr 172.21.15.18:0/2496237866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69000640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f640b3090 0x7f4f6412b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f63e00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f640ccbf0 0x7f4f64163c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 -- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f640ccbf0 msgr2=0x7f4f64163c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f640ccbf0 0x7f4f64163c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 -- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f640b3090 msgr2=0x7f4f6412b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f640b3090 0x7f4f6412b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 -- 172.21.15.18:0/2496237866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6415a830 con 0x7f4f64144120 2024-04-25T10:05:05.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f69a00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c01a4d0 tx=0x7f4f5c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0bd020 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0b8470 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0b2040 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f64127570 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f64127af0 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.424+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f640745d0 con 0x7f4f64144120 2024-04-25T10:05:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.428+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f5c0c0020 con 0x7f4f64144120 2024-04-25T10:05:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.428+0000 7f4f60c00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 0x7f4f44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.428+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4f5c11fb20 con 0x7f4f64144120 2024-04-25T10:05:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.428+0000 7f4f69000640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 0x7f4f44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.428+0000 7f4f69000640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 0x7f4f44069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f580079c0 tx=0x7f4f58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.432+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f5c0c7070 con 0x7f4f64144120 2024-04-25T10:05:05.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.648+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f4f6406d940 con 0x7f4f64144120 2024-04-25T10:05:05.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.652+0000 7f4f60c00640 1 -- 172.21.15.18:0/2496237866 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4f6415a830 con 0x7f4f64144120 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 msgr2=0x7f4f44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 0x7f4f44069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4f580079c0 tx=0x7f4f58008040 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 msgr2=0x7f4f6415a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c01a4d0 tx=0x7f4f5c019640 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 shutdown_connections 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f64144120 0x7f4f6415a2f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4f44066f60 0x7f4f44069420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4f640ccbf0 0x7f4f64163c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 --2- 172.21.15.18:0/2496237866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f640b3090 0x7f4f6412b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 >> 172.21.15.18:0/2496237866 conn(0x7f4f64067080 msgr2=0x7f4f641648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 shutdown_connections 2024-04-25T10:05:05.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.656+0000 7f4f6ba00640 1 -- 172.21.15.18:0/2496237866 wait complete. 2024-04-25T10:05:05.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T10:05:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.816+0000 7f679bc00640 1 Processor -- start 2024-04-25T10:05:05.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.816+0000 7f679bc00640 1 -- start start 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6794144120 0x7f679415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67940ccbf0 0x7f679415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f67940b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679415e490 con 0x7f67940ccbf0 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f679415bc40 con 0x7f6794144120 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f679bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679415b3a0 con 0x7f679415ee60 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67940ccbf0 0x7f679415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67940ccbf0 0x7f679415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36344/0 (socket says 172.21.15.18:36344) 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 -- 172.21.15.18:0/1049004769 learned_addr learned my addr 172.21.15.18:0/1049004769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:05.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f6799c00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f67940b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f6799200640 1 --2- 172.21.15.18:0/1049004769 >> v2:172.21.15.167:3300/0 conn(0x7f6794144120 0x7f679415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 -- 172.21.15.18:0/1049004769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 msgr2=0x7f67940b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f67940b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 -- 172.21.15.18:0/1049004769 >> v2:172.21.15.167:3300/0 conn(0x7f6794144120 msgr2=0x7f679415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:05.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 --2- 172.21.15.18:0/1049004769 >> v2:172.21.15.167:3300/0 conn(0x7f6794144120 0x7f679415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 -- 172.21.15.18:0/1049004769 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679415b680 con 0x7f67940ccbf0 2024-04-25T10:05:05.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.820+0000 7f678be00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67940ccbf0 0x7f679415e920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f679406b9b0 tx=0x7f677c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ba727228771771 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f6793e00640 1 -- 172.21.15.18:0/1049004769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0b2070 con 0x7f67940ccbf0 2024-04-25T10:05:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f6793e00640 1 -- 172.21.15.18:0/1049004769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0a9070 con 0x7f67940ccbf0 2024-04-25T10:05:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f6793e00640 1 -- 172.21.15.18:0/1049004769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0ad880 con 0x7f67940ccbf0 2024-04-25T10:05:05.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- 172.21.15.18:0/1049004769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67940ccbf0 msgr2=0x7f679415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67940ccbf0 0x7f679415e920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f679406b9b0 tx=0x7f677c01c490 comp rx=0 tx=0).stop 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- 172.21.15.18:0/1049004769 shutdown_connections 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f67940b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- 172.21.15.18:0/1049004769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67940ccbf0 0x7f679415e920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- 172.21.15.18:0/1049004769 >> v2:172.21.15.167:3300/0 conn(0x7f6794144120 0x7f679415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- 172.21.15.18:0/1049004769 >> 172.21.15.18:0/1049004769 conn(0x7f6794067080 msgr2=0x7f679406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- 172.21.15.18:0/1049004769 shutdown_connections 2024-04-25T10:05:05.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- 172.21.15.18:0/1049004769 wait complete. 2024-04-25T10:05:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 Processor -- start 2024-04-25T10:05:05.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- start start 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 0x7f679415c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f679415f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794071640 con 0x7f6794144120 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940714c0 con 0x7f67940ccbf0 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f679bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940717c0 con 0x7f679415ee60 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f678be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f678be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36348/0 (socket says 172.21.15.18:36348) 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.824+0000 7f678be00640 1 -- 172.21.15.18:0/3621397880 learned_addr learned my addr 172.21.15.18:0/3621397880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 -- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 msgr2=0x7f679415f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f679415f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 -- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 msgr2=0x7f679415c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:05.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6799200640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 0x7f679415c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 0x7f679415c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 -- 172.21.15.18:0/3621397880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67941600a0 con 0x7f6794144120 2024-04-25T10:05:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6799200640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 0x7f679415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:05.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f678be00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097c0 tx=0x7f677c019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0bb070 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677c0adbd0 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6794160380 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677c0b2040 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6794160940 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67940745d0 con 0x7f6794144120 2024-04-25T10:05:05.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f677c0be070 con 0x7f6794144120 2024-04-25T10:05:05.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 0x7f6770069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:05.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.828+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f677c11dea0 con 0x7f6794144120 2024-04-25T10:05:05.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.832+0000 7f6799200640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 0x7f6770069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:05.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.832+0000 7f6799200640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 0x7f6770069470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6784009a60 tx=0x7f6784008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:05.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:05.832+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f677c016110 con 0x7f6794144120 2024-04-25T10:05:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.052+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f679406ae20 con 0x7f6794144120 2024-04-25T10:05:06.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f6791600640 1 -- 172.21.15.18:0/3621397880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f677c0ef0e0 con 0x7f6794144120 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 msgr2=0x7f6770069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 0x7f6770069470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6784009a60 tx=0x7f6784008040 comp rx=0 tx=0).stop 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 msgr2=0x7f679415f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f677c0097c0 tx=0x7f677c019230 comp rx=0 tx=0).stop 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 shutdown_connections 2024-04-25T10:05:06.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6770066fb0 0x7f6770069470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f679415ee60 0x7f679415f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6794144120 0x7f679415f3e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 --2- 172.21.15.18:0/3621397880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67940ccbf0 0x7f679415c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 >> 172.21.15.18:0/3621397880 conn(0x7f6794067080 msgr2=0x7f6794141000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 shutdown_connections 2024-04-25T10:05:06.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.056+0000 7f679bc00640 1 -- 172.21.15.18:0/3621397880 wait complete. 2024-04-25T10:05:06.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T10:05:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 Processor -- start 2024-04-25T10:05:06.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 -- start start 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f000c09a170 0x7f000c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f000c06bf30 0x7f000c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f000c15e040 con 0x7f000c15dc60 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c0cff80 con 0x7f000c06bf30 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0013a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000c0d0260 con 0x7f000c09a170 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f000c06bf30 0x7f000c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f000c06bf30 0x7f000c0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36358/0 (socket says 172.21.15.18:36358) 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 -- 172.21.15.18:0/2888904587 learned_addr learned my addr 172.21.15.18:0/2888904587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0003e00640 1 --2- 172.21.15.18:0/2888904587 >> v2:172.21.15.167:3300/0 conn(0x7f000c09a170 0x7f000c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 -- 172.21.15.18:0/2888904587 >> v2:172.21.15.167:3300/0 conn(0x7f000c09a170 msgr2=0x7f000c0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 --2- 172.21.15.18:0/2888904587 >> v2:172.21.15.167:3300/0 conn(0x7f000c09a170 0x7f000c0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 -- 172.21.15.18:0/2888904587 >> v1:172.21.15.167:6789/0 conn(0x7f000c15dc60 legacy=0x7f000c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.220+0000 7f0011a00640 1 -- 172.21.15.18:0/2888904587 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c0d0540 con 0x7f000c06bf30 2024-04-25T10:05:06.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0011a00640 1 --2- 172.21.15.18:0/2888904587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c06bf30 0x7f000c0cf8a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f000c0d2810 tx=0x7f000401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddfadafd88a07a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f000be00640 1 -- 172.21.15.18:0/2888904587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00040a5760 con 0x7f000c06bf30 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f000be00640 1 -- 172.21.15.18:0/2888904587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00040a5900 con 0x7f000c06bf30 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f000be00640 1 -- 172.21.15.18:0/2888904587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00040a5cd0 con 0x7f000c06bf30 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 -- 172.21.15.18:0/2888904587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c06bf30 msgr2=0x7f000c0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 --2- 172.21.15.18:0/2888904587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c06bf30 0x7f000c0cf8a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f000c0d2810 tx=0x7f000401c8a0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 -- 172.21.15.18:0/2888904587 shutdown_connections 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 --2- 172.21.15.18:0/2888904587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c06bf30 0x7f000c0cf8a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 --2- 172.21.15.18:0/2888904587 >> v2:172.21.15.167:3300/0 conn(0x7f000c09a170 0x7f000c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 -- 172.21.15.18:0/2888904587 >> 172.21.15.18:0/2888904587 conn(0x7f000c0b3200 msgr2=0x7f000c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 -- 172.21.15.18:0/2888904587 shutdown_connections 2024-04-25T10:05:06.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.224+0000 7f0013a00640 1 -- 172.21.15.18:0/2888904587 wait complete. 2024-04-25T10:05:06.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 Processor -- start 2024-04-25T10:05:06.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- start start 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 0x7f000c155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f000c09a170 0x7f000c0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cc6f0 con 0x7f000c15dc60 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cc570 con 0x7f000c06bf30 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000c0cc870 con 0x7f000c09a170 2024-04-25T10:05:06.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36374/0 (socket says 172.21.15.18:36374) 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 -- 172.21.15.18:0/2649915394 learned_addr learned my addr 172.21.15.18:0/2649915394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0003e00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f000c09a170 0x7f000c0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011000640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 0x7f000c155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 -- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f000c09a170 msgr2=0x7f000c0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f000c09a170 0x7f000c0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 -- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 msgr2=0x7f000c155220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 0x7f000c155220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 -- 172.21.15.18:0/2649915394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f000c1578a0 con 0x7f000c15dc60 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011000640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 0x7f000c155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:06.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0011a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f00040af040 tx=0x7f0004019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00040bc020 con 0x7f000c15dc60 2024-04-25T10:05:06.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00040b8670 con 0x7f000c15dc60 2024-04-25T10:05:06.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004009510 con 0x7f000c15dc60 2024-04-25T10:05:06.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f000c157b80 con 0x7f000c15dc60 2024-04-25T10:05:06.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f000c158140 con 0x7f000c15dc60 2024-04-25T10:05:06.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.228+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000c0745d0 con 0x7f000c15dc60 2024-04-25T10:05:06.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.232+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00040bf020 con 0x7f000c15dc60 2024-04-25T10:05:06.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.232+0000 7f0009600640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 0x7effe8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.232+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f000411fde0 con 0x7f000c15dc60 2024-04-25T10:05:06.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.232+0000 7f0011000640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 0x7effe8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.232+0000 7f0011000640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 0x7effe8069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f000c099e70 tx=0x7efffc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.236+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00040c6030 con 0x7f000c15dc60 2024-04-25T10:05:06.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.460+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f000c0b7590 con 0x7f000c15dc60 2024-04-25T10:05:06.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.460+0000 7f0009600640 1 -- 172.21.15.18:0/2649915394 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f00040165e0 con 0x7f000c15dc60 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 msgr2=0x7effe8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 0x7effe8069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f000c099e70 tx=0x7efffc009040 comp rx=0 tx=0).stop 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 msgr2=0x7f000c158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f00040af040 tx=0x7f0004019640 comp rx=0 tx=0).stop 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 shutdown_connections 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f000c15dc60 0x7f000c158940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7effe8066f60 0x7effe8069420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f000c09a170 0x7f000c0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 --2- 172.21.15.18:0/2649915394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f000c06bf30 0x7f000c155220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 >> 172.21.15.18:0/2649915394 conn(0x7f000c0b3200 msgr2=0x7f000c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 shutdown_connections 2024-04-25T10:05:06.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.464+0000 7f0013a00640 1 -- 172.21.15.18:0/2649915394 wait complete. 2024-04-25T10:05:06.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T10:05:06.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 Processor -- start 2024-04-25T10:05:06.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 -- start start 2024-04-25T10:05:06.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5b415dc00 0x7fc5b40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5b40b30d0 con 0x7fc5b40c70d0 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b40cd860 con 0x7fc5b415dc00 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5bc800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40ccf30 con 0x7fc5b40d0150 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5b415dc00 0x7fc5b40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5b415dc00 0x7fc5b40af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36380/0 (socket says 172.21.15.18:36380) 2024-04-25T10:05:06.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 -- 172.21.15.18:0/277558874 learned_addr learned my addr 172.21.15.18:0/277558874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9400640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 -- 172.21.15.18:0/277558874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 msgr2=0x7fc5b40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 -- 172.21.15.18:0/277558874 >> v1:172.21.15.167:6789/0 conn(0x7fc5b40c70d0 legacy=0x7fc5b406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9e00640 1 -- 172.21.15.18:0/277558874 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40cd210 con 0x7fc5b415dc00 2024-04-25T10:05:06.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.624+0000 7fc5b9400640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5b9e00640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40af770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009870 tx=0x7fc5a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b50ad2a8df1283b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5b8a00640 1 -- 172.21.15.18:0/277558874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80b0070 con 0x7fc5b415dc00 2024-04-25T10:05:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5b8a00640 1 -- 172.21.15.18:0/277558874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a80ab600 con 0x7fc5b415dc00 2024-04-25T10:05:06.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5b8a00640 1 -- 172.21.15.18:0/277558874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80ab9d0 con 0x7fc5b415dc00 2024-04-25T10:05:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 -- 172.21.15.18:0/277558874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 msgr2=0x7fc5b40af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40af770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009870 tx=0x7fc5a801c520 comp rx=0 tx=0).stop 2024-04-25T10:05:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 -- 172.21.15.18:0/277558874 shutdown_connections 2024-04-25T10:05:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 --2- 172.21.15.18:0/277558874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40af770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 -- 172.21.15.18:0/277558874 >> 172.21.15.18:0/277558874 conn(0x7fc5b40b2240 msgr2=0x7fc5b40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 -- 172.21.15.18:0/277558874 shutdown_connections 2024-04-25T10:05:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.628+0000 7fc5bc800640 1 -- 172.21.15.18:0/277558874 wait complete. 2024-04-25T10:05:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 Processor -- start 2024-04-25T10:05:06.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- start start 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5b40c70d0 0x7fc5b40b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40d0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b416a640 con 0x7fc5b415dc00 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40cdf00 con 0x7fc5b40c70d0 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b416a7c0 con 0x7fc5b40d0150 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36390/0 (socket says 172.21.15.18:36390) 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 -- 172.21.15.18:0/1371885625 learned_addr learned my addr 172.21.15.18:0/1371885625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:06.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5b9400640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5b9e00640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5b40c70d0 0x7fc5b40b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 -- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 msgr2=0x7fc5b40d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 -- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5b40c70d0 msgr2=0x7fc5b40b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5b40c70d0 0x7fc5b40b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 -- 172.21.15.18:0/1371885625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40b1ca0 con 0x7fc5b415dc00 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5b9400640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ba800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c780 tx=0x7fc5b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b0004b70 con 0x7fc5b415dc00 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b0004d10 con 0x7fc5b415dc00 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b4152090 con 0x7fc5b415dc00 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b000aa90 con 0x7fc5b415dc00 2024-04-25T10:05:06.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.632+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b4152650 con 0x7fc5b415dc00 2024-04-25T10:05:06.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b40745d0 con 0x7fc5b415dc00 2024-04-25T10:05:06.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc5b000ac30 con 0x7fc5b415dc00 2024-04-25T10:05:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5ae000640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 0x7fc598069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc5b0085190 con 0x7fc5b415dc00 2024-04-25T10:05:06.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5b9e00640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 0x7fc598069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:06.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.636+0000 7fc5b9e00640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 0x7fc598069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80ad000 tx=0x7fc5a80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:06.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.640+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5b0020070 con 0x7fc5b415dc00 2024-04-25T10:05:06.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.856+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fc5b40ad5c0 con 0x7fc5b415dc00 2024-04-25T10:05:06.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5ae000640 1 -- 172.21.15.18:0/1371885625 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc5b40b1ca0 con 0x7fc5b415dc00 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 msgr2=0x7fc598069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 0x7fc598069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80ad000 tx=0x7fc5a80a6000 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 msgr2=0x7fc5b40d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc5b000c780 tx=0x7fc5b000cc40 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 shutdown_connections 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5b415dc00 0x7fc5b40d0a90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc598066f60 0x7fc598069420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5b40d0150 0x7fc5b40d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 --2- 172.21.15.18:0/1371885625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5b40c70d0 0x7fc5b40b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 >> 172.21.15.18:0/1371885625 conn(0x7fc5b40b2240 msgr2=0x7fc5b40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 shutdown_connections 2024-04-25T10:05:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:06.860+0000 7fc5bc800640 1 -- 172.21.15.18:0/1371885625 wait complete. 2024-04-25T10:05:06.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:07.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 Processor -- start 2024-04-25T10:05:07.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 -- start start 2024-04-25T10:05:07.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99b8145270 0x7f99b815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 0x7f99b80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80cc4e0 con 0x7f99b80b1750 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b8145650 con 0x7f99b8145270 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99bd400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80ce040 con 0x7f99b80cd4d0 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99b8145270 0x7f99b815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99b8145270 0x7f99b815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36402/0 (socket says 172.21.15.18:36402) 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 -- 172.21.15.18:0/2152892446 learned_addr learned my addr 172.21.15.18:0/2152892446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b7200640 1 --1- 172.21.15.18:0/2152892446 >> v1:172.21.15.18:6789/0 conn(0x7f99b80b1750 0x7f99b80b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48660/0 (socket says 172.21.15.18:48660) 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99ade00640 1 --2- 172.21.15.18:0/2152892446 >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 0x7f99b80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 -- 172.21.15.18:0/2152892446 >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 msgr2=0x7f99b80cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 --2- 172.21.15.18:0/2152892446 >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 0x7f99b80cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 -- 172.21.15.18:0/2152892446 >> v1:172.21.15.18:6789/0 conn(0x7f99b80b1750 legacy=0x7f99b80b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b6800640 1 -- 172.21.15.18:0/2152892446 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80ce320 con 0x7f99b8145270 2024-04-25T10:05:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99ade00640 1 --2- 172.21.15.18:0/2152892446 >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 0x7f99b80cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:07.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.024+0000 7f99b5e00640 1 -- 172.21.15.18:0/2152892446 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283275209 0 0) 0x7f99b80cc4e0 con 0x7f99b80b1750 2024-04-25T10:05:07.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99b6800640 1 --2- 172.21.15.18:0/2152892446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b8145270 0x7f99b815fe50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b24b0 tx=0x7f99a801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9ace41484d3b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99b5e00640 1 -- 172.21.15.18:0/2152892446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ab610 con 0x7f99b8145270 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99b5e00640 1 -- 172.21.15.18:0/2152892446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80b0070 con 0x7f99b8145270 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99b5e00640 1 -- 172.21.15.18:0/2152892446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ab9d0 con 0x7f99b8145270 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 -- 172.21.15.18:0/2152892446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b8145270 msgr2=0x7f99b815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 --2- 172.21.15.18:0/2152892446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b8145270 0x7f99b815fe50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99b80b24b0 tx=0x7f99a801c520 comp rx=0 tx=0).stop 2024-04-25T10:05:07.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 -- 172.21.15.18:0/2152892446 shutdown_connections 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 --2- 172.21.15.18:0/2152892446 >> v2:172.21.15.167:3300/0 conn(0x7f99b80cd4d0 0x7f99b80cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 --2- 172.21.15.18:0/2152892446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b8145270 0x7f99b815fe50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 -- 172.21.15.18:0/2152892446 >> 172.21.15.18:0/2152892446 conn(0x7f99b8066fa0 msgr2=0x7f99b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 -- 172.21.15.18:0/2152892446 shutdown_connections 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.028+0000 7f99bd400640 1 -- 172.21.15.18:0/2152892446 wait complete. 2024-04-25T10:05:07.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 Processor -- start 2024-04-25T10:05:07.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- start start 2024-04-25T10:05:07.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 0x7f99b815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99b8145270 0x7f99b80b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815c710 con 0x7f99b80cd4d0 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815c590 con 0x7f99b80b1750 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815c890 con 0x7f99b8145270 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36404/0 (socket says 172.21.15.18:36404) 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 -- 172.21.15.18:0/1672990833 learned_addr learned my addr 172.21.15.18:0/1672990833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99b7200640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99b8145270 0x7f99b80b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99b6800640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 0x7f99b815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 -- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99b8145270 msgr2=0x7f99b80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99b8145270 0x7f99b80b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 -- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 msgr2=0x7f99b815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 0x7f99b815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 -- 172.21.15.18:0/1672990833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80b4590 con 0x7f99b80cd4d0 2024-04-25T10:05:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99b6800640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 0x7f99b815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:07.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99ade00640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c7c0 tx=0x7f99a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0007a30 con 0x7f99b80cd4d0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0007bd0 con 0x7f99b80cd4d0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a00113f0 con 0x7f99b80cd4d0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b80b4870 con 0x7f99b80cd4d0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b815b190 con 0x7f99b80cd4d0 2024-04-25T10:05:07.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.032+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b80745d0 con 0x7f99b80cd4d0 2024-04-25T10:05:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.036+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99a0011590 con 0x7f99b80cd4d0 2024-04-25T10:05:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.036+0000 7f99af400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 0x7f9994069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.036+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f99a0084ff0 con 0x7f99b80cd4d0 2024-04-25T10:05:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.036+0000 7f99b6800640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 0x7f9994069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.036+0000 7f99b6800640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 0x7f9994069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99a80af000 tx=0x7f99a80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.040+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f99a0015020 con 0x7f99b80cd4d0 2024-04-25T10:05:07.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.200+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b806b8e0 con 0x7f99b80cd4d0 2024-04-25T10:05:07.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99af400640 1 -- 172.21.15.18:0/1672990833 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13140 (secure 0 0 0) 0x7f99a0055b80 con 0x7f99b80cd4d0 2024-04-25T10:05:07.213 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:07.213 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:04.051306+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:07.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 msgr2=0x7f9994069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 0x7f9994069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f99a80af000 tx=0x7f99a80a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 msgr2=0x7f99b81f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99a000c7c0 tx=0x7f99a000cc80 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 shutdown_connections 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9994066f60 0x7f9994069420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f99b8145270 0x7f99b80b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99b80cd4d0 0x7f99b81f7340 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 --2- 172.21.15.18:0/1672990833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99b80b1750 0x7f99b815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 >> 172.21.15.18:0/1672990833 conn(0x7f99b8066fa0 msgr2=0x7f99b806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 shutdown_connections 2024-04-25T10:05:07.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.204+0000 7f99bd400640 1 -- 172.21.15.18:0/1672990833 wait complete. 2024-04-25T10:05:07.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:07.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:07.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.368+0000 7f88cf200640 1 Processor -- start 2024-04-25T10:05:07.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.368+0000 7f88cf200640 1 -- start start 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cf200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88c806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cf200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c815e9a0 con 0x7f88c8150f40 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cf200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c815dbe0 con 0x7f88c815af40 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cf200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c806f530 con 0x7f88c8072210 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f88c8150f40 0x7f88c8071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48676/0 (socket says 172.21.15.18:48676) 2024-04-25T10:05:07.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7e00640 1 -- 172.21.15.18:0/2833047306 learned_addr learned my addr 172.21.15.18:0/2833047306 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197468068 0 0) 0x7f88c815e9a0 con 0x7f88c8150f40 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ac004640 con 0x7f88c8150f40 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88bf400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88c806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1396773156 0 0) 0x7f88ac004640 con 0x7f88c8150f40 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 msgr2=0x7f88c806ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88c806ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 >> v1:172.21.15.167:6789/0 conn(0x7f88c815af40 legacy=0x7f88c80cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c815dec0 con 0x7f88c8150f40 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f88b8001a00 con 0x7f88c8150f40 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 >> v1:172.21.15.18:6789/0 conn(0x7f88c8150f40 legacy=0x7f88c8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac004b00 0x7f88ac004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88ac005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ac005eb0 0x7f88ac006330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c806f530 con 0x7f88ac005eb0 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0036d0 con 0x7f88ac004b00 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ac0038d0 con 0x7f88c8072210 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ac005eb0 0x7f88ac006330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88bf400640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88ac005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88c7e00640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac004b00 0x7f88ac004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 -- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 msgr2=0x7f88ac005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c8072210 0x7f88ac005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 -- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac004b00 msgr2=0x7f88ac004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88ac004b00 0x7f88ac004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.372+0000 7f88cd200640 1 -- 172.21.15.18:0/2833047306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ac004640 con 0x7f88ac005eb0 2024-04-25T10:05:07.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cd200640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ac005eb0 0x7f88ac006330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001750 tx=0x7f88c001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcd171d301e3e41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00013a0 con 0x7f88ac005eb0 2024-04-25T10:05:07.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00052f0 con 0x7f88ac005eb0 2024-04-25T10:05:07.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88c7400640 1 -- 172.21.15.18:0/2833047306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0003840 con 0x7f88ac005eb0 2024-04-25T10:05:07.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- 172.21.15.18:0/2833047306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ac005eb0 msgr2=0x7f88ac006330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 --2- 172.21.15.18:0/2833047306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88ac005eb0 0x7f88ac006330 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001750 tx=0x7f88c001c3c0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cd200640 1 -- 172.21.15.18:0/2833047306 reap_dead start 2024-04-25T10:05:07.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- 172.21.15.18:0/2833047306 shutdown_connections 2024-04-25T10:05:07.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- 172.21.15.18:0/2833047306 >> 172.21.15.18:0/2833047306 conn(0x7f88c8067080 msgr2=0x7f88c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- 172.21.15.18:0/2833047306 shutdown_connections 2024-04-25T10:05:07.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- 172.21.15.18:0/2833047306 wait complete. 2024-04-25T10:05:07.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 Processor -- start 2024-04-25T10:05:07.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.376+0000 7f88cf200640 1 -- start start 2024-04-25T10:05:07.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c81441c0 0x7f88c80adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88c80ae1c0 0x7f88c81590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ce550 con 0x7f88c8143de0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ce3d0 con 0x7f88c80ae1c0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ce6d0 con 0x7f88c81441c0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36422/0 (socket says 172.21.15.18:36422) 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 -- 172.21.15.18:0/1954787704 learned_addr learned my addr 172.21.15.18:0/1954787704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88bf400640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c81441c0 0x7f88c80adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cd200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88c80ae1c0 0x7f88c81590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 -- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c81441c0 msgr2=0x7f88c80adc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c81441c0 0x7f88c80adc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 -- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88c80ae1c0 msgr2=0x7f88c81590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88c80ae1c0 0x7f88c81590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 -- 172.21.15.18:0/1954787704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c81522b0 con 0x7f88c8143de0 2024-04-25T10:05:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c7e00640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001aa0 tx=0x7f88b800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8017020 con 0x7f88c8143de0 2024-04-25T10:05:07.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b800ada0 con 0x7f88c8143de0 2024-04-25T10:05:07.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8013630 con 0x7f88c8143de0 2024-04-25T10:05:07.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8152590 con 0x7f88c8143de0 2024-04-25T10:05:07.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80aeda0 con 0x7f88c8143de0 2024-04-25T10:05:07.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80745d0 con 0x7f88c8143de0 2024-04-25T10:05:07.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.380+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88b801a020 con 0x7f88c8143de0 2024-04-25T10:05:07.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.384+0000 7f88c4c00640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.384+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f88b8085920 con 0x7f88c8143de0 2024-04-25T10:05:07.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.384+0000 7f88bf400640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.384+0000 7f88bf400640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 0x7f88a4069420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88c81544d0 tx=0x7f88b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.388+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88b8021020 con 0x7f88c8143de0 2024-04-25T10:05:07.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.548+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88c80ae5a0 con 0x7f88c8143de0 2024-04-25T10:05:07.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.548+0000 7f88c4c00640 1 -- 172.21.15.18:0/1954787704 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88b8056af0 con 0x7f88c8143de0 2024-04-25T10:05:07.560 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:05:07.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 msgr2=0x7f88a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 0x7f88a4069420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88c81544d0 tx=0x7f88b0008040 comp rx=0 tx=0).stop 2024-04-25T10:05:07.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 msgr2=0x7f88c81fa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f88b8001aa0 tx=0x7f88b800a360 comp rx=0 tx=0).stop 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 shutdown_connections 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88c80ae1c0 0x7f88c81590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88c81441c0 0x7f88c80adc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 --2- 172.21.15.18:0/1954787704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88c8143de0 0x7f88c81fa920 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 >> 172.21.15.18:0/1954787704 conn(0x7f88c8067080 msgr2=0x7f88c80cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 shutdown_connections 2024-04-25T10:05:07.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.552+0000 7f88cf200640 1 -- 172.21.15.18:0/1954787704 wait complete. 2024-04-25T10:05:07.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:05:07.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 Processor -- start 2024-04-25T10:05:07.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 -- start start 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27580ce480 0x7f27580b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275815eda0 con 0x7f275815b520 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27580b10e0 con 0x7f27580ce480 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2758099e00 con 0x7f275815b140 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275ca00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f275815b520 0x7f27580cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48680/0 (socket says 172.21.15.18:48680) 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275ca00640 1 -- 172.21.15.18:0/2880297896 learned_addr learned my addr 172.21.15.18:0/2880297896 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:07.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275de00640 1 --2- 172.21.15.18:0/2880297896 >> v2:172.21.15.18:3300/0 conn(0x7f27580ce480 0x7f27580b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275d400640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275de00640 1 -- 172.21.15.18:0/2880297896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 msgr2=0x7f275815e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275de00640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275de00640 1 -- 172.21.15.18:0/2880297896 >> v1:172.21.15.18:6789/0 conn(0x7f275815b520 legacy=0x7f27580cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.712+0000 7f275de00640 1 -- 172.21.15.18:0/2880297896 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275809a0e0 con 0x7f27580ce480 2024-04-25T10:05:07.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275de00640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580ce480 0x7f27580b17b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2750009d90 tx=0x7f275001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b922d167553b4983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f2757e00640 1 -- 172.21.15.18:0/2880297896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500b2070 con 0x7f27580ce480 2024-04-25T10:05:07.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f2757e00640 1 -- 172.21.15.18:0/2880297896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500a5800 con 0x7f27580ce480 2024-04-25T10:05:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f2757e00640 1 -- 172.21.15.18:0/2880297896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500a5bd0 con 0x7f27580ce480 2024-04-25T10:05:07.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- 172.21.15.18:0/2880297896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580ce480 msgr2=0x7f27580b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580ce480 0x7f27580b17b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2750009d90 tx=0x7f275001c940 comp rx=0 tx=0).stop 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- 172.21.15.18:0/2880297896 shutdown_connections 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27580ce480 0x7f27580b17b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 --2- 172.21.15.18:0/2880297896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- 172.21.15.18:0/2880297896 >> 172.21.15.18:0/2880297896 conn(0x7f27580d14f0 msgr2=0x7f27580d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- 172.21.15.18:0/2880297896 shutdown_connections 2024-04-25T10:05:07.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- 172.21.15.18:0/2880297896 wait complete. 2024-04-25T10:05:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 Processor -- start 2024-04-25T10:05:07.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.716+0000 7f275e800640 1 -- start start 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 0x7f27581569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758099be0 con 0x7f275815b520 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2758099a60 con 0x7f27580ce480 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275806bd20 con 0x7f275815b140 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36440/0 (socket says 172.21.15.18:36440) 2024-04-25T10:05:07.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 -- 172.21.15.18:0/935270044 learned_addr learned my addr 172.21.15.18:0/935270044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275ca00640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275d400640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 0x7f27581569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 -- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 msgr2=0x7f275815b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 -- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 msgr2=0x7f27581569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 0x7f27581569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 -- 172.21.15.18:0/935270044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2758156f10 con 0x7f275815b520 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275d400640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 0x7f27581569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275de00640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f27500b0040 tx=0x7f27500196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500b2050 con 0x7f275815b520 2024-04-25T10:05:07.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500be070 con 0x7f275815b520 2024-04-25T10:05:07.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275815da10 con 0x7f275815b520 2024-04-25T10:05:07.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500adb10 con 0x7f275815b520 2024-04-25T10:05:07.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2758155c10 con 0x7f275815b520 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804efa0 con 0x7f275815b520 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.720+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27500adcb0 con 0x7f275815b520 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.724+0000 7f2755600640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 0x7f2738069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.724+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2750120250 con 0x7f275815b520 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.724+0000 7f275d400640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 0x7f2738069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.724+0000 7f275d400640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 0x7f2738069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f274c009840 tx=0x7f274c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.728+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2750016560 con 0x7f275815b520 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f275806d270 con 0x7f275815b520 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f2755600640 1 -- 172.21.15.18:0/935270044 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7f27500ab340 con 0x7f275815b520 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:07.902 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 msgr2=0x7f2738069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 0x7f2738069450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f274c009840 tx=0x7f274c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 msgr2=0x7f27580c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f27500b0040 tx=0x7f27500196e0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 shutdown_connections 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275815b520 0x7f27580c4fc0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2738066f90 0x7f2738069450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f275815b140 0x7f275815b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 --2- 172.21.15.18:0/935270044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27580ce480 0x7f27581569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 >> 172.21.15.18:0/935270044 conn(0x7f27580d14f0 msgr2=0x7f275806fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:07.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 shutdown_connections 2024-04-25T10:05:07.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:07.892+0000 7f275e800640 1 -- 172.21.15.18:0/935270044 wait complete. 2024-04-25T10:05:07.923 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:05:07.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:05:08.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 Processor -- start 2024-04-25T10:05:08.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 -- start start 2024-04-25T10:05:08.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0988157ae0 0x7f098815e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098815e9d0 con 0x7f09880721f0 2024-04-25T10:05:08.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0988157ec0 con 0x7f09880b47d0 2024-04-25T10:05:08.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0990600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098815a610 con 0x7f0988157ae0 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0988157ae0 0x7f098815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0988157ae0 0x7f098815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36450/0 (socket says 172.21.15.18:36450) 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 -- 172.21.15.18:0/4139181931 learned_addr learned my addr 172.21.15.18:0/4139181931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098e600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f09880721f0 0x7f09880cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48692/0 (socket says 172.21.15.18:48692) 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 -- 172.21.15.18:0/4139181931 >> v1:172.21.15.167:6789/0 conn(0x7f09880b47d0 legacy=0x7f0988071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 -- 172.21.15.18:0/4139181931 >> v1:172.21.15.18:6789/0 conn(0x7f09880721f0 legacy=0x7f09880cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f098dc00640 1 -- 172.21.15.18:0/4139181931 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098815a8f0 con 0x7f0988157ae0 2024-04-25T10:05:08.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.060+0000 7f0987e00640 1 -- 172.21.15.18:0/4139181931 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2137359543 0 0) 0x7f09800014a0 con 0x7f09880721f0 2024-04-25T10:05:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f098dc00640 1 --2- 172.21.15.18:0/4139181931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0988157ae0 0x7f098815e490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f097c009870 tx=0x7f097c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35328014b8247ef0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0987e00640 1 -- 172.21.15.18:0/4139181931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0b1070 con 0x7f0988157ae0 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0987e00640 1 -- 172.21.15.18:0/4139181931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c0ac630 con 0x7f0988157ae0 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0987e00640 1 -- 172.21.15.18:0/4139181931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a8050 con 0x7f0988157ae0 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- 172.21.15.18:0/4139181931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0988157ae0 msgr2=0x7f098815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 --2- 172.21.15.18:0/4139181931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0988157ae0 0x7f098815e490 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f097c009870 tx=0x7f097c01c560 comp rx=0 tx=0).stop 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- 172.21.15.18:0/4139181931 shutdown_connections 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 --2- 172.21.15.18:0/4139181931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0988157ae0 0x7f098815e490 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- 172.21.15.18:0/4139181931 >> 172.21.15.18:0/4139181931 conn(0x7f098806ac10 msgr2=0x7f098806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- 172.21.15.18:0/4139181931 shutdown_connections 2024-04-25T10:05:08.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- 172.21.15.18:0/4139181931 wait complete. 2024-04-25T10:05:08.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 Processor -- start 2024-04-25T10:05:08.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.064+0000 7f0990600640 1 -- start start 2024-04-25T10:05:08.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 0x7f0988153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 0x7f0988151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880ceaf0 con 0x7f09880b47d0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880ce970 con 0x7f09880721f0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880cec70 con 0x7f0988157ae0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36460/0 (socket says 172.21.15.18:36460) 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 -- 172.21.15.18:0/564863279 learned_addr learned my addr 172.21.15.18:0/564863279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098e600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 0x7f0988151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098dc00640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 0x7f0988153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 -- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 msgr2=0x7f0988151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 0x7f0988151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 -- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 msgr2=0x7f0988153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:08.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 0x7f0988153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 -- 172.21.15.18:0/564863279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09881535e0 con 0x7f09880b47d0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098dc00640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 0x7f0988153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098e600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 0x7f0988151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f098d200640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f097400c530 tx=0x7f097400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974016020 con 0x7f09880b47d0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974005220 con 0x7f09880b47d0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974007030 con 0x7f09880b47d0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09881538c0 con 0x7f09880b47d0 2024-04-25T10:05:08.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0988153e80 con 0x7f09880b47d0 2024-04-25T10:05:08.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880745d0 con 0x7f09880b47d0 2024-04-25T10:05:08.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.068+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09740071d0 con 0x7f09880b47d0 2024-04-25T10:05:08.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.072+0000 7f0985600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 0x7f0968069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:08.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.072+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f09740848a0 con 0x7f09880b47d0 2024-04-25T10:05:08.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.072+0000 7f098dc00640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 0x7f0968069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:08.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.072+0000 7f098dc00640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 0x7f0968069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ae000 tx=0x7f097c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:08.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.076+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0974020020 con 0x7f09880b47d0 2024-04-25T10:05:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:08.240+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0988158250 con 0x7f09880b47d0 2024-04-25T10:05:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.056+0000 7f0985600640 1 -- 172.21.15.18:0/564863279 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f09740074c0 con 0x7f09880b47d0 2024-04-25T10:05:09.067 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 msgr2=0x7f0968069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 0x7f0968069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f097c0ae000 tx=0x7f097c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 msgr2=0x7f098814e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f097400c530 tx=0x7f097400c9f0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 shutdown_connections 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0968066f60 0x7f0968069420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0988157ae0 0x7f0988151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09880b47d0 0x7f098814e890 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 --2- 172.21.15.18:0/564863279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09880721f0 0x7f0988153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 >> 172.21.15.18:0/564863279 conn(0x7f098806ac10 msgr2=0x7f098806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 shutdown_connections 2024-04-25T10:05:09.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.060+0000 7f0990600640 1 -- 172.21.15.18:0/564863279 wait complete. 2024-04-25T10:05:09.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:05:09.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 Processor -- start 2024-04-25T10:05:09.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 -- start start 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015acd0 0x7f58d015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d015bc40 con 0x7f58d0144120 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d015b3a0 con 0x7f58d015ee60 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58d6000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d015e490 con 0x7f58d015acd0 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015acd0 0x7f58d015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d015acd0 0x7f58d015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36470/0 (socket says 172.21.15.18:36470) 2024-04-25T10:05:09.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 -- 172.21.15.18:0/420593675 learned_addr learned my addr 172.21.15.18:0/420593675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:09.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58cf400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f58d0144120 0x7f58d00ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48700/0 (socket says 172.21.15.18:48700) 2024-04-25T10:05:09.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 -- 172.21.15.18:0/420593675 >> v1:172.21.15.167:6789/0 conn(0x7f58d015ee60 legacy=0x7f58d00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:09.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 -- 172.21.15.18:0/420593675 >> v1:172.21.15.18:6789/0 conn(0x7f58d0144120 legacy=0x7f58d00ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58c7e00640 1 -- 172.21.15.18:0/420593675 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d015b680 con 0x7f58d015acd0 2024-04-25T10:05:09.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.240+0000 7f58cea00640 1 -- 172.21.15.18:0/420593675 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443419928 0 0) 0x7f58d015bc40 con 0x7f58d0144120 2024-04-25T10:05:09.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58c7e00640 1 --2- 172.21.15.18:0/420593675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015e920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5bef45520521fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58cea00640 1 -- 172.21.15.18:0/420593675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b0070 con 0x7f58d015acd0 2024-04-25T10:05:09.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58cea00640 1 -- 172.21.15.18:0/420593675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80ab600 con 0x7f58d015acd0 2024-04-25T10:05:09.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58cea00640 1 -- 172.21.15.18:0/420593675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80ab9d0 con 0x7f58d015acd0 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 -- 172.21.15.18:0/420593675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 msgr2=0x7f58d015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 --2- 172.21.15.18:0/420593675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015e920 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009870 tx=0x7f58b801c490 comp rx=0 tx=0).stop 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 -- 172.21.15.18:0/420593675 shutdown_connections 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 --2- 172.21.15.18:0/420593675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015e920 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 -- 172.21.15.18:0/420593675 >> 172.21.15.18:0/420593675 conn(0x7f58d0067080 msgr2=0x7f58d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 -- 172.21.15.18:0/420593675 shutdown_connections 2024-04-25T10:05:09.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.244+0000 7f58d6000640 1 -- 172.21.15.18:0/420593675 wait complete. 2024-04-25T10:05:09.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 Processor -- start 2024-04-25T10:05:09.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- start start 2024-04-25T10:05:09.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0144120 0x7f58d015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d015ee60 0x7f58d013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d01687e0 con 0x7f58d015acd0 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0168660 con 0x7f58d0144120 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d0168960 con 0x7f58d015ee60 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36476/0 (socket says 172.21.15.18:36476) 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 -- 172.21.15.18:0/2656968277 learned_addr learned my addr 172.21.15.18:0/2656968277 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58cf400640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0144120 0x7f58d015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58cfe00640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d015ee60 0x7f58d013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 -- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d015ee60 msgr2=0x7f58d013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d015ee60 0x7f58d013fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 -- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0144120 msgr2=0x7f58d015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0144120 0x7f58d015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:09.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 -- 172.21.15.18:0/2656968277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d015a5f0 con 0x7f58d015acd0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7e00640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f58b801a0c0 tx=0x7f58b801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80bd070 con 0x7f58d015acd0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8004030 con 0x7f58d015acd0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d013c9b0 con 0x7f58d015acd0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80b0040 con 0x7f58d015acd0 2024-04-25T10:05:09.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d013cf70 con 0x7f58d015acd0 2024-04-25T10:05:09.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.248+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d00745d0 con 0x7f58d015acd0 2024-04-25T10:05:09.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.252+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58b80c0070 con 0x7f58d015acd0 2024-04-25T10:05:09.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.252+0000 7f58c7400640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 0x7f58ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:09.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.252+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f58b811ef10 con 0x7f58d015acd0 2024-04-25T10:05:09.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.252+0000 7f58cf400640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 0x7f58ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:09.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.252+0000 7f58cf400640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 0x7f58ac069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000f70 tx=0x7f58c0007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:09.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.256+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f58b80c7020 con 0x7f58d015acd0 2024-04-25T10:05:09.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:09.420+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f58d0141380 con 0x7f58d015acd0 2024-04-25T10:05:10.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.064+0000 7f58c7400640 1 -- 172.21.15.18:0/2656968277 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f58b8016110 con 0x7f58d015acd0 2024-04-25T10:05:10.074 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.064+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 msgr2=0x7f58ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.064+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 0x7f58ac069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58c0000f70 tx=0x7f58c0007c10 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 msgr2=0x7f58d015c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f58b801a0c0 tx=0x7f58b801acd0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 shutdown_connections 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58ac066f60 0x7f58ac069420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d015ee60 0x7f58d013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d015acd0 0x7f58d015c600 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 --2- 172.21.15.18:0/2656968277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d0144120 0x7f58d015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 >> 172.21.15.18:0/2656968277 conn(0x7f58d0067080 msgr2=0x7f58d00b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 shutdown_connections 2024-04-25T10:05:10.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.068+0000 7f58d6000640 1 -- 172.21.15.18:0/2656968277 wait complete. 2024-04-25T10:05:10.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:05:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.248+0000 7fa2cfe00640 1 Processor -- start 2024-04-25T10:05:10.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.248+0000 7fa2cfe00640 1 -- start start 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 0x7fa2c80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cfe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c815bc40 con 0x7fa2c8144120 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cfe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2c815b3a0 con 0x7fa2c815acd0 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cfe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c815e490 con 0x7fa2c80b3090 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cd400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa2c8144120 0x7fa2c80ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48716/0 (socket says 172.21.15.18:48716) 2024-04-25T10:05:10.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cd400640 1 -- 172.21.15.18:0/3066483545 learned_addr learned my addr 172.21.15.18:0/3066483545 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cde00640 1 --2- 172.21.15.18:0/3066483545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 0x7fa2c80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024352635 0 0) 0x7fa2c815bc40 con 0x7fa2c8144120 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b0003530 con 0x7fa2c8144120 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578300981 0 0) 0x7fa2c815b3a0 con 0x7fa2c815acd0 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2c815bc40 con 0x7fa2c815acd0 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cde00640 1 -- 172.21.15.18:0/3066483545 >> v1:172.21.15.167:6789/0 conn(0x7fa2c815acd0 legacy=0x7fa2c815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cde00640 1 -- 172.21.15.18:0/3066483545 >> v1:172.21.15.18:6789/0 conn(0x7fa2c8144120 legacy=0x7fa2c80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.252+0000 7fa2cde00640 1 -- 172.21.15.18:0/3066483545 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c815b680 con 0x7fa2c80b3090 2024-04-25T10:05:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cde00640 1 --2- 172.21.15.18:0/3066483545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 0x7fa2c80b3520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2c815e610 tx=0x7fa2c001c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b18d076afd92a93e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00b2070 con 0x7fa2c80b3090 2024-04-25T10:05:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00a58b0 con 0x7fa2c80b3090 2024-04-25T10:05:10.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2c7e00640 1 -- 172.21.15.18:0/3066483545 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00a5c60 con 0x7fa2c80b3090 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- 172.21.15.18:0/3066483545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 msgr2=0x7fa2c80b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/3066483545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 0x7fa2c80b3520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2c815e610 tx=0x7fa2c001c900 comp rx=0 tx=0).stop 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- 172.21.15.18:0/3066483545 shutdown_connections 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/3066483545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c80b3090 0x7fa2c80b3520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- 172.21.15.18:0/3066483545 >> 172.21.15.18:0/3066483545 conn(0x7fa2c8067080 msgr2=0x7fa2c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- 172.21.15.18:0/3066483545 shutdown_connections 2024-04-25T10:05:10.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- 172.21.15.18:0/3066483545 wait complete. 2024-04-25T10:05:10.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 Processor -- start 2024-04-25T10:05:10.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.256+0000 7fa2cfe00640 1 -- start start 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 0x7fa2c80a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 0x7fa2c80b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c81685d0 con 0x7fa2c80b3090 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8168450 con 0x7fa2c8144120 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2c8168750 con 0x7fa2c815acd0 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36488/0 (socket says 172.21.15.18:36488) 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 -- 172.21.15.18:0/4205264341 learned_addr learned my addr 172.21.15.18:0/4205264341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cde00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 0x7fa2c80b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cca00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 0x7fa2c80a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 -- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 msgr2=0x7fa2c80b06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 0x7fa2c80b06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 -- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 msgr2=0x7fa2c80a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 0x7fa2c80a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 -- 172.21.15.18:0/4205264341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c81f9df0 con 0x7fa2c80b3090 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cde00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 0x7fa2c80b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cca00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 0x7fa2c80a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cd400640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00c500 tx=0x7fa2bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc017070 con 0x7fa2c80b3090 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2c81fa0d0 con 0x7fa2c80b3090 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2bc005cf0 con 0x7fa2c80b3090 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2bc007330 con 0x7fa2c80b3090 2024-04-25T10:05:10.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2c81fa690 con 0x7fa2c80b3090 2024-04-25T10:05:10.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2c80745d0 con 0x7fa2c80b3090 2024-04-25T10:05:10.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.260+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2bc01a070 con 0x7fa2c80b3090 2024-04-25T10:05:10.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.264+0000 7fa2c5600640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 0x7fa2a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:10.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.264+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fa2bc084ae0 con 0x7fa2c80b3090 2024-04-25T10:05:10.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.264+0000 7fa2cca00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 0x7fa2a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:10.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.264+0000 7fa2cca00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 0x7fa2a8069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40016a0 tx=0x7fa2b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.268+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2bc021020 con 0x7fa2c80b3090 2024-04-25T10:05:10.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:10.460+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa2c813d9b0 con 0x7fa2c80b3090 2024-04-25T10:05:11.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.064+0000 7fa2c5600640 1 -- 172.21.15.18:0/4205264341 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa2bc0559b0 con 0x7fa2c80b3090 2024-04-25T10:05:11.076 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T10:05:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 msgr2=0x7fa2a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 0x7fa2a8069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa2b40016a0 tx=0x7fa2b4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 msgr2=0x7fa2c813d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc00c500 tx=0x7fa2bc00c9c0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 shutdown_connections 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2a8066f60 0x7fa2a8069420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2c815acd0 0x7fa2c80b06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2c8144120 0x7fa2c80a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 --2- 172.21.15.18:0/4205264341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2c80b3090 0x7fa2c813d470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 >> 172.21.15.18:0/4205264341 conn(0x7fa2c8067080 msgr2=0x7fa2c8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 shutdown_connections 2024-04-25T10:05:11.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.068+0000 7fa2cfe00640 1 -- 172.21.15.18:0/4205264341 wait complete. 2024-04-25T10:05:11.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:11.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.256+0000 7f8871a00640 1 Processor -- start 2024-04-25T10:05:11.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.256+0000 7f8871a00640 1 -- start start 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8871a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f886c0b1e60 0x7f886c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8871a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0cc4e0 con 0x7f886c15fe50 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8871a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0ce040 con 0x7f886c145270 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8871a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886c145650 con 0x7f886c0b1e60 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8862000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f886c15fe50 0x7f886c0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:48720/0 (socket says 172.21.15.18:48720) 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f8862000640 1 -- 172.21.15.18:0/3043467273 learned_addr learned my addr 172.21.15.18:0/3043467273 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886b400640 1 --2- 172.21.15.18:0/3043467273 >> v2:172.21.15.167:3300/0 conn(0x7f886c0b1e60 0x7f886c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397074457 0 0) 0x7f886c0cc4e0 con 0x7f886c15fe50 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8850003530 con 0x7f886c15fe50 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886b400640 1 -- 172.21.15.18:0/3043467273 >> v1:172.21.15.167:6789/0 conn(0x7f886c145270 legacy=0x7f886c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370199146 0 0) 0x7f886c0ce040 con 0x7f886c145270 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886b400640 1 -- 172.21.15.18:0/3043467273 >> v1:172.21.15.18:6789/0 conn(0x7f886c15fe50 legacy=0x7f886c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.260+0000 7f886b400640 1 -- 172.21.15.18:0/3043467273 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c0ce320 con 0x7f886c0b1e60 2024-04-25T10:05:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f886b400640 1 --2- 172.21.15.18:0/3043467273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c0b1e60 0x7f886c15bd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8864009d90 tx=0x7f886401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a86c530a1dd7007 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640b2070 con 0x7f886c0b1e60 2024-04-25T10:05:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640a5520 con 0x7f886c0b1e60 2024-04-25T10:05:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f886a000640 1 -- 172.21.15.18:0/3043467273 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854001680 con 0x7f886c0b1e60 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- 172.21.15.18:0/3043467273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c0b1e60 msgr2=0x7f886c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 --2- 172.21.15.18:0/3043467273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c0b1e60 0x7f886c15bd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8864009d90 tx=0x7f886401c7b0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- 172.21.15.18:0/3043467273 shutdown_connections 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 --2- 172.21.15.18:0/3043467273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c0b1e60 0x7f886c15bd80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- 172.21.15.18:0/3043467273 >> 172.21.15.18:0/3043467273 conn(0x7f886c066fa0 msgr2=0x7f886c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- 172.21.15.18:0/3043467273 shutdown_connections 2024-04-25T10:05:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- 172.21.15.18:0/3043467273 wait complete. 2024-04-25T10:05:11.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 Processor -- start 2024-04-25T10:05:11.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.264+0000 7f8871a00640 1 -- start start 2024-04-25T10:05:11.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f886c0b1e60 0x7f886c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c15fe50 0x7f886c140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0cdd60 con 0x7f886c145270 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0cdbe0 con 0x7f886c15fe50 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c169720 con 0x7f886c0b1e60 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36492/0 (socket says 172.21.15.18:36492) 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 -- 172.21.15.18:0/2300221961 learned_addr learned my addr 172.21.15.18:0/2300221961 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f886aa00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f886c0b1e60 0x7f886c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f886b400640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c15fe50 0x7f886c140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 -- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f886c0b1e60 msgr2=0x7f886c0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f886c0b1e60 0x7f886c0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 -- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c15fe50 msgr2=0x7f886c140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c15fe50 0x7f886c140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 -- 172.21.15.18:0/2300221961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c161b40 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8862000640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f885400c730 tx=0x7f885400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854018070 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8854007500 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0b3100 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854004a30 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0b36c0 con 0x7f886c145270 2024-04-25T10:05:11.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.268+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c1615a0 con 0x7f886c145270 2024-04-25T10:05:11.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.272+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f885401b070 con 0x7f886c145270 2024-04-25T10:05:11.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.272+0000 7f8863400640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 0x7f8848069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.272+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8854084670 con 0x7f886c145270 2024-04-25T10:05:11.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.272+0000 7f886aa00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 0x7f8848069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.272+0000 7f886aa00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 0x7f8848069450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f885c000f70 tx=0x7f885c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.276+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8854054e90 con 0x7f886c145270 2024-04-25T10:05:11.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f886c0745d0 con 0x7f886c145270 2024-04-25T10:05:11.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8863400640 1 -- 172.21.15.18:0/2300221961 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16931 (secure 0 0 0) 0x7f8854058f30 con 0x7f886c145270 2024-04-25T10:05:11.450 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:11.451 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":40,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:10.466073+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:11.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 msgr2=0x7f8848069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 0x7f8848069450 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f885c000f70 tx=0x7f885c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 msgr2=0x7f886c162990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f885400c730 tx=0x7f885400cbf0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 shutdown_connections 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f886c15fe50 0x7f886c140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f886c145270 0x7f886c162990 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8848066f90 0x7f8848069450 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 --2- 172.21.15.18:0/2300221961 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f886c0b1e60 0x7f886c0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 >> 172.21.15.18:0/2300221961 conn(0x7f886c066fa0 msgr2=0x7f886c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 shutdown_connections 2024-04-25T10:05:11.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.440+0000 7f8871a00640 1 -- 172.21.15.18:0/2300221961 wait complete. 2024-04-25T10:05:11.473 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:11.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 Processor -- start 2024-04-25T10:05:11.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 -- start start 2024-04-25T10:05:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 0x7f4a0406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a040b3950 0x7f4a0406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0415def0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a0415e1b0 con 0x7f4a040b3950 2024-04-25T10:05:11.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a09a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0415e490 con 0x7f4a040b2dc0 2024-04-25T10:05:11.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f49fbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 0x7f4a0406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a040b3950 0x7f4a0406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a02a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f4a0415b2f0 0x7f4a040b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:40568/0 (socket says 172.21.15.18:40568) 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a02a00640 1 -- 172.21.15.18:0/3242199965 learned_addr learned my addr 172.21.15.18:0/3242199965 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a040b3950 0x7f4a0406b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:54556/0 (socket says 172.21.15.18:54556) 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f49fbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 0x7f4a0406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:49968/0 (socket says 172.21.15.18:49968) 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 -- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 msgr2=0x7f4a0406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 --2- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 0x7f4a0406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 -- 172.21.15.18:0/3242199965 >> v1:172.21.15.167:6789/0 conn(0x7f4a0415b2f0 legacy=0x7f4a040b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a03400640 1 -- 172.21.15.18:0/3242199965 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0415e770 con 0x7f4a040b3950 2024-04-25T10:05:11.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.604+0000 7f4a02000640 1 -- 172.21.15.18:0/3242199965 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4191400424 0 0) 0x7f4a0415def0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a03400640 1 --2- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b3950 0x7f4a0406b150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009dc0 tx=0x7f49fc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b8c12d9a4256c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a02000640 1 -- 172.21.15.18:0/3242199965 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0b2070 con 0x7f4a040b3950 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a02000640 1 -- 172.21.15.18:0/3242199965 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0a5a00 con 0x7f4a040b3950 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a02000640 1 -- 172.21.15.18:0/3242199965 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0415b8e0 con 0x7f4a040b3950 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 -- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b3950 msgr2=0x7f4a0406b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 --2- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b3950 0x7f4a0406b150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f49fc009dc0 tx=0x7f49fc01c920 comp rx=0 tx=0).stop 2024-04-25T10:05:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 -- 172.21.15.18:0/3242199965 shutdown_connections 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 --2- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b3950 0x7f4a0406b150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 --2- 172.21.15.18:0/3242199965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b2dc0 0x7f4a0406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 -- 172.21.15.18:0/3242199965 >> 172.21.15.18:0/3242199965 conn(0x7f4a040b23b0 msgr2=0x7f4a040cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 -- 172.21.15.18:0/3242199965 shutdown_connections 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.608+0000 7f4a09a00640 1 -- 172.21.15.18:0/3242199965 wait complete. 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 Processor -- start 2024-04-25T10:05:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- start start 2024-04-25T10:05:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b2dc0 0x7f4a04148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b3950 0x7f4a0415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0416a880 con 0x7f4a0415b2f0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a041616f0 con 0x7f4a040b2dc0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0416aa00 con 0x7f4a040b3950 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45544/0 (socket says 172.21.15.18:45544) 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 -- 172.21.15.18:0/1424511401 learned_addr learned my addr 172.21.15.18:0/1424511401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f49fbe00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b3950 0x7f4a0415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a02a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b2dc0 0x7f4a04148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 -- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b3950 msgr2=0x7f4a0415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b3950 0x7f4a0415fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 -- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b2dc0 msgr2=0x7f4a04148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b2dc0 0x7f4a04148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 -- 172.21.15.18:0/1424511401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a040cd3a0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a03400640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0b0040 tx=0x7f49fc0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0b2050 con 0x7f4a0415b2f0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0be070 con 0x7f4a0415b2f0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0adb30 con 0x7f4a0415b2f0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a040cd680 con 0x7f4a0415b2f0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.612+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a040cdc40 con 0x7f4a0415b2f0 2024-04-25T10:05:11.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a040745d0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f49fc0adcd0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f49faa00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 0x7f49e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f49fc1203c0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f4a02a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 0x7f49e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.616+0000 7f4a02a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 0x7f49e0069450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49f4000f70 tx=0x7f49f4007df0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.620+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f49fc016540 con 0x7f4a0415b2f0 2024-04-25T10:05:11.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a040d0ab0 con 0x7f4a0415b2f0 2024-04-25T10:05:11.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f49faa00640 1 -- 172.21.15.18:0/1424511401 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16931 (secure 0 0 0) 0x7f49fc0f0c20 con 0x7f4a0415b2f0 2024-04-25T10:05:11.794 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:11.794 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":40,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:10.466073+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:11.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 msgr2=0x7f49e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 0x7f49e0069450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49f4000f70 tx=0x7f49f4007df0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 msgr2=0x7f4a04160530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0b0040 tx=0x7f49fc0196c0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 shutdown_connections 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a0415b2f0 0x7f4a04160530 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f49e0066f90 0x7f49e0069450 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a040b3950 0x7f4a0415fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 --2- 172.21.15.18:0/1424511401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a040b2dc0 0x7f4a04148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.784+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 >> 172.21.15.18:0/1424511401 conn(0x7f4a040b23b0 msgr2=0x7f4a040b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.788+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 shutdown_connections 2024-04-25T10:05:11.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.788+0000 7f4a09a00640 1 -- 172.21.15.18:0/1424511401 wait complete. 2024-04-25T10:05:11.817 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:05:11.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.948+0000 7f2df4600640 1 Processor -- start 2024-04-25T10:05:11.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.948+0000 7f2df4600640 1 -- start start 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df4600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2dec15dc60 0x7f2dec0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df4600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec15e040 con 0x7f2dec09a170 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df4600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0cff80 con 0x7f2dec06bf30 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df4600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dec0d0260 con 0x7f2dec15dc60 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df2600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2dec09a170 0x7f2dec0cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55108/0 (socket says 172.21.15.18:55108) 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df2600640 1 -- 172.21.15.18:0/2801722197 learned_addr learned my addr 172.21.15.18:0/2801722197 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df1c00640 1 --2- 172.21.15.18:0/2801722197 >> v2:172.21.15.167:3300/0 conn(0x7f2dec15dc60 0x7f2dec0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2debe00640 1 -- 172.21.15.18:0/2801722197 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655940758 0 0) 0x7f2dec15e040 con 0x7f2dec09a170 2024-04-25T10:05:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2debe00640 1 -- 172.21.15.18:0/2801722197 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd4003530 con 0x7f2dec09a170 2024-04-25T10:05:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df1c00640 1 -- 172.21.15.18:0/2801722197 >> v1:172.21.15.167:6789/0 conn(0x7f2dec06bf30 legacy=0x7f2dec099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df1c00640 1 -- 172.21.15.18:0/2801722197 >> v1:172.21.15.18:6789/0 conn(0x7f2dec09a170 legacy=0x7f2dec0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.952+0000 7f2df1c00640 1 -- 172.21.15.18:0/2801722197 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0d0540 con 0x7f2dec15dc60 2024-04-25T10:05:11.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df1c00640 1 --2- 172.21.15.18:0/2801722197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec15dc60 0x7f2dec0d1020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2de00097c0 tx=0x7f2de001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5632eac8f8de181e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2debe00640 1 -- 172.21.15.18:0/2801722197 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00b1070 con 0x7f2dec15dc60 2024-04-25T10:05:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2debe00640 1 -- 172.21.15.18:0/2801722197 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00a8050 con 0x7f2dec15dc60 2024-04-25T10:05:11.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2debe00640 1 -- 172.21.15.18:0/2801722197 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de00ac840 con 0x7f2dec15dc60 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- 172.21.15.18:0/2801722197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec15dc60 msgr2=0x7f2dec0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 --2- 172.21.15.18:0/2801722197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec15dc60 0x7f2dec0d1020 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2de00097c0 tx=0x7f2de001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- 172.21.15.18:0/2801722197 shutdown_connections 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 --2- 172.21.15.18:0/2801722197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec15dc60 0x7f2dec0d1020 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- 172.21.15.18:0/2801722197 >> 172.21.15.18:0/2801722197 conn(0x7f2dec0b3200 msgr2=0x7f2dec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- 172.21.15.18:0/2801722197 shutdown_connections 2024-04-25T10:05:11.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- 172.21.15.18:0/2801722197 wait complete. 2024-04-25T10:05:11.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 Processor -- start 2024-04-25T10:05:11.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- start start 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 0x7f2dec160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 0x7f2dec0c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.956+0000 7f2df4600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec06cfa0 con 0x7f2dec15dc60 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df4600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0cc880 con 0x7f2dec09a170 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec161150 con 0x7f2dec06bf30 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45548/0 (socket says 172.21.15.18:45548) 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 -- 172.21.15.18:0/630805358 learned_addr learned my addr 172.21.15.18:0/630805358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df1c00640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 0x7f2dec160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df1200640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 0x7f2dec0c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 -- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 msgr2=0x7f2dec160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 0x7f2dec160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 -- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 msgr2=0x7f2dec0c8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 0x7f2dec0c8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 -- 172.21.15.18:0/630805358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0cb200 con 0x7f2dec15dc60 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df1c00640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 0x7f2dec160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df1200640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 0x7f2dec0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:11.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df2600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2de400cb10 tx=0x7f2de400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4017070 con 0x7f2dec15dc60 2024-04-25T10:05:11.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de400ac70 con 0x7f2dec15dc60 2024-04-25T10:05:11.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec0cb4e0 con 0x7f2dec15dc60 2024-04-25T10:05:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de400ae60 con 0x7f2dec15dc60 2024-04-25T10:05:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec15bba0 con 0x7f2dec15dc60 2024-04-25T10:05:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec0745d0 con 0x7f2dec15dc60 2024-04-25T10:05:11.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2de401a070 con 0x7f2dec15dc60 2024-04-25T10:05:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.960+0000 7f2de9600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 0x7f2dcc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.964+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2de4084fe0 con 0x7f2dec15dc60 2024-04-25T10:05:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.964+0000 7f2df1c00640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 0x7f2dcc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.964+0000 7f2df1c00640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 0x7f2dcc069450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae000 tx=0x7f2de00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:11.968+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2de4055e00 con 0x7f2dec15dc60 2024-04-25T10:05:12.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:12.172+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2dec0c8a90 con 0x7f2dec15dc60 2024-04-25T10:05:13.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2de9600640 1 -- 172.21.15.18:0/630805358 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2de4055700 con 0x7f2dec15dc60 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 msgr2=0x7f2dcc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 0x7f2dcc069450 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2de00ae000 tx=0x7f2de00a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 msgr2=0x7f2dec0c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2de400cb10 tx=0x7f2de400a060 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 shutdown_connections 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dec15dc60 0x7f2dec0c91f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2dec09a170 0x7f2dec0c8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dcc066f90 0x7f2dcc069450 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 --2- 172.21.15.18:0/630805358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2dec06bf30 0x7f2dec160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 >> 172.21.15.18:0/630805358 conn(0x7f2dec0b3200 msgr2=0x7f2dec0ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:13.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 shutdown_connections 2024-04-25T10:05:13.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.092+0000 7f2df4600640 1 -- 172.21.15.18:0/630805358 wait complete. 2024-04-25T10:05:13.128 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:05:13.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:05:13.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 Processor -- start 2024-04-25T10:05:13.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 -- start start 2024-04-25T10:05:13.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 0x7fd80415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 0x7fd8040b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80415bc40 con 0x7fd804144120 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80415e490 con 0x7fd80415acd0 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd80ba00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80415b150 con 0x7fd80415ee60 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd804144120 0x7fd8040ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55122/0 (socket says 172.21.15.18:55122) 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809000640 1 -- 172.21.15.18:0/3445137480 learned_addr learned my addr 172.21.15.18:0/3445137480 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd7fbe00640 1 --2- 172.21.15.18:0/3445137480 >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 0x7fd80415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809a00640 1 --2- 172.21.15.18:0/3445137480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 0x7fd8040b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd803e00640 1 -- 172.21.15.18:0/3445137480 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665538943 0 0) 0x7fd80415bc40 con 0x7fd804144120 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd803e00640 1 -- 172.21.15.18:0/3445137480 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e8003530 con 0x7fd804144120 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809a00640 1 -- 172.21.15.18:0/3445137480 >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 msgr2=0x7fd80415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809a00640 1 --2- 172.21.15.18:0/3445137480 >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 0x7fd80415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809a00640 1 -- 172.21.15.18:0/3445137480 >> v1:172.21.15.18:6789/0 conn(0x7fd804144120 legacy=0x7fd8040ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd809a00640 1 -- 172.21.15.18:0/3445137480 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80415b3a0 con 0x7fd80415ee60 2024-04-25T10:05:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.268+0000 7fd7fbe00640 1 --2- 172.21.15.18:0/3445137480 >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 0x7fd80415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd809a00640 1 --2- 172.21.15.18:0/3445137480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 0x7fd8040b3090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f0576d0a362616c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd803e00640 1 -- 172.21.15.18:0/3445137480 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0b2070 con 0x7fd80415ee60 2024-04-25T10:05:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd803e00640 1 -- 172.21.15.18:0/3445137480 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0a57a0 con 0x7fd80415ee60 2024-04-25T10:05:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd803e00640 1 -- 172.21.15.18:0/3445137480 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0a5b50 con 0x7fd80415ee60 2024-04-25T10:05:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 -- 172.21.15.18:0/3445137480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 msgr2=0x7fd8040b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 --2- 172.21.15.18:0/3445137480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 0x7fd8040b3090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009d90 tx=0x7fd7fc01c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 -- 172.21.15.18:0/3445137480 shutdown_connections 2024-04-25T10:05:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 --2- 172.21.15.18:0/3445137480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd80415ee60 0x7fd8040b3090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 --2- 172.21.15.18:0/3445137480 >> v2:172.21.15.167:3300/0 conn(0x7fd80415acd0 0x7fd80415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 -- 172.21.15.18:0/3445137480 >> 172.21.15.18:0/3445137480 conn(0x7fd804067080 msgr2=0x7fd80406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 -- 172.21.15.18:0/3445137480 shutdown_connections 2024-04-25T10:05:13.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.272+0000 7fd80ba00640 1 -- 172.21.15.18:0/3445137480 wait complete. 2024-04-25T10:05:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 Processor -- start 2024-04-25T10:05:13.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- start start 2024-04-25T10:05:13.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd804144120 0x7fd80413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80415acd0 0x7fd80413d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80406d660 con 0x7fd80415ee60 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80406d4e0 con 0x7fd80415acd0 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80406d7e0 con 0x7fd804144120 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45550/0 (socket says 172.21.15.18:45550) 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 -- 172.21.15.18:0/1152645234 learned_addr learned my addr 172.21.15.18:0/1152645234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809000640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd804144120 0x7fd80413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd7fbe00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80415acd0 0x7fd80413d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 -- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd804144120 msgr2=0x7fd80413fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd804144120 0x7fd80413fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 -- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80415acd0 msgr2=0x7fd80413d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80415acd0 0x7fd80413d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 -- 172.21.15.18:0/1152645234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80413df10 con 0x7fd80415ee60 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd809a00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01a510 tx=0x7fd7fc019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0bb020 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc0a5950 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc0b2040 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80413e1b0 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80415c4c0 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.276+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040745d0 con 0x7fd80415ee60 2024-04-25T10:05:13.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.280+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd7fc0be020 con 0x7fd80415ee60 2024-04-25T10:05:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.280+0000 7fd801600640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 0x7fd7e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.280+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd7fc11f630 con 0x7fd80415ee60 2024-04-25T10:05:13.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.280+0000 7fd809000640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 0x7fd7e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:13.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.280+0000 7fd809000640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 0x7fd7e0069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4005890 tx=0x7fd7f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:13.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.284+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7fc0c5070 con 0x7fd80415ee60 2024-04-25T10:05:13.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:13.480+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd80413c2a0 con 0x7fd80415ee60 2024-04-25T10:05:14.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.096+0000 7fd801600640 1 -- 172.21.15.18:0/1152645234 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd7fc016560 con 0x7fd80415ee60 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 msgr2=0x7fd7e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 0x7fd7e0069420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4005890 tx=0x7fd7f4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 msgr2=0x7fd804141b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc01a510 tx=0x7fd7fc019680 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 shutdown_connections 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd80415ee60 0x7fd804141b50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd80415acd0 0x7fd80413d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd7e0066f60 0x7fd7e0069420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 --2- 172.21.15.18:0/1152645234 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd804144120 0x7fd80413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 >> 172.21.15.18:0/1152645234 conn(0x7fd804067080 msgr2=0x7fd8040b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 shutdown_connections 2024-04-25T10:05:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.100+0000 7fd80ba00640 1 -- 172.21.15.18:0/1152645234 wait complete. 2024-04-25T10:05:14.133 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:05:14.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:14.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 Processor -- start 2024-04-25T10:05:14.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 -- start start 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f709015dcd0 0x7f7090099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f7090099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709006d740 con 0x7f709009a7a0 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900cbfc0 con 0x7f709015dcd0 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f7094c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709006cea0 con 0x7f70900cd460 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f709015dcd0 0x7f7090099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f709015dcd0 0x7f7090099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45552/0 (socket says 172.21.15.18:45552) 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 -- 172.21.15.18:0/311722943 learned_addr learned my addr 172.21.15.18:0/311722943 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708fe00640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f7090099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 -- 172.21.15.18:0/311722943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 msgr2=0x7f7090099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f7090099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 -- 172.21.15.18:0/311722943 >> v1:172.21.15.167:6789/0 conn(0x7f709009a7a0 legacy=0x7f70900cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.268+0000 7f708f400640 1 -- 172.21.15.18:0/311722943 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709006d180 con 0x7f709015dcd0 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f708f400640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090099a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7080009870 tx=0x7f708001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d6dc5840e07a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f708e000640 1 -- 172.21.15.18:0/311722943 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a95f0 con 0x7f709015dcd0 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f708e000640 1 -- 172.21.15.18:0/311722943 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800a9790 con 0x7f709015dcd0 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f708e000640 1 -- 172.21.15.18:0/311722943 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a9b60 con 0x7f709015dcd0 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- 172.21.15.18:0/311722943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 msgr2=0x7f7090099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090099a60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7080009870 tx=0x7f708001c530 comp rx=0 tx=0).stop 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- 172.21.15.18:0/311722943 shutdown_connections 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f7090099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 --2- 172.21.15.18:0/311722943 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090099a60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- 172.21.15.18:0/311722943 >> 172.21.15.18:0/311722943 conn(0x7f70900b3050 msgr2=0x7f70900b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- 172.21.15.18:0/311722943 shutdown_connections 2024-04-25T10:05:14.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- 172.21.15.18:0/311722943 wait complete. 2024-04-25T10:05:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 Processor -- start 2024-04-25T10:05:14.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.272+0000 7f7094c00640 1 -- start start 2024-04-25T10:05:14.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f709009a7a0 0x7f7090152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f70900700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709016aa20 con 0x7f709015dcd0 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709016a8a0 con 0x7f709009a7a0 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709016aba0 con 0x7f70900cd460 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45556/0 (socket says 172.21.15.18:45556) 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 -- 172.21.15.18:0/2582616379 learned_addr learned my addr 172.21.15.18:0/2582616379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708f400640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f709009a7a0 0x7f7090152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708ea00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f70900700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 -- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 msgr2=0x7f70900700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f70900700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 -- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f709009a7a0 msgr2=0x7f7090152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f709009a7a0 0x7f7090152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 -- 172.21.15.18:0/2582616379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7090152860 con 0x7f709015dcd0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708ea00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f70900700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f708fe00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7088009fd0 tx=0x7f708800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088014420 con 0x7f709015dcd0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7088019070 con 0x7f709015dcd0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7088014800 con 0x7f709015dcd0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7090152ae0 con 0x7f709015dcd0 2024-04-25T10:05:14.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70901530a0 con 0x7f709015dcd0 2024-04-25T10:05:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709004efa0 con 0x7f709015dcd0 2024-04-25T10:05:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.276+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70880149a0 con 0x7f709015dcd0 2024-04-25T10:05:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.280+0000 7f7087400640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 0x7f7070069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.280+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7088085940 con 0x7f709015dcd0 2024-04-25T10:05:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.280+0000 7f708f400640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 0x7f7070069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.280+0000 7f708f400640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 0x7f7070069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f70800ae000 tx=0x7f70800b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.284+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7090152860 con 0x7f709015dcd0 2024-04-25T10:05:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70900ceb90 con 0x7f709015dcd0 2024-04-25T10:05:14.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7087400640 1 -- 172.21.15.18:0/2582616379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f70880567b0 con 0x7f709015dcd0 2024-04-25T10:05:14.490 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:14.491 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:14.491 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 msgr2=0x7f7070069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 0x7f7070069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f70800ae000 tx=0x7f70800b3040 comp rx=0 tx=0).stop 2024-04-25T10:05:14.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 msgr2=0x7f7090151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7088009fd0 tx=0x7f708800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 shutdown_connections 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f709015dcd0 0x7f7090151790 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7070066f60 0x7f7070069420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70900cd460 0x7f70900700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 --2- 172.21.15.18:0/2582616379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f709009a7a0 0x7f7090152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 >> 172.21.15.18:0/2582616379 conn(0x7f70900b3050 msgr2=0x7f70900cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 shutdown_connections 2024-04-25T10:05:14.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.480+0000 7f7094c00640 1 -- 172.21.15.18:0/2582616379 wait complete. 2024-04-25T10:05:14.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:14.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 Processor -- start 2024-04-25T10:05:14.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 -- start start 2024-04-25T10:05:14.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4cc0b08a0 0x7fc4cc06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc0cf540 con 0x7fc4cc0b18e0 2024-04-25T10:05:14.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc15b240 con 0x7fc4cc06e980 2024-04-25T10:05:14.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4d0a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc0ce350 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c9400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4cc0b18e0 0x7fc4cc0b0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55132/0 (socket says 172.21.15.18:55132) 2024-04-25T10:05:14.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c9400640 1 -- 172.21.15.18:0/2362292704 learned_addr learned my addr 172.21.15.18:0/2362292704 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:14.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4ca800640 1 --2- 172.21.15.18:0/2362292704 >> v2:172.21.15.167:3300/0 conn(0x7fc4cc0b08a0 0x7fc4cc06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815353641 0 0) 0x7fc4cc0cf540 con 0x7fc4cc0b18e0 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4b0003530 con 0x7fc4cc0b18e0 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067457958 0 0) 0x7fc4cc15b240 con 0x7fc4cc06e980 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4cc0cf540 con 0x7fc4cc06e980 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4ca800640 1 -- 172.21.15.18:0/2362292704 >> v1:172.21.15.167:6789/0 conn(0x7fc4cc06e980 legacy=0x7fc4cc0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4ca800640 1 -- 172.21.15.18:0/2362292704 >> v1:172.21.15.18:6789/0 conn(0x7fc4cc0b18e0 legacy=0x7fc4cc0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608425945 0 0) 0x7fc4b0003530 con 0x7fc4cc0b18e0 2024-04-25T10:05:14.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.644+0000 7fc4ca800640 1 -- 172.21.15.18:0/2362292704 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc0ce630 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4ca800640 1 --2- 172.21.15.18:0/2362292704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc06d2b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c401c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6424b509bb6bee9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40b2070 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c40a5570 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4c8a00640 1 -- 172.21.15.18:0/2362292704 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8001680 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 -- 172.21.15.18:0/2362292704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc0b08a0 msgr2=0x7fc4cc06d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/2362292704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc06d2b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c401c7d0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 -- 172.21.15.18:0/2362292704 shutdown_connections 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/2362292704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc06d2b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 -- 172.21.15.18:0/2362292704 >> 172.21.15.18:0/2362292704 conn(0x7fc4cc066fa0 msgr2=0x7fc4cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 -- 172.21.15.18:0/2362292704 shutdown_connections 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.648+0000 7fc4d0a00640 1 -- 172.21.15.18:0/2362292704 wait complete. 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 Processor -- start 2024-04-25T10:05:14.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- start start 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc06e980 0x7fc4cc138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4cc0b18e0 0x7fc4cc1f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc15ae60 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0b0ef0 con 0x7fc4cc06e980 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc15afe0 con 0x7fc4cc0b18e0 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45570/0 (socket says 172.21.15.18:45570) 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 -- 172.21.15.18:0/983719937 learned_addr learned my addr 172.21.15.18:0/983719937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9e00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc06e980 0x7fc4cc138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4ca800640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4cc0b18e0 0x7fc4cc1f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 -- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4cc0b18e0 msgr2=0x7fc4cc1f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4cc0b18e0 0x7fc4cc1f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 -- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc06e980 msgr2=0x7fc4cc138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc06e980 0x7fc4cc138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 -- 172.21.15.18:0/983719937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc1f7980 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c9400640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c730 tx=0x7fc4b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8017070 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8005b00 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8007070 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4cc1f7c60 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc138320 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.652+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc138520 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.656+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4b801a070 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.656+0000 7fc4c2000640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 0x7fc4ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.656+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc4b8084760 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.656+0000 7fc4c9e00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 0x7fc4ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.656+0000 7fc4c9e00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 0x7fc4ac069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0011f0 tx=0x7fc4bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:14.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.660+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4cc138520 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.820+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4cc0745d0 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4c2000640 1 -- 172.21.15.18:0/983719937 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16918 (secure 0 0 0) 0x7fc4b8055540 con 0x7fc4cc0b08a0 2024-04-25T10:05:14.833 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:14.833 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":41,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:12.080575+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:14.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 msgr2=0x7fc4ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 0x7fc4ac069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc0011f0 tx=0x7fc4bc009040 comp rx=0 tx=0).stop 2024-04-25T10:05:14.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 msgr2=0x7fc4cc155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800c730 tx=0x7fc4b800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 shutdown_connections 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4ac066f60 0x7fc4ac069420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4cc0b18e0 0x7fc4cc1f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4cc0b08a0 0x7fc4cc155250 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 --2- 172.21.15.18:0/983719937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4cc06e980 0x7fc4cc138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 >> 172.21.15.18:0/983719937 conn(0x7fc4cc066fa0 msgr2=0x7fc4cc0cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 shutdown_connections 2024-04-25T10:05:14.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.824+0000 7fc4d0a00640 1 -- 172.21.15.18:0/983719937 wait complete. 2024-04-25T10:05:14.854 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:05:14.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:14.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.984+0000 7fca8aa00640 1 Processor -- start 2024-04-25T10:05:14.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.984+0000 7fca8aa00640 1 -- start start 2024-04-25T10:05:14.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca8aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca840b2dc0 0x7fca8406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca8406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca8aa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8415def0 con 0x7fca8415b2f0 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca8aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8415e1b0 con 0x7fca840b2dc0 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca8aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8415e490 con 0x7fca840b3950 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca83e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fca8415b2f0 0x7fca840b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55136/0 (socket says 172.21.15.18:55136) 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca83e00640 1 -- 172.21.15.18:0/3644691164 learned_addr learned my addr 172.21.15.18:0/3644691164 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca7b400640 1 --2- 172.21.15.18:0/3644691164 >> v2:172.21.15.18:3300/0 conn(0x7fca840b2dc0 0x7fca8406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca88a00640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca8406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca7b400640 1 -- 172.21.15.18:0/3644691164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 msgr2=0x7fca8406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca7b400640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca8406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca7b400640 1 -- 172.21.15.18:0/3644691164 >> v1:172.21.15.18:6789/0 conn(0x7fca8415b2f0 legacy=0x7fca840b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca7b400640 1 -- 172.21.15.18:0/3644691164 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8415e770 con 0x7fca840b2dc0 2024-04-25T10:05:14.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.988+0000 7fca83400640 1 -- 172.21.15.18:0/3644691164 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356614569 0 0) 0x7fca8415def0 con 0x7fca8415b2f0 2024-04-25T10:05:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca7b400640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca8406ac10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097c0 tx=0x7fca6c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c47da9951a311b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca83400640 1 -- 172.21.15.18:0/3644691164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8415b8e0 con 0x7fca840b2dc0 2024-04-25T10:05:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca83400640 1 -- 172.21.15.18:0/3644691164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0af070 con 0x7fca840b2dc0 2024-04-25T10:05:15.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca83400640 1 -- 172.21.15.18:0/3644691164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0aa810 con 0x7fca840b2dc0 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- 172.21.15.18:0/3644691164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 msgr2=0x7fca8406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca8406ac10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097c0 tx=0x7fca6c01c470 comp rx=0 tx=0).stop 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- 172.21.15.18:0/3644691164 shutdown_connections 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca8406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- 172.21.15.18:0/3644691164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca8406ac10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- 172.21.15.18:0/3644691164 >> 172.21.15.18:0/3644691164 conn(0x7fca840b23b0 msgr2=0x7fca840cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- 172.21.15.18:0/3644691164 shutdown_connections 2024-04-25T10:05:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- 172.21.15.18:0/3644691164 wait complete. 2024-04-25T10:05:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 Processor -- start 2024-04-25T10:05:15.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- start start 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca84159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca8415b2f0 0x7fca8415ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.992+0000 7fca8aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8416a880 con 0x7fca840b2dc0 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca8aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca84161730 con 0x7fca8415b2f0 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca8aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8416aa00 con 0x7fca840b3950 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45596/0 (socket says 172.21.15.18:45596) 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 -- 172.21.15.18:0/4217555124 learned_addr learned my addr 172.21.15.18:0/4217555124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 -- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 msgr2=0x7fca84159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca84159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 -- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca8415b2f0 msgr2=0x7fca8415ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca8415b2f0 0x7fca8415ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 -- 172.21.15.18:0/4217555124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca84155cb0 con 0x7fca840b2dc0 2024-04-25T10:05:15.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca83e00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c480 tx=0x7fca7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca740074e0 con 0x7fca840b2dc0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca740047f0 con 0x7fca840b2dc0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74004be0 con 0x7fca840b2dc0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca84155f90 con 0x7fca840b2dc0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca84156550 con 0x7fca840b2dc0 2024-04-25T10:05:15.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca840745d0 con 0x7fca840b2dc0 2024-04-25T10:05:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca74011070 con 0x7fca840b2dc0 2024-04-25T10:05:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:14.996+0000 7fca80c00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 0x7fca60069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.000+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fca74084d40 con 0x7fca840b2dc0 2024-04-25T10:05:15.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.000+0000 7fca7b400640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 0x7fca60069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.000+0000 7fca7b400640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 0x7fca60069450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0ae000 tx=0x7fca6c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.000+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca74055bb0 con 0x7fca840b2dc0 2024-04-25T10:05:15.055 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T10:05:15.046+0000 7efef1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:05:15.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.168+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca840d0ab0 con 0x7fca60066f90 2024-04-25T10:05:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.172+0000 7fca80c00640 1 -- 172.21.15.18:0/4217555124 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+244346 (secure 0 0 0) 0x7fca840d0ab0 con 0x7fca60066f90 2024-04-25T10:05:15.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:15.188 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 msgr2=0x7fca60069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 0x7fca60069450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0ae000 tx=0x7fca6c004740 comp rx=0 tx=0).stop 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 msgr2=0x7fca841478d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fca7400c480 tx=0x7fca7400c940 comp rx=0 tx=0).stop 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 shutdown_connections 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca8415b2f0 0x7fca8415ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fca60066f90 0x7fca60069450 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fca840b3950 0x7fca84159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 --2- 172.21.15.18:0/4217555124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca840b2dc0 0x7fca841478d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 >> 172.21.15.18:0/4217555124 conn(0x7fca840b23b0 msgr2=0x7fca841619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 shutdown_connections 2024-04-25T10:05:15.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.176+0000 7fca8aa00640 1 -- 172.21.15.18:0/4217555124 wait complete. 2024-04-25T10:05:15.206 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2024-04-25T10:05:13.413654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592084,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":173,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":94,"acting":94,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":61,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":229144,"kb_used_data":4596,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745576,"statfs":{"total":773094113280,"available":772859469824,"internally_reserved":0,"allocated":4706304,"data_stored":2681084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.349790"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088140+0000","last_change":"2024-04-25T10:05:11.084989+0000","last_active":"2024-04-25T10:05:12.088140+0000","last_peered":"2024-04-25T10:05:12.088140+0000","last_clean":"2024-04-25T10:05:12.088140+0000","last_became_active":"2024-04-25T10:05:11.084693+0000","last_became_peered":"2024-04-25T10:05:11.084693+0000","last_unstale":"2024-04-25T10:05:12.088140+0000","last_undegraded":"2024-04-25T10:05:12.088140+0000","last_fullsized":"2024-04-25T10:05:12.088140+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:19.124009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087966+0000","last_change":"2024-04-25T10:05:11.102945+0000","last_active":"2024-04-25T10:05:12.087966+0000","last_peered":"2024-04-25T10:05:12.087966+0000","last_clean":"2024-04-25T10:05:12.087966+0000","last_became_active":"2024-04-25T10:05:11.102686+0000","last_became_peered":"2024-04-25T10:05:11.102686+0000","last_unstale":"2024-04-25T10:05:12.087966+0000","last_undegraded":"2024-04-25T10:05:12.087966+0000","last_fullsized":"2024-04-25T10:05:12.087966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:19.068919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174713+0000","last_change":"2024-04-25T10:05:11.093088+0000","last_active":"2024-04-25T10:05:12.174713+0000","last_peered":"2024-04-25T10:05:12.174713+0000","last_clean":"2024-04-25T10:05:12.174713+0000","last_became_active":"2024-04-25T10:05:11.092760+0000","last_became_peered":"2024-04-25T10:05:11.092760+0000","last_unstale":"2024-04-25T10:05:12.174713+0000","last_undegraded":"2024-04-25T10:05:12.174713+0000","last_fullsized":"2024-04-25T10:05:12.174713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112037+0000","last_change":"2024-04-25T10:05:11.107006+0000","last_active":"2024-04-25T10:05:11.112037+0000","last_peered":"2024-04-25T10:05:11.112037+0000","last_clean":"2024-04-25T10:05:11.112037+0000","last_became_active":"2024-04-25T10:05:11.106727+0000","last_became_peered":"2024-04-25T10:05:11.106727+0000","last_unstale":"2024-04-25T10:05:11.112037+0000","last_undegraded":"2024-04-25T10:05:11.112037+0000","last_fullsized":"2024-04-25T10:05:11.112037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:36.230497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.111882+0000","last_change":"2024-04-25T10:05:11.106814+0000","last_active":"2024-04-25T10:05:11.111882+0000","last_peered":"2024-04-25T10:05:11.111882+0000","last_clean":"2024-04-25T10:05:11.111882+0000","last_became_active":"2024-04-25T10:05:11.106511+0000","last_became_peered":"2024-04-25T10:05:11.106511+0000","last_unstale":"2024-04-25T10:05:11.111882+0000","last_undegraded":"2024-04-25T10:05:11.111882+0000","last_fullsized":"2024-04-25T10:05:11.111882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:30.252006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213973+0000","last_change":"2024-04-25T10:05:11.088639+0000","last_active":"2024-04-25T10:05:12.213973+0000","last_peered":"2024-04-25T10:05:12.213973+0000","last_clean":"2024-04-25T10:05:12.213973+0000","last_became_active":"2024-04-25T10:05:11.088329+0000","last_became_peered":"2024-04-25T10:05:11.088329+0000","last_unstale":"2024-04-25T10:05:12.213973+0000","last_undegraded":"2024-04-25T10:05:12.213973+0000","last_fullsized":"2024-04-25T10:05:12.213973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087532+0000","last_change":"2024-04-25T10:05:11.095553+0000","last_active":"2024-04-25T10:05:12.087532+0000","last_peered":"2024-04-25T10:05:12.087532+0000","last_clean":"2024-04-25T10:05:12.087532+0000","last_became_active":"2024-04-25T10:05:11.095303+0000","last_became_peered":"2024-04-25T10:05:11.095303+0000","last_unstale":"2024-04-25T10:05:12.087532+0000","last_undegraded":"2024-04-25T10:05:12.087532+0000","last_fullsized":"2024-04-25T10:05:12.087532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:20.869026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174863+0000","last_change":"2024-04-25T10:05:11.096379+0000","last_active":"2024-04-25T10:05:12.174863+0000","last_peered":"2024-04-25T10:05:12.174863+0000","last_clean":"2024-04-25T10:05:12.174863+0000","last_became_active":"2024-04-25T10:05:11.096088+0000","last_became_peered":"2024-04-25T10:05:11.096088+0000","last_unstale":"2024-04-25T10:05:12.174863+0000","last_undegraded":"2024-04-25T10:05:12.174863+0000","last_fullsized":"2024-04-25T10:05:12.174863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:37.369468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174522+0000","last_change":"2024-04-25T10:05:11.107649+0000","last_active":"2024-04-25T10:05:12.174522+0000","last_peered":"2024-04-25T10:05:12.174522+0000","last_clean":"2024-04-25T10:05:12.174522+0000","last_became_active":"2024-04-25T10:05:11.107370+0000","last_became_peered":"2024-04-25T10:05:11.107370+0000","last_unstale":"2024-04-25T10:05:12.174522+0000","last_undegraded":"2024-04-25T10:05:12.174522+0000","last_fullsized":"2024-04-25T10:05:12.174522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.109883+0000","last_change":"2024-04-25T10:05:11.105788+0000","last_active":"2024-04-25T10:05:11.109883+0000","last_peered":"2024-04-25T10:05:11.109883+0000","last_clean":"2024-04-25T10:05:11.109883+0000","last_became_active":"2024-04-25T10:05:11.104433+0000","last_became_peered":"2024-04-25T10:05:11.104433+0000","last_unstale":"2024-04-25T10:05:11.109883+0000","last_undegraded":"2024-04-25T10:05:11.109883+0000","last_fullsized":"2024-04-25T10:05:11.109883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:45.834658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112817+0000","last_change":"2024-04-25T10:05:11.111474+0000","last_active":"2024-04-25T10:05:11.112817+0000","last_peered":"2024-04-25T10:05:11.112817+0000","last_clean":"2024-04-25T10:05:11.112817+0000","last_became_active":"2024-04-25T10:05:11.110995+0000","last_became_peered":"2024-04-25T10:05:11.110995+0000","last_unstale":"2024-04-25T10:05:11.112817+0000","last_undegraded":"2024-04-25T10:05:11.112817+0000","last_fullsized":"2024-04-25T10:05:11.112817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:17.860936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214265+0000","last_change":"2024-04-25T10:05:11.094918+0000","last_active":"2024-04-25T10:05:12.214265+0000","last_peered":"2024-04-25T10:05:12.214265+0000","last_clean":"2024-04-25T10:05:12.214265+0000","last_became_active":"2024-04-25T10:05:11.094529+0000","last_became_peered":"2024-04-25T10:05:11.094529+0000","last_unstale":"2024-04-25T10:05:12.214265+0000","last_undegraded":"2024-04-25T10:05:12.214265+0000","last_fullsized":"2024-04-25T10:05:12.214265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213985+0000","last_change":"2024-04-25T10:05:11.104263+0000","last_active":"2024-04-25T10:05:12.213985+0000","last_peered":"2024-04-25T10:05:12.213985+0000","last_clean":"2024-04-25T10:05:12.213985+0000","last_became_active":"2024-04-25T10:05:11.103952+0000","last_became_peered":"2024-04-25T10:05:11.103952+0000","last_unstale":"2024-04-25T10:05:12.213985+0000","last_undegraded":"2024-04-25T10:05:12.213985+0000","last_fullsized":"2024-04-25T10:05:12.213985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214289+0000","last_change":"2024-04-25T10:05:11.098506+0000","last_active":"2024-04-25T10:05:12.214289+0000","last_peered":"2024-04-25T10:05:12.214289+0000","last_clean":"2024-04-25T10:05:12.214289+0000","last_became_active":"2024-04-25T10:05:11.097683+0000","last_became_peered":"2024-04-25T10:05:11.097683+0000","last_unstale":"2024-04-25T10:05:12.214289+0000","last_undegraded":"2024-04-25T10:05:12.214289+0000","last_fullsized":"2024-04-25T10:05:12.214289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174726+0000","last_change":"2024-04-25T10:05:10.095080+0000","last_active":"2024-04-25T10:05:12.174726+0000","last_peered":"2024-04-25T10:05:12.174726+0000","last_clean":"2024-04-25T10:05:12.174726+0000","last_became_active":"2024-04-25T10:05:10.094684+0000","last_became_peered":"2024-04-25T10:05:10.094684+0000","last_unstale":"2024-04-25T10:05:12.174726+0000","last_undegraded":"2024-04-25T10:05:12.174726+0000","last_fullsized":"2024-04-25T10:05:12.174726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.641951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214343+0000","last_change":"2024-04-25T10:05:10.096555+0000","last_active":"2024-04-25T10:05:12.214343+0000","last_peered":"2024-04-25T10:05:12.214343+0000","last_clean":"2024-04-25T10:05:12.214343+0000","last_became_active":"2024-04-25T10:05:10.096283+0000","last_became_peered":"2024-04-25T10:05:10.096283+0000","last_unstale":"2024-04-25T10:05:12.214343+0000","last_undegraded":"2024-04-25T10:05:12.214343+0000","last_fullsized":"2024-04-25T10:05:12.214343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:28.739560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088113+0000","last_change":"2024-04-25T10:05:11.099962+0000","last_active":"2024-04-25T10:05:12.088113+0000","last_peered":"2024-04-25T10:05:12.088113+0000","last_clean":"2024-04-25T10:05:12.088113+0000","last_became_active":"2024-04-25T10:05:11.099514+0000","last_became_peered":"2024-04-25T10:05:11.099514+0000","last_unstale":"2024-04-25T10:05:12.088113+0000","last_undegraded":"2024-04-25T10:05:12.088113+0000","last_fullsized":"2024-04-25T10:05:12.088113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:28.598478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174246+0000","last_change":"2024-04-25T10:05:11.092467+0000","last_active":"2024-04-25T10:05:12.174246+0000","last_peered":"2024-04-25T10:05:12.174246+0000","last_clean":"2024-04-25T10:05:12.174246+0000","last_became_active":"2024-04-25T10:05:11.092175+0000","last_became_peered":"2024-04-25T10:05:11.092175+0000","last_unstale":"2024-04-25T10:05:12.174246+0000","last_undegraded":"2024-04-25T10:05:12.174246+0000","last_fullsized":"2024-04-25T10:05:12.174246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213946+0000","last_change":"2024-04-25T10:05:10.092352+0000","last_active":"2024-04-25T10:05:12.213946+0000","last_peered":"2024-04-25T10:05:12.213946+0000","last_clean":"2024-04-25T10:05:12.213946+0000","last_became_active":"2024-04-25T10:05:10.092136+0000","last_became_peered":"2024-04-25T10:05:10.092136+0000","last_unstale":"2024-04-25T10:05:12.213946+0000","last_undegraded":"2024-04-25T10:05:12.213946+0000","last_fullsized":"2024-04-25T10:05:12.213946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.008784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087845+0000","last_change":"2024-04-25T10:05:11.109057+0000","last_active":"2024-04-25T10:05:12.087845+0000","last_peered":"2024-04-25T10:05:12.087845+0000","last_clean":"2024-04-25T10:05:12.087845+0000","last_became_active":"2024-04-25T10:05:11.108768+0000","last_became_peered":"2024-04-25T10:05:11.108768+0000","last_unstale":"2024-04-25T10:05:12.087845+0000","last_undegraded":"2024-04-25T10:05:12.087845+0000","last_fullsized":"2024-04-25T10:05:12.087845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:34.641815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112060+0000","last_change":"2024-04-25T10:05:11.107490+0000","last_active":"2024-04-25T10:05:11.112060+0000","last_peered":"2024-04-25T10:05:11.112060+0000","last_clean":"2024-04-25T10:05:11.112060+0000","last_became_active":"2024-04-25T10:05:11.107169+0000","last_became_peered":"2024-04-25T10:05:11.107169+0000","last_unstale":"2024-04-25T10:05:11.112060+0000","last_undegraded":"2024-04-25T10:05:11.112060+0000","last_fullsized":"2024-04-25T10:05:11.112060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:40.349412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088199+0000","last_change":"2024-04-25T10:05:10.088358+0000","last_active":"2024-04-25T10:05:12.088199+0000","last_peered":"2024-04-25T10:05:12.088199+0000","last_clean":"2024-04-25T10:05:12.088199+0000","last_became_active":"2024-04-25T10:05:10.088093+0000","last_became_peered":"2024-04-25T10:05:10.088093+0000","last_unstale":"2024-04-25T10:05:12.088199+0000","last_undegraded":"2024-04-25T10:05:12.088199+0000","last_fullsized":"2024-04-25T10:05:12.088199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:21.592620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174731+0000","last_change":"2024-04-25T10:05:11.108397+0000","last_active":"2024-04-25T10:05:12.174731+0000","last_peered":"2024-04-25T10:05:12.174731+0000","last_clean":"2024-04-25T10:05:12.174731+0000","last_became_active":"2024-04-25T10:05:11.108120+0000","last_became_peered":"2024-04-25T10:05:11.108120+0000","last_unstale":"2024-04-25T10:05:12.174731+0000","last_undegraded":"2024-04-25T10:05:12.174731+0000","last_fullsized":"2024-04-25T10:05:12.174731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.986951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087993+0000","last_change":"2024-04-25T10:05:10.086083+0000","last_active":"2024-04-25T10:05:12.087993+0000","last_peered":"2024-04-25T10:05:12.087993+0000","last_clean":"2024-04-25T10:05:12.087993+0000","last_became_active":"2024-04-25T10:05:10.085812+0000","last_became_peered":"2024-04-25T10:05:10.085812+0000","last_unstale":"2024-04-25T10:05:12.087993+0000","last_undegraded":"2024-04-25T10:05:12.087993+0000","last_fullsized":"2024-04-25T10:05:12.087993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:59.282929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174244+0000","last_change":"2024-04-25T10:05:11.095667+0000","last_active":"2024-04-25T10:05:12.174244+0000","last_peered":"2024-04-25T10:05:12.174244+0000","last_clean":"2024-04-25T10:05:12.174244+0000","last_became_active":"2024-04-25T10:05:11.095388+0000","last_became_peered":"2024-04-25T10:05:11.095388+0000","last_unstale":"2024-04-25T10:05:12.174244+0000","last_undegraded":"2024-04-25T10:05:12.174244+0000","last_fullsized":"2024-04-25T10:05:12.174244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088108+0000","last_change":"2024-04-25T10:05:10.099572+0000","last_active":"2024-04-25T10:05:12.088108+0000","last_peered":"2024-04-25T10:05:12.088108+0000","last_clean":"2024-04-25T10:05:12.088108+0000","last_became_active":"2024-04-25T10:05:10.098996+0000","last_became_peered":"2024-04-25T10:05:10.098996+0000","last_unstale":"2024-04-25T10:05:12.088108+0000","last_undegraded":"2024-04-25T10:05:12.088108+0000","last_fullsized":"2024-04-25T10:05:12.088108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.367622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087527+0000","last_change":"2024-04-25T10:05:11.084885+0000","last_active":"2024-04-25T10:05:12.087527+0000","last_peered":"2024-04-25T10:05:12.087527+0000","last_clean":"2024-04-25T10:05:12.087527+0000","last_became_active":"2024-04-25T10:05:11.084583+0000","last_became_peered":"2024-04-25T10:05:11.084583+0000","last_unstale":"2024-04-25T10:05:12.087527+0000","last_undegraded":"2024-04-25T10:05:12.087527+0000","last_fullsized":"2024-04-25T10:05:12.087527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:21.947174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213889+0000","last_change":"2024-04-25T10:05:10.091905+0000","last_active":"2024-04-25T10:05:12.213889+0000","last_peered":"2024-04-25T10:05:12.213889+0000","last_clean":"2024-04-25T10:05:12.213889+0000","last_became_active":"2024-04-25T10:05:10.089979+0000","last_became_peered":"2024-04-25T10:05:10.089979+0000","last_unstale":"2024-04-25T10:05:12.213889+0000","last_undegraded":"2024-04-25T10:05:12.213889+0000","last_fullsized":"2024-04-25T10:05:12.213889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.641951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088034+0000","last_change":"2024-04-25T10:05:11.087255+0000","last_active":"2024-04-25T10:05:12.088034+0000","last_peered":"2024-04-25T10:05:12.088034+0000","last_clean":"2024-04-25T10:05:12.088034+0000","last_became_active":"2024-04-25T10:05:11.086894+0000","last_became_peered":"2024-04-25T10:05:11.086894+0000","last_unstale":"2024-04-25T10:05:12.088034+0000","last_undegraded":"2024-04-25T10:05:12.088034+0000","last_fullsized":"2024-04-25T10:05:12.088034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:53.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087852+0000","last_change":"2024-04-25T10:05:11.094200+0000","last_active":"2024-04-25T10:05:12.087852+0000","last_peered":"2024-04-25T10:05:12.087852+0000","last_clean":"2024-04-25T10:05:12.087852+0000","last_became_active":"2024-04-25T10:05:11.093919+0000","last_became_peered":"2024-04-25T10:05:11.093919+0000","last_unstale":"2024-04-25T10:05:12.087852+0000","last_undegraded":"2024-04-25T10:05:12.087852+0000","last_fullsized":"2024-04-25T10:05:12.087852+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:33.344272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.111085+0000","last_change":"2024-04-25T10:05:10.090740+0000","last_active":"2024-04-25T10:05:11.111085+0000","last_peered":"2024-04-25T10:05:11.111085+0000","last_clean":"2024-04-25T10:05:11.111085+0000","last_became_active":"2024-04-25T10:05:10.090484+0000","last_became_peered":"2024-04-25T10:05:10.090484+0000","last_unstale":"2024-04-25T10:05:11.111085+0000","last_undegraded":"2024-04-25T10:05:11.111085+0000","last_fullsized":"2024-04-25T10:05:11.111085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:25.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.106427+0000","last_change":"2024-04-25T10:05:11.101704+0000","last_active":"2024-04-25T10:05:11.106427+0000","last_peered":"2024-04-25T10:05:11.106427+0000","last_clean":"2024-04-25T10:05:11.106427+0000","last_became_active":"2024-04-25T10:05:11.100575+0000","last_became_peered":"2024-04-25T10:05:11.100575+0000","last_unstale":"2024-04-25T10:05:11.106427+0000","last_undegraded":"2024-04-25T10:05:11.106427+0000","last_fullsized":"2024-04-25T10:05:11.106427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:22.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214119+0000","last_change":"2024-04-25T10:05:10.098802+0000","last_active":"2024-04-25T10:05:12.214119+0000","last_peered":"2024-04-25T10:05:12.214119+0000","last_clean":"2024-04-25T10:05:12.214119+0000","last_became_active":"2024-04-25T10:05:10.098437+0000","last_became_peered":"2024-04-25T10:05:10.098437+0000","last_unstale":"2024-04-25T10:05:12.214119+0000","last_undegraded":"2024-04-25T10:05:12.214119+0000","last_fullsized":"2024-04-25T10:05:12.214119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.109397+0000","last_change":"2024-04-25T10:05:10.093680+0000","last_active":"2024-04-25T10:05:11.109397+0000","last_peered":"2024-04-25T10:05:11.109397+0000","last_clean":"2024-04-25T10:05:11.109397+0000","last_became_active":"2024-04-25T10:05:10.093248+0000","last_became_peered":"2024-04-25T10:05:10.093248+0000","last_unstale":"2024-04-25T10:05:11.109397+0000","last_undegraded":"2024-04-25T10:05:11.109397+0000","last_fullsized":"2024-04-25T10:05:11.109397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:41.282055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174407+0000","last_change":"2024-04-25T10:05:11.102365+0000","last_active":"2024-04-25T10:05:12.174407+0000","last_peered":"2024-04-25T10:05:12.174407+0000","last_clean":"2024-04-25T10:05:12.174407+0000","last_became_active":"2024-04-25T10:05:11.101717+0000","last_became_peered":"2024-04-25T10:05:11.101717+0000","last_unstale":"2024-04-25T10:05:12.174407+0000","last_undegraded":"2024-04-25T10:05:12.174407+0000","last_fullsized":"2024-04-25T10:05:12.174407+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.097447+0000","last_change":"2024-04-25T10:05:10.088028+0000","last_active":"2024-04-25T10:05:11.097447+0000","last_peered":"2024-04-25T10:05:11.097447+0000","last_clean":"2024-04-25T10:05:11.097447+0000","last_became_active":"2024-04-25T10:05:10.087717+0000","last_became_peered":"2024-04-25T10:05:10.087717+0000","last_unstale":"2024-04-25T10:05:11.097447+0000","last_undegraded":"2024-04-25T10:05:11.097447+0000","last_fullsized":"2024-04-25T10:05:11.097447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:31.274090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088054+0000","last_change":"2024-04-25T10:05:11.109075+0000","last_active":"2024-04-25T10:05:12.088054+0000","last_peered":"2024-04-25T10:05:12.088054+0000","last_clean":"2024-04-25T10:05:12.088054+0000","last_became_active":"2024-04-25T10:05:11.108360+0000","last_became_peered":"2024-04-25T10:05:11.108360+0000","last_unstale":"2024-04-25T10:05:12.088054+0000","last_undegraded":"2024-04-25T10:05:12.088054+0000","last_fullsized":"2024-04-25T10:05:12.088054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:40.432448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.098393+0000","last_change":"2024-04-25T10:05:10.093466+0000","last_active":"2024-04-25T10:05:11.098393+0000","last_peered":"2024-04-25T10:05:11.098393+0000","last_clean":"2024-04-25T10:05:11.098393+0000","last_became_active":"2024-04-25T10:05:10.093040+0000","last_became_peered":"2024-04-25T10:05:10.093040+0000","last_unstale":"2024-04-25T10:05:11.098393+0000","last_undegraded":"2024-04-25T10:05:11.098393+0000","last_fullsized":"2024-04-25T10:05:11.098393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:20.918991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214043+0000","last_change":"2024-04-25T10:05:11.097290+0000","last_active":"2024-04-25T10:05:12.214043+0000","last_peered":"2024-04-25T10:05:12.214043+0000","last_clean":"2024-04-25T10:05:12.214043+0000","last_became_active":"2024-04-25T10:05:11.097027+0000","last_became_peered":"2024-04-25T10:05:11.097027+0000","last_unstale":"2024-04-25T10:05:12.214043+0000","last_undegraded":"2024-04-25T10:05:12.214043+0000","last_fullsized":"2024-04-25T10:05:12.214043+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.094601+0000","last_change":"2024-04-25T10:05:10.091396+0000","last_active":"2024-04-25T10:05:11.094601+0000","last_peered":"2024-04-25T10:05:11.094601+0000","last_clean":"2024-04-25T10:05:11.094601+0000","last_became_active":"2024-04-25T10:05:10.088637+0000","last_became_peered":"2024-04-25T10:05:10.088637+0000","last_unstale":"2024-04-25T10:05:11.094601+0000","last_undegraded":"2024-04-25T10:05:11.094601+0000","last_fullsized":"2024-04-25T10:05:11.094601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:11.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088021+0000","last_change":"2024-04-25T10:05:11.110267+0000","last_active":"2024-04-25T10:05:12.088021+0000","last_peered":"2024-04-25T10:05:12.088021+0000","last_clean":"2024-04-25T10:05:12.088021+0000","last_became_active":"2024-04-25T10:05:11.109965+0000","last_became_peered":"2024-04-25T10:05:11.109965+0000","last_unstale":"2024-04-25T10:05:12.088021+0000","last_undegraded":"2024-04-25T10:05:12.088021+0000","last_fullsized":"2024-04-25T10:05:12.088021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:09.038449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174672+0000","last_change":"2024-04-25T10:05:10.096617+0000","last_active":"2024-04-25T10:05:12.174672+0000","last_peered":"2024-04-25T10:05:12.174672+0000","last_clean":"2024-04-25T10:05:12.174672+0000","last_became_active":"2024-04-25T10:05:10.096317+0000","last_became_peered":"2024-04-25T10:05:10.096317+0000","last_unstale":"2024-04-25T10:05:12.174672+0000","last_undegraded":"2024-04-25T10:05:12.174672+0000","last_fullsized":"2024-04-25T10:05:12.174672+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:58.032690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174345+0000","last_change":"2024-04-25T10:05:11.084109+0000","last_active":"2024-04-25T10:05:12.174345+0000","last_peered":"2024-04-25T10:05:12.174345+0000","last_clean":"2024-04-25T10:05:12.174345+0000","last_became_active":"2024-04-25T10:05:11.083788+0000","last_became_peered":"2024-04-25T10:05:11.083788+0000","last_unstale":"2024-04-25T10:05:12.174345+0000","last_undegraded":"2024-04-25T10:05:12.174345+0000","last_fullsized":"2024-04-25T10:05:12.174345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174449+0000","last_change":"2024-04-25T10:05:10.089722+0000","last_active":"2024-04-25T10:05:12.174449+0000","last_peered":"2024-04-25T10:05:12.174449+0000","last_clean":"2024-04-25T10:05:12.174449+0000","last_became_active":"2024-04-25T10:05:10.089462+0000","last_became_peered":"2024-04-25T10:05:10.089462+0000","last_unstale":"2024-04-25T10:05:12.174449+0000","last_undegraded":"2024-04-25T10:05:12.174449+0000","last_fullsized":"2024-04-25T10:05:12.174449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.008784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213905+0000","last_change":"2024-04-25T10:05:11.102775+0000","last_active":"2024-04-25T10:05:12.213905+0000","last_peered":"2024-04-25T10:05:12.213905+0000","last_clean":"2024-04-25T10:05:12.213905+0000","last_became_active":"2024-04-25T10:05:11.102526+0000","last_became_peered":"2024-04-25T10:05:11.102526+0000","last_unstale":"2024-04-25T10:05:12.213905+0000","last_undegraded":"2024-04-25T10:05:12.213905+0000","last_fullsized":"2024-04-25T10:05:12.213905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087528+0000","last_change":"2024-04-25T10:05:10.087490+0000","last_active":"2024-04-25T10:05:12.087528+0000","last_peered":"2024-04-25T10:05:12.087528+0000","last_clean":"2024-04-25T10:05:12.087528+0000","last_became_active":"2024-04-25T10:05:10.087214+0000","last_became_peered":"2024-04-25T10:05:10.087214+0000","last_unstale":"2024-04-25T10:05:12.087528+0000","last_undegraded":"2024-04-25T10:05:12.087528+0000","last_fullsized":"2024-04-25T10:05:12.087528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:48.182264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:10.062387+0000","last_change":"2024-04-25T10:05:10.062387+0000","last_active":"2024-04-25T10:05:10.062387+0000","last_peered":"2024-04-25T10:05:10.062387+0000","last_clean":"2024-04-25T10:05:10.062387+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:10.062387+0000","last_undegraded":"2024-04-25T10:05:10.062387+0000","last_fullsized":"2024-04-25T10:05:10.062387+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:09.052184+0000","last_change":"2024-04-25T10:05:09.052184+0000","last_active":"2024-04-25T10:05:09.052184+0000","last_peered":"2024-04-25T10:05:09.052184+0000","last_clean":"2024-04-25T10:05:09.052184+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:09.052184+0000","last_undegraded":"2024-04-25T10:05:09.052184+0000","last_fullsized":"2024-04-25T10:05:09.052184+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":197,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T10:05:04.939949+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:04.939949+0000","last_peered":"2024-04-25T10:05:04.939949+0000","last_clean":"2024-04-25T10:05:04.939949+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:04.939949+0000","last_undegraded":"2024-04-25T10:05:04.939949+0000","last_fullsized":"2024-04-25T10:05:04.939949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1716,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28020,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343820,"statfs":{"total":96636764160,"available":96608071680,"internally_reserved":0,"allocated":1011712,"data_stored":767660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":417792,"data_stored":177292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":177292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509459,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27448,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":417792,"data_stored":177292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":471040,"data_stored":198981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":787737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:15.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:15.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.380+0000 7f9d44600640 1 Processor -- start 2024-04-25T10:05:15.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.380+0000 7f9d44600640 1 -- start start 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d44600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d3c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d44600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c15ac60 con 0x7f9d3c0cef30 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d44600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d3c0cf3e0 con 0x7f9d3c144140 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d44600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15af20 con 0x7f9d3c06ead0 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d3c0cef30 0x7f9d3c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55140/0 (socket says 172.21.15.18:55140) 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41200640 1 -- 172.21.15.18:0/3038147559 learned_addr learned my addr 172.21.15.18:0/3038147559 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:15.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d42600640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d3c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439122512 0 0) 0x7f9d3c15ac60 con 0x7f9d3c0cef30 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d24003530 con 0x7f9d3c0cef30 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605763590 0 0) 0x7f9d3c0cf3e0 con 0x7f9d3c144140 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c15ac60 con 0x7f9d3c144140 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058565963 0 0) 0x7f9d24003530 con 0x7f9d3c0cef30 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 msgr2=0x7f9d3c1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d3c1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 >> v1:172.21.15.167:6789/0 conn(0x7f9d3c144140 legacy=0x7f9d3c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c15b200 con 0x7f9d3c0cef30 2024-04-25T10:05:15.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f9d28001680 con 0x7f9d3c0cef30 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 >> v1:172.21.15.18:6789/0 conn(0x7f9d3c0cef30 legacy=0x7f9d3c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d24003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d24004810 0x7f9d24004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d240051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15af20 con 0x7f9d24003b80 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2400ba80 con 0x7f9d24004810 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2400bc80 con 0x7f9d3c06ead0 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d24003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41200640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d24004810 0x7f9d24004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d42600640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d240051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 -- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 msgr2=0x7f9d240051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c06ead0 0x7f9d240051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 -- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d24004810 msgr2=0x7f9d24004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:15.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d24004810 0x7f9d24004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.384+0000 7f9d41c00640 1 -- 172.21.15.18:0/3038147559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24003530 con 0x7f9d24003b80 2024-04-25T10:05:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d41c00640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d24003f80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007fd0 tx=0x7f9d3001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46cdb343ba5aee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30001520 con 0x7f9d24003b80 2024-04-25T10:05:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300052f0 con 0x7f9d24003b80 2024-04-25T10:05:15.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d3be00640 1 -- 172.21.15.18:0/3038147559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30003840 con 0x7f9d24003b80 2024-04-25T10:05:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 -- 172.21.15.18:0/3038147559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 msgr2=0x7f9d24003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 --2- 172.21.15.18:0/3038147559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d24003f80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d30007fd0 tx=0x7f9d3001c540 comp rx=0 tx=0).stop 2024-04-25T10:05:15.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d42600640 1 -- 172.21.15.18:0/3038147559 reap_dead start 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 -- 172.21.15.18:0/3038147559 shutdown_connections 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 -- 172.21.15.18:0/3038147559 >> 172.21.15.18:0/3038147559 conn(0x7f9d3c066fa0 msgr2=0x7f9d3c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 -- 172.21.15.18:0/3038147559 shutdown_connections 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.388+0000 7f9d44600640 1 -- 172.21.15.18:0/3038147559 wait complete. 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 Processor -- start 2024-04-25T10:05:15.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- start start 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c1f6710 0x7f9d3c1621b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c1626f0 0x7f9d3c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15bb80 con 0x7f9d24003b80 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c15ba00 con 0x7f9d3c1626f0 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3c06dac0 con 0x7f9d3c1f6710 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45620/0 (socket says 172.21.15.18:45620) 2024-04-25T10:05:15.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 -- 172.21.15.18:0/2420181553 learned_addr learned my addr 172.21.15.18:0/2420181553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:15.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 -- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c1f6710 msgr2=0x7f9d3c1621b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c1f6710 0x7f9d3c1621b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 -- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c1626f0 msgr2=0x7f9d3c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c1626f0 0x7f9d3c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 -- 172.21.15.18:0/2420181553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c162d50 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d41c00640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ad040 tx=0x7f9d24005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d300bf070 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d300054a0 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d3c0b2650 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30003dc0 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d3c0b2c10 con 0x7f9d24003b80 2024-04-25T10:05:15.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.392+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d3c0745d0 con 0x7f9d24003b80 2024-04-25T10:05:15.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.396+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d300c2070 con 0x7f9d24003b80 2024-04-25T10:05:15.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.396+0000 7f9d39600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.396+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9d3011e920 con 0x7f9d24003b80 2024-04-25T10:05:15.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.396+0000 7f9d41200640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.396+0000 7f9d41200640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 0x7f9d1c069450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c1611e0 tx=0x7f9d28000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.400+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d30016250 con 0x7f9d24003b80 2024-04-25T10:05:15.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.560+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9d3c0b4630 con 0x7f9d1c066f90 2024-04-25T10:05:15.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.568+0000 7f9d39600640 1 -- 172.21.15.18:0/2420181553 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251951 (secure 0 0 0) 0x7f9d3c0b4630 con 0x7f9d1c066f90 2024-04-25T10:05:15.580 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:15.581 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:15.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 msgr2=0x7f9d1c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 0x7f9d1c069450 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c1611e0 tx=0x7f9d28000f80 comp rx=0 tx=0).stop 2024-04-25T10:05:15.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 msgr2=0x7f9d3c1413b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d300ad040 tx=0x7f9d24005840 comp rx=0 tx=0).stop 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 shutdown_connections 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d3c1626f0 0x7f9d3c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9d1c066f90 0x7f9d1c069450 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9d3c1f6710 0x7f9d3c1621b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 --2- 172.21.15.18:0/2420181553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d24003b80 0x7f9d3c1413b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 >> 172.21.15.18:0/2420181553 conn(0x7f9d3c066fa0 msgr2=0x7f9d3c15c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 shutdown_connections 2024-04-25T10:05:15.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.572+0000 7f9d44600640 1 -- 172.21.15.18:0/2420181553 wait complete. 2024-04-25T10:05:15.600 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2024-04-25T10:05:15.414240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":229316,"kb_used_data":4812,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754745404,"statfs":{"total":773094113280,"available":772859293696,"internally_reserved":0,"allocated":4927488,"data_stored":2784312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":229756465},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001475"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088140+0000","last_change":"2024-04-25T10:05:11.084989+0000","last_active":"2024-04-25T10:05:12.088140+0000","last_peered":"2024-04-25T10:05:12.088140+0000","last_clean":"2024-04-25T10:05:12.088140+0000","last_became_active":"2024-04-25T10:05:11.084693+0000","last_became_peered":"2024-04-25T10:05:11.084693+0000","last_unstale":"2024-04-25T10:05:12.088140+0000","last_undegraded":"2024-04-25T10:05:12.088140+0000","last_fullsized":"2024-04-25T10:05:12.088140+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:06:19.124009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087966+0000","last_change":"2024-04-25T10:05:11.102945+0000","last_active":"2024-04-25T10:05:12.087966+0000","last_peered":"2024-04-25T10:05:12.087966+0000","last_clean":"2024-04-25T10:05:12.087966+0000","last_became_active":"2024-04-25T10:05:11.102686+0000","last_became_peered":"2024-04-25T10:05:11.102686+0000","last_unstale":"2024-04-25T10:05:12.087966+0000","last_undegraded":"2024-04-25T10:05:12.087966+0000","last_fullsized":"2024-04-25T10:05:12.087966+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:19.068919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174713+0000","last_change":"2024-04-25T10:05:11.093088+0000","last_active":"2024-04-25T10:05:12.174713+0000","last_peered":"2024-04-25T10:05:12.174713+0000","last_clean":"2024-04-25T10:05:12.174713+0000","last_became_active":"2024-04-25T10:05:11.092760+0000","last_became_peered":"2024-04-25T10:05:11.092760+0000","last_unstale":"2024-04-25T10:05:12.174713+0000","last_undegraded":"2024-04-25T10:05:12.174713+0000","last_fullsized":"2024-04-25T10:05:12.174713+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112037+0000","last_change":"2024-04-25T10:05:11.107006+0000","last_active":"2024-04-25T10:05:11.112037+0000","last_peered":"2024-04-25T10:05:11.112037+0000","last_clean":"2024-04-25T10:05:11.112037+0000","last_became_active":"2024-04-25T10:05:11.106727+0000","last_became_peered":"2024-04-25T10:05:11.106727+0000","last_unstale":"2024-04-25T10:05:11.112037+0000","last_undegraded":"2024-04-25T10:05:11.112037+0000","last_fullsized":"2024-04-25T10:05:11.112037+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:36.230497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.111882+0000","last_change":"2024-04-25T10:05:11.106814+0000","last_active":"2024-04-25T10:05:11.111882+0000","last_peered":"2024-04-25T10:05:11.111882+0000","last_clean":"2024-04-25T10:05:11.111882+0000","last_became_active":"2024-04-25T10:05:11.106511+0000","last_became_peered":"2024-04-25T10:05:11.106511+0000","last_unstale":"2024-04-25T10:05:11.111882+0000","last_undegraded":"2024-04-25T10:05:11.111882+0000","last_fullsized":"2024-04-25T10:05:11.111882+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:30.252006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213973+0000","last_change":"2024-04-25T10:05:11.088639+0000","last_active":"2024-04-25T10:05:12.213973+0000","last_peered":"2024-04-25T10:05:12.213973+0000","last_clean":"2024-04-25T10:05:12.213973+0000","last_became_active":"2024-04-25T10:05:11.088329+0000","last_became_peered":"2024-04-25T10:05:11.088329+0000","last_unstale":"2024-04-25T10:05:12.213973+0000","last_undegraded":"2024-04-25T10:05:12.213973+0000","last_fullsized":"2024-04-25T10:05:12.213973+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947921+0000","last_change":"2024-04-25T10:05:11.104363+0000","last_active":"2024-04-25T10:05:12.947921+0000","last_peered":"2024-04-25T10:05:12.947921+0000","last_clean":"2024-04-25T10:05:12.947921+0000","last_became_active":"2024-04-25T10:05:11.104097+0000","last_became_peered":"2024-04-25T10:05:11.104097+0000","last_unstale":"2024-04-25T10:05:12.947921+0000","last_undegraded":"2024-04-25T10:05:12.947921+0000","last_fullsized":"2024-04-25T10:05:12.947921+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.986951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087532+0000","last_change":"2024-04-25T10:05:11.095553+0000","last_active":"2024-04-25T10:05:12.087532+0000","last_peered":"2024-04-25T10:05:12.087532+0000","last_clean":"2024-04-25T10:05:12.087532+0000","last_became_active":"2024-04-25T10:05:11.095303+0000","last_became_peered":"2024-04-25T10:05:11.095303+0000","last_unstale":"2024-04-25T10:05:12.087532+0000","last_undegraded":"2024-04-25T10:05:12.087532+0000","last_fullsized":"2024-04-25T10:05:12.087532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:20.869026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174863+0000","last_change":"2024-04-25T10:05:11.096379+0000","last_active":"2024-04-25T10:05:12.174863+0000","last_peered":"2024-04-25T10:05:12.174863+0000","last_clean":"2024-04-25T10:05:12.174863+0000","last_became_active":"2024-04-25T10:05:11.096088+0000","last_became_peered":"2024-04-25T10:05:11.096088+0000","last_unstale":"2024-04-25T10:05:12.174863+0000","last_undegraded":"2024-04-25T10:05:12.174863+0000","last_fullsized":"2024-04-25T10:05:12.174863+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:37.369468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948731+0000","last_change":"2024-04-25T10:05:11.113749+0000","last_active":"2024-04-25T10:05:12.948731+0000","last_peered":"2024-04-25T10:05:12.948731+0000","last_clean":"2024-04-25T10:05:12.948731+0000","last_became_active":"2024-04-25T10:05:11.113404+0000","last_became_peered":"2024-04-25T10:05:11.113404+0000","last_unstale":"2024-04-25T10:05:12.948731+0000","last_undegraded":"2024-04-25T10:05:12.948731+0000","last_fullsized":"2024-04-25T10:05:12.948731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:21.409188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948898+0000","last_change":"2024-04-25T10:05:11.107754+0000","last_active":"2024-04-25T10:05:12.948898+0000","last_peered":"2024-04-25T10:05:12.948898+0000","last_clean":"2024-04-25T10:05:12.948898+0000","last_became_active":"2024-04-25T10:05:11.107481+0000","last_became_peered":"2024-04-25T10:05:11.107481+0000","last_unstale":"2024-04-25T10:05:12.948898+0000","last_undegraded":"2024-04-25T10:05:12.948898+0000","last_fullsized":"2024-04-25T10:05:12.948898+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:41.139137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174522+0000","last_change":"2024-04-25T10:05:11.107649+0000","last_active":"2024-04-25T10:05:12.174522+0000","last_peered":"2024-04-25T10:05:12.174522+0000","last_clean":"2024-04-25T10:05:12.174522+0000","last_became_active":"2024-04-25T10:05:11.107370+0000","last_became_peered":"2024-04-25T10:05:11.107370+0000","last_unstale":"2024-04-25T10:05:12.174522+0000","last_undegraded":"2024-04-25T10:05:12.174522+0000","last_fullsized":"2024-04-25T10:05:12.174522+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948201+0000","last_change":"2024-04-25T10:05:11.109452+0000","last_active":"2024-04-25T10:05:12.948201+0000","last_peered":"2024-04-25T10:05:12.948201+0000","last_clean":"2024-04-25T10:05:12.948201+0000","last_became_active":"2024-04-25T10:05:11.108545+0000","last_became_peered":"2024-04-25T10:05:11.108545+0000","last_unstale":"2024-04-25T10:05:12.948201+0000","last_undegraded":"2024-04-25T10:05:12.948201+0000","last_fullsized":"2024-04-25T10:05:12.948201+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:38.927762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094358+0000","last_change":"2024-04-25T10:05:11.104412+0000","last_active":"2024-04-25T10:05:12.094358+0000","last_peered":"2024-04-25T10:05:12.094358+0000","last_clean":"2024-04-25T10:05:12.094358+0000","last_became_active":"2024-04-25T10:05:11.103725+0000","last_became_peered":"2024-04-25T10:05:11.103725+0000","last_unstale":"2024-04-25T10:05:12.094358+0000","last_undegraded":"2024-04-25T10:05:12.094358+0000","last_fullsized":"2024-04-25T10:05:12.094358+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.986951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948094+0000","last_change":"2024-04-25T10:05:11.108282+0000","last_active":"2024-04-25T10:05:12.948094+0000","last_peered":"2024-04-25T10:05:12.948094+0000","last_clean":"2024-04-25T10:05:12.948094+0000","last_became_active":"2024-04-25T10:05:11.107990+0000","last_became_peered":"2024-04-25T10:05:11.107990+0000","last_unstale":"2024-04-25T10:05:12.948094+0000","last_undegraded":"2024-04-25T10:05:12.948094+0000","last_fullsized":"2024-04-25T10:05:12.948094+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:37.369468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947691+0000","last_change":"2024-04-25T10:05:11.110123+0000","last_active":"2024-04-25T10:05:12.947691+0000","last_peered":"2024-04-25T10:05:12.947691+0000","last_clean":"2024-04-25T10:05:12.947691+0000","last_became_active":"2024-04-25T10:05:11.108312+0000","last_became_peered":"2024-04-25T10:05:11.108312+0000","last_unstale":"2024-04-25T10:05:12.947691+0000","last_undegraded":"2024-04-25T10:05:12.947691+0000","last_fullsized":"2024-04-25T10:05:12.947691+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948680+0000","last_change":"2024-04-25T10:05:11.116492+0000","last_active":"2024-04-25T10:05:12.948680+0000","last_peered":"2024-04-25T10:05:12.948680+0000","last_clean":"2024-04-25T10:05:12.948680+0000","last_became_active":"2024-04-25T10:05:11.116202+0000","last_became_peered":"2024-04-25T10:05:11.116202+0000","last_unstale":"2024-04-25T10:05:12.948680+0000","last_undegraded":"2024-04-25T10:05:12.948680+0000","last_fullsized":"2024-04-25T10:05:12.948680+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:38.927762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.095078+0000","last_change":"2024-04-25T10:05:11.110320+0000","last_active":"2024-04-25T10:05:12.095078+0000","last_peered":"2024-04-25T10:05:12.095078+0000","last_clean":"2024-04-25T10:05:12.095078+0000","last_became_active":"2024-04-25T10:05:11.110100+0000","last_became_peered":"2024-04-25T10:05:11.110100+0000","last_unstale":"2024-04-25T10:05:12.095078+0000","last_undegraded":"2024-04-25T10:05:12.095078+0000","last_fullsized":"2024-04-25T10:05:12.095078+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:03.815106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.109883+0000","last_change":"2024-04-25T10:05:11.105788+0000","last_active":"2024-04-25T10:05:11.109883+0000","last_peered":"2024-04-25T10:05:11.109883+0000","last_clean":"2024-04-25T10:05:11.109883+0000","last_became_active":"2024-04-25T10:05:11.104433+0000","last_became_peered":"2024-04-25T10:05:11.104433+0000","last_unstale":"2024-04-25T10:05:11.109883+0000","last_undegraded":"2024-04-25T10:05:11.109883+0000","last_fullsized":"2024-04-25T10:05:11.109883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:45.834658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094977+0000","last_change":"2024-04-25T10:05:11.107895+0000","last_active":"2024-04-25T10:05:12.094977+0000","last_peered":"2024-04-25T10:05:12.094977+0000","last_clean":"2024-04-25T10:05:12.094977+0000","last_became_active":"2024-04-25T10:05:11.107610+0000","last_became_peered":"2024-04-25T10:05:11.107610+0000","last_unstale":"2024-04-25T10:05:12.094977+0000","last_undegraded":"2024-04-25T10:05:12.094977+0000","last_fullsized":"2024-04-25T10:05:12.094977+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:49.878046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948443+0000","last_change":"2024-04-25T10:05:11.091308+0000","last_active":"2024-04-25T10:05:12.948443+0000","last_peered":"2024-04-25T10:05:12.948443+0000","last_clean":"2024-04-25T10:05:12.948443+0000","last_became_active":"2024-04-25T10:05:11.091057+0000","last_became_peered":"2024-04-25T10:05:11.091057+0000","last_unstale":"2024-04-25T10:05:12.948443+0000","last_undegraded":"2024-04-25T10:05:12.948443+0000","last_fullsized":"2024-04-25T10:05:12.948443+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:45.168016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094120+0000","last_change":"2024-04-25T10:05:11.111606+0000","last_active":"2024-04-25T10:05:12.094120+0000","last_peered":"2024-04-25T10:05:12.094120+0000","last_clean":"2024-04-25T10:05:12.094120+0000","last_became_active":"2024-04-25T10:05:11.109264+0000","last_became_peered":"2024-04-25T10:05:11.109264+0000","last_unstale":"2024-04-25T10:05:12.094120+0000","last_undegraded":"2024-04-25T10:05:12.094120+0000","last_fullsized":"2024-04-25T10:05:12.094120+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947911+0000","last_change":"2024-04-25T10:05:11.107211+0000","last_active":"2024-04-25T10:05:12.947911+0000","last_peered":"2024-04-25T10:05:12.947911+0000","last_clean":"2024-04-25T10:05:12.947911+0000","last_became_active":"2024-04-25T10:05:11.106615+0000","last_became_peered":"2024-04-25T10:05:11.106615+0000","last_unstale":"2024-04-25T10:05:12.947911+0000","last_undegraded":"2024-04-25T10:05:12.947911+0000","last_fullsized":"2024-04-25T10:05:12.947911+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112817+0000","last_change":"2024-04-25T10:05:11.111474+0000","last_active":"2024-04-25T10:05:11.112817+0000","last_peered":"2024-04-25T10:05:11.112817+0000","last_clean":"2024-04-25T10:05:11.112817+0000","last_became_active":"2024-04-25T10:05:11.110995+0000","last_became_peered":"2024-04-25T10:05:11.110995+0000","last_unstale":"2024-04-25T10:05:11.112817+0000","last_undegraded":"2024-04-25T10:05:11.112817+0000","last_fullsized":"2024-04-25T10:05:11.112817+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:17.860936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.095235+0000","last_change":"2024-04-25T10:05:11.099880+0000","last_active":"2024-04-25T10:05:12.095235+0000","last_peered":"2024-04-25T10:05:12.095235+0000","last_clean":"2024-04-25T10:05:12.095235+0000","last_became_active":"2024-04-25T10:05:11.099609+0000","last_became_peered":"2024-04-25T10:05:11.099609+0000","last_unstale":"2024-04-25T10:05:12.095235+0000","last_undegraded":"2024-04-25T10:05:12.095235+0000","last_fullsized":"2024-04-25T10:05:12.095235+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:33.083192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214265+0000","last_change":"2024-04-25T10:05:11.094918+0000","last_active":"2024-04-25T10:05:12.214265+0000","last_peered":"2024-04-25T10:05:12.214265+0000","last_clean":"2024-04-25T10:05:12.214265+0000","last_became_active":"2024-04-25T10:05:11.094529+0000","last_became_peered":"2024-04-25T10:05:11.094529+0000","last_unstale":"2024-04-25T10:05:12.214265+0000","last_undegraded":"2024-04-25T10:05:12.214265+0000","last_fullsized":"2024-04-25T10:05:12.214265+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.095014+0000","last_change":"2024-04-25T10:05:11.099807+0000","last_active":"2024-04-25T10:05:12.095014+0000","last_peered":"2024-04-25T10:05:12.095014+0000","last_clean":"2024-04-25T10:05:12.095014+0000","last_became_active":"2024-04-25T10:05:11.099298+0000","last_became_peered":"2024-04-25T10:05:11.099298+0000","last_unstale":"2024-04-25T10:05:12.095014+0000","last_undegraded":"2024-04-25T10:05:12.095014+0000","last_fullsized":"2024-04-25T10:05:12.095014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:36.777380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948507+0000","last_change":"2024-04-25T10:05:11.097714+0000","last_active":"2024-04-25T10:05:12.948507+0000","last_peered":"2024-04-25T10:05:12.948507+0000","last_clean":"2024-04-25T10:05:12.948507+0000","last_became_active":"2024-04-25T10:05:11.097193+0000","last_became_peered":"2024-04-25T10:05:11.097193+0000","last_unstale":"2024-04-25T10:05:12.948507+0000","last_undegraded":"2024-04-25T10:05:12.948507+0000","last_fullsized":"2024-04-25T10:05:12.948507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:22.746280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094799+0000","last_change":"2024-04-25T10:05:11.091283+0000","last_active":"2024-04-25T10:05:12.094799+0000","last_peered":"2024-04-25T10:05:12.094799+0000","last_clean":"2024-04-25T10:05:12.094799+0000","last_became_active":"2024-04-25T10:05:11.091006+0000","last_became_peered":"2024-04-25T10:05:11.091006+0000","last_unstale":"2024-04-25T10:05:12.094799+0000","last_undegraded":"2024-04-25T10:05:12.094799+0000","last_fullsized":"2024-04-25T10:05:12.094799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:45.286765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094789+0000","last_change":"2024-04-25T10:05:11.083639+0000","last_active":"2024-04-25T10:05:12.094789+0000","last_peered":"2024-04-25T10:05:12.094789+0000","last_clean":"2024-04-25T10:05:12.094789+0000","last_became_active":"2024-04-25T10:05:11.083357+0000","last_became_peered":"2024-04-25T10:05:11.083357+0000","last_unstale":"2024-04-25T10:05:12.094789+0000","last_undegraded":"2024-04-25T10:05:12.094789+0000","last_fullsized":"2024-04-25T10:05:12.094789+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:31.855424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947849+0000","last_change":"2024-04-25T10:05:11.107434+0000","last_active":"2024-04-25T10:05:12.947849+0000","last_peered":"2024-04-25T10:05:12.947849+0000","last_clean":"2024-04-25T10:05:12.947849+0000","last_became_active":"2024-04-25T10:05:11.106911+0000","last_became_peered":"2024-04-25T10:05:11.106911+0000","last_unstale":"2024-04-25T10:05:12.947849+0000","last_undegraded":"2024-04-25T10:05:12.947849+0000","last_fullsized":"2024-04-25T10:05:12.947849+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213985+0000","last_change":"2024-04-25T10:05:11.104263+0000","last_active":"2024-04-25T10:05:12.213985+0000","last_peered":"2024-04-25T10:05:12.213985+0000","last_clean":"2024-04-25T10:05:12.213985+0000","last_became_active":"2024-04-25T10:05:11.103952+0000","last_became_peered":"2024-04-25T10:05:11.103952+0000","last_unstale":"2024-04-25T10:05:12.213985+0000","last_undegraded":"2024-04-25T10:05:12.213985+0000","last_fullsized":"2024-04-25T10:05:12.213985+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948553+0000","last_change":"2024-04-25T10:05:11.109572+0000","last_active":"2024-04-25T10:05:12.948553+0000","last_peered":"2024-04-25T10:05:12.948553+0000","last_clean":"2024-04-25T10:05:12.948553+0000","last_became_active":"2024-04-25T10:05:11.106716+0000","last_became_peered":"2024-04-25T10:05:11.106716+0000","last_unstale":"2024-04-25T10:05:12.948553+0000","last_undegraded":"2024-04-25T10:05:12.948553+0000","last_fullsized":"2024-04-25T10:05:12.948553+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.986951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.095237+0000","last_change":"2024-04-25T10:05:10.097005+0000","last_active":"2024-04-25T10:05:12.095237+0000","last_peered":"2024-04-25T10:05:12.095237+0000","last_clean":"2024-04-25T10:05:12.095237+0000","last_became_active":"2024-04-25T10:05:10.096716+0000","last_became_peered":"2024-04-25T10:05:10.096716+0000","last_unstale":"2024-04-25T10:05:12.095237+0000","last_undegraded":"2024-04-25T10:05:12.095237+0000","last_fullsized":"2024-04-25T10:05:12.095237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:11.081046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214289+0000","last_change":"2024-04-25T10:05:11.098506+0000","last_active":"2024-04-25T10:05:12.214289+0000","last_peered":"2024-04-25T10:05:12.214289+0000","last_clean":"2024-04-25T10:05:12.214289+0000","last_became_active":"2024-04-25T10:05:11.097683+0000","last_became_peered":"2024-04-25T10:05:11.097683+0000","last_unstale":"2024-04-25T10:05:12.214289+0000","last_undegraded":"2024-04-25T10:05:12.214289+0000","last_fullsized":"2024-04-25T10:05:12.214289+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174726+0000","last_change":"2024-04-25T10:05:10.095080+0000","last_active":"2024-04-25T10:05:12.174726+0000","last_peered":"2024-04-25T10:05:12.174726+0000","last_clean":"2024-04-25T10:05:12.174726+0000","last_became_active":"2024-04-25T10:05:10.094684+0000","last_became_peered":"2024-04-25T10:05:10.094684+0000","last_unstale":"2024-04-25T10:05:12.174726+0000","last_undegraded":"2024-04-25T10:05:12.174726+0000","last_fullsized":"2024-04-25T10:05:12.174726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.641951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094305+0000","last_change":"2024-04-25T10:05:11.102619+0000","last_active":"2024-04-25T10:05:12.094305+0000","last_peered":"2024-04-25T10:05:12.094305+0000","last_clean":"2024-04-25T10:05:12.094305+0000","last_became_active":"2024-04-25T10:05:11.102171+0000","last_became_peered":"2024-04-25T10:05:11.102171+0000","last_unstale":"2024-04-25T10:05:12.094305+0000","last_undegraded":"2024-04-25T10:05:12.094305+0000","last_fullsized":"2024-04-25T10:05:12.094305+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214343+0000","last_change":"2024-04-25T10:05:10.096555+0000","last_active":"2024-04-25T10:05:12.214343+0000","last_peered":"2024-04-25T10:05:12.214343+0000","last_clean":"2024-04-25T10:05:12.214343+0000","last_became_active":"2024-04-25T10:05:10.096283+0000","last_became_peered":"2024-04-25T10:05:10.096283+0000","last_unstale":"2024-04-25T10:05:12.214343+0000","last_undegraded":"2024-04-25T10:05:12.214343+0000","last_fullsized":"2024-04-25T10:05:12.214343+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:28.739560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088113+0000","last_change":"2024-04-25T10:05:11.099962+0000","last_active":"2024-04-25T10:05:12.088113+0000","last_peered":"2024-04-25T10:05:12.088113+0000","last_clean":"2024-04-25T10:05:12.088113+0000","last_became_active":"2024-04-25T10:05:11.099514+0000","last_became_peered":"2024-04-25T10:05:11.099514+0000","last_unstale":"2024-04-25T10:05:12.088113+0000","last_undegraded":"2024-04-25T10:05:12.088113+0000","last_fullsized":"2024-04-25T10:05:12.088113+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:28.598478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094112+0000","last_change":"2024-04-25T10:05:10.090462+0000","last_active":"2024-04-25T10:05:12.094112+0000","last_peered":"2024-04-25T10:05:12.094112+0000","last_clean":"2024-04-25T10:05:12.094112+0000","last_became_active":"2024-04-25T10:05:10.090124+0000","last_became_peered":"2024-04-25T10:05:10.090124+0000","last_unstale":"2024-04-25T10:05:12.094112+0000","last_undegraded":"2024-04-25T10:05:12.094112+0000","last_fullsized":"2024-04-25T10:05:12.094112+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:28.739560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174246+0000","last_change":"2024-04-25T10:05:11.092467+0000","last_active":"2024-04-25T10:05:12.174246+0000","last_peered":"2024-04-25T10:05:12.174246+0000","last_clean":"2024-04-25T10:05:12.174246+0000","last_became_active":"2024-04-25T10:05:11.092175+0000","last_became_peered":"2024-04-25T10:05:11.092175+0000","last_unstale":"2024-04-25T10:05:12.174246+0000","last_undegraded":"2024-04-25T10:05:12.174246+0000","last_fullsized":"2024-04-25T10:05:12.174246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948442+0000","last_change":"2024-04-25T10:05:10.097388+0000","last_active":"2024-04-25T10:05:12.948442+0000","last_peered":"2024-04-25T10:05:12.948442+0000","last_clean":"2024-04-25T10:05:12.948442+0000","last_became_active":"2024-04-25T10:05:10.097090+0000","last_became_peered":"2024-04-25T10:05:10.097090+0000","last_unstale":"2024-04-25T10:05:12.948442+0000","last_undegraded":"2024-04-25T10:05:12.948442+0000","last_fullsized":"2024-04-25T10:05:12.948442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948270+0000","last_change":"2024-04-25T10:05:11.101356+0000","last_active":"2024-04-25T10:05:12.948270+0000","last_peered":"2024-04-25T10:05:12.948270+0000","last_clean":"2024-04-25T10:05:12.948270+0000","last_became_active":"2024-04-25T10:05:11.100607+0000","last_became_peered":"2024-04-25T10:05:11.100607+0000","last_unstale":"2024-04-25T10:05:12.948270+0000","last_undegraded":"2024-04-25T10:05:12.948270+0000","last_fullsized":"2024-04-25T10:05:12.948270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:48.273996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947791+0000","last_change":"2024-04-25T10:05:10.101709+0000","last_active":"2024-04-25T10:05:12.947791+0000","last_peered":"2024-04-25T10:05:12.947791+0000","last_clean":"2024-04-25T10:05:12.947791+0000","last_became_active":"2024-04-25T10:05:10.101434+0000","last_became_peered":"2024-04-25T10:05:10.101434+0000","last_unstale":"2024-04-25T10:05:12.947791+0000","last_undegraded":"2024-04-25T10:05:12.947791+0000","last_fullsized":"2024-04-25T10:05:12.947791+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:11.081046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094270+0000","last_change":"2024-04-25T10:05:11.104604+0000","last_active":"2024-04-25T10:05:12.094270+0000","last_peered":"2024-04-25T10:05:12.094270+0000","last_clean":"2024-04-25T10:05:12.094270+0000","last_became_active":"2024-04-25T10:05:11.103980+0000","last_became_peered":"2024-04-25T10:05:11.103980+0000","last_unstale":"2024-04-25T10:05:12.094270+0000","last_undegraded":"2024-04-25T10:05:12.094270+0000","last_fullsized":"2024-04-25T10:05:12.094270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:17.179849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213946+0000","last_change":"2024-04-25T10:05:10.092352+0000","last_active":"2024-04-25T10:05:12.213946+0000","last_peered":"2024-04-25T10:05:12.213946+0000","last_clean":"2024-04-25T10:05:12.213946+0000","last_became_active":"2024-04-25T10:05:10.092136+0000","last_became_peered":"2024-04-25T10:05:10.092136+0000","last_unstale":"2024-04-25T10:05:12.213946+0000","last_undegraded":"2024-04-25T10:05:12.213946+0000","last_fullsized":"2024-04-25T10:05:12.213946+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.008784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087845+0000","last_change":"2024-04-25T10:05:11.109057+0000","last_active":"2024-04-25T10:05:12.087845+0000","last_peered":"2024-04-25T10:05:12.087845+0000","last_clean":"2024-04-25T10:05:12.087845+0000","last_became_active":"2024-04-25T10:05:11.108768+0000","last_became_peered":"2024-04-25T10:05:11.108768+0000","last_unstale":"2024-04-25T10:05:12.087845+0000","last_undegraded":"2024-04-25T10:05:12.087845+0000","last_fullsized":"2024-04-25T10:05:12.087845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:34.641815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.093657+0000","last_change":"2024-04-25T10:05:10.088210+0000","last_active":"2024-04-25T10:05:12.093657+0000","last_peered":"2024-04-25T10:05:12.093657+0000","last_clean":"2024-04-25T10:05:12.093657+0000","last_became_active":"2024-04-25T10:05:10.087689+0000","last_became_peered":"2024-04-25T10:05:10.087689+0000","last_unstale":"2024-04-25T10:05:12.093657+0000","last_undegraded":"2024-04-25T10:05:12.093657+0000","last_fullsized":"2024-04-25T10:05:12.093657+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.008784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.112060+0000","last_change":"2024-04-25T10:05:11.107490+0000","last_active":"2024-04-25T10:05:11.112060+0000","last_peered":"2024-04-25T10:05:11.112060+0000","last_clean":"2024-04-25T10:05:11.112060+0000","last_became_active":"2024-04-25T10:05:11.107169+0000","last_became_peered":"2024-04-25T10:05:11.107169+0000","last_unstale":"2024-04-25T10:05:11.112060+0000","last_undegraded":"2024-04-25T10:05:11.112060+0000","last_fullsized":"2024-04-25T10:05:11.112060+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:40.349412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088199+0000","last_change":"2024-04-25T10:05:10.088358+0000","last_active":"2024-04-25T10:05:12.088199+0000","last_peered":"2024-04-25T10:05:12.088199+0000","last_clean":"2024-04-25T10:05:12.088199+0000","last_became_active":"2024-04-25T10:05:10.088093+0000","last_became_peered":"2024-04-25T10:05:10.088093+0000","last_unstale":"2024-04-25T10:05:12.088199+0000","last_undegraded":"2024-04-25T10:05:12.088199+0000","last_fullsized":"2024-04-25T10:05:12.088199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:21.592620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947784+0000","last_change":"2024-04-25T10:05:11.110963+0000","last_active":"2024-04-25T10:05:12.947784+0000","last_peered":"2024-04-25T10:05:12.947784+0000","last_clean":"2024-04-25T10:05:12.947784+0000","last_became_active":"2024-04-25T10:05:11.110718+0000","last_became_peered":"2024-04-25T10:05:11.110718+0000","last_unstale":"2024-04-25T10:05:12.947784+0000","last_undegraded":"2024-04-25T10:05:12.947784+0000","last_fullsized":"2024-04-25T10:05:12.947784+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:05.313042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948857+0000","last_change":"2024-04-25T10:05:10.088738+0000","last_active":"2024-04-25T10:05:12.948857+0000","last_peered":"2024-04-25T10:05:12.948857+0000","last_clean":"2024-04-25T10:05:12.948857+0000","last_became_active":"2024-04-25T10:05:10.088464+0000","last_became_peered":"2024-04-25T10:05:10.088464+0000","last_unstale":"2024-04-25T10:05:12.948857+0000","last_undegraded":"2024-04-25T10:05:12.948857+0000","last_fullsized":"2024-04-25T10:05:12.948857+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:44.276562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174731+0000","last_change":"2024-04-25T10:05:11.108397+0000","last_active":"2024-04-25T10:05:12.174731+0000","last_peered":"2024-04-25T10:05:12.174731+0000","last_clean":"2024-04-25T10:05:12.174731+0000","last_became_active":"2024-04-25T10:05:11.108120+0000","last_became_peered":"2024-04-25T10:05:11.108120+0000","last_unstale":"2024-04-25T10:05:12.174731+0000","last_undegraded":"2024-04-25T10:05:12.174731+0000","last_fullsized":"2024-04-25T10:05:12.174731+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:17.986951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948576+0000","last_change":"2024-04-25T10:05:10.090425+0000","last_active":"2024-04-25T10:05:12.948576+0000","last_peered":"2024-04-25T10:05:12.948576+0000","last_clean":"2024-04-25T10:05:12.948576+0000","last_became_active":"2024-04-25T10:05:10.090159+0000","last_became_peered":"2024-04-25T10:05:10.090159+0000","last_unstale":"2024-04-25T10:05:12.948576+0000","last_undegraded":"2024-04-25T10:05:12.948576+0000","last_fullsized":"2024-04-25T10:05:12.948576+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:05:30.845222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094198+0000","last_change":"2024-04-25T10:05:11.108733+0000","last_active":"2024-04-25T10:05:12.094198+0000","last_peered":"2024-04-25T10:05:12.094198+0000","last_clean":"2024-04-25T10:05:12.094198+0000","last_became_active":"2024-04-25T10:05:11.108477+0000","last_became_peered":"2024-04-25T10:05:11.108477+0000","last_unstale":"2024-04-25T10:05:12.094198+0000","last_undegraded":"2024-04-25T10:05:12.094198+0000","last_fullsized":"2024-04-25T10:05:12.094198+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087993+0000","last_change":"2024-04-25T10:05:10.086083+0000","last_active":"2024-04-25T10:05:12.087993+0000","last_peered":"2024-04-25T10:05:12.087993+0000","last_clean":"2024-04-25T10:05:12.087993+0000","last_became_active":"2024-04-25T10:05:10.085812+0000","last_became_peered":"2024-04-25T10:05:10.085812+0000","last_unstale":"2024-04-25T10:05:12.087993+0000","last_undegraded":"2024-04-25T10:05:12.087993+0000","last_fullsized":"2024-04-25T10:05:12.087993+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:59.282929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174244+0000","last_change":"2024-04-25T10:05:11.095667+0000","last_active":"2024-04-25T10:05:12.174244+0000","last_peered":"2024-04-25T10:05:12.174244+0000","last_clean":"2024-04-25T10:05:12.174244+0000","last_became_active":"2024-04-25T10:05:11.095388+0000","last_became_peered":"2024-04-25T10:05:11.095388+0000","last_unstale":"2024-04-25T10:05:12.174244+0000","last_undegraded":"2024-04-25T10:05:12.174244+0000","last_fullsized":"2024-04-25T10:05:12.174244+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088108+0000","last_change":"2024-04-25T10:05:10.099572+0000","last_active":"2024-04-25T10:05:12.088108+0000","last_peered":"2024-04-25T10:05:12.088108+0000","last_clean":"2024-04-25T10:05:12.088108+0000","last_became_active":"2024-04-25T10:05:10.098996+0000","last_became_peered":"2024-04-25T10:05:10.098996+0000","last_unstale":"2024-04-25T10:05:12.088108+0000","last_undegraded":"2024-04-25T10:05:12.088108+0000","last_fullsized":"2024-04-25T10:05:12.088108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:55.367622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087527+0000","last_change":"2024-04-25T10:05:11.084885+0000","last_active":"2024-04-25T10:05:12.087527+0000","last_peered":"2024-04-25T10:05:12.087527+0000","last_clean":"2024-04-25T10:05:12.087527+0000","last_became_active":"2024-04-25T10:05:11.084583+0000","last_became_peered":"2024-04-25T10:05:11.084583+0000","last_unstale":"2024-04-25T10:05:12.087527+0000","last_undegraded":"2024-04-25T10:05:12.087527+0000","last_fullsized":"2024-04-25T10:05:12.087527+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:44:21.947174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213889+0000","last_change":"2024-04-25T10:05:10.091905+0000","last_active":"2024-04-25T10:05:12.213889+0000","last_peered":"2024-04-25T10:05:12.213889+0000","last_clean":"2024-04-25T10:05:12.213889+0000","last_became_active":"2024-04-25T10:05:10.089979+0000","last_became_peered":"2024-04-25T10:05:10.089979+0000","last_unstale":"2024-04-25T10:05:12.213889+0000","last_undegraded":"2024-04-25T10:05:12.213889+0000","last_fullsized":"2024-04-25T10:05:12.213889+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.641951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947631+0000","last_change":"2024-04-25T10:05:11.115884+0000","last_active":"2024-04-25T10:05:12.947631+0000","last_peered":"2024-04-25T10:05:12.947631+0000","last_clean":"2024-04-25T10:05:12.947631+0000","last_became_active":"2024-04-25T10:05:11.114790+0000","last_became_peered":"2024-04-25T10:05:11.114790+0000","last_unstale":"2024-04-25T10:05:12.947631+0000","last_undegraded":"2024-04-25T10:05:12.947631+0000","last_fullsized":"2024-04-25T10:05:12.947631+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:57.856245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094660+0000","last_change":"2024-04-25T10:05:10.088643+0000","last_active":"2024-04-25T10:05:12.094660+0000","last_peered":"2024-04-25T10:05:12.094660+0000","last_clean":"2024-04-25T10:05:12.094660+0000","last_became_active":"2024-04-25T10:05:10.088380+0000","last_became_peered":"2024-04-25T10:05:10.088380+0000","last_unstale":"2024-04-25T10:05:12.094660+0000","last_undegraded":"2024-04-25T10:05:12.094660+0000","last_fullsized":"2024-04-25T10:05:12.094660+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:27.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088034+0000","last_change":"2024-04-25T10:05:11.087255+0000","last_active":"2024-04-25T10:05:12.088034+0000","last_peered":"2024-04-25T10:05:12.088034+0000","last_clean":"2024-04-25T10:05:12.088034+0000","last_became_active":"2024-04-25T10:05:11.086894+0000","last_became_peered":"2024-04-25T10:05:11.086894+0000","last_unstale":"2024-04-25T10:05:12.088034+0000","last_undegraded":"2024-04-25T10:05:12.088034+0000","last_fullsized":"2024-04-25T10:05:12.088034+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:53.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":22,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947819+0000","last_change":"2024-04-25T10:05:10.101751+0000","last_active":"2024-04-25T10:05:12.947819+0000","last_peered":"2024-04-25T10:05:12.947819+0000","last_clean":"2024-04-25T10:05:12.947819+0000","last_became_active":"2024-04-25T10:05:10.101424+0000","last_became_peered":"2024-04-25T10:05:10.101424+0000","last_unstale":"2024-04-25T10:05:12.947819+0000","last_undegraded":"2024-04-25T10:05:12.947819+0000","last_fullsized":"2024-04-25T10:05:12.947819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:27.445042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087852+0000","last_change":"2024-04-25T10:05:11.094200+0000","last_active":"2024-04-25T10:05:12.087852+0000","last_peered":"2024-04-25T10:05:12.087852+0000","last_clean":"2024-04-25T10:05:12.087852+0000","last_became_active":"2024-04-25T10:05:11.093919+0000","last_became_peered":"2024-04-25T10:05:11.093919+0000","last_unstale":"2024-04-25T10:05:12.087852+0000","last_undegraded":"2024-04-25T10:05:12.087852+0000","last_fullsized":"2024-04-25T10:05:12.087852+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:33.344272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.949006+0000","last_change":"2024-04-25T10:05:10.094054+0000","last_active":"2024-04-25T10:05:12.949006+0000","last_peered":"2024-04-25T10:05:12.949006+0000","last_clean":"2024-04-25T10:05:12.949006+0000","last_became_active":"2024-04-25T10:05:10.093751+0000","last_became_peered":"2024-04-25T10:05:10.093751+0000","last_unstale":"2024-04-25T10:05:12.949006+0000","last_undegraded":"2024-04-25T10:05:12.949006+0000","last_fullsized":"2024-04-25T10:05:12.949006+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:48.867843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948455+0000","last_change":"2024-04-25T10:05:11.093213+0000","last_active":"2024-04-25T10:05:12.948455+0000","last_peered":"2024-04-25T10:05:12.948455+0000","last_clean":"2024-04-25T10:05:12.948455+0000","last_became_active":"2024-04-25T10:05:11.092816+0000","last_became_peered":"2024-04-25T10:05:11.092816+0000","last_unstale":"2024-04-25T10:05:12.948455+0000","last_undegraded":"2024-04-25T10:05:12.948455+0000","last_fullsized":"2024-04-25T10:05:12.948455+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:01.115295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094346+0000","last_change":"2024-04-25T10:05:10.094386+0000","last_active":"2024-04-25T10:05:12.094346+0000","last_peered":"2024-04-25T10:05:12.094346+0000","last_clean":"2024-04-25T10:05:12.094346+0000","last_became_active":"2024-04-25T10:05:10.089989+0000","last_became_peered":"2024-04-25T10:05:10.089989+0000","last_unstale":"2024-04-25T10:05:12.094346+0000","last_undegraded":"2024-04-25T10:05:12.094346+0000","last_fullsized":"2024-04-25T10:05:12.094346+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094225+0000","last_change":"2024-04-25T10:05:11.095432+0000","last_active":"2024-04-25T10:05:12.094225+0000","last_peered":"2024-04-25T10:05:12.094225+0000","last_clean":"2024-04-25T10:05:12.094225+0000","last_became_active":"2024-04-25T10:05:11.093316+0000","last_became_peered":"2024-04-25T10:05:11.093316+0000","last_unstale":"2024-04-25T10:05:12.094225+0000","last_undegraded":"2024-04-25T10:05:12.094225+0000","last_fullsized":"2024-04-25T10:05:12.094225+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.111085+0000","last_change":"2024-04-25T10:05:10.090740+0000","last_active":"2024-04-25T10:05:11.111085+0000","last_peered":"2024-04-25T10:05:11.111085+0000","last_clean":"2024-04-25T10:05:11.111085+0000","last_became_active":"2024-04-25T10:05:10.090484+0000","last_became_peered":"2024-04-25T10:05:10.090484+0000","last_unstale":"2024-04-25T10:05:11.111085+0000","last_undegraded":"2024-04-25T10:05:11.111085+0000","last_fullsized":"2024-04-25T10:05:11.111085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:25.229873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.106427+0000","last_change":"2024-04-25T10:05:11.101704+0000","last_active":"2024-04-25T10:05:11.106427+0000","last_peered":"2024-04-25T10:05:11.106427+0000","last_clean":"2024-04-25T10:05:11.106427+0000","last_became_active":"2024-04-25T10:05:11.100575+0000","last_became_peered":"2024-04-25T10:05:11.100575+0000","last_unstale":"2024-04-25T10:05:11.106427+0000","last_undegraded":"2024-04-25T10:05:11.106427+0000","last_fullsized":"2024-04-25T10:05:11.106427+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:22.425015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214119+0000","last_change":"2024-04-25T10:05:10.098802+0000","last_active":"2024-04-25T10:05:12.214119+0000","last_peered":"2024-04-25T10:05:12.214119+0000","last_clean":"2024-04-25T10:05:12.214119+0000","last_became_active":"2024-04-25T10:05:10.098437+0000","last_became_peered":"2024-04-25T10:05:10.098437+0000","last_unstale":"2024-04-25T10:05:12.214119+0000","last_undegraded":"2024-04-25T10:05:12.214119+0000","last_fullsized":"2024-04-25T10:05:12.214119+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947999+0000","last_change":"2024-04-25T10:05:11.106943+0000","last_active":"2024-04-25T10:05:12.947999+0000","last_peered":"2024-04-25T10:05:12.947999+0000","last_clean":"2024-04-25T10:05:12.947999+0000","last_became_active":"2024-04-25T10:05:11.106666+0000","last_became_peered":"2024-04-25T10:05:11.106666+0000","last_unstale":"2024-04-25T10:05:12.947999+0000","last_undegraded":"2024-04-25T10:05:12.947999+0000","last_fullsized":"2024-04-25T10:05:12.947999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:12.759672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.109397+0000","last_change":"2024-04-25T10:05:10.093680+0000","last_active":"2024-04-25T10:05:11.109397+0000","last_peered":"2024-04-25T10:05:11.109397+0000","last_clean":"2024-04-25T10:05:11.109397+0000","last_became_active":"2024-04-25T10:05:10.093248+0000","last_became_peered":"2024-04-25T10:05:10.093248+0000","last_unstale":"2024-04-25T10:05:11.109397+0000","last_undegraded":"2024-04-25T10:05:11.109397+0000","last_fullsized":"2024-04-25T10:05:11.109397+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:41.282055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174407+0000","last_change":"2024-04-25T10:05:11.102365+0000","last_active":"2024-04-25T10:05:12.174407+0000","last_peered":"2024-04-25T10:05:12.174407+0000","last_clean":"2024-04-25T10:05:12.174407+0000","last_became_active":"2024-04-25T10:05:11.101717+0000","last_became_peered":"2024-04-25T10:05:11.101717+0000","last_unstale":"2024-04-25T10:05:12.174407+0000","last_undegraded":"2024-04-25T10:05:12.174407+0000","last_fullsized":"2024-04-25T10:05:12.174407+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.097447+0000","last_change":"2024-04-25T10:05:10.088028+0000","last_active":"2024-04-25T10:05:11.097447+0000","last_peered":"2024-04-25T10:05:11.097447+0000","last_clean":"2024-04-25T10:05:11.097447+0000","last_became_active":"2024-04-25T10:05:10.087717+0000","last_became_peered":"2024-04-25T10:05:10.087717+0000","last_unstale":"2024-04-25T10:05:11.097447+0000","last_undegraded":"2024-04-25T10:05:11.097447+0000","last_fullsized":"2024-04-25T10:05:11.097447+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:31.274090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948612+0000","last_change":"2024-04-25T10:05:11.101657+0000","last_active":"2024-04-25T10:05:12.948612+0000","last_peered":"2024-04-25T10:05:12.948612+0000","last_clean":"2024-04-25T10:05:12.948612+0000","last_became_active":"2024-04-25T10:05:11.101351+0000","last_became_peered":"2024-04-25T10:05:11.101351+0000","last_unstale":"2024-04-25T10:05:12.948612+0000","last_undegraded":"2024-04-25T10:05:12.948612+0000","last_fullsized":"2024-04-25T10:05:12.948612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:03.022697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947942+0000","last_change":"2024-04-25T10:05:10.099339+0000","last_active":"2024-04-25T10:05:12.947942+0000","last_peered":"2024-04-25T10:05:12.947942+0000","last_clean":"2024-04-25T10:05:12.947942+0000","last_became_active":"2024-04-25T10:05:10.099009+0000","last_became_peered":"2024-04-25T10:05:10.099009+0000","last_unstale":"2024-04-25T10:05:12.947942+0000","last_undegraded":"2024-04-25T10:05:12.947942+0000","last_fullsized":"2024-04-25T10:05:12.947942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:51.470496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088054+0000","last_change":"2024-04-25T10:05:11.109075+0000","last_active":"2024-04-25T10:05:12.088054+0000","last_peered":"2024-04-25T10:05:12.088054+0000","last_clean":"2024-04-25T10:05:12.088054+0000","last_became_active":"2024-04-25T10:05:11.108360+0000","last_became_peered":"2024-04-25T10:05:11.108360+0000","last_unstale":"2024-04-25T10:05:12.088054+0000","last_undegraded":"2024-04-25T10:05:12.088054+0000","last_fullsized":"2024-04-25T10:05:12.088054+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:40.432448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.098393+0000","last_change":"2024-04-25T10:05:10.093466+0000","last_active":"2024-04-25T10:05:11.098393+0000","last_peered":"2024-04-25T10:05:11.098393+0000","last_clean":"2024-04-25T10:05:11.098393+0000","last_became_active":"2024-04-25T10:05:10.093040+0000","last_became_peered":"2024-04-25T10:05:10.093040+0000","last_unstale":"2024-04-25T10:05:11.098393+0000","last_undegraded":"2024-04-25T10:05:11.098393+0000","last_fullsized":"2024-04-25T10:05:11.098393+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:20.918991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.214043+0000","last_change":"2024-04-25T10:05:11.097290+0000","last_active":"2024-04-25T10:05:12.214043+0000","last_peered":"2024-04-25T10:05:12.214043+0000","last_clean":"2024-04-25T10:05:12.214043+0000","last_became_active":"2024-04-25T10:05:11.097027+0000","last_became_peered":"2024-04-25T10:05:11.097027+0000","last_unstale":"2024-04-25T10:05:12.214043+0000","last_undegraded":"2024-04-25T10:05:12.214043+0000","last_fullsized":"2024-04-25T10:05:12.214043+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.949041+0000","last_change":"2024-04-25T10:05:10.091090+0000","last_active":"2024-04-25T10:05:12.949041+0000","last_peered":"2024-04-25T10:05:12.949041+0000","last_clean":"2024-04-25T10:05:12.949041+0000","last_became_active":"2024-04-25T10:05:10.090761+0000","last_became_peered":"2024-04-25T10:05:10.090761+0000","last_unstale":"2024-04-25T10:05:12.949041+0000","last_undegraded":"2024-04-25T10:05:12.949041+0000","last_fullsized":"2024-04-25T10:05:12.949041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:35.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948679+0000","last_change":"2024-04-25T10:05:11.110681+0000","last_active":"2024-04-25T10:05:12.948679+0000","last_peered":"2024-04-25T10:05:12.948679+0000","last_clean":"2024-04-25T10:05:12.948679+0000","last_became_active":"2024-04-25T10:05:11.110476+0000","last_became_peered":"2024-04-25T10:05:11.110476+0000","last_unstale":"2024-04-25T10:05:12.948679+0000","last_undegraded":"2024-04-25T10:05:12.948679+0000","last_fullsized":"2024-04-25T10:05:12.948679+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:37.369468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T10:05:11.094601+0000","last_change":"2024-04-25T10:05:10.091396+0000","last_active":"2024-04-25T10:05:11.094601+0000","last_peered":"2024-04-25T10:05:11.094601+0000","last_clean":"2024-04-25T10:05:11.094601+0000","last_became_active":"2024-04-25T10:05:10.088637+0000","last_became_peered":"2024-04-25T10:05:10.088637+0000","last_unstale":"2024-04-25T10:05:11.094601+0000","last_undegraded":"2024-04-25T10:05:11.094601+0000","last_fullsized":"2024-04-25T10:05:11.094601+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:11.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.088021+0000","last_change":"2024-04-25T10:05:11.110267+0000","last_active":"2024-04-25T10:05:12.088021+0000","last_peered":"2024-04-25T10:05:12.088021+0000","last_clean":"2024-04-25T10:05:12.088021+0000","last_became_active":"2024-04-25T10:05:11.109965+0000","last_became_peered":"2024-04-25T10:05:11.109965+0000","last_unstale":"2024-04-25T10:05:12.088021+0000","last_undegraded":"2024-04-25T10:05:12.088021+0000","last_fullsized":"2024-04-25T10:05:12.088021+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:09.038449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174672+0000","last_change":"2024-04-25T10:05:10.096617+0000","last_active":"2024-04-25T10:05:12.174672+0000","last_peered":"2024-04-25T10:05:12.174672+0000","last_clean":"2024-04-25T10:05:12.174672+0000","last_became_active":"2024-04-25T10:05:10.096317+0000","last_became_peered":"2024-04-25T10:05:10.096317+0000","last_unstale":"2024-04-25T10:05:12.174672+0000","last_undegraded":"2024-04-25T10:05:12.174672+0000","last_fullsized":"2024-04-25T10:05:12.174672+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:58.032690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174345+0000","last_change":"2024-04-25T10:05:11.084109+0000","last_active":"2024-04-25T10:05:12.174345+0000","last_peered":"2024-04-25T10:05:12.174345+0000","last_clean":"2024-04-25T10:05:12.174345+0000","last_became_active":"2024-04-25T10:05:11.083788+0000","last_became_peered":"2024-04-25T10:05:11.083788+0000","last_unstale":"2024-04-25T10:05:12.174345+0000","last_undegraded":"2024-04-25T10:05:12.174345+0000","last_fullsized":"2024-04-25T10:05:12.174345+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:00.397044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.174449+0000","last_change":"2024-04-25T10:05:10.089722+0000","last_active":"2024-04-25T10:05:12.174449+0000","last_peered":"2024-04-25T10:05:12.174449+0000","last_clean":"2024-04-25T10:05:12.174449+0000","last_became_active":"2024-04-25T10:05:10.089462+0000","last_became_peered":"2024-04-25T10:05:10.089462+0000","last_unstale":"2024-04-25T10:05:12.174449+0000","last_undegraded":"2024-04-25T10:05:12.174449+0000","last_fullsized":"2024-04-25T10:05:12.174449+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.008784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.213905+0000","last_change":"2024-04-25T10:05:11.102775+0000","last_active":"2024-04-25T10:05:12.213905+0000","last_peered":"2024-04-25T10:05:12.213905+0000","last_clean":"2024-04-25T10:05:12.213905+0000","last_became_active":"2024-04-25T10:05:11.102526+0000","last_became_peered":"2024-04-25T10:05:11.102526+0000","last_unstale":"2024-04-25T10:05:12.213905+0000","last_undegraded":"2024-04-25T10:05:12.213905+0000","last_fullsized":"2024-04-25T10:05:12.213905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094904+0000","last_change":"2024-04-25T10:05:10.092281+0000","last_active":"2024-04-25T10:05:12.094904+0000","last_peered":"2024-04-25T10:05:12.094904+0000","last_clean":"2024-04-25T10:05:12.094904+0000","last_became_active":"2024-04-25T10:05:10.091951+0000","last_became_peered":"2024-04-25T10:05:10.091951+0000","last_unstale":"2024-04-25T10:05:12.094904+0000","last_undegraded":"2024-04-25T10:05:12.094904+0000","last_fullsized":"2024-04-25T10:05:12.094904+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:12:51.470496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.093848+0000","last_change":"2024-04-25T10:05:11.104216+0000","last_active":"2024-04-25T10:05:12.093848+0000","last_peered":"2024-04-25T10:05:12.093848+0000","last_clean":"2024-04-25T10:05:12.093848+0000","last_became_active":"2024-04-25T10:05:11.103454+0000","last_became_peered":"2024-04-25T10:05:11.103454+0000","last_unstale":"2024-04-25T10:05:12.093848+0000","last_undegraded":"2024-04-25T10:05:12.093848+0000","last_fullsized":"2024-04-25T10:05:12.093848+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:19.992775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.094002+0000","last_change":"2024-04-25T10:05:10.092946+0000","last_active":"2024-04-25T10:05:12.094002+0000","last_peered":"2024-04-25T10:05:12.094002+0000","last_clean":"2024-04-25T10:05:12.094002+0000","last_became_active":"2024-04-25T10:05:10.090476+0000","last_became_peered":"2024-04-25T10:05:10.090476+0000","last_unstale":"2024-04-25T10:05:12.094002+0000","last_undegraded":"2024-04-25T10:05:12.094002+0000","last_fullsized":"2024-04-25T10:05:12.094002+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.641951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947867+0000","last_change":"2024-04-25T10:05:11.109699+0000","last_active":"2024-04-25T10:05:12.947867+0000","last_peered":"2024-04-25T10:05:12.947867+0000","last_clean":"2024-04-25T10:05:12.947867+0000","last_became_active":"2024-04-25T10:05:11.107184+0000","last_became_peered":"2024-04-25T10:05:11.107184+0000","last_unstale":"2024-04-25T10:05:12.947867+0000","last_undegraded":"2024-04-25T10:05:12.947867+0000","last_fullsized":"2024-04-25T10:05:12.947867+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:42.214700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.087528+0000","last_change":"2024-04-25T10:05:10.087490+0000","last_active":"2024-04-25T10:05:12.087528+0000","last_peered":"2024-04-25T10:05:12.087528+0000","last_clean":"2024-04-25T10:05:12.087528+0000","last_became_active":"2024-04-25T10:05:10.087214+0000","last_became_peered":"2024-04-25T10:05:10.087214+0000","last_unstale":"2024-04-25T10:05:12.087528+0000","last_undegraded":"2024-04-25T10:05:12.087528+0000","last_fullsized":"2024-04-25T10:05:12.087528+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:48.182264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948476+0000","last_change":"2024-04-25T10:05:11.103516+0000","last_active":"2024-04-25T10:05:12.948476+0000","last_peered":"2024-04-25T10:05:12.948476+0000","last_clean":"2024-04-25T10:05:12.948476+0000","last_became_active":"2024-04-25T10:05:11.103236+0000","last_became_peered":"2024-04-25T10:05:11.103236+0000","last_unstale":"2024-04-25T10:05:12.948476+0000","last_undegraded":"2024-04-25T10:05:12.948476+0000","last_fullsized":"2024-04-25T10:05:12.948476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:10.062387+0000","last_clean_scrub_stamp":"2024-04-25T10:05:10.062387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:34.311228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.948040+0000","last_change":"2024-04-25T10:05:10.102309+0000","last_active":"2024-04-25T10:05:12.948040+0000","last_peered":"2024-04-25T10:05:12.948040+0000","last_clean":"2024-04-25T10:05:12.948040+0000","last_became_active":"2024-04-25T10:05:10.102042+0000","last_became_peered":"2024-04-25T10:05:10.102042+0000","last_unstale":"2024-04-25T10:05:12.948040+0000","last_undegraded":"2024-04-25T10:05:12.948040+0000","last_fullsized":"2024-04-25T10:05:12.948040+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:09.052184+0000","last_clean_scrub_stamp":"2024-04-25T10:05:09.052184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:58.032690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":205,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-25T10:05:12.947344+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:12.947344+0000","last_peered":"2024-04-25T10:05:12.947344+0000","last_clean":"2024-04-25T10:05:12.947344+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:12.947344+0000","last_undegraded":"2024-04-25T10:05:12.947344+0000","last_fullsized":"2024-04-25T10:05:12.947344+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":796077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509463,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":471040,"data_stored":204609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":197447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542166,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":471040,"data_stored":198981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542166,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":197425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32216,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339624,"statfs":{"total":96636764160,"available":96603774976,"internally_reserved":0,"allocated":1052672,"data_stored":787737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:15.604 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:05:15.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:05:15.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 Processor -- start 2024-04-25T10:05:15.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 -- start start 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 0x7ff7fc071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff7fc072040 0x7ff7fc161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc072460 con 0x7ff7fc161cc0 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc0b2dc0 con 0x7ff7fc072040 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff801600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc06ac10 con 0x7ff7fc15dd90 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.780+0000 7ff7f2000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff7fc072040 0x7ff7fc161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff7fc072040 0x7ff7fc161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45626/0 (socket says 172.21.15.18:45626) 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 -- 172.21.15.18:0/1123555047 learned_addr learned my addr 172.21.15.18:0/1123555047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7faa00640 1 --2- 172.21.15.18:0/1123555047 >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 0x7ff7fc071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 -- 172.21.15.18:0/1123555047 >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 msgr2=0x7ff7fc071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 --2- 172.21.15.18:0/1123555047 >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 0x7ff7fc071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 -- 172.21.15.18:0/1123555047 >> v1:172.21.15.167:6789/0 conn(0x7ff7fc161cc0 legacy=0x7ff7fc0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 -- 172.21.15.18:0/1123555047 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc06aeb0 con 0x7ff7fc072040 2024-04-25T10:05:15.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7faa00640 1 --2- 172.21.15.18:0/1123555047 >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 0x7ff7fc071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:15.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7f2000640 1 --2- 172.21.15.18:0/1123555047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc072040 0x7ff7fc161780 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc070be0 tx=0x7ff7e401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a7208047f4924a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7fa000640 1 -- 172.21.15.18:0/1123555047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40b2070 con 0x7ff7fc072040 2024-04-25T10:05:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7fa000640 1 -- 172.21.15.18:0/1123555047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40a9070 con 0x7ff7fc072040 2024-04-25T10:05:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.784+0000 7ff7fa000640 1 -- 172.21.15.18:0/1123555047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e40ad880 con 0x7ff7fc072040 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- 172.21.15.18:0/1123555047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc072040 msgr2=0x7ff7fc161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- 172.21.15.18:0/1123555047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc072040 0x7ff7fc161780 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc070be0 tx=0x7ff7e401c490 comp rx=0 tx=0).stop 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- 172.21.15.18:0/1123555047 shutdown_connections 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- 172.21.15.18:0/1123555047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc072040 0x7ff7fc161780 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- 172.21.15.18:0/1123555047 >> v2:172.21.15.167:3300/0 conn(0x7ff7fc15dd90 0x7ff7fc071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- 172.21.15.18:0/1123555047 >> 172.21.15.18:0/1123555047 conn(0x7ff7fc0cfd90 msgr2=0x7ff7fc0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- 172.21.15.18:0/1123555047 shutdown_connections 2024-04-25T10:05:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- 172.21.15.18:0/1123555047 wait complete. 2024-04-25T10:05:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 Processor -- start 2024-04-25T10:05:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- start start 2024-04-25T10:05:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7fc072040 0x7ff7fc155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc15dd90 0x7ff7fc1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc16aac0 con 0x7ff7fc161cc0 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1624e0 con 0x7ff7fc15dd90 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff801600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc16ac40 con 0x7ff7fc072040 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45642/0 (socket says 172.21.15.18:45642) 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 -- 172.21.15.18:0/1310502623 learned_addr learned my addr 172.21.15.18:0/1310502623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7faa00640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7fc072040 0x7ff7fc155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7f2000640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc15dd90 0x7ff7fc1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 -- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7fc072040 msgr2=0x7ff7fc155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7fc072040 0x7ff7fc155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 -- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc15dd90 msgr2=0x7ff7fc1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc15dd90 0x7ff7fc1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 -- 172.21.15.18:0/1310502623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc153140 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.788+0000 7ff7fb400640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c7a0 tx=0x7ff7f400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4003b80 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f4003d20 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400aa90 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc153420 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1539e0 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc0745d0 con 0x7ff7fc161cc0 2024-04-25T10:05:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff7f400ac30 con 0x7ff7fc161cc0 2024-04-25T10:05:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 0x7ff7d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff7f4084fa0 con 0x7ff7fc161cc0 2024-04-25T10:05:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.792+0000 7ff7faa00640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 0x7ff7d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.796+0000 7ff7faa00640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 0x7ff7d8069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec006e90 tx=0x7ff7ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:15.796+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7f40557d0 con 0x7ff7fc161cc0 2024-04-25T10:05:16.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.016+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff7fc0726e0 con 0x7ff7fc161cc0 2024-04-25T10:05:16.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.016+0000 7ff7f3400640 1 -- 172.21.15.18:0/1310502623 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff7f4059870 con 0x7ff7fc161cc0 2024-04-25T10:05:16.028 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:05:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:05:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:05:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:05:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:05:16.029 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 msgr2=0x7ff7d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 0x7ff7d8069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec006e90 tx=0x7ff7ec008040 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 msgr2=0x7ff7fc14c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7f400c7a0 tx=0x7ff7f400cc60 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 shutdown_connections 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7fc161cc0 0x7ff7fc14c8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff7fc15dd90 0x7ff7fc1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff7d8066f60 0x7ff7d8069420 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 --2- 172.21.15.18:0/1310502623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7fc072040 0x7ff7fc155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 >> 172.21.15.18:0/1310502623 conn(0x7ff7fc0cfd90 msgr2=0x7ff7fc15e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 shutdown_connections 2024-04-25T10:05:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.020+0000 7ff801600640 1 -- 172.21.15.18:0/1310502623 wait complete. 2024-04-25T10:05:16.051 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 Processor -- start 2024-04-25T10:05:16.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 -- start start 2024-04-25T10:05:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f109815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980cc4e0 con 0x7f109815fe50 2024-04-25T10:05:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980ce040 con 0x7f1098145270 2024-04-25T10:05:16.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1098145650 con 0x7f10980b1e60 2024-04-25T10:05:16.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1097400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f109815fe50 0x7f10980b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55148/0 (socket says 172.21.15.18:55148) 2024-04-25T10:05:16.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1097400640 1 -- 172.21.15.18:0/998957975 learned_addr learned my addr 172.21.15.18:0/998957975 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:16.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f109815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50081496 0 0) 0x7f10980cc4e0 con 0x7f109815fe50 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f107c003530 con 0x7f109815fe50 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939010865 0 0) 0x7f10980ce040 con 0x7f1098145270 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10980cc4e0 con 0x7f1098145270 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3659489057 0 0) 0x7f107c003530 con 0x7f109815fe50 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 msgr2=0x7f109815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f109815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 >> v1:172.21.15.167:6789/0 conn(0x7f1098145270 legacy=0x7f10980cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980ce320 con 0x7f109815fe50 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f1084001680 con 0x7f109815fe50 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 >> v1:172.21.15.18:6789/0 conn(0x7f109815fe50 legacy=0x7f10980b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f107c003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f107c0040e0 0x7f107c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f107c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098145650 con 0x7f107c004d50 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c00bab0 con 0x7f107c0040e0 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c00bcb0 con 0x7f10980b1e60 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f107c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1097400640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f107c0040e0 0x7f107c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f1097e00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f107c003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 -- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 msgr2=0x7f107c003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980b1e60 0x7f107c003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 -- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f107c0040e0 msgr2=0x7f107c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f107c0040e0 0x7f107c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.184+0000 7f109ce00640 1 -- 172.21.15.18:0/998957975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c003530 con 0x7f107c004d50 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ce00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f107c0051d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1090009f90 tx=0x7f109001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742bca59fd364b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10900b2070 con 0x7f107c004d50 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900a5c50 con 0x7f107c004d50 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f1096a00640 1 -- 172.21.15.18:0/998957975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090009c10 con 0x7f107c004d50 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 -- 172.21.15.18:0/998957975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 msgr2=0x7f107c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 --2- 172.21.15.18:0/998957975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f107c0051d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1090009f90 tx=0x7f109001cc40 comp rx=0 tx=0).stop 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ce00640 1 -- 172.21.15.18:0/998957975 reap_dead start 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 -- 172.21.15.18:0/998957975 shutdown_connections 2024-04-25T10:05:16.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 -- 172.21.15.18:0/998957975 >> 172.21.15.18:0/998957975 conn(0x7f1098066fa0 msgr2=0x7f109806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 -- 172.21.15.18:0/998957975 shutdown_connections 2024-04-25T10:05:16.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.188+0000 7f109ee00640 1 -- 172.21.15.18:0/998957975 wait complete. 2024-04-25T10:05:16.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 Processor -- start 2024-04-25T10:05:16.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- start start 2024-04-25T10:05:16.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980ca2f0 0x7f10980caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 0x7f10980c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109815f650 con 0x7f107c004d50 2024-04-25T10:05:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10981602b0 con 0x7f10980c73a0 2024-04-25T10:05:16.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109815f930 con 0x7f10980ca2f0 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45652/0 (socket says 172.21.15.18:45652) 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 -- 172.21.15.18:0/2630867445 learned_addr learned my addr 172.21.15.18:0/2630867445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ce00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 0x7f10980c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097400640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980ca2f0 0x7f10980caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 -- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980ca2f0 msgr2=0x7f10980caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980ca2f0 0x7f10980caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 -- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 msgr2=0x7f10980c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 0x7f10980c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 -- 172.21.15.18:0/2630867445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980c9250 con 0x7f107c004d50 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ce00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 0x7f10980c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f1097e00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f108800f7a0 tx=0x7f108800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10880052e0 con 0x7f107c004d50 2024-04-25T10:05:16.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088018070 con 0x7f107c004d50 2024-04-25T10:05:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088005480 con 0x7f107c004d50 2024-04-25T10:05:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10980c9530 con 0x7f107c004d50 2024-04-25T10:05:16.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.192+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10980c9af0 con 0x7f107c004d50 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10980745d0 con 0x7f107c004d50 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f108800d950 con 0x7f107c004d50 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f108fe00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 0x7f1078069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1088085250 con 0x7f107c004d50 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f1097400640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 0x7f1078069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.196+0000 7f1097400640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 0x7f1078069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10980ca6f0 tx=0x7f1084009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.200+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f108801a310 con 0x7f107c004d50 2024-04-25T10:05:16.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.396+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f109806b8e0 con 0x7f107c004d50 2024-04-25T10:05:16.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.396+0000 7f108fe00640 1 -- 172.21.15.18:0/2630867445 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f1088056030 con 0x7f107c004d50 2024-04-25T10:05:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:16.407 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:16.407 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 msgr2=0x7f1078069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 0x7f1078069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f10980ca6f0 tx=0x7f1084009040 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 msgr2=0x7f10980c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f108800f7a0 tx=0x7f108800fc60 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 shutdown_connections 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10980c73a0 0x7f10980c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1078066f60 0x7f1078069420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10980ca2f0 0x7f10980caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 --2- 172.21.15.18:0/2630867445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f107c004d50 0x7f10980c8950 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 >> 172.21.15.18:0/2630867445 conn(0x7f1098066fa0 msgr2=0x7f10980af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 shutdown_connections 2024-04-25T10:05:16.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.400+0000 7f109ee00640 1 -- 172.21.15.18:0/2630867445 wait complete. 2024-04-25T10:05:16.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:05:10.466571+0000', 'modified': '2024-04-25T10:05:13.486260+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34901}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34901': {'gid': 34901, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6836/978423196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 978423196}, {'type': 'v1', 'addr': '172.21.15.167:6836', 'nonce': 978423196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:05:16.831 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:05:16.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T10:05:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.964+0000 7f3405a00640 1 Processor -- start 2024-04-25T10:05:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 -- start start 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f340015af40 0x7f34000cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f340015e9a0 con 0x7f3400150f40 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340006f530 con 0x7f340015af40 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f3405a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f340015dbe0 con 0x7f3400072210 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33fea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3400150f40 0x7f3400071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55150/0 (socket says 172.21.15.18:55150) 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33fea00640 1 -- 172.21.15.18:0/1227125928 learned_addr learned my addr 172.21.15.18:0/1227125928 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33ff400640 1 --2- 172.21.15.18:0/1227125928 >> v2:172.21.15.18:3300/0 conn(0x7f340015af40 0x7f34000cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33f6000640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33fe000640 1 -- 172.21.15.18:0/1227125928 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84960408 0 0) 0x7f340015e9a0 con 0x7f3400150f40 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33fe000640 1 -- 172.21.15.18:0/1227125928 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e4003530 con 0x7f3400150f40 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33ff400640 1 -- 172.21.15.18:0/1227125928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 msgr2=0x7f340006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33ff400640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33ff400640 1 -- 172.21.15.18:0/1227125928 >> v1:172.21.15.18:6789/0 conn(0x7f3400150f40 legacy=0x7f3400071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.968+0000 7f33ff400640 1 -- 172.21.15.18:0/1227125928 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340015dec0 con 0x7f340015af40 2024-04-25T10:05:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f33ff400640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f340015af40 0x7f34000cdcc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f33f80097c0 tx=0x7f33f801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58681c9e54bec299 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f33fe000640 1 -- 172.21.15.18:0/1227125928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80b0070 con 0x7f340015af40 2024-04-25T10:05:16.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f33fe000640 1 -- 172.21.15.18:0/1227125928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f80ab600 con 0x7f340015af40 2024-04-25T10:05:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f33fe000640 1 -- 172.21.15.18:0/1227125928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80ab9d0 con 0x7f340015af40 2024-04-25T10:05:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- 172.21.15.18:0/1227125928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f340015af40 msgr2=0x7f34000cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f340015af40 0x7f34000cdcc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f33f80097c0 tx=0x7f33f801c380 comp rx=0 tx=0).stop 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- 172.21.15.18:0/1227125928 shutdown_connections 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f340015af40 0x7f34000cdcc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 --2- 172.21.15.18:0/1227125928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- 172.21.15.18:0/1227125928 >> 172.21.15.18:0/1227125928 conn(0x7f3400067080 msgr2=0x7f340006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- 172.21.15.18:0/1227125928 shutdown_connections 2024-04-25T10:05:16.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- 172.21.15.18:0/1227125928 wait complete. 2024-04-25T10:05:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 Processor -- start 2024-04-25T10:05:16.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.972+0000 7f3405a00640 1 -- start start 2024-04-25T10:05:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f340015af40 0x7f340014ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000ce380 con 0x7f3400150f40 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34000ce200 con 0x7f340015af40 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34000ce500 con 0x7f3400072210 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45668/0 (socket says 172.21.15.18:45668) 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 -- 172.21.15.18:0/1431699890 learned_addr learned my addr 172.21.15.18:0/1431699890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33ff400640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f340015af40 0x7f340014ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33fea00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 -- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 msgr2=0x7f340013bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340013bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 -- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f340015af40 msgr2=0x7f340014ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f340015af40 0x7f340014ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 -- 172.21.15.18:0/1431699890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34000b0490 con 0x7f3400150f40 2024-04-25T10:05:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f6000640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33e800efc0 tx=0x7f33e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f7400640 1 -- 172.21.15.18:0/1431699890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8018020 con 0x7f3400150f40 2024-04-25T10:05:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f7400640 1 -- 172.21.15.18:0/1431699890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8014480 con 0x7f3400150f40 2024-04-25T10:05:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f7400640 1 -- 172.21.15.18:0/1431699890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8014850 con 0x7f3400150f40 2024-04-25T10:05:16.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34000b01b0 con 0x7f3400150f40 2024-04-25T10:05:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3400168280 con 0x7f3400150f40 2024-04-25T10:05:16.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.976+0000 7f33f7400640 1 -- 172.21.15.18:0/1431699890 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33e801b020 con 0x7f3400150f40 2024-04-25T10:05:16.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33f7400640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33f7400640 1 -- 172.21.15.18:0/1431699890 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33e8085d60 con 0x7f3400150f40 2024-04-25T10:05:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 Processor -- start 2024-04-25T10:05:16.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 -- start start 2024-04-25T10:05:16.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 0x7f33dc069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005890 tx=0x7f33f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d749399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74939f30 0x561d7493a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d748215f0 con 0x561d74983920 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d74788da0 con 0x561d74939f30 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d74711150 con 0x561d74984240 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45676/0 (socket says 172.21.15.18:45676) 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 -- 172.21.15.18:0/825729667 learned_addr learned my addr 172.21.15.18:0/825729667 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33f6000640 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d749399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33ff400640 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74939f30 0x561d7493a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 -- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 msgr2=0x561d749399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d749399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 -- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74939f30 msgr2=0x561d7493a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74939f30 0x561d7493a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 -- 172.21.15.18:0/825729667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d7472aca0 con 0x561d74983920 2024-04-25T10:05:16.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33fea00640 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f33f00058c0 tx=0x7f33f0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fd4903c1942204c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33ef400640 1 -- 172.21.15.18:0/825729667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0005e40 con 0x561d74983920 2024-04-25T10:05:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.980+0000 7f33ef400640 1 -- 172.21.15.18:0/825729667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000e7b0 con 0x561d74983920 2024-04-25T10:05:16.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33ef400640 1 -- 172.21.15.18:0/825729667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000eb60 con 0x561d74983920 2024-04-25T10:05:16.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/825729667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 msgr2=0x561d74983d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:16.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f33f00058c0 tx=0x7f33f0011000 comp rx=0 tx=0).stop 2024-04-25T10:05:16.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/825729667 shutdown_connections 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74939f30 0x561d7493a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d749399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- 172.21.15.18:0/825729667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d74983d00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/825729667 >> 172.21.15.18:0/825729667 conn(0x561d749402a0 msgr2=0x561d749382d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/825729667 shutdown_connections 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/825729667 wait complete. 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- start start 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 Processor -- start 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d7498b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d7493daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d74743990 con 0x561d74939f30 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d74784e40 con 0x561d74983920 2024-04-25T10:05:16.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d74714900 con 0x561d74984240 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 10 client.0 _ll_register_callbacks cb 0x561d7483c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45690/0 (socket says 172.21.15.18:45690) 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 -- 172.21.15.18:0/2794962620 learned_addr learned my addr 172.21.15.18:0/2794962620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33f6000640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d7498b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33ff400640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d7493daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 -- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 msgr2=0x561d7493daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d7493daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 -- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 msgr2=0x561d7498b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d7498b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 -- 172.21.15.18:0/2794962620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d74741630 con 0x561d74939f30 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33fea00640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561d7472c200 tx=0x7f33f0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ccbc6fff9d1171 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:05:16.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0021450 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33f0010050 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.984+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33f000e7b0 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33f0034050 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 10 client.5454 fetch_fsmap learned FSMap version 18 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x561d747113a0 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000e7b0 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f33f0037020 con 0x561d74939f30 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 10 client.5454 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 10 client.5454 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 20 client.5454 populate_metadata read hostname 'smithi018' 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d7493f160 0x561d74994d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 4 client.5454 mds_command: new command op to 34901 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 --> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d74724a50 con 0x561d7493f160 2024-04-25T10:05:17.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33f6000640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d7493f160 0x561d74994d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 10 client.5454 ms_handle_connect on v2:172.21.15.167:6834/978423196 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33f6000640 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d7493f160 0x561d74994d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f14082f5bfad86b6 server_cookie=481477ba4f301a4c in_seq=0 out_seq=0 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 1 -- 172.21.15.18:0/2794962620 <== mds.0 v2:172.21.15.167:6834/978423196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561d74724a50 con 0x561d7493f160 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 10 client.5454 handle_command_reply: tid=0 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 client.5454 shutdown 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 msgr2=0x561d7498acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x561d7472c200 tx=0x7f33f0000ee0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 shutdown_connections 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74984240 0x561d7493daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d7498b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d7493f160 0x561d74994d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 --2- 172.21.15.18:0/2794962620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74939f30 0x561d7498acf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f33e3e00640 0 client.5454 ms_handle_reset on v2:172.21.15.167:6834/978423196 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 >> 172.21.15.18:0/2794962620 conn(0x561d749402a0 msgr2=0x561d749389e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 shutdown_connections 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 1 -- 172.21.15.18:0/2794962620 wait complete. 2024-04-25T10:05:17.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:16.988+0000 7f3408e19000 20 client.5454 trim_cache size 0 max 16384 2024-04-25T10:05:17.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 Processor -- start 2024-04-25T10:05:17.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 -- start start 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749df200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d749df740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400202410 con 0x561d74984240 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3400156050 con 0x561d74983920 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3400201e40 con 0x561d74939f30 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45702/0 (socket says 172.21.15.18:45702) 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 -- 172.21.15.18:0/1972440257 learned_addr learned my addr 172.21.15.18:0/1972440257 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33f6000640 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d749df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33fea00640 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749df200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 -- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 msgr2=0x561d749df200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749df200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 -- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 msgr2=0x561d749df740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d749df740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.004+0000 7f33ff400640 1 -- 172.21.15.18:0/1972440257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d74984070 con 0x561d74984240 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33ff400640 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f33f8008010 tx=0x7f33f8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e85f0429cce66a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33eea00640 1 -- 172.21.15.18:0/1972440257 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80b0040 con 0x561d74984240 2024-04-25T10:05:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33eea00640 1 -- 172.21.15.18:0/1972440257 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f80ab7c0 con 0x561d74984240 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33eea00640 1 -- 172.21.15.18:0/1972440257 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f80abbb0 con 0x561d74984240 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/1972440257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 msgr2=0x561d749dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f33f8008010 tx=0x7f33f8004740 comp rx=0 tx=0).stop 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/1972440257 shutdown_connections 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74984240 0x561d749dfc80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74983920 0x561d749df740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- 172.21.15.18:0/1972440257 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749df200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/1972440257 >> 172.21.15.18:0/1972440257 conn(0x561d749402a0 msgr2=0x561d7493d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/1972440257 shutdown_connections 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/1972440257 wait complete. 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- start start 2024-04-25T10:05:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 Processor -- start 2024-04-25T10:05:17.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749901a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74984240 0x561d749c8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d7478d3d0 con 0x561d74983920 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d74844d50 con 0x561d74984240 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d74723980 con 0x561d74939f30 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 10 client.0 _ll_register_callbacks cb 0x7f33f0001db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45714/0 (socket says 172.21.15.18:45714) 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 -- 172.21.15.18:0/3412954099 learned_addr learned my addr 172.21.15.18:0/3412954099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 -- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 msgr2=0x561d749901a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749901a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 -- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74984240 msgr2=0x561d749c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74984240 0x561d749c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 -- 172.21.15.18:0/3412954099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561d7480a600 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33f6000640 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33e80563d0 tx=0x7f33e8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32a88782e20fec21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33e3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8052ab0 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33e805e6c0 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.008+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f33f80ab7c0 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33e8079070 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 10 client.5460 fetch_fsmap learned FSMap version 18 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x561d7471d9b0 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f80ab7c0 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f33e8055890 con 0x561d74983920 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 10 client.5460 fetch_fsmap finished waiting for FSMap version 18 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 10 client.5460 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:05:17.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 20 client.5460 populate_metadata read hostname 'smithi018' 2024-04-25T10:05:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d749c8d90 0x561d749e42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 4 client.5460 mds_command: new command op to 34901 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:05:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 --> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561d747962e0 con 0x561d749c8d90 2024-04-25T10:05:17.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33fea00640 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d749c8d90 0x561d749e42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 10 client.5460 ms_handle_connect on v2:172.21.15.167:6834/978423196 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33fea00640 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d749c8d90 0x561d749e42c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629cde2b4709e6d3 server_cookie=a7a696bd354d02ca in_seq=0 out_seq=0 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 1 -- 172.21.15.18:0/3412954099 <== mds.0 v2:172.21.15.167:6834/978423196 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x561d747962e0 con 0x561d749c8d90 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 10 client.5460 handle_command_reply: tid=0 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 client.5460 shutdown 2024-04-25T10:05:17.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 msgr2=0x561d749c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f33e80563d0 tx=0x7f33e8016040 comp rx=0 tx=0).stop 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 shutdown_connections 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561d74984240 0x561d749c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:6834/978423196,v1:172.21.15.167:6836/978423196] conn(0x561d749c8d90 0x561d749e42c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561d74983920 0x561d749c8310 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 --2- 172.21.15.18:0/3412954099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x561d74939f30 0x561d749901a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f33e3e00640 0 client.5460 ms_handle_reset on v2:172.21.15.167:6834/978423196 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 >> 172.21.15.18:0/3412954099 conn(0x561d749402a0 msgr2=0x561d7498b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 shutdown_connections 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 1 -- 172.21.15.18:0/3412954099 wait complete. 2024-04-25T10:05:17.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3408e19000 20 client.5460 trim_cache size 0 max 16384 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 34901, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.9450812500000003, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 18, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 41, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 41, 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 13.808091810000001 2024-04-25T10:05:17.027 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:05:17.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 msgr2=0x7f33dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 0x7f33dc069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f33f0005890 tx=0x7f33f0009040 comp rx=0 tx=0).stop 2024-04-25T10:05:17.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 msgr2=0x7f34000af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f33e800efc0 tx=0x7f33e800c490 comp rx=0 tx=0).stop 2024-04-25T10:05:17.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 shutdown_connections 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f340015af40 0x7f340014ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3400150f40 0x7f34000af760 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33dc066f60 0x7f33dc069420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 --2- 172.21.15.18:0/1431699890 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3400072210 0x7f340013bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 >> 172.21.15.18:0/1431699890 conn(0x7f3400067080 msgr2=0x7f340014f900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 shutdown_connections 2024-04-25T10:05:17.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.012+0000 7f3405a00640 1 -- 172.21.15.18:0/1431699890 wait complete. 2024-04-25T10:05:17.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:05:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.172+0000 7f7738600640 1 Processor -- start 2024-04-25T10:05:17.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.172+0000 7f7738600640 1 -- start start 2024-04-25T10:05:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7738600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 0x7f77300b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7738600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77300b2dc0 0x7f77300b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7738600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773015def0 con 0x7f773006dad0 2024-04-25T10:05:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7738600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773015e1b0 con 0x7f77300b2dc0 2024-04-25T10:05:17.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7738600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773015e490 con 0x7f773015b2f0 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77300b2dc0 0x7f77300b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7736600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f773006dad0 0x7f773006dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55156/0 (socket says 172.21.15.18:55156) 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77300b2dc0 0x7f77300b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45730/0 (socket says 172.21.15.18:45730) 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7736600640 1 -- 172.21.15.18:0/3967219123 learned_addr learned my addr 172.21.15.18:0/3967219123 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735c00640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 0x7f77300b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 -- 172.21.15.18:0/3967219123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 msgr2=0x7f77300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 0x7f77300b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 -- 172.21.15.18:0/3967219123 >> v1:172.21.15.18:6789/0 conn(0x7f773006dad0 legacy=0x7f773006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 -- 172.21.15.18:0/3967219123 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773015e770 con 0x7f77300b2dc0 2024-04-25T10:05:17.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735c00640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 0x7f77300b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:17.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.176+0000 7f7735200640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300b2dc0 0x7f77300b3780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f771c0097f0 tx=0x7f771c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b64062e1a19970 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f772fe00640 1 -- 172.21.15.18:0/3967219123 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773015b8e0 con 0x7f77300b2dc0 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f772fe00640 1 -- 172.21.15.18:0/3967219123 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771c0af070 con 0x7f77300b2dc0 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f772fe00640 1 -- 172.21.15.18:0/3967219123 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771c0aa810 con 0x7f77300b2dc0 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- 172.21.15.18:0/3967219123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300b2dc0 msgr2=0x7f77300b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300b2dc0 0x7f77300b3780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f771c0097f0 tx=0x7f771c01c470 comp rx=0 tx=0).stop 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- 172.21.15.18:0/3967219123 shutdown_connections 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77300b2dc0 0x7f77300b3780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- 172.21.15.18:0/3967219123 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773015b2f0 0x7f77300b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- 172.21.15.18:0/3967219123 >> 172.21.15.18:0/3967219123 conn(0x7f77300b23b0 msgr2=0x7f77300cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- 172.21.15.18:0/3967219123 shutdown_connections 2024-04-25T10:05:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- 172.21.15.18:0/3967219123 wait complete. 2024-04-25T10:05:17.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 Processor -- start 2024-04-25T10:05:17.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- start start 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773006dad0 0x7f77301506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 0x7f773014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773016a880 con 0x7f773015b2f0 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77301616f0 con 0x7f77300b2dc0 2024-04-25T10:05:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7738600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773016aa00 con 0x7f773006dad0 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7736600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7736600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45738/0 (socket says 172.21.15.18:45738) 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7736600640 1 -- 172.21.15.18:0/3452873631 learned_addr learned my addr 172.21.15.18:0/3452873631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7735c00640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773006dad0 0x7f77301506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.180+0000 7f7735200640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 0x7f773014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 -- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773006dad0 msgr2=0x7f77301506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773006dad0 0x7f77301506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 -- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 msgr2=0x7f773014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 0x7f773014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 -- 172.21.15.18:0/3452873631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77301511b0 con 0x7f773015b2f0 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7735200640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 0x7f773014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:17.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7736600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f772800caa0 tx=0x7f772800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728017070 con 0x7f773015b2f0 2024-04-25T10:05:17.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800ac00 con 0x7f773015b2f0 2024-04-25T10:05:17.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7730151490 con 0x7f773015b2f0 2024-04-25T10:05:17.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7728012400 con 0x7f773015b2f0 2024-04-25T10:05:17.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7730151d30 con 0x7f773015b2f0 2024-04-25T10:05:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7730151660 con 0x7f773015b2f0 2024-04-25T10:05:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f772801a070 con 0x7f773015b2f0 2024-04-25T10:05:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 0x7f7710069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7728084e70 con 0x7f773015b2f0 2024-04-25T10:05:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.184+0000 7f7735c00640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 0x7f7710069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.188+0000 7f7735c00640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 0x7f7710069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7724006e90 tx=0x7f7724008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:17.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.188+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7728055600 con 0x7f773015b2f0 2024-04-25T10:05:17.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.384+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f77300745d0 con 0x7f773015b2f0 2024-04-25T10:05:17.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.384+0000 7f772d600640 1 -- 172.21.15.18:0/3452873631 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f77280596a0 con 0x7f773015b2f0 2024-04-25T10:05:17.396 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 msgr2=0x7f7710069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 0x7f7710069420 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7724006e90 tx=0x7f7724008040 comp rx=0 tx=0).stop 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 msgr2=0x7f77301530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f772800caa0 tx=0x7f772800cf60 comp rx=0 tx=0).stop 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 shutdown_connections 2024-04-25T10:05:17.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f773015b2f0 0x7f77301530e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77300b2dc0 0x7f773014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7710066f60 0x7f7710069420 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 --2- 172.21.15.18:0/3452873631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f773006dad0 0x7f77301506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 >> 172.21.15.18:0/3452873631 conn(0x7f77300b23b0 msgr2=0x7f77301619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 shutdown_connections 2024-04-25T10:05:17.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:17.388+0000 7f7738600640 1 -- 172.21.15.18:0/3452873631 wait complete. 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:05:17.418 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:17.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.419 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.428 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42387sec preferred_lft 42387sec 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.429 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:05:17.430 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:05:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.431 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:05:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:05:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:05:17.431 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:05:17.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.432 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:05:17.494 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:05:17.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.496 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:05:17.555 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:05:17.555 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:05:17.555 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:05:17.555 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:05:17.555 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:05:17.556 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:05:17.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:05:17.556 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:05:17.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.646 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:05:17.654 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:05:17.654 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:05:17.655 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:17.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:05:17.720 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:05:17.720 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:05:17.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:05:17.773 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:17.823 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:05:17.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:05:17.913 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:05:17.913 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:05:17.930 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:05:17.930 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:05:17.930 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:05:17.930 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:05:17.930 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:05:17.935 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:05:17.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.935 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:17.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:17.958 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:05:18.019 INFO:teuthology.orchestra.run.smithi018.stdout:client35024 2024-04-25T10:05:18.020 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:18.020 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:18.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.069 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T10:05:18.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.133 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T10:05:18.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.187 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T10:05:18.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.239 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T10:05:18.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.293 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T10:05:18.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:18.350 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./ 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./rfile 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./parentdir 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./parentdir/pfile 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./parentdir/childdir 2024-04-25T10:05:18.408 INFO:teuthology.orchestra.run.smithi018.stdout:./parentdir/childdir/cfile 2024-04-25T10:05:18.409 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:18.410 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:18.410 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:18.410 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:18.410 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:05:18.410 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:18.522 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:05:18.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T10:05:18.531 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:18.638 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627778 2024-04-25T10:05:18.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T10:05:18.648 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:18.753 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:05:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:18.762 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:18.763 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:18.763 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:18.763 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:18.763 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T10:05:18.763 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:18.869 INFO:teuthology.orchestra.run.smithi018.stdout:1099511628279 2024-04-25T10:05:18.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T10:05:18.879 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:18.990 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:05:18.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:18.999 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:05:19.000 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:05:19.000 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:05:19.000 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:05:19.000 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T10:05:19.000 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:05:19.106 INFO:teuthology.orchestra.run.smithi018.stdout:1099511628280 2024-04-25T10:05:19.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:05:19.116 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:19.116 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:19.165 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:19.165 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:19.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.392+0000 7fc138000640 1 Processor -- start 2024-04-25T10:05:19.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.392+0000 7fc138000640 1 -- start start 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc138000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc130144140 0x7fc1300ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc138000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc1300b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc138000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13015ac60 con 0x7fc1300ced60 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc138000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1300cf3e0 con 0x7fc130144140 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc138000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13015af20 con 0x7fc13006ead0 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc130144140 0x7fc1300ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc130144140 0x7fc1300ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45748/0 (socket says 172.21.15.18:45748) 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 -- 172.21.15.18:0/3786306832 learned_addr learned my addr 172.21.15.18:0/3786306832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc136000640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc1300b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 -- 172.21.15.18:0/3786306832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 msgr2=0x7fc1300b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc1300b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 -- 172.21.15.18:0/3786306832 >> v1:172.21.15.167:6789/0 conn(0x7fc1300ced60 legacy=0x7fc13006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.396+0000 7fc135600640 1 -- 172.21.15.18:0/3786306832 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13015b200 con 0x7fc130144140 2024-04-25T10:05:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc135600640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc130144140 0x7fc1300ce820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc124009870 tx=0x7fc12401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f9d20ad2b3b3e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc12fe00640 1 -- 172.21.15.18:0/3786306832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1240b1070 con 0x7fc130144140 2024-04-25T10:05:19.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc12fe00640 1 -- 172.21.15.18:0/3786306832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1240ac440 con 0x7fc130144140 2024-04-25T10:05:19.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc12fe00640 1 -- 172.21.15.18:0/3786306832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1240ac810 con 0x7fc130144140 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- 172.21.15.18:0/3786306832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc130144140 msgr2=0x7fc1300ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc130144140 0x7fc1300ce820 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc124009870 tx=0x7fc12401c520 comp rx=0 tx=0).stop 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- 172.21.15.18:0/3786306832 shutdown_connections 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc1300b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- 172.21.15.18:0/3786306832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc130144140 0x7fc1300ce820 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- 172.21.15.18:0/3786306832 >> 172.21.15.18:0/3786306832 conn(0x7fc130066fa0 msgr2=0x7fc13006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- 172.21.15.18:0/3786306832 shutdown_connections 2024-04-25T10:05:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- 172.21.15.18:0/3786306832 wait complete. 2024-04-25T10:05:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 Processor -- start 2024-04-25T10:05:19.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- start start 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc130142e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130144140 0x7fc1300cb010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13015bb80 con 0x7fc1300ced60 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13015ba00 con 0x7fc130144140 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.400+0000 7fc138000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1301653d0 con 0x7fc13006ead0 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45758/0 (socket says 172.21.15.18:45758) 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 -- 172.21.15.18:0/3078156451 learned_addr learned my addr 172.21.15.18:0/3078156451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc135600640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc130142e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc136000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130144140 0x7fc1300cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 -- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 msgr2=0x7fc130142e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc130142e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 -- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130144140 msgr2=0x7fc1300cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130144140 0x7fc1300cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 -- 172.21.15.18:0/3078156451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1300cb620 con 0x7fc1300ced60 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc134c00640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c450 tx=0x7fc11c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012830 con 0x7fc1300ced60 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c017070 con 0x7fc1300ced60 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c012c30 con 0x7fc1300ced60 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1300cb900 con 0x7fc1300ced60 2024-04-25T10:05:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1301433c0 con 0x7fc1300ced60 2024-04-25T10:05:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1300cbe20 con 0x7fc1300ced60 2024-04-25T10:05:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.404+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc11c01c460 con 0x7fc1300ced60 2024-04-25T10:05:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.408+0000 7fc12d600640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 0x7fc110069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.408+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc11c084ec0 con 0x7fc1300ced60 2024-04-25T10:05:19.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.408+0000 7fc135600640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 0x7fc110069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.408+0000 7fc135600640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 0x7fc110069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ae000 tx=0x7fc124009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.412+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc1300cbe20 con 0x7fc1300ced60 2024-04-25T10:05:19.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.572+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1300745d0 con 0x7fc1300ced60 2024-04-25T10:05:19.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc12d600640 1 -- 172.21.15.18:0/3078156451 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16918 (secure 0 0 0) 0x7fc11c055650 con 0x7fc1300ced60 2024-04-25T10:05:19.585 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:19.585 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":41,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:12.080575+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 msgr2=0x7fc110069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 0x7fc110069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc1240ae000 tx=0x7fc124009040 comp rx=0 tx=0).stop 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 msgr2=0x7fc1300caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00c450 tx=0x7fc11c00c910 comp rx=0 tx=0).stop 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 shutdown_connections 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130144140 0x7fc1300cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1300ced60 0x7fc1300caad0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc110066f60 0x7fc110069420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 --2- 172.21.15.18:0/3078156451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc13006ead0 0x7fc130142e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 >> 172.21.15.18:0/3078156451 conn(0x7fc130066fa0 msgr2=0x7fc130164a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 shutdown_connections 2024-04-25T10:05:19.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.576+0000 7fc138000640 1 -- 172.21.15.18:0/3078156451 wait complete. 2024-04-25T10:05:19.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:05:08.290854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:05:09.472259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:19.608 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 Processor -- start 2024-04-25T10:05:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 -- start start 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb015dc00 0x7fecb00af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb00b30d0 con 0x7fecb00c70d0 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb00cd860 con 0x7fecb015dc00 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00ccf30 con 0x7fecb00d0150 2024-04-25T10:05:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb015dc00 0x7fecb00af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecaf400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb5200640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fecb00c70d0 0x7fecb006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:40650/0 (socket says 172.21.15.18:40650) 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecb5200640 1 -- 172.21.15.18:0/3316747638 learned_addr learned my addr 172.21.15.18:0/3316747638 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fecb015dc00 0x7fecb00af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:54790/0 (socket says 172.21.15.18:54790) 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 -- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 msgr2=0x7fecb00c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 --2- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 -- 172.21.15.18:0/3316747638 >> v1:172.21.15.167:6789/0 conn(0x7fecb00c70d0 legacy=0x7fecb006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecafe00640 1 -- 172.21.15.18:0/3316747638 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb00cd210 con 0x7fecb015dc00 2024-04-25T10:05:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.744+0000 7fecaea00640 1 -- 172.21.15.18:0/3316747638 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139491466 0 0) 0x7fecb00b30d0 con 0x7fecb00c70d0 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecafe00640 1 --2- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb00af770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feca00097c0 tx=0x7feca001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5534bc609e0144 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecaea00640 1 -- 172.21.15.18:0/3316747638 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b0070 con 0x7fecb015dc00 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecaea00640 1 -- 172.21.15.18:0/3316747638 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00a4e50 con 0x7fecb015dc00 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecaea00640 1 -- 172.21.15.18:0/3316747638 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00ab820 con 0x7fecb015dc00 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 -- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 msgr2=0x7fecb00af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 --2- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb00af770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feca00097c0 tx=0x7feca001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 -- 172.21.15.18:0/3316747638 shutdown_connections 2024-04-25T10:05:19.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 --2- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 --2- 172.21.15.18:0/3316747638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb00af770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 -- 172.21.15.18:0/3316747638 >> 172.21.15.18:0/3316747638 conn(0x7fecb00b2240 msgr2=0x7fecb00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 -- 172.21.15.18:0/3316747638 shutdown_connections 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.748+0000 7fecb7200640 1 -- 172.21.15.18:0/3316747638 wait complete. 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 Processor -- start 2024-04-25T10:05:19.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- start start 2024-04-25T10:05:19.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb014f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00cdf00 con 0x7fecb00c70d0 2024-04-25T10:05:19.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb00c7520 con 0x7fecb015dc00 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb016a640 con 0x7fecb00d0150 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45774/0 (socket says 172.21.15.18:45774) 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 -- 172.21.15.18:0/1786397538 learned_addr learned my addr 172.21.15.18:0/1786397538 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 -- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 msgr2=0x7fecb00b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecaf400640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb5200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb014f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 -- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 msgr2=0x7fecb014f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb014f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 -- 172.21.15.18:0/1786397538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb015eee0 con 0x7fecb00c70d0 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecaf400640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb5200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecafe00640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feca001a0d0 tx=0x7feca001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b0050 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00bc070 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00b7690 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb0150dd0 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb015f180 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.752+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb01512f0 con 0x7fecb00c70d0 2024-04-25T10:05:19.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.756+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feca00b7830 con 0x7fecb00c70d0 2024-04-25T10:05:19.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.756+0000 7feca7e00640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 0x7fec90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:19.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.756+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feca011f5f0 con 0x7fecb00c70d0 2024-04-25T10:05:19.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.756+0000 7fecaf400640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 0x7fec90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:19.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.756+0000 7fecaf400640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 0x7fec90069420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecb00ccc50 tx=0x7fec9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:19.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.760+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecb01512f0 con 0x7fecb00c70d0 2024-04-25T10:05:19.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.924+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fecb00745d0 con 0x7fecb00c70d0 2024-04-25T10:05:19.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.924+0000 7feca7e00640 1 -- 172.21.15.18:0/1786397538 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7feca0016090 con 0x7fecb00c70d0 2024-04-25T10:05:19.936 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 msgr2=0x7fec90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 0x7fec90069420 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fecb00ccc50 tx=0x7fec9c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 msgr2=0x7fecb00b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feca001a0d0 tx=0x7feca001ace0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 shutdown_connections 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecb015dc00 0x7fecb014f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec90066f60 0x7fec90069420 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fecb00d0150 0x7fecb00b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 --2- 172.21.15.18:0/1786397538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fecb00c70d0 0x7fecb00b27e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 >> 172.21.15.18:0/1786397538 conn(0x7fecb00b2240 msgr2=0x7fecb00ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 shutdown_connections 2024-04-25T10:05:19.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:19.928+0000 7fecb7200640 1 -- 172.21.15.18:0/1786397538 wait complete. 2024-04-25T10:05:19.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:05:20.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.088+0000 7fb28de00640 1 Processor -- start 2024-04-25T10:05:20.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.088+0000 7fb28de00640 1 -- start start 2024-04-25T10:05:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb28815a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28de00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2880b3ab0 0x7fb288071a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28de00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb28815add0 con 0x7fb28815a870 2024-04-25T10:05:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28de00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2880715c0 con 0x7fb2880b3ab0 2024-04-25T10:05:20.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28815b0b0 con 0x7fb288154250 2024-04-25T10:05:20.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2880b3ab0 0x7fb288071a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb28815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb28815a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50190/0 (socket says 172.21.15.18:50190) 2024-04-25T10:05:20.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb2880b3ab0 0x7fb288071a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:54816/0 (socket says 172.21.15.18:54816) 2024-04-25T10:05:20.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28ca00640 1 -- 172.21.15.18:0/1425542618 learned_addr learned my addr 172.21.15.18:0/1425542618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb27fe00640 1 --1- 172.21.15.18:0/1425542618 >> v1:172.21.15.167:6789/0 conn(0x7fb28815a870 0x7fb2880b33a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:40666/0 (socket says 172.21.15.18:40666) 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 -- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 msgr2=0x7fb28815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 --2- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb28815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 -- 172.21.15.18:0/1425542618 >> v1:172.21.15.167:6789/0 conn(0x7fb28815a870 legacy=0x7fb2880b33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb28d400640 1 -- 172.21.15.18:0/1425542618 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb288071250 con 0x7fb2880b3ab0 2024-04-25T10:05:20.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.092+0000 7fb287e00640 1 -- 172.21.15.18:0/1425542618 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177200556 0 0) 0x7fb28815add0 con 0x7fb28815a870 2024-04-25T10:05:20.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28d400640 1 --2- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2880b3ab0 0x7fb288071a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d90 tx=0x7fb28001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8afdea181c65d87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb287e00640 1 -- 172.21.15.18:0/1425542618 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800b2070 con 0x7fb2880b3ab0 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb287e00640 1 -- 172.21.15.18:0/1425542618 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2800a57b0 con 0x7fb2880b3ab0 2024-04-25T10:05:20.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb287e00640 1 -- 172.21.15.18:0/1425542618 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2800a5b80 con 0x7fb2880b3ab0 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 -- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2880b3ab0 msgr2=0x7fb288071a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 --2- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2880b3ab0 0x7fb288071a50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb280009d90 tx=0x7fb28001c970 comp rx=0 tx=0).stop 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 -- 172.21.15.18:0/1425542618 shutdown_connections 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 --2- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2880b3ab0 0x7fb288071a50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 --2- 172.21.15.18:0/1425542618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb28815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 -- 172.21.15.18:0/1425542618 >> 172.21.15.18:0/1425542618 conn(0x7fb288066fa0 msgr2=0x7fb28806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 -- 172.21.15.18:0/1425542618 shutdown_connections 2024-04-25T10:05:20.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.096+0000 7fb28de00640 1 -- 172.21.15.18:0/1425542618 wait complete. 2024-04-25T10:05:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 Processor -- start 2024-04-25T10:05:20.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- start start 2024-04-25T10:05:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb288161dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb28815a870 0x7fb2880ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb288072320 con 0x7fb2880b3ab0 2024-04-25T10:05:20.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880721a0 con 0x7fb28815a870 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880724a0 con 0x7fb288154250 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45780/0 (socket says 172.21.15.18:45780) 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 -- 172.21.15.18:0/1429001190 learned_addr learned my addr 172.21.15.18:0/1429001190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb27fe00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb288161dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28d400640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb28815a870 0x7fb2880ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 -- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 msgr2=0x7fb288161dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb288161dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 -- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb28815a870 msgr2=0x7fb2880ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb28815a870 0x7fb2880ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 -- 172.21.15.18:0/1429001190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880cc310 con 0x7fb2880b3ab0 2024-04-25T10:05:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb27fe00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb288161dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28ca00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb27800e8c0 tx=0x7fb27800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278017070 con 0x7fb2880b3ab0 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27800c940 con 0x7fb2880b3ab0 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800cd30 con 0x7fb2880b3ab0 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb288151980 con 0x7fb2880b3ab0 2024-04-25T10:05:20.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.100+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb288151f40 con 0x7fb2880b3ab0 2024-04-25T10:05:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2880745d0 con 0x7fb2880b3ab0 2024-04-25T10:05:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb27801a070 con 0x7fb2880b3ab0 2024-04-25T10:05:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb285600640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 0x7fb264069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb2780850e0 con 0x7fb2880b3ab0 2024-04-25T10:05:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb27fe00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 0x7fb264069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.104+0000 7fb27fe00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 0x7fb264069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2880b0d30 tx=0x7fb270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.108+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb278055f40 con 0x7fb2880b3ab0 2024-04-25T10:05:20.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.268+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb288152600 con 0x7fb2880b3ab0 2024-04-25T10:05:20.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb285600640 1 -- 172.21.15.18:0/1429001190 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb278055840 con 0x7fb2880b3ab0 2024-04-25T10:05:20.281 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 msgr2=0x7fb264069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 0x7fb264069420 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb2880b0d30 tx=0x7fb270009040 comp rx=0 tx=0).stop 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 msgr2=0x7fb288150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb27800e8c0 tx=0x7fb27800ed80 comp rx=0 tx=0).stop 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 shutdown_connections 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb28815a870 0x7fb2880ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb264066f60 0x7fb264069420 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb288154250 0x7fb288161dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 --2- 172.21.15.18:0/1429001190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2880b3ab0 0x7fb288150f70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 >> 172.21.15.18:0/1429001190 conn(0x7fb288066fa0 msgr2=0x7fb28815bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 shutdown_connections 2024-04-25T10:05:20.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.272+0000 7fb28de00640 1 -- 172.21.15.18:0/1429001190 wait complete. 2024-04-25T10:05:20.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:05:20.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 Processor -- start 2024-04-25T10:05:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 -- start start 2024-04-25T10:05:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f95380b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f953815bc40 con 0x7f9538144120 2024-04-25T10:05:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f953815e490 con 0x7f953815acd0 2024-04-25T10:05:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953815b150 con 0x7f953815ee60 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f952fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f9537e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9538144120 0x7f95380ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:40680/0 (socket says 172.21.15.18:40680) 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f9537e00640 1 -- 172.21.15.18:0/2876142176 learned_addr learned my addr 172.21.15.18:0/2876142176 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f952fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:54840/0 (socket says 172.21.15.18:54840) 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.436+0000 7f953ce00640 1 --2- 172.21.15.18:0/2876142176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f95380b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f9537400640 1 -- 172.21.15.18:0/2876142176 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336702770 0 0) 0x7f953815bc40 con 0x7f9538144120 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f9537400640 1 -- 172.21.15.18:0/2876142176 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f951c003530 con 0x7f9538144120 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f953ce00640 1 -- 172.21.15.18:0/2876142176 >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 msgr2=0x7f953815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f953ce00640 1 --2- 172.21.15.18:0/2876142176 >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f953ce00640 1 -- 172.21.15.18:0/2876142176 >> v1:172.21.15.167:6789/0 conn(0x7f9538144120 legacy=0x7f95380ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f953ce00640 1 -- 172.21.15.18:0/2876142176 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953815b3a0 con 0x7f953815ee60 2024-04-25T10:05:20.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f952fe00640 1 --2- 172.21.15.18:0/2876142176 >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:20.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f953ce00640 1 --2- 172.21.15.18:0/2876142176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f95380b3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9530009d90 tx=0x7f953001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffbdb3c7ffd92846 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f9537400640 1 -- 172.21.15.18:0/2876142176 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300b2070 con 0x7f953815ee60 2024-04-25T10:05:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f9537400640 1 -- 172.21.15.18:0/2876142176 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95300a57a0 con 0x7f953815ee60 2024-04-25T10:05:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.440+0000 7f9537400640 1 -- 172.21.15.18:0/2876142176 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95300a5b70 con 0x7f953815ee60 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- 172.21.15.18:0/2876142176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 msgr2=0x7f95380b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- 172.21.15.18:0/2876142176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f95380b3090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9530009d90 tx=0x7f953001c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- 172.21.15.18:0/2876142176 shutdown_connections 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- 172.21.15.18:0/2876142176 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f95380b3090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- 172.21.15.18:0/2876142176 >> v2:172.21.15.167:3300/0 conn(0x7f953815acd0 0x7f953815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- 172.21.15.18:0/2876142176 >> 172.21.15.18:0/2876142176 conn(0x7f9538067080 msgr2=0x7f953806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- 172.21.15.18:0/2876142176 shutdown_connections 2024-04-25T10:05:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- 172.21.15.18:0/2876142176 wait complete. 2024-04-25T10:05:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 Processor -- start 2024-04-25T10:05:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- start start 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953815acd0 0x7f9538142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f9538143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95381677d0 con 0x7f9538144120 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9538167650 con 0x7f953815acd0 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9538167950 con 0x7f953815ee60 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45782/0 (socket says 172.21.15.18:45782) 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 -- 172.21.15.18:0/2665293782 learned_addr learned my addr 172.21.15.18:0/2665293782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:20.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f952fe00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953815acd0 0x7f9538142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f953ce00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f9538143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 -- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 msgr2=0x7f9538143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f9538143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 -- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953815acd0 msgr2=0x7f9538142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953815acd0 0x7f9538142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.444+0000 7f9537e00640 1 -- 172.21.15.18:0/2665293782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9538140e50 con 0x7f9538144120 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9537e00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f952800c420 tx=0x7f952800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9528017070 con 0x7f9538144120 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9528005cf0 con 0x7f9538144120 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280072d0 con 0x7f9538144120 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f953813f010 con 0x7f9538144120 2024-04-25T10:05:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95380af360 con 0x7f9538144120 2024-04-25T10:05:20.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95380745d0 con 0x7f9538144120 2024-04-25T10:05:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f952801a070 con 0x7f9538144120 2024-04-25T10:05:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 0x7f9514069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9528084480 con 0x7f9538144120 2024-04-25T10:05:20.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.448+0000 7f952fe00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 0x7f9514069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.462 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.452+0000 7f952fe00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 0x7f9514069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9520009580 tx=0x7f9520009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.452+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9528054cb0 con 0x7f9538144120 2024-04-25T10:05:20.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.612+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95380cc0b0 con 0x7f9538144120 2024-04-25T10:05:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.612+0000 7f9534c00640 1 -- 172.21.15.18:0/2665293782 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9528058d50 con 0x7f9538144120 2024-04-25T10:05:20.624 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:05:20.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 msgr2=0x7f9514069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 0x7f9514069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9520009580 tx=0x7f9520009190 comp rx=0 tx=0).stop 2024-04-25T10:05:20.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 msgr2=0x7f953813ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f952800c420 tx=0x7f952800c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 shutdown_connections 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9514066f60 0x7f9514069420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f953815ee60 0x7f9538143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f953815acd0 0x7f9538142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 --2- 172.21.15.18:0/2665293782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9538144120 0x7f953813ead0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 >> 172.21.15.18:0/2665293782 conn(0x7f9538067080 msgr2=0x7f9538140740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 shutdown_connections 2024-04-25T10:05:20.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.616+0000 7f953ee00640 1 -- 172.21.15.18:0/2665293782 wait complete. 2024-04-25T10:05:20.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:05:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.776+0000 7f0daa800640 1 Processor -- start 2024-04-25T10:05:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.776+0000 7f0daa800640 1 -- start start 2024-04-25T10:05:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0daa800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 0x7f0da415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0daa800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da40b3090 0x7f0da40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0daa800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da415bc40 con 0x7f0da40ccbf0 2024-04-25T10:05:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0daa800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415e490 con 0x7f0da40b3090 2024-04-25T10:05:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0daa800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415b3a0 con 0x7f0da4144120 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da40b3090 0x7f0da40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0da40b3090 0x7f0da40b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45784/0 (socket says 172.21.15.18:45784) 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 -- 172.21.15.18:0/2714445157 learned_addr learned my addr 172.21.15.18:0/2714445157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 -- 172.21.15.18:0/2714445157 >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 msgr2=0x7f0da415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3400640 1 --2- 172.21.15.18:0/2714445157 >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 0x7f0da415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 --2- 172.21.15.18:0/2714445157 >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 0x7f0da415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 -- 172.21.15.18:0/2714445157 >> v1:172.21.15.167:6789/0 conn(0x7f0da40ccbf0 legacy=0x7f0da415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3e00640 1 -- 172.21.15.18:0/2714445157 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da415b680 con 0x7f0da40b3090 2024-04-25T10:05:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.780+0000 7f0da3400640 1 --2- 172.21.15.18:0/2714445157 >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 0x7f0da415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0da3e00640 1 --2- 172.21.15.18:0/2714445157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40b3520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0da406b9b0 tx=0x7f0d9c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffdcd529f72493e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0da2a00640 1 -- 172.21.15.18:0/2714445157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5670 con 0x7f0da40b3090 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0da2a00640 1 -- 172.21.15.18:0/2714445157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c0a5810 con 0x7f0da40b3090 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0da2a00640 1 -- 172.21.15.18:0/2714445157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c0a5be0 con 0x7f0da40b3090 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- 172.21.15.18:0/2714445157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 msgr2=0x7f0da40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 --2- 172.21.15.18:0/2714445157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40b3520 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0da406b9b0 tx=0x7f0d9c01c920 comp rx=0 tx=0).stop 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- 172.21.15.18:0/2714445157 shutdown_connections 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 --2- 172.21.15.18:0/2714445157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40b3520 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 --2- 172.21.15.18:0/2714445157 >> v2:172.21.15.167:3300/0 conn(0x7f0da4144120 0x7f0da415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- 172.21.15.18:0/2714445157 >> 172.21.15.18:0/2714445157 conn(0x7f0da4067080 msgr2=0x7f0da406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- 172.21.15.18:0/2714445157 shutdown_connections 2024-04-25T10:05:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- 172.21.15.18:0/2714445157 wait complete. 2024-04-25T10:05:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 Processor -- start 2024-04-25T10:05:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.784+0000 7f0daa800640 1 -- start start 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da40ccbf0 0x7f0da413e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 0x7f0da413bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da41675c0 con 0x7f0da40b3090 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4167440 con 0x7f0da4144120 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4167740 con 0x7f0da40ccbf0 2024-04-25T10:05:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45794/0 (socket says 172.21.15.18:45794) 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 -- 172.21.15.18:0/4036580641 learned_addr learned my addr 172.21.15.18:0/4036580641 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3e00640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 0x7f0da413bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0d9be00640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da40ccbf0 0x7f0da413e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 -- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da40ccbf0 msgr2=0x7f0da413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da40ccbf0 0x7f0da413e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 -- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 msgr2=0x7f0da413bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 0x7f0da413bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 -- 172.21.15.18:0/4036580641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da413ed70 con 0x7f0da40b3090 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3e00640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 0x7f0da413bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0da3400640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7f0 tx=0x7f0d9400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94015070 con 0x7f0da40b3090 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d94007820 con 0x7f0da40b3090 2024-04-25T10:05:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da413f050 con 0x7f0da40b3090 2024-04-25T10:05:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d94007c10 con 0x7f0da40b3090 2024-04-25T10:05:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da413f610 con 0x7f0da40b3090 2024-04-25T10:05:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da40745d0 con 0x7f0da40b3090 2024-04-25T10:05:20.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.788+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0d94018070 con 0x7f0da40b3090 2024-04-25T10:05:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.792+0000 7f0d9b400640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 0x7f0d80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.792+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0d94085180 con 0x7f0da40b3090 2024-04-25T10:05:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.792+0000 7f0d9be00640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 0x7f0d80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:20.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.792+0000 7f0d9be00640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 0x7f0d80069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0da413cd50 tx=0x7f0d8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.796+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d94055f60 con 0x7f0da40b3090 2024-04-25T10:05:20.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.968+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0da413caa0 con 0x7f0da40b3090 2024-04-25T10:05:20.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.968+0000 7f0d9b400640 1 -- 172.21.15.18:0/4036580641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v41) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0d94055860 con 0x7f0da40b3090 2024-04-25T10:05:20.981 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:05:20.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 msgr2=0x7f0d80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 0x7f0d80069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0da413cd50 tx=0x7f0d8c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 msgr2=0x7f0da40af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0d9400c7f0 tx=0x7f0d9400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 shutdown_connections 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0da4144120 0x7f0da413bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d80066f60 0x7f0d80069420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0da40ccbf0 0x7f0da413e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 --2- 172.21.15.18:0/4036580641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0da40b3090 0x7f0da40af260 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 >> 172.21.15.18:0/4036580641 conn(0x7f0da4067080 msgr2=0x7f0da40b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 shutdown_connections 2024-04-25T10:05:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:20.972+0000 7f0daa800640 1 -- 172.21.15.18:0/4036580641 wait complete. 2024-04-25T10:05:21.001 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:05:21.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:21.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:05:21.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:05:21.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:05:21.061 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:05:21.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:21.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.252+0000 7f499fe00640 1 Processor -- start 2024-04-25T10:05:21.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 -- start start 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 0x7f49980b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 0x7f499815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49980cc4e0 con 0x7f4998145270 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49980b20e0 con 0x7f49980b1c90 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4998145650 con 0x7f499815fe50 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4998145270 0x7f49980cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55168/0 (socket says 172.21.15.18:55168) 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499d400640 1 -- 172.21.15.18:0/4149595856 learned_addr learned my addr 172.21.15.18:0/4149595856 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:21.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499ca00640 1 --2- 172.21.15.18:0/4149595856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 0x7f49980b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499de00640 1 --2- 172.21.15.18:0/4149595856 >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 0x7f499815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f4997e00640 1 -- 172.21.15.18:0/4149595856 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233293728 0 0) 0x7f49980cc4e0 con 0x7f4998145270 2024-04-25T10:05:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f4997e00640 1 -- 172.21.15.18:0/4149595856 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4980003530 con 0x7f4998145270 2024-04-25T10:05:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499ca00640 1 -- 172.21.15.18:0/4149595856 >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 msgr2=0x7f499815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499ca00640 1 --2- 172.21.15.18:0/4149595856 >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 0x7f499815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499ca00640 1 -- 172.21.15.18:0/4149595856 >> v1:172.21.15.18:6789/0 conn(0x7f4998145270 legacy=0x7f49980cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499ca00640 1 -- 172.21.15.18:0/4149595856 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980ce040 con 0x7f499815fe50 2024-04-25T10:05:21.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.256+0000 7f499de00640 1 --2- 172.21.15.18:0/4149595856 >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 0x7f499815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:21.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499ca00640 1 --2- 172.21.15.18:0/4149595856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 0x7f49980b1750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49840097c0 tx=0x7f498401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43e93329f6d30c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f4997e00640 1 -- 172.21.15.18:0/4149595856 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840b2070 con 0x7f499815fe50 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f4997e00640 1 -- 172.21.15.18:0/4149595856 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49840ad640 con 0x7f499815fe50 2024-04-25T10:05:21.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f4997e00640 1 -- 172.21.15.18:0/4149595856 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840ada10 con 0x7f499815fe50 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 -- 172.21.15.18:0/4149595856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 msgr2=0x7f49980b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 --2- 172.21.15.18:0/4149595856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 0x7f49980b1750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f49840097c0 tx=0x7f498401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 -- 172.21.15.18:0/4149595856 shutdown_connections 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 --2- 172.21.15.18:0/4149595856 >> v2:172.21.15.167:3300/0 conn(0x7f49980b1c90 0x7f499815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 --2- 172.21.15.18:0/4149595856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f499815fe50 0x7f49980b1750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 -- 172.21.15.18:0/4149595856 >> 172.21.15.18:0/4149595856 conn(0x7f4998066fa0 msgr2=0x7f499806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 -- 172.21.15.18:0/4149595856 shutdown_connections 2024-04-25T10:05:21.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 -- 172.21.15.18:0/4149595856 wait complete. 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.260+0000 7f499fe00640 1 Processor -- start 2024-04-25T10:05:21.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- start start 2024-04-25T10:05:21.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49980b1c90 0x7f49980b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998145270 0x7f499812ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49980cdbe0 con 0x7f499815fe50 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499815f930 con 0x7f49980b1c90 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49980cdd60 con 0x7f4998145270 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45798/0 (socket says 172.21.15.18:45798) 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 -- 172.21.15.18:0/3714359485 learned_addr learned my addr 172.21.15.18:0/3714359485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499d400640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49980b1c90 0x7f49980b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499ca00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998145270 0x7f499812ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 -- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998145270 msgr2=0x7f499812ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998145270 0x7f499812ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 -- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49980b1c90 msgr2=0x7f49980b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49980b1c90 0x7f49980b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 -- 172.21.15.18:0/3714359485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980b2850 con 0x7f499815fe50 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499de00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f499000efc0 tx=0x7f4990009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990018030 con 0x7f499815fe50 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000cde0 con 0x7f499815fe50 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990003bc0 con 0x7f499815fe50 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49980b2b30 con 0x7f499815fe50 2024-04-25T10:05:21.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49980b30f0 con 0x7f499815fe50 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.264+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49980745d0 con 0x7f499815fe50 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.268+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f499001b070 con 0x7f499815fe50 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.268+0000 7f4995600640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.268+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4990085c10 con 0x7f499815fe50 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.268+0000 7f499d400640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.268+0000 7f499d400640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f498c005890 tx=0x7f498c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.272+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4990010040 con 0x7f499815fe50 2024-04-25T10:05:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.464+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f499806b8e0 con 0x7f499815fe50 2024-04-25T10:05:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f4995600640 1 -- 172.21.15.18:0/3714359485 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f4990056a80 con 0x7f499815fe50 2024-04-25T10:05:21.477 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:21.477 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:21.477 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 msgr2=0x7f4978069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f498c005890 tx=0x7f498c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 msgr2=0x7f4998142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f499000efc0 tx=0x7f4990009f90 comp rx=0 tx=0).stop 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 shutdown_connections 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815fe50 0x7f4998142120 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998145270 0x7f499812ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 --2- 172.21.15.18:0/3714359485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49980b1c90 0x7f49980b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 >> 172.21.15.18:0/3714359485 conn(0x7f4998066fa0 msgr2=0x7f499815db30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 shutdown_connections 2024-04-25T10:05:21.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.468+0000 7f499fe00640 1 -- 172.21.15.18:0/3714359485 wait complete. 2024-04-25T10:05:21.499 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T10:05:21.670 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:05:21.671 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:05:21.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:21.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.800+0000 7f2e0b200640 1 Processor -- start 2024-04-25T10:05:21.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.800+0000 7f2e0b200640 1 -- start start 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0b200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 0x7f2e0c0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0b200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c0cdb30 con 0x7f2e0c15fde0 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0b200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c15c340 con 0x7f2e0c0717c0 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c145280 con 0x7f2e0c144ea0 2024-04-25T10:05:21.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0a800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 0x7f2e0c0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0a800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 0x7f2e0c0cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:43566/0 (socket says 172.21.15.18:43566) 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:58272/0 (socket says 172.21.15.18:58272) 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e0a800640 1 -- 172.21.15.18:0/400920912 learned_addr learned my addr 172.21.15.18:0/400920912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e03e00640 1 --1- 172.21.15.18:0/400920912 >> v1:172.21.15.167:6789/0 conn(0x7f2e0c15fde0 0x7f2e0c0710b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58056/0 (socket says 172.21.15.18:58056) 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 -- 172.21.15.18:0/400920912 >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 msgr2=0x7f2e0c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 --2- 172.21.15.18:0/400920912 >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 0x7f2e0c0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 -- 172.21.15.18:0/400920912 >> v1:172.21.15.167:6789/0 conn(0x7f2e0c15fde0 legacy=0x7f2e0c0710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09400640 1 -- 172.21.15.18:0/400920912 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4152327182 0 0) 0x7f2e0c0cdb30 con 0x7f2e0c15fde0 2024-04-25T10:05:21.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.804+0000 7f2e09e00640 1 -- 172.21.15.18:0/400920912 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c15bcf0 con 0x7f2e0c144ea0 2024-04-25T10:05:21.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e09e00640 1 --2- 172.21.15.18:0/400920912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0097c0 tx=0x7f2dfc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13c6479aadf51818 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e09400640 1 -- 172.21.15.18:0/400920912 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0ab600 con 0x7f2e0c144ea0 2024-04-25T10:05:21.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e09400640 1 -- 172.21.15.18:0/400920912 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0b0070 con 0x7f2e0c144ea0 2024-04-25T10:05:21.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e09400640 1 -- 172.21.15.18:0/400920912 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0ab9c0 con 0x7f2e0c144ea0 2024-04-25T10:05:21.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- 172.21.15.18:0/400920912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 msgr2=0x7f2e0c0cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 --2- 172.21.15.18:0/400920912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0097c0 tx=0x7f2dfc01c470 comp rx=0 tx=0).stop 2024-04-25T10:05:21.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- 172.21.15.18:0/400920912 shutdown_connections 2024-04-25T10:05:21.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 --2- 172.21.15.18:0/400920912 >> v2:172.21.15.167:3300/0 conn(0x7f2e0c0717c0 0x7f2e0c0cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 --2- 172.21.15.18:0/400920912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0cd1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- 172.21.15.18:0/400920912 >> 172.21.15.18:0/400920912 conn(0x7f2e0c066fa0 msgr2=0x7f2e0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- 172.21.15.18:0/400920912 shutdown_connections 2024-04-25T10:05:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- 172.21.15.18:0/400920912 wait complete. 2024-04-25T10:05:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 Processor -- start 2024-04-25T10:05:21.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.808+0000 7f2e0b200640 1 -- start start 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0717c0 0x7f2e0c164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0b0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0b2590 con 0x7f2e0c15fde0 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cd910 con 0x7f2e0c0717c0 2024-04-25T10:05:21.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0b2710 con 0x7f2e0c144ea0 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48474/0 (socket says 172.21.15.18:48474) 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 -- 172.21.15.18:0/805898912 learned_addr learned my addr 172.21.15.18:0/805898912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e03e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0b0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e09e00640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0717c0 0x7f2e0c164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 -- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 msgr2=0x7f2e0c0b0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0b0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 -- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0717c0 msgr2=0x7f2e0c164bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0717c0 0x7f2e0c164bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:21.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 -- 172.21.15.18:0/805898912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c161d80 con 0x7f2e0c15fde0 2024-04-25T10:05:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0a800640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400efc0 tx=0x7f2e0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0400cd20 con 0x7f2e0c15fde0 2024-04-25T10:05:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e040039a0 con 0x7f2e0c15fde0 2024-04-25T10:05:21.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c162fc0 con 0x7f2e0c15fde0 2024-04-25T10:05:21.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04003d90 con 0x7f2e0c15fde0 2024-04-25T10:05:21.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c163580 con 0x7f2e0c15fde0 2024-04-25T10:05:21.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c04efa0 con 0x7f2e0c15fde0 2024-04-25T10:05:21.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.812+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e04012050 con 0x7f2e0c15fde0 2024-04-25T10:05:21.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.816+0000 7f2e02000640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 0x7f2de8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:21.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.816+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e04085560 con 0x7f2e0c15fde0 2024-04-25T10:05:21.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.816+0000 7f2e09e00640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 0x7f2de8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:21.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.816+0000 7f2e09e00640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 0x7f2de8069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0af000 tx=0x7f2dfc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:21.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:21.820+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e0c161d80 con 0x7f2e0c15fde0 2024-04-25T10:05:22.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.012+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e0c1662b0 con 0x7f2e0c15fde0 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.012+0000 7f2e02000640 1 -- 172.21.15.18:0/805898912 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f2e04010040 con 0x7f2e0c15fde0 2024-04-25T10:05:22.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:22.024 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:22.024 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 msgr2=0x7f2de8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 0x7f2de8069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0af000 tx=0x7f2dfc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 msgr2=0x7f2e0c0b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:22.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400efc0 tx=0x7f2e0400c490 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 shutdown_connections 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e0c15fde0 0x7f2e0c0b0860 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2de8066f90 0x7f2de8069450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e0c144ea0 0x7f2e0c0b0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 --2- 172.21.15.18:0/805898912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e0c0717c0 0x7f2e0c164bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 >> 172.21.15.18:0/805898912 conn(0x7f2e0c066fa0 msgr2=0x7f2e0c0b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 shutdown_connections 2024-04-25T10:05:22.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:22.016+0000 7f2e0b200640 1 -- 172.21.15.18:0/805898912 wait complete. 2024-04-25T10:05:22.045 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json tag path /parentdir mytag 2024-04-25T10:05:22.206 INFO:teuthology.orchestra.run.smithi167.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T10:05:22.207 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T10:05:32.208 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T10:05:32.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 Processor -- start 2024-04-25T10:05:32.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- start start 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea126e80 0x559dea1f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea1de670 0x559dea1f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dea152200 con 0x559dea1dea50 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dea0ca9f0 con 0x559dea1de670 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dea152380 con 0x559dea126e80 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52618/0 (socket says 172.21.15.18:52618) 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 -- 172.21.15.18:0/344005188 learned_addr learned my addr 172.21.15.18:0/344005188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2332a00640 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea1de670 0x559dea1f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333400640 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea126e80 0x559dea1f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 -- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea126e80 msgr2=0x559dea1f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea126e80 0x559dea1f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 -- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea1de670 msgr2=0x559dea1f7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea1de670 0x559dea1f7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 -- 172.21.15.18:0/344005188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dea202cc0 con 0x559dea1dea50 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2333e00640 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a770 tx=0x7f232c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbda080aff2755c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2331600640 1 -- 172.21.15.18:0/344005188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0bd070 con 0x559dea1dea50 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2331600640 1 -- 172.21.15.18:0/344005188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c0b4040 con 0x559dea1dea50 2024-04-25T10:05:32.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2331600640 1 -- 172.21.15.18:0/344005188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c0b3070 con 0x559dea1dea50 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- 172.21.15.18:0/344005188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 msgr2=0x559dea124e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f232c00a770 tx=0x7f232c0033b0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- 172.21.15.18:0/344005188 shutdown_connections 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1dea50 0x559dea124e10 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea1de670 0x559dea1f7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 --2- 172.21.15.18:0/344005188 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea126e80 0x559dea1f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.252+0000 7f2336111080 1 -- 172.21.15.18:0/344005188 >> 172.21.15.18:0/344005188 conn(0x559dea124400 msgr2=0x559dea153710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- 172.21.15.18:0/344005188 shutdown_connections 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- 172.21.15.18:0/344005188 wait complete. 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 Processor -- start 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- start start 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea126e80 0x559dea1f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 0x559dea165900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea1dea50 0x559dea169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dea165720 con 0x559dea1de670 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dea1642b0 con 0x559dea126e80 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559dea166210 con 0x559dea1dea50 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 0x559dea165900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 0x559dea165900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52620/0 (socket says 172.21.15.18:52620) 2024-04-25T10:05:32.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 -- 172.21.15.18:0/1344895408 learned_addr learned my addr 172.21.15.18:0/1344895408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2333400640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea126e80 0x559dea1f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2333e00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea1dea50 0x559dea169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 -- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea1dea50 msgr2=0x559dea169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea1dea50 0x559dea169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 -- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea126e80 msgr2=0x559dea1f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559dea126e80 0x559dea1f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 -- 172.21.15.18:0/1344895408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dea1664b0 con 0x559dea1de670 2024-04-25T10:05:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2333e00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559dea1dea50 0x559dea169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2332a00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 0x559dea165900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2320008ab0 tx=0x7f2320008f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f232be00640 1 -- 172.21.15.18:0/1344895408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320006e40 con 0x559dea1de670 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f232be00640 1 -- 172.21.15.18:0/1344895408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232001a070 con 0x559dea1de670 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f232be00640 1 -- 172.21.15.18:0/1344895408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320015680 con 0x559dea1de670 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559dea166750 con 0x559dea1de670 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.256+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dea166c90 con 0x559dea1de670 2024-04-25T10:05:32.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f232be00640 1 -- 172.21.15.18:0/1344895408 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2320013030 con 0x559dea1de670 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f232be00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2314065970 0x7f2314067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f232be00640 1 -- 172.21.15.18:0/1344895408 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2320084700 con 0x559dea1de670 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f2336111080 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x559dea16b0f0 0x559dea167640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f2333400640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2314065970 0x7f2314067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x559dea167b80 con 0x559dea16b0f0 2024-04-25T10:05:32.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.260+0000 7f2333e00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x559dea16b0f0 0x559dea167640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2333400640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2314065970 0x7f2314067e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2324000c10 tx=0x7f2324003910 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2333e00640 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x559dea16b0f0 0x559dea167640 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2333e00640 1 -- 172.21.15.18:0/1344895408 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f232c0b6070 con 0x559dea16b0f0 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x559dea16b0f0 msgr2=0x559dea167640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x559dea16b0f0 0x559dea167640 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2314065970 msgr2=0x7f2314067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2314065970 0x7f2314067e30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2324000c10 tx=0x7f2324003910 comp rx=0 tx=0).stop 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 msgr2=0x559dea165900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 --2- 172.21.15.18:0/1344895408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559dea1de670 0x559dea165900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2320008ab0 tx=0x7f2320008f70 comp rx=0 tx=0).stop 2024-04-25T10:05:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2333e00640 1 -- 172.21.15.18:0/1344895408 reap_dead start 2024-04-25T10:05:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 shutdown_connections 2024-04-25T10:05:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 >> 172.21.15.18:0/1344895408 conn(0x559dea124400 msgr2=0x559dea152e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 shutdown_connections 2024-04-25T10:05:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.264+0000 7f2336111080 1 -- 172.21.15.18:0/1344895408 wait complete. 2024-04-25T10:05:32.279 INFO:teuthology.orchestra.run.smithi018.stdout:mytag 2024-04-25T10:05:32.279 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T10:05:32.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 Processor -- start 2024-04-25T10:05:32.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 -- start start 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460b478b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460b47df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a460a0f180 con 0x55a460a10d50 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a460a0f000 con 0x55a460ab4570 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3784a03080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a460a0f300 con 0x55a460a28170 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3781c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3781c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52636/0 (socket says 172.21.15.18:52636) 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3781c00640 1 -- 172.21.15.18:0/4127703763 learned_addr learned my addr 172.21.15.18:0/4127703763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3782600640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460b47df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.316+0000 7f3781200640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460b478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 msgr2=0x55a460b478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460b478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 msgr2=0x55a460b47df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460b47df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/4127703763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a460b46990 con 0x55a460a10d50 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3782600640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460b47df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781200640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460b478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f37740097d0 tx=0x7f3774005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cb17c871e181e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f377b400640 1 -- 172.21.15.18:0/4127703763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774019070 con 0x55a460a10d50 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f377b400640 1 -- 172.21.15.18:0/4127703763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774008d40 con 0x55a460a10d50 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f377b400640 1 -- 172.21.15.18:0/4127703763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37740146a0 con 0x55a460a10d50 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- 172.21.15.18:0/4127703763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 msgr2=0x55a460ab0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f37740097d0 tx=0x7f3774005a10 comp rx=0 tx=0).stop 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- 172.21.15.18:0/4127703763 shutdown_connections 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460b47df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460b478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- 172.21.15.18:0/4127703763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab0820 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- 172.21.15.18:0/4127703763 >> 172.21.15.18:0/4127703763 conn(0x55a4609dd440 msgr2=0x55a460ab6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- 172.21.15.18:0/4127703763 shutdown_connections 2024-04-25T10:05:32.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- 172.21.15.18:0/4127703763 wait complete. 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 Processor -- start 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- start start 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460a0bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460a20150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a460b46ed0 con 0x55a460a10d50 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a460b46c30 con 0x55a460ab4570 2024-04-25T10:05:32.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3784a03080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a460b47170 con 0x55a460a28170 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52648/0 (socket says 172.21.15.18:52648) 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/1074708422 learned_addr learned my addr 172.21.15.18:0/1074708422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781200640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460a0bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3782600640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460a20150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 msgr2=0x55a460a0bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460a0bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 msgr2=0x55a460a20150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460a20150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781c00640 1 -- 172.21.15.18:0/1074708422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a460ab62b0 con 0x55a460a10d50 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3782600640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a460ab4570 0x55a460a20150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.320+0000 7f3781200640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a460a28170 0x55a460a0bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3781c00640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab59a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3774008780 tx=0x7f3774003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 -- 172.21.15.18:0/1074708422 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774023020 con 0x55a460a10d50 2024-04-25T10:05:32.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 -- 172.21.15.18:0/1074708422 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377401a040 con 0x55a460a10d50 2024-04-25T10:05:32.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 -- 172.21.15.18:0/1074708422 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774019070 con 0x55a460a10d50 2024-04-25T10:05:32.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a460ab6550 con 0x55a460a10d50 2024-04-25T10:05:32.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a460ab6a90 con 0x55a460a10d50 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 -- 172.21.15.18:0/1074708422 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3774026020 con 0x55a460a10d50 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3764065970 0x7f3764067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f377a000640 1 -- 172.21.15.18:0/1074708422 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3774085ba0 con 0x55a460a10d50 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3781200640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3764065970 0x7f3764067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3784a03080 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55a460a0c2a0 0x55a460a23690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x55a460b460e0 con 0x55a460a0c2a0 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.324+0000 7f3782600640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55a460a0c2a0 0x55a460a23690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3781200640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3764065970 0x7f3764067e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f37700ac000 tx=0x7f37700a5000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3782600640 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55a460a0c2a0 0x55a460a23690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3782600640 1 -- 172.21.15.18:0/1074708422 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f377c011040 con 0x55a460a0c2a0 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55a460a0c2a0 msgr2=0x55a460a23690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55a460a0c2a0 0x55a460a23690 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3764065970 msgr2=0x7f3764067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3764065970 0x7f3764067e30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f37700ac000 tx=0x7f37700a5000 comp rx=0 tx=0).stop 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 msgr2=0x55a460ab59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 --2- 172.21.15.18:0/1074708422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a460a10d50 0x55a460ab59a0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3774008780 tx=0x7f3774003030 comp rx=0 tx=0).stop 2024-04-25T10:05:32.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3782600640 1 -- 172.21.15.18:0/1074708422 reap_dead start 2024-04-25T10:05:32.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 shutdown_connections 2024-04-25T10:05:32.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 >> 172.21.15.18:0/1074708422 conn(0x55a4609dd440 msgr2=0x55a460aafde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 shutdown_connections 2024-04-25T10:05:32.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.328+0000 7f3784a03080 1 -- 172.21.15.18:0/1074708422 wait complete. 2024-04-25T10:05:32.342 INFO:teuthology.orchestra.run.smithi018.stdout:mytag 2024-04-25T10:05:32.343 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T10:05:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 Processor -- start 2024-04-25T10:05:32.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 -- start start 2024-04-25T10:05:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85f50 0x5640d7c84dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7d37890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d7c86eb0 con 0x5640d7c85720 2024-04-25T10:05:32.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d7b719f0 con 0x5640d7c85f50 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f441a359080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640d7c87150 con 0x5640d7d37480 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f4417600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f4417600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52674/0 (socket says 172.21.15.18:52674) 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f4417600640 1 -- 172.21.15.18:0/4024870391 learned_addr learned my addr 172.21.15.18:0/4024870391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f4416c00640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85f50 0x5640d7c84dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.420+0000 7f4418000640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7d37890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 -- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 msgr2=0x5640d7d37890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7d37890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 -- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85f50 msgr2=0x5640d7c84dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85f50 0x5640d7c84dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 -- 172.21.15.18:0/4024870391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640d7c0f8f0 con 0x5640d7c85720 2024-04-25T10:05:32.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4418000640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7d37890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4408009950 tx=0x7f4408005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf47e779163ee705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4415800640 1 -- 172.21.15.18:0/4024870391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408019070 con 0x5640d7c85720 2024-04-25T10:05:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4415800640 1 -- 172.21.15.18:0/4024870391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408008d40 con 0x5640d7c85720 2024-04-25T10:05:32.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4415800640 1 -- 172.21.15.18:0/4024870391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080146a0 con 0x5640d7c85720 2024-04-25T10:05:32.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- 172.21.15.18:0/4024870391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 msgr2=0x5640d7c10810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4408009950 tx=0x7f4408005a10 comp rx=0 tx=0).stop 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- 172.21.15.18:0/4024870391 shutdown_connections 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7d37890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85f50 0x5640d7c84dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- 172.21.15.18:0/4024870391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85720 0x5640d7c10810 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- 172.21.15.18:0/4024870391 >> 172.21.15.18:0/4024870391 conn(0x5640d7bcb400 msgr2=0x5640d7c87f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- 172.21.15.18:0/4024870391 shutdown_connections 2024-04-25T10:05:32.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- 172.21.15.18:0/4024870391 wait complete. 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 Processor -- start 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- start start 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85720 0x5640d7d34d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 0x5640d7d36540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7c9f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d7c0fb90 con 0x5640d7c85f50 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640d7c85310 con 0x5640d7c85720 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f441a359080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640d7c0fe30 con 0x5640d7d37480 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 0x5640d7d36540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 0x5640d7d36540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52676/0 (socket says 172.21.15.18:52676) 2024-04-25T10:05:32.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 -- 172.21.15.18:0/4065120967 learned_addr learned my addr 172.21.15.18:0/4065120967 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4418000640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7c9f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4417600640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85720 0x5640d7d34d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 -- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 msgr2=0x5640d7c9f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5640d7d37480 0x5640d7c9f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 -- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85720 msgr2=0x5640d7d34d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5640d7c85720 0x5640d7d34d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.424+0000 7f4416c00640 1 -- 172.21.15.18:0/4065120967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640d7d35620 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f4416c00640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 0x5640d7d36540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44040ad040 tx=0x7f44040180d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 -- 172.21.15.18:0/4065120967 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44040af040 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 -- 172.21.15.18:0/4065120967 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44040b53f0 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 -- 172.21.15.18:0/4065120967 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44040b57e0 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640d7d358c0 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640d7d35e00 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 -- 172.21.15.18:0/4065120967 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f44040b5980 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f8065970 0x7f43f8067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.428+0000 7f440fe00640 1 -- 172.21.15.18:0/4065120967 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f440411ed00 con 0x5640d7c85f50 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4417600640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f8065970 0x7f43f8067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5640d7c9f560 0x5640d7bf84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x5640d7d36a80 con 0x5640d7c9f560 2024-04-25T10:05:32.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4418000640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5640d7c9f560 0x5640d7bf84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4417600640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f8065970 0x7f43f8067e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44080098f0 tx=0x7f4408009f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4418000640 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5640d7c9f560 0x5640d7bf84d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4418000640 1 -- 172.21.15.18:0/4065120967 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f4410006020 con 0x5640d7c9f560 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5640d7c9f560 msgr2=0x5640d7bf84d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5640d7c9f560 0x5640d7bf84d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f8065970 msgr2=0x7f43f8067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f8065970 0x7f43f8067e30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f44080098f0 tx=0x7f4408009f90 comp rx=0 tx=0).stop 2024-04-25T10:05:32.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 msgr2=0x5640d7d36540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 --2- 172.21.15.18:0/4065120967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5640d7c85f50 0x5640d7d36540 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44040ad040 tx=0x7f44040180d0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f4418000640 1 -- 172.21.15.18:0/4065120967 reap_dead start 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 shutdown_connections 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 >> 172.21.15.18:0/4065120967 conn(0x5640d7bcb400 msgr2=0x5640d7c87f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 shutdown_connections 2024-04-25T10:05:32.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.432+0000 7f441a359080 1 -- 172.21.15.18:0/4065120967 wait complete. 2024-04-25T10:05:32.447 INFO:teuthology.orchestra.run.smithi018.stdout:mytag 2024-04-25T10:05:32.447 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T10:05:32.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.524+0000 7f33c0b85080 1 Processor -- start 2024-04-25T10:05:32.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.524+0000 7f33c0b85080 1 -- start start 2024-04-25T10:05:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdea4770 0x5599fdf78040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a870 0x5599fdee2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fde489f0 con 0x5599fdf5a490 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fde4c950 con 0x5599fdea4770 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599fdf5cbb0 con 0x5599fdf5a870 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52682/0 (socket says 172.21.15.18:52682) 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 -- 172.21.15.18:0/1744925446 learned_addr learned my addr 172.21.15.18:0/1744925446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bde00640 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdea4770 0x5599fdf78040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33be800640 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a870 0x5599fdee2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 -- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a870 msgr2=0x5599fdee2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a870 0x5599fdee2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 -- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdea4770 msgr2=0x5599fdf78040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdea4770 0x5599fdf78040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 -- 172.21.15.18:0/1744925446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599fdf78e60 con 0x5599fdf5a490 2024-04-25T10:05:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33bd400640 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b3b0 tx=0x7f33ac00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adb12b7bde8a2ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33b7e00640 1 -- 172.21.15.18:0/1744925446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac016070 con 0x5599fdf5a490 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33b7e00640 1 -- 172.21.15.18:0/1744925446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac00d580 con 0x5599fdf5a490 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33b7e00640 1 -- 172.21.15.18:0/1744925446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac00d750 con 0x5599fdf5a490 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- 172.21.15.18:0/1744925446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 msgr2=0x5599fdf78580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b3b0 tx=0x7f33ac00b870 comp rx=0 tx=0).stop 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- 172.21.15.18:0/1744925446 shutdown_connections 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a870 0x5599fdee2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdf5a490 0x5599fdf78580 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1744925446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdea4770 0x5599fdf78040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- 172.21.15.18:0/1744925446 >> 172.21.15.18:0/1744925446 conn(0x5599fdea2400 msgr2=0x5599fded0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- 172.21.15.18:0/1744925446 shutdown_connections 2024-04-25T10:05:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- 172.21.15.18:0/1744925446 wait complete. 2024-04-25T10:05:32.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 Processor -- start 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- start start 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 0x5599fdf770b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a490 0x5599fdeea140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdf5a870 0x5599fdf57d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fdf79100 con 0x5599fdea4770 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599fdf74560 con 0x5599fdf5a870 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.528+0000 7f33c0b85080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599fdf74800 con 0x5599fdf5a490 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 0x5599fdf770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 0x5599fdf770b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52688/0 (socket says 172.21.15.18:52688) 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 -- 172.21.15.18:0/1115582354 learned_addr learned my addr 172.21.15.18:0/1115582354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bd400640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a490 0x5599fdeea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33be800640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdf5a870 0x5599fdf57d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 -- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a490 msgr2=0x5599fdeea140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a490 0x5599fdeea140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 -- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdf5a870 msgr2=0x5599fdf57d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdf5a870 0x5599fdf57d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 -- 172.21.15.18:0/1115582354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599fdf76190 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bd400640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5599fdf5a490 0x5599fdeea140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33be800640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5599fdf5a870 0x5599fdf57d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33bde00640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 0x5599fdf770b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f33b000a530 tx=0x7f33b00180c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 -- 172.21.15.18:0/1115582354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00ba030 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 -- 172.21.15.18:0/1115582354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b00b6460 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599fdf76430 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 -- 172.21.15.18:0/1115582354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00af040 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599fdf76970 con 0x5599fdea4770 2024-04-25T10:05:32.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 -- 172.21.15.18:0/1115582354 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33b00bd030 con 0x5599fdea4770 2024-04-25T10:05:32.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33a00659a0 0x7f33a0067e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.532+0000 7f33b6a00640 1 -- 172.21.15.18:0/1115582354 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f33b011f030 con 0x5599fdea4770 2024-04-25T10:05:32.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33bd400640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33a00659a0 0x7f33a0067e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5599fdf75c80 0x5599fdf6ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x5599fdf6f470 con 0x5599fdf75c80 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33be800640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5599fdf75c80 0x5599fdf6ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33bd400640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33a00659a0 0x7f33a0067e60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b350 tx=0x7f33ac002000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33be800640 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5599fdf75c80 0x5599fdf6ef30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33be800640 1 -- 172.21.15.18:0/1115582354 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f33b80044d0 con 0x5599fdf75c80 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5599fdf75c80 msgr2=0x5599fdf6ef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5599fdf75c80 0x5599fdf6ef30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33a00659a0 msgr2=0x7f33a0067e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f33a00659a0 0x7f33a0067e60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00b350 tx=0x7f33ac002000 comp rx=0 tx=0).stop 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 msgr2=0x5599fdf770b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 --2- 172.21.15.18:0/1115582354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5599fdea4770 0x5599fdf770b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f33b000a530 tx=0x7f33b00180c0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33be800640 1 -- 172.21.15.18:0/1115582354 reap_dead start 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 shutdown_connections 2024-04-25T10:05:32.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 >> 172.21.15.18:0/1115582354 conn(0x5599fdea2400 msgr2=0x5599fdf78040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 shutdown_connections 2024-04-25T10:05:32.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.536+0000 7f33c0b85080 1 -- 172.21.15.18:0/1115582354 wait complete. 2024-04-25T10:05:32.551 INFO:teuthology.orchestra.run.smithi018.stdout:mytag 2024-04-25T10:05:32.551 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T10:05:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 Processor -- start 2024-04-25T10:05:32.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 -- start start 2024-04-25T10:05:32.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f28f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f288ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476f28cb70 con 0x56476f28a490 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476f1789f0 con 0x56476f1d4770 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e6847080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476f1ffd50 con 0x56476f28a870 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52712/0 (socket says 172.21.15.18:52712) 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 -- 172.21.15.18:0/3507678956 learned_addr learned my addr 172.21.15.18:0/3507678956 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e3800640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f288ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2e00640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f28f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 -- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 msgr2=0x56476f288ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f288ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 -- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 msgr2=0x56476f28f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f28f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 -- 172.21.15.18:0/3507678956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56476f28eb20 con 0x56476f28a490 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2e00640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f28f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.628+0000 7f56e2400640 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b2d0 tx=0x7f56d000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b96a8d771f36255 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e1000640 1 -- 172.21.15.18:0/3507678956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000a040 con 0x56476f28a490 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e1000640 1 -- 172.21.15.18:0/3507678956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000f620 con 0x56476f28a490 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e1000640 1 -- 172.21.15.18:0/3507678956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000f9f0 con 0x56476f28a490 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/3507678956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 msgr2=0x56476f2a8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f56d000b2d0 tx=0x7f56d000b790 comp rx=0 tx=0).stop 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/3507678956 shutdown_connections 2024-04-25T10:05:32.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f288ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f2a8590 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- 172.21.15.18:0/3507678956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f28f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/3507678956 >> 172.21.15.18:0/3507678956 conn(0x56476f1d2400 msgr2=0x56476f200cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/3507678956 shutdown_connections 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/3507678956 wait complete. 2024-04-25T10:05:32.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 Processor -- start 2024-04-25T10:05:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- start start 2024-04-25T10:05:32.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f217bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f1fd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f1fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476f28d0d0 con 0x56476f28a490 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476f2896b0 con 0x56476f1d4770 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476f289910 con 0x56476f28a870 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f1fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f1fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52724/0 (socket says 172.21.15.18:52724) 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 -- 172.21.15.18:0/844947286 learned_addr learned my addr 172.21.15.18:0/844947286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e3800640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f1fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2e00640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f217bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 -- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 msgr2=0x56476f1fddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f1fddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 -- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 msgr2=0x56476f217bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f217bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 -- 172.21.15.18:0/844947286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56476f218550 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e3800640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56476f28a870 0x56476f1fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2e00640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56476f1d4770 0x56476f217bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e2400640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f1fd870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e620 tx=0x7f56d0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56db400640 1 -- 172.21.15.18:0/844947286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0020070 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56db400640 1 -- 172.21.15.18:0/844947286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000ec30 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56db400640 1 -- 172.21.15.18:0/844947286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d001c440 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.632+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56476f2187f0 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56476f342040 con 0x56476f28a490 2024-04-25T10:05:32.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56db400640 1 -- 172.21.15.18:0/844947286 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56d0023070 con 0x56476f28a490 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56db400640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f56c4065940 0x7f56c4067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56db400640 1 -- 172.21.15.18:0/844947286 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f56d0085da0 con 0x56476f28a490 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56e6847080 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x56476f3424e0 0x56476f3428c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x56476f218110 con 0x56476f3424e0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56e2e00640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f56c4065940 0x7f56c4067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.636+0000 7f56e3800640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x56476f3424e0 0x56476f3428c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e2e00640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f56c4065940 0x7f56c4067e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009910 tx=0x7f56d400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e3800640 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x56476f3424e0 0x56476f3428c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e3800640 1 -- 172.21.15.18:0/844947286 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f56dc0b3040 con 0x56476f3424e0 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x56476f3424e0 msgr2=0x56476f3428c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x56476f3424e0 0x56476f3428c0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f56c4065940 msgr2=0x7f56c4067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f56c4065940 0x7f56c4067e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009910 tx=0x7f56d400c040 comp rx=0 tx=0).stop 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 msgr2=0x56476f1fd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 --2- 172.21.15.18:0/844947286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56476f28a490 0x56476f1fd870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f56d000e620 tx=0x7f56d0000bd0 comp rx=0 tx=0).stop 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e3800640 1 -- 172.21.15.18:0/844947286 reap_dead start 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 shutdown_connections 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 >> 172.21.15.18:0/844947286 conn(0x56476f1d2400 msgr2=0x56476f290920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 shutdown_connections 2024-04-25T10:05:32.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:32.640+0000 7f56e6847080 1 -- 172.21.15.18:0/844947286 wait complete. 2024-04-25T10:05:32.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:05:32.655 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:05:32.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:32.775 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:32.833 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:05:32.833 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:32.833 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:32.842 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:32.842 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:05:32.842 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:32.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:32.851 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:32.851 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:32.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:32.892 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:05:32.892 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:32.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:32.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:33.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 Processor -- start 2024-04-25T10:05:33.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 -- start start 2024-04-25T10:05:33.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86a415dcd0 0x7f86a4099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a4099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a406d740 con 0x7f86a40b06c0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40cbfc0 con 0x7f86a415dcd0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86aa600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a406cea0 con 0x7f86a409a7a0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86a415dcd0 0x7f86a4099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f86a40b06c0 0x7f86a40cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55912/0 (socket says 172.21.15.18:55912) 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f86a415dcd0 0x7f86a4099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52738/0 (socket says 172.21.15.18:52738) 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9c00640 1 -- 172.21.15.18:0/1393595039 learned_addr learned my addr 172.21.15.18:0/1393595039 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a3e00640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a4099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 -- 172.21.15.18:0/1393595039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 msgr2=0x7f86a4099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a4099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 -- 172.21.15.18:0/1393595039 >> v1:172.21.15.18:6789/0 conn(0x7f86a40b06c0 legacy=0x7f86a40cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a9200640 1 -- 172.21.15.18:0/1393595039 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a406d180 con 0x7f86a415dcd0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a3400640 1 -- 172.21.15.18:0/1393595039 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487754951 0 0) 0x7f86a406d740 con 0x7f86a40b06c0 2024-04-25T10:05:33.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.068+0000 7f86a3e00640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a4099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86a9200640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a415dcd0 0x7f86a4099a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86980097c0 tx=0x7f869801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3055e0dd6ae50d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86a3400640 1 -- 172.21.15.18:0/1393595039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980a7070 con 0x7f86a415dcd0 2024-04-25T10:05:33.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86a3400640 1 -- 172.21.15.18:0/1393595039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86980b0070 con 0x7f86a415dcd0 2024-04-25T10:05:33.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86a3400640 1 -- 172.21.15.18:0/1393595039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980ab890 con 0x7f86a415dcd0 2024-04-25T10:05:33.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- 172.21.15.18:0/1393595039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a415dcd0 msgr2=0x7f86a4099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a415dcd0 0x7f86a4099a60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f86980097c0 tx=0x7f869801c470 comp rx=0 tx=0).stop 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- 172.21.15.18:0/1393595039 shutdown_connections 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a4099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 --2- 172.21.15.18:0/1393595039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a415dcd0 0x7f86a4099a60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- 172.21.15.18:0/1393595039 >> 172.21.15.18:0/1393595039 conn(0x7f86a40b3050 msgr2=0x7f86a40b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- 172.21.15.18:0/1393595039 shutdown_connections 2024-04-25T10:05:33.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- 172.21.15.18:0/1393595039 wait complete. 2024-04-25T10:05:33.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 Processor -- start 2024-04-25T10:05:33.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.072+0000 7f86aa600640 1 -- start start 2024-04-25T10:05:33.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a40b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86a415dcd0 0x7f86a415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a416aa20 con 0x7f86a40b06c0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a416a8a0 con 0x7f86a415dcd0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a416aba0 con 0x7f86a409a7a0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52744/0 (socket says 172.21.15.18:52744) 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 -- 172.21.15.18:0/3871334928 learned_addr learned my addr 172.21.15.18:0/3871334928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a9200640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a40b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a9c00640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86a415dcd0 0x7f86a415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 -- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 msgr2=0x7f86a40b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a40b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 -- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86a415dcd0 msgr2=0x7f86a415c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86a415dcd0 0x7f86a415c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 -- 172.21.15.18:0/3871334928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a415cc20 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a3e00640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f869000c820 tx=0x7f869000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690015070 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690007a30 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a40b4a20 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690007e40 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a40b4fe0 con 0x7f86a40b06c0 2024-04-25T10:05:33.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.076+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a404efa0 con 0x7f86a40b06c0 2024-04-25T10:05:33.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.080+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8690018070 con 0x7f86a40b06c0 2024-04-25T10:05:33.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.080+0000 7f86a0c00640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 0x7f8684069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.080+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86900853a0 con 0x7f86a40b06c0 2024-04-25T10:05:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.080+0000 7f86a9200640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 0x7f8684069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.080+0000 7f86a9200640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 0x7f8684069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f86980af000 tx=0x7f86980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.084+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8690055d40 con 0x7f86a40b06c0 2024-04-25T10:05:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.280+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86a415d500 con 0x7f86a40b06c0 2024-04-25T10:05:33.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.280+0000 7f86a0c00640 1 -- 172.21.15.18:0/3871334928 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f8690059de0 con 0x7f86a40b06c0 2024-04-25T10:05:33.292 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:33.292 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:33.292 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 msgr2=0x7f8684069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 0x7f8684069420 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f86980af000 tx=0x7f86980a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 msgr2=0x7f86a40b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f869000c820 tx=0x7f869000cce0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 shutdown_connections 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86a415dcd0 0x7f86a415c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86a40b06c0 0x7f86a40b43b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8684066f60 0x7f8684069420 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 --2- 172.21.15.18:0/3871334928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f86a409a7a0 0x7f86a40b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 >> 172.21.15.18:0/3871334928 conn(0x7f86a40b3050 msgr2=0x7f86a40cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 shutdown_connections 2024-04-25T10:05:33.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.284+0000 7f86aa600640 1 -- 172.21.15.18:0/3871334928 wait complete. 2024-04-25T10:05:33.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:33.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 Processor -- start 2024-04-25T10:05:33.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 -- start start 2024-04-25T10:05:33.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 0x7fe084099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe08415ee00 0x7fe08406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe08409a380 con 0x7fe0841616a0 2024-04-25T10:05:33.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08406c650 con 0x7fe08415ee00 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.448+0000 7fe089400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406c930 con 0x7fe084099a60 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe08415ee00 0x7fe08406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe083200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe0841616a0 0x7fe084161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55918/0 (socket says 172.21.15.18:55918) 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe083200640 1 -- 172.21.15.18:0/2424405964 learned_addr learned my addr 172.21.15.18:0/2424405964 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe082800640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 0x7fe084099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 -- 172.21.15.18:0/2424405964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 msgr2=0x7fe084099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 0x7fe084099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 -- 172.21.15.18:0/2424405964 >> v1:172.21.15.18:6789/0 conn(0x7fe0841616a0 legacy=0x7fe084161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe081e00640 1 -- 172.21.15.18:0/2424405964 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893514896 0 0) 0x7fe08409a380 con 0x7fe0841616a0 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 -- 172.21.15.18:0/2424405964 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08406cc10 con 0x7fe08415ee00 2024-04-25T10:05:33.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe082800640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 0x7fe084099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:33.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe07be00640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08415ee00 0x7fe08406bd20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f266dd04b4e236f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe081e00640 1 -- 172.21.15.18:0/2424405964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c0b0070 con 0x7fe08415ee00 2024-04-25T10:05:33.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe081e00640 1 -- 172.21.15.18:0/2424405964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c004230 con 0x7fe08415ee00 2024-04-25T10:05:33.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.452+0000 7fe081e00640 1 -- 172.21.15.18:0/2424405964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003620 con 0x7fe08415ee00 2024-04-25T10:05:33.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- 172.21.15.18:0/2424405964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08415ee00 msgr2=0x7fe08406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08415ee00 0x7fe08406bd20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0097c0 tx=0x7fe06c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- 172.21.15.18:0/2424405964 shutdown_connections 2024-04-25T10:05:33.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08415ee00 0x7fe08406bd20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- 172.21.15.18:0/2424405964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe084099a60 0x7fe084099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- 172.21.15.18:0/2424405964 >> 172.21.15.18:0/2424405964 conn(0x7fe0840d17a0 msgr2=0x7fe0840d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- 172.21.15.18:0/2424405964 shutdown_connections 2024-04-25T10:05:33.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- 172.21.15.18:0/2424405964 wait complete. 2024-04-25T10:05:33.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 Processor -- start 2024-04-25T10:05:33.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- start start 2024-04-25T10:05:33.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe08415ee00 0x7fe0840cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0841616a0 0x7fe084144990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406c3e0 con 0x7fe084099a60 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08406c260 con 0x7fe08415ee00 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe089400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe08416b210 con 0x7fe0841616a0 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52752/0 (socket says 172.21.15.18:52752) 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 -- 172.21.15.18:0/484687692 learned_addr learned my addr 172.21.15.18:0/484687692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 -- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0841616a0 msgr2=0x7fe084144990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0841616a0 0x7fe084144990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 -- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe08415ee00 msgr2=0x7fe0840cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe08415ee00 0x7fe0840cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.456+0000 7fe082800640 1 -- 172.21.15.18:0/484687692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840cb580 con 0x7fe084099a60 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe082800640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c7f0 tx=0x7fe07400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe074007a30 con 0x7fe084099a60 2024-04-25T10:05:33.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe074007bd0 con 0x7fe084099a60 2024-04-25T10:05:33.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0740113f0 con 0x7fe084099a60 2024-04-25T10:05:33.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe084158ee0 con 0x7fe084099a60 2024-04-25T10:05:33.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0841594a0 con 0x7fe084099a60 2024-04-25T10:05:33.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0840745d0 con 0x7fe084099a60 2024-04-25T10:05:33.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe074011590 con 0x7fe084099a60 2024-04-25T10:05:33.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 0x7fe060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.460+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe074085340 con 0x7fe084099a60 2024-04-25T10:05:33.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.464+0000 7fe07be00640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 0x7fe060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.464+0000 7fe07be00640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 0x7fe060069420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0ad000 tx=0x7fe06c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.464+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe074015020 con 0x7fe084099a60 2024-04-25T10:05:33.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe08409ae10 con 0x7fe084099a60 2024-04-25T10:05:33.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe07aa00640 1 -- 172.21.15.18:0/484687692 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16918 (secure 0 0 0) 0x7fe074056250 con 0x7fe084099a60 2024-04-25T10:05:33.642 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:33.642 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":41,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:12.080575+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 msgr2=0x7fe060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 0x7fe060069420 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0ad000 tx=0x7fe06c004740 comp rx=0 tx=0).stop 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 msgr2=0x7fe0840b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe07400c7f0 tx=0x7fe07400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 shutdown_connections 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe060066f60 0x7fe060069420 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0841616a0 0x7fe084144990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe08415ee00 0x7fe0840cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 --2- 172.21.15.18:0/484687692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe084099a60 0x7fe0840b4710 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 >> 172.21.15.18:0/484687692 conn(0x7fe0840d17a0 msgr2=0x7fe08406fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 shutdown_connections 2024-04-25T10:05:33.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.632+0000 7fe089400640 1 -- 172.21.15.18:0/484687692 wait complete. 2024-04-25T10:05:33.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:05:08.290854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:05:09.472259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:33.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 Processor -- start 2024-04-25T10:05:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 -- start start 2024-04-25T10:05:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe85006bf30 0x7fe8500d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85015e040 con 0x7fe85015dc60 2024-04-25T10:05:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500cff80 con 0x7fe85009a170 2024-04-25T10:05:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe857600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500d0260 con 0x7fe85006bf30 2024-04-25T10:05:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe854c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe85015dc60 0x7fe850099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55928/0 (socket says 172.21.15.18:55928) 2024-04-25T10:05:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe854c00640 1 -- 172.21.15.18:0/998374098 learned_addr learned my addr 172.21.15.18:0/998374098 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe855600640 1 --2- 172.21.15.18:0/998374098 >> v2:172.21.15.167:3300/0 conn(0x7fe85006bf30 0x7fe8500d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930088893 0 0) 0x7fe85015e040 con 0x7fe85015dc60 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe838003530 con 0x7fe85015dc60 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2590839760 0 0) 0x7fe838003530 con 0x7fe85015dc60 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 >> v2:172.21.15.167:3300/0 conn(0x7fe85006bf30 msgr2=0x7fe8500d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 --2- 172.21.15.18:0/998374098 >> v2:172.21.15.167:3300/0 conn(0x7fe85006bf30 0x7fe8500d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 >> v1:172.21.15.167:6789/0 conn(0x7fe85009a170 legacy=0x7fe8500cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500d0540 con 0x7fe85015dc60 2024-04-25T10:05:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fe844001680 con 0x7fe85015dc60 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 >> v1:172.21.15.18:6789/0 conn(0x7fe85015dc60 legacy=0x7fe850099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8380039c0 0x7fe838003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 0x7fe838004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8380052f0 0x7fe83800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500d0260 con 0x7fe838004810 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83800c1c0 con 0x7fe8380039c0 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83800c3c0 con 0x7fe8380052f0 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe84fe00640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 0x7fe838004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe854c00640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8380039c0 0x7fe838003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.800+0000 7fe855600640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8380052f0 0x7fe83800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 -- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8380052f0 msgr2=0x7fe83800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8380052f0 0x7fe83800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 -- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8380039c0 msgr2=0x7fe838003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8380039c0 0x7fe838003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 -- 172.21.15.18:0/998374098 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe838003530 con 0x7fe838004810 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe855600640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe8380052f0 0x7fe83800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:33.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe855600640 1 -- 172.21.15.18:0/998374098 reap_dead start 2024-04-25T10:05:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84fe00640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 0x7fe838004c90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe83c001750 tx=0x7fe83c01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7548ed03385f0e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c0013a0 con 0x7fe838004810 2024-04-25T10:05:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c0052f0 con 0x7fe838004810 2024-04-25T10:05:33.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe84f400640 1 -- 172.21.15.18:0/998374098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c003840 con 0x7fe838004810 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 -- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 msgr2=0x7fe838004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 0x7fe838004c90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe83c001750 tx=0x7fe83c01c370 comp rx=0 tx=0).stop 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 -- 172.21.15.18:0/998374098 shutdown_connections 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 --2- 172.21.15.18:0/998374098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe838004810 0x7fe838004c90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 -- 172.21.15.18:0/998374098 >> 172.21.15.18:0/998374098 conn(0x7fe8500b3200 msgr2=0x7fe8500b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 -- 172.21.15.18:0/998374098 shutdown_connections 2024-04-25T10:05:33.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.804+0000 7fe857600640 1 -- 172.21.15.18:0/998374098 wait complete. 2024-04-25T10:05:33.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 Processor -- start 2024-04-25T10:05:33.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- start start 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe838004810 0x7fe85009c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe85015b8a0 0x7fe85009d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85006cfa0 con 0x7fe850160eb0 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500d1430 con 0x7fe85015b8a0 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85009b6f0 con 0x7fe838004810 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52778/0 (socket says 172.21.15.18:52778) 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 -- 172.21.15.18:0/3080377303 learned_addr learned my addr 172.21.15.18:0/3080377303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe854c00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe838004810 0x7fe85009c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe855600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe85015b8a0 0x7fe85009d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 -- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe838004810 msgr2=0x7fe85009c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe838004810 0x7fe85009c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 -- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe85015b8a0 msgr2=0x7fe85009d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe85015b8a0 0x7fe85009d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 -- 172.21.15.18:0/3080377303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85009b9d0 con 0x7fe850160eb0 2024-04-25T10:05:33.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84fe00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe83c01c1a0 tx=0x7fe838005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007a40 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83c0ba070 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83c007270 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85009bcb0 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.808+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85015cbc0 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8500745d0 con 0x7fe850160eb0 2024-04-25T10:05:33.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe83c0052f0 con 0x7fe850160eb0 2024-04-25T10:05:33.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe84cc00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 0x7fe830069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:33.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe83c11f4f0 con 0x7fe850160eb0 2024-04-25T10:05:33.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe854c00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 0x7fe830069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:33.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.812+0000 7fe854c00640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 0x7fe830069420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe844000c10 tx=0x7fe844009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:33.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.816+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe83c0160b0 con 0x7fe850160eb0 2024-04-25T10:05:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe850099d10 con 0x7fe850160eb0 2024-04-25T10:05:33.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe84cc00640 1 -- 172.21.15.18:0/3080377303 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe83c0f03f0 con 0x7fe850160eb0 2024-04-25T10:05:33.990 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:05:33.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 msgr2=0x7fe830069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 0x7fe830069420 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe844000c10 tx=0x7fe844009040 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 msgr2=0x7fe85015b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe83c01c1a0 tx=0x7fe838005840 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 shutdown_connections 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe85015b8a0 0x7fe85009d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe850160eb0 0x7fe85015b360 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe830066f60 0x7fe830069420 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 --2- 172.21.15.18:0/3080377303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe838004810 0x7fe85009c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 >> 172.21.15.18:0/3080377303 conn(0x7fe8500b3200 msgr2=0x7fe8501616f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.980+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 shutdown_connections 2024-04-25T10:05:33.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:33.984+0000 7fe857600640 1 -- 172.21.15.18:0/3080377303 wait complete. 2024-04-25T10:05:34.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:05:34.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.144+0000 7f6d51400640 1 Processor -- start 2024-04-25T10:05:34.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.144+0000 7f6d51400640 1 -- start start 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d51400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c15acd0 0x7f6d4c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d51400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 0x7f6d4c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d51400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c15bc40 con 0x7f6d4c144120 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d51400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c15e490 con 0x7f6d4c15acd0 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d51400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c15b150 con 0x7f6d4c15ee60 2024-04-25T10:05:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c15acd0 0x7f6d4c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d4a800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6d4c144120 0x7f6d4c0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55944/0 (socket says 172.21.15.18:55944) 2024-04-25T10:05:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c15acd0 0x7f6d4c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52782/0 (socket says 172.21.15.18:52782) 2024-04-25T10:05:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d4a800640 1 -- 172.21.15.18:0/3119056933 learned_addr learned my addr 172.21.15.18:0/3119056933 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d4b200640 1 --2- 172.21.15.18:0/3119056933 >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 0x7f6d4c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 -- 172.21.15.18:0/3119056933 >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 msgr2=0x7f6d4c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 --2- 172.21.15.18:0/3119056933 >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 0x7f6d4c0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 -- 172.21.15.18:0/3119056933 >> v1:172.21.15.18:6789/0 conn(0x7f6d4c144120 legacy=0x7f6d4c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d49e00640 1 -- 172.21.15.18:0/3119056933 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761611633 0 0) 0x7f6d4c15bc40 con 0x7f6d4c144120 2024-04-25T10:05:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d43e00640 1 -- 172.21.15.18:0/3119056933 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c15b3a0 con 0x7f6d4c15acd0 2024-04-25T10:05:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.148+0000 7f6d4b200640 1 --2- 172.21.15.18:0/3119056933 >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 0x7f6d4c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:34.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d43e00640 1 --2- 172.21.15.18:0/3119056933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c15e920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c06bb20 tx=0x7f6d3401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883f8cbfe76746cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d49e00640 1 -- 172.21.15.18:0/3119056933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340b0070 con 0x7f6d4c15acd0 2024-04-25T10:05:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d49e00640 1 -- 172.21.15.18:0/3119056933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d340ab600 con 0x7f6d4c15acd0 2024-04-25T10:05:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d49e00640 1 -- 172.21.15.18:0/3119056933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340ab9d0 con 0x7f6d4c15acd0 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 -- 172.21.15.18:0/3119056933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15acd0 msgr2=0x7f6d4c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 --2- 172.21.15.18:0/3119056933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c15e920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c06bb20 tx=0x7f6d3401c3f0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 -- 172.21.15.18:0/3119056933 shutdown_connections 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 --2- 172.21.15.18:0/3119056933 >> v2:172.21.15.167:3300/0 conn(0x7f6d4c15ee60 0x7f6d4c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 --2- 172.21.15.18:0/3119056933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c15e920 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 -- 172.21.15.18:0/3119056933 >> 172.21.15.18:0/3119056933 conn(0x7f6d4c067080 msgr2=0x7f6d4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 -- 172.21.15.18:0/3119056933 shutdown_connections 2024-04-25T10:05:34.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.152+0000 7f6d51400640 1 -- 172.21.15.18:0/3119056933 wait complete. 2024-04-25T10:05:34.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 Processor -- start 2024-04-25T10:05:34.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- start start 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c144120 0x7f6d4c1599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c1593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1677d0 con 0x7f6d4c15ee60 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c167650 con 0x7f6d4c15acd0 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c167950 con 0x7f6d4c144120 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52790/0 (socket says 172.21.15.18:52790) 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 -- 172.21.15.18:0/1105696201 learned_addr learned my addr 172.21.15.18:0/1105696201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:34.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d43e00640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c1593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4a800640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c144120 0x7f6d4c1599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 -- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c144120 msgr2=0x7f6d4c1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c144120 0x7f6d4c1599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 -- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c15acd0 msgr2=0x7f6d4c1593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c1593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 -- 172.21.15.18:0/1105696201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c1f82b0 con 0x7f6d4c15ee60 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d4b200640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400cd50 tx=0x7f6d4400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400f680 con 0x7f6d4c15ee60 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400f840 con 0x7f6d4c15ee60 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c1f8590 con 0x7f6d4c15ee60 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400fc30 con 0x7f6d4c15ee60 2024-04-25T10:05:34.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c1f8b50 con 0x7f6d4c15ee60 2024-04-25T10:05:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.156+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c0745d0 con 0x7f6d4c15ee60 2024-04-25T10:05:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.160+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d440213f0 con 0x7f6d4c15ee60 2024-04-25T10:05:34.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.160+0000 7f6d42a00640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 0x7f6d28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.160+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d44085e40 con 0x7f6d4c15ee60 2024-04-25T10:05:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.160+0000 7f6d4a800640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 0x7f6d28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.160+0000 7f6d4a800640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 0x7f6d28069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c007fd0 tx=0x7f6d3c007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.164+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d44014030 con 0x7f6d4c15ee60 2024-04-25T10:05:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.328+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d4c06ad10 con 0x7f6d4c15ee60 2024-04-25T10:05:34.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.328+0000 7f6d42a00640 1 -- 172.21.15.18:0/1105696201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d44056660 con 0x7f6d4c15ee60 2024-04-25T10:05:34.339 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 msgr2=0x7f6d28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 0x7f6d28069420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c007fd0 tx=0x7f6d3c007d60 comp rx=0 tx=0).stop 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 msgr2=0x7f6d4c1f48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400cd50 tx=0x7f6d4400a650 comp rx=0 tx=0).stop 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 shutdown_connections 2024-04-25T10:05:34.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15ee60 0x7f6d4c1f48d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c15acd0 0x7f6d4c1593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d28066f60 0x7f6d28069420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 --2- 172.21.15.18:0/1105696201 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c144120 0x7f6d4c1599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 >> 172.21.15.18:0/1105696201 conn(0x7f6d4c067080 msgr2=0x7f6d4c140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 shutdown_connections 2024-04-25T10:05:34.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.332+0000 7f6d51400640 1 -- 172.21.15.18:0/1105696201 wait complete. 2024-04-25T10:05:34.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:05:34.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.492+0000 7f0795a00640 1 Processor -- start 2024-04-25T10:05:34.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.492+0000 7f0795a00640 1 -- start start 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f079006b4e0 0x7f07901576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079015dfc0 con 0x7f07900cfdf0 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079015e2a0 con 0x7f0790072f60 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079015e580 con 0x7f079006b4e0 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f079006b4e0 0x7f07901576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f079006b4e0 0x7f07901576e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52800/0 (socket says 172.21.15.18:52800) 2024-04-25T10:05:34.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 -- 172.21.15.18:0/170492247 learned_addr learned my addr 172.21.15.18:0/170492247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:34.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 -- 172.21.15.18:0/170492247 >> v1:172.21.15.167:6789/0 conn(0x7f0790072f60 legacy=0x7f07900cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 -- 172.21.15.18:0/170492247 >> v1:172.21.15.18:6789/0 conn(0x7f07900cfdf0 legacy=0x7f079006add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.496+0000 7f0795000640 1 -- 172.21.15.18:0/170492247 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079015e860 con 0x7f079006b4e0 2024-04-25T10:05:34.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795000640 1 --2- 172.21.15.18:0/170492247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f079006b4e0 0x7f07901576e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0788009e50 tx=0x7f078801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b45c9d69877c7f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f078f400640 1 -- 172.21.15.18:0/170492247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880a5700 con 0x7f079006b4e0 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f078f400640 1 -- 172.21.15.18:0/170492247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880a58a0 con 0x7f079006b4e0 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f078f400640 1 -- 172.21.15.18:0/170492247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880a5c70 con 0x7f079006b4e0 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- 172.21.15.18:0/170492247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f079006b4e0 msgr2=0x7f07901576e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 --2- 172.21.15.18:0/170492247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f079006b4e0 0x7f07901576e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0788009e50 tx=0x7f078801ca30 comp rx=0 tx=0).stop 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- 172.21.15.18:0/170492247 shutdown_connections 2024-04-25T10:05:34.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 --2- 172.21.15.18:0/170492247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f079006b4e0 0x7f07901576e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- 172.21.15.18:0/170492247 >> 172.21.15.18:0/170492247 conn(0x7f07900b21a0 msgr2=0x7f07900b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:34.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- 172.21.15.18:0/170492247 shutdown_connections 2024-04-25T10:05:34.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- 172.21.15.18:0/170492247 wait complete. 2024-04-25T10:05:34.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 Processor -- start 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.500+0000 7f0795a00640 1 -- start start 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f079006b4e0 0x7f0790153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790072f60 0x7f079014eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079016c270 con 0x7f07900cfdf0 2024-04-25T10:05:34.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079016c3f0 con 0x7f0790072f60 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079016c570 con 0x7f079006b4e0 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52810/0 (socket says 172.21.15.18:52810) 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 -- 172.21.15.18:0/1091800261 learned_addr learned my addr 172.21.15.18:0/1091800261 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f078fe00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f079006b4e0 0x7f0790153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0787400640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790072f60 0x7f079014eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 -- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f079006b4e0 msgr2=0x7f0790153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f079006b4e0 0x7f0790153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 -- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790072f60 msgr2=0x7f079014eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790072f60 0x7f079014eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 -- 172.21.15.18:0/1091800261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790162270 con 0x7f07900cfdf0 2024-04-25T10:05:34.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795000640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f07880af040 tx=0x7f07880197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880bc020 con 0x7f07900cfdf0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880b8880 con 0x7f07900cfdf0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0788009510 con 0x7f07900cfdf0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0790152170 con 0x7f07900cfdf0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079015b270 con 0x7f07900cfdf0 2024-04-25T10:05:34.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079015ad80 con 0x7f07900cfdf0 2024-04-25T10:05:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.504+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f07880bf020 con 0x7f07900cfdf0 2024-04-25T10:05:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.508+0000 7f078cc00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 0x7f076c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.508+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0788120510 con 0x7f07900cfdf0 2024-04-25T10:05:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.508+0000 7f078fe00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 0x7f076c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.508+0000 7f078fe00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 0x7f076c069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07900b52f0 tx=0x7f0780009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.512+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07880c6030 con 0x7f07900cfdf0 2024-04-25T10:05:34.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07900745d0 con 0x7f07900cfdf0 2024-04-25T10:05:34.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f078cc00640 1 -- 172.21.15.18:0/1091800261 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0788016620 con 0x7f07900cfdf0 2024-04-25T10:05:34.682 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 msgr2=0x7f076c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 0x7f076c069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f07900b52f0 tx=0x7f0780009040 comp rx=0 tx=0).stop 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 msgr2=0x7f079014f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f07880af040 tx=0x7f07880197d0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 shutdown_connections 2024-04-25T10:05:34.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07900cfdf0 0x7f079014f410 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0790072f60 0x7f079014eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f076c066f60 0x7f076c069420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 --2- 172.21.15.18:0/1091800261 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f079006b4e0 0x7f0790153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 >> 172.21.15.18:0/1091800261 conn(0x7f07900b21a0 msgr2=0x7f07900d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 shutdown_connections 2024-04-25T10:05:34.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.672+0000 7f0795a00640 1 -- 172.21.15.18:0/1091800261 wait complete. 2024-04-25T10:05:34.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.832+0000 7f2bd0000640 1 Processor -- start 2024-04-25T10:05:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.832+0000 7f2bd0000640 1 -- start start 2024-04-25T10:05:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.832+0000 7f2bd0000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2bc815fe50 0x7f2bc80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.832+0000 7f2bd0000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc80b1c90 0x7f2bc815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bd0000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc80b20a0 con 0x7f2bc8145270 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bd0000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc8145650 con 0x7f2bc80b1c90 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bd0000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc81602b0 con 0x7f2bc815fe50 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc80b1c90 0x7f2bc815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2bc80b1c90 0x7f2bc815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52822/0 (socket says 172.21.15.18:52822) 2024-04-25T10:05:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 -- 172.21.15.18:0/3258575915 learned_addr learned my addr 172.21.15.18:0/3258575915 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bccc00640 1 --2- 172.21.15.18:0/3258575915 >> v2:172.21.15.167:3300/0 conn(0x7f2bc815fe50 0x7f2bc80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 -- 172.21.15.18:0/3258575915 >> v2:172.21.15.167:3300/0 conn(0x7f2bc815fe50 msgr2=0x7f2bc80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 --2- 172.21.15.18:0/3258575915 >> v2:172.21.15.167:3300/0 conn(0x7f2bc815fe50 0x7f2bc80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 -- 172.21.15.18:0/3258575915 >> v1:172.21.15.167:6789/0 conn(0x7f2bc8145270 legacy=0x7f2bc80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 -- 172.21.15.18:0/3258575915 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80cc4e0 con 0x7f2bc80b1c90 2024-04-25T10:05:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bce000640 1 --2- 172.21.15.18:0/3258575915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815bd80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80b24b0 tx=0x7f2bc001c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dfb4b57a238056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bc7e00640 1 -- 172.21.15.18:0/3258575915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00a5660 con 0x7f2bc80b1c90 2024-04-25T10:05:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bc7e00640 1 -- 172.21.15.18:0/3258575915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc00a5800 con 0x7f2bc80b1c90 2024-04-25T10:05:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.836+0000 7f2bc7e00640 1 -- 172.21.15.18:0/3258575915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc00a5bd0 con 0x7f2bc80b1c90 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- 172.21.15.18:0/3258575915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 msgr2=0x7f2bc815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- 172.21.15.18:0/3258575915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815bd80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80b24b0 tx=0x7f2bc001c7a0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- 172.21.15.18:0/3258575915 shutdown_connections 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- 172.21.15.18:0/3258575915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815bd80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- 172.21.15.18:0/3258575915 >> v2:172.21.15.167:3300/0 conn(0x7f2bc815fe50 0x7f2bc80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- 172.21.15.18:0/3258575915 >> 172.21.15.18:0/3258575915 conn(0x7f2bc8066fa0 msgr2=0x7f2bc806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- 172.21.15.18:0/3258575915 shutdown_connections 2024-04-25T10:05:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- 172.21.15.18:0/3258575915 wait complete. 2024-04-25T10:05:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 Processor -- start 2024-04-25T10:05:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- start start 2024-04-25T10:05:34.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 0x7f2bc80af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 0x7f2bc81f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc815f930 con 0x7f2bc80b1c90 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc815f650 con 0x7f2bc8145270 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bd0000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc80cdbe0 con 0x7f2bc815fe50 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bcd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52834/0 (socket says 172.21.15.18:52834) 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bcd600640 1 -- 172.21.15.18:0/2731474528 learned_addr learned my addr 172.21.15.18:0/2731474528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bccc00640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 0x7f2bc80af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bce000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 0x7f2bc81f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bcd600640 1 -- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 msgr2=0x7f2bc81f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.840+0000 7f2bcd600640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 0x7f2bc81f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bcd600640 1 -- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 msgr2=0x7f2bc80af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bcd600640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 0x7f2bc80af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:34.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bcd600640 1 -- 172.21.15.18:0/2731474528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc80b48f0 con 0x7f2bc80b1c90 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bce000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 0x7f2bc81f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bccc00640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 0x7f2bc80af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bcd600640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00c480 tx=0x7f2bbc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc012830 con 0x7f2bc80b1c90 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc017070 con 0x7f2bc80b1c90 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc012c30 con 0x7f2bc80b1c90 2024-04-25T10:05:34.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc813e850 con 0x7f2bc80b1c90 2024-04-25T10:05:34.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc813ee10 con 0x7f2bc80b1c90 2024-04-25T10:05:34.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc80745d0 con 0x7f2bc80b1c90 2024-04-25T10:05:34.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2bbc01c460 con 0x7f2bc80b1c90 2024-04-25T10:05:34.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 0x7f2ba8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:34.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2bbc084fa0 con 0x7f2bc80b1c90 2024-04-25T10:05:34.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.844+0000 7f2bccc00640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 0x7f2ba8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:34.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.848+0000 7f2bccc00640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 0x7f2ba8069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2bc815f2d0 tx=0x7f2bb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:34.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:34.848+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2bbc055eb0 con 0x7f2bc80b1c90 2024-04-25T10:05:35.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc806b8e0 con 0x7f2bc80b1c90 2024-04-25T10:05:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bc5600640 1 -- 172.21.15.18:0/2731474528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f2bbc0557b0 con 0x7f2bc80b1c90 2024-04-25T10:05:35.057 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:35.057 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:35.058 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:35.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 msgr2=0x7f2ba8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 0x7f2ba8069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2bc815f2d0 tx=0x7f2bb4008040 comp rx=0 tx=0).stop 2024-04-25T10:05:35.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 msgr2=0x7f2bc815ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00c480 tx=0x7f2bbc00c940 comp rx=0 tx=0).stop 2024-04-25T10:05:35.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 shutdown_connections 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ba8066f60 0x7f2ba8069420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2bc815fe50 0x7f2bc81f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bc8145270 0x7f2bc80af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 --2- 172.21.15.18:0/2731474528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2bc80b1c90 0x7f2bc815ac40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 >> 172.21.15.18:0/2731474528 conn(0x7f2bc8066fa0 msgr2=0x7f2bc80736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 shutdown_connections 2024-04-25T10:05:35.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.048+0000 7f2bd0000640 1 -- 172.21.15.18:0/2731474528 wait complete. 2024-04-25T10:05:35.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.212+0000 7f9934a00640 1 Processor -- start 2024-04-25T10:05:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.212+0000 7f9934a00640 1 -- start start 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9934a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f993015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9934a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99300cf370 0x7f9930099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9934a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993015c310 con 0x7f993009a600 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9934a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99300d0410 con 0x7f99300cf370 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9934a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993009a380 con 0x7f9930099a60 2024-04-25T10:05:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99300cf370 0x7f9930099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99300cf370 0x7f9930099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52850/0 (socket says 172.21.15.18:52850) 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 -- 172.21.15.18:0/2289311849 learned_addr learned my addr 172.21.15.18:0/2289311849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f992de00640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f993015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 -- 172.21.15.18:0/2289311849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 msgr2=0x7f993015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f993015bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 -- 172.21.15.18:0/2289311849 >> v1:172.21.15.167:6789/0 conn(0x7f993009a600 legacy=0x7f993015f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:35.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 -- 172.21.15.18:0/2289311849 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300cf800 con 0x7f99300cf370 2024-04-25T10:05:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f9925400640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99300cf370 0x7f9930099e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f991801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5931278bf1d6cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.216+0000 7f992d400640 1 -- 172.21.15.18:0/2289311849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180b1070 con 0x7f99300cf370 2024-04-25T10:05:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f992d400640 1 -- 172.21.15.18:0/2289311849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99180ac410 con 0x7f99300cf370 2024-04-25T10:05:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f992d400640 1 -- 172.21.15.18:0/2289311849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180ac7e0 con 0x7f99300cf370 2024-04-25T10:05:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- 172.21.15.18:0/2289311849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99300cf370 msgr2=0x7f9930099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99300cf370 0x7f9930099e40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9918009870 tx=0x7f991801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- 172.21.15.18:0/2289311849 shutdown_connections 2024-04-25T10:05:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99300cf370 0x7f9930099e40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- 172.21.15.18:0/2289311849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f993015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- 172.21.15.18:0/2289311849 >> 172.21.15.18:0/2289311849 conn(0x7f99300d17a0 msgr2=0x7f99300d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- 172.21.15.18:0/2289311849 shutdown_connections 2024-04-25T10:05:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- 172.21.15.18:0/2289311849 wait complete. 2024-04-25T10:05:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 Processor -- start 2024-04-25T10:05:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- start start 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f9930165310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930151af0 0x7f9930159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99301689d0 con 0x7f993009a600 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9930168850 con 0x7f9930151af0 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9934a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9930168b50 con 0x7f9930099a60 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52862/0 (socket says 172.21.15.18:52862) 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 -- 172.21.15.18:0/2151212314 learned_addr learned my addr 172.21.15.18:0/2151212314 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f992e800640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930151af0 0x7f9930159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f992de00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f9930165310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 -- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 msgr2=0x7f9930165310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f9930165310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 -- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930151af0 msgr2=0x7f9930159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930151af0 0x7f9930159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.220+0000 7f9925400640 1 -- 172.21.15.18:0/2151212314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99300cf1a0 con 0x7f993009a600 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9925400640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f99180af040 tx=0x7f9918019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180bc070 con 0x7f993009a600 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99180ace40 con 0x7f993009a600 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9930165eb0 con 0x7f993009a600 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180b1070 con 0x7f993009a600 2024-04-25T10:05:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993013e900 con 0x7f993009a600 2024-04-25T10:05:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99300745d0 con 0x7f993009a600 2024-04-25T10:05:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99180bf070 con 0x7f993009a600 2024-04-25T10:05:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 0x7f990c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f991811eba0 con 0x7f993009a600 2024-04-25T10:05:35.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.224+0000 7f992de00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 0x7f990c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.228+0000 7f992de00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 0x7f990c069450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9920003fd0 tx=0x7f99200039c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.228+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9918016150 con 0x7f993009a600 2024-04-25T10:05:35.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.392+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99300d2620 con 0x7f993009a600 2024-04-25T10:05:35.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.392+0000 7f9926a00640 1 -- 172.21.15.18:0/2151212314 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16918 (secure 0 0 0) 0x7f99180ef980 con 0x7f993009a600 2024-04-25T10:05:35.404 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:35.405 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":41,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:12.080575+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:35.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 msgr2=0x7f990c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 0x7f990c069450 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9920003fd0 tx=0x7f99200039c0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 msgr2=0x7f9930165850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f99180af040 tx=0x7f9918019240 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 shutdown_connections 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9930151af0 0x7f9930159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f993009a600 0x7f9930165850 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f990c066f90 0x7f990c069450 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 --2- 172.21.15.18:0/2151212314 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9930099a60 0x7f9930165310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 >> 172.21.15.18:0/2151212314 conn(0x7f99300d17a0 msgr2=0x7f99300b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 shutdown_connections 2024-04-25T10:05:35.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.396+0000 7f9934a00640 1 -- 172.21.15.18:0/2151212314 wait complete. 2024-04-25T10:05:35.426 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:05:35.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 Processor -- start 2024-04-25T10:05:35.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 -- start start 2024-04-25T10:05:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f317015fe50 0x7f31700b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31700b20a0 con 0x7f31700b1c90 2024-04-25T10:05:35.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31700cc4e0 con 0x7f3170145270 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3177a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3170145650 con 0x7f317015fe50 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3167e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f317015fe50 0x7f31700b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3175a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f31700b1c90 0x7f317015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55950/0 (socket says 172.21.15.18:55950) 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.556+0000 7f3175a00640 1 -- 172.21.15.18:0/2516263490 learned_addr learned my addr 172.21.15.18:0/2516263490 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3167e00640 1 -- 172.21.15.18:0/2516263490 >> v1:172.21.15.167:6789/0 conn(0x7f3170145270 legacy=0x7f31700cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3167e00640 1 -- 172.21.15.18:0/2516263490 >> v1:172.21.15.18:6789/0 conn(0x7f31700b1c90 legacy=0x7f317015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3167e00640 1 -- 172.21.15.18:0/2516263490 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700ce040 con 0x7f317015fe50 2024-04-25T10:05:35.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3167e00640 1 --2- 172.21.15.18:0/2516263490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317015fe50 0x7f31700b1750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f31580097c0 tx=0x7f315801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3eac290836feb31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f316fe00640 1 -- 172.21.15.18:0/2516263490 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580b1070 con 0x7f317015fe50 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f316fe00640 1 -- 172.21.15.18:0/2516263490 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580ac5f0 con 0x7f317015fe50 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f316fe00640 1 -- 172.21.15.18:0/2516263490 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580ac9c0 con 0x7f317015fe50 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 -- 172.21.15.18:0/2516263490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317015fe50 msgr2=0x7f31700b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 --2- 172.21.15.18:0/2516263490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317015fe50 0x7f31700b1750 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f31580097c0 tx=0x7f315801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 -- 172.21.15.18:0/2516263490 shutdown_connections 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 --2- 172.21.15.18:0/2516263490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f317015fe50 0x7f31700b1750 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 -- 172.21.15.18:0/2516263490 >> 172.21.15.18:0/2516263490 conn(0x7f3170066fa0 msgr2=0x7f317006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 -- 172.21.15.18:0/2516263490 shutdown_connections 2024-04-25T10:05:35.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.560+0000 7f3177a00640 1 -- 172.21.15.18:0/2516263490 wait complete. 2024-04-25T10:05:35.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 Processor -- start 2024-04-25T10:05:35.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- start start 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 0x7f317013eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 0x7f3170139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700cdbe0 con 0x7f3170145270 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317015f930 con 0x7f317015fe50 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31700cdd60 con 0x7f31700b1c90 2024-04-25T10:05:35.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52876/0 (socket says 172.21.15.18:52876) 2024-04-25T10:05:35.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 -- 172.21.15.18:0/1240897936 learned_addr learned my addr 172.21.15.18:0/1240897936 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:35.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3175000640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 0x7f317013eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 -- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 msgr2=0x7f317013eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3175a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 0x7f3170139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 0x7f317013eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 -- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 msgr2=0x7f3170139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 0x7f3170139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 -- 172.21.15.18:0/1240897936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31700b03b0 con 0x7f3170145270 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3175000640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 0x7f317013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3175a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 0x7f3170139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3167e00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f315801a0d0 tx=0x7f3158019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580b1040 con 0x7f3170145270 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31580ba070 con 0x7f3170145270 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31580b5870 con 0x7f3170145270 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31700b0690 con 0x7f3170145270 2024-04-25T10:05:35.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.564+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31700b0c50 con 0x7f3170145270 2024-04-25T10:05:35.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31700745d0 con 0x7f3170145270 2024-04-25T10:05:35.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31580ac4b0 con 0x7f3170145270 2024-04-25T10:05:35.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f316d600640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 0x7f314c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f315811ef40 con 0x7f3170145270 2024-04-25T10:05:35.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f3175000640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 0x7f314c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.568+0000 7f3175000640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 0x7f314c069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31600016f0 tx=0x7f3160009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.572+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31580a9070 con 0x7f3170145270 2024-04-25T10:05:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f317006b8e0 con 0x7f3170145270 2024-04-25T10:05:35.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f316d600640 1 -- 172.21.15.18:0/1240897936 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f3158016090 con 0x7f3170145270 2024-04-25T10:05:35.778 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:35.778 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:35.778 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 msgr2=0x7f314c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 0x7f314c069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f31600016f0 tx=0x7f3160009040 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 msgr2=0x7f31700af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f315801a0d0 tx=0x7f3158019240 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 shutdown_connections 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f317015fe50 0x7f3170139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3170145270 0x7f31700af9c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f314c066f60 0x7f314c069420 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 --2- 172.21.15.18:0/1240897936 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31700b1c90 0x7f317013eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 >> 172.21.15.18:0/1240897936 conn(0x7f3170066fa0 msgr2=0x7f317013cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 shutdown_connections 2024-04-25T10:05:35.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.768+0000 7f3177a00640 1 -- 172.21.15.18:0/1240897936 wait complete. 2024-04-25T10:05:35.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:35.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.928+0000 7fa5aaa00640 1 Processor -- start 2024-04-25T10:05:35.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.928+0000 7fa5aaa00640 1 -- start start 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5aaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5a40cef30 0x7fa5a406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5aaa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a415ac60 con 0x7fa5a406e900 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5aaa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a40cf3e0 con 0x7fa5a4144140 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5aaa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a406ed50 con 0x7fa5a40cef30 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa59be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5a40cef30 0x7fa5a406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5a8a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa5a406e900 0x7fa5a40b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55956/0 (socket says 172.21.15.18:55956) 2024-04-25T10:05:35.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5a8a00640 1 -- 172.21.15.18:0/3978665048 learned_addr learned my addr 172.21.15.18:0/3978665048 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa59be00640 1 -- 172.21.15.18:0/3978665048 >> v1:172.21.15.167:6789/0 conn(0x7fa5a4144140 legacy=0x7fa5a40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa59be00640 1 -- 172.21.15.18:0/3978665048 >> v1:172.21.15.18:6789/0 conn(0x7fa5a406e900 legacy=0x7fa5a40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa5a3400640 1 -- 172.21.15.18:0/3978665048 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721529524 0 0) 0x7fa5a415ac60 con 0x7fa5a406e900 2024-04-25T10:05:35.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.932+0000 7fa59be00640 1 -- 172.21.15.18:0/3978665048 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a415af20 con 0x7fa5a40cef30 2024-04-25T10:05:35.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa59be00640 1 --2- 172.21.15.18:0/3978665048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a40cef30 0x7fa5a406e3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0097c0 tx=0x7fa58c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2712f275fdc50ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5a3400640 1 -- 172.21.15.18:0/3978665048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0b1070 con 0x7fa5a40cef30 2024-04-25T10:05:35.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5a3400640 1 -- 172.21.15.18:0/3978665048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c0ac3f0 con 0x7fa5a40cef30 2024-04-25T10:05:35.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5a3400640 1 -- 172.21.15.18:0/3978665048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0ac7c0 con 0x7fa5a40cef30 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- 172.21.15.18:0/3978665048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a40cef30 msgr2=0x7fa5a406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/3978665048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a40cef30 0x7fa5a406e3c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa58c0097c0 tx=0x7fa58c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- 172.21.15.18:0/3978665048 shutdown_connections 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/3978665048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a40cef30 0x7fa5a406e3c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- 172.21.15.18:0/3978665048 >> 172.21.15.18:0/3978665048 conn(0x7fa5a4066fa0 msgr2=0x7fa5a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- 172.21.15.18:0/3978665048 shutdown_connections 2024-04-25T10:05:35.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- 172.21.15.18:0/3978665048 wait complete. 2024-04-25T10:05:35.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 Processor -- start 2024-04-25T10:05:35.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- start start 2024-04-25T10:05:35.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a406e900 0x7fa5a4143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a40cef30 0x7fa5a40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a415ba00 con 0x7fa5a4144140 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4144520 con 0x7fa5a40cef30 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5aaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a415bb80 con 0x7fa5a406e900 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.936+0000 7fa5a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52896/0 (socket says 172.21.15.18:52896) 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 -- 172.21.15.18:0/2648580442 learned_addr learned my addr 172.21.15.18:0/2648580442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa59be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a40cef30 0x7fa5a40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a3e00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a406e900 0x7fa5a4143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 -- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a406e900 msgr2=0x7fa5a4143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a406e900 0x7fa5a4143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 -- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a40cef30 msgr2=0x7fa5a40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a40cef30 0x7fa5a40b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:35.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 -- 172.21.15.18:0/2648580442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4132ea0 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a8a00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00c7d0 tx=0x7fa59c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c018070 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c00a640 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c00aa70 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a40b46f0 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a40b4410 con 0x7fa5a4144140 2024-04-25T10:05:35.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a40745d0 con 0x7fa5a4144140 2024-04-25T10:05:35.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa59c01b070 con 0x7fa5a4144140 2024-04-25T10:05:35.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.940+0000 7fa5a0c00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 0x7fa580069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:35.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.944+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa59c084640 con 0x7fa5a4144140 2024-04-25T10:05:35.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.944+0000 7fa5a3e00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 0x7fa580069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:35.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.944+0000 7fa5a3e00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 0x7fa580069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5a415a3b0 tx=0x7fa594009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:35.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:35.944+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa59c054f00 con 0x7fa5a4144140 2024-04-25T10:05:36.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5a415ac60 con 0x7fa5a4144140 2024-04-25T10:05:36.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5a0c00640 1 -- 172.21.15.18:0/2648580442 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa59c058fa0 con 0x7fa5a4144140 2024-04-25T10:05:36.154 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:36.154 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:10.466571+0000","modified":"2024-04-25T10:05:13.486260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34901},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34901":{"gid":34901,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/978423196","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":978423196},{"type":"v1","addr":"172.21.15.167:6836","nonce":978423196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T10:05:36.155 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 18 2024-04-25T10:05:36.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 msgr2=0x7fa580069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 0x7fa580069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5a415a3b0 tx=0x7fa594009040 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 msgr2=0x7fa5a406da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa59c00c7d0 tx=0x7fa59c00cc90 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 shutdown_connections 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5a4144140 0x7fa5a406da20 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5a40cef30 0x7fa5a40b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa580066f60 0x7fa580069420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 --2- 172.21.15.18:0/2648580442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5a406e900 0x7fa5a4143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 >> 172.21.15.18:0/2648580442 conn(0x7fa5a4066fa0 msgr2=0x7fa5a40b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 shutdown_connections 2024-04-25T10:05:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.144+0000 7fa5aaa00640 1 -- 172.21.15.18:0/2648580442 wait complete. 2024-04-25T10:05:36.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:36.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 Processor -- start 2024-04-25T10:05:36.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 -- start start 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 0x7f7dd406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dd409dc30 0x7f7dd40cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd406d960 con 0x7f7dd40af500 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd40ce520 con 0x7f7dd409dc30 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd3200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd406c540 con 0x7f7dd406bc20 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dd409dc30 0x7f7dd40cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dd409dc30 0x7f7dd40cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52906/0 (socket says 172.21.15.18:52906) 2024-04-25T10:05:36.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 -- 172.21.15.18:0/3533800582 learned_addr learned my addr 172.21.15.18:0/3533800582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 -- 172.21.15.18:0/3533800582 >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 msgr2=0x7f7dd406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd1e00640 1 --2- 172.21.15.18:0/3533800582 >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 0x7f7dd406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 --2- 172.21.15.18:0/3533800582 >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 0x7f7dd406c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 -- 172.21.15.18:0/3533800582 >> v1:172.21.15.167:6789/0 conn(0x7f7dd40af500 legacy=0x7f7dd40ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:36.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd2800640 1 -- 172.21.15.18:0/3533800582 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd406dc00 con 0x7f7dd409dc30 2024-04-25T10:05:36.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.308+0000 7f7dd1e00640 1 --2- 172.21.15.18:0/3533800582 >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 0x7f7dd406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd2800640 1 --2- 172.21.15.18:0/3533800582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd409dc30 0x7f7dd40cf0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406ea20 tx=0x7f7dcc01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11316d804352bbef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd1400640 1 -- 172.21.15.18:0/3533800582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a5670 con 0x7f7dd409dc30 2024-04-25T10:05:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd1400640 1 -- 172.21.15.18:0/3533800582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0a5810 con 0x7f7dd409dc30 2024-04-25T10:05:36.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd1400640 1 -- 172.21.15.18:0/3533800582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0a5be0 con 0x7f7dd409dc30 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 -- 172.21.15.18:0/3533800582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd409dc30 msgr2=0x7f7dd40cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 --2- 172.21.15.18:0/3533800582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd409dc30 0x7f7dd40cf0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7dd406ea20 tx=0x7f7dcc01c9b0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 -- 172.21.15.18:0/3533800582 shutdown_connections 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 --2- 172.21.15.18:0/3533800582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd409dc30 0x7f7dd40cf0c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 --2- 172.21.15.18:0/3533800582 >> v2:172.21.15.167:3300/0 conn(0x7f7dd406bc20 0x7f7dd406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 -- 172.21.15.18:0/3533800582 >> 172.21.15.18:0/3533800582 conn(0x7f7dd40cd560 msgr2=0x7f7dd4071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 -- 172.21.15.18:0/3533800582 shutdown_connections 2024-04-25T10:05:36.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.312+0000 7f7dd3200640 1 -- 172.21.15.18:0/3533800582 wait complete. 2024-04-25T10:05:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 Processor -- start 2024-04-25T10:05:36.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- start start 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dd406bc20 0x7f7dd40b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dd409dc30 0x7f7dd413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415ba20 con 0x7f7dd40af500 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd40acda0 con 0x7f7dd409dc30 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd415bba0 con 0x7f7dd406bc20 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52908/0 (socket says 172.21.15.18:52908) 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 -- 172.21.15.18:0/2770819465 learned_addr learned my addr 172.21.15.18:0/2770819465 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dcbe00640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dd409dc30 0x7f7dd413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd1e00640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dd406bc20 0x7f7dd40b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 -- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dd406bc20 msgr2=0x7f7dd40b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dd406bc20 0x7f7dd40b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 -- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dd409dc30 msgr2=0x7f7dd413de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dd409dc30 0x7f7dd413de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 -- 172.21.15.18:0/2770819465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd4163bf0 con 0x7f7dd40af500 2024-04-25T10:05:36.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd2800640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0af040 tx=0x7f7dcc019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b8670 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dcc0be070 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dcc0b8a70 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd4163ed0 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd4164490 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.316+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd404efa0 con 0x7f7dd40af500 2024-04-25T10:05:36.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.320+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7dcc0b8c10 con 0x7f7dd40af500 2024-04-25T10:05:36.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.320+0000 7f7dca000640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 0x7f7db0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.320+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7dcc1201f0 con 0x7f7dd40af500 2024-04-25T10:05:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.320+0000 7f7dd1e00640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 0x7f7db0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.320+0000 7f7dd1e00640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 0x7f7db0069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.324+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7dcc0165a0 con 0x7f7dd40af500 2024-04-25T10:05:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.484+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7dd4071bd0 con 0x7f7dd40af500 2024-04-25T10:05:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dca000640 1 -- 172.21.15.18:0/2770819465 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16911 (secure 0 0 0) 0x7f7dcc0a57e0 con 0x7f7dd40af500 2024-04-25T10:05:36.497 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:36.497 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:36.161262+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:08.290854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:09.472259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.19","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 msgr2=0x7f7db0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 0x7f7db0069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4006fd0 tx=0x7f7dc4008040 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 msgr2=0x7f7dd4164c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc0af040 tx=0x7f7dcc019750 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 shutdown_connections 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dd40af500 0x7f7dd4164c90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dd409dc30 0x7f7dd413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7db0066f60 0x7f7db0069420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 --2- 172.21.15.18:0/2770819465 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dd406bc20 0x7f7dd40b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 >> 172.21.15.18:0/2770819465 conn(0x7f7dd40cd560 msgr2=0x7f7dd40ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 shutdown_connections 2024-04-25T10:05:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.488+0000 7f7dd3200640 1 -- 172.21.15.18:0/2770819465 wait complete. 2024-04-25T10:05:36.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:05:36.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.652+0000 7f3679000640 1 Processor -- start 2024-04-25T10:05:36.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.652+0000 7f3679000640 1 -- start start 2024-04-25T10:05:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3679000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3674144120 0x7f367415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3679000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36740ccbf0 0x7f367415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3679000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367415bc40 con 0x7f367415ee60 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3679000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367415e490 con 0x7f36740ccbf0 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3679000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367415b3a0 con 0x7f3674144120 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36740ccbf0 0x7f367415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36740ccbf0 0x7f367415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52916/0 (socket says 172.21.15.18:52916) 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 -- 172.21.15.18:0/2605234982 learned_addr learned my addr 172.21.15.18:0/2605234982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3672800640 1 --1- 172.21.15.18:0/2605234982 >> v1:172.21.15.18:6789/0 conn(0x7f367415ee60 0x7f36740b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55966/0 (socket says 172.21.15.18:55966) 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3671e00640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3674144120 0x7f367415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 -- 172.21.15.18:0/2605234982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3674144120 msgr2=0x7f367415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3674144120 0x7f367415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 -- 172.21.15.18:0/2605234982 >> v1:172.21.15.18:6789/0 conn(0x7f367415ee60 legacy=0x7f36740b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 -- 172.21.15.18:0/2605234982 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367415b680 con 0x7f36740ccbf0 2024-04-25T10:05:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.656+0000 7f3669400640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367415e920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f365c009870 tx=0x7f365c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9564c5c1c1e729 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671400640 1 -- 172.21.15.18:0/2605234982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0b0070 con 0x7f36740ccbf0 2024-04-25T10:05:36.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671400640 1 -- 172.21.15.18:0/2605234982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c0ab600 con 0x7f36740ccbf0 2024-04-25T10:05:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671400640 1 -- 172.21.15.18:0/2605234982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c0ab9d0 con 0x7f36740ccbf0 2024-04-25T10:05:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- 172.21.15.18:0/2605234982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 msgr2=0x7f367415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367415e920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f365c009870 tx=0x7f365c01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- 172.21.15.18:0/2605234982 shutdown_connections 2024-04-25T10:05:36.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367415e920 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- 172.21.15.18:0/2605234982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3674144120 0x7f367415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- 172.21.15.18:0/2605234982 >> 172.21.15.18:0/2605234982 conn(0x7f3674067080 msgr2=0x7f367406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- 172.21.15.18:0/2605234982 shutdown_connections 2024-04-25T10:05:36.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- 172.21.15.18:0/2605234982 wait complete. 2024-04-25T10:05:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 Processor -- start 2024-04-25T10:05:36.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- start start 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3674144120 0x7f36740ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 0x7f36740adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36741675c0 con 0x7f36740ccbf0 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3674167440 con 0x7f3674144120 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3679000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3674167740 con 0x7f367415ee60 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52922/0 (socket says 172.21.15.18:52922) 2024-04-25T10:05:36.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3671e00640 1 -- 172.21.15.18:0/2371139636 learned_addr learned my addr 172.21.15.18:0/2371139636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3672800640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 0x7f36740adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.660+0000 7f3669400640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3674144120 0x7f36740ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 -- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 msgr2=0x7f36740adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 0x7f36740adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 -- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3674144120 msgr2=0x7f36740ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3674144120 0x7f36740ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 -- 172.21.15.18:0/2371139636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36740b0160 con 0x7f36740ccbf0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3672800640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 0x7f36740adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3671e00640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f366400d800 tx=0x7f366400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400b6c0 con 0x7f36740ccbf0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664019070 con 0x7f36740ccbf0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400ba60 con 0x7f36740ccbf0 2024-04-25T10:05:36.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36740b0400 con 0x7f36740ccbf0 2024-04-25T10:05:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36740b09c0 con 0x7f36740ccbf0 2024-04-25T10:05:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36740745d0 con 0x7f36740ccbf0 2024-04-25T10:05:36.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.664+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f366400bc00 con 0x7f36740ccbf0 2024-04-25T10:05:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.668+0000 7f366aa00640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 0x7f3650069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:36.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.668+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f36640855f0 con 0x7f36740ccbf0 2024-04-25T10:05:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.668+0000 7f3669400640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 0x7f3650069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:36.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.668+0000 7f3669400640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 0x7f3650069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f365c0ad000 tx=0x7f365c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:36.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.672+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f36640564e0 con 0x7f36740ccbf0 2024-04-25T10:05:36.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.868+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f367406c250 con 0x7f36740ccbf0 2024-04-25T10:05:36.879 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:05:36.868+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:05:36.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f366aa00640 1 -- 172.21.15.18:0/2371139636 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3664055de0 con 0x7f36740ccbf0 2024-04-25T10:05:36.881 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:05:36.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 msgr2=0x7f3650069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 0x7f3650069420 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f365c0ad000 tx=0x7f365c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:36.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 msgr2=0x7f367413fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:36.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f366400d800 tx=0x7f366400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 shutdown_connections 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3650066f60 0x7f3650069420 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f367415ee60 0x7f36740adf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3674144120 0x7f36740ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 --2- 172.21.15.18:0/2371139636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36740ccbf0 0x7f367413fe30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 >> 172.21.15.18:0/2371139636 conn(0x7f3674067080 msgr2=0x7f36740b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 shutdown_connections 2024-04-25T10:05:36.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:36.872+0000 7f3679000640 1 -- 172.21.15.18:0/2371139636 wait complete. 2024-04-25T10:05:36.896 INFO:tasks.ceph.mds.b.smithi167.stderr: -6451> 2024-04-25T10:05:15.046+0000 7efef1800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:05:36.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:05:36.948 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:05:37.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 Processor -- start 2024-04-25T10:05:37.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 -- start start 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8b415acd0 0x7fb8b415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 0x7fb8b40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b415bc40 con 0x7fb8b4144120 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b415e490 con 0x7fb8b415acd0 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b9e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b415b150 con 0x7fb8b415ee60 2024-04-25T10:05:37.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8b415acd0 0x7fb8b415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8b415acd0 0x7fb8b415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52934/0 (socket says 172.21.15.18:52934) 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 -- 172.21.15.18:0/2562969761 learned_addr learned my addr 172.21.15.18:0/2562969761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b3400640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 0x7fb8b40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 -- 172.21.15.18:0/2562969761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 msgr2=0x7fb8b40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 0x7fb8b40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 -- 172.21.15.18:0/2562969761 >> v1:172.21.15.167:6789/0 conn(0x7fb8b4144120 legacy=0x7fb8b40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8abe00640 1 -- 172.21.15.18:0/2562969761 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b415b3a0 con 0x7fb8b415acd0 2024-04-25T10:05:37.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.040+0000 7fb8b3400640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 0x7fb8b40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8abe00640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b415acd0 0x7fb8b415e920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a045e544188de44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b2000640 1 -- 172.21.15.18:0/2562969761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0b1070 con 0x7fb8b415acd0 2024-04-25T10:05:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b2000640 1 -- 172.21.15.18:0/2562969761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c0a8050 con 0x7fb8b415acd0 2024-04-25T10:05:37.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b2000640 1 -- 172.21.15.18:0/2562969761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0ac860 con 0x7fb8b415acd0 2024-04-25T10:05:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 -- 172.21.15.18:0/2562969761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b415acd0 msgr2=0x7fb8b415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b415acd0 0x7fb8b415e920 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009870 tx=0x7fb89c01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 -- 172.21.15.18:0/2562969761 shutdown_connections 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415ee60 0x7fb8b40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/2562969761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b415acd0 0x7fb8b415e920 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 -- 172.21.15.18:0/2562969761 >> 172.21.15.18:0/2562969761 conn(0x7fb8b4067080 msgr2=0x7fb8b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 -- 172.21.15.18:0/2562969761 shutdown_connections 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.044+0000 7fb8b9e00640 1 -- 172.21.15.18:0/2562969761 wait complete. 2024-04-25T10:05:37.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 Processor -- start 2024-04-25T10:05:37.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- start start 2024-04-25T10:05:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 0x7fb8b4162560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8b415ee60 0x7fb8b40b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b41677d0 con 0x7fb8b4144120 2024-04-25T10:05:37.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4167650 con 0x7fb8b415ee60 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b4167950 con 0x7fb8b415acd0 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52950/0 (socket says 172.21.15.18:52950) 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 -- 172.21.15.18:0/1556654555 learned_addr learned my addr 172.21.15.18:0/1556654555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b3400640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8b415ee60 0x7fb8b40b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8abe00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 0x7fb8b4162560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 -- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 msgr2=0x7fb8b4162560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 0x7fb8b4162560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 -- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8b415ee60 msgr2=0x7fb8b40b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8b415ee60 0x7fb8b40b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 -- 172.21.15.18:0/1556654555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b40cc870 con 0x7fb8b4144120 2024-04-25T10:05:37.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8abe00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 0x7fb8b4162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b2a00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c420 tx=0x7fb8a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a40052d0 con 0x7fb8b4144120 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4005470 con 0x7fb8b4144120 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b415f510 con 0x7fb8b4144120 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4007260 con 0x7fb8b4144120 2024-04-25T10:05:37.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b415fa90 con 0x7fb8b4144120 2024-04-25T10:05:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.048+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b41601a0 con 0x7fb8b4144120 2024-04-25T10:05:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.052+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8a4007400 con 0x7fb8b4144120 2024-04-25T10:05:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.052+0000 7fb8ab400640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 0x7fb890069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:37.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.052+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6216+0+0 (secure 0 0 0) 0x7fb8a40845f0 con 0x7fb8b4144120 2024-04-25T10:05:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.052+0000 7fb8abe00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 0x7fb890069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:37.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.052+0000 7fb8abe00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 0x7fb890069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0ae000 tx=0x7fb89c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:37.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.056+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8a4054e40 con 0x7fb8b4144120 2024-04-25T10:05:37.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.252+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb8b413fb40 con 0x7fb8b4144120 2024-04-25T10:05:37.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.872+0000 7fb8ab400640 1 -- 172.21.15.18:0/1556654555 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb8a4058ee0 con 0x7fb8b4144120 2024-04-25T10:05:37.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 msgr2=0x7fb890069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 0x7fb890069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0ae000 tx=0x7fb89c008040 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 msgr2=0x7fb8b413f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c420 tx=0x7fb8a400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 shutdown_connections 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8b415ee60 0x7fb8b40b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb890066f60 0x7fb890069420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8b415acd0 0x7fb8b4162560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 --2- 172.21.15.18:0/1556654555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8b4144120 0x7fb8b413f600 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 >> 172.21.15.18:0/1556654555 conn(0x7fb8b4067080 msgr2=0x7fb8b415db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 shutdown_connections 2024-04-25T10:05:37.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:37.876+0000 7fb8b9e00640 1 -- 172.21.15.18:0/1556654555 wait complete. 2024-04-25T10:05:37.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:05:38.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 Processor -- start 2024-04-25T10:05:38.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 -- start start 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1fc099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1fc0cf640 0x7ff1fc0cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1fc09a380 con 0x7ff1fc09a810 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1fc15e180 con 0x7ff1fc0cf640 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15e460 con 0x7ff1fc099a60 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff1fc09a810 0x7ff1fc06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55968/0 (socket says 172.21.15.18:55968) 2024-04-25T10:05:38.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fbe00640 1 -- 172.21.15.18:0/2630000985 learned_addr learned my addr 172.21.15.18:0/2630000985 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:38.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1fc099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927272914 0 0) 0x7ff1fc09a380 con 0x7ff1fc09a810 2024-04-25T10:05:38.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e4003530 con 0x7ff1fc09a810 2024-04-25T10:05:38.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201400640 1 --2- 172.21.15.18:0/2630000985 >> v2:172.21.15.167:3300/0 conn(0x7ff1fc0cf640 0x7ff1fc0cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639414149 0 0) 0x7ff1e4003530 con 0x7ff1fc09a810 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 msgr2=0x7ff1fc099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1fc099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 >> v2:172.21.15.167:3300/0 conn(0x7ff1fc0cf640 msgr2=0x7ff1fc0cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 --2- 172.21.15.18:0/2630000985 >> v2:172.21.15.167:3300/0 conn(0x7ff1fc0cf640 0x7ff1fc0cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc15e740 con 0x7ff1fc09a810 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff1e8001680 con 0x7ff1fc09a810 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 >> v1:172.21.15.18:6789/0 conn(0x7ff1fc09a810 legacy=0x7ff1fc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1e40039c0 0x7ff1e4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e4004810 0x7ff1e4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15e180 con 0x7ff1e40039c0 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc15e460 con 0x7ff1e4004810 2024-04-25T10:05:38.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e400b9d0 con 0x7ff1fc099a60 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201400640 1 --2- 172.21.15.18:0/2630000985 >> v2:172.21.15.167:3300/0 conn(0x7ff1fc0cf640 0x7ff1fc0cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1e40039c0 0x7ff1e4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff1fbe00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e4004810 0x7ff1e4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff201400640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 -- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 msgr2=0x7ff1e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc099a60 0x7ff1e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 -- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e4004810 msgr2=0x7ff1e4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e4004810 0x7ff1e4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.048+0000 7ff200a00640 1 -- 172.21.15.18:0/2630000985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4003530 con 0x7ff1e40039c0 2024-04-25T10:05:38.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff200a00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1e40039c0 0x7ff1e4003de0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009ae0 tx=0x7ff1f001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bae9b5b9a2c839 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:38.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00096b0 con 0x7ff1e40039c0 2024-04-25T10:05:38.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00a9470 con 0x7ff1e40039c0 2024-04-25T10:05:38.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff1fb400640 1 -- 172.21.15.18:0/2630000985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f00a9860 con 0x7ff1e40039c0 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 -- 172.21.15.18:0/2630000985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1e40039c0 msgr2=0x7ff1e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 --2- 172.21.15.18:0/2630000985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1e40039c0 0x7ff1e4003de0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0009ae0 tx=0x7ff1f001ca70 comp rx=0 tx=0).stop 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201400640 1 -- 172.21.15.18:0/2630000985 reap_dead start 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 -- 172.21.15.18:0/2630000985 shutdown_connections 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 -- 172.21.15.18:0/2630000985 >> 172.21.15.18:0/2630000985 conn(0x7ff1fc0d15b0 msgr2=0x7ff1fc0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 -- 172.21.15.18:0/2630000985 shutdown_connections 2024-04-25T10:05:38.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.052+0000 7ff201e00640 1 -- 172.21.15.18:0/2630000985 wait complete. 2024-04-25T10:05:38.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 Processor -- start 2024-04-25T10:05:38.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- start start 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e40039c0 0x7ff1fc157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc0cdaf0 0x7ff1fc06fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc168930 con 0x7ff1fc0cd670 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc1687b0 con 0x7ff1e40039c0 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1fc168ab0 con 0x7ff1fc0cdaf0 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52956/0 (socket says 172.21.15.18:52956) 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 -- 172.21.15.18:0/223766570 learned_addr learned my addr 172.21.15.18:0/223766570 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201400640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc0cdaf0 0x7ff1fc06fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff200a00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e40039c0 0x7ff1fc157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 -- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc0cdaf0 msgr2=0x7ff1fc06fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc0cdaf0 0x7ff1fc06fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 -- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e40039c0 msgr2=0x7ff1fc157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e40039c0 0x7ff1fc157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 -- 172.21.15.18:0/223766570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1fc0c5e40 con 0x7ff1fc0cd670 2024-04-25T10:05:38.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1fbe00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e7b0 tx=0x7ff1e800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:38.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800c660 con 0x7ff1fc0cd670 2024-04-25T10:05:38.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e8018070 con 0x7ff1fc0cd670 2024-04-25T10:05:38.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1fc0c6120 con 0x7ff1fc0cd670 2024-04-25T10:05:38.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e800ca40 con 0x7ff1fc0cd670 2024-04-25T10:05:38.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.056+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1fc0c66e0 con 0x7ff1fc0cd670 2024-04-25T10:05:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1fc0745d0 con 0x7ff1fc0cd670 2024-04-25T10:05:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff1e800cbe0 con 0x7ff1fc0cd670 2024-04-25T10:05:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff1f8c00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6216+0+0 (secure 0 0 0) 0x7ff1e8085130 con 0x7ff1fc0cd670 2024-04-25T10:05:38.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff200a00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:38.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.060+0000 7ff200a00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 0x7ff1dc069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ae000 tx=0x7ff1f00b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:38.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.064+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1e8055ea0 con 0x7ff1fc0cd670 2024-04-25T10:05:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:38.232+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff1fc168590 con 0x7ff1fc0cd670 2024-04-25T10:05:39.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.176+0000 7ff1f8c00640 1 -- 172.21.15.18:0/223766570 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff1e80557a0 con 0x7ff1fc0cd670 2024-04-25T10:05:39.186 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:05:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.176+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 msgr2=0x7ff1dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.176+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 0x7ff1dc069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00ae000 tx=0x7ff1f00b3040 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.176+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 msgr2=0x7ff1fc06f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.176+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e7b0 tx=0x7ff1e800ebb0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 shutdown_connections 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1fc0cdaf0 0x7ff1fc06fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1fc0cd670 0x7ff1fc06f9b0 secure :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff1e800e7b0 tx=0x7ff1e800ebb0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 --2- 172.21.15.18:0/223766570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1e40039c0 0x7ff1fc157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 >> 172.21.15.18:0/223766570 conn(0x7ff1fc0d15b0 msgr2=0x7ff1fc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:39.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 shutdown_connections 2024-04-25T10:05:39.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.180+0000 7ff201e00640 1 -- 172.21.15.18:0/223766570 wait complete. 2024-04-25T10:05:39.214 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:05:39.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 Processor -- start 2024-04-25T10:05:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 -- start start 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02c8144080 0x7f02c80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c8071e40 0x7f02c80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c80cf490 con 0x7f02c806e3c0 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c80719b0 con 0x7f02c8144080 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02d0600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80cf1b0 con 0x7f02c8071e40 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02cdc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02c8144080 0x7f02c80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02ce600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f02c806e3c0 0x7f02c80b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55982/0 (socket says 172.21.15.18:55982) 2024-04-25T10:05:39.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02ce600640 1 -- 172.21.15.18:0/1852329697 learned_addr learned my addr 172.21.15.18:0/1852329697 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.352+0000 7f02cd200640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c8071e40 0x7f02c80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02cdc00640 1 -- 172.21.15.18:0/1852329697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c8071e40 msgr2=0x7f02c80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02cdc00640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c8071e40 0x7f02c80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02cdc00640 1 -- 172.21.15.18:0/1852329697 >> v1:172.21.15.18:6789/0 conn(0x7f02c806e3c0 legacy=0x7f02c80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02cdc00640 1 -- 172.21.15.18:0/1852329697 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c8071360 con 0x7f02c8144080 2024-04-25T10:05:39.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02cdc00640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c80ce660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0097c0 tx=0x7f02bc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab0ed2be082c1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02c7e00640 1 -- 172.21.15.18:0/1852329697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0ab650 con 0x7f02c8144080 2024-04-25T10:05:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02c7e00640 1 -- 172.21.15.18:0/1852329697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc0b0070 con 0x7f02c8144080 2024-04-25T10:05:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02c7e00640 1 -- 172.21.15.18:0/1852329697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0aba10 con 0x7f02c8144080 2024-04-25T10:05:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 -- 172.21.15.18:0/1852329697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 msgr2=0x7f02c80ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c80ce660 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0097c0 tx=0x7f02bc01c470 comp rx=0 tx=0).stop 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 -- 172.21.15.18:0/1852329697 shutdown_connections 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c8071e40 0x7f02c80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 --2- 172.21.15.18:0/1852329697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c80ce660 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 -- 172.21.15.18:0/1852329697 >> 172.21.15.18:0/1852329697 conn(0x7f02c806ac10 msgr2=0x7f02c806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 -- 172.21.15.18:0/1852329697 shutdown_connections 2024-04-25T10:05:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.356+0000 7f02d0600640 1 -- 172.21.15.18:0/1852329697 wait complete. 2024-04-25T10:05:39.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 Processor -- start 2024-04-25T10:05:39.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 -- start start 2024-04-25T10:05:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c806e3c0 0x7f02c80b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c8071e40 0x7f02c80b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80b4ad0 con 0x7f02c8144080 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c80b4950 con 0x7f02c8071e40 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02d0600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c81675a0 con 0x7f02c806e3c0 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52976/0 (socket says 172.21.15.18:52976) 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 -- 172.21.15.18:0/4202754458 learned_addr learned my addr 172.21.15.18:0/4202754458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02cdc00640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c806e3c0 0x7f02c80b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02cd200640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c8071e40 0x7f02c80b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 -- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c806e3c0 msgr2=0x7f02c80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c806e3c0 0x7f02c80b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 -- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c8071e40 msgr2=0x7f02c80b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c8071e40 0x7f02c80b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 -- 172.21.15.18:0/4202754458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c80b0f20 con 0x7f02c8144080 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02ce600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f02c000cbc0 tx=0x7f02c000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0017070 con 0x7f02c8144080 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.360+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c000ad40 con 0x7f02c8144080 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c80b1200 con 0x7f02c8144080 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c0012600 con 0x7f02c8144080 2024-04-25T10:05:39.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c80b17c0 con 0x7f02c8144080 2024-04-25T10:05:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c80745d0 con 0x7f02c8144080 2024-04-25T10:05:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02c001a070 con 0x7f02c8144080 2024-04-25T10:05:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02c5600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 0x7f02a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f02c0084e10 con 0x7f02c8144080 2024-04-25T10:05:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.364+0000 7f02cdc00640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 0x7f02a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.368+0000 7f02cdc00640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 0x7f02a8069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0af000 tx=0x7f02bc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:39.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.368+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02c0088030 con 0x7f02c8144080 2024-04-25T10:05:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:39.532+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02c80b1c90 con 0x7f02c8144080 2024-04-25T10:05:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.176+0000 7f02c5600640 1 -- 172.21.15.18:0/4202754458 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02c00556e0 con 0x7f02c8144080 2024-04-25T10:05:40.188 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:05:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 msgr2=0x7f02a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 0x7f02a8069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f02bc0af000 tx=0x7f02bc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:40.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 msgr2=0x7f02c8164b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f02c000cbc0 tx=0x7f02c000a430 comp rx=0 tx=0).stop 2024-04-25T10:05:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 shutdown_connections 2024-04-25T10:05:40.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02c8144080 0x7f02c8164b10 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02c8071e40 0x7f02c80b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02a8066f60 0x7f02a8069420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 --2- 172.21.15.18:0/4202754458 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02c806e3c0 0x7f02c80b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 >> 172.21.15.18:0/4202754458 conn(0x7f02c806ac10 msgr2=0x7f02c815f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 shutdown_connections 2024-04-25T10:05:40.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.180+0000 7f02d0600640 1 -- 172.21.15.18:0/4202754458 wait complete. 2024-04-25T10:05:40.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:05:40.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.348+0000 7f158aa00640 1 Processor -- start 2024-04-25T10:05:40.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 -- start start 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1584159320 0x7f158415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f158406e4a0 0x7f158406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f158415fc00 con 0x7f158415f440 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158406d640 con 0x7f1584159320 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f158aa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f158406ee10 con 0x7f158406e4a0 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1584159320 0x7f158415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1584159320 0x7f158415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52980/0 (socket says 172.21.15.18:52980) 2024-04-25T10:05:40.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 -- 172.21.15.18:0/2272106464 learned_addr learned my addr 172.21.15.18:0/2272106464 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 -- 172.21.15.18:0/2272106464 >> v2:172.21.15.167:3300/0 conn(0x7f158406e4a0 msgr2=0x7f158406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 --2- 172.21.15.18:0/2272106464 >> v2:172.21.15.167:3300/0 conn(0x7f158406e4a0 0x7f158406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 -- 172.21.15.18:0/2272106464 >> v1:172.21.15.167:6789/0 conn(0x7f158415f440 legacy=0x7f158406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.352+0000 7f1583e00640 1 -- 172.21.15.18:0/2272106464 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158415fee0 con 0x7f1584159320 2024-04-25T10:05:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f1583e00640 1 --2- 172.21.15.18:0/2272106464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1584159320 0x7f158415c9b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1584072630 tx=0x7f157401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5220e0e910999931 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f1583400640 1 -- 172.21.15.18:0/2272106464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740ab620 con 0x7f1584159320 2024-04-25T10:05:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f1583400640 1 -- 172.21.15.18:0/2272106464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15740b0070 con 0x7f1584159320 2024-04-25T10:05:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f1583400640 1 -- 172.21.15.18:0/2272106464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15740ab9e0 con 0x7f1584159320 2024-04-25T10:05:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- 172.21.15.18:0/2272106464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1584159320 msgr2=0x7f158415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 --2- 172.21.15.18:0/2272106464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1584159320 0x7f158415c9b0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1584072630 tx=0x7f157401c420 comp rx=0 tx=0).stop 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- 172.21.15.18:0/2272106464 shutdown_connections 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 --2- 172.21.15.18:0/2272106464 >> v2:172.21.15.167:3300/0 conn(0x7f158406e4a0 0x7f158406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 --2- 172.21.15.18:0/2272106464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1584159320 0x7f158415c9b0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- 172.21.15.18:0/2272106464 >> 172.21.15.18:0/2272106464 conn(0x7f1584067080 msgr2=0x7f158406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- 172.21.15.18:0/2272106464 shutdown_connections 2024-04-25T10:05:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- 172.21.15.18:0/2272106464 wait complete. 2024-04-25T10:05:40.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 Processor -- start 2024-04-25T10:05:40.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.356+0000 7f158aa00640 1 -- start start 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158406e4a0 0x7f15841581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 0x7f15841f7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1584159700 con 0x7f158415f440 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158415f8a0 con 0x7f158406e4a0 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1584168590 con 0x7f1584159320 2024-04-25T10:05:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52986/0 (socket says 172.21.15.18:52986) 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 -- 172.21.15.18:0/2581794305 learned_addr learned my addr 172.21.15.18:0/2581794305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1583e00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158406e4a0 0x7f15841581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f157be00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 0x7f15841f7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 -- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 msgr2=0x7f15841f7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 0x7f15841f7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 -- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158406e4a0 msgr2=0x7f15841581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158406e4a0 0x7f15841581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 -- 172.21.15.18:0/2581794305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15841387e0 con 0x7f158415f440 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f157be00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 0x7f15841f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1588a00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f157c00b9a0 tx=0x7f157c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c019070 con 0x7f158415f440 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f157c00cbc0 con 0x7f158415f440 2024-04-25T10:05:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157c014440 con 0x7f158415f440 2024-04-25T10:05:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1584138a80 con 0x7f158415f440 2024-04-25T10:05:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15841f6b10 con 0x7f158415f440 2024-04-25T10:05:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15841f6620 con 0x7f158415f440 2024-04-25T10:05:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.360+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f157c01c070 con 0x7f158415f440 2024-04-25T10:05:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.364+0000 7f1580c00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 0x7f1560069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.364+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f157c084d30 con 0x7f158415f440 2024-04-25T10:05:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.364+0000 7f1583e00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 0x7f1560069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.364+0000 7f1583e00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 0x7f1560069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15740af000 tx=0x7f15740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.368+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f157c055d80 con 0x7f158415f440 2024-04-25T10:05:40.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.532+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f15840745d0 con 0x7f158415f440 2024-04-25T10:05:40.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f1580c00640 1 -- 172.21.15.18:0/2581794305 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f157c055680 con 0x7f158415f440 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 msgr2=0x7f1560069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 0x7f1560069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15740af000 tx=0x7f15740a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 msgr2=0x7f15841382a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f157c00b9a0 tx=0x7f157c00be60 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 shutdown_connections 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f158415f440 0x7f15841382a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1560066f60 0x7f1560069420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1584159320 0x7f15841f7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 --2- 172.21.15.18:0/2581794305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f158406e4a0 0x7f15841581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 >> 172.21.15.18:0/2581794305 conn(0x7f1584067080 msgr2=0x7f1584140f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:40.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 shutdown_connections 2024-04-25T10:05:40.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.536+0000 7f158aa00640 1 -- 172.21.15.18:0/2581794305 wait complete. 2024-04-25T10:05:40.568 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T10:05:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.696+0000 7fea6e000640 1 Processor -- start 2024-04-25T10:05:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.696+0000 7fea6e000640 1 -- start start 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea6e000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fea6806edc0 0x7fea6806e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea6e000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6806d6f0 con 0x7fea68071690 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea6e000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6806d9d0 con 0x7fea680b22d0 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea6e000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6806dcb0 con 0x7fea6806edc0 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fea68071690 0x7fea68071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55992/0 (socket says 172.21.15.18:55992) 2024-04-25T10:05:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67400640 1 -- 172.21.15.18:0/2187868118 learned_addr learned my addr 172.21.15.18:0/2187868118 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189438228 0 0) 0x7fea6806d6f0 con 0x7fea68071690 2024-04-25T10:05:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea4c003530 con 0x7fea68071690 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67e00640 1 --2- 172.21.15.18:0/2187868118 >> v2:172.21.15.167:3300/0 conn(0x7fea6806edc0 0x7fea6806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2692163712 0 0) 0x7fea4c003530 con 0x7fea68071690 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 >> v2:172.21.15.167:3300/0 conn(0x7fea6806edc0 msgr2=0x7fea6806e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 --2- 172.21.15.18:0/2187868118 >> v2:172.21.15.167:3300/0 conn(0x7fea6806edc0 0x7fea6806e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 >> v1:172.21.15.167:6789/0 conn(0x7fea680b22d0 legacy=0x7fea680acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6806df90 con 0x7fea68071690 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fea58001680 con 0x7fea68071690 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 >> v1:172.21.15.18:6789/0 conn(0x7fea68071690 legacy=0x7fea68071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4c0039c0 0x7fea4c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea4c0051d0 0x7fea4c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6806dcb0 con 0x7fea4c004810 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c00c120 con 0x7fea4c0039c0 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c00c320 con 0x7fea4c0051d0 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67400640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4c0039c0 0x7fea4c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67e00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea4c0051d0 0x7fea4c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 -- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea4c0051d0 msgr2=0x7fea4c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea4c0051d0 0x7fea4c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 -- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4c0039c0 msgr2=0x7fea4c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea4c0039c0 0x7fea4c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea5fe00640 1 -- 172.21.15.18:0/2187868118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c003530 con 0x7fea4c004810 2024-04-25T10:05:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.700+0000 7fea67e00640 1 -- 172.21.15.18:0/2187868118 reap_dead start 2024-04-25T10:05:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea4c004c90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea50001780 tx=0x7fea5001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e417eca2ad054a93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea500013a0 con 0x7fea4c004810 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea500052f0 con 0x7fea4c004810 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea66a00640 1 -- 172.21.15.18:0/2187868118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003840 con 0x7fea4c004810 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 -- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 msgr2=0x7fea4c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea4c004c90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea50001780 tx=0x7fea5001c420 comp rx=0 tx=0).stop 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 -- 172.21.15.18:0/2187868118 shutdown_connections 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 --2- 172.21.15.18:0/2187868118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea4c004c90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 -- 172.21.15.18:0/2187868118 >> 172.21.15.18:0/2187868118 conn(0x7fea680b17b0 msgr2=0x7fea680b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 -- 172.21.15.18:0/2187868118 shutdown_connections 2024-04-25T10:05:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.704+0000 7fea6e000640 1 -- 172.21.15.18:0/2187868118 wait complete. 2024-04-25T10:05:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 Processor -- start 2024-04-25T10:05:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- start start 2024-04-25T10:05:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 0x7fea680b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 0x7fea68153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea68072760 con 0x7fea4c004810 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6815de10 con 0x7fea681f3e20 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea680728e0 con 0x7fea680b3380 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53016/0 (socket says 172.21.15.18:53016) 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 -- 172.21.15.18:0/2270992524 learned_addr learned my addr 172.21.15.18:0/2270992524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 0x7fea680b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67e00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 0x7fea68153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 -- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 msgr2=0x7fea68153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 0x7fea68153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 -- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 msgr2=0x7fea680b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 0x7fea680b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 -- 172.21.15.18:0/2270992524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6815e6d0 con 0x7fea4c004810 2024-04-25T10:05:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 0x7fea680b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67e00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 0x7fea68153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea67400640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fea58007d10 tx=0x7fea58012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5801c070 con 0x7fea4c004810 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58014750 con 0x7fea4c004810 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58014b40 con 0x7fea4c004810 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6815e9b0 con 0x7fea4c004810 2024-04-25T10:05:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6815ef70 con 0x7fea4c004810 2024-04-25T10:05:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.708+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea680745d0 con 0x7fea4c004810 2024-04-25T10:05:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.712+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea5801f070 con 0x7fea4c004810 2024-04-25T10:05:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.712+0000 7fea5f400640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 0x7fea44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.712+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fea58087970 con 0x7fea4c004810 2024-04-25T10:05:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.712+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 0x7fea44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.712+0000 7fea5fe00640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 0x7fea44069420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea50001750 tx=0x7fea500011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.716+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea58058a50 con 0x7fea4c004810 2024-04-25T10:05:40.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:40.932+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fea6815ac80 con 0x7fea4c004810 2024-04-25T10:05:41.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.188+0000 7fea5f400640 1 -- 172.21.15.18:0/2270992524 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v120) v1 ==== 142+0+0 (secure 0 0 0) 0x7fea58058350 con 0x7fea4c004810 2024-04-25T10:05:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 msgr2=0x7fea44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 0x7fea44069420 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea50001750 tx=0x7fea500011a0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 msgr2=0x7fea681527a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fea58007d10 tx=0x7fea58012920 comp rx=0 tx=0).stop 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 shutdown_connections 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea44066f60 0x7fea44069420 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fea680b3380 0x7fea68153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fea681f3e20 0x7fea680b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 --2- 172.21.15.18:0/2270992524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fea4c004810 0x7fea681527a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 >> 172.21.15.18:0/2270992524 conn(0x7fea680b17b0 msgr2=0x7fea6815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 shutdown_connections 2024-04-25T10:05:41.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.192+0000 7fea6e000640 1 -- 172.21.15.18:0/2270992524 wait complete. 2024-04-25T10:05:41.221 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T10:05:41.221 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T10:05:41.222 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:05:41.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:41.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 Processor -- start 2024-04-25T10:05:41.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 -- start start 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa15c0cef30 0x7fa15c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c15ac60 con 0x7fa15c144140 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15c0cf3e0 con 0x7fa15c06e900 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa163e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15c06ed50 con 0x7fa15c0cef30 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa15c144140 0x7fa15c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55996/0 (socket says 172.21.15.18:55996) 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161400640 1 -- 172.21.15.18:0/1498319146 learned_addr learned my addr 172.21.15.18:0/1498319146 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa160a00640 1 --2- 172.21.15.18:0/1498319146 >> v2:172.21.15.167:3300/0 conn(0x7fa15c0cef30 0x7fa15c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19051761 0 0) 0x7fa15c15ac60 con 0x7fa15c144140 2024-04-25T10:05:41.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa144005740 con 0x7fa15c144140 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772634691 0 0) 0x7fa15c0cf3e0 con 0x7fa15c06e900 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa15c15ac60 con 0x7fa15c06e900 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784099964 0 0) 0x7fa144005740 con 0x7fa15c144140 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 >> v2:172.21.15.167:3300/0 conn(0x7fa15c0cef30 msgr2=0x7fa15c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 --2- 172.21.15.18:0/1498319146 >> v2:172.21.15.167:3300/0 conn(0x7fa15c0cef30 0x7fa15c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 >> v1:172.21.15.167:6789/0 conn(0x7fa15c06e900 legacy=0x7fa15c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c15af20 con 0x7fa15c144140 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fa150001680 con 0x7fa15c144140 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 >> v1:172.21.15.18:6789/0 conn(0x7fa15c144140 legacy=0x7fa15c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa144005d60 0x7fa144006160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa144006a20 0x7fa144006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 0x7fa14400dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c06ed50 con 0x7fa1440073e0 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14400e260 con 0x7fa144006a20 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14400e460 con 0x7fa144005d60 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 0x7fa14400dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161400640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa144005d60 0x7fa144006160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa160a00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa144006a20 0x7fa144006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 -- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa144005d60 msgr2=0x7fa144006160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa144005d60 0x7fa144006160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 -- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa144006a20 msgr2=0x7fa144006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa144006a20 0x7fa144006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.360+0000 7fa161e00640 1 -- 172.21.15.18:0/1498319146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa144005740 con 0x7fa1440073e0 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa161e00640 1 -- 172.21.15.18:0/1498319146 reap_dead start 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa161e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 0x7fa14400dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa154001fd0 tx=0x7fa15401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff85291900a5fb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa154001c20 con 0x7fa1440073e0 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154003b80 con 0x7fa1440073e0 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa15be00640 1 -- 172.21.15.18:0/1498319146 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540050d0 con 0x7fa1440073e0 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 -- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 msgr2=0x7fa14400dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 0x7fa14400dbe0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa154001fd0 tx=0x7fa15401c900 comp rx=0 tx=0).stop 2024-04-25T10:05:41.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 -- 172.21.15.18:0/1498319146 shutdown_connections 2024-04-25T10:05:41.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 --2- 172.21.15.18:0/1498319146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1440073e0 0x7fa14400dbe0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 -- 172.21.15.18:0/1498319146 >> 172.21.15.18:0/1498319146 conn(0x7fa15c066fa0 msgr2=0x7fa15c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:41.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 -- 172.21.15.18:0/1498319146 shutdown_connections 2024-04-25T10:05:41.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.364+0000 7fa163e00640 1 -- 172.21.15.18:0/1498319146 wait complete. 2024-04-25T10:05:41.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 Processor -- start 2024-04-25T10:05:41.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- start start 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1440073e0 0x7fa15c0caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c133900 0x7fa15c133d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c0b1f30 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c15b4e0 con 0x7fa15c133900 2024-04-25T10:05:41.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c144520 con 0x7fa1440073e0 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53042/0 (socket says 172.21.15.18:53042) 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 -- 172.21.15.18:0/2103626051 learned_addr learned my addr 172.21.15.18:0/2103626051 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa161400640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1440073e0 0x7fa15c0caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa161e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c133900 0x7fa15c133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 -- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1440073e0 msgr2=0x7fa15c0caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1440073e0 0x7fa15c0caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 -- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c133900 msgr2=0x7fa15c133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c133900 0x7fa15c133d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 -- 172.21.15.18:0/2103626051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0cb020 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa160a00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa148011990 tx=0x7fa148011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14800fa30 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14800fbd0 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa148014440 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c0c9a40 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.368+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c0ca000 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c0745d0 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa148012040 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa159600640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 0x7fa13c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa148085420 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa161400640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 0x7fa13c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.372+0000 7fa161400640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 0x7fa13c069450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa150001060 tx=0x7fa150001e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.376+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa148019030 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.540+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa15c06b1d0 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa159600640 1 -- 172.21.15.18:0/2103626051 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13269 (secure 0 0 0) 0x7fa148056500 con 0x7fa15c0cb5a0 2024-04-25T10:05:41.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:41.553 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":45,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:40.180817+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6836/978423196":"2024-04-26T10:05:36.873865+0000","172.21.15.167:6834/978423196":"2024-04-26T10:05:36.873865+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 msgr2=0x7fa13c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 0x7fa13c069450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa150001060 tx=0x7fa150001e40 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 msgr2=0x7fa15c1510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa148011990 tx=0x7fa148011d90 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 shutdown_connections 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa15c133900 0x7fa15c133d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa15c0cb5a0 0x7fa15c1510c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa13c066f90 0x7fa13c069450 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 --2- 172.21.15.18:0/2103626051 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1440073e0 0x7fa15c0caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 >> 172.21.15.18:0/2103626051 conn(0x7fa15c066fa0 msgr2=0x7fa15c15d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 shutdown_connections 2024-04-25T10:05:41.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.544+0000 7fa163e00640 1 -- 172.21.15.18:0/2103626051 wait complete. 2024-04-25T10:05:41.575 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:41.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 Processor -- start 2024-04-25T10:05:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 -- start start 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79c806bf30 0x7f79c80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c815e040 con 0x7f79c8099a60 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c80cff80 con 0x7f79c806bf30 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cf400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80d0260 con 0x7f79c815dc60 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79c806bf30 0x7f79c80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f79c806bf30 0x7f79c80cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57774/0 (socket says 172.21.15.18:57774) 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 -- 172.21.15.18:0/1439792321 learned_addr learned my addr 172.21.15.18:0/1439792321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 -- 172.21.15.18:0/1439792321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 msgr2=0x7f79c80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cca00640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 -- 172.21.15.18:0/1439792321 >> v1:172.21.15.167:6789/0 conn(0x7f79c8099a60 legacy=0x7f79c80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79bfe00640 1 -- 172.21.15.18:0/1439792321 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c80d0540 con 0x7f79c806bf30 2024-04-25T10:05:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.712+0000 7f79cca00640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:41.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79bfe00640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c806bf30 0x7f79c80cf8a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009870 tx=0x7f79b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b381e81d5d56f659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79c7e00640 1 -- 172.21.15.18:0/1439792321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00ab620 con 0x7f79c806bf30 2024-04-25T10:05:41.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79c7e00640 1 -- 172.21.15.18:0/1439792321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00b0070 con 0x7f79c806bf30 2024-04-25T10:05:41.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79c7e00640 1 -- 172.21.15.18:0/1439792321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00ab9e0 con 0x7f79c806bf30 2024-04-25T10:05:41.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 -- 172.21.15.18:0/1439792321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c806bf30 msgr2=0x7f79c80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c806bf30 0x7f79c80cf8a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009870 tx=0x7f79b001c460 comp rx=0 tx=0).stop 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 -- 172.21.15.18:0/1439792321 shutdown_connections 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c806bf30 0x7f79c80cf8a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 --2- 172.21.15.18:0/1439792321 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 -- 172.21.15.18:0/1439792321 >> 172.21.15.18:0/1439792321 conn(0x7f79c80b3200 msgr2=0x7f79c80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 -- 172.21.15.18:0/1439792321 shutdown_connections 2024-04-25T10:05:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 -- 172.21.15.18:0/1439792321 wait complete. 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.716+0000 7f79cf400640 1 Processor -- start 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- start start 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 0x7f79c80b69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c806cfa0 con 0x7f79c8099a60 2024-04-25T10:05:41.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c80cc880 con 0x7f79c806bf30 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c814d0c0 con 0x7f79c815dc60 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57790/0 (socket says 172.21.15.18:57790) 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 -- 172.21.15.18:0/1379949312 learned_addr learned my addr 172.21.15.18:0/1379949312 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cca00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 0x7f79c80b69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cd400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 -- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 msgr2=0x7f79c80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 -- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 msgr2=0x7f79c80b69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 0x7f79c80b69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 -- 172.21.15.18:0/1379949312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c8150ee0 con 0x7f79c8099a60 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cca00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 0x7f79c80b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79bfe00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79b00ad040 tx=0x7f79b001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00abd90 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00be3f0 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00be7e0 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c80b6f10 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c80cb020 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.720+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c80745d0 con 0x7f79c8099a60 2024-04-25T10:05:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.724+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f79b00b43f0 con 0x7f79c8099a60 2024-04-25T10:05:41.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.724+0000 7f79c5600640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 0x7f79a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:41.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.724+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f79b011efb0 con 0x7f79c8099a60 2024-04-25T10:05:41.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.724+0000 7f79cca00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 0x7f79a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.724+0000 7f79cca00640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 0x7f79a4069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f79b800a9b0 tx=0x7f79b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:41.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.728+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f79c8150ee0 con 0x7f79c8099a60 2024-04-25T10:05:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.888+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79c8151120 con 0x7f79c8099a60 2024-04-25T10:05:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.888+0000 7f79c5600640 1 -- 172.21.15.18:0/1379949312 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79b0016110 con 0x7f79c8099a60 2024-04-25T10:05:41.901 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:05:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 msgr2=0x7f79a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 0x7f79a4069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f79b800a9b0 tx=0x7f79b8008040 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 msgr2=0x7f79c80c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79b00ad040 tx=0x7f79b001aca0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 shutdown_connections 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f79a4066f60 0x7f79a4069420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f79c815dc60 0x7f79c80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79c8099a60 0x7f79c80c7080 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 --2- 172.21.15.18:0/1379949312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f79c806bf30 0x7f79c80b69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 >> 172.21.15.18:0/1379949312 conn(0x7f79c80b3200 msgr2=0x7f79c806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 shutdown_connections 2024-04-25T10:05:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:41.892+0000 7f79cf400640 1 -- 172.21.15.18:0/1379949312 wait complete. 2024-04-25T10:05:41.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T10:05:42.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 Processor -- start 2024-04-25T10:05:42.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 -- start start 2024-04-25T10:05:42.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb45c1450f0 0x7fb45c0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 0x7fb45c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45c1454d0 con 0x7fb45c0b3900 2024-04-25T10:05:42.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0b4a20 con 0x7fb45c1450f0 2024-04-25T10:05:42.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45b200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb45c0b3e10 con 0x7fb45c06b320 2024-04-25T10:05:42.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb45c1450f0 0x7fb45c0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb45c1450f0 0x7fb45c0b33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57798/0 (socket says 172.21.15.18:57798) 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 -- 172.21.15.18:0/139401121 learned_addr learned my addr 172.21.15.18:0/139401121 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb45c0b3900 0x7fb45c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54740/0 (socket says 172.21.15.18:54740) 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 -- 172.21.15.18:0/139401121 >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 msgr2=0x7fb45c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45a800640 1 --2- 172.21.15.18:0/139401121 >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 0x7fb45c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 --2- 172.21.15.18:0/139401121 >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 0x7fb45c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb458a00640 1 -- 172.21.15.18:0/139401121 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440345905 0 0) 0x7fb45c1454d0 con 0x7fb45c0b3900 2024-04-25T10:05:42.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 -- 172.21.15.18:0/139401121 >> v1:172.21.15.18:6789/0 conn(0x7fb45c0b3900 legacy=0x7fb45c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb459e00640 1 -- 172.21.15.18:0/139401121 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c0b40f0 con 0x7fb45c1450f0 2024-04-25T10:05:42.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.056+0000 7fb45a800640 1 --2- 172.21.15.18:0/139401121 >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 0x7fb45c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb459e00640 1 --2- 172.21.15.18:0/139401121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c1450f0 0x7fb45c0b33c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0b4990 tx=0x7fb44c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2b1e127eda886b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb458a00640 1 -- 172.21.15.18:0/139401121 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0aa650 con 0x7fb45c1450f0 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb458a00640 1 -- 172.21.15.18:0/139401121 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0af070 con 0x7fb45c1450f0 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb458a00640 1 -- 172.21.15.18:0/139401121 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0aaa10 con 0x7fb45c1450f0 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 -- 172.21.15.18:0/139401121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c1450f0 msgr2=0x7fb45c0b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 --2- 172.21.15.18:0/139401121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c1450f0 0x7fb45c0b33c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb45c0b4990 tx=0x7fb44c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 -- 172.21.15.18:0/139401121 shutdown_connections 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 --2- 172.21.15.18:0/139401121 >> v2:172.21.15.167:3300/0 conn(0x7fb45c06b320 0x7fb45c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 --2- 172.21.15.18:0/139401121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c1450f0 0x7fb45c0b33c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 -- 172.21.15.18:0/139401121 >> 172.21.15.18:0/139401121 conn(0x7fb45c099a60 msgr2=0x7fb45c0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 -- 172.21.15.18:0/139401121 shutdown_connections 2024-04-25T10:05:42.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 -- 172.21.15.18:0/139401121 wait complete. 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.060+0000 7fb45b200640 1 Processor -- start 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- start start 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb45c0b3900 0x7fb45c0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb45c1450f0 0x7fb45c1560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b5d80 con 0x7fb45c06b320 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b5c00 con 0x7fb45c1450f0 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45c0b5f00 con 0x7fb45c0b3900 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57810/0 (socket says 172.21.15.18:57810) 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 -- 172.21.15.18:0/2463391191 learned_addr learned my addr 172.21.15.18:0/2463391191 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:42.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45a800640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb45c1450f0 0x7fb45c1560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459400640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb45c0b3900 0x7fb45c0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 -- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb45c0b3900 msgr2=0x7fb45c0b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb45c0b3900 0x7fb45c0b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 -- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb45c1450f0 msgr2=0x7fb45c1560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb45c1450f0 0x7fb45c1560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 -- 172.21.15.18:0/2463391191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c159320 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb459e00640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ac040 tx=0x7fb44c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c0b9070 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c0a6040 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c004020 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb45c156ee0 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb45c0b1db0 con 0x7fb45c06b320 2024-04-25T10:05:42.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.064+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45c04efa0 con 0x7fb45c06b320 2024-04-25T10:05:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.068+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb44c0041c0 con 0x7fb45c06b320 2024-04-25T10:05:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.068+0000 7fb452000640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 0x7fb43c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.068+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb44c11ef80 con 0x7fb45c06b320 2024-04-25T10:05:42.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.068+0000 7fb459400640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 0x7fb43c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:42.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.068+0000 7fb459400640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 0x7fb43c069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb45c155d00 tx=0x7fb448007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:42.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.072+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb44c016110 con 0x7fb45c06b320 2024-04-25T10:05:42.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:42.296+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fb45c143920 con 0x7fb45c06b320 2024-04-25T10:05:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.196+0000 7fb452000640 1 -- 172.21.15.18:0/2463391191 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v122) v1 ==== 152+0+0 (secure 0 0 0) 0x7fb44c0044b0 con 0x7fb45c06b320 2024-04-25T10:05:43.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 msgr2=0x7fb43c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 0x7fb43c069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb45c155d00 tx=0x7fb448007d60 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 msgr2=0x7fb45c158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0ac040 tx=0x7fb44c01ad30 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 shutdown_connections 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb45c1450f0 0x7fb45c1560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb43c066f60 0x7fb43c069420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb45c0b3900 0x7fb45c0b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 --2- 172.21.15.18:0/2463391191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb45c06b320 0x7fb45c158c40 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 >> 172.21.15.18:0/2463391191 conn(0x7fb45c099a60 msgr2=0x7fb45c142640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 shutdown_connections 2024-04-25T10:05:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.200+0000 7fb45b200640 1 -- 172.21.15.18:0/2463391191 wait complete. 2024-04-25T10:05:43.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:05:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 Processor -- start 2024-04-25T10:05:43.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 -- start start 2024-04-25T10:05:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b015f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f00b00cc050 0x7f00b00cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b009ade0 con 0x7f00b015b9e0 2024-04-25T10:05:43.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b0099a60 con 0x7f00b00cc050 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b5600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0099d40 con 0x7f00b015f3b0 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00afe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f00b015b9e0 0x7f00b00cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54750/0 (socket says 172.21.15.18:54750) 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00afe00640 1 -- 172.21.15.18:0/2433680227 learned_addr learned my addr 172.21.15.18:0/2433680227 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b4c00640 1 --2- 172.21.15.18:0/2433680227 >> v2:172.21.15.18:3300/0 conn(0x7f00b00cc050 0x7f00b00cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00a7e00640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b4c00640 1 -- 172.21.15.18:0/2433680227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 msgr2=0x7f00b015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b4c00640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b4c00640 1 -- 172.21.15.18:0/2433680227 >> v1:172.21.15.18:6789/0 conn(0x7f00b015b9e0 legacy=0x7f00b00cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.372+0000 7f00b4c00640 1 -- 172.21.15.18:0/2433680227 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b009a020 con 0x7f00b00cc050 2024-04-25T10:05:43.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b4c00640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b00cc050 0x7f00b00cc480 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=febd68cc8f67dbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00af400640 1 -- 172.21.15.18:0/2433680227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80b2070 con 0x7f00b00cc050 2024-04-25T10:05:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00af400640 1 -- 172.21.15.18:0/2433680227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a80a5920 con 0x7f00b00cc050 2024-04-25T10:05:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00af400640 1 -- 172.21.15.18:0/2433680227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a80a5cf0 con 0x7f00b00cc050 2024-04-25T10:05:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 -- 172.21.15.18:0/2433680227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b00cc050 msgr2=0x7f00b00cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b00cc050 0x7f00b00cc480 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009d90 tx=0x7f00a801c970 comp rx=0 tx=0).stop 2024-04-25T10:05:43.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 -- 172.21.15.18:0/2433680227 shutdown_connections 2024-04-25T10:05:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b00cc050 0x7f00b00cc480 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 --2- 172.21.15.18:0/2433680227 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 -- 172.21.15.18:0/2433680227 >> 172.21.15.18:0/2433680227 conn(0x7f00b00b3030 msgr2=0x7f00b00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 -- 172.21.15.18:0/2433680227 shutdown_connections 2024-04-25T10:05:43.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.376+0000 7f00b5600640 1 -- 172.21.15.18:0/2433680227 wait complete. 2024-04-25T10:05:43.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 Processor -- start 2024-04-25T10:05:43.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- start start 2024-04-25T10:05:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 0x7f00b015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b0156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00d03d0 con 0x7f00b015b9e0 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00d0250 con 0x7f00b00cc050 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01686f0 con 0x7f00b015f3b0 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57822/0 (socket says 172.21.15.18:57822) 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 -- 172.21.15.18:0/3191082072 learned_addr learned my addr 172.21.15.18:0/3191082072 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00afe00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 0x7f00b015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 -- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 msgr2=0x7f00b0156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b4c00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b0156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b0156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 -- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 msgr2=0x7f00b015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 0x7f00b015bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 -- 172.21.15.18:0/3191082072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b006bf70 con 0x7f00b015b9e0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00afe00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 0x7f00b015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b4c00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b0156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00a7e00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f009800d830 tx=0x7f009800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800b6c0 con 0x7f00b015b9e0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098019070 con 0x7f00b015b9e0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b006c250 con 0x7f00b015b9e0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009800ba60 con 0x7f00b015b9e0 2024-04-25T10:05:43.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b006c810 con 0x7f00b015b9e0 2024-04-25T10:05:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.380+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00745d0 con 0x7f00b015b9e0 2024-04-25T10:05:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.384+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f009801e460 con 0x7f00b015b9e0 2024-04-25T10:05:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.384+0000 7f00acc00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 0x7f008c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.384+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0098085630 con 0x7f00b015b9e0 2024-04-25T10:05:43.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.384+0000 7f00afe00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 0x7f008c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:43.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.384+0000 7f00afe00640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 0x7f008c069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00a0007fd0 tx=0x7f00a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:43.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.388+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0098056720 con 0x7f00b015b9e0 2024-04-25T10:05:43.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.548+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f00b00d1320 con 0x7f00b015b9e0 2024-04-25T10:05:43.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.552+0000 7f00acc00640 1 -- 172.21.15.18:0/3191082072 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0098056020 con 0x7f00b015b9e0 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 msgr2=0x7f008c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 0x7f008c069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00a0007fd0 tx=0x7f00a0009040 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 msgr2=0x7f00b00cecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f009800d830 tx=0x7f009800dcf0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 shutdown_connections 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f008c066f60 0x7f008c069420 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00b015f3b0 0x7f00b0156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00b015b9e0 0x7f00b00cecf0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 --2- 172.21.15.18:0/3191082072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00b00cc050 0x7f00b015bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 >> 172.21.15.18:0/3191082072 conn(0x7f00b00b3030 msgr2=0x7f00b00b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:43.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 shutdown_connections 2024-04-25T10:05:43.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.556+0000 7f00b5600640 1 -- 172.21.15.18:0/3191082072 wait complete. 2024-04-25T10:05:43.585 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:05:43.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:43.675 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:05:43.756 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:05:43.756 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:43.756 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:43.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:43.766 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:05:43.766 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:43.775 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:43.775 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:05:43.775 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:43.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:05:43.821 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:05:43.821 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:05:43.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:05:43.829 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:05:43.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:44.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.992+0000 7f7afd200640 1 Processor -- start 2024-04-25T10:05:44.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.992+0000 7f7afd200640 1 -- start start 2024-04-25T10:05:44.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7afd200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7af8144140 0x7f7af80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7afd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7af80ced60 0x7f7af806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7afd200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af815ac60 con 0x7f7af806e900 2024-04-25T10:05:44.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7afd200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af806ed30 con 0x7f7af80ced60 2024-04-25T10:05:44.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7afd200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7af80cf3e0 con 0x7f7af8144140 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7af80ced60 0x7f7af806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7af80ced60 0x7f7af806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57824/0 (socket says 172.21.15.18:57824) 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 -- 172.21.15.18:0/3142149491 learned_addr learned my addr 172.21.15.18:0/3142149491 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7af5e00640 1 --2- 172.21.15.18:0/3142149491 >> v2:172.21.15.167:3300/0 conn(0x7f7af8144140 0x7f7af80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 -- 172.21.15.18:0/3142149491 >> v2:172.21.15.167:3300/0 conn(0x7f7af8144140 msgr2=0x7f7af80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 --2- 172.21.15.18:0/3142149491 >> v2:172.21.15.167:3300/0 conn(0x7f7af8144140 0x7f7af80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 -- 172.21.15.18:0/3142149491 >> v1:172.21.15.18:6789/0 conn(0x7f7af806e900 legacy=0x7f7af815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 -- 172.21.15.18:0/3142149491 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af815af20 con 0x7f7af80ced60 2024-04-25T10:05:44.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7aed400640 1 --2- 172.21.15.18:0/3142149491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80ced60 0x7f7af806e3c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7af806eef0 tx=0x7f7ae001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f992ab4bb2113a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7af5400640 1 -- 172.21.15.18:0/3142149491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00b0070 con 0x7f7af80ced60 2024-04-25T10:05:44.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7af5400640 1 -- 172.21.15.18:0/3142149491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae00ab600 con 0x7f7af80ced60 2024-04-25T10:05:44.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:43.996+0000 7f7af5400640 1 -- 172.21.15.18:0/3142149491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae00ab9d0 con 0x7f7af80ced60 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- 172.21.15.18:0/3142149491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80ced60 msgr2=0x7f7af806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- 172.21.15.18:0/3142149491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80ced60 0x7f7af806e3c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7af806eef0 tx=0x7f7ae001c520 comp rx=0 tx=0).stop 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- 172.21.15.18:0/3142149491 shutdown_connections 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- 172.21.15.18:0/3142149491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af80ced60 0x7f7af806e3c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- 172.21.15.18:0/3142149491 >> v2:172.21.15.167:3300/0 conn(0x7f7af8144140 0x7f7af80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- 172.21.15.18:0/3142149491 >> 172.21.15.18:0/3142149491 conn(0x7f7af8066fa0 msgr2=0x7f7af806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:44.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- 172.21.15.18:0/3142149491 shutdown_connections 2024-04-25T10:05:44.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- 172.21.15.18:0/3142149491 wait complete. 2024-04-25T10:05:44.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 Processor -- start 2024-04-25T10:05:44.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- start start 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 0x7f7af81f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7af8144140 0x7f7af81f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af815ba00 con 0x7f7af806e900 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af8144520 con 0x7f7af80ced60 2024-04-25T10:05:44.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7afd200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af815bb80 con 0x7f7af8144140 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57834/0 (socket says 172.21.15.18:57834) 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 -- 172.21.15.18:0/2192159932 learned_addr learned my addr 172.21.15.18:0/2192159932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 -- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7af8144140 msgr2=0x7f7af81f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7af8144140 0x7f7af81f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7aed400640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 0x7f7af81f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.000+0000 7f7af5e00640 1 -- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 msgr2=0x7f7af81f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7af5e00640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 0x7f7af81f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7af5e00640 1 -- 172.21.15.18:0/2192159932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8139cb0 con 0x7f7af806e900 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aed400640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 0x7f7af81f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:44.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7af5e00640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d5f0 tx=0x7f7ae800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80125f0 con 0x7f7af806e900 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae8019070 con 0x7f7af806e900 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af8139f90 con 0x7f7af806e900 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae80129b0 con 0x7f7af806e900 2024-04-25T10:05:44.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af81397d0 con 0x7f7af806e900 2024-04-25T10:05:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af80745d0 con 0x7f7af806e900 2024-04-25T10:05:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ae8012b50 con 0x7f7af806e900 2024-04-25T10:05:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 0x7f7ad4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7ae8085270 con 0x7f7af806e900 2024-04-25T10:05:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.004+0000 7f7aed400640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 0x7f7ad4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.008+0000 7f7aed400640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 0x7f7ad4069420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00ad000 tx=0x7f7ae0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.008+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ae8056480 con 0x7f7af806e900 2024-04-25T10:05:44.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7af813a320 con 0x7f7af806e900 2024-04-25T10:05:44.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7aeea00640 1 -- 172.21.15.18:0/2192159932 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3706 (secure 0 0 0) 0x7f7ae8055d80 con 0x7f7af806e900 2024-04-25T10:05:44.218 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:44.218 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5194,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3113152472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":3113152472},{"type":"v1","addr":"172.21.15.167:6837","nonce":3113152472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5265,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/4272956772","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":4272956772},{"type":"v1","addr":"172.21.15.18:6834","nonce":4272956772}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5268,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3871934481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3871934481},{"type":"v1","addr":"172.21.15.18:6835","nonce":3871934481}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":35129,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2578744038","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2578744038},{"type":"v1","addr":"172.21.15.167:6836","nonce":2578744038}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2024-04-25T10:05:44.219 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 20 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 msgr2=0x7f7ad4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 0x7f7ad4069420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00ad000 tx=0x7f7ae0008040 comp rx=0 tx=0).stop 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 msgr2=0x7f7af8154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7ae800d5f0 tx=0x7f7ae800dab0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 shutdown_connections 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ad4066f60 0x7f7ad4069420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7af8144140 0x7f7af81f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7af80ced60 0x7f7af81f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 --2- 172.21.15.18:0/2192159932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7af806e900 0x7f7af8154720 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 >> 172.21.15.18:0/2192159932 conn(0x7f7af8066fa0 msgr2=0x7f7af80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 shutdown_connections 2024-04-25T10:05:44.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.208+0000 7f7afd200640 1 -- 172.21.15.18:0/2192159932 wait complete. 2024-04-25T10:05:44.240 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:05:44.240 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:05:44.240 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:05:44.240 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.241 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:05:44.241 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:05:44.241 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:05:44.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.241 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:05:44.241 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:05:44.241 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:05:44.242 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.242 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:05:44.242 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:05:44.242 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:05:44.242 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:05:44.254 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:05:44.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:05:44.256 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:05:44.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:05:44.257 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:05:44.258 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:05:44.258 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:05:44.259 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:05:44.303 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:05:44.303 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:44.305 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:05:44.305 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:44.308 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:05:44.308 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:44.310 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:05:44.310 DEBUG:teuthology.parallel:result is None 2024-04-25T10:05:44.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:05:44.389 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:05:44.390 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:05:44.401 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:05:44.401 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:05:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 Processor -- start 2024-04-25T10:05:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 -- start start 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f377c15dc60 0x7f377c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f377c09a170 0x7f377c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f377c15e040 con 0x7f377c06bf30 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0cff80 con 0x7f377c15dc60 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f3782000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0d0260 con 0x7f377c09a170 2024-04-25T10:05:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f377b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f377c15dc60 0x7f377c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f377b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f377c15dc60 0x7f377c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57860/0 (socket says 172.21.15.18:57860) 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f377b400640 1 -- 172.21.15.18:0/3072432280 learned_addr learned my addr 172.21.15.18:0/3072432280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.448+0000 7f377be00640 1 --2- 172.21.15.18:0/3072432280 >> v2:172.21.15.167:3300/0 conn(0x7f377c09a170 0x7f377c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377b400640 1 -- 172.21.15.18:0/3072432280 >> v2:172.21.15.167:3300/0 conn(0x7f377c09a170 msgr2=0x7f377c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377b400640 1 --2- 172.21.15.18:0/3072432280 >> v2:172.21.15.167:3300/0 conn(0x7f377c09a170 0x7f377c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377b400640 1 -- 172.21.15.18:0/3072432280 >> v1:172.21.15.167:6789/0 conn(0x7f377c06bf30 legacy=0x7f377c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377b400640 1 -- 172.21.15.18:0/3072432280 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0d0540 con 0x7f377c15dc60 2024-04-25T10:05:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377b400640 1 --2- 172.21.15.18:0/3072432280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c0d1020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f377c072a70 tx=0x7f376c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3da333ba54e0df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377aa00640 1 -- 172.21.15.18:0/3072432280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0ab660 con 0x7f377c15dc60 2024-04-25T10:05:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377aa00640 1 -- 172.21.15.18:0/3072432280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0b0070 con 0x7f377c15dc60 2024-04-25T10:05:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f377aa00640 1 -- 172.21.15.18:0/3072432280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c0aba20 con 0x7f377c15dc60 2024-04-25T10:05:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f3782000640 1 -- 172.21.15.18:0/3072432280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 msgr2=0x7f377c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.452+0000 7f3782000640 1 --2- 172.21.15.18:0/3072432280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c0d1020 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f377c072a70 tx=0x7f376c01c460 comp rx=0 tx=0).stop 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- 172.21.15.18:0/3072432280 shutdown_connections 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 --2- 172.21.15.18:0/3072432280 >> v2:172.21.15.167:3300/0 conn(0x7f377c09a170 0x7f377c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 --2- 172.21.15.18:0/3072432280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c0d1020 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- 172.21.15.18:0/3072432280 >> 172.21.15.18:0/3072432280 conn(0x7f377c0b3200 msgr2=0x7f377c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- 172.21.15.18:0/3072432280 shutdown_connections 2024-04-25T10:05:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- 172.21.15.18:0/3072432280 wait complete. 2024-04-25T10:05:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 Processor -- start 2024-04-25T10:05:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- start start 2024-04-25T10:05:44.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 0x7f377c0b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f377c09a170 0x7f377c14b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cc6f0 con 0x7f377c15dc60 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cc570 con 0x7f377c06bf30 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0cc870 con 0x7f377c09a170 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57872/0 (socket says 172.21.15.18:57872) 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 -- 172.21.15.18:0/3487298718 learned_addr learned my addr 172.21.15.18:0/3487298718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377b400640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 0x7f377c0b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3773e00640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f377c09a170 0x7f377c14b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 -- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f377c09a170 msgr2=0x7f377c14b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f377c09a170 0x7f377c14b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 -- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 msgr2=0x7f377c0b5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 0x7f377c0b5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 -- 172.21.15.18:0/3487298718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0b5920 con 0x7f377c15dc60 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377b400640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 0x7f377c0b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f377be00640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f377400ef90 tx=0x7f377400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774018020 con 0x7f377c15dc60 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3774014480 con 0x7f377c15dc60 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774014870 con 0x7f377c15dc60 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.456+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c0b5c00 con 0x7f377c15dc60 2024-04-25T10:05:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c0b64a0 con 0x7f377c15dc60 2024-04-25T10:05:44.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c0b66a0 con 0x7f377c15dc60 2024-04-25T10:05:44.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f377401b020 con 0x7f377c15dc60 2024-04-25T10:05:44.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f3773400640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 0x7f3758069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:44.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f3774085bf0 con 0x7f377c15dc60 2024-04-25T10:05:44.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.460+0000 7f377b400640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 0x7f3758069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:44.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.464+0000 7f377b400640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 0x7f3758069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f376c0af000 tx=0x7f376c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:44.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.464+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3774022030 con 0x7f377c15dc60 2024-04-25T10:05:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:44.636+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f377c0b5dd0 con 0x7f377c15dc60 2024-04-25T10:05:45.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.216+0000 7f3773400640 1 -- 172.21.15.18:0/3487298718 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3774010040 con 0x7f377c15dc60 2024-04-25T10:05:45.226 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 msgr2=0x7f3758069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 0x7f3758069420 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f376c0af000 tx=0x7f376c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 msgr2=0x7f377c14bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f377400ef90 tx=0x7f377400c490 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 shutdown_connections 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f377c15dc60 0x7f377c14bc70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3758066f60 0x7f3758069420 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f377c09a170 0x7f377c14b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 --2- 172.21.15.18:0/3487298718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f377c06bf30 0x7f377c0b5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 >> 172.21.15.18:0/3487298718 conn(0x7f377c0b3200 msgr2=0x7f377c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 shutdown_connections 2024-04-25T10:05:45.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.220+0000 7f3782000640 1 -- 172.21.15.18:0/3487298718 wait complete. 2024-04-25T10:05:45.255 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:05:45.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.388+0000 7f77a5c00640 1 Processor -- start 2024-04-25T10:05:45.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.388+0000 7f77a5c00640 1 -- start start 2024-04-25T10:05:45.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f77a5c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77a0144140 0x7f77a00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f77a5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f77a5c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a015ac60 con 0x7f77a00ced60 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f77a5c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a00cf3e0 con 0x7f77a0144140 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f77a5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a015af20 con 0x7f77a006ead0 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77a0144140 0x7f77a00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f77a0144140 0x7f77a00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57876/0 (socket says 172.21.15.18:57876) 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 -- 172.21.15.18:0/2314696131 learned_addr learned my addr 172.21.15.18:0/2314696131 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779f400640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 -- 172.21.15.18:0/2314696131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 msgr2=0x7f77a00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:45.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a00b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 -- 172.21.15.18:0/2314696131 >> v1:172.21.15.167:6789/0 conn(0x7f77a00ced60 legacy=0x7f77a006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:45.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.392+0000 7f779ea00640 1 -- 172.21.15.18:0/2314696131 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a015b200 con 0x7f77a0144140 2024-04-25T10:05:45.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f779ea00640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a0144140 0x7f77a00ce820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7790009870 tx=0x7f779001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f55f7a56ca507e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f779e000640 1 -- 172.21.15.18:0/2314696131 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900b0070 con 0x7f77a0144140 2024-04-25T10:05:45.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f779e000640 1 -- 172.21.15.18:0/2314696131 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77900ab600 con 0x7f77a0144140 2024-04-25T10:05:45.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f779e000640 1 -- 172.21.15.18:0/2314696131 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77900ab9d0 con 0x7f77a0144140 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- 172.21.15.18:0/2314696131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a0144140 msgr2=0x7f77a00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a0144140 0x7f77a00ce820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7790009870 tx=0x7f779001c560 comp rx=0 tx=0).stop 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- 172.21.15.18:0/2314696131 shutdown_connections 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2314696131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a0144140 0x7f77a00ce820 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- 172.21.15.18:0/2314696131 >> 172.21.15.18:0/2314696131 conn(0x7f77a0066fa0 msgr2=0x7f77a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- 172.21.15.18:0/2314696131 shutdown_connections 2024-04-25T10:05:45.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- 172.21.15.18:0/2314696131 wait complete. 2024-04-25T10:05:45.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 Processor -- start 2024-04-25T10:05:45.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- start start 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a01f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 0x7f77a0163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a015bb80 con 0x7f77a00ced60 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a015ba00 con 0x7f77a0144140 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.396+0000 7f77a5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a006d2b0 con 0x7f77a006ead0 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f779f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 0x7f77a0163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57878/0 (socket says 172.21.15.18:57878) 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 -- 172.21.15.18:0/2794019982 learned_addr learned my addr 172.21.15.18:0/2794019982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f779ea00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a01f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 -- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 msgr2=0x7f77a01f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a01f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 -- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 msgr2=0x7f77a0163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 0x7f77a0163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 -- 172.21.15.18:0/2794019982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a013fc70 con 0x7f77a00ced60 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f779f400640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 0x7f77a0163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f779ea00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a01f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7796000640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f778800c790 tx=0x7f778800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788016020 con 0x7f77a00ced60 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788006d60 con 0x7f77a00ced60 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788003bc0 con 0x7f77a00ced60 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a013ff50 con 0x7f77a00ced60 2024-04-25T10:05:45.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a0140510 con 0x7f77a00ced60 2024-04-25T10:05:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a00745d0 con 0x7f77a00ced60 2024-04-25T10:05:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f778800a850 con 0x7f77a00ced60 2024-04-25T10:05:45.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.400+0000 7f7797400640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 0x7f777c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.404+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f77880849a0 con 0x7f77a00ced60 2024-04-25T10:05:45.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.404+0000 7f779ea00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 0x7f777c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.404+0000 7f779ea00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 0x7f777c069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f77900ad000 tx=0x7f7790008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.408+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7788020020 con 0x7f77a00ced60 2024-04-25T10:05:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f77a015a5b0 con 0x7f77a00ced60 2024-04-25T10:05:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f7797400640 1 -- 172.21.15.18:0/2794019982 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f77880555b0 con 0x7f77a00ced60 2024-04-25T10:05:45.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:05:45.636 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:45.637 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.638 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:05:45.640 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:05:45.642 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:05:45.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.644 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.645 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.646 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.647 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:05:45.648 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:05:45.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:45.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:05:45.649 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:05:45.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 msgr2=0x7f777c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 0x7f777c069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f77900ad000 tx=0x7f7790008040 comp rx=0 tx=0).stop 2024-04-25T10:05:45.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 msgr2=0x7f77a013f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f778800c790 tx=0x7f778800cc50 comp rx=0 tx=0).stop 2024-04-25T10:05:45.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 shutdown_connections 2024-04-25T10:05:45.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77a0144140 0x7f77a0163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77a00ced60 0x7f77a013f240 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f777c066f60 0x7f777c069420 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 --2- 172.21.15.18:0/2794019982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f77a006ead0 0x7f77a01f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 >> 172.21.15.18:0/2794019982 conn(0x7f77a0066fa0 msgr2=0x7f77a015e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 shutdown_connections 2024-04-25T10:05:45.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.624+0000 7f77a5c00640 1 -- 172.21.15.18:0/2794019982 wait complete. 2024-04-25T10:05:45.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 Processor -- start 2024-04-25T10:05:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 -- start start 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec15ddf0 con 0x7f7bec15da10 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec06b480 con 0x7f7bec0d11b0 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec0d06d0 con 0x7f7bec0b4920 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf1c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7bec15da10 0x7f7bec06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54766/0 (socket says 172.21.15.18:54766) 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf1c00640 1 -- 172.21.15.18:0/133735577 learned_addr learned my addr 172.21.15.18:0/133735577 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf2600640 1 --2- 172.21.15.18:0/133735577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613348991 0 0) 0x7f7bec15ddf0 con 0x7f7bec15da10 2024-04-25T10:05:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bd4003530 con 0x7f7bec15da10 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855204048 0 0) 0x7f7bec06b480 con 0x7f7bec0d11b0 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec15ddf0 con 0x7f7bec0d11b0 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf2600640 1 -- 172.21.15.18:0/133735577 >> v1:172.21.15.167:6789/0 conn(0x7f7bec0d11b0 legacy=0x7f7bec0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf2600640 1 -- 172.21.15.18:0/133735577 >> v1:172.21.15.18:6789/0 conn(0x7f7bec15da10 legacy=0x7f7bec06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810934425 0 0) 0x7f7bd4003530 con 0x7f7bec15da10 2024-04-25T10:05:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.788+0000 7f7bf2600640 1 -- 172.21.15.18:0/133735577 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec0d09b0 con 0x7f7bec0b4920 2024-04-25T10:05:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf2600640 1 --2- 172.21.15.18:0/133735577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec0afe20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009dc0 tx=0x7f7be401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74413334780e6a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40b2070 con 0x7f7bec0b4920 2024-04-25T10:05:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40a58d0 con 0x7f7bec0b4920 2024-04-25T10:05:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bebe00640 1 -- 172.21.15.18:0/133735577 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40a5c80 con 0x7f7bec0b4920 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 -- 172.21.15.18:0/133735577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 msgr2=0x7f7bec0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 --2- 172.21.15.18:0/133735577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec0afe20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7be4009dc0 tx=0x7f7be401c900 comp rx=0 tx=0).stop 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 -- 172.21.15.18:0/133735577 shutdown_connections 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 --2- 172.21.15.18:0/133735577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec0afe20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 -- 172.21.15.18:0/133735577 >> 172.21.15.18:0/133735577 conn(0x7f7bec0b2400 msgr2=0x7f7bec0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 -- 172.21.15.18:0/133735577 shutdown_connections 2024-04-25T10:05:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.792+0000 7f7bf4600640 1 -- 172.21.15.18:0/133735577 wait complete. 2024-04-25T10:05:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 Processor -- start 2024-04-25T10:05:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- start start 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec13c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bec0d11b0 0x7f7bec0cf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec16b900 con 0x7f7bec15da10 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec16b780 con 0x7f7bec0d11b0 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec16ba80 con 0x7f7bec0b4920 2024-04-25T10:05:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57880/0 (socket says 172.21.15.18:57880) 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 -- 172.21.15.18:0/2656035769 learned_addr learned my addr 172.21.15.18:0/2656035769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf1c00640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec13c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf1200640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bec0d11b0 0x7f7bec0cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 -- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 msgr2=0x7f7bec13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec13c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 -- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bec0d11b0 msgr2=0x7f7bec0cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bec0d11b0 0x7f7bec0cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 -- 172.21.15.18:0/2656035769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec0cc170 con 0x7f7bec15da10 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf2600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7be401a530 tx=0x7f7be40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be40b2050 con 0x7f7bec15da10 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be40be070 con 0x7f7bec15da10 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be4009450 con 0x7f7bec15da10 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec0cc450 con 0x7f7bec15da10 2024-04-25T10:05:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.796+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec13cbb0 con 0x7f7bec15da10 2024-04-25T10:05:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec0745d0 con 0x7f7bec15da10 2024-04-25T10:05:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7be40adca0 con 0x7f7bec15da10 2024-04-25T10:05:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7be9600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 0x7f7bcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7be411ffd0 con 0x7f7bec15da10 2024-04-25T10:05:45.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7bf1c00640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 0x7f7bcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:45.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.800+0000 7f7bf1c00640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 0x7f7bcc069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005890 tx=0x7f7be0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:45.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.804+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7be4016580 con 0x7f7bec15da10 2024-04-25T10:05:45.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bec0cc970 con 0x7f7bec15da10 2024-04-25T10:05:45.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7be9600640 1 -- 172.21.15.18:0/2656035769 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13140 (secure 0 0 0) 0x7f7be40f0ac0 con 0x7f7bec15da10 2024-04-25T10:05:45.978 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:45.978 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":49,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:45.231910+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 msgr2=0x7f7bcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 0x7f7bcc069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7be0005890 tx=0x7f7be0009040 comp rx=0 tx=0).stop 2024-04-25T10:05:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 msgr2=0x7f7bec0cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7be401a530 tx=0x7f7be40196a0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 shutdown_connections 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bec15da10 0x7f7bec0cf580 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bec0d11b0 0x7f7bec0cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bcc066f60 0x7f7bcc069420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 --2- 172.21.15.18:0/2656035769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bec0b4920 0x7f7bec13c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 >> 172.21.15.18:0/2656035769 conn(0x7f7bec0b2400 msgr2=0x7f7bec0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 shutdown_connections 2024-04-25T10:05:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:45.968+0000 7f7bf4600640 1 -- 172.21.15.18:0/2656035769 wait complete. 2024-04-25T10:05:46.001 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:05:46.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:05:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 Processor -- start 2024-04-25T10:05:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 -- start start 2024-04-25T10:05:46.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc56015acd0 0x7fc56015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56015bc40 con 0x7fc560144120 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc56015b3a0 con 0x7fc56015ee60 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc567800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56015e490 con 0x7fc56015acd0 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc564e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc560144120 0x7fc5600ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54780/0 (socket says 172.21.15.18:54780) 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc564e00640 1 -- 172.21.15.18:0/2310467001 learned_addr learned my addr 172.21.15.18:0/2310467001 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55fe00640 1 --2- 172.21.15.18:0/2310467001 >> v2:172.21.15.167:3300/0 conn(0x7fc56015acd0 0x7fc56015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113038604 0 0) 0x7fc56015bc40 con 0x7fc560144120 2024-04-25T10:05:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc548005740 con 0x7fc560144120 2024-04-25T10:05:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469715173 0 0) 0x7fc56015b3a0 con 0x7fc56015ee60 2024-04-25T10:05:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc56015bc40 con 0x7fc56015ee60 2024-04-25T10:05:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55fe00640 1 -- 172.21.15.18:0/2310467001 >> v1:172.21.15.167:6789/0 conn(0x7fc56015ee60 legacy=0x7fc5600b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55fe00640 1 -- 172.21.15.18:0/2310467001 >> v1:172.21.15.18:6789/0 conn(0x7fc560144120 legacy=0x7fc5600ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.136+0000 7fc55fe00640 1 -- 172.21.15.18:0/2310467001 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56015b680 con 0x7fc56015acd0 2024-04-25T10:05:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc55fe00640 1 --2- 172.21.15.18:0/2310467001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56015acd0 0x7fc56015e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097c0 tx=0x7fc54c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8735bba3148efc5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0b0070 con 0x7fc56015acd0 2024-04-25T10:05:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c0ab600 con 0x7fc56015acd0 2024-04-25T10:05:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc55f400640 1 -- 172.21.15.18:0/2310467001 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c0ab9d0 con 0x7fc56015acd0 2024-04-25T10:05:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 -- 172.21.15.18:0/2310467001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56015acd0 msgr2=0x7fc56015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 --2- 172.21.15.18:0/2310467001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56015acd0 0x7fc56015e920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc54c0097c0 tx=0x7fc54c01c410 comp rx=0 tx=0).stop 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 -- 172.21.15.18:0/2310467001 shutdown_connections 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 --2- 172.21.15.18:0/2310467001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56015acd0 0x7fc56015e920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 -- 172.21.15.18:0/2310467001 >> 172.21.15.18:0/2310467001 conn(0x7fc560067080 msgr2=0x7fc56006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 -- 172.21.15.18:0/2310467001 shutdown_connections 2024-04-25T10:05:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.140+0000 7fc567800640 1 -- 172.21.15.18:0/2310467001 wait complete. 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 Processor -- start 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- start start 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc560144120 0x7fc560141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56015acd0 0x7fc56013f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56006de70 con 0x7fc56015ee60 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc56006dcf0 con 0x7fc560144120 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56006dff0 con 0x7fc56015acd0 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57892/0 (socket says 172.21.15.18:57892) 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 -- 172.21.15.18:0/3006345282 learned_addr learned my addr 172.21.15.18:0/3006345282 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc564e00640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc560144120 0x7fc560141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc55fe00640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56015acd0 0x7fc56013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 -- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56015acd0 msgr2=0x7fc56013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56015acd0 0x7fc56013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 -- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc560144120 msgr2=0x7fc560141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc560144120 0x7fc560141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 -- 172.21.15.18:0/3006345282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56013ca30 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc565800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c730 tx=0x7fc55800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558003b80 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558003d20 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc56013cd10 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800aa90 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc56013d2d0 con 0x7fc56015ee60 2024-04-25T10:05:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.144+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5600745d0 con 0x7fc56015ee60 2024-04-25T10:05:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.148+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc55800ac30 con 0x7fc56015ee60 2024-04-25T10:05:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.148+0000 7fc55cc00640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 0x7fc540069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.148+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc558084da0 con 0x7fc56015ee60 2024-04-25T10:05:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.148+0000 7fc564e00640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 0x7fc540069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.148+0000 7fc564e00640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 0x7fc540069420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5540011f0 tx=0x7fc554009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.152+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc558055f60 con 0x7fc56015ee60 2024-04-25T10:05:46.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc56013a840 con 0x7fc56015ee60 2024-04-25T10:05:46.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc55cc00640 1 -- 172.21.15.18:0/3006345282 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc558055860 con 0x7fc56015ee60 2024-04-25T10:05:46.326 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:05:46.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 msgr2=0x7fc540069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 0x7fc540069420 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc5540011f0 tx=0x7fc554009040 comp rx=0 tx=0).stop 2024-04-25T10:05:46.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 msgr2=0x7fc5601f35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc55800c730 tx=0x7fc55800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 shutdown_connections 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56015ee60 0x7fc5601f35b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc540066f60 0x7fc540069420 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56015acd0 0x7fc56013f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 --2- 172.21.15.18:0/3006345282 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc560144120 0x7fc560141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 >> 172.21.15.18:0/3006345282 conn(0x7fc560067080 msgr2=0x7fc5600b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 shutdown_connections 2024-04-25T10:05:46.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.316+0000 7fc567800640 1 -- 172.21.15.18:0/3006345282 wait complete. 2024-04-25T10:05:46.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:05:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.476+0000 7f80fb800640 1 Processor -- start 2024-04-25T10:05:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.476+0000 7f80fb800640 1 -- start start 2024-04-25T10:05:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80fb800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80f415fe50 0x7f80f40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80fb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 0x7f80f415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80fb800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f40cc4e0 con 0x7f80f4145270 2024-04-25T10:05:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80fb800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f4145650 con 0x7f80f415fe50 2024-04-25T10:05:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80fb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f41602b0 con 0x7f80f40b1c90 2024-04-25T10:05:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80ebe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80f415fe50 0x7f80f40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80f8e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f80f4145270 0x7f80f40cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54788/0 (socket says 172.21.15.18:54788) 2024-04-25T10:05:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80f8e00640 1 -- 172.21.15.18:0/3945430565 learned_addr learned my addr 172.21.15.18:0/3945430565 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80f9800640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 0x7f80f415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80ebe00640 1 -- 172.21.15.18:0/3945430565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 msgr2=0x7f80f415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80ebe00640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 0x7f80f415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80ebe00640 1 -- 172.21.15.18:0/3945430565 >> v1:172.21.15.18:6789/0 conn(0x7f80f4145270 legacy=0x7f80f40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80ebe00640 1 -- 172.21.15.18:0/3945430565 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40ce040 con 0x7f80f415fe50 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80f9800640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 0x7f80f415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.480+0000 7f80f3e00640 1 -- 172.21.15.18:0/3945430565 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094330545 0 0) 0x7f80f40cc4e0 con 0x7f80f4145270 2024-04-25T10:05:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80ebe00640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f415fe50 0x7f80f40b1750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0097c0 tx=0x7f80dc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee499cfe8cd5b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80f3e00640 1 -- 172.21.15.18:0/3945430565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0b2070 con 0x7f80f415fe50 2024-04-25T10:05:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80f3e00640 1 -- 172.21.15.18:0/3945430565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc0ad640 con 0x7f80f415fe50 2024-04-25T10:05:46.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80f3e00640 1 -- 172.21.15.18:0/3945430565 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0ada10 con 0x7f80f415fe50 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- 172.21.15.18:0/3945430565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f415fe50 msgr2=0x7f80f40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f415fe50 0x7f80f40b1750 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0097c0 tx=0x7f80dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- 172.21.15.18:0/3945430565 shutdown_connections 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f40b1c90 0x7f80f415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- 172.21.15.18:0/3945430565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f415fe50 0x7f80f40b1750 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- 172.21.15.18:0/3945430565 >> 172.21.15.18:0/3945430565 conn(0x7f80f4066fa0 msgr2=0x7f80f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- 172.21.15.18:0/3945430565 shutdown_connections 2024-04-25T10:05:46.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- 172.21.15.18:0/3945430565 wait complete. 2024-04-25T10:05:46.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 Processor -- start 2024-04-25T10:05:46.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- start start 2024-04-25T10:05:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f40b1c90 0x7f80f413d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f415fe50 0x7f80f40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40cdbe0 con 0x7f80f4145270 2024-04-25T10:05:46.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f415f930 con 0x7f80f40b1c90 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.484+0000 7f80fb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f40cdd60 con 0x7f80f415fe50 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57918/0 (socket says 172.21.15.18:57918) 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 -- 172.21.15.18:0/2143491526 learned_addr learned my addr 172.21.15.18:0/2143491526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f8e00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f40b1c90 0x7f80f413d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f9800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f415fe50 0x7f80f40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 -- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f415fe50 msgr2=0x7f80f40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f415fe50 0x7f80f40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 -- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f40b1c90 msgr2=0x7f80f413d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f40b1c90 0x7f80f413d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 -- 172.21.15.18:0/2143491526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f40b3380 con 0x7f80f4145270 2024-04-25T10:05:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80ebe00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0097c0 tx=0x7f80dc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0bd070 con 0x7f80f4145270 2024-04-25T10:05:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc004030 con 0x7f80f4145270 2024-04-25T10:05:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f40b3660 con 0x7f80f4145270 2024-04-25T10:05:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0b2040 con 0x7f80f4145270 2024-04-25T10:05:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f40aa210 con 0x7f80f4145270 2024-04-25T10:05:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f40745d0 con 0x7f80f4145270 2024-04-25T10:05:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80dc0c0070 con 0x7f80f4145270 2024-04-25T10:05:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.488+0000 7f80f1600640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 0x7f80d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.492+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f80dc11e260 con 0x7f80f4145270 2024-04-25T10:05:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.492+0000 7f80f8e00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 0x7f80d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.492+0000 7f80f8e00640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 0x7f80d0069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80e4000f70 tx=0x7f80e4007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.492+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f80dc016090 con 0x7f80f4145270 2024-04-25T10:05:46.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.656+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f80f406b8e0 con 0x7f80f4145270 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.656+0000 7f80f1600640 1 -- 172.21.15.18:0/2143491526 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+65 (secure 0 0 0) 0x7f80dc0ef390 con 0x7f80f4145270 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:05:46.668 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 msgr2=0x7f80d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 0x7f80d0069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f80e4000f70 tx=0x7f80e4007b60 comp rx=0 tx=0).stop 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 msgr2=0x7f80f40b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0097c0 tx=0x7f80dc019240 comp rx=0 tx=0).stop 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 shutdown_connections 2024-04-25T10:05:46.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80d0066f90 0x7f80d0069450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f80f415fe50 0x7f80f40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80f4145270 0x7f80f40b0590 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 --2- 172.21.15.18:0/2143491526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80f40b1c90 0x7f80f413d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 >> 172.21.15.18:0/2143491526 conn(0x7f80f4066fa0 msgr2=0x7f80f4165390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 shutdown_connections 2024-04-25T10:05:46.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.660+0000 7f80fb800640 1 -- 172.21.15.18:0/2143491526 wait complete. 2024-04-25T10:05:46.690 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:05:46.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:05:46.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 Processor -- start 2024-04-25T10:05:46.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 -- start start 2024-04-25T10:05:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 0x7efc1006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc100cf490 con 0x7efc10144080 2024-04-25T10:05:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc1006ed70 con 0x7efc10071e40 2024-04-25T10:05:46.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.824+0000 7efc17c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100719b0 con 0x7efc1006e900 2024-04-25T10:05:46.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc0fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 0x7efc1006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:59008/0 (socket says 172.21.15.18:59008) 2024-04-25T10:05:46.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 -- 172.21.15.18:0/2721022075 learned_addr learned my addr 172.21.15.18:0/2721022075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:46.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15200640 1 --1- 172.21.15.18:0/2721022075 >> v1:172.21.15.167:6789/0 conn(0x7efc10144080 0x7efc100ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:51186/0 (socket says 172.21.15.18:51186) 2024-04-25T10:05:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 -- 172.21.15.18:0/2721022075 >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 msgr2=0x7efc1006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 --2- 172.21.15.18:0/2721022075 >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 0x7efc1006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 -- 172.21.15.18:0/2721022075 >> v1:172.21.15.167:6789/0 conn(0x7efc10144080 legacy=0x7efc100ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 -- 172.21.15.18:0/2721022075 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc100cf1b0 con 0x7efc1006e900 2024-04-25T10:05:46.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc0fe00640 1 --2- 172.21.15.18:0/2721022075 >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 0x7efc1006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:46.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc15c00640 1 --2- 172.21.15.18:0/2721022075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc0800d150 tx=0x7efc0801ea90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ab3358e8c3615ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.828+0000 7efc0f400640 1 -- 172.21.15.18:0/2721022075 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800b2d0 con 0x7efc1006e900 2024-04-25T10:05:46.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc0f400640 1 -- 172.21.15.18:0/2721022075 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0800b470 con 0x7efc1006e900 2024-04-25T10:05:46.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc0f400640 1 -- 172.21.15.18:0/2721022075 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080a7ac0 con 0x7efc1006e900 2024-04-25T10:05:46.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- 172.21.15.18:0/2721022075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 msgr2=0x7efc1015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- 172.21.15.18:0/2721022075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7efc0800d150 tx=0x7efc0801ea90 comp rx=0 tx=0).stop 2024-04-25T10:05:46.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- 172.21.15.18:0/2721022075 shutdown_connections 2024-04-25T10:05:46.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- 172.21.15.18:0/2721022075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc1006e900 0x7efc1015e200 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- 172.21.15.18:0/2721022075 >> v2:172.21.15.167:3300/0 conn(0x7efc10071e40 0x7efc1006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- 172.21.15.18:0/2721022075 >> 172.21.15.18:0/2721022075 conn(0x7efc1006ac10 msgr2=0x7efc1006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:46.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- 172.21.15.18:0/2721022075 shutdown_connections 2024-04-25T10:05:46.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- 172.21.15.18:0/2721022075 wait complete. 2024-04-25T10:05:46.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 Processor -- start 2024-04-25T10:05:46.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- start start 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc1006e900 0x7efc10139fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc10071e40 0x7efc1013a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100b4ad0 con 0x7efc10144080 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc100b4950 con 0x7efc1006e900 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc17c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc100ced70 con 0x7efc10071e40 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc15c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc15c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57920/0 (socket says 172.21.15.18:57920) 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc15c00640 1 -- 172.21.15.18:0/743229144 learned_addr learned my addr 172.21.15.18:0/743229144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc15200640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc1006e900 0x7efc10139fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.832+0000 7efc0fe00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc10071e40 0x7efc1013a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 -- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc10071e40 msgr2=0x7efc1013a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc10071e40 0x7efc1013a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 -- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc1006e900 msgr2=0x7efc10139fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc1006e900 0x7efc10139fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 -- 172.21.15.18:0/743229144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc1013a520 con 0x7efc10144080 2024-04-25T10:05:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc15c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc0801d140 tx=0x7efc0801b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0800b720 con 0x7efc10144080 2024-04-25T10:05:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc080be070 con 0x7efc10144080 2024-04-25T10:05:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc10141860 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08009a60 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc10141e20 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc100745d0 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc080b6070 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 0x7efbf0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.836+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5249+0+0 (secure 0 0 0) 0x7efc0811fc60 con 0x7efc10144080 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.840+0000 7efc15200640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 0x7efbf0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.840+0000 7efc15200640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 0x7efbf0069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efc04000f70 tx=0x7efc04007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:46.840+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc08018740 con 0x7efc10144080 2024-04-25T10:05:47.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.008+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efc100b2ab0 con 0x7efc10144080 2024-04-25T10:05:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.236+0000 7efc0cc00640 1 -- 172.21.15.18:0/743229144 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v50) v1 ==== 138+0+0 (secure 0 0 0) 0x7efc080f0890 con 0x7efc10144080 2024-04-25T10:05:47.249 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:05:47.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 msgr2=0x7efbf0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 0x7efbf0069420 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7efc04000f70 tx=0x7efc04007e30 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 msgr2=0x7efc101566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7efc0801d140 tx=0x7efc0801b830 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 shutdown_connections 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc10144080 0x7efc101566c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbf0066f60 0x7efbf0069420 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc10071e40 0x7efc1013a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 --2- 172.21.15.18:0/743229144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc1006e900 0x7efc10139fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 >> 172.21.15.18:0/743229144 conn(0x7efc1006ac10 msgr2=0x7efc1015dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 shutdown_connections 2024-04-25T10:05:47.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.240+0000 7efc17c00640 1 -- 172.21.15.18:0/743229144 wait complete. 2024-04-25T10:05:47.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:05:47.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.412+0000 7efebaa00640 1 Processor -- start 2024-04-25T10:05:47.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.412+0000 7efebaa00640 1 -- start start 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efebaa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efeb40c72a0 0x7efeb40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efebaa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb40b30d0 con 0x7efeb40d0150 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efebaa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb40ccf30 con 0x7efeb415dc00 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efebaa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb40cd860 con 0x7efeb40c72a0 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeab400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efeb40d0150 0x7efeb40c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54802/0 (socket says 172.21.15.18:54802) 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeab400640 1 -- 172.21.15.18:0/3198563675 learned_addr learned my addr 172.21.15.18:0/3198563675 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:47.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeb8a00640 1 --2- 172.21.15.18:0/3198563675 >> v2:172.21.15.167:3300/0 conn(0x7efeb40c72a0 0x7efeb40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeb8a00640 1 -- 172.21.15.18:0/3198563675 >> v1:172.21.15.167:6789/0 conn(0x7efeb415dc00 legacy=0x7efeb40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeb8a00640 1 -- 172.21.15.18:0/3198563675 >> v1:172.21.15.18:6789/0 conn(0x7efeb40d0150 legacy=0x7efeb40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.416+0000 7efeb8a00640 1 -- 172.21.15.18:0/3198563675 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb40cd210 con 0x7efeb40c72a0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efeb8a00640 1 --2- 172.21.15.18:0/3198563675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb40af770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efeac009d90 tx=0x7efeac01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=250b246068d64d0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efeb3400640 1 -- 172.21.15.18:0/3198563675 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0b2070 con 0x7efeb40c72a0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efeb3400640 1 -- 172.21.15.18:0/3198563675 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac0a5740 con 0x7efeb40c72a0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efeb3400640 1 -- 172.21.15.18:0/3198563675 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0a5b10 con 0x7efeb40c72a0 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 -- 172.21.15.18:0/3198563675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 msgr2=0x7efeb40af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 --2- 172.21.15.18:0/3198563675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb40af770 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efeac009d90 tx=0x7efeac01c970 comp rx=0 tx=0).stop 2024-04-25T10:05:47.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 -- 172.21.15.18:0/3198563675 shutdown_connections 2024-04-25T10:05:47.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 --2- 172.21.15.18:0/3198563675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb40af770 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 -- 172.21.15.18:0/3198563675 >> 172.21.15.18:0/3198563675 conn(0x7efeb40b2240 msgr2=0x7efeb40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:47.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 -- 172.21.15.18:0/3198563675 shutdown_connections 2024-04-25T10:05:47.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.420+0000 7efebaa00640 1 -- 172.21.15.18:0/3198563675 wait complete. 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 Processor -- start 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- start start 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb415dc00 0x7efeb414ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:47.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb416b7d0 con 0x7efeb40d0150 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb416b650 con 0x7efeb40c72a0 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb416b950 con 0x7efeb415dc00 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57926/0 (socket says 172.21.15.18:57926) 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 -- 172.21.15.18:0/1976688469 learned_addr learned my addr 172.21.15.18:0/1976688469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeb3e00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 -- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb415dc00 msgr2=0x7efeb414ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb415dc00 0x7efeb414ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 -- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 msgr2=0x7efeb414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 -- 172.21.15.18:0/1976688469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4153e30 con 0x7efeb40d0150 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeb3e00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeab400640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c530 tx=0x7efe9c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:47.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c017070 con 0x7efeb40d0150 2024-04-25T10:05:47.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c005cf0 con 0x7efeb40d0150 2024-04-25T10:05:47.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb4153b50 con 0x7efeb40d0150 2024-04-25T10:05:47.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c007270 con 0x7efeb40d0150 2024-04-25T10:05:47.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb414f0b0 con 0x7efeb40d0150 2024-04-25T10:05:47.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.424+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb40745d0 con 0x7efeb40d0150 2024-04-25T10:05:47.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.428+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe9c01a070 con 0x7efeb40d0150 2024-04-25T10:05:47.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.428+0000 7efeb0c00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 0x7efe90069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:47.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.428+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5619+0+0 (secure 0 0 0) 0x7efe9c084680 con 0x7efeb40d0150 2024-04-25T10:05:47.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.428+0000 7efeb3e00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 0x7efe90069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:47.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.428+0000 7efeb3e00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 0x7efe90069450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efea4001650 tx=0x7efea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:47.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.432+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe9c0550e0 con 0x7efeb40d0150 2024-04-25T10:05:47.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:47.596+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efeb40cf370 con 0x7efeb40d0150 2024-04-25T10:05:48.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.244+0000 7efeb0c00640 1 -- 172.21.15.18:0/1976688469 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v51) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe9c059180 con 0x7efeb40d0150 2024-04-25T10:05:48.256 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:05:48.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 msgr2=0x7efe90069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 0x7efe90069450 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7efea4001650 tx=0x7efea4009040 comp rx=0 tx=0).stop 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 msgr2=0x7efeb41531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00c530 tx=0x7efe9c00c9f0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 shutdown_connections 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe90066f90 0x7efe90069450 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efeb415dc00 0x7efeb414ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efeb40d0150 0x7efeb41531d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 --2- 172.21.15.18:0/1976688469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb40c72a0 0x7efeb414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 >> 172.21.15.18:0/1976688469 conn(0x7efeb40b2240 msgr2=0x7efeb40c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:48.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 shutdown_connections 2024-04-25T10:05:48.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.248+0000 7efebaa00640 1 -- 172.21.15.18:0/1976688469 wait complete. 2024-04-25T10:05:48.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:05:48.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.428+0000 7fbfd4200640 1 Processor -- start 2024-04-25T10:05:48.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.428+0000 7fbfd4200640 1 -- start start 2024-04-25T10:05:48.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd4200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbfcc0b3090 0x7fbfcc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:48.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd4200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc15bc40 con 0x7fbfcc15acd0 2024-04-25T10:05:48.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd4200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfcc15b3a0 con 0x7fbfcc144120 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd4200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfcc15e490 con 0x7fbfcc0b3090 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbfcc0b3090 0x7fbfcc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbfcc0b3090 0x7fbfcc0b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57934/0 (socket says 172.21.15.18:57934) 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 -- 172.21.15.18:0/602683536 learned_addr learned my addr 172.21.15.18:0/602683536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd0e00640 1 --1- 172.21.15.18:0/602683536 >> v1:172.21.15.18:6789/0 conn(0x7fbfcc15acd0 0x7fbfcc15e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54808/0 (socket says 172.21.15.18:54808) 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 -- 172.21.15.18:0/602683536 >> v1:172.21.15.167:6789/0 conn(0x7fbfcc144120 legacy=0x7fbfcc0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 -- 172.21.15.18:0/602683536 >> v1:172.21.15.18:6789/0 conn(0x7fbfcc15acd0 legacy=0x7fbfcc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfcbe00640 1 -- 172.21.15.18:0/602683536 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325123288 0 0) 0x7fbfcc15bc40 con 0x7fbfcc15acd0 2024-04-25T10:05:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.432+0000 7fbfd2200640 1 -- 172.21.15.18:0/602683536 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc15b680 con 0x7fbfcc0b3090 2024-04-25T10:05:48.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd2200640 1 --2- 172.21.15.18:0/602683536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc0b3520 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63745f194c8281e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:48.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfcbe00640 1 -- 172.21.15.18:0/602683536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5620 con 0x7fbfcc0b3090 2024-04-25T10:05:48.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfcbe00640 1 -- 172.21.15.18:0/602683536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40a57c0 con 0x7fbfcc0b3090 2024-04-25T10:05:48.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfcbe00640 1 -- 172.21.15.18:0/602683536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40a5b90 con 0x7fbfcc0b3090 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- 172.21.15.18:0/602683536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc0b3090 msgr2=0x7fbfcc0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 --2- 172.21.15.18:0/602683536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc0b3520 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbfc4009e50 tx=0x7fbfc401c960 comp rx=0 tx=0).stop 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- 172.21.15.18:0/602683536 shutdown_connections 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 --2- 172.21.15.18:0/602683536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc0b3520 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- 172.21.15.18:0/602683536 >> 172.21.15.18:0/602683536 conn(0x7fbfcc067080 msgr2=0x7fbfcc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- 172.21.15.18:0/602683536 shutdown_connections 2024-04-25T10:05:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- 172.21.15.18:0/602683536 wait complete. 2024-04-25T10:05:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 Processor -- start 2024-04-25T10:05:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- start start 2024-04-25T10:05:48.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc13f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:48.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 0x7fbfcc165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06d660 con 0x7fbfcc15acd0 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06d4e0 con 0x7fbfcc0b3090 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.436+0000 7fbfd4200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfcc06d7e0 con 0x7fbfcc144120 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57938/0 (socket says 172.21.15.18:57938) 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 -- 172.21.15.18:0/3961825344 learned_addr learned my addr 172.21.15.18:0/3961825344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd1800640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd0e00640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 0x7fbfcc165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 -- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 msgr2=0x7fbfcc165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 0x7fbfcc165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 -- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfcc0b3090 msgr2=0x7fbfcc13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 -- 172.21.15.18:0/3961825344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc1606e0 con 0x7fbfcc15acd0 2024-04-25T10:05:48.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd0e00640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 0x7fbfcc165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:48.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd2200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40af040 tx=0x7fbfc4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40bc020 con 0x7fbfcc15acd0 2024-04-25T10:05:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc40b8670 con 0x7fbfcc15acd0 2024-04-25T10:05:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfcc160a20 con 0x7fbfcc15acd0 2024-04-25T10:05:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc40b8a60 con 0x7fbfcc15acd0 2024-04-25T10:05:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfcc161260 con 0x7fbfcc15acd0 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfcc0745d0 con 0x7fbfcc15acd0 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.440+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbfc40bf020 con 0x7fbfcc15acd0 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.444+0000 7fbfc9600640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 0x7fbfac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.444+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fbfc4120840 con 0x7fbfcc15acd0 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.444+0000 7fbfd1800640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 0x7fbfac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:48.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.444+0000 7fbfd1800640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 0x7fbfac069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0b1260 tx=0x7fbfc0007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:48.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.448+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbfc40c6030 con 0x7fbfcc15acd0 2024-04-25T10:05:48.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:48.640+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbfcc0b2050 con 0x7fbfcc15acd0 2024-04-25T10:05:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.248+0000 7fbfc9600640 1 -- 172.21.15.18:0/3961825344 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbfcc160a20 con 0x7fbfcc15acd0 2024-04-25T10:05:49.258 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T10:05:49.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 msgr2=0x7fbfac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 0x7fbfac069420 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc0b1260 tx=0x7fbfc0007e40 comp rx=0 tx=0).stop 2024-04-25T10:05:49.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 msgr2=0x7fbfcc161a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fbfc40af040 tx=0x7fbfc4019700 comp rx=0 tx=0).stop 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 shutdown_connections 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfcc15acd0 0x7fbfcc161a60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbfac066f60 0x7fbfac069420 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfcc144120 0x7fbfcc165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 --2- 172.21.15.18:0/3961825344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfcc0b3090 0x7fbfcc13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 >> 172.21.15.18:0/3961825344 conn(0x7fbfcc067080 msgr2=0x7fbfcc0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 shutdown_connections 2024-04-25T10:05:49.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.252+0000 7fbfd4200640 1 -- 172.21.15.18:0/3961825344 wait complete. 2024-04-25T10:05:49.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.440+0000 7f114e800640 1 Processor -- start 2024-04-25T10:05:49.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.440+0000 7f114e800640 1 -- start start 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f114e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f11480afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f114e800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f11480b4210 0x7f11480b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f114e800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114815ddf0 con 0x7f114815da10 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f114e800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11480b4bc0 con 0x7f11480b4210 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f114e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114806b480 con 0x7f11480d11b0 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f114815da10 0x7f114806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54812/0 (socket says 172.21.15.18:54812) 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 -- 172.21.15.18:0/2977223931 learned_addr learned my addr 172.21.15.18:0/2977223931 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f113fe00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f11480afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147e00640 1 --2- 172.21.15.18:0/2977223931 >> v2:172.21.15.167:3300/0 conn(0x7f11480b4210 0x7f11480b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864972727 0 0) 0x7f114815ddf0 con 0x7f114815da10 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f112c003530 con 0x7f114815da10 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720462764 0 0) 0x7f112c003530 con 0x7f114815da10 2024-04-25T10:05:49.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 msgr2=0x7f11480afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f11480afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 >> v2:172.21.15.167:3300/0 conn(0x7f11480b4210 msgr2=0x7f11480b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 --2- 172.21.15.18:0/2977223931 >> v2:172.21.15.167:3300/0 conn(0x7f11480b4210 0x7f11480b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11480d06d0 con 0x7f114815da10 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f1138001680 con 0x7f114815da10 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f113fe00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f11480afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 >> v1:172.21.15.18:6789/0 conn(0x7f114815da10 legacy=0x7f114806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c0039c0 0x7f112c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f112c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c004d50 0x7f112c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11480b4bc0 con 0x7f112c0039c0 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114806b480 con 0x7f112c004d50 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112c00b9d0 con 0x7f11480d11b0 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147e00640 1 --2- 172.21.15.18:0/2977223931 >> v2:172.21.15.167:3300/0 conn(0x7f11480b4210 0x7f11480b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:49.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c0039c0 0x7f112c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f113fe00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f112c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147e00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c004d50 0x7f112c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 -- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 msgr2=0x7f112c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11480d11b0 0x7f112c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 -- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c004d50 msgr2=0x7f112c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c004d50 0x7f112c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147400640 1 -- 172.21.15.18:0/2977223931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c003530 con 0x7f112c0039c0 2024-04-25T10:05:49.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.444+0000 7f1147e00640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c004d50 0x7f112c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f1147400640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c0039c0 0x7f112c003de0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f113800c2c0 tx=0x7f113801cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256ff7231dd7101 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138007d60 con 0x7f112c0039c0 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a9020 con 0x7f112c0039c0 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f1146a00640 1 -- 172.21.15.18:0/2977223931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1138005ae0 con 0x7f112c0039c0 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- 172.21.15.18:0/2977223931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c0039c0 msgr2=0x7f112c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 --2- 172.21.15.18:0/2977223931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112c0039c0 0x7f112c003de0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f113800c2c0 tx=0x7f113801cce0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f1147e00640 1 -- 172.21.15.18:0/2977223931 reap_dead start 2024-04-25T10:05:49.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- 172.21.15.18:0/2977223931 shutdown_connections 2024-04-25T10:05:49.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- 172.21.15.18:0/2977223931 >> 172.21.15.18:0/2977223931 conn(0x7f11480b2400 msgr2=0x7f11480b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:49.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- 172.21.15.18:0/2977223931 shutdown_connections 2024-04-25T10:05:49.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- 172.21.15.18:0/2977223931 wait complete. 2024-04-25T10:05:49.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 Processor -- start 2024-04-25T10:05:49.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.448+0000 7f114e800640 1 -- start start 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c0039c0 0x7f11480cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1148160d00 0x7f11480cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1148162150 con 0x7f11480cf710 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1148161fd0 con 0x7f112c0039c0 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11481622d0 con 0x7f1148160d00 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f113fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1148160d00 0x7f11480cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57954/0 (socket says 172.21.15.18:57954) 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 -- 172.21.15.18:0/683672541 learned_addr learned my addr 172.21.15.18:0/683672541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147400640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c0039c0 0x7f11480cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 -- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1148160d00 msgr2=0x7f11480cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1148160d00 0x7f11480cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 -- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c0039c0 msgr2=0x7f11480cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c0039c0 0x7f11480cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 -- 172.21.15.18:0/683672541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1148164750 con 0x7f11480cf710 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f1147e00640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f114806bac0 tx=0x7f11400115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11400039a0 con 0x7f11480cf710 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114001b070 con 0x7f11480cf710 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11480cfcb0 con 0x7f11480cf710 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1140003b40 con 0x7f11480cf710 2024-04-25T10:05:49.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11480d0270 con 0x7f11480cf710 2024-04-25T10:05:49.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11480745d0 con 0x7f11480cf710 2024-04-25T10:05:49.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.452+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1140003ce0 con 0x7f11480cf710 2024-04-25T10:05:49.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.456+0000 7f113f400640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 0x7f1124069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.456+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1140085970 con 0x7f11480cf710 2024-04-25T10:05:49.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.456+0000 7f1147400640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 0x7f1124069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.456+0000 7f1147400640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 0x7f1124069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f11380aa000 tx=0x7f1138001a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.460+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1140056100 con 0x7f11480cf710 2024-04-25T10:05:49.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.620+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1148072860 con 0x7f11480cf710 2024-04-25T10:05:49.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f113f400640 1 -- 172.21.15.18:0/683672541 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16931 (secure 0 0 0) 0x7f114005a1a0 con 0x7f11480cf710 2024-04-25T10:05:49.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:49.634 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":52,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:48.647226+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 msgr2=0x7f1124069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 0x7f1124069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f11380aa000 tx=0x7f1138001a50 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 msgr2=0x7f1148148d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f114806bac0 tx=0x7f11400115a0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 shutdown_connections 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11480cf710 0x7f1148148d90 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1124066f60 0x7f1124069420 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1148160d00 0x7f11480cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 --2- 172.21.15.18:0/683672541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f112c0039c0 0x7f11480cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 >> 172.21.15.18:0/683672541 conn(0x7f11480b2400 msgr2=0x7f11480b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 shutdown_connections 2024-04-25T10:05:49.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.624+0000 7f114e800640 1 -- 172.21.15.18:0/683672541 wait complete. 2024-04-25T10:05:49.654 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:49.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 Processor -- start 2024-04-25T10:05:49.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 -- start start 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 0x7fec5c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fec5c0b4210 0x7fec5c0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec5c15ddf0 con 0x7fec5c15da10 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec5c0b4bc0 con 0x7fec5c0b4210 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec62800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c06b480 con 0x7fec5c0d11b0 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec5b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fec5c15da10 0x7fec5c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54824/0 (socket says 172.21.15.18:54824) 2024-04-25T10:05:49.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.784+0000 7fec5b400640 1 -- 172.21.15.18:0/3660974619 learned_addr learned my addr 172.21.15.18:0/3660974619 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:49.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 --2- 172.21.15.18:0/3660974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 0x7fec5c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5be00640 1 --2- 172.21.15.18:0/3660974619 >> v2:172.21.15.167:3300/0 conn(0x7fec5c0b4210 0x7fec5c0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5aa00640 1 -- 172.21.15.18:0/3660974619 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135901454 0 0) 0x7fec5c15ddf0 con 0x7fec5c15da10 2024-04-25T10:05:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5aa00640 1 -- 172.21.15.18:0/3660974619 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec40003530 con 0x7fec5c15da10 2024-04-25T10:05:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 -- 172.21.15.18:0/3660974619 >> v2:172.21.15.167:3300/0 conn(0x7fec5c0b4210 msgr2=0x7fec5c0b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 --2- 172.21.15.18:0/3660974619 >> v2:172.21.15.167:3300/0 conn(0x7fec5c0b4210 0x7fec5c0b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 -- 172.21.15.18:0/3660974619 >> v1:172.21.15.18:6789/0 conn(0x7fec5c15da10 legacy=0x7fec5c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 -- 172.21.15.18:0/3660974619 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0d06d0 con 0x7fec5c0d11b0 2024-04-25T10:05:49.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec52a00640 1 --2- 172.21.15.18:0/3660974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 0x7fec5c0afe20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec440097c0 tx=0x7fec4401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca475d04fd514fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5aa00640 1 -- 172.21.15.18:0/3660974619 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440b0070 con 0x7fec5c0d11b0 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5aa00640 1 -- 172.21.15.18:0/3660974619 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec440ab600 con 0x7fec5c0d11b0 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.788+0000 7fec5aa00640 1 -- 172.21.15.18:0/3660974619 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440ab9d0 con 0x7fec5c0d11b0 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- 172.21.15.18:0/3660974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 msgr2=0x7fec5c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- 172.21.15.18:0/3660974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 0x7fec5c0afe20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec440097c0 tx=0x7fec4401c410 comp rx=0 tx=0).stop 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- 172.21.15.18:0/3660974619 shutdown_connections 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- 172.21.15.18:0/3660974619 >> v2:172.21.15.167:3300/0 conn(0x7fec5c0b4210 0x7fec5c0b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- 172.21.15.18:0/3660974619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c0d11b0 0x7fec5c0afe20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- 172.21.15.18:0/3660974619 >> 172.21.15.18:0/3660974619 conn(0x7fec5c0b2400 msgr2=0x7fec5c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:49.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- 172.21.15.18:0/3660974619 shutdown_connections 2024-04-25T10:05:49.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- 172.21.15.18:0/3660974619 wait complete. 2024-04-25T10:05:49.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 Processor -- start 2024-04-25T10:05:49.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- start start 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 0x7fec5c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 0x7fec5c1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c162190 con 0x7fec5c0d11b0 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c162010 con 0x7fec5c0b4210 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec62800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec5c162310 con 0x7fec5c15da10 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57968/0 (socket says 172.21.15.18:57968) 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 -- 172.21.15.18:0/484634380 learned_addr learned my addr 172.21.15.18:0/484634380 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:49.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec5b400640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 0x7fec5c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec5be00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 0x7fec5c1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 -- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 msgr2=0x7fec5c1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 0x7fec5c1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 -- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 msgr2=0x7fec5c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 0x7fec5c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec52a00640 1 -- 172.21.15.18:0/484634380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c0b1670 con 0x7fec5c0d11b0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec5b400640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 0x7fec5c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.792+0000 7fec5be00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 0x7fec5c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec52a00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fec440ae040 tx=0x7fec440191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440b0040 con 0x7fec5c0d11b0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec440b9070 con 0x7fec5c0d11b0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec5c0b0090 con 0x7fec5c0d11b0 2024-04-25T10:05:49.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec440b4650 con 0x7fec5c0d11b0 2024-04-25T10:05:49.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec5c0b0650 con 0x7fec5c0d11b0 2024-04-25T10:05:49.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c0745d0 con 0x7fec5c0d11b0 2024-04-25T10:05:49.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec440b47f0 con 0x7fec5c0d11b0 2024-04-25T10:05:49.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 0x7fec38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:49.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fec4411eee0 con 0x7fec5c0d11b0 2024-04-25T10:05:49.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.796+0000 7fec5b400640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 0x7fec38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:49.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.800+0000 7fec5b400640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 0x7fec38069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fec4c005890 tx=0x7fec4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:49.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.800+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec44016090 con 0x7fec5c0d11b0 2024-04-25T10:05:49.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.964+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec5c160f20 con 0x7fec5c0d11b0 2024-04-25T10:05:49.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.964+0000 7fec53e00640 1 -- 172.21.15.18:0/484634380 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16931 (secure 0 0 0) 0x7fec440efc40 con 0x7fec5c0d11b0 2024-04-25T10:05:49.976 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:49.976 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":52,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:48.647226+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 msgr2=0x7fec38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 0x7fec38069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fec4c005890 tx=0x7fec4c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 msgr2=0x7fec5c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fec440ae040 tx=0x7fec440191b0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 shutdown_connections 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec38066f60 0x7fec38069420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec5c15da10 0x7fec5c1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec5c0d11b0 0x7fec5c0b1130 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 --2- 172.21.15.18:0/484634380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec5c0b4210 0x7fec5c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 >> 172.21.15.18:0/484634380 conn(0x7fec5c0b2400 msgr2=0x7fec5c15c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 shutdown_connections 2024-04-25T10:05:49.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:49.968+0000 7fec62800640 1 -- 172.21.15.18:0/484634380 wait complete. 2024-04-25T10:05:49.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:05:50.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.132+0000 7f5946000640 1 Processor -- start 2024-04-25T10:05:50.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.132+0000 7f5946000640 1 -- start start 2024-04-25T10:05:50.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5946000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f59400cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5946000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59400d0080 0x7f594015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5946000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594009ade0 con 0x7f594015f8f0 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5946000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f594015fd20 con 0x7f59400d0080 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5946000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5940099a60 con 0x7f594015b9e0 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59400d0080 0x7f594015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59400d0080 0x7f594015f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57970/0 (socket says 172.21.15.18:57970) 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 -- 172.21.15.18:0/3043188862 learned_addr learned my addr 172.21.15.18:0/3043188862 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5944c00640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f59400cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 -- 172.21.15.18:0/3043188862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 msgr2=0x7f59400cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f59400cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 -- 172.21.15.18:0/3043188862 >> v1:172.21.15.167:6789/0 conn(0x7f594015f8f0 legacy=0x7f594015bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 -- 172.21.15.18:0/3043188862 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940099d40 con 0x7f59400d0080 2024-04-25T10:05:50.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f5944c00640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f59400cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:50.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.136+0000 7f593fe00640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59400d0080 0x7f594015f3b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f592c009870 tx=0x7f592c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64ad6041d29450b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f593f400640 1 -- 172.21.15.18:0/3043188862 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0a9620 con 0x7f59400d0080 2024-04-25T10:05:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f593f400640 1 -- 172.21.15.18:0/3043188862 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0a97c0 con 0x7f59400d0080 2024-04-25T10:05:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f593f400640 1 -- 172.21.15.18:0/3043188862 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0a9b90 con 0x7f59400d0080 2024-04-25T10:05:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- 172.21.15.18:0/3043188862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59400d0080 msgr2=0x7f594015f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:50.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59400d0080 0x7f594015f3b0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f592c009870 tx=0x7f592c01c560 comp rx=0 tx=0).stop 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- 172.21.15.18:0/3043188862 shutdown_connections 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59400d0080 0x7f594015f3b0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- 172.21.15.18:0/3043188862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f59400cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- 172.21.15.18:0/3043188862 >> 172.21.15.18:0/3043188862 conn(0x7f59400b3030 msgr2=0x7f59400b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- 172.21.15.18:0/3043188862 shutdown_connections 2024-04-25T10:05:50.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- 172.21.15.18:0/3043188862 wait complete. 2024-04-25T10:05:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 Processor -- start 2024-04-25T10:05:50.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- start start 2024-04-25T10:05:50.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 0x7f594014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f5940159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401686f0 con 0x7f594015f8f0 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594009a8c0 con 0x7f59400d0080 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5946000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5940168870 con 0x7f594015b9e0 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.140+0000 7f5945600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5944c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 0x7f594014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5944c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 0x7f594014e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:40834/0 (socket says 172.21.15.18:40834) 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5944c00640 1 -- 172.21.15.18:0/1179881689 learned_addr learned my addr 172.21.15.18:0/1179881689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57982/0 (socket says 172.21.15.18:57982) 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f593fe00640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f5940159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 -- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 msgr2=0x7f5940159300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:50.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f5940159300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 -- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 msgr2=0x7f594014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 0x7f594014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 -- 172.21.15.18:0/1179881689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5940159ec0 con 0x7f594015f8f0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5945600640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f593800c730 tx=0x7f593800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938003b80 con 0x7f594015f8f0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5938003d20 con 0x7f594015f8f0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593800aa30 con 0x7f594015f8f0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594015a1a0 con 0x7f594015f8f0 2024-04-25T10:05:50.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594015a760 con 0x7f594015f8f0 2024-04-25T10:05:50.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59400745d0 con 0x7f594015f8f0 2024-04-25T10:05:50.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.144+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f593800abd0 con 0x7f594015f8f0 2024-04-25T10:05:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.148+0000 7f593cc00640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 0x7f5920069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.148+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5938084ef0 con 0x7f594015f8f0 2024-04-25T10:05:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.148+0000 7f5944c00640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 0x7f5920069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:50.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.148+0000 7f5944c00640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 0x7f5920069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a10 tx=0x7f5934008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:50.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.152+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f594009ade0 con 0x7f594015f8f0 2024-04-25T10:05:50.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:50.352+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f59400d1320 con 0x7f594015f8f0 2024-04-25T10:05:50.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:50.520 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:05:51.230 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:05:51.225+0000 7f940fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:05:51.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.272+0000 7f593cc00640 1 -- 172.21.15.18:0/1179881689 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5938055720 con 0x7f594015f8f0 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 msgr2=0x7f5920069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 0x7f5920069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5934009a10 tx=0x7f5934008040 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 msgr2=0x7f5940159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f593800c730 tx=0x7f593800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 shutdown_connections 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f594015f8f0 0x7f5940159840 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5920066f60 0x7f5920069420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f594015b9e0 0x7f5940159300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 --2- 172.21.15.18:0/1179881689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59400d0080 0x7f594014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 >> 172.21.15.18:0/1179881689 conn(0x7f59400b3030 msgr2=0x7f59400cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:51.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 shutdown_connections 2024-04-25T10:05:51.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.276+0000 7f5946000640 1 -- 172.21.15.18:0/1179881689 wait complete. 2024-04-25T10:05:51.310 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:05:51.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:05:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 Processor -- start 2024-04-25T10:05:51.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 -- start start 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f255806bf30 0x7f25580d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255815e040 con 0x7f255809a170 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580cff80 con 0x7f255815dc60 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255f600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25580d0260 con 0x7f255806bf30 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255d600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f255806bf30 0x7f25580d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f2557e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f255809a170 0x7f25580cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54828/0 (socket says 172.21.15.18:54828) 2024-04-25T10:05:51.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f2557e00640 1 -- 172.21.15.18:0/2793673343 learned_addr learned my addr 172.21.15.18:0/2793673343 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:51.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255d600640 1 -- 172.21.15.18:0/2793673343 >> v1:172.21.15.167:6789/0 conn(0x7f255815dc60 legacy=0x7f2558099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f255d600640 1 -- 172.21.15.18:0/2793673343 >> v1:172.21.15.18:6789/0 conn(0x7f255809a170 legacy=0x7f25580cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.448+0000 7f2557400640 1 -- 172.21.15.18:0/2793673343 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940899709 0 0) 0x7f255815e040 con 0x7f255809a170 2024-04-25T10:05:51.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255d600640 1 -- 172.21.15.18:0/2793673343 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580d0540 con 0x7f255806bf30 2024-04-25T10:05:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255d600640 1 --2- 172.21.15.18:0/2793673343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255806bf30 0x7f25580d1020 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2550009d90 tx=0x7f255001c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc11c48394b57a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f2557400640 1 -- 172.21.15.18:0/2793673343 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500b2070 con 0x7f255806bf30 2024-04-25T10:05:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f2557400640 1 -- 172.21.15.18:0/2793673343 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500a58e0 con 0x7f255806bf30 2024-04-25T10:05:51.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f2557400640 1 -- 172.21.15.18:0/2793673343 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500a5cb0 con 0x7f255806bf30 2024-04-25T10:05:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 -- 172.21.15.18:0/2793673343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255806bf30 msgr2=0x7f25580d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 --2- 172.21.15.18:0/2793673343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255806bf30 0x7f25580d1020 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2550009d90 tx=0x7f255001c820 comp rx=0 tx=0).stop 2024-04-25T10:05:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 -- 172.21.15.18:0/2793673343 shutdown_connections 2024-04-25T10:05:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 --2- 172.21.15.18:0/2793673343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255806bf30 0x7f25580d1020 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 -- 172.21.15.18:0/2793673343 >> 172.21.15.18:0/2793673343 conn(0x7f25580b3200 msgr2=0x7f25580b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 -- 172.21.15.18:0/2793673343 shutdown_connections 2024-04-25T10:05:51.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.452+0000 7f255f600640 1 -- 172.21.15.18:0/2793673343 wait complete. 2024-04-25T10:05:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 Processor -- start 2024-04-25T10:05:51.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- start start 2024-04-25T10:05:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 0x7f25581f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:51.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 0x7f255815ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255806cfa0 con 0x7f255815dc60 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580cc880 con 0x7f255809a170 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c8880 con 0x7f255806bf30 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:58008/0 (socket says 172.21.15.18:58008) 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 -- 172.21.15.18:0/1834932620 learned_addr learned my addr 172.21.15.18:0/1834932620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f2557e00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 0x7f255815ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255cc00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 0x7f25581f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 -- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 msgr2=0x7f25581f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 0x7f25581f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 -- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 msgr2=0x7f255815ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 0x7f255815ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:51.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 -- 172.21.15.18:0/1834932620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558153130 con 0x7f255815dc60 2024-04-25T10:05:51.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f2557e00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 0x7f255815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:51.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255cc00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 0x7f25581f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:51.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255d600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f255001a450 tx=0x7f25500195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500bd020 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500ad6c0 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25581f79c0 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25500b2040 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.456+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25581f7f80 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580745d0 con 0x7f255815dc60 2024-04-25T10:05:51.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f25500c0020 con 0x7f255815dc60 2024-04-25T10:05:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f2554c00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 0x7f2538069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f25501202c0 con 0x7f255815dc60 2024-04-25T10:05:51.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f255cc00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 0x7f2538069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:51.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.460+0000 7f255cc00640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 0x7f2538069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f25580cb9c0 tx=0x7f2548009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:51.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.464+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f25500c7030 con 0x7f255815dc60 2024-04-25T10:05:51.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:51.664+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f25580b7590 con 0x7f255815dc60 2024-04-25T10:05:52.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.280+0000 7f2554c00640 1 -- 172.21.15.18:0/1834932620 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2558153130 con 0x7f255815dc60 2024-04-25T10:05:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 msgr2=0x7f2538069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 0x7f2538069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f25580cb9c0 tx=0x7f2548009040 comp rx=0 tx=0).stop 2024-04-25T10:05:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 msgr2=0x7f2558152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f255001a450 tx=0x7f25500195c0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 shutdown_connections 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f255815dc60 0x7f2558152760 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f255809a170 0x7f255815ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2538066f60 0x7f2538069420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 --2- 172.21.15.18:0/1834932620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f255806bf30 0x7f25581f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 >> 172.21.15.18:0/1834932620 conn(0x7f25580b3200 msgr2=0x7f25581594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 shutdown_connections 2024-04-25T10:05:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.284+0000 7f255f600640 1 -- 172.21.15.18:0/1834932620 wait complete. 2024-04-25T10:05:52.316 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:05:52.316 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:52.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.448+0000 7ff336800640 1 Processor -- start 2024-04-25T10:05:52.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.448+0000 7ff336800640 1 -- start start 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff336800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff33015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff336800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3300cc4e0 con 0x7ff3300cd4d0 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff336800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3300ce040 con 0x7ff3300b1e60 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff336800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff330145650 con 0x7ff330145270 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff3300cd4d0 0x7ff3300b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47634/0 (socket says 172.21.15.18:47634) 2024-04-25T10:05:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 -- 172.21.15.18:0/1275899379 learned_addr learned my addr 172.21.15.18:0/1275899379 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:52.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32f400640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff33015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453137947 0 0) 0x7ff3300cc4e0 con 0x7ff3300cd4d0 2024-04-25T10:05:52.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff314003530 con 0x7ff3300cd4d0 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2034098546 0 0) 0x7ff314003530 con 0x7ff3300cd4d0 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 msgr2=0x7ff33015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff33015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 >> v1:172.21.15.167:6789/0 conn(0x7ff3300b1e60 legacy=0x7ff33015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300ce320 con 0x7ff3300cd4d0 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff318001680 con 0x7ff3300cd4d0 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 >> v1:172.21.15.18:6789/0 conn(0x7ff3300cd4d0 legacy=0x7ff3300b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3140039f0 0x7ff314003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff314004810 0x7ff314004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff3140051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff330145650 con 0x7ff314004810 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31400ba80 con 0x7ff3140039f0 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31400bc80 con 0x7ff330145270 2024-04-25T10:05:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff314004810 0x7ff314004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32f400640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3140039f0 0x7ff314003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff32fe00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff3140051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 -- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 msgr2=0x7ff3140051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff330145270 0x7ff3140051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 -- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3140039f0 msgr2=0x7ff314003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3140039f0 0x7ff314003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.452+0000 7ff327e00640 1 -- 172.21.15.18:0/1275899379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff314003530 con 0x7ff314004810 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff327e00640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff314004810 0x7ff314004c90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff31800c190 tx=0x7ff31801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95619c852151b237 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318007d00 con 0x7ff314004810 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff318005b00 con 0x7ff314004810 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff32ea00640 1 -- 172.21.15.18:0/1275899379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff318007070 con 0x7ff314004810 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 -- 172.21.15.18:0/1275899379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff314004810 msgr2=0x7ff314004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 --2- 172.21.15.18:0/1275899379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff314004810 0x7ff314004c90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff31800c190 tx=0x7ff31801f370 comp rx=0 tx=0).stop 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff32fe00640 1 -- 172.21.15.18:0/1275899379 reap_dead start 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 -- 172.21.15.18:0/1275899379 shutdown_connections 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 -- 172.21.15.18:0/1275899379 >> 172.21.15.18:0/1275899379 conn(0x7ff330066fa0 msgr2=0x7ff33006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 -- 172.21.15.18:0/1275899379 shutdown_connections 2024-04-25T10:05:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 -- 172.21.15.18:0/1275899379 wait complete. 2024-04-25T10:05:52.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.456+0000 7ff336800640 1 Processor -- start 2024-04-25T10:05:52.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- start start 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff314004810 0x7ff330153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3300ad960 0x7ff3300addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33015f930 con 0x7ff3300b0310 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33015f650 con 0x7ff314004810 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33015fe50 con 0x7ff3300ad960 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42010/0 (socket says 172.21.15.18:42010) 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 -- 172.21.15.18:0/147103825 learned_addr learned my addr 172.21.15.18:0/147103825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff327e00640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3300ad960 0x7ff3300addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32f400640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff314004810 0x7ff330153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 -- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3300ad960 msgr2=0x7ff3300addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3300ad960 0x7ff3300addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 -- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff314004810 msgr2=0x7ff330153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff314004810 0x7ff330153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 -- 172.21.15.18:0/147103825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300acd40 con 0x7ff3300b0310 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff32fe00640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff3300cd1f0 tx=0x7ff32800fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32801a070 con 0x7ff3300b0310 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff328006b60 con 0x7ff3300b0310 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328003980 con 0x7ff3300b0310 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33013f740 con 0x7ff3300b0310 2024-04-25T10:05:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33013fd00 con 0x7ff3300b0310 2024-04-25T10:05:52.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.460+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3300745d0 con 0x7ff3300b0310 2024-04-25T10:05:52.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.464+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff32801d070 con 0x7ff3300b0310 2024-04-25T10:05:52.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.464+0000 7ff327400640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 0x7ff30c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.464+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff328084580 con 0x7ff3300b0310 2024-04-25T10:05:52.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.464+0000 7ff32f400640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 0x7ff30c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.464+0000 7ff32f400640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 0x7ff30c069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff320009be0 tx=0x7ff320009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.468+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff328054db0 con 0x7ff3300b0310 2024-04-25T10:05:52.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.664+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3300b1ad0 con 0x7ff3300b0310 2024-04-25T10:05:52.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff327400640 1 -- 172.21.15.18:0/147103825 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ff328058e50 con 0x7ff3300b0310 2024-04-25T10:05:52.677 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:52.677 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:05:52.678 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:05:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 msgr2=0x7ff30c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 0x7ff30c069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff320009be0 tx=0x7ff320009190 comp rx=0 tx=0).stop 2024-04-25T10:05:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 msgr2=0x7ff3300b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff3300cd1f0 tx=0x7ff32800fc10 comp rx=0 tx=0).stop 2024-04-25T10:05:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 shutdown_connections 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3300b0310 0x7ff3300b0790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff30c066f60 0x7ff30c069420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3300ad960 0x7ff3300addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 --2- 172.21.15.18:0/147103825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff314004810 0x7ff330153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 >> 172.21.15.18:0/147103825 conn(0x7ff330066fa0 msgr2=0x7ff3300aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 shutdown_connections 2024-04-25T10:05:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.668+0000 7ff336800640 1 -- 172.21.15.18:0/147103825 wait complete. 2024-04-25T10:05:52.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:05:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 Processor -- start 2024-04-25T10:05:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 -- start start 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7260099a60 0x7f7260099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f726015ee00 0x7f726006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726009a380 con 0x7f72601616a0 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726006c650 con 0x7f7260099a60 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7267c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726006c930 con 0x7f726015ee00 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7265200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7260099a60 0x7f7260099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7265200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7260099a60 0x7f7260099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42022/0 (socket says 172.21.15.18:42022) 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.828+0000 7f7265200640 1 -- 172.21.15.18:0/536690402 learned_addr learned my addr 172.21.15.18:0/536690402 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f725fe00640 1 --2- 172.21.15.18:0/536690402 >> v2:172.21.15.167:3300/0 conn(0x7f726015ee00 0x7f726006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f7265200640 1 -- 172.21.15.18:0/536690402 >> v2:172.21.15.167:3300/0 conn(0x7f726015ee00 msgr2=0x7f726006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f7265200640 1 --2- 172.21.15.18:0/536690402 >> v2:172.21.15.167:3300/0 conn(0x7f726015ee00 0x7f726006bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f7265200640 1 -- 172.21.15.18:0/536690402 >> v1:172.21.15.167:6789/0 conn(0x7f72601616a0 legacy=0x7f7260161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:52.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f7265200640 1 -- 172.21.15.18:0/536690402 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726006cc10 con 0x7f7260099a60 2024-04-25T10:05:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f7265200640 1 --2- 172.21.15.18:0/536690402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7260099a60 0x7f7260099e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f72600ce1f0 tx=0x7f725401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf419a273b05d6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f725f400640 1 -- 172.21.15.18:0/536690402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72540b2070 con 0x7f7260099a60 2024-04-25T10:05:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f725f400640 1 -- 172.21.15.18:0/536690402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72540ad640 con 0x7f7260099a60 2024-04-25T10:05:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.832+0000 7f725f400640 1 -- 172.21.15.18:0/536690402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72540ada10 con 0x7f7260099a60 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- 172.21.15.18:0/536690402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7260099a60 msgr2=0x7f7260099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- 172.21.15.18:0/536690402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7260099a60 0x7f7260099e40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f72600ce1f0 tx=0x7f725401c4e0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- 172.21.15.18:0/536690402 shutdown_connections 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- 172.21.15.18:0/536690402 >> v2:172.21.15.167:3300/0 conn(0x7f726015ee00 0x7f726006bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- 172.21.15.18:0/536690402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7260099a60 0x7f7260099e40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- 172.21.15.18:0/536690402 >> 172.21.15.18:0/536690402 conn(0x7f72600d17a0 msgr2=0x7f72600d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- 172.21.15.18:0/536690402 shutdown_connections 2024-04-25T10:05:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- 172.21.15.18:0/536690402 wait complete. 2024-04-25T10:05:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 Processor -- start 2024-04-25T10:05:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- start start 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7260099a60 0x7f7260151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726015ee00 0x7f72600cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726006c3e0 con 0x7f72601616a0 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726006c260 con 0x7f726015ee00 2024-04-25T10:05:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7267c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726016b210 con 0x7f7260099a60 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7265c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7265c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42024/0 (socket says 172.21.15.18:42024) 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7265200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7260099a60 0x7f7260151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f7265c00640 1 -- 172.21.15.18:0/2886573002 learned_addr learned my addr 172.21.15.18:0/2886573002 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.836+0000 7f725fe00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726015ee00 0x7f72600cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 -- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7260099a60 msgr2=0x7f7260151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7260099a60 0x7f7260151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 -- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726015ee00 msgr2=0x7f72600cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726015ee00 0x7f72600cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 -- 172.21.15.18:0/2886573002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72601f7770 con 0x7f72601616a0 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f725800c780 tx=0x7f725800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258004b70 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258004d10 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72601f7a50 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725800aa90 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72601f8010 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72600745d0 con 0x7f72601616a0 2024-04-25T10:05:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f725800ac30 con 0x7f72601616a0 2024-04-25T10:05:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 0x7f7240069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72580853b0 con 0x7f72601616a0 2024-04-25T10:05:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.840+0000 7f7265200640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 0x7f7240069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:52.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.844+0000 7f7265200640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 0x7f7240069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f72540af000 tx=0x7f7254008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:52.844+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7258020070 con 0x7f72601616a0 2024-04-25T10:05:53.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.008+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7260067f00 con 0x7f72601616a0 2024-04-25T10:05:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.008+0000 7f725cc00640 1 -- 172.21.15.18:0/2886573002 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16918 (secure 0 0 0) 0x7f7258055b40 con 0x7f72601616a0 2024-04-25T10:05:53.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:53.020 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":53,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:50.266838+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 msgr2=0x7f7240069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 0x7f7240069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f72540af000 tx=0x7f7254008040 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 msgr2=0x7f72600b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f725800c780 tx=0x7f725800cc40 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 shutdown_connections 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72601616a0 0x7f72600b45f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f726015ee00 0x7f72600cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7240066f60 0x7f7240069420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 --2- 172.21.15.18:0/2886573002 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7260099a60 0x7f7260151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 >> 172.21.15.18:0/2886573002 conn(0x7f72600d17a0 msgr2=0x7f7260156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 shutdown_connections 2024-04-25T10:05:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.012+0000 7f7267c00640 1 -- 172.21.15.18:0/2886573002 wait complete. 2024-04-25T10:05:53.041 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:05:53.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 Processor -- start 2024-04-25T10:05:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 -- start start 2024-04-25T10:05:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39e815b140 0x7f39e815e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 0x7f39e80b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e815eda0 con 0x7f39e815b520 2024-04-25T10:05:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80b10e0 con 0x7f39e815b140 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ee400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e8099e00 con 0x7f39e80ce480 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ed000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39e815b140 0x7f39e815e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39dfe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f39e815b520 0x7f39e80cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47648/0 (socket says 172.21.15.18:47648) 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39dfe00640 1 -- 172.21.15.18:0/2689530175 learned_addr learned my addr 172.21.15.18:0/2689530175 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39eda00640 1 --2- 172.21.15.18:0/2689530175 >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 0x7f39e80b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ed000640 1 -- 172.21.15.18:0/2689530175 >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 msgr2=0x7f39e80b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ed000640 1 --2- 172.21.15.18:0/2689530175 >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 0x7f39e80b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ed000640 1 -- 172.21.15.18:0/2689530175 >> v1:172.21.15.18:6789/0 conn(0x7f39e815b520 legacy=0x7f39e80cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39ed000640 1 -- 172.21.15.18:0/2689530175 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e809a0e0 con 0x7f39e815b140 2024-04-25T10:05:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.172+0000 7f39eda00640 1 --2- 172.21.15.18:0/2689530175 >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 0x7f39e80b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ed000640 1 --2- 172.21.15.18:0/2689530175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e815b140 0x7f39e815e860 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f39e80b14b0 tx=0x7f39d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd383e81ba7f135 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39e7e00640 1 -- 172.21.15.18:0/2689530175 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80b1070 con 0x7f39e815b140 2024-04-25T10:05:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39e7e00640 1 -- 172.21.15.18:0/2689530175 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80ac420 con 0x7f39e815b140 2024-04-25T10:05:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39e7e00640 1 -- 172.21.15.18:0/2689530175 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80ac7f0 con 0x7f39e815b140 2024-04-25T10:05:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 -- 172.21.15.18:0/2689530175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e815b140 msgr2=0x7f39e815e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 --2- 172.21.15.18:0/2689530175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e815b140 0x7f39e815e860 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f39e80b14b0 tx=0x7f39d801c3c0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 -- 172.21.15.18:0/2689530175 shutdown_connections 2024-04-25T10:05:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 --2- 172.21.15.18:0/2689530175 >> v2:172.21.15.167:3300/0 conn(0x7f39e80ce480 0x7f39e80b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 --2- 172.21.15.18:0/2689530175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e815b140 0x7f39e815e860 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 -- 172.21.15.18:0/2689530175 >> 172.21.15.18:0/2689530175 conn(0x7f39e80d14f0 msgr2=0x7f39e80d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 -- 172.21.15.18:0/2689530175 shutdown_connections 2024-04-25T10:05:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.176+0000 7f39ee400640 1 -- 172.21.15.18:0/2689530175 wait complete. 2024-04-25T10:05:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 Processor -- start 2024-04-25T10:05:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- start start 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e815b140 0x7f39e814f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 0x7f39e8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8099be0 con 0x7f39e80ce480 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e8099a60 con 0x7f39e815b520 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e806bd20 con 0x7f39e815b140 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42036/0 (socket says 172.21.15.18:42036) 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 -- 172.21.15.18:0/2362359301 learned_addr learned my addr 172.21.15.18:0/2362359301 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39dfe00640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e815b140 0x7f39e814f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39eda00640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 0x7f39e8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 -- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e815b140 msgr2=0x7f39e814f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e815b140 0x7f39e814f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 -- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 msgr2=0x7f39e8152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 0x7f39e8152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 -- 172.21.15.18:0/2362359301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8158de0 con 0x7f39e80ce480 2024-04-25T10:05:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39eda00640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 0x7f39e8152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:53.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ed000640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f39d80af040 tx=0x7f39d801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80b1050 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80bd070 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80b8890 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e81590c0 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e814f5c0 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.180+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e804efa0 con 0x7f39e80ce480 2024-04-25T10:05:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.184+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39d80b8a30 con 0x7f39e80ce480 2024-04-25T10:05:53.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.184+0000 7f39e5600640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 0x7f39c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.184+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f39d811f8d0 con 0x7f39e80ce480 2024-04-25T10:05:53.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.184+0000 7f39dfe00640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 0x7f39c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.184+0000 7f39dfe00640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 0x7f39c4069450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39e80af720 tx=0x7f39d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.188+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39d8016070 con 0x7f39e80ce480 2024-04-25T10:05:53.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.348+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39e80ae2c0 con 0x7f39c4066f90 2024-04-25T10:05:53.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.352+0000 7f39e5600640 1 -- 172.21.15.18:0/2362359301 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243068 (secure 0 0 0) 0x7f39e80ae2c0 con 0x7f39c4066f90 2024-04-25T10:05:53.367 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:53.368 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 msgr2=0x7f39c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 0x7f39c4069450 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39e80af720 tx=0x7f39d0009040 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 msgr2=0x7f39e815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f39d80af040 tx=0x7f39d801ac00 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 shutdown_connections 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e815b520 0x7f39e8152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39c4066f90 0x7f39c4069450 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e815b140 0x7f39e814f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 --2- 172.21.15.18:0/2362359301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39e80ce480 0x7f39e815ab80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 >> 172.21.15.18:0/2362359301 conn(0x7f39e80d14f0 msgr2=0x7f39e80702e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 shutdown_connections 2024-04-25T10:05:53.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.356+0000 7f39ee400640 1 -- 172.21.15.18:0/2362359301 wait complete. 2024-04-25T10:05:53.387 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-04-25T10:05:51.423089+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":118,"acting":118,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234356,"kb_used_data":5700,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754740364,"statfs":{"total":773094113280,"available":772854132736,"internally_reserved":0,"allocated":5836800,"data_stored":3221749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":234016305},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.177781"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264912+0000","last_change":"2024-04-25T10:05:48.264912+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264912+0000","last_undegraded":"2024-04-25T10:05:48.264912+0000","last_fullsized":"2024-04-25T10:05:48.264912+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263046+0000","last_change":"2024-04-25T10:05:48.263046+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263046+0000","last_undegraded":"2024-04-25T10:05:48.263046+0000","last_fullsized":"2024-04-25T10:05:48.263046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260500+0000","last_change":"2024-04-25T10:05:48.260500+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260500+0000","last_undegraded":"2024-04-25T10:05:48.260500+0000","last_fullsized":"2024-04-25T10:05:48.260500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261510+0000","last_change":"2024-04-25T10:05:48.261510+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261510+0000","last_undegraded":"2024-04-25T10:05:48.261510+0000","last_fullsized":"2024-04-25T10:05:48.261510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264029+0000","last_change":"2024-04-25T10:05:48.264029+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264029+0000","last_undegraded":"2024-04-25T10:05:48.264029+0000","last_fullsized":"2024-04-25T10:05:48.264029+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257006+0000","last_change":"2024-04-25T10:05:48.257006+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257006+0000","last_undegraded":"2024-04-25T10:05:48.257006+0000","last_fullsized":"2024-04-25T10:05:48.257006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256159+0000","last_change":"2024-04-25T10:05:48.256159+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256159+0000","last_undegraded":"2024-04-25T10:05:48.256159+0000","last_fullsized":"2024-04-25T10:05:48.256159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256497+0000","last_change":"2024-04-25T10:05:48.256497+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256497+0000","last_undegraded":"2024-04-25T10:05:48.256497+0000","last_fullsized":"2024-04-25T10:05:48.256497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262964+0000","last_change":"2024-04-25T10:05:48.262964+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262964+0000","last_undegraded":"2024-04-25T10:05:48.262964+0000","last_fullsized":"2024-04-25T10:05:48.262964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265891+0000","last_change":"2024-04-25T10:05:48.265891+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265891+0000","last_undegraded":"2024-04-25T10:05:48.265891+0000","last_fullsized":"2024-04-25T10:05:48.265891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261054+0000","last_change":"2024-04-25T10:05:48.261054+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261054+0000","last_undegraded":"2024-04-25T10:05:48.261054+0000","last_fullsized":"2024-04-25T10:05:48.261054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272908+0000","last_change":"2024-04-25T10:05:48.269196+0000","last_active":"2024-04-25T10:05:48.272908+0000","last_peered":"2024-04-25T10:05:48.272908+0000","last_clean":"2024-04-25T10:05:48.272908+0000","last_became_active":"2024-04-25T10:05:48.268189+0000","last_became_peered":"2024-04-25T10:05:48.268189+0000","last_unstale":"2024-04-25T10:05:48.272908+0000","last_undegraded":"2024-04-25T10:05:48.272908+0000","last_fullsized":"2024-04-25T10:05:48.272908+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:22.346700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262585+0000","last_change":"2024-04-25T10:05:48.262585+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262585+0000","last_undegraded":"2024-04-25T10:05:48.262585+0000","last_fullsized":"2024-04-25T10:05:48.262585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.250293+0000","last_change":"2024-04-25T10:05:47.250293+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.250293+0000","last_undegraded":"2024-04-25T10:05:47.250293+0000","last_fullsized":"2024-04-25T10:05:47.250293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257851+0000","last_change":"2024-04-25T10:05:48.257851+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257851+0000","last_undegraded":"2024-04-25T10:05:48.257851+0000","last_fullsized":"2024-04-25T10:05:48.257851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.250304+0000","last_change":"2024-04-25T10:05:47.250304+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.250304+0000","last_undegraded":"2024-04-25T10:05:47.250304+0000","last_fullsized":"2024-04-25T10:05:47.250304+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.280963+0000","last_change":"2024-04-25T10:05:48.275810+0000","last_active":"2024-04-25T10:05:48.280963+0000","last_peered":"2024-04-25T10:05:48.280963+0000","last_clean":"2024-04-25T10:05:48.280963+0000","last_became_active":"2024-04-25T10:05:48.275553+0000","last_became_peered":"2024-04-25T10:05:48.275553+0000","last_unstale":"2024-04-25T10:05:48.280963+0000","last_undegraded":"2024-04-25T10:05:48.280963+0000","last_fullsized":"2024-04-25T10:05:48.280963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259924+0000","last_change":"2024-04-25T10:05:48.259924+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259924+0000","last_undegraded":"2024-04-25T10:05:48.259924+0000","last_fullsized":"2024-04-25T10:05:48.259924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.247530+0000","last_change":"2024-04-25T10:05:47.247530+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.247530+0000","last_undegraded":"2024-04-25T10:05:47.247530+0000","last_fullsized":"2024-04-25T10:05:47.247530+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265323+0000","last_change":"2024-04-25T10:05:48.265323+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265323+0000","last_undegraded":"2024-04-25T10:05:48.265323+0000","last_fullsized":"2024-04-25T10:05:48.265323+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272465+0000","last_change":"2024-04-25T10:05:48.268595+0000","last_active":"2024-04-25T10:05:48.272465+0000","last_peered":"2024-04-25T10:05:48.272465+0000","last_clean":"2024-04-25T10:05:48.272465+0000","last_became_active":"2024-04-25T10:05:48.267579+0000","last_became_peered":"2024-04-25T10:05:48.267579+0000","last_unstale":"2024-04-25T10:05:48.272465+0000","last_undegraded":"2024-04-25T10:05:48.272465+0000","last_fullsized":"2024-04-25T10:05:48.272465+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.298325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272949+0000","last_change":"2024-04-25T10:05:48.269624+0000","last_active":"2024-04-25T10:05:48.272949+0000","last_peered":"2024-04-25T10:05:48.272949+0000","last_clean":"2024-04-25T10:05:48.272949+0000","last_became_active":"2024-04-25T10:05:48.266543+0000","last_became_peered":"2024-04-25T10:05:48.266543+0000","last_unstale":"2024-04-25T10:05:48.272949+0000","last_undegraded":"2024-04-25T10:05:48.272949+0000","last_fullsized":"2024-04-25T10:05:48.272949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:38.293978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263559+0000","last_change":"2024-04-25T10:05:48.263559+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263559+0000","last_undegraded":"2024-04-25T10:05:48.263559+0000","last_fullsized":"2024-04-25T10:05:48.263559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.247040+0000","last_change":"2024-04-25T10:05:47.247040+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.247040+0000","last_undegraded":"2024-04-25T10:05:47.247040+0000","last_fullsized":"2024-04-25T10:05:47.247040+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259836+0000","last_change":"2024-04-25T10:05:48.259836+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259836+0000","last_undegraded":"2024-04-25T10:05:48.259836+0000","last_fullsized":"2024-04-25T10:05:48.259836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275998+0000","last_change":"2024-04-25T10:05:48.274485+0000","last_active":"2024-04-25T10:05:48.275998+0000","last_peered":"2024-04-25T10:05:48.275998+0000","last_clean":"2024-04-25T10:05:48.275998+0000","last_became_active":"2024-04-25T10:05:48.274200+0000","last_became_peered":"2024-04-25T10:05:48.274200+0000","last_unstale":"2024-04-25T10:05:48.275998+0000","last_undegraded":"2024-04-25T10:05:48.275998+0000","last_fullsized":"2024-04-25T10:05:48.275998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264785+0000","last_change":"2024-04-25T10:05:48.264785+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264785+0000","last_undegraded":"2024-04-25T10:05:48.264785+0000","last_fullsized":"2024-04-25T10:05:48.264785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286472+0000","last_change":"2024-04-25T10:05:48.283403+0000","last_active":"2024-04-25T10:05:48.286472+0000","last_peered":"2024-04-25T10:05:48.286472+0000","last_clean":"2024-04-25T10:05:48.286472+0000","last_became_active":"2024-04-25T10:05:48.283065+0000","last_became_peered":"2024-04-25T10:05:48.283065+0000","last_unstale":"2024-04-25T10:05:48.286472+0000","last_undegraded":"2024-04-25T10:05:48.286472+0000","last_fullsized":"2024-04-25T10:05:48.286472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.283844+0000","last_change":"2024-04-25T10:05:48.279091+0000","last_active":"2024-04-25T10:05:48.283844+0000","last_peered":"2024-04-25T10:05:48.283844+0000","last_clean":"2024-04-25T10:05:48.283844+0000","last_became_active":"2024-04-25T10:05:48.278825+0000","last_became_peered":"2024-04-25T10:05:48.278825+0000","last_unstale":"2024-04-25T10:05:48.283844+0000","last_undegraded":"2024-04-25T10:05:48.283844+0000","last_fullsized":"2024-04-25T10:05:48.283844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259884+0000","last_change":"2024-04-25T10:05:48.259884+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259884+0000","last_undegraded":"2024-04-25T10:05:48.259884+0000","last_fullsized":"2024-04-25T10:05:48.259884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.249908+0000","last_change":"2024-04-25T10:05:47.249908+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.249908+0000","last_undegraded":"2024-04-25T10:05:47.249908+0000","last_fullsized":"2024-04-25T10:05:47.249908+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264461+0000","last_change":"2024-04-25T10:05:48.264461+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264461+0000","last_undegraded":"2024-04-25T10:05:48.264461+0000","last_fullsized":"2024-04-25T10:05:48.264461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.247055+0000","last_change":"2024-04-25T10:05:47.247055+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.247055+0000","last_undegraded":"2024-04-25T10:05:47.247055+0000","last_fullsized":"2024-04-25T10:05:47.247055+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286612+0000","last_change":"2024-04-25T10:05:48.283276+0000","last_active":"2024-04-25T10:05:48.286612+0000","last_peered":"2024-04-25T10:05:48.286612+0000","last_clean":"2024-04-25T10:05:48.286612+0000","last_became_active":"2024-04-25T10:05:48.282966+0000","last_became_peered":"2024-04-25T10:05:48.282966+0000","last_unstale":"2024-04-25T10:05:48.286612+0000","last_undegraded":"2024-04-25T10:05:48.286612+0000","last_fullsized":"2024-04-25T10:05:48.286612+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.201380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275950+0000","last_change":"2024-04-25T10:05:48.274031+0000","last_active":"2024-04-25T10:05:48.275950+0000","last_peered":"2024-04-25T10:05:48.275950+0000","last_clean":"2024-04-25T10:05:48.275950+0000","last_became_active":"2024-04-25T10:05:48.273773+0000","last_became_peered":"2024-04-25T10:05:48.273773+0000","last_unstale":"2024-04-25T10:05:48.275950+0000","last_undegraded":"2024-04-25T10:05:48.275950+0000","last_fullsized":"2024-04-25T10:05:48.275950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.249866+0000","last_change":"2024-04-25T10:05:47.249866+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.249866+0000","last_undegraded":"2024-04-25T10:05:47.249866+0000","last_fullsized":"2024-04-25T10:05:47.249866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.246956+0000","last_change":"2024-04-25T10:05:47.246956+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.246956+0000","last_undegraded":"2024-04-25T10:05:47.246956+0000","last_fullsized":"2024-04-25T10:05:47.246956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.253106+0000","last_change":"2024-04-25T10:05:47.253106+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.253106+0000","last_undegraded":"2024-04-25T10:05:47.253106+0000","last_fullsized":"2024-04-25T10:05:47.253106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260952+0000","last_change":"2024-04-25T10:05:48.260952+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260952+0000","last_undegraded":"2024-04-25T10:05:48.260952+0000","last_fullsized":"2024-04-25T10:05:48.260952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273224+0000","last_change":"2024-04-25T10:05:48.271962+0000","last_active":"2024-04-25T10:05:48.273224+0000","last_peered":"2024-04-25T10:05:48.273224+0000","last_clean":"2024-04-25T10:05:48.273224+0000","last_became_active":"2024-04-25T10:05:48.271483+0000","last_became_peered":"2024-04-25T10:05:48.271483+0000","last_unstale":"2024-04-25T10:05:48.273224+0000","last_undegraded":"2024-04-25T10:05:48.273224+0000","last_fullsized":"2024-04-25T10:05:48.273224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:11.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273084+0000","last_change":"2024-04-25T10:05:48.267427+0000","last_active":"2024-04-25T10:05:48.273084+0000","last_peered":"2024-04-25T10:05:48.273084+0000","last_clean":"2024-04-25T10:05:48.273084+0000","last_became_active":"2024-04-25T10:05:48.267151+0000","last_became_peered":"2024-04-25T10:05:48.267151+0000","last_unstale":"2024-04-25T10:05:48.273084+0000","last_undegraded":"2024-04-25T10:05:48.273084+0000","last_fullsized":"2024-04-25T10:05:48.273084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:25.452679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263960+0000","last_change":"2024-04-25T10:05:48.263960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263960+0000","last_undegraded":"2024-04-25T10:05:48.263960+0000","last_fullsized":"2024-04-25T10:05:48.263960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.251030+0000","last_change":"2024-04-25T10:05:47.251030+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.251030+0000","last_undegraded":"2024-04-25T10:05:47.251030+0000","last_fullsized":"2024-04-25T10:05:47.251030+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257960+0000","last_change":"2024-04-25T10:05:48.257960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257960+0000","last_undegraded":"2024-04-25T10:05:48.257960+0000","last_fullsized":"2024-04-25T10:05:48.257960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.251109+0000","last_change":"2024-04-25T10:05:47.251109+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.251109+0000","last_undegraded":"2024-04-25T10:05:47.251109+0000","last_fullsized":"2024-04-25T10:05:47.251109+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.246919+0000","last_change":"2024-04-25T10:05:47.246919+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.246919+0000","last_undegraded":"2024-04-25T10:05:47.246919+0000","last_fullsized":"2024-04-25T10:05:47.246919+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.252445+0000","last_change":"2024-04-25T10:05:47.252445+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.252445+0000","last_undegraded":"2024-04-25T10:05:47.252445+0000","last_fullsized":"2024-04-25T10:05:47.252445+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264035+0000","last_change":"2024-04-25T10:05:48.264035+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264035+0000","last_undegraded":"2024-04-25T10:05:48.264035+0000","last_fullsized":"2024-04-25T10:05:48.264035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286603+0000","last_change":"2024-04-25T10:05:48.283226+0000","last_active":"2024-04-25T10:05:48.286603+0000","last_peered":"2024-04-25T10:05:48.286603+0000","last_clean":"2024-04-25T10:05:48.286603+0000","last_became_active":"2024-04-25T10:05:48.282936+0000","last_became_peered":"2024-04-25T10:05:48.282936+0000","last_unstale":"2024-04-25T10:05:48.286603+0000","last_undegraded":"2024-04-25T10:05:48.286603+0000","last_fullsized":"2024-04-25T10:05:48.286603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:59.924963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286770+0000","last_change":"2024-04-25T10:05:48.281960+0000","last_active":"2024-04-25T10:05:48.286770+0000","last_peered":"2024-04-25T10:05:48.286770+0000","last_clean":"2024-04-25T10:05:48.286770+0000","last_became_active":"2024-04-25T10:05:48.281643+0000","last_became_peered":"2024-04-25T10:05:48.281643+0000","last_unstale":"2024-04-25T10:05:48.286770+0000","last_undegraded":"2024-04-25T10:05:48.286770+0000","last_fullsized":"2024-04-25T10:05:48.286770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.246963+0000","last_change":"2024-04-25T10:05:47.246963+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.246963+0000","last_undegraded":"2024-04-25T10:05:47.246963+0000","last_fullsized":"2024-04-25T10:05:47.246963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.250013+0000","last_change":"2024-04-25T10:05:47.250013+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.250013+0000","last_undegraded":"2024-04-25T10:05:47.250013+0000","last_fullsized":"2024-04-25T10:05:47.250013+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262617+0000","last_change":"2024-04-25T10:05:48.262617+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262617+0000","last_undegraded":"2024-04-25T10:05:48.262617+0000","last_fullsized":"2024-04-25T10:05:48.262617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.250411+0000","last_change":"2024-04-25T10:05:47.250411+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.250411+0000","last_undegraded":"2024-04-25T10:05:47.250411+0000","last_fullsized":"2024-04-25T10:05:47.250411+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281271+0000","last_change":"2024-04-25T10:05:48.276064+0000","last_active":"2024-04-25T10:05:48.281271+0000","last_peered":"2024-04-25T10:05:48.281271+0000","last_clean":"2024-04-25T10:05:48.281271+0000","last_became_active":"2024-04-25T10:05:48.275744+0000","last_became_peered":"2024-04-25T10:05:48.275744+0000","last_unstale":"2024-04-25T10:05:48.281271+0000","last_undegraded":"2024-04-25T10:05:48.281271+0000","last_fullsized":"2024-04-25T10:05:48.281271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:05:48.244110+0000","last_change":"2024-04-25T10:05:48.244110+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.244110+0000","last_undegraded":"2024-04-25T10:05:48.244110+0000","last_fullsized":"2024-04-25T10:05:48.244110+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281034+0000","last_change":"2024-04-25T10:05:48.277544+0000","last_active":"2024-04-25T10:05:48.281034+0000","last_peered":"2024-04-25T10:05:48.281034+0000","last_clean":"2024-04-25T10:05:48.281034+0000","last_became_active":"2024-04-25T10:05:48.277305+0000","last_became_peered":"2024-04-25T10:05:48.277305+0000","last_unstale":"2024-04-25T10:05:48.281034+0000","last_undegraded":"2024-04-25T10:05:48.281034+0000","last_fullsized":"2024-04-25T10:05:48.281034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256078+0000","last_change":"2024-04-25T10:05:48.256078+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256078+0000","last_undegraded":"2024-04-25T10:05:48.256078+0000","last_fullsized":"2024-04-25T10:05:48.256078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":1,"reported_epoch":50,"state":"creating+peering","last_fresh":"2024-04-25T10:05:47.246891+0000","last_change":"2024-04-25T10:05:47.246891+0000","last_active":"2024-04-25T10:05:47.241071+0000","last_peered":"2024-04-25T10:05:47.241071+0000","last_clean":"2024-04-25T10:05:47.241071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:47.246891+0000","last_undegraded":"2024-04-25T10:05:47.246891+0000","last_fullsized":"2024-04-25T10:05:47.246891+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":224,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.267693+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:48.267693+0000","last_peered":"2024-04-25T10:05:48.267693+0000","last_clean":"2024-04-25T10:05:48.267693+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:48.267693+0000","last_undegraded":"2024-04-25T10:05:48.267693+0000","last_fullsized":"2024-04-25T10:05:48.267693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1179648,"data_stored":847823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":251246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31744,"kb_used_data":560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340096,"statfs":{"total":96636764160,"available":96604258304,"internally_reserved":0,"allocated":573440,"data_stored":251246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32320,"kb_used_data":1140,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339520,"statfs":{"total":96636764160,"available":96603668480,"internally_reserved":0,"allocated":1167360,"data_stored":841614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:53.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 Processor -- start 2024-04-25T10:05:53.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 -- start start 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f803c09a170 0x7f803c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 0x7f803c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f803c0cd6c0 con 0x7f803c15efa0 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0b3fe0 con 0x7f803c09a170 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8041800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f803c0cce20 con 0x7f803c0cdb70 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f803c09a170 0x7f803c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f803c15efa0 0x7f803c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47652/0 (socket says 172.21.15.18:47652) 2024-04-25T10:05:53.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803be00640 1 -- 172.21.15.18:0/3033798581 learned_addr learned my addr 172.21.15.18:0/3033798581 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8040e00640 1 --2- 172.21.15.18:0/3033798581 >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 0x7f803c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803b400640 1 -- 172.21.15.18:0/3033798581 >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 msgr2=0x7f803c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803b400640 1 --2- 172.21.15.18:0/3033798581 >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 0x7f803c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803b400640 1 -- 172.21.15.18:0/3033798581 >> v1:172.21.15.18:6789/0 conn(0x7f803c15efa0 legacy=0x7f803c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803b400640 1 -- 172.21.15.18:0/3033798581 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c0cd100 con 0x7f803c09a170 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f803aa00640 1 -- 172.21.15.18:0/3033798581 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247940933 0 0) 0x7f803c0cd6c0 con 0x7f803c15efa0 2024-04-25T10:05:53.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.560+0000 7f8040e00640 1 --2- 172.21.15.18:0/3033798581 >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 0x7f803c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:05:53.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f803b400640 1 --2- 172.21.15.18:0/3033798581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c09a170 0x7f803c0b11a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f803c0b0430 tx=0x7f802801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280e15a2c92763c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f803aa00640 1 -- 172.21.15.18:0/3033798581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280b0070 con 0x7f803c09a170 2024-04-25T10:05:53.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f803aa00640 1 -- 172.21.15.18:0/3033798581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80280ab600 con 0x7f803c09a170 2024-04-25T10:05:53.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f803aa00640 1 -- 172.21.15.18:0/3033798581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280ab9d0 con 0x7f803c09a170 2024-04-25T10:05:53.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- 172.21.15.18:0/3033798581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c09a170 msgr2=0x7f803c0b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 --2- 172.21.15.18:0/3033798581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c09a170 0x7f803c0b11a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f803c0b0430 tx=0x7f802801c480 comp rx=0 tx=0).stop 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- 172.21.15.18:0/3033798581 shutdown_connections 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 --2- 172.21.15.18:0/3033798581 >> v2:172.21.15.167:3300/0 conn(0x7f803c0cdb70 0x7f803c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 --2- 172.21.15.18:0/3033798581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c09a170 0x7f803c0b11a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- 172.21.15.18:0/3033798581 >> 172.21.15.18:0/3033798581 conn(0x7f803c0b3050 msgr2=0x7f803c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- 172.21.15.18:0/3033798581 shutdown_connections 2024-04-25T10:05:53.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- 172.21.15.18:0/3033798581 wait complete. 2024-04-25T10:05:53.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 Processor -- start 2024-04-25T10:05:53.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.564+0000 7f8041800640 1 -- start start 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c09a170 0x7f803c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c15efa0 0x7f803c1f9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c1686a0 con 0x7f803c0cdb70 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f803c0b3dc0 con 0x7f803c09a170 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f803c168820 con 0x7f803c15efa0 2024-04-25T10:05:53.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42062/0 (socket says 172.21.15.18:42062) 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 -- 172.21.15.18:0/2060899398 learned_addr learned my addr 172.21.15.18:0/2060899398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803be00640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c09a170 0x7f803c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8040e00640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c15efa0 0x7f803c1f9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 -- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c15efa0 msgr2=0x7f803c1f9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c15efa0 0x7f803c1f9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 -- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c09a170 msgr2=0x7f803c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c09a170 0x7f803c06c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 -- 172.21.15.18:0/2060899398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f803c06da90 con 0x7f803c0cdb70 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f803b400640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f802801a0b0 tx=0x7f8028019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280b0040 con 0x7f803c0cdb70 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80280ba070 con 0x7f803c0cdb70 2024-04-25T10:05:53.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280b4870 con 0x7f803c0cdb70 2024-04-25T10:05:53.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f803c154570 con 0x7f803c0cdb70 2024-04-25T10:05:53.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f803c06cc70 con 0x7f803c0cdb70 2024-04-25T10:05:53.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803c154b80 con 0x7f803c0cdb70 2024-04-25T10:05:53.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.568+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80280ab480 con 0x7f803c0cdb70 2024-04-25T10:05:53.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.572+0000 7f8033e00640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 0x7f801c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.572+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f802811eff0 con 0x7f803c0cdb70 2024-04-25T10:05:53.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.572+0000 7f803be00640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 0x7f801c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.572+0000 7f803be00640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 0x7f801c069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f802c000f70 tx=0x7f802c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.576+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8028016070 con 0x7f803c0cdb70 2024-04-25T10:05:53.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.732+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f803c04efa0 con 0x7f801c066f60 2024-04-25T10:05:53.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.740+0000 7f8033e00640 1 -- 172.21.15.18:0/2060899398 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249805 (secure 0 0 0) 0x7f803c04efa0 con 0x7f801c066f60 2024-04-25T10:05:53.753 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:53.754 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:53.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 msgr2=0x7f801c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 0x7f801c069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f802c000f70 tx=0x7f802c007b60 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 msgr2=0x7f803c06f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f802801a0b0 tx=0x7f8028019220 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 shutdown_connections 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f801c066f60 0x7f801c069420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f803c15efa0 0x7f803c1f9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f803c0cdb70 0x7f803c06f4e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 --2- 172.21.15.18:0/2060899398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f803c09a170 0x7f803c06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 >> 172.21.15.18:0/2060899398 conn(0x7f803c0b3050 msgr2=0x7f803c0b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 shutdown_connections 2024-04-25T10:05:53.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.744+0000 7f8041800640 1 -- 172.21.15.18:0/2060899398 wait complete. 2024-04-25T10:05:53.773 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-04-25T10:05:53.423578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238740,"kb_used_data":5924,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735980,"statfs":{"total":773094113280,"available":772849643520,"internally_reserved":0,"allocated":6066176,"data_stored":3325942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001566"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273860+0000","last_change":"2024-04-25T10:05:49.285079+0000","last_active":"2024-04-25T10:05:50.273860+0000","last_peered":"2024-04-25T10:05:50.273860+0000","last_clean":"2024-04-25T10:05:50.273860+0000","last_became_active":"2024-04-25T10:05:49.284804+0000","last_became_peered":"2024-04-25T10:05:49.284804+0000","last_unstale":"2024-04-25T10:05:50.273860+0000","last_undegraded":"2024-04-25T10:05:50.273860+0000","last_fullsized":"2024-04-25T10:05:50.273860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264912+0000","last_change":"2024-04-25T10:05:48.264912+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264912+0000","last_undegraded":"2024-04-25T10:05:48.264912+0000","last_fullsized":"2024-04-25T10:05:48.264912+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753632+0000","last_change":"2024-04-25T10:05:49.287086+0000","last_active":"2024-04-25T10:05:50.753632+0000","last_peered":"2024-04-25T10:05:50.753632+0000","last_clean":"2024-04-25T10:05:50.753632+0000","last_became_active":"2024-04-25T10:05:49.285731+0000","last_became_peered":"2024-04-25T10:05:49.285731+0000","last_unstale":"2024-04-25T10:05:50.753632+0000","last_undegraded":"2024-04-25T10:05:50.753632+0000","last_fullsized":"2024-04-25T10:05:50.753632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:16.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263046+0000","last_change":"2024-04-25T10:05:48.263046+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263046+0000","last_undegraded":"2024-04-25T10:05:48.263046+0000","last_fullsized":"2024-04-25T10:05:48.263046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260500+0000","last_change":"2024-04-25T10:05:48.260500+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260500+0000","last_undegraded":"2024-04-25T10:05:48.260500+0000","last_fullsized":"2024-04-25T10:05:48.260500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273516+0000","last_change":"2024-04-25T10:05:49.282396+0000","last_active":"2024-04-25T10:05:50.273516+0000","last_peered":"2024-04-25T10:05:50.273516+0000","last_clean":"2024-04-25T10:05:50.273516+0000","last_became_active":"2024-04-25T10:05:49.281398+0000","last_became_peered":"2024-04-25T10:05:49.281398+0000","last_unstale":"2024-04-25T10:05:50.273516+0000","last_undegraded":"2024-04-25T10:05:50.273516+0000","last_fullsized":"2024-04-25T10:05:50.273516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.475074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752757+0000","last_change":"2024-04-25T10:05:49.286501+0000","last_active":"2024-04-25T10:05:50.752757+0000","last_peered":"2024-04-25T10:05:50.752757+0000","last_clean":"2024-04-25T10:05:50.752757+0000","last_became_active":"2024-04-25T10:05:49.286244+0000","last_became_peered":"2024-04-25T10:05:49.286244+0000","last_unstale":"2024-04-25T10:05:50.752757+0000","last_undegraded":"2024-04-25T10:05:50.752757+0000","last_fullsized":"2024-04-25T10:05:50.752757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752551+0000","last_change":"2024-04-25T10:05:49.292415+0000","last_active":"2024-04-25T10:05:50.752551+0000","last_peered":"2024-04-25T10:05:50.752551+0000","last_clean":"2024-04-25T10:05:50.752551+0000","last_became_active":"2024-04-25T10:05:49.292210+0000","last_became_peered":"2024-04-25T10:05:49.292210+0000","last_unstale":"2024-04-25T10:05:50.752551+0000","last_undegraded":"2024-04-25T10:05:50.752551+0000","last_fullsized":"2024-04-25T10:05:50.752551+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:42.412711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753322+0000","last_change":"2024-04-25T10:05:49.294200+0000","last_active":"2024-04-25T10:05:50.753322+0000","last_peered":"2024-04-25T10:05:50.753322+0000","last_clean":"2024-04-25T10:05:50.753322+0000","last_became_active":"2024-04-25T10:05:49.293943+0000","last_became_peered":"2024-04-25T10:05:49.293943+0000","last_unstale":"2024-04-25T10:05:50.753322+0000","last_undegraded":"2024-04-25T10:05:50.753322+0000","last_fullsized":"2024-04-25T10:05:50.753322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:20.041919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273688+0000","last_change":"2024-04-25T10:05:49.275464+0000","last_active":"2024-04-25T10:05:50.273688+0000","last_peered":"2024-04-25T10:05:50.273688+0000","last_clean":"2024-04-25T10:05:50.273688+0000","last_became_active":"2024-04-25T10:05:49.274039+0000","last_became_peered":"2024-04-25T10:05:49.274039+0000","last_unstale":"2024-04-25T10:05:50.273688+0000","last_undegraded":"2024-04-25T10:05:50.273688+0000","last_fullsized":"2024-04-25T10:05:50.273688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752801+0000","last_change":"2024-04-25T10:05:49.282389+0000","last_active":"2024-04-25T10:05:50.752801+0000","last_peered":"2024-04-25T10:05:50.752801+0000","last_clean":"2024-04-25T10:05:50.752801+0000","last_became_active":"2024-04-25T10:05:49.282122+0000","last_became_peered":"2024-04-25T10:05:49.282122+0000","last_unstale":"2024-04-25T10:05:50.752801+0000","last_undegraded":"2024-04-25T10:05:50.752801+0000","last_fullsized":"2024-04-25T10:05:50.752801+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:15.551190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753119+0000","last_change":"2024-04-25T10:05:49.286972+0000","last_active":"2024-04-25T10:05:50.753119+0000","last_peered":"2024-04-25T10:05:50.753119+0000","last_clean":"2024-04-25T10:05:50.753119+0000","last_became_active":"2024-04-25T10:05:49.286632+0000","last_became_peered":"2024-04-25T10:05:49.286632+0000","last_unstale":"2024-04-25T10:05:50.753119+0000","last_undegraded":"2024-04-25T10:05:50.753119+0000","last_fullsized":"2024-04-25T10:05:50.753119+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:57.536288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273434+0000","last_change":"2024-04-25T10:05:49.269276+0000","last_active":"2024-04-25T10:05:50.273434+0000","last_peered":"2024-04-25T10:05:50.273434+0000","last_clean":"2024-04-25T10:05:50.273434+0000","last_became_active":"2024-04-25T10:05:49.269012+0000","last_became_peered":"2024-04-25T10:05:49.269012+0000","last_unstale":"2024-04-25T10:05:50.273434+0000","last_undegraded":"2024-04-25T10:05:50.273434+0000","last_fullsized":"2024-04-25T10:05:50.273434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:37.910181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753593+0000","last_change":"2024-04-25T10:05:49.293545+0000","last_active":"2024-04-25T10:05:50.753593+0000","last_peered":"2024-04-25T10:05:50.753593+0000","last_clean":"2024-04-25T10:05:50.753593+0000","last_became_active":"2024-04-25T10:05:49.292750+0000","last_became_peered":"2024-04-25T10:05:49.292750+0000","last_unstale":"2024-04-25T10:05:50.753593+0000","last_undegraded":"2024-04-25T10:05:50.753593+0000","last_fullsized":"2024-04-25T10:05:50.753593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.143210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261510+0000","last_change":"2024-04-25T10:05:48.261510+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261510+0000","last_undegraded":"2024-04-25T10:05:48.261510+0000","last_fullsized":"2024-04-25T10:05:48.261510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273381+0000","last_change":"2024-04-25T10:05:49.266345+0000","last_active":"2024-04-25T10:05:50.273381+0000","last_peered":"2024-04-25T10:05:50.273381+0000","last_clean":"2024-04-25T10:05:50.273381+0000","last_became_active":"2024-04-25T10:05:49.266113+0000","last_became_peered":"2024-04-25T10:05:49.266113+0000","last_unstale":"2024-04-25T10:05:50.273381+0000","last_undegraded":"2024-04-25T10:05:50.273381+0000","last_fullsized":"2024-04-25T10:05:50.273381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:39.048517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754014+0000","last_change":"2024-04-25T10:05:49.290847+0000","last_active":"2024-04-25T10:05:50.754014+0000","last_peered":"2024-04-25T10:05:50.754014+0000","last_clean":"2024-04-25T10:05:50.754014+0000","last_became_active":"2024-04-25T10:05:49.289958+0000","last_became_peered":"2024-04-25T10:05:49.289958+0000","last_unstale":"2024-04-25T10:05:50.754014+0000","last_undegraded":"2024-04-25T10:05:50.754014+0000","last_fullsized":"2024-04-25T10:05:50.754014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:15.945832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264029+0000","last_change":"2024-04-25T10:05:48.264029+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264029+0000","last_undegraded":"2024-04-25T10:05:48.264029+0000","last_fullsized":"2024-04-25T10:05:48.264029+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753810+0000","last_change":"2024-04-25T10:05:49.286035+0000","last_active":"2024-04-25T10:05:50.753810+0000","last_peered":"2024-04-25T10:05:50.753810+0000","last_clean":"2024-04-25T10:05:50.753810+0000","last_became_active":"2024-04-25T10:05:49.285407+0000","last_became_peered":"2024-04-25T10:05:49.285407+0000","last_unstale":"2024-04-25T10:05:50.753810+0000","last_undegraded":"2024-04-25T10:05:50.753810+0000","last_fullsized":"2024-04-25T10:05:50.753810+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:01.390046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257006+0000","last_change":"2024-04-25T10:05:48.257006+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257006+0000","last_undegraded":"2024-04-25T10:05:48.257006+0000","last_fullsized":"2024-04-25T10:05:48.257006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256159+0000","last_change":"2024-04-25T10:05:48.256159+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256159+0000","last_undegraded":"2024-04-25T10:05:48.256159+0000","last_fullsized":"2024-04-25T10:05:48.256159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752422+0000","last_change":"2024-04-25T10:05:49.290986+0000","last_active":"2024-04-25T10:05:50.752422+0000","last_peered":"2024-04-25T10:05:50.752422+0000","last_clean":"2024-04-25T10:05:50.752422+0000","last_became_active":"2024-04-25T10:05:49.290722+0000","last_became_peered":"2024-04-25T10:05:49.290722+0000","last_unstale":"2024-04-25T10:05:50.752422+0000","last_undegraded":"2024-04-25T10:05:50.752422+0000","last_fullsized":"2024-04-25T10:05:50.752422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:59.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752349+0000","last_change":"2024-04-25T10:05:49.281828+0000","last_active":"2024-04-25T10:05:50.752349+0000","last_peered":"2024-04-25T10:05:50.752349+0000","last_clean":"2024-04-25T10:05:50.752349+0000","last_became_active":"2024-04-25T10:05:49.281534+0000","last_became_peered":"2024-04-25T10:05:49.281534+0000","last_unstale":"2024-04-25T10:05:50.752349+0000","last_undegraded":"2024-04-25T10:05:50.752349+0000","last_fullsized":"2024-04-25T10:05:50.752349+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:56.168674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753622+0000","last_change":"2024-04-25T10:05:49.280300+0000","last_active":"2024-04-25T10:05:50.753622+0000","last_peered":"2024-04-25T10:05:50.753622+0000","last_clean":"2024-04-25T10:05:50.753622+0000","last_became_active":"2024-04-25T10:05:49.280086+0000","last_became_peered":"2024-04-25T10:05:49.280086+0000","last_unstale":"2024-04-25T10:05:50.753622+0000","last_undegraded":"2024-04-25T10:05:50.753622+0000","last_fullsized":"2024-04-25T10:05:50.753622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.855084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754070+0000","last_change":"2024-04-25T10:05:49.290270+0000","last_active":"2024-04-25T10:05:50.754070+0000","last_peered":"2024-04-25T10:05:50.754070+0000","last_clean":"2024-04-25T10:05:50.754070+0000","last_became_active":"2024-04-25T10:05:49.289680+0000","last_became_peered":"2024-04-25T10:05:49.289680+0000","last_unstale":"2024-04-25T10:05:50.754070+0000","last_undegraded":"2024-04-25T10:05:50.754070+0000","last_fullsized":"2024-04-25T10:05:50.754070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:33.485998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752875+0000","last_change":"2024-04-25T10:05:49.280231+0000","last_active":"2024-04-25T10:05:50.752875+0000","last_peered":"2024-04-25T10:05:50.752875+0000","last_clean":"2024-04-25T10:05:50.752875+0000","last_became_active":"2024-04-25T10:05:49.279570+0000","last_became_peered":"2024-04-25T10:05:49.279570+0000","last_unstale":"2024-04-25T10:05:50.752875+0000","last_undegraded":"2024-04-25T10:05:50.752875+0000","last_fullsized":"2024-04-25T10:05:50.752875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:50.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273943+0000","last_change":"2024-04-25T10:05:49.288396+0000","last_active":"2024-04-25T10:05:50.273943+0000","last_peered":"2024-04-25T10:05:50.273943+0000","last_clean":"2024-04-25T10:05:50.273943+0000","last_became_active":"2024-04-25T10:05:49.287993+0000","last_became_peered":"2024-04-25T10:05:49.287993+0000","last_unstale":"2024-04-25T10:05:50.273943+0000","last_undegraded":"2024-04-25T10:05:50.273943+0000","last_fullsized":"2024-04-25T10:05:50.273943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256497+0000","last_change":"2024-04-25T10:05:48.256497+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256497+0000","last_undegraded":"2024-04-25T10:05:48.256497+0000","last_fullsized":"2024-04-25T10:05:48.256497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752992+0000","last_change":"2024-04-25T10:05:49.281466+0000","last_active":"2024-04-25T10:05:50.752992+0000","last_peered":"2024-04-25T10:05:50.752992+0000","last_clean":"2024-04-25T10:05:50.752992+0000","last_became_active":"2024-04-25T10:05:49.281165+0000","last_became_peered":"2024-04-25T10:05:49.281165+0000","last_unstale":"2024-04-25T10:05:50.752992+0000","last_undegraded":"2024-04-25T10:05:50.752992+0000","last_fullsized":"2024-04-25T10:05:50.752992+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:11.398600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262964+0000","last_change":"2024-04-25T10:05:48.262964+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262964+0000","last_undegraded":"2024-04-25T10:05:48.262964+0000","last_fullsized":"2024-04-25T10:05:48.262964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752900+0000","last_change":"2024-04-25T10:05:49.286018+0000","last_active":"2024-04-25T10:05:50.752900+0000","last_peered":"2024-04-25T10:05:50.752900+0000","last_clean":"2024-04-25T10:05:50.752900+0000","last_became_active":"2024-04-25T10:05:49.285531+0000","last_became_peered":"2024-04-25T10:05:49.285531+0000","last_unstale":"2024-04-25T10:05:50.752900+0000","last_undegraded":"2024-04-25T10:05:50.752900+0000","last_fullsized":"2024-04-25T10:05:50.752900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:14.155973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265891+0000","last_change":"2024-04-25T10:05:48.265891+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265891+0000","last_undegraded":"2024-04-25T10:05:48.265891+0000","last_fullsized":"2024-04-25T10:05:48.265891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261054+0000","last_change":"2024-04-25T10:05:48.261054+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261054+0000","last_undegraded":"2024-04-25T10:05:48.261054+0000","last_fullsized":"2024-04-25T10:05:48.261054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272908+0000","last_change":"2024-04-25T10:05:48.269196+0000","last_active":"2024-04-25T10:05:48.272908+0000","last_peered":"2024-04-25T10:05:48.272908+0000","last_clean":"2024-04-25T10:05:48.272908+0000","last_became_active":"2024-04-25T10:05:48.268189+0000","last_became_peered":"2024-04-25T10:05:48.268189+0000","last_unstale":"2024-04-25T10:05:48.272908+0000","last_undegraded":"2024-04-25T10:05:48.272908+0000","last_fullsized":"2024-04-25T10:05:48.272908+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:22.346700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262585+0000","last_change":"2024-04-25T10:05:48.262585+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262585+0000","last_undegraded":"2024-04-25T10:05:48.262585+0000","last_fullsized":"2024-04-25T10:05:48.262585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273598+0000","last_change":"2024-04-25T10:05:48.275908+0000","last_active":"2024-04-25T10:05:50.273598+0000","last_peered":"2024-04-25T10:05:50.273598+0000","last_clean":"2024-04-25T10:05:50.273598+0000","last_became_active":"2024-04-25T10:05:48.274479+0000","last_became_peered":"2024-04-25T10:05:48.274479+0000","last_unstale":"2024-04-25T10:05:50.273598+0000","last_undegraded":"2024-04-25T10:05:50.273598+0000","last_fullsized":"2024-04-25T10:05:50.273598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257851+0000","last_change":"2024-04-25T10:05:48.257851+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257851+0000","last_undegraded":"2024-04-25T10:05:48.257851+0000","last_fullsized":"2024-04-25T10:05:48.257851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273866+0000","last_change":"2024-04-25T10:05:48.271308+0000","last_active":"2024-04-25T10:05:50.273866+0000","last_peered":"2024-04-25T10:05:50.273866+0000","last_clean":"2024-04-25T10:05:50.273866+0000","last_became_active":"2024-04-25T10:05:48.270922+0000","last_became_peered":"2024-04-25T10:05:48.270922+0000","last_unstale":"2024-04-25T10:05:50.273866+0000","last_undegraded":"2024-04-25T10:05:50.273866+0000","last_fullsized":"2024-04-25T10:05:50.273866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752734+0000","last_change":"2024-04-25T10:05:49.279560+0000","last_active":"2024-04-25T10:05:50.752734+0000","last_peered":"2024-04-25T10:05:50.752734+0000","last_clean":"2024-04-25T10:05:50.752734+0000","last_became_active":"2024-04-25T10:05:49.278516+0000","last_became_peered":"2024-04-25T10:05:49.278516+0000","last_unstale":"2024-04-25T10:05:50.752734+0000","last_undegraded":"2024-04-25T10:05:50.752734+0000","last_fullsized":"2024-04-25T10:05:50.752734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:10.096617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.280963+0000","last_change":"2024-04-25T10:05:48.275810+0000","last_active":"2024-04-25T10:05:48.280963+0000","last_peered":"2024-04-25T10:05:48.280963+0000","last_clean":"2024-04-25T10:05:48.280963+0000","last_became_active":"2024-04-25T10:05:48.275553+0000","last_became_peered":"2024-04-25T10:05:48.275553+0000","last_unstale":"2024-04-25T10:05:48.280963+0000","last_undegraded":"2024-04-25T10:05:48.280963+0000","last_fullsized":"2024-04-25T10:05:48.280963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259924+0000","last_change":"2024-04-25T10:05:48.259924+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259924+0000","last_undegraded":"2024-04-25T10:05:48.259924+0000","last_fullsized":"2024-04-25T10:05:48.259924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753106+0000","last_change":"2024-04-25T10:05:48.276598+0000","last_active":"2024-04-25T10:05:50.753106+0000","last_peered":"2024-04-25T10:05:50.753106+0000","last_clean":"2024-04-25T10:05:50.753106+0000","last_became_active":"2024-04-25T10:05:48.276341+0000","last_became_peered":"2024-04-25T10:05:48.276341+0000","last_unstale":"2024-04-25T10:05:50.753106+0000","last_undegraded":"2024-04-25T10:05:50.753106+0000","last_fullsized":"2024-04-25T10:05:50.753106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:01.796857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265323+0000","last_change":"2024-04-25T10:05:48.265323+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265323+0000","last_undegraded":"2024-04-25T10:05:48.265323+0000","last_fullsized":"2024-04-25T10:05:48.265323+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272465+0000","last_change":"2024-04-25T10:05:48.268595+0000","last_active":"2024-04-25T10:05:48.272465+0000","last_peered":"2024-04-25T10:05:48.272465+0000","last_clean":"2024-04-25T10:05:48.272465+0000","last_became_active":"2024-04-25T10:05:48.267579+0000","last_became_peered":"2024-04-25T10:05:48.267579+0000","last_unstale":"2024-04-25T10:05:48.272465+0000","last_undegraded":"2024-04-25T10:05:48.272465+0000","last_fullsized":"2024-04-25T10:05:48.272465+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.298325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753172+0000","last_change":"2024-04-25T10:05:49.280027+0000","last_active":"2024-04-25T10:05:50.753172+0000","last_peered":"2024-04-25T10:05:50.753172+0000","last_clean":"2024-04-25T10:05:50.753172+0000","last_became_active":"2024-04-25T10:05:49.279193+0000","last_became_peered":"2024-04-25T10:05:49.279193+0000","last_unstale":"2024-04-25T10:05:50.753172+0000","last_undegraded":"2024-04-25T10:05:50.753172+0000","last_fullsized":"2024-04-25T10:05:50.753172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:45.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272949+0000","last_change":"2024-04-25T10:05:48.269624+0000","last_active":"2024-04-25T10:05:48.272949+0000","last_peered":"2024-04-25T10:05:48.272949+0000","last_clean":"2024-04-25T10:05:48.272949+0000","last_became_active":"2024-04-25T10:05:48.266543+0000","last_became_peered":"2024-04-25T10:05:48.266543+0000","last_unstale":"2024-04-25T10:05:48.272949+0000","last_undegraded":"2024-04-25T10:05:48.272949+0000","last_fullsized":"2024-04-25T10:05:48.272949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:38.293978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263559+0000","last_change":"2024-04-25T10:05:48.263559+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263559+0000","last_undegraded":"2024-04-25T10:05:48.263559+0000","last_fullsized":"2024-04-25T10:05:48.263559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752986+0000","last_change":"2024-04-25T10:05:48.283483+0000","last_active":"2024-04-25T10:05:50.752986+0000","last_peered":"2024-04-25T10:05:50.752986+0000","last_clean":"2024-04-25T10:05:50.752986+0000","last_became_active":"2024-04-25T10:05:48.283232+0000","last_became_peered":"2024-04-25T10:05:48.283232+0000","last_unstale":"2024-04-25T10:05:50.752986+0000","last_undegraded":"2024-04-25T10:05:50.752986+0000","last_fullsized":"2024-04-25T10:05:50.752986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259836+0000","last_change":"2024-04-25T10:05:48.259836+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259836+0000","last_undegraded":"2024-04-25T10:05:48.259836+0000","last_fullsized":"2024-04-25T10:05:48.259836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275998+0000","last_change":"2024-04-25T10:05:48.274485+0000","last_active":"2024-04-25T10:05:48.275998+0000","last_peered":"2024-04-25T10:05:48.275998+0000","last_clean":"2024-04-25T10:05:48.275998+0000","last_became_active":"2024-04-25T10:05:48.274200+0000","last_became_peered":"2024-04-25T10:05:48.274200+0000","last_unstale":"2024-04-25T10:05:48.275998+0000","last_undegraded":"2024-04-25T10:05:48.275998+0000","last_fullsized":"2024-04-25T10:05:48.275998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264785+0000","last_change":"2024-04-25T10:05:48.264785+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264785+0000","last_undegraded":"2024-04-25T10:05:48.264785+0000","last_fullsized":"2024-04-25T10:05:48.264785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286472+0000","last_change":"2024-04-25T10:05:48.283403+0000","last_active":"2024-04-25T10:05:48.286472+0000","last_peered":"2024-04-25T10:05:48.286472+0000","last_clean":"2024-04-25T10:05:48.286472+0000","last_became_active":"2024-04-25T10:05:48.283065+0000","last_became_peered":"2024-04-25T10:05:48.283065+0000","last_unstale":"2024-04-25T10:05:48.286472+0000","last_undegraded":"2024-04-25T10:05:48.286472+0000","last_fullsized":"2024-04-25T10:05:48.286472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753410+0000","last_change":"2024-04-25T10:05:49.289134+0000","last_active":"2024-04-25T10:05:50.753410+0000","last_peered":"2024-04-25T10:05:50.753410+0000","last_clean":"2024-04-25T10:05:50.753410+0000","last_became_active":"2024-04-25T10:05:49.288846+0000","last_became_peered":"2024-04-25T10:05:49.288846+0000","last_unstale":"2024-04-25T10:05:50.753410+0000","last_undegraded":"2024-04-25T10:05:50.753410+0000","last_fullsized":"2024-04-25T10:05:50.753410+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:34.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.283844+0000","last_change":"2024-04-25T10:05:48.279091+0000","last_active":"2024-04-25T10:05:48.283844+0000","last_peered":"2024-04-25T10:05:48.283844+0000","last_clean":"2024-04-25T10:05:48.283844+0000","last_became_active":"2024-04-25T10:05:48.278825+0000","last_became_peered":"2024-04-25T10:05:48.278825+0000","last_unstale":"2024-04-25T10:05:48.283844+0000","last_undegraded":"2024-04-25T10:05:48.283844+0000","last_fullsized":"2024-04-25T10:05:48.283844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259884+0000","last_change":"2024-04-25T10:05:48.259884+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259884+0000","last_undegraded":"2024-04-25T10:05:48.259884+0000","last_fullsized":"2024-04-25T10:05:48.259884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753403+0000","last_change":"2024-04-25T10:05:48.272940+0000","last_active":"2024-04-25T10:05:50.753403+0000","last_peered":"2024-04-25T10:05:50.753403+0000","last_clean":"2024-04-25T10:05:50.753403+0000","last_became_active":"2024-04-25T10:05:48.272660+0000","last_became_peered":"2024-04-25T10:05:48.272660+0000","last_unstale":"2024-04-25T10:05:50.753403+0000","last_undegraded":"2024-04-25T10:05:50.753403+0000","last_fullsized":"2024-04-25T10:05:50.753403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.495702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264461+0000","last_change":"2024-04-25T10:05:48.264461+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264461+0000","last_undegraded":"2024-04-25T10:05:48.264461+0000","last_fullsized":"2024-04-25T10:05:48.264461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753204+0000","last_change":"2024-04-25T10:05:48.280067+0000","last_active":"2024-04-25T10:05:50.753204+0000","last_peered":"2024-04-25T10:05:50.753204+0000","last_clean":"2024-04-25T10:05:50.753204+0000","last_became_active":"2024-04-25T10:05:48.279765+0000","last_became_peered":"2024-04-25T10:05:48.279765+0000","last_unstale":"2024-04-25T10:05:50.753204+0000","last_undegraded":"2024-04-25T10:05:50.753204+0000","last_fullsized":"2024-04-25T10:05:50.753204+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:43.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753804+0000","last_change":"2024-04-25T10:05:49.286825+0000","last_active":"2024-04-25T10:05:50.753804+0000","last_peered":"2024-04-25T10:05:50.753804+0000","last_clean":"2024-04-25T10:05:50.753804+0000","last_became_active":"2024-04-25T10:05:49.277289+0000","last_became_peered":"2024-04-25T10:05:49.277289+0000","last_unstale":"2024-04-25T10:05:50.753804+0000","last_undegraded":"2024-04-25T10:05:50.753804+0000","last_fullsized":"2024-04-25T10:05:50.753804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:06.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286612+0000","last_change":"2024-04-25T10:05:48.283276+0000","last_active":"2024-04-25T10:05:48.286612+0000","last_peered":"2024-04-25T10:05:48.286612+0000","last_clean":"2024-04-25T10:05:48.286612+0000","last_became_active":"2024-04-25T10:05:48.282966+0000","last_became_peered":"2024-04-25T10:05:48.282966+0000","last_unstale":"2024-04-25T10:05:48.286612+0000","last_undegraded":"2024-04-25T10:05:48.286612+0000","last_fullsized":"2024-04-25T10:05:48.286612+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.201380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753012+0000","last_change":"2024-04-25T10:05:49.279816+0000","last_active":"2024-04-25T10:05:50.753012+0000","last_peered":"2024-04-25T10:05:50.753012+0000","last_clean":"2024-04-25T10:05:50.753012+0000","last_became_active":"2024-04-25T10:05:49.278817+0000","last_became_peered":"2024-04-25T10:05:49.278817+0000","last_unstale":"2024-04-25T10:05:50.753012+0000","last_undegraded":"2024-04-25T10:05:50.753012+0000","last_fullsized":"2024-04-25T10:05:50.753012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:19.953916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275950+0000","last_change":"2024-04-25T10:05:48.274031+0000","last_active":"2024-04-25T10:05:48.275950+0000","last_peered":"2024-04-25T10:05:48.275950+0000","last_clean":"2024-04-25T10:05:48.275950+0000","last_became_active":"2024-04-25T10:05:48.273773+0000","last_became_peered":"2024-04-25T10:05:48.273773+0000","last_unstale":"2024-04-25T10:05:48.275950+0000","last_undegraded":"2024-04-25T10:05:48.275950+0000","last_fullsized":"2024-04-25T10:05:48.275950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753930+0000","last_change":"2024-04-25T10:05:49.292075+0000","last_active":"2024-04-25T10:05:50.753930+0000","last_peered":"2024-04-25T10:05:50.753930+0000","last_clean":"2024-04-25T10:05:50.753930+0000","last_became_active":"2024-04-25T10:05:49.290568+0000","last_became_peered":"2024-04-25T10:05:49.290568+0000","last_unstale":"2024-04-25T10:05:50.753930+0000","last_undegraded":"2024-04-25T10:05:50.753930+0000","last_fullsized":"2024-04-25T10:05:50.753930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:14.833904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752608+0000","last_change":"2024-04-25T10:05:48.265471+0000","last_active":"2024-04-25T10:05:50.752608+0000","last_peered":"2024-04-25T10:05:50.752608+0000","last_clean":"2024-04-25T10:05:50.752608+0000","last_became_active":"2024-04-25T10:05:48.265206+0000","last_became_peered":"2024-04-25T10:05:48.265206+0000","last_unstale":"2024-04-25T10:05:50.752608+0000","last_undegraded":"2024-04-25T10:05:50.752608+0000","last_fullsized":"2024-04-25T10:05:50.752608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.065657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752783+0000","last_change":"2024-04-25T10:05:49.287611+0000","last_active":"2024-04-25T10:05:50.752783+0000","last_peered":"2024-04-25T10:05:50.752783+0000","last_clean":"2024-04-25T10:05:50.752783+0000","last_became_active":"2024-04-25T10:05:49.287212+0000","last_became_peered":"2024-04-25T10:05:49.287212+0000","last_unstale":"2024-04-25T10:05:50.752783+0000","last_undegraded":"2024-04-25T10:05:50.752783+0000","last_fullsized":"2024-04-25T10:05:50.752783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.073227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754064+0000","last_change":"2024-04-25T10:05:48.282046+0000","last_active":"2024-04-25T10:05:50.754064+0000","last_peered":"2024-04-25T10:05:50.754064+0000","last_clean":"2024-04-25T10:05:50.754064+0000","last_became_active":"2024-04-25T10:05:48.279856+0000","last_became_peered":"2024-04-25T10:05:48.279856+0000","last_unstale":"2024-04-25T10:05:50.754064+0000","last_undegraded":"2024-04-25T10:05:50.754064+0000","last_fullsized":"2024-04-25T10:05:50.754064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:36.907141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273399+0000","last_change":"2024-04-25T10:05:49.288251+0000","last_active":"2024-04-25T10:05:50.273399+0000","last_peered":"2024-04-25T10:05:50.273399+0000","last_clean":"2024-04-25T10:05:50.273399+0000","last_became_active":"2024-04-25T10:05:49.287944+0000","last_became_peered":"2024-04-25T10:05:49.287944+0000","last_unstale":"2024-04-25T10:05:50.273399+0000","last_undegraded":"2024-04-25T10:05:50.273399+0000","last_fullsized":"2024-04-25T10:05:50.273399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:05.168013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753178+0000","last_change":"2024-04-25T10:05:48.270200+0000","last_active":"2024-04-25T10:05:50.753178+0000","last_peered":"2024-04-25T10:05:50.753178+0000","last_clean":"2024-04-25T10:05:50.753178+0000","last_became_active":"2024-04-25T10:05:48.269876+0000","last_became_peered":"2024-04-25T10:05:48.269876+0000","last_unstale":"2024-04-25T10:05:50.753178+0000","last_undegraded":"2024-04-25T10:05:50.753178+0000","last_fullsized":"2024-04-25T10:05:50.753178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:19.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260952+0000","last_change":"2024-04-25T10:05:48.260952+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260952+0000","last_undegraded":"2024-04-25T10:05:48.260952+0000","last_fullsized":"2024-04-25T10:05:48.260952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273224+0000","last_change":"2024-04-25T10:05:48.271962+0000","last_active":"2024-04-25T10:05:48.273224+0000","last_peered":"2024-04-25T10:05:48.273224+0000","last_clean":"2024-04-25T10:05:48.273224+0000","last_became_active":"2024-04-25T10:05:48.271483+0000","last_became_peered":"2024-04-25T10:05:48.271483+0000","last_unstale":"2024-04-25T10:05:48.273224+0000","last_undegraded":"2024-04-25T10:05:48.273224+0000","last_fullsized":"2024-04-25T10:05:48.273224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:11.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273599+0000","last_change":"2024-04-25T10:05:49.273945+0000","last_active":"2024-04-25T10:05:50.273599+0000","last_peered":"2024-04-25T10:05:50.273599+0000","last_clean":"2024-04-25T10:05:50.273599+0000","last_became_active":"2024-04-25T10:05:49.273627+0000","last_became_peered":"2024-04-25T10:05:49.273627+0000","last_unstale":"2024-04-25T10:05:50.273599+0000","last_undegraded":"2024-04-25T10:05:50.273599+0000","last_fullsized":"2024-04-25T10:05:50.273599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273084+0000","last_change":"2024-04-25T10:05:48.267427+0000","last_active":"2024-04-25T10:05:48.273084+0000","last_peered":"2024-04-25T10:05:48.273084+0000","last_clean":"2024-04-25T10:05:48.273084+0000","last_became_active":"2024-04-25T10:05:48.267151+0000","last_became_peered":"2024-04-25T10:05:48.267151+0000","last_unstale":"2024-04-25T10:05:48.273084+0000","last_undegraded":"2024-04-25T10:05:48.273084+0000","last_fullsized":"2024-04-25T10:05:48.273084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:25.452679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263960+0000","last_change":"2024-04-25T10:05:48.263960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263960+0000","last_undegraded":"2024-04-25T10:05:48.263960+0000","last_fullsized":"2024-04-25T10:05:48.263960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273648+0000","last_change":"2024-04-25T10:05:48.270641+0000","last_active":"2024-04-25T10:05:50.273648+0000","last_peered":"2024-04-25T10:05:50.273648+0000","last_clean":"2024-04-25T10:05:50.273648+0000","last_became_active":"2024-04-25T10:05:48.270317+0000","last_became_peered":"2024-04-25T10:05:48.270317+0000","last_unstale":"2024-04-25T10:05:50.273648+0000","last_undegraded":"2024-04-25T10:05:50.273648+0000","last_fullsized":"2024-04-25T10:05:50.273648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257960+0000","last_change":"2024-04-25T10:05:48.257960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257960+0000","last_undegraded":"2024-04-25T10:05:48.257960+0000","last_fullsized":"2024-04-25T10:05:48.257960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752480+0000","last_change":"2024-04-25T10:05:48.269712+0000","last_active":"2024-04-25T10:05:50.752480+0000","last_peered":"2024-04-25T10:05:50.752480+0000","last_clean":"2024-04-25T10:05:50.752480+0000","last_became_active":"2024-04-25T10:05:48.269322+0000","last_became_peered":"2024-04-25T10:05:48.269322+0000","last_unstale":"2024-04-25T10:05:50.752480+0000","last_undegraded":"2024-04-25T10:05:50.752480+0000","last_fullsized":"2024-04-25T10:05:50.752480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:04.949669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754039+0000","last_change":"2024-04-25T10:05:49.287123+0000","last_active":"2024-04-25T10:05:50.754039+0000","last_peered":"2024-04-25T10:05:50.754039+0000","last_clean":"2024-04-25T10:05:50.754039+0000","last_became_active":"2024-04-25T10:05:49.286843+0000","last_became_peered":"2024-04-25T10:05:49.286843+0000","last_unstale":"2024-04-25T10:05:50.754039+0000","last_undegraded":"2024-04-25T10:05:50.754039+0000","last_fullsized":"2024-04-25T10:05:50.754039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:22.087955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752866+0000","last_change":"2024-04-25T10:05:48.281874+0000","last_active":"2024-04-25T10:05:50.752866+0000","last_peered":"2024-04-25T10:05:50.752866+0000","last_clean":"2024-04-25T10:05:50.752866+0000","last_became_active":"2024-04-25T10:05:48.281609+0000","last_became_peered":"2024-04-25T10:05:48.281609+0000","last_unstale":"2024-04-25T10:05:50.752866+0000","last_undegraded":"2024-04-25T10:05:50.752866+0000","last_fullsized":"2024-04-25T10:05:50.752866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273809+0000","last_change":"2024-04-25T10:05:49.283100+0000","last_active":"2024-04-25T10:05:50.273809+0000","last_peered":"2024-04-25T10:05:50.273809+0000","last_clean":"2024-04-25T10:05:50.273809+0000","last_became_active":"2024-04-25T10:05:49.282848+0000","last_became_peered":"2024-04-25T10:05:49.282848+0000","last_unstale":"2024-04-25T10:05:50.273809+0000","last_undegraded":"2024-04-25T10:05:50.273809+0000","last_fullsized":"2024-04-25T10:05:50.273809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752169+0000","last_change":"2024-04-25T10:05:48.272439+0000","last_active":"2024-04-25T10:05:50.752169+0000","last_peered":"2024-04-25T10:05:50.752169+0000","last_clean":"2024-04-25T10:05:50.752169+0000","last_became_active":"2024-04-25T10:05:48.272138+0000","last_became_peered":"2024-04-25T10:05:48.272138+0000","last_unstale":"2024-04-25T10:05:50.752169+0000","last_undegraded":"2024-04-25T10:05:50.752169+0000","last_fullsized":"2024-04-25T10:05:50.752169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:37.575727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264035+0000","last_change":"2024-04-25T10:05:48.264035+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264035+0000","last_undegraded":"2024-04-25T10:05:48.264035+0000","last_fullsized":"2024-04-25T10:05:48.264035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286603+0000","last_change":"2024-04-25T10:05:48.283226+0000","last_active":"2024-04-25T10:05:48.286603+0000","last_peered":"2024-04-25T10:05:48.286603+0000","last_clean":"2024-04-25T10:05:48.286603+0000","last_became_active":"2024-04-25T10:05:48.282936+0000","last_became_peered":"2024-04-25T10:05:48.282936+0000","last_unstale":"2024-04-25T10:05:48.286603+0000","last_undegraded":"2024-04-25T10:05:48.286603+0000","last_fullsized":"2024-04-25T10:05:48.286603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:59.924963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273466+0000","last_change":"2024-04-25T10:05:49.267528+0000","last_active":"2024-04-25T10:05:50.273466+0000","last_peered":"2024-04-25T10:05:50.273466+0000","last_clean":"2024-04-25T10:05:50.273466+0000","last_became_active":"2024-04-25T10:05:49.267253+0000","last_became_peered":"2024-04-25T10:05:49.267253+0000","last_unstale":"2024-04-25T10:05:50.273466+0000","last_undegraded":"2024-04-25T10:05:50.273466+0000","last_fullsized":"2024-04-25T10:05:50.273466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.973080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286770+0000","last_change":"2024-04-25T10:05:48.281960+0000","last_active":"2024-04-25T10:05:48.286770+0000","last_peered":"2024-04-25T10:05:48.286770+0000","last_clean":"2024-04-25T10:05:48.286770+0000","last_became_active":"2024-04-25T10:05:48.281643+0000","last_became_peered":"2024-04-25T10:05:48.281643+0000","last_unstale":"2024-04-25T10:05:48.286770+0000","last_undegraded":"2024-04-25T10:05:48.286770+0000","last_fullsized":"2024-04-25T10:05:48.286770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753397+0000","last_change":"2024-04-25T10:05:49.278775+0000","last_active":"2024-04-25T10:05:50.753397+0000","last_peered":"2024-04-25T10:05:50.753397+0000","last_clean":"2024-04-25T10:05:50.753397+0000","last_became_active":"2024-04-25T10:05:49.278156+0000","last_became_peered":"2024-04-25T10:05:49.278156+0000","last_unstale":"2024-04-25T10:05:50.753397+0000","last_undegraded":"2024-04-25T10:05:50.753397+0000","last_fullsized":"2024-04-25T10:05:50.753397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:58.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753377+0000","last_change":"2024-04-25T10:05:48.284598+0000","last_active":"2024-04-25T10:05:50.753377+0000","last_peered":"2024-04-25T10:05:50.753377+0000","last_clean":"2024-04-25T10:05:50.753377+0000","last_became_active":"2024-04-25T10:05:48.284293+0000","last_became_peered":"2024-04-25T10:05:48.284293+0000","last_unstale":"2024-04-25T10:05:50.753377+0000","last_undegraded":"2024-04-25T10:05:50.753377+0000","last_fullsized":"2024-04-25T10:05:50.753377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:55.962777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753276+0000","last_change":"2024-04-25T10:05:49.279763+0000","last_active":"2024-04-25T10:05:50.753276+0000","last_peered":"2024-04-25T10:05:50.753276+0000","last_clean":"2024-04-25T10:05:50.753276+0000","last_became_active":"2024-04-25T10:05:49.279445+0000","last_became_peered":"2024-04-25T10:05:49.279445+0000","last_unstale":"2024-04-25T10:05:50.753276+0000","last_undegraded":"2024-04-25T10:05:50.753276+0000","last_fullsized":"2024-04-25T10:05:50.753276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:58.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753442+0000","last_change":"2024-04-25T10:05:48.268661+0000","last_active":"2024-04-25T10:05:50.753442+0000","last_peered":"2024-04-25T10:05:50.753442+0000","last_clean":"2024-04-25T10:05:50.753442+0000","last_became_active":"2024-04-25T10:05:48.268385+0000","last_became_peered":"2024-04-25T10:05:48.268385+0000","last_unstale":"2024-04-25T10:05:50.753442+0000","last_undegraded":"2024-04-25T10:05:50.753442+0000","last_fullsized":"2024-04-25T10:05:50.753442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:25.882935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262617+0000","last_change":"2024-04-25T10:05:48.262617+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262617+0000","last_undegraded":"2024-04-25T10:05:48.262617+0000","last_fullsized":"2024-04-25T10:05:48.262617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752574+0000","last_change":"2024-04-25T10:05:48.275050+0000","last_active":"2024-04-25T10:05:50.752574+0000","last_peered":"2024-04-25T10:05:50.752574+0000","last_clean":"2024-04-25T10:05:50.752574+0000","last_became_active":"2024-04-25T10:05:48.274788+0000","last_became_peered":"2024-04-25T10:05:48.274788+0000","last_unstale":"2024-04-25T10:05:50.752574+0000","last_undegraded":"2024-04-25T10:05:50.752574+0000","last_fullsized":"2024-04-25T10:05:50.752574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:10.415099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753846+0000","last_change":"2024-04-25T10:05:49.281926+0000","last_active":"2024-04-25T10:05:50.753846+0000","last_peered":"2024-04-25T10:05:50.753846+0000","last_clean":"2024-04-25T10:05:50.753846+0000","last_became_active":"2024-04-25T10:05:49.281693+0000","last_became_peered":"2024-04-25T10:05:49.281693+0000","last_unstale":"2024-04-25T10:05:50.753846+0000","last_undegraded":"2024-04-25T10:05:50.753846+0000","last_fullsized":"2024-04-25T10:05:50.753846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:25.453805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281271+0000","last_change":"2024-04-25T10:05:48.276064+0000","last_active":"2024-04-25T10:05:48.281271+0000","last_peered":"2024-04-25T10:05:48.281271+0000","last_clean":"2024-04-25T10:05:48.281271+0000","last_became_active":"2024-04-25T10:05:48.275744+0000","last_became_peered":"2024-04-25T10:05:48.275744+0000","last_unstale":"2024-04-25T10:05:48.281271+0000","last_undegraded":"2024-04-25T10:05:48.281271+0000","last_fullsized":"2024-04-25T10:05:48.281271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753468+0000","last_change":"2024-04-25T10:05:49.297061+0000","last_active":"2024-04-25T10:05:50.753468+0000","last_peered":"2024-04-25T10:05:50.753468+0000","last_clean":"2024-04-25T10:05:50.753468+0000","last_became_active":"2024-04-25T10:05:49.294500+0000","last_became_peered":"2024-04-25T10:05:49.294500+0000","last_unstale":"2024-04-25T10:05:50.753468+0000","last_undegraded":"2024-04-25T10:05:50.753468+0000","last_fullsized":"2024-04-25T10:05:50.753468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.086551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281034+0000","last_change":"2024-04-25T10:05:48.277544+0000","last_active":"2024-04-25T10:05:48.281034+0000","last_peered":"2024-04-25T10:05:48.281034+0000","last_clean":"2024-04-25T10:05:48.281034+0000","last_became_active":"2024-04-25T10:05:48.277305+0000","last_became_peered":"2024-04-25T10:05:48.277305+0000","last_unstale":"2024-04-25T10:05:48.281034+0000","last_undegraded":"2024-04-25T10:05:48.281034+0000","last_fullsized":"2024-04-25T10:05:48.281034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256078+0000","last_change":"2024-04-25T10:05:48.256078+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256078+0000","last_undegraded":"2024-04-25T10:05:48.256078+0000","last_fullsized":"2024-04-25T10:05:48.256078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753974+0000","last_change":"2024-04-25T10:05:48.280958+0000","last_active":"2024-04-25T10:05:50.753974+0000","last_peered":"2024-04-25T10:05:50.753974+0000","last_clean":"2024-04-25T10:05:50.753974+0000","last_became_active":"2024-04-25T10:05:48.280282+0000","last_became_peered":"2024-04-25T10:05:48.280282+0000","last_unstale":"2024-04-25T10:05:50.753974+0000","last_undegraded":"2024-04-25T10:05:50.753974+0000","last_fullsized":"2024-04-25T10:05:50.753974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:05.893165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":224,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.267693+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:48.267693+0000","last_peered":"2024-04-25T10:05:48.267693+0000","last_clean":"2024-04-25T10:05:48.267693+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:48.267693+0000","last_undegraded":"2024-04-25T10:05:48.267693+0000","last_fullsized":"2024-04-25T10:05:48.267693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1179648,"data_stored":847823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":638976,"data_stored":279615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":279593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":278141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":868405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:53.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.948+0000 7fd3d6800640 1 Processor -- start 2024-04-25T10:05:53.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.948+0000 7fd3d6800640 1 -- start start 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3d6800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d00cf370 0x7fd3d0099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3d6800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3d009a600 0x7fd3d00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3d6800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d009a380 con 0x7fd3d0099a60 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3d6800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d00d0410 con 0x7fd3d009a600 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3d6800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00cf800 con 0x7fd3d00cf370 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cf400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd3d0099a60 0x7fd3d015bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47666/0 (socket says 172.21.15.18:47666) 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cf400640 1 -- 172.21.15.18:0/2410202167 learned_addr learned my addr 172.21.15.18:0/2410202167 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cfe00640 1 --2- 172.21.15.18:0/2410202167 >> v2:172.21.15.18:3300/0 conn(0x7fd3d009a600 0x7fd3d00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3c7e00640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d00cf370 0x7fd3d0099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cea00640 1 -- 172.21.15.18:0/2410202167 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915563637 0 0) 0x7fd3d009a380 con 0x7fd3d0099a60 2024-04-25T10:05:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cfe00640 1 -- 172.21.15.18:0/2410202167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d00cf370 msgr2=0x7fd3d0099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cfe00640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d00cf370 0x7fd3d0099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cfe00640 1 -- 172.21.15.18:0/2410202167 >> v1:172.21.15.18:6789/0 conn(0x7fd3d0099a60 legacy=0x7fd3d015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.952+0000 7fd3cfe00640 1 -- 172.21.15.18:0/2410202167 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00cfae0 con 0x7fd3d009a600 2024-04-25T10:05:53.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3cfe00640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d009a600 0x7fd3d00cc2b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009d90 tx=0x7fd3c801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b4a2895764b3ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3cea00640 1 -- 172.21.15.18:0/2410202167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80b2070 con 0x7fd3d009a600 2024-04-25T10:05:53.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3cea00640 1 -- 172.21.15.18:0/2410202167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c80a58f0 con 0x7fd3d009a600 2024-04-25T10:05:53.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3cea00640 1 -- 172.21.15.18:0/2410202167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c80a5cc0 con 0x7fd3d009a600 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- 172.21.15.18:0/2410202167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d009a600 msgr2=0x7fd3d00cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d009a600 0x7fd3d00cc2b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009d90 tx=0x7fd3c801c8b0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- 172.21.15.18:0/2410202167 shutdown_connections 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d009a600 0x7fd3d00cc2b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 --2- 172.21.15.18:0/2410202167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d00cf370 0x7fd3d0099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- 172.21.15.18:0/2410202167 >> 172.21.15.18:0/2410202167 conn(0x7fd3d00d17a0 msgr2=0x7fd3d00d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:53.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- 172.21.15.18:0/2410202167 shutdown_connections 2024-04-25T10:05:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- 172.21.15.18:0/2410202167 wait complete. 2024-04-25T10:05:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 Processor -- start 2024-04-25T10:05:53.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 -- start start 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.956+0000 7fd3d6800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d009a600 0x7fd3d00b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 0x7fd3d01535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00cd390 con 0x7fd3d0099a60 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00cd210 con 0x7fd3d00b1d50 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d00cd510 con 0x7fd3d009a600 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42082/0 (socket says 172.21.15.18:42082) 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 -- 172.21.15.18:0/833316139 learned_addr learned my addr 172.21.15.18:0/833316139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3c7e00640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d009a600 0x7fd3d00b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cfe00640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 0x7fd3d01535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 -- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d009a600 msgr2=0x7fd3d00b00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d009a600 0x7fd3d00b00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 -- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 msgr2=0x7fd3d01535a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 0x7fd3d01535a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 -- 172.21.15.18:0/833316139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d00cef60 con 0x7fd3d0099a60 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cfe00640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 0x7fd3d01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3cf400640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c480 tx=0x7fd3c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0018070 con 0x7fd3d0099a60 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c0007500 con 0x7fd3d0099a60 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0004a30 con 0x7fd3d0099a60 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d00c77c0 con 0x7fd3d0099a60 2024-04-25T10:05:53.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d00c7d80 con 0x7fd3d0099a60 2024-04-25T10:05:53.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d00745d0 con 0x7fd3d0099a60 2024-04-25T10:05:53.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.960+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd3c0004bd0 con 0x7fd3d0099a60 2024-04-25T10:05:53.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.964+0000 7fd3c7400640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 0x7fd3ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:53.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.964+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd3c00843a0 con 0x7fd3d0099a60 2024-04-25T10:05:53.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.964+0000 7fd3c7e00640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 0x7fd3ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:53.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.964+0000 7fd3c7e00640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 0x7fd3ac069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd3d01f9e40 tx=0x7fd3b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:53.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:53.968+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3c0054bc0 con 0x7fd3d0099a60 2024-04-25T10:05:54.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.124+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3d00d2620 con 0x7fd3ac066f60 2024-04-25T10:05:54.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.132+0000 7fd3c7400640 1 -- 172.21.15.18:0/833316139 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249805 (secure 0 0 0) 0x7fd3d00d2620 con 0x7fd3ac066f60 2024-04-25T10:05:54.146 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:54.148 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 msgr2=0x7fd3ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 0x7fd3ac069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd3d01f9e40 tx=0x7fd3b8008040 comp rx=0 tx=0).stop 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 msgr2=0x7fd3d00ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fd3c000c480 tx=0x7fd3c000c940 comp rx=0 tx=0).stop 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 shutdown_connections 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3d00b1d50 0x7fd3d01535a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd3ac066f60 0x7fd3ac069420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3d009a600 0x7fd3d00b00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 --2- 172.21.15.18:0/833316139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3d0099a60 0x7fd3d00ae540 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 >> 172.21.15.18:0/833316139 conn(0x7fd3d00d17a0 msgr2=0x7fd3d0099e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 shutdown_connections 2024-04-25T10:05:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.136+0000 7fd3d6800640 1 -- 172.21.15.18:0/833316139 wait complete. 2024-04-25T10:05:54.166 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-04-25T10:05:53.423578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238740,"kb_used_data":5924,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735980,"statfs":{"total":773094113280,"available":772849643520,"internally_reserved":0,"allocated":6066176,"data_stored":3325942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001566"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273860+0000","last_change":"2024-04-25T10:05:49.285079+0000","last_active":"2024-04-25T10:05:50.273860+0000","last_peered":"2024-04-25T10:05:50.273860+0000","last_clean":"2024-04-25T10:05:50.273860+0000","last_became_active":"2024-04-25T10:05:49.284804+0000","last_became_peered":"2024-04-25T10:05:49.284804+0000","last_unstale":"2024-04-25T10:05:50.273860+0000","last_undegraded":"2024-04-25T10:05:50.273860+0000","last_fullsized":"2024-04-25T10:05:50.273860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264912+0000","last_change":"2024-04-25T10:05:48.264912+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264912+0000","last_undegraded":"2024-04-25T10:05:48.264912+0000","last_fullsized":"2024-04-25T10:05:48.264912+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753632+0000","last_change":"2024-04-25T10:05:49.287086+0000","last_active":"2024-04-25T10:05:50.753632+0000","last_peered":"2024-04-25T10:05:50.753632+0000","last_clean":"2024-04-25T10:05:50.753632+0000","last_became_active":"2024-04-25T10:05:49.285731+0000","last_became_peered":"2024-04-25T10:05:49.285731+0000","last_unstale":"2024-04-25T10:05:50.753632+0000","last_undegraded":"2024-04-25T10:05:50.753632+0000","last_fullsized":"2024-04-25T10:05:50.753632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:16.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263046+0000","last_change":"2024-04-25T10:05:48.263046+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263046+0000","last_undegraded":"2024-04-25T10:05:48.263046+0000","last_fullsized":"2024-04-25T10:05:48.263046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260500+0000","last_change":"2024-04-25T10:05:48.260500+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260500+0000","last_undegraded":"2024-04-25T10:05:48.260500+0000","last_fullsized":"2024-04-25T10:05:48.260500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273516+0000","last_change":"2024-04-25T10:05:49.282396+0000","last_active":"2024-04-25T10:05:50.273516+0000","last_peered":"2024-04-25T10:05:50.273516+0000","last_clean":"2024-04-25T10:05:50.273516+0000","last_became_active":"2024-04-25T10:05:49.281398+0000","last_became_peered":"2024-04-25T10:05:49.281398+0000","last_unstale":"2024-04-25T10:05:50.273516+0000","last_undegraded":"2024-04-25T10:05:50.273516+0000","last_fullsized":"2024-04-25T10:05:50.273516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.475074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752757+0000","last_change":"2024-04-25T10:05:49.286501+0000","last_active":"2024-04-25T10:05:50.752757+0000","last_peered":"2024-04-25T10:05:50.752757+0000","last_clean":"2024-04-25T10:05:50.752757+0000","last_became_active":"2024-04-25T10:05:49.286244+0000","last_became_peered":"2024-04-25T10:05:49.286244+0000","last_unstale":"2024-04-25T10:05:50.752757+0000","last_undegraded":"2024-04-25T10:05:50.752757+0000","last_fullsized":"2024-04-25T10:05:50.752757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752551+0000","last_change":"2024-04-25T10:05:49.292415+0000","last_active":"2024-04-25T10:05:50.752551+0000","last_peered":"2024-04-25T10:05:50.752551+0000","last_clean":"2024-04-25T10:05:50.752551+0000","last_became_active":"2024-04-25T10:05:49.292210+0000","last_became_peered":"2024-04-25T10:05:49.292210+0000","last_unstale":"2024-04-25T10:05:50.752551+0000","last_undegraded":"2024-04-25T10:05:50.752551+0000","last_fullsized":"2024-04-25T10:05:50.752551+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:42.412711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753322+0000","last_change":"2024-04-25T10:05:49.294200+0000","last_active":"2024-04-25T10:05:50.753322+0000","last_peered":"2024-04-25T10:05:50.753322+0000","last_clean":"2024-04-25T10:05:50.753322+0000","last_became_active":"2024-04-25T10:05:49.293943+0000","last_became_peered":"2024-04-25T10:05:49.293943+0000","last_unstale":"2024-04-25T10:05:50.753322+0000","last_undegraded":"2024-04-25T10:05:50.753322+0000","last_fullsized":"2024-04-25T10:05:50.753322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:20.041919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273688+0000","last_change":"2024-04-25T10:05:49.275464+0000","last_active":"2024-04-25T10:05:50.273688+0000","last_peered":"2024-04-25T10:05:50.273688+0000","last_clean":"2024-04-25T10:05:50.273688+0000","last_became_active":"2024-04-25T10:05:49.274039+0000","last_became_peered":"2024-04-25T10:05:49.274039+0000","last_unstale":"2024-04-25T10:05:50.273688+0000","last_undegraded":"2024-04-25T10:05:50.273688+0000","last_fullsized":"2024-04-25T10:05:50.273688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752801+0000","last_change":"2024-04-25T10:05:49.282389+0000","last_active":"2024-04-25T10:05:50.752801+0000","last_peered":"2024-04-25T10:05:50.752801+0000","last_clean":"2024-04-25T10:05:50.752801+0000","last_became_active":"2024-04-25T10:05:49.282122+0000","last_became_peered":"2024-04-25T10:05:49.282122+0000","last_unstale":"2024-04-25T10:05:50.752801+0000","last_undegraded":"2024-04-25T10:05:50.752801+0000","last_fullsized":"2024-04-25T10:05:50.752801+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:15.551190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753119+0000","last_change":"2024-04-25T10:05:49.286972+0000","last_active":"2024-04-25T10:05:50.753119+0000","last_peered":"2024-04-25T10:05:50.753119+0000","last_clean":"2024-04-25T10:05:50.753119+0000","last_became_active":"2024-04-25T10:05:49.286632+0000","last_became_peered":"2024-04-25T10:05:49.286632+0000","last_unstale":"2024-04-25T10:05:50.753119+0000","last_undegraded":"2024-04-25T10:05:50.753119+0000","last_fullsized":"2024-04-25T10:05:50.753119+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:57.536288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273434+0000","last_change":"2024-04-25T10:05:49.269276+0000","last_active":"2024-04-25T10:05:50.273434+0000","last_peered":"2024-04-25T10:05:50.273434+0000","last_clean":"2024-04-25T10:05:50.273434+0000","last_became_active":"2024-04-25T10:05:49.269012+0000","last_became_peered":"2024-04-25T10:05:49.269012+0000","last_unstale":"2024-04-25T10:05:50.273434+0000","last_undegraded":"2024-04-25T10:05:50.273434+0000","last_fullsized":"2024-04-25T10:05:50.273434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:37.910181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753593+0000","last_change":"2024-04-25T10:05:49.293545+0000","last_active":"2024-04-25T10:05:50.753593+0000","last_peered":"2024-04-25T10:05:50.753593+0000","last_clean":"2024-04-25T10:05:50.753593+0000","last_became_active":"2024-04-25T10:05:49.292750+0000","last_became_peered":"2024-04-25T10:05:49.292750+0000","last_unstale":"2024-04-25T10:05:50.753593+0000","last_undegraded":"2024-04-25T10:05:50.753593+0000","last_fullsized":"2024-04-25T10:05:50.753593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.143210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261510+0000","last_change":"2024-04-25T10:05:48.261510+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261510+0000","last_undegraded":"2024-04-25T10:05:48.261510+0000","last_fullsized":"2024-04-25T10:05:48.261510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273381+0000","last_change":"2024-04-25T10:05:49.266345+0000","last_active":"2024-04-25T10:05:50.273381+0000","last_peered":"2024-04-25T10:05:50.273381+0000","last_clean":"2024-04-25T10:05:50.273381+0000","last_became_active":"2024-04-25T10:05:49.266113+0000","last_became_peered":"2024-04-25T10:05:49.266113+0000","last_unstale":"2024-04-25T10:05:50.273381+0000","last_undegraded":"2024-04-25T10:05:50.273381+0000","last_fullsized":"2024-04-25T10:05:50.273381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:39.048517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754014+0000","last_change":"2024-04-25T10:05:49.290847+0000","last_active":"2024-04-25T10:05:50.754014+0000","last_peered":"2024-04-25T10:05:50.754014+0000","last_clean":"2024-04-25T10:05:50.754014+0000","last_became_active":"2024-04-25T10:05:49.289958+0000","last_became_peered":"2024-04-25T10:05:49.289958+0000","last_unstale":"2024-04-25T10:05:50.754014+0000","last_undegraded":"2024-04-25T10:05:50.754014+0000","last_fullsized":"2024-04-25T10:05:50.754014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:15.945832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264029+0000","last_change":"2024-04-25T10:05:48.264029+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264029+0000","last_undegraded":"2024-04-25T10:05:48.264029+0000","last_fullsized":"2024-04-25T10:05:48.264029+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753810+0000","last_change":"2024-04-25T10:05:49.286035+0000","last_active":"2024-04-25T10:05:50.753810+0000","last_peered":"2024-04-25T10:05:50.753810+0000","last_clean":"2024-04-25T10:05:50.753810+0000","last_became_active":"2024-04-25T10:05:49.285407+0000","last_became_peered":"2024-04-25T10:05:49.285407+0000","last_unstale":"2024-04-25T10:05:50.753810+0000","last_undegraded":"2024-04-25T10:05:50.753810+0000","last_fullsized":"2024-04-25T10:05:50.753810+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:01.390046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257006+0000","last_change":"2024-04-25T10:05:48.257006+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257006+0000","last_undegraded":"2024-04-25T10:05:48.257006+0000","last_fullsized":"2024-04-25T10:05:48.257006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256159+0000","last_change":"2024-04-25T10:05:48.256159+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256159+0000","last_undegraded":"2024-04-25T10:05:48.256159+0000","last_fullsized":"2024-04-25T10:05:48.256159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752422+0000","last_change":"2024-04-25T10:05:49.290986+0000","last_active":"2024-04-25T10:05:50.752422+0000","last_peered":"2024-04-25T10:05:50.752422+0000","last_clean":"2024-04-25T10:05:50.752422+0000","last_became_active":"2024-04-25T10:05:49.290722+0000","last_became_peered":"2024-04-25T10:05:49.290722+0000","last_unstale":"2024-04-25T10:05:50.752422+0000","last_undegraded":"2024-04-25T10:05:50.752422+0000","last_fullsized":"2024-04-25T10:05:50.752422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:59.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752349+0000","last_change":"2024-04-25T10:05:49.281828+0000","last_active":"2024-04-25T10:05:50.752349+0000","last_peered":"2024-04-25T10:05:50.752349+0000","last_clean":"2024-04-25T10:05:50.752349+0000","last_became_active":"2024-04-25T10:05:49.281534+0000","last_became_peered":"2024-04-25T10:05:49.281534+0000","last_unstale":"2024-04-25T10:05:50.752349+0000","last_undegraded":"2024-04-25T10:05:50.752349+0000","last_fullsized":"2024-04-25T10:05:50.752349+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:56.168674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753622+0000","last_change":"2024-04-25T10:05:49.280300+0000","last_active":"2024-04-25T10:05:50.753622+0000","last_peered":"2024-04-25T10:05:50.753622+0000","last_clean":"2024-04-25T10:05:50.753622+0000","last_became_active":"2024-04-25T10:05:49.280086+0000","last_became_peered":"2024-04-25T10:05:49.280086+0000","last_unstale":"2024-04-25T10:05:50.753622+0000","last_undegraded":"2024-04-25T10:05:50.753622+0000","last_fullsized":"2024-04-25T10:05:50.753622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.855084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754070+0000","last_change":"2024-04-25T10:05:49.290270+0000","last_active":"2024-04-25T10:05:50.754070+0000","last_peered":"2024-04-25T10:05:50.754070+0000","last_clean":"2024-04-25T10:05:50.754070+0000","last_became_active":"2024-04-25T10:05:49.289680+0000","last_became_peered":"2024-04-25T10:05:49.289680+0000","last_unstale":"2024-04-25T10:05:50.754070+0000","last_undegraded":"2024-04-25T10:05:50.754070+0000","last_fullsized":"2024-04-25T10:05:50.754070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:33.485998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752875+0000","last_change":"2024-04-25T10:05:49.280231+0000","last_active":"2024-04-25T10:05:50.752875+0000","last_peered":"2024-04-25T10:05:50.752875+0000","last_clean":"2024-04-25T10:05:50.752875+0000","last_became_active":"2024-04-25T10:05:49.279570+0000","last_became_peered":"2024-04-25T10:05:49.279570+0000","last_unstale":"2024-04-25T10:05:50.752875+0000","last_undegraded":"2024-04-25T10:05:50.752875+0000","last_fullsized":"2024-04-25T10:05:50.752875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:50.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273943+0000","last_change":"2024-04-25T10:05:49.288396+0000","last_active":"2024-04-25T10:05:50.273943+0000","last_peered":"2024-04-25T10:05:50.273943+0000","last_clean":"2024-04-25T10:05:50.273943+0000","last_became_active":"2024-04-25T10:05:49.287993+0000","last_became_peered":"2024-04-25T10:05:49.287993+0000","last_unstale":"2024-04-25T10:05:50.273943+0000","last_undegraded":"2024-04-25T10:05:50.273943+0000","last_fullsized":"2024-04-25T10:05:50.273943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256497+0000","last_change":"2024-04-25T10:05:48.256497+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256497+0000","last_undegraded":"2024-04-25T10:05:48.256497+0000","last_fullsized":"2024-04-25T10:05:48.256497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752992+0000","last_change":"2024-04-25T10:05:49.281466+0000","last_active":"2024-04-25T10:05:50.752992+0000","last_peered":"2024-04-25T10:05:50.752992+0000","last_clean":"2024-04-25T10:05:50.752992+0000","last_became_active":"2024-04-25T10:05:49.281165+0000","last_became_peered":"2024-04-25T10:05:49.281165+0000","last_unstale":"2024-04-25T10:05:50.752992+0000","last_undegraded":"2024-04-25T10:05:50.752992+0000","last_fullsized":"2024-04-25T10:05:50.752992+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:11.398600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262964+0000","last_change":"2024-04-25T10:05:48.262964+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262964+0000","last_undegraded":"2024-04-25T10:05:48.262964+0000","last_fullsized":"2024-04-25T10:05:48.262964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752900+0000","last_change":"2024-04-25T10:05:49.286018+0000","last_active":"2024-04-25T10:05:50.752900+0000","last_peered":"2024-04-25T10:05:50.752900+0000","last_clean":"2024-04-25T10:05:50.752900+0000","last_became_active":"2024-04-25T10:05:49.285531+0000","last_became_peered":"2024-04-25T10:05:49.285531+0000","last_unstale":"2024-04-25T10:05:50.752900+0000","last_undegraded":"2024-04-25T10:05:50.752900+0000","last_fullsized":"2024-04-25T10:05:50.752900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:14.155973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265891+0000","last_change":"2024-04-25T10:05:48.265891+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265891+0000","last_undegraded":"2024-04-25T10:05:48.265891+0000","last_fullsized":"2024-04-25T10:05:48.265891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261054+0000","last_change":"2024-04-25T10:05:48.261054+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261054+0000","last_undegraded":"2024-04-25T10:05:48.261054+0000","last_fullsized":"2024-04-25T10:05:48.261054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272908+0000","last_change":"2024-04-25T10:05:48.269196+0000","last_active":"2024-04-25T10:05:48.272908+0000","last_peered":"2024-04-25T10:05:48.272908+0000","last_clean":"2024-04-25T10:05:48.272908+0000","last_became_active":"2024-04-25T10:05:48.268189+0000","last_became_peered":"2024-04-25T10:05:48.268189+0000","last_unstale":"2024-04-25T10:05:48.272908+0000","last_undegraded":"2024-04-25T10:05:48.272908+0000","last_fullsized":"2024-04-25T10:05:48.272908+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:22.346700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262585+0000","last_change":"2024-04-25T10:05:48.262585+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262585+0000","last_undegraded":"2024-04-25T10:05:48.262585+0000","last_fullsized":"2024-04-25T10:05:48.262585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273598+0000","last_change":"2024-04-25T10:05:48.275908+0000","last_active":"2024-04-25T10:05:50.273598+0000","last_peered":"2024-04-25T10:05:50.273598+0000","last_clean":"2024-04-25T10:05:50.273598+0000","last_became_active":"2024-04-25T10:05:48.274479+0000","last_became_peered":"2024-04-25T10:05:48.274479+0000","last_unstale":"2024-04-25T10:05:50.273598+0000","last_undegraded":"2024-04-25T10:05:50.273598+0000","last_fullsized":"2024-04-25T10:05:50.273598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257851+0000","last_change":"2024-04-25T10:05:48.257851+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257851+0000","last_undegraded":"2024-04-25T10:05:48.257851+0000","last_fullsized":"2024-04-25T10:05:48.257851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273866+0000","last_change":"2024-04-25T10:05:48.271308+0000","last_active":"2024-04-25T10:05:50.273866+0000","last_peered":"2024-04-25T10:05:50.273866+0000","last_clean":"2024-04-25T10:05:50.273866+0000","last_became_active":"2024-04-25T10:05:48.270922+0000","last_became_peered":"2024-04-25T10:05:48.270922+0000","last_unstale":"2024-04-25T10:05:50.273866+0000","last_undegraded":"2024-04-25T10:05:50.273866+0000","last_fullsized":"2024-04-25T10:05:50.273866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752734+0000","last_change":"2024-04-25T10:05:49.279560+0000","last_active":"2024-04-25T10:05:50.752734+0000","last_peered":"2024-04-25T10:05:50.752734+0000","last_clean":"2024-04-25T10:05:50.752734+0000","last_became_active":"2024-04-25T10:05:49.278516+0000","last_became_peered":"2024-04-25T10:05:49.278516+0000","last_unstale":"2024-04-25T10:05:50.752734+0000","last_undegraded":"2024-04-25T10:05:50.752734+0000","last_fullsized":"2024-04-25T10:05:50.752734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:10.096617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.280963+0000","last_change":"2024-04-25T10:05:48.275810+0000","last_active":"2024-04-25T10:05:48.280963+0000","last_peered":"2024-04-25T10:05:48.280963+0000","last_clean":"2024-04-25T10:05:48.280963+0000","last_became_active":"2024-04-25T10:05:48.275553+0000","last_became_peered":"2024-04-25T10:05:48.275553+0000","last_unstale":"2024-04-25T10:05:48.280963+0000","last_undegraded":"2024-04-25T10:05:48.280963+0000","last_fullsized":"2024-04-25T10:05:48.280963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259924+0000","last_change":"2024-04-25T10:05:48.259924+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259924+0000","last_undegraded":"2024-04-25T10:05:48.259924+0000","last_fullsized":"2024-04-25T10:05:48.259924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753106+0000","last_change":"2024-04-25T10:05:48.276598+0000","last_active":"2024-04-25T10:05:50.753106+0000","last_peered":"2024-04-25T10:05:50.753106+0000","last_clean":"2024-04-25T10:05:50.753106+0000","last_became_active":"2024-04-25T10:05:48.276341+0000","last_became_peered":"2024-04-25T10:05:48.276341+0000","last_unstale":"2024-04-25T10:05:50.753106+0000","last_undegraded":"2024-04-25T10:05:50.753106+0000","last_fullsized":"2024-04-25T10:05:50.753106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:01.796857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265323+0000","last_change":"2024-04-25T10:05:48.265323+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265323+0000","last_undegraded":"2024-04-25T10:05:48.265323+0000","last_fullsized":"2024-04-25T10:05:48.265323+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272465+0000","last_change":"2024-04-25T10:05:48.268595+0000","last_active":"2024-04-25T10:05:48.272465+0000","last_peered":"2024-04-25T10:05:48.272465+0000","last_clean":"2024-04-25T10:05:48.272465+0000","last_became_active":"2024-04-25T10:05:48.267579+0000","last_became_peered":"2024-04-25T10:05:48.267579+0000","last_unstale":"2024-04-25T10:05:48.272465+0000","last_undegraded":"2024-04-25T10:05:48.272465+0000","last_fullsized":"2024-04-25T10:05:48.272465+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.298325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753172+0000","last_change":"2024-04-25T10:05:49.280027+0000","last_active":"2024-04-25T10:05:50.753172+0000","last_peered":"2024-04-25T10:05:50.753172+0000","last_clean":"2024-04-25T10:05:50.753172+0000","last_became_active":"2024-04-25T10:05:49.279193+0000","last_became_peered":"2024-04-25T10:05:49.279193+0000","last_unstale":"2024-04-25T10:05:50.753172+0000","last_undegraded":"2024-04-25T10:05:50.753172+0000","last_fullsized":"2024-04-25T10:05:50.753172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:45.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272949+0000","last_change":"2024-04-25T10:05:48.269624+0000","last_active":"2024-04-25T10:05:48.272949+0000","last_peered":"2024-04-25T10:05:48.272949+0000","last_clean":"2024-04-25T10:05:48.272949+0000","last_became_active":"2024-04-25T10:05:48.266543+0000","last_became_peered":"2024-04-25T10:05:48.266543+0000","last_unstale":"2024-04-25T10:05:48.272949+0000","last_undegraded":"2024-04-25T10:05:48.272949+0000","last_fullsized":"2024-04-25T10:05:48.272949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:38.293978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263559+0000","last_change":"2024-04-25T10:05:48.263559+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263559+0000","last_undegraded":"2024-04-25T10:05:48.263559+0000","last_fullsized":"2024-04-25T10:05:48.263559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752986+0000","last_change":"2024-04-25T10:05:48.283483+0000","last_active":"2024-04-25T10:05:50.752986+0000","last_peered":"2024-04-25T10:05:50.752986+0000","last_clean":"2024-04-25T10:05:50.752986+0000","last_became_active":"2024-04-25T10:05:48.283232+0000","last_became_peered":"2024-04-25T10:05:48.283232+0000","last_unstale":"2024-04-25T10:05:50.752986+0000","last_undegraded":"2024-04-25T10:05:50.752986+0000","last_fullsized":"2024-04-25T10:05:50.752986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259836+0000","last_change":"2024-04-25T10:05:48.259836+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259836+0000","last_undegraded":"2024-04-25T10:05:48.259836+0000","last_fullsized":"2024-04-25T10:05:48.259836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275998+0000","last_change":"2024-04-25T10:05:48.274485+0000","last_active":"2024-04-25T10:05:48.275998+0000","last_peered":"2024-04-25T10:05:48.275998+0000","last_clean":"2024-04-25T10:05:48.275998+0000","last_became_active":"2024-04-25T10:05:48.274200+0000","last_became_peered":"2024-04-25T10:05:48.274200+0000","last_unstale":"2024-04-25T10:05:48.275998+0000","last_undegraded":"2024-04-25T10:05:48.275998+0000","last_fullsized":"2024-04-25T10:05:48.275998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264785+0000","last_change":"2024-04-25T10:05:48.264785+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264785+0000","last_undegraded":"2024-04-25T10:05:48.264785+0000","last_fullsized":"2024-04-25T10:05:48.264785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286472+0000","last_change":"2024-04-25T10:05:48.283403+0000","last_active":"2024-04-25T10:05:48.286472+0000","last_peered":"2024-04-25T10:05:48.286472+0000","last_clean":"2024-04-25T10:05:48.286472+0000","last_became_active":"2024-04-25T10:05:48.283065+0000","last_became_peered":"2024-04-25T10:05:48.283065+0000","last_unstale":"2024-04-25T10:05:48.286472+0000","last_undegraded":"2024-04-25T10:05:48.286472+0000","last_fullsized":"2024-04-25T10:05:48.286472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753410+0000","last_change":"2024-04-25T10:05:49.289134+0000","last_active":"2024-04-25T10:05:50.753410+0000","last_peered":"2024-04-25T10:05:50.753410+0000","last_clean":"2024-04-25T10:05:50.753410+0000","last_became_active":"2024-04-25T10:05:49.288846+0000","last_became_peered":"2024-04-25T10:05:49.288846+0000","last_unstale":"2024-04-25T10:05:50.753410+0000","last_undegraded":"2024-04-25T10:05:50.753410+0000","last_fullsized":"2024-04-25T10:05:50.753410+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:34.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.283844+0000","last_change":"2024-04-25T10:05:48.279091+0000","last_active":"2024-04-25T10:05:48.283844+0000","last_peered":"2024-04-25T10:05:48.283844+0000","last_clean":"2024-04-25T10:05:48.283844+0000","last_became_active":"2024-04-25T10:05:48.278825+0000","last_became_peered":"2024-04-25T10:05:48.278825+0000","last_unstale":"2024-04-25T10:05:48.283844+0000","last_undegraded":"2024-04-25T10:05:48.283844+0000","last_fullsized":"2024-04-25T10:05:48.283844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259884+0000","last_change":"2024-04-25T10:05:48.259884+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259884+0000","last_undegraded":"2024-04-25T10:05:48.259884+0000","last_fullsized":"2024-04-25T10:05:48.259884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753403+0000","last_change":"2024-04-25T10:05:48.272940+0000","last_active":"2024-04-25T10:05:50.753403+0000","last_peered":"2024-04-25T10:05:50.753403+0000","last_clean":"2024-04-25T10:05:50.753403+0000","last_became_active":"2024-04-25T10:05:48.272660+0000","last_became_peered":"2024-04-25T10:05:48.272660+0000","last_unstale":"2024-04-25T10:05:50.753403+0000","last_undegraded":"2024-04-25T10:05:50.753403+0000","last_fullsized":"2024-04-25T10:05:50.753403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.495702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264461+0000","last_change":"2024-04-25T10:05:48.264461+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264461+0000","last_undegraded":"2024-04-25T10:05:48.264461+0000","last_fullsized":"2024-04-25T10:05:48.264461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753204+0000","last_change":"2024-04-25T10:05:48.280067+0000","last_active":"2024-04-25T10:05:50.753204+0000","last_peered":"2024-04-25T10:05:50.753204+0000","last_clean":"2024-04-25T10:05:50.753204+0000","last_became_active":"2024-04-25T10:05:48.279765+0000","last_became_peered":"2024-04-25T10:05:48.279765+0000","last_unstale":"2024-04-25T10:05:50.753204+0000","last_undegraded":"2024-04-25T10:05:50.753204+0000","last_fullsized":"2024-04-25T10:05:50.753204+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:43.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753804+0000","last_change":"2024-04-25T10:05:49.286825+0000","last_active":"2024-04-25T10:05:50.753804+0000","last_peered":"2024-04-25T10:05:50.753804+0000","last_clean":"2024-04-25T10:05:50.753804+0000","last_became_active":"2024-04-25T10:05:49.277289+0000","last_became_peered":"2024-04-25T10:05:49.277289+0000","last_unstale":"2024-04-25T10:05:50.753804+0000","last_undegraded":"2024-04-25T10:05:50.753804+0000","last_fullsized":"2024-04-25T10:05:50.753804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:06.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286612+0000","last_change":"2024-04-25T10:05:48.283276+0000","last_active":"2024-04-25T10:05:48.286612+0000","last_peered":"2024-04-25T10:05:48.286612+0000","last_clean":"2024-04-25T10:05:48.286612+0000","last_became_active":"2024-04-25T10:05:48.282966+0000","last_became_peered":"2024-04-25T10:05:48.282966+0000","last_unstale":"2024-04-25T10:05:48.286612+0000","last_undegraded":"2024-04-25T10:05:48.286612+0000","last_fullsized":"2024-04-25T10:05:48.286612+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.201380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753012+0000","last_change":"2024-04-25T10:05:49.279816+0000","last_active":"2024-04-25T10:05:50.753012+0000","last_peered":"2024-04-25T10:05:50.753012+0000","last_clean":"2024-04-25T10:05:50.753012+0000","last_became_active":"2024-04-25T10:05:49.278817+0000","last_became_peered":"2024-04-25T10:05:49.278817+0000","last_unstale":"2024-04-25T10:05:50.753012+0000","last_undegraded":"2024-04-25T10:05:50.753012+0000","last_fullsized":"2024-04-25T10:05:50.753012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:19.953916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275950+0000","last_change":"2024-04-25T10:05:48.274031+0000","last_active":"2024-04-25T10:05:48.275950+0000","last_peered":"2024-04-25T10:05:48.275950+0000","last_clean":"2024-04-25T10:05:48.275950+0000","last_became_active":"2024-04-25T10:05:48.273773+0000","last_became_peered":"2024-04-25T10:05:48.273773+0000","last_unstale":"2024-04-25T10:05:48.275950+0000","last_undegraded":"2024-04-25T10:05:48.275950+0000","last_fullsized":"2024-04-25T10:05:48.275950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753930+0000","last_change":"2024-04-25T10:05:49.292075+0000","last_active":"2024-04-25T10:05:50.753930+0000","last_peered":"2024-04-25T10:05:50.753930+0000","last_clean":"2024-04-25T10:05:50.753930+0000","last_became_active":"2024-04-25T10:05:49.290568+0000","last_became_peered":"2024-04-25T10:05:49.290568+0000","last_unstale":"2024-04-25T10:05:50.753930+0000","last_undegraded":"2024-04-25T10:05:50.753930+0000","last_fullsized":"2024-04-25T10:05:50.753930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:14.833904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752608+0000","last_change":"2024-04-25T10:05:48.265471+0000","last_active":"2024-04-25T10:05:50.752608+0000","last_peered":"2024-04-25T10:05:50.752608+0000","last_clean":"2024-04-25T10:05:50.752608+0000","last_became_active":"2024-04-25T10:05:48.265206+0000","last_became_peered":"2024-04-25T10:05:48.265206+0000","last_unstale":"2024-04-25T10:05:50.752608+0000","last_undegraded":"2024-04-25T10:05:50.752608+0000","last_fullsized":"2024-04-25T10:05:50.752608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.065657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752783+0000","last_change":"2024-04-25T10:05:49.287611+0000","last_active":"2024-04-25T10:05:50.752783+0000","last_peered":"2024-04-25T10:05:50.752783+0000","last_clean":"2024-04-25T10:05:50.752783+0000","last_became_active":"2024-04-25T10:05:49.287212+0000","last_became_peered":"2024-04-25T10:05:49.287212+0000","last_unstale":"2024-04-25T10:05:50.752783+0000","last_undegraded":"2024-04-25T10:05:50.752783+0000","last_fullsized":"2024-04-25T10:05:50.752783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.073227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754064+0000","last_change":"2024-04-25T10:05:48.282046+0000","last_active":"2024-04-25T10:05:50.754064+0000","last_peered":"2024-04-25T10:05:50.754064+0000","last_clean":"2024-04-25T10:05:50.754064+0000","last_became_active":"2024-04-25T10:05:48.279856+0000","last_became_peered":"2024-04-25T10:05:48.279856+0000","last_unstale":"2024-04-25T10:05:50.754064+0000","last_undegraded":"2024-04-25T10:05:50.754064+0000","last_fullsized":"2024-04-25T10:05:50.754064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:36.907141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273399+0000","last_change":"2024-04-25T10:05:49.288251+0000","last_active":"2024-04-25T10:05:50.273399+0000","last_peered":"2024-04-25T10:05:50.273399+0000","last_clean":"2024-04-25T10:05:50.273399+0000","last_became_active":"2024-04-25T10:05:49.287944+0000","last_became_peered":"2024-04-25T10:05:49.287944+0000","last_unstale":"2024-04-25T10:05:50.273399+0000","last_undegraded":"2024-04-25T10:05:50.273399+0000","last_fullsized":"2024-04-25T10:05:50.273399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:05.168013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753178+0000","last_change":"2024-04-25T10:05:48.270200+0000","last_active":"2024-04-25T10:05:50.753178+0000","last_peered":"2024-04-25T10:05:50.753178+0000","last_clean":"2024-04-25T10:05:50.753178+0000","last_became_active":"2024-04-25T10:05:48.269876+0000","last_became_peered":"2024-04-25T10:05:48.269876+0000","last_unstale":"2024-04-25T10:05:50.753178+0000","last_undegraded":"2024-04-25T10:05:50.753178+0000","last_fullsized":"2024-04-25T10:05:50.753178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:19.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260952+0000","last_change":"2024-04-25T10:05:48.260952+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260952+0000","last_undegraded":"2024-04-25T10:05:48.260952+0000","last_fullsized":"2024-04-25T10:05:48.260952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273224+0000","last_change":"2024-04-25T10:05:48.271962+0000","last_active":"2024-04-25T10:05:48.273224+0000","last_peered":"2024-04-25T10:05:48.273224+0000","last_clean":"2024-04-25T10:05:48.273224+0000","last_became_active":"2024-04-25T10:05:48.271483+0000","last_became_peered":"2024-04-25T10:05:48.271483+0000","last_unstale":"2024-04-25T10:05:48.273224+0000","last_undegraded":"2024-04-25T10:05:48.273224+0000","last_fullsized":"2024-04-25T10:05:48.273224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:11.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273599+0000","last_change":"2024-04-25T10:05:49.273945+0000","last_active":"2024-04-25T10:05:50.273599+0000","last_peered":"2024-04-25T10:05:50.273599+0000","last_clean":"2024-04-25T10:05:50.273599+0000","last_became_active":"2024-04-25T10:05:49.273627+0000","last_became_peered":"2024-04-25T10:05:49.273627+0000","last_unstale":"2024-04-25T10:05:50.273599+0000","last_undegraded":"2024-04-25T10:05:50.273599+0000","last_fullsized":"2024-04-25T10:05:50.273599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273084+0000","last_change":"2024-04-25T10:05:48.267427+0000","last_active":"2024-04-25T10:05:48.273084+0000","last_peered":"2024-04-25T10:05:48.273084+0000","last_clean":"2024-04-25T10:05:48.273084+0000","last_became_active":"2024-04-25T10:05:48.267151+0000","last_became_peered":"2024-04-25T10:05:48.267151+0000","last_unstale":"2024-04-25T10:05:48.273084+0000","last_undegraded":"2024-04-25T10:05:48.273084+0000","last_fullsized":"2024-04-25T10:05:48.273084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:25.452679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263960+0000","last_change":"2024-04-25T10:05:48.263960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263960+0000","last_undegraded":"2024-04-25T10:05:48.263960+0000","last_fullsized":"2024-04-25T10:05:48.263960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273648+0000","last_change":"2024-04-25T10:05:48.270641+0000","last_active":"2024-04-25T10:05:50.273648+0000","last_peered":"2024-04-25T10:05:50.273648+0000","last_clean":"2024-04-25T10:05:50.273648+0000","last_became_active":"2024-04-25T10:05:48.270317+0000","last_became_peered":"2024-04-25T10:05:48.270317+0000","last_unstale":"2024-04-25T10:05:50.273648+0000","last_undegraded":"2024-04-25T10:05:50.273648+0000","last_fullsized":"2024-04-25T10:05:50.273648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257960+0000","last_change":"2024-04-25T10:05:48.257960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257960+0000","last_undegraded":"2024-04-25T10:05:48.257960+0000","last_fullsized":"2024-04-25T10:05:48.257960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752480+0000","last_change":"2024-04-25T10:05:48.269712+0000","last_active":"2024-04-25T10:05:50.752480+0000","last_peered":"2024-04-25T10:05:50.752480+0000","last_clean":"2024-04-25T10:05:50.752480+0000","last_became_active":"2024-04-25T10:05:48.269322+0000","last_became_peered":"2024-04-25T10:05:48.269322+0000","last_unstale":"2024-04-25T10:05:50.752480+0000","last_undegraded":"2024-04-25T10:05:50.752480+0000","last_fullsized":"2024-04-25T10:05:50.752480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:04.949669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754039+0000","last_change":"2024-04-25T10:05:49.287123+0000","last_active":"2024-04-25T10:05:50.754039+0000","last_peered":"2024-04-25T10:05:50.754039+0000","last_clean":"2024-04-25T10:05:50.754039+0000","last_became_active":"2024-04-25T10:05:49.286843+0000","last_became_peered":"2024-04-25T10:05:49.286843+0000","last_unstale":"2024-04-25T10:05:50.754039+0000","last_undegraded":"2024-04-25T10:05:50.754039+0000","last_fullsized":"2024-04-25T10:05:50.754039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:22.087955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752866+0000","last_change":"2024-04-25T10:05:48.281874+0000","last_active":"2024-04-25T10:05:50.752866+0000","last_peered":"2024-04-25T10:05:50.752866+0000","last_clean":"2024-04-25T10:05:50.752866+0000","last_became_active":"2024-04-25T10:05:48.281609+0000","last_became_peered":"2024-04-25T10:05:48.281609+0000","last_unstale":"2024-04-25T10:05:50.752866+0000","last_undegraded":"2024-04-25T10:05:50.752866+0000","last_fullsized":"2024-04-25T10:05:50.752866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273809+0000","last_change":"2024-04-25T10:05:49.283100+0000","last_active":"2024-04-25T10:05:50.273809+0000","last_peered":"2024-04-25T10:05:50.273809+0000","last_clean":"2024-04-25T10:05:50.273809+0000","last_became_active":"2024-04-25T10:05:49.282848+0000","last_became_peered":"2024-04-25T10:05:49.282848+0000","last_unstale":"2024-04-25T10:05:50.273809+0000","last_undegraded":"2024-04-25T10:05:50.273809+0000","last_fullsized":"2024-04-25T10:05:50.273809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752169+0000","last_change":"2024-04-25T10:05:48.272439+0000","last_active":"2024-04-25T10:05:50.752169+0000","last_peered":"2024-04-25T10:05:50.752169+0000","last_clean":"2024-04-25T10:05:50.752169+0000","last_became_active":"2024-04-25T10:05:48.272138+0000","last_became_peered":"2024-04-25T10:05:48.272138+0000","last_unstale":"2024-04-25T10:05:50.752169+0000","last_undegraded":"2024-04-25T10:05:50.752169+0000","last_fullsized":"2024-04-25T10:05:50.752169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:37.575727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264035+0000","last_change":"2024-04-25T10:05:48.264035+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264035+0000","last_undegraded":"2024-04-25T10:05:48.264035+0000","last_fullsized":"2024-04-25T10:05:48.264035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286603+0000","last_change":"2024-04-25T10:05:48.283226+0000","last_active":"2024-04-25T10:05:48.286603+0000","last_peered":"2024-04-25T10:05:48.286603+0000","last_clean":"2024-04-25T10:05:48.286603+0000","last_became_active":"2024-04-25T10:05:48.282936+0000","last_became_peered":"2024-04-25T10:05:48.282936+0000","last_unstale":"2024-04-25T10:05:48.286603+0000","last_undegraded":"2024-04-25T10:05:48.286603+0000","last_fullsized":"2024-04-25T10:05:48.286603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:59.924963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273466+0000","last_change":"2024-04-25T10:05:49.267528+0000","last_active":"2024-04-25T10:05:50.273466+0000","last_peered":"2024-04-25T10:05:50.273466+0000","last_clean":"2024-04-25T10:05:50.273466+0000","last_became_active":"2024-04-25T10:05:49.267253+0000","last_became_peered":"2024-04-25T10:05:49.267253+0000","last_unstale":"2024-04-25T10:05:50.273466+0000","last_undegraded":"2024-04-25T10:05:50.273466+0000","last_fullsized":"2024-04-25T10:05:50.273466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.973080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286770+0000","last_change":"2024-04-25T10:05:48.281960+0000","last_active":"2024-04-25T10:05:48.286770+0000","last_peered":"2024-04-25T10:05:48.286770+0000","last_clean":"2024-04-25T10:05:48.286770+0000","last_became_active":"2024-04-25T10:05:48.281643+0000","last_became_peered":"2024-04-25T10:05:48.281643+0000","last_unstale":"2024-04-25T10:05:48.286770+0000","last_undegraded":"2024-04-25T10:05:48.286770+0000","last_fullsized":"2024-04-25T10:05:48.286770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753397+0000","last_change":"2024-04-25T10:05:49.278775+0000","last_active":"2024-04-25T10:05:50.753397+0000","last_peered":"2024-04-25T10:05:50.753397+0000","last_clean":"2024-04-25T10:05:50.753397+0000","last_became_active":"2024-04-25T10:05:49.278156+0000","last_became_peered":"2024-04-25T10:05:49.278156+0000","last_unstale":"2024-04-25T10:05:50.753397+0000","last_undegraded":"2024-04-25T10:05:50.753397+0000","last_fullsized":"2024-04-25T10:05:50.753397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:58.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753377+0000","last_change":"2024-04-25T10:05:48.284598+0000","last_active":"2024-04-25T10:05:50.753377+0000","last_peered":"2024-04-25T10:05:50.753377+0000","last_clean":"2024-04-25T10:05:50.753377+0000","last_became_active":"2024-04-25T10:05:48.284293+0000","last_became_peered":"2024-04-25T10:05:48.284293+0000","last_unstale":"2024-04-25T10:05:50.753377+0000","last_undegraded":"2024-04-25T10:05:50.753377+0000","last_fullsized":"2024-04-25T10:05:50.753377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:55.962777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753276+0000","last_change":"2024-04-25T10:05:49.279763+0000","last_active":"2024-04-25T10:05:50.753276+0000","last_peered":"2024-04-25T10:05:50.753276+0000","last_clean":"2024-04-25T10:05:50.753276+0000","last_became_active":"2024-04-25T10:05:49.279445+0000","last_became_peered":"2024-04-25T10:05:49.279445+0000","last_unstale":"2024-04-25T10:05:50.753276+0000","last_undegraded":"2024-04-25T10:05:50.753276+0000","last_fullsized":"2024-04-25T10:05:50.753276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:58.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753442+0000","last_change":"2024-04-25T10:05:48.268661+0000","last_active":"2024-04-25T10:05:50.753442+0000","last_peered":"2024-04-25T10:05:50.753442+0000","last_clean":"2024-04-25T10:05:50.753442+0000","last_became_active":"2024-04-25T10:05:48.268385+0000","last_became_peered":"2024-04-25T10:05:48.268385+0000","last_unstale":"2024-04-25T10:05:50.753442+0000","last_undegraded":"2024-04-25T10:05:50.753442+0000","last_fullsized":"2024-04-25T10:05:50.753442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:25.882935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262617+0000","last_change":"2024-04-25T10:05:48.262617+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262617+0000","last_undegraded":"2024-04-25T10:05:48.262617+0000","last_fullsized":"2024-04-25T10:05:48.262617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752574+0000","last_change":"2024-04-25T10:05:48.275050+0000","last_active":"2024-04-25T10:05:50.752574+0000","last_peered":"2024-04-25T10:05:50.752574+0000","last_clean":"2024-04-25T10:05:50.752574+0000","last_became_active":"2024-04-25T10:05:48.274788+0000","last_became_peered":"2024-04-25T10:05:48.274788+0000","last_unstale":"2024-04-25T10:05:50.752574+0000","last_undegraded":"2024-04-25T10:05:50.752574+0000","last_fullsized":"2024-04-25T10:05:50.752574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:10.415099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753846+0000","last_change":"2024-04-25T10:05:49.281926+0000","last_active":"2024-04-25T10:05:50.753846+0000","last_peered":"2024-04-25T10:05:50.753846+0000","last_clean":"2024-04-25T10:05:50.753846+0000","last_became_active":"2024-04-25T10:05:49.281693+0000","last_became_peered":"2024-04-25T10:05:49.281693+0000","last_unstale":"2024-04-25T10:05:50.753846+0000","last_undegraded":"2024-04-25T10:05:50.753846+0000","last_fullsized":"2024-04-25T10:05:50.753846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:25.453805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281271+0000","last_change":"2024-04-25T10:05:48.276064+0000","last_active":"2024-04-25T10:05:48.281271+0000","last_peered":"2024-04-25T10:05:48.281271+0000","last_clean":"2024-04-25T10:05:48.281271+0000","last_became_active":"2024-04-25T10:05:48.275744+0000","last_became_peered":"2024-04-25T10:05:48.275744+0000","last_unstale":"2024-04-25T10:05:48.281271+0000","last_undegraded":"2024-04-25T10:05:48.281271+0000","last_fullsized":"2024-04-25T10:05:48.281271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753468+0000","last_change":"2024-04-25T10:05:49.297061+0000","last_active":"2024-04-25T10:05:50.753468+0000","last_peered":"2024-04-25T10:05:50.753468+0000","last_clean":"2024-04-25T10:05:50.753468+0000","last_became_active":"2024-04-25T10:05:49.294500+0000","last_became_peered":"2024-04-25T10:05:49.294500+0000","last_unstale":"2024-04-25T10:05:50.753468+0000","last_undegraded":"2024-04-25T10:05:50.753468+0000","last_fullsized":"2024-04-25T10:05:50.753468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.086551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281034+0000","last_change":"2024-04-25T10:05:48.277544+0000","last_active":"2024-04-25T10:05:48.281034+0000","last_peered":"2024-04-25T10:05:48.281034+0000","last_clean":"2024-04-25T10:05:48.281034+0000","last_became_active":"2024-04-25T10:05:48.277305+0000","last_became_peered":"2024-04-25T10:05:48.277305+0000","last_unstale":"2024-04-25T10:05:48.281034+0000","last_undegraded":"2024-04-25T10:05:48.281034+0000","last_fullsized":"2024-04-25T10:05:48.281034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256078+0000","last_change":"2024-04-25T10:05:48.256078+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256078+0000","last_undegraded":"2024-04-25T10:05:48.256078+0000","last_fullsized":"2024-04-25T10:05:48.256078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753974+0000","last_change":"2024-04-25T10:05:48.280958+0000","last_active":"2024-04-25T10:05:50.753974+0000","last_peered":"2024-04-25T10:05:50.753974+0000","last_clean":"2024-04-25T10:05:50.753974+0000","last_became_active":"2024-04-25T10:05:48.280282+0000","last_became_peered":"2024-04-25T10:05:48.280282+0000","last_unstale":"2024-04-25T10:05:50.753974+0000","last_undegraded":"2024-04-25T10:05:50.753974+0000","last_fullsized":"2024-04-25T10:05:50.753974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:05.893165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":224,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.267693+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:48.267693+0000","last_peered":"2024-04-25T10:05:48.267693+0000","last_clean":"2024-04-25T10:05:48.267693+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:48.267693+0000","last_undegraded":"2024-04-25T10:05:48.267693+0000","last_fullsized":"2024-04-25T10:05:48.267693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1179648,"data_stored":847823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":638976,"data_stored":279615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":279593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":278141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":868405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:54.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2024-04-25T10:05:54.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.264912+0000', 'last_change': '2024-04-25T10:05:48.264912+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.264912+0000', 'last_undegraded': '2024-04-25T10:05:48.264912+0000', 'last_fullsized': '2024-04-25T10:05:48.264912+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.263046+0000', 'last_change': '2024-04-25T10:05:48.263046+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.263046+0000', 'last_undegraded': '2024-04-25T10:05:48.263046+0000', 'last_fullsized': '2024-04-25T10:05:48.263046+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.260500+0000', 'last_change': '2024-04-25T10:05:48.260500+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.260500+0000', 'last_undegraded': '2024-04-25T10:05:48.260500+0000', 'last_fullsized': '2024-04-25T10:05:48.260500+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.261510+0000', 'last_change': '2024-04-25T10:05:48.261510+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.261510+0000', 'last_undegraded': '2024-04-25T10:05:48.261510+0000', 'last_fullsized': '2024-04-25T10:05:48.261510+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2024-04-25T10:05:54.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.264029+0000', 'last_change': '2024-04-25T10:05:48.264029+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.264029+0000', 'last_undegraded': '2024-04-25T10:05:48.264029+0000', 'last_fullsized': '2024-04-25T10:05:48.264029+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.257006+0000', 'last_change': '2024-04-25T10:05:48.257006+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.257006+0000', 'last_undegraded': '2024-04-25T10:05:48.257006+0000', 'last_fullsized': '2024-04-25T10:05:48.257006+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.256159+0000', 'last_change': '2024-04-25T10:05:48.256159+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.256159+0000', 'last_undegraded': '2024-04-25T10:05:48.256159+0000', 'last_fullsized': '2024-04-25T10:05:48.256159+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.256497+0000', 'last_change': '2024-04-25T10:05:48.256497+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.256497+0000', 'last_undegraded': '2024-04-25T10:05:48.256497+0000', 'last_fullsized': '2024-04-25T10:05:48.256497+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.262964+0000', 'last_change': '2024-04-25T10:05:48.262964+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.262964+0000', 'last_undegraded': '2024-04-25T10:05:48.262964+0000', 'last_fullsized': '2024-04-25T10:05:48.262964+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2024-04-25T10:05:54.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.265891+0000', 'last_change': '2024-04-25T10:05:48.265891+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.265891+0000', 'last_undegraded': '2024-04-25T10:05:48.265891+0000', 'last_fullsized': '2024-04-25T10:05:48.265891+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.261054+0000', 'last_change': '2024-04-25T10:05:48.261054+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.261054+0000', 'last_undegraded': '2024-04-25T10:05:48.261054+0000', 'last_fullsized': '2024-04-25T10:05:48.261054+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.262585+0000', 'last_change': '2024-04-25T10:05:48.262585+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.262585+0000', 'last_undegraded': '2024-04-25T10:05:48.262585+0000', 'last_fullsized': '2024-04-25T10:05:48.262585+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.257851+0000', 'last_change': '2024-04-25T10:05:48.257851+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.257851+0000', 'last_undegraded': '2024-04-25T10:05:48.257851+0000', 'last_fullsized': '2024-04-25T10:05:48.257851+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.259924+0000', 'last_change': '2024-04-25T10:05:48.259924+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.259924+0000', 'last_undegraded': '2024-04-25T10:05:48.259924+0000', 'last_fullsized': '2024-04-25T10:05:48.259924+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2024-04-25T10:05:54.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.265323+0000', 'last_change': '2024-04-25T10:05:48.265323+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.265323+0000', 'last_undegraded': '2024-04-25T10:05:48.265323+0000', 'last_fullsized': '2024-04-25T10:05:48.265323+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.263559+0000', 'last_change': '2024-04-25T10:05:48.263559+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.263559+0000', 'last_undegraded': '2024-04-25T10:05:48.263559+0000', 'last_fullsized': '2024-04-25T10:05:48.263559+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.259836+0000', 'last_change': '2024-04-25T10:05:48.259836+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.259836+0000', 'last_undegraded': '2024-04-25T10:05:48.259836+0000', 'last_fullsized': '2024-04-25T10:05:48.259836+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.264785+0000', 'last_change': '2024-04-25T10:05:48.264785+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.264785+0000', 'last_undegraded': '2024-04-25T10:05:48.264785+0000', 'last_fullsized': '2024-04-25T10:05:48.264785+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.259884+0000', 'last_change': '2024-04-25T10:05:48.259884+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.259884+0000', 'last_undegraded': '2024-04-25T10:05:48.259884+0000', 'last_fullsized': '2024-04-25T10:05:48.259884+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2024-04-25T10:05:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.264461+0000', 'last_change': '2024-04-25T10:05:48.264461+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.264461+0000', 'last_undegraded': '2024-04-25T10:05:48.264461+0000', 'last_fullsized': '2024-04-25T10:05:48.264461+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.260952+0000', 'last_change': '2024-04-25T10:05:48.260952+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.260952+0000', 'last_undegraded': '2024-04-25T10:05:48.260952+0000', 'last_fullsized': '2024-04-25T10:05:48.260952+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.263960+0000', 'last_change': '2024-04-25T10:05:48.263960+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.263960+0000', 'last_undegraded': '2024-04-25T10:05:48.263960+0000', 'last_fullsized': '2024-04-25T10:05:48.263960+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.257960+0000', 'last_change': '2024-04-25T10:05:48.257960+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.257960+0000', 'last_undegraded': '2024-04-25T10:05:48.257960+0000', 'last_fullsized': '2024-04-25T10:05:48.257960+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.264035+0000', 'last_change': '2024-04-25T10:05:48.264035+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.264035+0000', 'last_undegraded': '2024-04-25T10:05:48.264035+0000', 'last_fullsized': '2024-04-25T10:05:48.264035+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2024-04-25T10:05:54.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.262617+0000', 'last_change': '2024-04-25T10:05:48.262617+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.262617+0000', 'last_undegraded': '2024-04-25T10:05:48.262617+0000', 'last_fullsized': '2024-04-25T10:05:48.262617+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:05:54.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2024-04-25T10:05:54.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 51, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:05:48.256078+0000', 'last_change': '2024-04-25T10:05:48.256078+0000', 'last_active': '2024-04-25T10:05:48.244110+0000', 'last_peered': '2024-04-25T10:05:48.244110+0000', 'last_clean': '2024-04-25T10:05:48.244110+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:05:48.256078+0000', 'last_undegraded': '2024-04-25T10:05:48.256078+0000', 'last_fullsized': '2024-04-25T10:05:48.256078+0000', 'mapping_epoch': 51, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 51, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'last_clean_scrub_stamp': '2024-04-25T10:05:48.244110+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:05:54.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:05:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.336+0000 7fc760400640 1 Processor -- start 2024-04-25T10:05:54.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.336+0000 7fc760400640 1 -- start start 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc760400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc7580d11b0 0x7fc7580afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc760400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 0x7fc7580b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc760400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75815ddf0 con 0x7fc75815da10 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc760400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7580b4ba0 con 0x7fc7580d11b0 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc760400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75806b480 con 0x7fc7580b4210 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75da00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc75815da10 0x7fc75806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47682/0 (socket says 172.21.15.18:47682) 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75da00640 1 -- 172.21.15.18:0/630709798 learned_addr learned my addr 172.21.15.18:0/630709798 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75d000640 1 --2- 172.21.15.18:0/630709798 >> v2:172.21.15.167:3300/0 conn(0x7fc7580d11b0 0x7fc7580afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75e400640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 0x7fc7580b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc757e00640 1 -- 172.21.15.18:0/630709798 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551672395 0 0) 0x7fc75815ddf0 con 0x7fc75815da10 2024-04-25T10:05:54.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc757e00640 1 -- 172.21.15.18:0/630709798 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc740003530 con 0x7fc75815da10 2024-04-25T10:05:54.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75d000640 1 -- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 msgr2=0x7fc7580b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:54.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75d000640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 0x7fc7580b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75d000640 1 -- 172.21.15.18:0/630709798 >> v1:172.21.15.18:6789/0 conn(0x7fc75815da10 legacy=0x7fc75806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75d000640 1 -- 172.21.15.18:0/630709798 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580d06d0 con 0x7fc7580d11b0 2024-04-25T10:05:54.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.340+0000 7fc75e400640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 0x7fc7580b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc75d000640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580d11b0 0x7fc7580afe20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097c0 tx=0x7fc74401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d1ffddf6a2a7949 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc757e00640 1 -- 172.21.15.18:0/630709798 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440b0070 con 0x7fc7580d11b0 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc757e00640 1 -- 172.21.15.18:0/630709798 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440ab600 con 0x7fc7580d11b0 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc757e00640 1 -- 172.21.15.18:0/630709798 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440ab9d0 con 0x7fc7580d11b0 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580d11b0 msgr2=0x7fc7580afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580d11b0 0x7fc7580afe20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097c0 tx=0x7fc74401c410 comp rx=0 tx=0).stop 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- 172.21.15.18:0/630709798 shutdown_connections 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7580b4210 0x7fc7580b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- 172.21.15.18:0/630709798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580d11b0 0x7fc7580afe20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- 172.21.15.18:0/630709798 >> 172.21.15.18:0/630709798 conn(0x7fc7580b2400 msgr2=0x7fc7580b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- 172.21.15.18:0/630709798 shutdown_connections 2024-04-25T10:05:54.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- 172.21.15.18:0/630709798 wait complete. 2024-04-25T10:05:54.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 Processor -- start 2024-04-25T10:05:54.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- start start 2024-04-25T10:05:54.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 0x7fc75814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 0x7fc7580cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758162150 con 0x7fc7580d11b0 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758161fd0 con 0x7fc7580b4210 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc760400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7581622d0 con 0x7fc75815da10 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc75d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc75d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42092/0 (socket says 172.21.15.18:42092) 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.344+0000 7fc75d000640 1 -- 172.21.15.18:0/2853804816 learned_addr learned my addr 172.21.15.18:0/2853804816 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75da00640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 0x7fc75814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75e400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 0x7fc7580cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 -- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 msgr2=0x7fc7580cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 0x7fc7580cef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 -- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 msgr2=0x7fc75814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 0x7fc75814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 -- 172.21.15.18:0/2853804816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580ca4d0 con 0x7fc7580d11b0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75e400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 0x7fc7580cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75da00640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 0x7fc75814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc75d000640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ae040 tx=0x7fc7440191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440b0040 con 0x7fc7580d11b0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440b9070 con 0x7fc7580d11b0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7580ce4a0 con 0x7fc7580d11b0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440b4650 con 0x7fc7580d11b0 2024-04-25T10:05:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7580cea60 con 0x7fc7580d11b0 2024-04-25T10:05:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7580745d0 con 0x7fc7580d11b0 2024-04-25T10:05:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7440b47f0 con 0x7fc7580d11b0 2024-04-25T10:05:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 0x7fc738069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.348+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc74411ef60 con 0x7fc7580d11b0 2024-04-25T10:05:54.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.352+0000 7fc75da00640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 0x7fc738069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.352+0000 7fc75da00640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 0x7fc738069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005890 tx=0x7fc74c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.352+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc744016090 con 0x7fc7580d11b0 2024-04-25T10:05:54.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.572+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc7580d04b0 con 0x7fc7580d11b0 2024-04-25T10:05:54.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.572+0000 7fc755600640 1 -- 172.21.15.18:0/2853804816 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1518 (secure 0 0 0) 0x7fc7440efd40 con 0x7fc7580d11b0 2024-04-25T10:05:54.583 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:54.584 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":53,"num_osds":8,"num_up_osds":8,"osd_up_since":1714039422,"num_in_osds":8,"osd_in_since":1714039413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":71},{"state_name":"creating+peering","count":26}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592036,"bytes_used":244469760,"bytes_avail":772849643520,"bytes_total":773094113280,"inactive_pgs_ratio":0.2680412232875824,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"d","status":"up:active","gid":35177}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2024-04-25T10:05:37.419768+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T10:05:54.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 msgr2=0x7fc738069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 0x7fc738069420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc74c005890 tx=0x7fc74c009040 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 msgr2=0x7fc7580c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7440ae040 tx=0x7fc7440191b0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 shutdown_connections 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc738066f60 0x7fc738069420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc75815da10 0x7fc7580cef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7580d11b0 0x7fc7580c9a80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 --2- 172.21.15.18:0/2853804816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7580b4210 0x7fc75814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 >> 172.21.15.18:0/2853804816 conn(0x7fc7580b2400 msgr2=0x7fc7580b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 shutdown_connections 2024-04-25T10:05:54.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.576+0000 7fc760400640 1 -- 172.21.15.18:0/2853804816 wait complete. 2024-04-25T10:05:54.604 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:05:54.604 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:54.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.732+0000 7fa9da000640 1 Processor -- start 2024-04-25T10:05:54.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 -- start start 2024-04-25T10:05:54.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d40cef30 0x7fa9d406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa9d406e900 0x7fa9d40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d415ac60 con 0x7fa9d4144140 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d406ed50 con 0x7fa9d40cef30 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9da000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d40cf3e0 con 0x7fa9d406e900 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d40cef30 0x7fa9d406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d40cef30 0x7fa9d406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42096/0 (socket says 172.21.15.18:42096) 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 -- 172.21.15.18:0/633991338 learned_addr learned my addr 172.21.15.18:0/633991338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9d3e00640 1 --2- 172.21.15.18:0/633991338 >> v2:172.21.15.167:3300/0 conn(0x7fa9d406e900 0x7fa9d40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 -- 172.21.15.18:0/633991338 >> v2:172.21.15.167:3300/0 conn(0x7fa9d406e900 msgr2=0x7fa9d40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 --2- 172.21.15.18:0/633991338 >> v2:172.21.15.167:3300/0 conn(0x7fa9d406e900 0x7fa9d40b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 -- 172.21.15.18:0/633991338 >> v1:172.21.15.167:6789/0 conn(0x7fa9d4144140 legacy=0x7fa9d40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:54.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.736+0000 7fa9caa00640 1 -- 172.21.15.18:0/633991338 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d415af20 con 0x7fa9d40cef30 2024-04-25T10:05:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9caa00640 1 --2- 172.21.15.18:0/633991338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d40cef30 0x7fa9d406e3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40cddd0 tx=0x7fa9bc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a37e1cc2cb55459 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9d2a00640 1 -- 172.21.15.18:0/633991338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0b0070 con 0x7fa9d40cef30 2024-04-25T10:05:54.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9d2a00640 1 -- 172.21.15.18:0/633991338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9bc0ab600 con 0x7fa9d40cef30 2024-04-25T10:05:54.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9d2a00640 1 -- 172.21.15.18:0/633991338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9bc0ab9d0 con 0x7fa9d40cef30 2024-04-25T10:05:54.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- 172.21.15.18:0/633991338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d40cef30 msgr2=0x7fa9d406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 --2- 172.21.15.18:0/633991338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d40cef30 0x7fa9d406e3c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40cddd0 tx=0x7fa9bc01c4e0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- 172.21.15.18:0/633991338 shutdown_connections 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 --2- 172.21.15.18:0/633991338 >> v2:172.21.15.167:3300/0 conn(0x7fa9d406e900 0x7fa9d40b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 --2- 172.21.15.18:0/633991338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d40cef30 0x7fa9d406e3c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- 172.21.15.18:0/633991338 >> 172.21.15.18:0/633991338 conn(0x7fa9d4066fa0 msgr2=0x7fa9d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- 172.21.15.18:0/633991338 shutdown_connections 2024-04-25T10:05:54.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- 172.21.15.18:0/633991338 wait complete. 2024-04-25T10:05:54.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 Processor -- start 2024-04-25T10:05:54.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.740+0000 7fa9da000640 1 -- start start 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d406e900 0x7fa9d4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d40cef30 0x7fa9d4159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415ba00 con 0x7fa9d4144140 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d4144520 con 0x7fa9d40cef30 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415bb80 con 0x7fa9d406e900 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42102/0 (socket says 172.21.15.18:42102) 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 -- 172.21.15.18:0/1921138205 learned_addr learned my addr 172.21.15.18:0/1921138205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:54.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9caa00640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d40cef30 0x7fa9d4159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3400640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d406e900 0x7fa9d4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 -- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d406e900 msgr2=0x7fa9d4151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d406e900 0x7fa9d4151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 -- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d40cef30 msgr2=0x7fa9d4159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d40cef30 0x7fa9d4159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 -- 172.21.15.18:0/1921138205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4151680 con 0x7fa9d4144140 2024-04-25T10:05:54.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9d3e00640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007e70 tx=0x7fa9cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc014420 con 0x7fa9d4144140 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc019070 con 0x7fa9d4144140 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d4163ff0 con 0x7fa9d4144140 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc014820 con 0x7fa9d4144140 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d41645b0 con 0x7fa9d4144140 2024-04-25T10:05:54.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.744+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d40745d0 con 0x7fa9d4144140 2024-04-25T10:05:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.748+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9cc0149c0 con 0x7fa9d4144140 2024-04-25T10:05:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.748+0000 7fa9cbe00640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 0x7fa9b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:54.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.748+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa9cc085a30 con 0x7fa9d4144140 2024-04-25T10:05:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.748+0000 7fa9d3400640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 0x7fa9b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:54.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.748+0000 7fa9d3400640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 0x7fa9b0069420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40098e0 tx=0x7fa9c4009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:54.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.752+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa9cc056150 con 0x7fa9d4144140 2024-04-25T10:05:54.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.908+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9d40ce880 con 0x7fa9b0066f60 2024-04-25T10:05:54.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.916+0000 7fa9cbe00640 1 -- 172.21.15.18:0/1921138205 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249805 (secure 0 0 0) 0x7fa9d40ce880 con 0x7fa9b0066f60 2024-04-25T10:05:54.930 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:54.931 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:54.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 msgr2=0x7fa9b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 0x7fa9b0069420 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa9c40098e0 tx=0x7fa9c4009060 comp rx=0 tx=0).stop 2024-04-25T10:05:54.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 msgr2=0x7fa9d4159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:54.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc007e70 tx=0x7fa9cc00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 shutdown_connections 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d4144140 0x7fa9d4159c70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d40cef30 0x7fa9d4159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9b0066f60 0x7fa9b0069420 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 --2- 172.21.15.18:0/1921138205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d406e900 0x7fa9d4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 >> 172.21.15.18:0/1921138205 conn(0x7fa9d4066fa0 msgr2=0x7fa9d40b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 shutdown_connections 2024-04-25T10:05:54.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:54.920+0000 7fa9da000640 1 -- 172.21.15.18:0/1921138205 wait complete. 2024-04-25T10:05:54.950 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2024-04-25T10:05:53.423578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592036,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238740,"kb_used_data":5924,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735980,"statfs":{"total":773094113280,"available":772849643520,"internally_reserved":0,"allocated":6066176,"data_stored":3325942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001566"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273860+0000","last_change":"2024-04-25T10:05:49.285079+0000","last_active":"2024-04-25T10:05:50.273860+0000","last_peered":"2024-04-25T10:05:50.273860+0000","last_clean":"2024-04-25T10:05:50.273860+0000","last_became_active":"2024-04-25T10:05:49.284804+0000","last_became_peered":"2024-04-25T10:05:49.284804+0000","last_unstale":"2024-04-25T10:05:50.273860+0000","last_undegraded":"2024-04-25T10:05:50.273860+0000","last_fullsized":"2024-04-25T10:05:50.273860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264912+0000","last_change":"2024-04-25T10:05:48.264912+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264912+0000","last_undegraded":"2024-04-25T10:05:48.264912+0000","last_fullsized":"2024-04-25T10:05:48.264912+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753632+0000","last_change":"2024-04-25T10:05:49.287086+0000","last_active":"2024-04-25T10:05:50.753632+0000","last_peered":"2024-04-25T10:05:50.753632+0000","last_clean":"2024-04-25T10:05:50.753632+0000","last_became_active":"2024-04-25T10:05:49.285731+0000","last_became_peered":"2024-04-25T10:05:49.285731+0000","last_unstale":"2024-04-25T10:05:50.753632+0000","last_undegraded":"2024-04-25T10:05:50.753632+0000","last_fullsized":"2024-04-25T10:05:50.753632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:16.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263046+0000","last_change":"2024-04-25T10:05:48.263046+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263046+0000","last_undegraded":"2024-04-25T10:05:48.263046+0000","last_fullsized":"2024-04-25T10:05:48.263046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260500+0000","last_change":"2024-04-25T10:05:48.260500+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260500+0000","last_undegraded":"2024-04-25T10:05:48.260500+0000","last_fullsized":"2024-04-25T10:05:48.260500+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273516+0000","last_change":"2024-04-25T10:05:49.282396+0000","last_active":"2024-04-25T10:05:50.273516+0000","last_peered":"2024-04-25T10:05:50.273516+0000","last_clean":"2024-04-25T10:05:50.273516+0000","last_became_active":"2024-04-25T10:05:49.281398+0000","last_became_peered":"2024-04-25T10:05:49.281398+0000","last_unstale":"2024-04-25T10:05:50.273516+0000","last_undegraded":"2024-04-25T10:05:50.273516+0000","last_fullsized":"2024-04-25T10:05:50.273516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.475074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752757+0000","last_change":"2024-04-25T10:05:49.286501+0000","last_active":"2024-04-25T10:05:50.752757+0000","last_peered":"2024-04-25T10:05:50.752757+0000","last_clean":"2024-04-25T10:05:50.752757+0000","last_became_active":"2024-04-25T10:05:49.286244+0000","last_became_peered":"2024-04-25T10:05:49.286244+0000","last_unstale":"2024-04-25T10:05:50.752757+0000","last_undegraded":"2024-04-25T10:05:50.752757+0000","last_fullsized":"2024-04-25T10:05:50.752757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752551+0000","last_change":"2024-04-25T10:05:49.292415+0000","last_active":"2024-04-25T10:05:50.752551+0000","last_peered":"2024-04-25T10:05:50.752551+0000","last_clean":"2024-04-25T10:05:50.752551+0000","last_became_active":"2024-04-25T10:05:49.292210+0000","last_became_peered":"2024-04-25T10:05:49.292210+0000","last_unstale":"2024-04-25T10:05:50.752551+0000","last_undegraded":"2024-04-25T10:05:50.752551+0000","last_fullsized":"2024-04-25T10:05:50.752551+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:42.412711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753322+0000","last_change":"2024-04-25T10:05:49.294200+0000","last_active":"2024-04-25T10:05:50.753322+0000","last_peered":"2024-04-25T10:05:50.753322+0000","last_clean":"2024-04-25T10:05:50.753322+0000","last_became_active":"2024-04-25T10:05:49.293943+0000","last_became_peered":"2024-04-25T10:05:49.293943+0000","last_unstale":"2024-04-25T10:05:50.753322+0000","last_undegraded":"2024-04-25T10:05:50.753322+0000","last_fullsized":"2024-04-25T10:05:50.753322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:20.041919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273688+0000","last_change":"2024-04-25T10:05:49.275464+0000","last_active":"2024-04-25T10:05:50.273688+0000","last_peered":"2024-04-25T10:05:50.273688+0000","last_clean":"2024-04-25T10:05:50.273688+0000","last_became_active":"2024-04-25T10:05:49.274039+0000","last_became_peered":"2024-04-25T10:05:49.274039+0000","last_unstale":"2024-04-25T10:05:50.273688+0000","last_undegraded":"2024-04-25T10:05:50.273688+0000","last_fullsized":"2024-04-25T10:05:50.273688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752801+0000","last_change":"2024-04-25T10:05:49.282389+0000","last_active":"2024-04-25T10:05:50.752801+0000","last_peered":"2024-04-25T10:05:50.752801+0000","last_clean":"2024-04-25T10:05:50.752801+0000","last_became_active":"2024-04-25T10:05:49.282122+0000","last_became_peered":"2024-04-25T10:05:49.282122+0000","last_unstale":"2024-04-25T10:05:50.752801+0000","last_undegraded":"2024-04-25T10:05:50.752801+0000","last_fullsized":"2024-04-25T10:05:50.752801+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:15.551190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753119+0000","last_change":"2024-04-25T10:05:49.286972+0000","last_active":"2024-04-25T10:05:50.753119+0000","last_peered":"2024-04-25T10:05:50.753119+0000","last_clean":"2024-04-25T10:05:50.753119+0000","last_became_active":"2024-04-25T10:05:49.286632+0000","last_became_peered":"2024-04-25T10:05:49.286632+0000","last_unstale":"2024-04-25T10:05:50.753119+0000","last_undegraded":"2024-04-25T10:05:50.753119+0000","last_fullsized":"2024-04-25T10:05:50.753119+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:57.536288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273434+0000","last_change":"2024-04-25T10:05:49.269276+0000","last_active":"2024-04-25T10:05:50.273434+0000","last_peered":"2024-04-25T10:05:50.273434+0000","last_clean":"2024-04-25T10:05:50.273434+0000","last_became_active":"2024-04-25T10:05:49.269012+0000","last_became_peered":"2024-04-25T10:05:49.269012+0000","last_unstale":"2024-04-25T10:05:50.273434+0000","last_undegraded":"2024-04-25T10:05:50.273434+0000","last_fullsized":"2024-04-25T10:05:50.273434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:37.910181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753593+0000","last_change":"2024-04-25T10:05:49.293545+0000","last_active":"2024-04-25T10:05:50.753593+0000","last_peered":"2024-04-25T10:05:50.753593+0000","last_clean":"2024-04-25T10:05:50.753593+0000","last_became_active":"2024-04-25T10:05:49.292750+0000","last_became_peered":"2024-04-25T10:05:49.292750+0000","last_unstale":"2024-04-25T10:05:50.753593+0000","last_undegraded":"2024-04-25T10:05:50.753593+0000","last_fullsized":"2024-04-25T10:05:50.753593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.143210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261510+0000","last_change":"2024-04-25T10:05:48.261510+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261510+0000","last_undegraded":"2024-04-25T10:05:48.261510+0000","last_fullsized":"2024-04-25T10:05:48.261510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273381+0000","last_change":"2024-04-25T10:05:49.266345+0000","last_active":"2024-04-25T10:05:50.273381+0000","last_peered":"2024-04-25T10:05:50.273381+0000","last_clean":"2024-04-25T10:05:50.273381+0000","last_became_active":"2024-04-25T10:05:49.266113+0000","last_became_peered":"2024-04-25T10:05:49.266113+0000","last_unstale":"2024-04-25T10:05:50.273381+0000","last_undegraded":"2024-04-25T10:05:50.273381+0000","last_fullsized":"2024-04-25T10:05:50.273381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:39.048517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754014+0000","last_change":"2024-04-25T10:05:49.290847+0000","last_active":"2024-04-25T10:05:50.754014+0000","last_peered":"2024-04-25T10:05:50.754014+0000","last_clean":"2024-04-25T10:05:50.754014+0000","last_became_active":"2024-04-25T10:05:49.289958+0000","last_became_peered":"2024-04-25T10:05:49.289958+0000","last_unstale":"2024-04-25T10:05:50.754014+0000","last_undegraded":"2024-04-25T10:05:50.754014+0000","last_fullsized":"2024-04-25T10:05:50.754014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:15.945832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264029+0000","last_change":"2024-04-25T10:05:48.264029+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264029+0000","last_undegraded":"2024-04-25T10:05:48.264029+0000","last_fullsized":"2024-04-25T10:05:48.264029+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753810+0000","last_change":"2024-04-25T10:05:49.286035+0000","last_active":"2024-04-25T10:05:50.753810+0000","last_peered":"2024-04-25T10:05:50.753810+0000","last_clean":"2024-04-25T10:05:50.753810+0000","last_became_active":"2024-04-25T10:05:49.285407+0000","last_became_peered":"2024-04-25T10:05:49.285407+0000","last_unstale":"2024-04-25T10:05:50.753810+0000","last_undegraded":"2024-04-25T10:05:50.753810+0000","last_fullsized":"2024-04-25T10:05:50.753810+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:01.390046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257006+0000","last_change":"2024-04-25T10:05:48.257006+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257006+0000","last_undegraded":"2024-04-25T10:05:48.257006+0000","last_fullsized":"2024-04-25T10:05:48.257006+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256159+0000","last_change":"2024-04-25T10:05:48.256159+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256159+0000","last_undegraded":"2024-04-25T10:05:48.256159+0000","last_fullsized":"2024-04-25T10:05:48.256159+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752422+0000","last_change":"2024-04-25T10:05:49.290986+0000","last_active":"2024-04-25T10:05:50.752422+0000","last_peered":"2024-04-25T10:05:50.752422+0000","last_clean":"2024-04-25T10:05:50.752422+0000","last_became_active":"2024-04-25T10:05:49.290722+0000","last_became_peered":"2024-04-25T10:05:49.290722+0000","last_unstale":"2024-04-25T10:05:50.752422+0000","last_undegraded":"2024-04-25T10:05:50.752422+0000","last_fullsized":"2024-04-25T10:05:50.752422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:59.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752349+0000","last_change":"2024-04-25T10:05:49.281828+0000","last_active":"2024-04-25T10:05:50.752349+0000","last_peered":"2024-04-25T10:05:50.752349+0000","last_clean":"2024-04-25T10:05:50.752349+0000","last_became_active":"2024-04-25T10:05:49.281534+0000","last_became_peered":"2024-04-25T10:05:49.281534+0000","last_unstale":"2024-04-25T10:05:50.752349+0000","last_undegraded":"2024-04-25T10:05:50.752349+0000","last_fullsized":"2024-04-25T10:05:50.752349+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:56.168674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753622+0000","last_change":"2024-04-25T10:05:49.280300+0000","last_active":"2024-04-25T10:05:50.753622+0000","last_peered":"2024-04-25T10:05:50.753622+0000","last_clean":"2024-04-25T10:05:50.753622+0000","last_became_active":"2024-04-25T10:05:49.280086+0000","last_became_peered":"2024-04-25T10:05:49.280086+0000","last_unstale":"2024-04-25T10:05:50.753622+0000","last_undegraded":"2024-04-25T10:05:50.753622+0000","last_fullsized":"2024-04-25T10:05:50.753622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.855084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754070+0000","last_change":"2024-04-25T10:05:49.290270+0000","last_active":"2024-04-25T10:05:50.754070+0000","last_peered":"2024-04-25T10:05:50.754070+0000","last_clean":"2024-04-25T10:05:50.754070+0000","last_became_active":"2024-04-25T10:05:49.289680+0000","last_became_peered":"2024-04-25T10:05:49.289680+0000","last_unstale":"2024-04-25T10:05:50.754070+0000","last_undegraded":"2024-04-25T10:05:50.754070+0000","last_fullsized":"2024-04-25T10:05:50.754070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:33.485998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752875+0000","last_change":"2024-04-25T10:05:49.280231+0000","last_active":"2024-04-25T10:05:50.752875+0000","last_peered":"2024-04-25T10:05:50.752875+0000","last_clean":"2024-04-25T10:05:50.752875+0000","last_became_active":"2024-04-25T10:05:49.279570+0000","last_became_peered":"2024-04-25T10:05:49.279570+0000","last_unstale":"2024-04-25T10:05:50.752875+0000","last_undegraded":"2024-04-25T10:05:50.752875+0000","last_fullsized":"2024-04-25T10:05:50.752875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:50.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273943+0000","last_change":"2024-04-25T10:05:49.288396+0000","last_active":"2024-04-25T10:05:50.273943+0000","last_peered":"2024-04-25T10:05:50.273943+0000","last_clean":"2024-04-25T10:05:50.273943+0000","last_became_active":"2024-04-25T10:05:49.287993+0000","last_became_peered":"2024-04-25T10:05:49.287993+0000","last_unstale":"2024-04-25T10:05:50.273943+0000","last_undegraded":"2024-04-25T10:05:50.273943+0000","last_fullsized":"2024-04-25T10:05:50.273943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256497+0000","last_change":"2024-04-25T10:05:48.256497+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256497+0000","last_undegraded":"2024-04-25T10:05:48.256497+0000","last_fullsized":"2024-04-25T10:05:48.256497+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752992+0000","last_change":"2024-04-25T10:05:49.281466+0000","last_active":"2024-04-25T10:05:50.752992+0000","last_peered":"2024-04-25T10:05:50.752992+0000","last_clean":"2024-04-25T10:05:50.752992+0000","last_became_active":"2024-04-25T10:05:49.281165+0000","last_became_peered":"2024-04-25T10:05:49.281165+0000","last_unstale":"2024-04-25T10:05:50.752992+0000","last_undegraded":"2024-04-25T10:05:50.752992+0000","last_fullsized":"2024-04-25T10:05:50.752992+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:11.398600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262964+0000","last_change":"2024-04-25T10:05:48.262964+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262964+0000","last_undegraded":"2024-04-25T10:05:48.262964+0000","last_fullsized":"2024-04-25T10:05:48.262964+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752900+0000","last_change":"2024-04-25T10:05:49.286018+0000","last_active":"2024-04-25T10:05:50.752900+0000","last_peered":"2024-04-25T10:05:50.752900+0000","last_clean":"2024-04-25T10:05:50.752900+0000","last_became_active":"2024-04-25T10:05:49.285531+0000","last_became_peered":"2024-04-25T10:05:49.285531+0000","last_unstale":"2024-04-25T10:05:50.752900+0000","last_undegraded":"2024-04-25T10:05:50.752900+0000","last_fullsized":"2024-04-25T10:05:50.752900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:14.155973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265891+0000","last_change":"2024-04-25T10:05:48.265891+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265891+0000","last_undegraded":"2024-04-25T10:05:48.265891+0000","last_fullsized":"2024-04-25T10:05:48.265891+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.261054+0000","last_change":"2024-04-25T10:05:48.261054+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.261054+0000","last_undegraded":"2024-04-25T10:05:48.261054+0000","last_fullsized":"2024-04-25T10:05:48.261054+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272908+0000","last_change":"2024-04-25T10:05:48.269196+0000","last_active":"2024-04-25T10:05:48.272908+0000","last_peered":"2024-04-25T10:05:48.272908+0000","last_clean":"2024-04-25T10:05:48.272908+0000","last_became_active":"2024-04-25T10:05:48.268189+0000","last_became_peered":"2024-04-25T10:05:48.268189+0000","last_unstale":"2024-04-25T10:05:48.272908+0000","last_undegraded":"2024-04-25T10:05:48.272908+0000","last_fullsized":"2024-04-25T10:05:48.272908+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:22.346700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262585+0000","last_change":"2024-04-25T10:05:48.262585+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262585+0000","last_undegraded":"2024-04-25T10:05:48.262585+0000","last_fullsized":"2024-04-25T10:05:48.262585+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273598+0000","last_change":"2024-04-25T10:05:48.275908+0000","last_active":"2024-04-25T10:05:50.273598+0000","last_peered":"2024-04-25T10:05:50.273598+0000","last_clean":"2024-04-25T10:05:50.273598+0000","last_became_active":"2024-04-25T10:05:48.274479+0000","last_became_peered":"2024-04-25T10:05:48.274479+0000","last_unstale":"2024-04-25T10:05:50.273598+0000","last_undegraded":"2024-04-25T10:05:50.273598+0000","last_fullsized":"2024-04-25T10:05:50.273598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257851+0000","last_change":"2024-04-25T10:05:48.257851+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257851+0000","last_undegraded":"2024-04-25T10:05:48.257851+0000","last_fullsized":"2024-04-25T10:05:48.257851+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273866+0000","last_change":"2024-04-25T10:05:48.271308+0000","last_active":"2024-04-25T10:05:50.273866+0000","last_peered":"2024-04-25T10:05:50.273866+0000","last_clean":"2024-04-25T10:05:50.273866+0000","last_became_active":"2024-04-25T10:05:48.270922+0000","last_became_peered":"2024-04-25T10:05:48.270922+0000","last_unstale":"2024-04-25T10:05:50.273866+0000","last_undegraded":"2024-04-25T10:05:50.273866+0000","last_fullsized":"2024-04-25T10:05:50.273866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752734+0000","last_change":"2024-04-25T10:05:49.279560+0000","last_active":"2024-04-25T10:05:50.752734+0000","last_peered":"2024-04-25T10:05:50.752734+0000","last_clean":"2024-04-25T10:05:50.752734+0000","last_became_active":"2024-04-25T10:05:49.278516+0000","last_became_peered":"2024-04-25T10:05:49.278516+0000","last_unstale":"2024-04-25T10:05:50.752734+0000","last_undegraded":"2024-04-25T10:05:50.752734+0000","last_fullsized":"2024-04-25T10:05:50.752734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:10.096617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.280963+0000","last_change":"2024-04-25T10:05:48.275810+0000","last_active":"2024-04-25T10:05:48.280963+0000","last_peered":"2024-04-25T10:05:48.280963+0000","last_clean":"2024-04-25T10:05:48.280963+0000","last_became_active":"2024-04-25T10:05:48.275553+0000","last_became_peered":"2024-04-25T10:05:48.275553+0000","last_unstale":"2024-04-25T10:05:48.280963+0000","last_undegraded":"2024-04-25T10:05:48.280963+0000","last_fullsized":"2024-04-25T10:05:48.280963+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259924+0000","last_change":"2024-04-25T10:05:48.259924+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259924+0000","last_undegraded":"2024-04-25T10:05:48.259924+0000","last_fullsized":"2024-04-25T10:05:48.259924+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753106+0000","last_change":"2024-04-25T10:05:48.276598+0000","last_active":"2024-04-25T10:05:50.753106+0000","last_peered":"2024-04-25T10:05:50.753106+0000","last_clean":"2024-04-25T10:05:50.753106+0000","last_became_active":"2024-04-25T10:05:48.276341+0000","last_became_peered":"2024-04-25T10:05:48.276341+0000","last_unstale":"2024-04-25T10:05:50.753106+0000","last_undegraded":"2024-04-25T10:05:50.753106+0000","last_fullsized":"2024-04-25T10:05:50.753106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:01.796857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.265323+0000","last_change":"2024-04-25T10:05:48.265323+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.265323+0000","last_undegraded":"2024-04-25T10:05:48.265323+0000","last_fullsized":"2024-04-25T10:05:48.265323+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272465+0000","last_change":"2024-04-25T10:05:48.268595+0000","last_active":"2024-04-25T10:05:48.272465+0000","last_peered":"2024-04-25T10:05:48.272465+0000","last_clean":"2024-04-25T10:05:48.272465+0000","last_became_active":"2024-04-25T10:05:48.267579+0000","last_became_peered":"2024-04-25T10:05:48.267579+0000","last_unstale":"2024-04-25T10:05:48.272465+0000","last_undegraded":"2024-04-25T10:05:48.272465+0000","last_fullsized":"2024-04-25T10:05:48.272465+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.298325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753172+0000","last_change":"2024-04-25T10:05:49.280027+0000","last_active":"2024-04-25T10:05:50.753172+0000","last_peered":"2024-04-25T10:05:50.753172+0000","last_clean":"2024-04-25T10:05:50.753172+0000","last_became_active":"2024-04-25T10:05:49.279193+0000","last_became_peered":"2024-04-25T10:05:49.279193+0000","last_unstale":"2024-04-25T10:05:50.753172+0000","last_undegraded":"2024-04-25T10:05:50.753172+0000","last_fullsized":"2024-04-25T10:05:50.753172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:45.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.272949+0000","last_change":"2024-04-25T10:05:48.269624+0000","last_active":"2024-04-25T10:05:48.272949+0000","last_peered":"2024-04-25T10:05:48.272949+0000","last_clean":"2024-04-25T10:05:48.272949+0000","last_became_active":"2024-04-25T10:05:48.266543+0000","last_became_peered":"2024-04-25T10:05:48.266543+0000","last_unstale":"2024-04-25T10:05:48.272949+0000","last_undegraded":"2024-04-25T10:05:48.272949+0000","last_fullsized":"2024-04-25T10:05:48.272949+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:38.293978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263559+0000","last_change":"2024-04-25T10:05:48.263559+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263559+0000","last_undegraded":"2024-04-25T10:05:48.263559+0000","last_fullsized":"2024-04-25T10:05:48.263559+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752986+0000","last_change":"2024-04-25T10:05:48.283483+0000","last_active":"2024-04-25T10:05:50.752986+0000","last_peered":"2024-04-25T10:05:50.752986+0000","last_clean":"2024-04-25T10:05:50.752986+0000","last_became_active":"2024-04-25T10:05:48.283232+0000","last_became_peered":"2024-04-25T10:05:48.283232+0000","last_unstale":"2024-04-25T10:05:50.752986+0000","last_undegraded":"2024-04-25T10:05:50.752986+0000","last_fullsized":"2024-04-25T10:05:50.752986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259836+0000","last_change":"2024-04-25T10:05:48.259836+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259836+0000","last_undegraded":"2024-04-25T10:05:48.259836+0000","last_fullsized":"2024-04-25T10:05:48.259836+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275998+0000","last_change":"2024-04-25T10:05:48.274485+0000","last_active":"2024-04-25T10:05:48.275998+0000","last_peered":"2024-04-25T10:05:48.275998+0000","last_clean":"2024-04-25T10:05:48.275998+0000","last_became_active":"2024-04-25T10:05:48.274200+0000","last_became_peered":"2024-04-25T10:05:48.274200+0000","last_unstale":"2024-04-25T10:05:48.275998+0000","last_undegraded":"2024-04-25T10:05:48.275998+0000","last_fullsized":"2024-04-25T10:05:48.275998+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264785+0000","last_change":"2024-04-25T10:05:48.264785+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264785+0000","last_undegraded":"2024-04-25T10:05:48.264785+0000","last_fullsized":"2024-04-25T10:05:48.264785+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286472+0000","last_change":"2024-04-25T10:05:48.283403+0000","last_active":"2024-04-25T10:05:48.286472+0000","last_peered":"2024-04-25T10:05:48.286472+0000","last_clean":"2024-04-25T10:05:48.286472+0000","last_became_active":"2024-04-25T10:05:48.283065+0000","last_became_peered":"2024-04-25T10:05:48.283065+0000","last_unstale":"2024-04-25T10:05:48.286472+0000","last_undegraded":"2024-04-25T10:05:48.286472+0000","last_fullsized":"2024-04-25T10:05:48.286472+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753410+0000","last_change":"2024-04-25T10:05:49.289134+0000","last_active":"2024-04-25T10:05:50.753410+0000","last_peered":"2024-04-25T10:05:50.753410+0000","last_clean":"2024-04-25T10:05:50.753410+0000","last_became_active":"2024-04-25T10:05:49.288846+0000","last_became_peered":"2024-04-25T10:05:49.288846+0000","last_unstale":"2024-04-25T10:05:50.753410+0000","last_undegraded":"2024-04-25T10:05:50.753410+0000","last_fullsized":"2024-04-25T10:05:50.753410+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:34.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.283844+0000","last_change":"2024-04-25T10:05:48.279091+0000","last_active":"2024-04-25T10:05:48.283844+0000","last_peered":"2024-04-25T10:05:48.283844+0000","last_clean":"2024-04-25T10:05:48.283844+0000","last_became_active":"2024-04-25T10:05:48.278825+0000","last_became_peered":"2024-04-25T10:05:48.278825+0000","last_unstale":"2024-04-25T10:05:48.283844+0000","last_undegraded":"2024-04-25T10:05:48.283844+0000","last_fullsized":"2024-04-25T10:05:48.283844+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.259884+0000","last_change":"2024-04-25T10:05:48.259884+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.259884+0000","last_undegraded":"2024-04-25T10:05:48.259884+0000","last_fullsized":"2024-04-25T10:05:48.259884+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753403+0000","last_change":"2024-04-25T10:05:48.272940+0000","last_active":"2024-04-25T10:05:50.753403+0000","last_peered":"2024-04-25T10:05:50.753403+0000","last_clean":"2024-04-25T10:05:50.753403+0000","last_became_active":"2024-04-25T10:05:48.272660+0000","last_became_peered":"2024-04-25T10:05:48.272660+0000","last_unstale":"2024-04-25T10:05:50.753403+0000","last_undegraded":"2024-04-25T10:05:50.753403+0000","last_fullsized":"2024-04-25T10:05:50.753403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.495702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264461+0000","last_change":"2024-04-25T10:05:48.264461+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264461+0000","last_undegraded":"2024-04-25T10:05:48.264461+0000","last_fullsized":"2024-04-25T10:05:48.264461+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753204+0000","last_change":"2024-04-25T10:05:48.280067+0000","last_active":"2024-04-25T10:05:50.753204+0000","last_peered":"2024-04-25T10:05:50.753204+0000","last_clean":"2024-04-25T10:05:50.753204+0000","last_became_active":"2024-04-25T10:05:48.279765+0000","last_became_peered":"2024-04-25T10:05:48.279765+0000","last_unstale":"2024-04-25T10:05:50.753204+0000","last_undegraded":"2024-04-25T10:05:50.753204+0000","last_fullsized":"2024-04-25T10:05:50.753204+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:43.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753804+0000","last_change":"2024-04-25T10:05:49.286825+0000","last_active":"2024-04-25T10:05:50.753804+0000","last_peered":"2024-04-25T10:05:50.753804+0000","last_clean":"2024-04-25T10:05:50.753804+0000","last_became_active":"2024-04-25T10:05:49.277289+0000","last_became_peered":"2024-04-25T10:05:49.277289+0000","last_unstale":"2024-04-25T10:05:50.753804+0000","last_undegraded":"2024-04-25T10:05:50.753804+0000","last_fullsized":"2024-04-25T10:05:50.753804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:06.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286612+0000","last_change":"2024-04-25T10:05:48.283276+0000","last_active":"2024-04-25T10:05:48.286612+0000","last_peered":"2024-04-25T10:05:48.286612+0000","last_clean":"2024-04-25T10:05:48.286612+0000","last_became_active":"2024-04-25T10:05:48.282966+0000","last_became_peered":"2024-04-25T10:05:48.282966+0000","last_unstale":"2024-04-25T10:05:48.286612+0000","last_undegraded":"2024-04-25T10:05:48.286612+0000","last_fullsized":"2024-04-25T10:05:48.286612+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:40.201380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753012+0000","last_change":"2024-04-25T10:05:49.279816+0000","last_active":"2024-04-25T10:05:50.753012+0000","last_peered":"2024-04-25T10:05:50.753012+0000","last_clean":"2024-04-25T10:05:50.753012+0000","last_became_active":"2024-04-25T10:05:49.278817+0000","last_became_peered":"2024-04-25T10:05:49.278817+0000","last_unstale":"2024-04-25T10:05:50.753012+0000","last_undegraded":"2024-04-25T10:05:50.753012+0000","last_fullsized":"2024-04-25T10:05:50.753012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:19.953916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.275950+0000","last_change":"2024-04-25T10:05:48.274031+0000","last_active":"2024-04-25T10:05:48.275950+0000","last_peered":"2024-04-25T10:05:48.275950+0000","last_clean":"2024-04-25T10:05:48.275950+0000","last_became_active":"2024-04-25T10:05:48.273773+0000","last_became_peered":"2024-04-25T10:05:48.273773+0000","last_unstale":"2024-04-25T10:05:48.275950+0000","last_undegraded":"2024-04-25T10:05:48.275950+0000","last_fullsized":"2024-04-25T10:05:48.275950+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753930+0000","last_change":"2024-04-25T10:05:49.292075+0000","last_active":"2024-04-25T10:05:50.753930+0000","last_peered":"2024-04-25T10:05:50.753930+0000","last_clean":"2024-04-25T10:05:50.753930+0000","last_became_active":"2024-04-25T10:05:49.290568+0000","last_became_peered":"2024-04-25T10:05:49.290568+0000","last_unstale":"2024-04-25T10:05:50.753930+0000","last_undegraded":"2024-04-25T10:05:50.753930+0000","last_fullsized":"2024-04-25T10:05:50.753930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:14.833904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752608+0000","last_change":"2024-04-25T10:05:48.265471+0000","last_active":"2024-04-25T10:05:50.752608+0000","last_peered":"2024-04-25T10:05:50.752608+0000","last_clean":"2024-04-25T10:05:50.752608+0000","last_became_active":"2024-04-25T10:05:48.265206+0000","last_became_peered":"2024-04-25T10:05:48.265206+0000","last_unstale":"2024-04-25T10:05:50.752608+0000","last_undegraded":"2024-04-25T10:05:50.752608+0000","last_fullsized":"2024-04-25T10:05:50.752608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.065657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752783+0000","last_change":"2024-04-25T10:05:49.287611+0000","last_active":"2024-04-25T10:05:50.752783+0000","last_peered":"2024-04-25T10:05:50.752783+0000","last_clean":"2024-04-25T10:05:50.752783+0000","last_became_active":"2024-04-25T10:05:49.287212+0000","last_became_peered":"2024-04-25T10:05:49.287212+0000","last_unstale":"2024-04-25T10:05:50.752783+0000","last_undegraded":"2024-04-25T10:05:50.752783+0000","last_fullsized":"2024-04-25T10:05:50.752783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.073227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754064+0000","last_change":"2024-04-25T10:05:48.282046+0000","last_active":"2024-04-25T10:05:50.754064+0000","last_peered":"2024-04-25T10:05:50.754064+0000","last_clean":"2024-04-25T10:05:50.754064+0000","last_became_active":"2024-04-25T10:05:48.279856+0000","last_became_peered":"2024-04-25T10:05:48.279856+0000","last_unstale":"2024-04-25T10:05:50.754064+0000","last_undegraded":"2024-04-25T10:05:50.754064+0000","last_fullsized":"2024-04-25T10:05:50.754064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:36.907141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273399+0000","last_change":"2024-04-25T10:05:49.288251+0000","last_active":"2024-04-25T10:05:50.273399+0000","last_peered":"2024-04-25T10:05:50.273399+0000","last_clean":"2024-04-25T10:05:50.273399+0000","last_became_active":"2024-04-25T10:05:49.287944+0000","last_became_peered":"2024-04-25T10:05:49.287944+0000","last_unstale":"2024-04-25T10:05:50.273399+0000","last_undegraded":"2024-04-25T10:05:50.273399+0000","last_fullsized":"2024-04-25T10:05:50.273399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:05.168013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753178+0000","last_change":"2024-04-25T10:05:48.270200+0000","last_active":"2024-04-25T10:05:50.753178+0000","last_peered":"2024-04-25T10:05:50.753178+0000","last_clean":"2024-04-25T10:05:50.753178+0000","last_became_active":"2024-04-25T10:05:48.269876+0000","last_became_peered":"2024-04-25T10:05:48.269876+0000","last_unstale":"2024-04-25T10:05:50.753178+0000","last_undegraded":"2024-04-25T10:05:50.753178+0000","last_fullsized":"2024-04-25T10:05:50.753178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:19.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.260952+0000","last_change":"2024-04-25T10:05:48.260952+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.260952+0000","last_undegraded":"2024-04-25T10:05:48.260952+0000","last_fullsized":"2024-04-25T10:05:48.260952+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273224+0000","last_change":"2024-04-25T10:05:48.271962+0000","last_active":"2024-04-25T10:05:48.273224+0000","last_peered":"2024-04-25T10:05:48.273224+0000","last_clean":"2024-04-25T10:05:48.273224+0000","last_became_active":"2024-04-25T10:05:48.271483+0000","last_became_peered":"2024-04-25T10:05:48.271483+0000","last_unstale":"2024-04-25T10:05:48.273224+0000","last_undegraded":"2024-04-25T10:05:48.273224+0000","last_fullsized":"2024-04-25T10:05:48.273224+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:11.489911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273599+0000","last_change":"2024-04-25T10:05:49.273945+0000","last_active":"2024-04-25T10:05:50.273599+0000","last_peered":"2024-04-25T10:05:50.273599+0000","last_clean":"2024-04-25T10:05:50.273599+0000","last_became_active":"2024-04-25T10:05:49.273627+0000","last_became_peered":"2024-04-25T10:05:49.273627+0000","last_unstale":"2024-04-25T10:05:50.273599+0000","last_undegraded":"2024-04-25T10:05:50.273599+0000","last_fullsized":"2024-04-25T10:05:50.273599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.273084+0000","last_change":"2024-04-25T10:05:48.267427+0000","last_active":"2024-04-25T10:05:48.273084+0000","last_peered":"2024-04-25T10:05:48.273084+0000","last_clean":"2024-04-25T10:05:48.273084+0000","last_became_active":"2024-04-25T10:05:48.267151+0000","last_became_peered":"2024-04-25T10:05:48.267151+0000","last_unstale":"2024-04-25T10:05:48.273084+0000","last_undegraded":"2024-04-25T10:05:48.273084+0000","last_fullsized":"2024-04-25T10:05:48.273084+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:25.452679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.263960+0000","last_change":"2024-04-25T10:05:48.263960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.263960+0000","last_undegraded":"2024-04-25T10:05:48.263960+0000","last_fullsized":"2024-04-25T10:05:48.263960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273648+0000","last_change":"2024-04-25T10:05:48.270641+0000","last_active":"2024-04-25T10:05:50.273648+0000","last_peered":"2024-04-25T10:05:50.273648+0000","last_clean":"2024-04-25T10:05:50.273648+0000","last_became_active":"2024-04-25T10:05:48.270317+0000","last_became_peered":"2024-04-25T10:05:48.270317+0000","last_unstale":"2024-04-25T10:05:50.273648+0000","last_undegraded":"2024-04-25T10:05:50.273648+0000","last_fullsized":"2024-04-25T10:05:50.273648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.257960+0000","last_change":"2024-04-25T10:05:48.257960+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.257960+0000","last_undegraded":"2024-04-25T10:05:48.257960+0000","last_fullsized":"2024-04-25T10:05:48.257960+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752480+0000","last_change":"2024-04-25T10:05:48.269712+0000","last_active":"2024-04-25T10:05:50.752480+0000","last_peered":"2024-04-25T10:05:50.752480+0000","last_clean":"2024-04-25T10:05:50.752480+0000","last_became_active":"2024-04-25T10:05:48.269322+0000","last_became_peered":"2024-04-25T10:05:48.269322+0000","last_unstale":"2024-04-25T10:05:50.752480+0000","last_undegraded":"2024-04-25T10:05:50.752480+0000","last_fullsized":"2024-04-25T10:05:50.752480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:04.949669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754039+0000","last_change":"2024-04-25T10:05:49.287123+0000","last_active":"2024-04-25T10:05:50.754039+0000","last_peered":"2024-04-25T10:05:50.754039+0000","last_clean":"2024-04-25T10:05:50.754039+0000","last_became_active":"2024-04-25T10:05:49.286843+0000","last_became_peered":"2024-04-25T10:05:49.286843+0000","last_unstale":"2024-04-25T10:05:50.754039+0000","last_undegraded":"2024-04-25T10:05:50.754039+0000","last_fullsized":"2024-04-25T10:05:50.754039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:22.087955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752866+0000","last_change":"2024-04-25T10:05:48.281874+0000","last_active":"2024-04-25T10:05:50.752866+0000","last_peered":"2024-04-25T10:05:50.752866+0000","last_clean":"2024-04-25T10:05:50.752866+0000","last_became_active":"2024-04-25T10:05:48.281609+0000","last_became_peered":"2024-04-25T10:05:48.281609+0000","last_unstale":"2024-04-25T10:05:50.752866+0000","last_undegraded":"2024-04-25T10:05:50.752866+0000","last_fullsized":"2024-04-25T10:05:50.752866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273809+0000","last_change":"2024-04-25T10:05:49.283100+0000","last_active":"2024-04-25T10:05:50.273809+0000","last_peered":"2024-04-25T10:05:50.273809+0000","last_clean":"2024-04-25T10:05:50.273809+0000","last_became_active":"2024-04-25T10:05:49.282848+0000","last_became_peered":"2024-04-25T10:05:49.282848+0000","last_unstale":"2024-04-25T10:05:50.273809+0000","last_undegraded":"2024-04-25T10:05:50.273809+0000","last_fullsized":"2024-04-25T10:05:50.273809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752169+0000","last_change":"2024-04-25T10:05:48.272439+0000","last_active":"2024-04-25T10:05:50.752169+0000","last_peered":"2024-04-25T10:05:50.752169+0000","last_clean":"2024-04-25T10:05:50.752169+0000","last_became_active":"2024-04-25T10:05:48.272138+0000","last_became_peered":"2024-04-25T10:05:48.272138+0000","last_unstale":"2024-04-25T10:05:50.752169+0000","last_undegraded":"2024-04-25T10:05:50.752169+0000","last_fullsized":"2024-04-25T10:05:50.752169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:37.575727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.264035+0000","last_change":"2024-04-25T10:05:48.264035+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.264035+0000","last_undegraded":"2024-04-25T10:05:48.264035+0000","last_fullsized":"2024-04-25T10:05:48.264035+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286603+0000","last_change":"2024-04-25T10:05:48.283226+0000","last_active":"2024-04-25T10:05:48.286603+0000","last_peered":"2024-04-25T10:05:48.286603+0000","last_clean":"2024-04-25T10:05:48.286603+0000","last_became_active":"2024-04-25T10:05:48.282936+0000","last_became_peered":"2024-04-25T10:05:48.282936+0000","last_unstale":"2024-04-25T10:05:48.286603+0000","last_undegraded":"2024-04-25T10:05:48.286603+0000","last_fullsized":"2024-04-25T10:05:48.286603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:59.924963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273466+0000","last_change":"2024-04-25T10:05:49.267528+0000","last_active":"2024-04-25T10:05:50.273466+0000","last_peered":"2024-04-25T10:05:50.273466+0000","last_clean":"2024-04-25T10:05:50.273466+0000","last_became_active":"2024-04-25T10:05:49.267253+0000","last_became_peered":"2024-04-25T10:05:49.267253+0000","last_unstale":"2024-04-25T10:05:50.273466+0000","last_undegraded":"2024-04-25T10:05:50.273466+0000","last_fullsized":"2024-04-25T10:05:50.273466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.973080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.286770+0000","last_change":"2024-04-25T10:05:48.281960+0000","last_active":"2024-04-25T10:05:48.286770+0000","last_peered":"2024-04-25T10:05:48.286770+0000","last_clean":"2024-04-25T10:05:48.286770+0000","last_became_active":"2024-04-25T10:05:48.281643+0000","last_became_peered":"2024-04-25T10:05:48.281643+0000","last_unstale":"2024-04-25T10:05:48.286770+0000","last_undegraded":"2024-04-25T10:05:48.286770+0000","last_fullsized":"2024-04-25T10:05:48.286770+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753397+0000","last_change":"2024-04-25T10:05:49.278775+0000","last_active":"2024-04-25T10:05:50.753397+0000","last_peered":"2024-04-25T10:05:50.753397+0000","last_clean":"2024-04-25T10:05:50.753397+0000","last_became_active":"2024-04-25T10:05:49.278156+0000","last_became_peered":"2024-04-25T10:05:49.278156+0000","last_unstale":"2024-04-25T10:05:50.753397+0000","last_undegraded":"2024-04-25T10:05:50.753397+0000","last_fullsized":"2024-04-25T10:05:50.753397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:58.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753377+0000","last_change":"2024-04-25T10:05:48.284598+0000","last_active":"2024-04-25T10:05:50.753377+0000","last_peered":"2024-04-25T10:05:50.753377+0000","last_clean":"2024-04-25T10:05:50.753377+0000","last_became_active":"2024-04-25T10:05:48.284293+0000","last_became_peered":"2024-04-25T10:05:48.284293+0000","last_unstale":"2024-04-25T10:05:50.753377+0000","last_undegraded":"2024-04-25T10:05:50.753377+0000","last_fullsized":"2024-04-25T10:05:50.753377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:55.962777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753276+0000","last_change":"2024-04-25T10:05:49.279763+0000","last_active":"2024-04-25T10:05:50.753276+0000","last_peered":"2024-04-25T10:05:50.753276+0000","last_clean":"2024-04-25T10:05:50.753276+0000","last_became_active":"2024-04-25T10:05:49.279445+0000","last_became_peered":"2024-04-25T10:05:49.279445+0000","last_unstale":"2024-04-25T10:05:50.753276+0000","last_undegraded":"2024-04-25T10:05:50.753276+0000","last_fullsized":"2024-04-25T10:05:50.753276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:58.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753442+0000","last_change":"2024-04-25T10:05:48.268661+0000","last_active":"2024-04-25T10:05:50.753442+0000","last_peered":"2024-04-25T10:05:50.753442+0000","last_clean":"2024-04-25T10:05:50.753442+0000","last_became_active":"2024-04-25T10:05:48.268385+0000","last_became_peered":"2024-04-25T10:05:48.268385+0000","last_unstale":"2024-04-25T10:05:50.753442+0000","last_undegraded":"2024-04-25T10:05:50.753442+0000","last_fullsized":"2024-04-25T10:05:50.753442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:25.882935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.262617+0000","last_change":"2024-04-25T10:05:48.262617+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.262617+0000","last_undegraded":"2024-04-25T10:05:48.262617+0000","last_fullsized":"2024-04-25T10:05:48.262617+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752574+0000","last_change":"2024-04-25T10:05:48.275050+0000","last_active":"2024-04-25T10:05:50.752574+0000","last_peered":"2024-04-25T10:05:50.752574+0000","last_clean":"2024-04-25T10:05:50.752574+0000","last_became_active":"2024-04-25T10:05:48.274788+0000","last_became_peered":"2024-04-25T10:05:48.274788+0000","last_unstale":"2024-04-25T10:05:50.752574+0000","last_undegraded":"2024-04-25T10:05:50.752574+0000","last_fullsized":"2024-04-25T10:05:50.752574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:10.415099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753846+0000","last_change":"2024-04-25T10:05:49.281926+0000","last_active":"2024-04-25T10:05:50.753846+0000","last_peered":"2024-04-25T10:05:50.753846+0000","last_clean":"2024-04-25T10:05:50.753846+0000","last_became_active":"2024-04-25T10:05:49.281693+0000","last_became_peered":"2024-04-25T10:05:49.281693+0000","last_unstale":"2024-04-25T10:05:50.753846+0000","last_undegraded":"2024-04-25T10:05:50.753846+0000","last_fullsized":"2024-04-25T10:05:50.753846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:25.453805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281271+0000","last_change":"2024-04-25T10:05:48.276064+0000","last_active":"2024-04-25T10:05:48.281271+0000","last_peered":"2024-04-25T10:05:48.281271+0000","last_clean":"2024-04-25T10:05:48.281271+0000","last_became_active":"2024-04-25T10:05:48.275744+0000","last_became_peered":"2024-04-25T10:05:48.275744+0000","last_unstale":"2024-04-25T10:05:48.281271+0000","last_undegraded":"2024-04-25T10:05:48.281271+0000","last_fullsized":"2024-04-25T10:05:48.281271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753468+0000","last_change":"2024-04-25T10:05:49.297061+0000","last_active":"2024-04-25T10:05:50.753468+0000","last_peered":"2024-04-25T10:05:50.753468+0000","last_clean":"2024-04-25T10:05:50.753468+0000","last_became_active":"2024-04-25T10:05:49.294500+0000","last_became_peered":"2024-04-25T10:05:49.294500+0000","last_unstale":"2024-04-25T10:05:50.753468+0000","last_undegraded":"2024-04-25T10:05:50.753468+0000","last_fullsized":"2024-04-25T10:05:50.753468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.086551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.281034+0000","last_change":"2024-04-25T10:05:48.277544+0000","last_active":"2024-04-25T10:05:48.281034+0000","last_peered":"2024-04-25T10:05:48.281034+0000","last_clean":"2024-04-25T10:05:48.281034+0000","last_became_active":"2024-04-25T10:05:48.277305+0000","last_became_peered":"2024-04-25T10:05:48.277305+0000","last_unstale":"2024-04-25T10:05:48.281034+0000","last_undegraded":"2024-04-25T10:05:48.281034+0000","last_fullsized":"2024-04-25T10:05:48.281034+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":51,"state":"creating+peering","last_fresh":"2024-04-25T10:05:48.256078+0000","last_change":"2024-04-25T10:05:48.256078+0000","last_active":"2024-04-25T10:05:48.244110+0000","last_peered":"2024-04-25T10:05:48.244110+0000","last_clean":"2024-04-25T10:05:48.244110+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:05:48.256078+0000","last_undegraded":"2024-04-25T10:05:48.256078+0000","last_fullsized":"2024-04-25T10:05:48.256078+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753974+0000","last_change":"2024-04-25T10:05:48.280958+0000","last_active":"2024-04-25T10:05:50.753974+0000","last_peered":"2024-04-25T10:05:50.753974+0000","last_clean":"2024-04-25T10:05:50.753974+0000","last_became_active":"2024-04-25T10:05:48.280282+0000","last_became_peered":"2024-04-25T10:05:48.280282+0000","last_unstale":"2024-04-25T10:05:50.753974+0000","last_undegraded":"2024-04-25T10:05:50.753974+0000","last_fullsized":"2024-04-25T10:05:50.753974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:05.893165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":224,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-04-25T10:05:48.267693+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:48.267693+0000","last_peered":"2024-04-25T10:05:48.267693+0000","last_clean":"2024-04-25T10:05:48.267693+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:48.267693+0000","last_undegraded":"2024-04-25T10:05:48.267693+0000","last_fullsized":"2024-04-25T10:05:48.267693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1668,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28180,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343660,"statfs":{"total":96636764160,"available":96607907840,"internally_reserved":0,"allocated":1179648,"data_stored":847823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509468,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509467,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":257455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":638976,"data_stored":279615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":279593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":278141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":868405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:57.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:05:58.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 Processor -- start 2024-04-25T10:05:58.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 -- start start 2024-04-25T10:05:58.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0cc4e0 con 0x7f7bdc145270 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0ce040 con 0x7f7bdc15fe50 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7be2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc145650 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdb400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7bdc145270 0x7f7bdc0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47688/0 (socket says 172.21.15.18:47688) 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdb400640 1 -- 172.21.15.18:0/4110264523 learned_addr learned my addr 172.21.15.18:0/4110264523 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:58.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdbe00640 1 --2- 172.21.15.18:0/4110264523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798135060 0 0) 0x7f7bdc0cc4e0 con 0x7f7bdc145270 2024-04-25T10:05:58.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc0003530 con 0x7f7bdc145270 2024-04-25T10:05:58.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68540110 0 0) 0x7f7bdc0ce040 con 0x7f7bdc15fe50 2024-04-25T10:05:58.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.096+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc0cc4e0 con 0x7f7bdc15fe50 2024-04-25T10:05:58.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdbe00640 1 -- 172.21.15.18:0/4110264523 >> v1:172.21.15.167:6789/0 conn(0x7f7bdc15fe50 legacy=0x7f7bdc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1627860141 0 0) 0x7f7bc0003530 con 0x7f7bdc145270 2024-04-25T10:05:58.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdbe00640 1 -- 172.21.15.18:0/4110264523 >> v1:172.21.15.18:6789/0 conn(0x7f7bdc145270 legacy=0x7f7bdc0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdbe00640 1 -- 172.21.15.18:0/4110264523 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0ce320 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdbe00640 1 --2- 172.21.15.18:0/4110264523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc15bd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009dc0 tx=0x7f7bd401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1945bc83fda065bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40b2070 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd40a55e0 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7bdaa00640 1 -- 172.21.15.18:0/4110264523 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc001680 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7be2000640 1 -- 172.21.15.18:0/4110264523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 msgr2=0x7f7bdc15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.100+0000 7f7be2000640 1 --2- 172.21.15.18:0/4110264523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc15bd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009dc0 tx=0x7f7bd401c8b0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- 172.21.15.18:0/4110264523 shutdown_connections 2024-04-25T10:05:58.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 --2- 172.21.15.18:0/4110264523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc15bd80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- 172.21.15.18:0/4110264523 >> 172.21.15.18:0/4110264523 conn(0x7f7bdc066fa0 msgr2=0x7f7bdc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:58.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- 172.21.15.18:0/4110264523 shutdown_connections 2024-04-25T10:05:58.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- 172.21.15.18:0/4110264523 wait complete. 2024-04-25T10:05:58.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 Processor -- start 2024-04-25T10:05:58.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- start start 2024-04-25T10:05:58.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc164770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 0x7f7bdc0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0cdd60 con 0x7f7bdc145270 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0cdbe0 con 0x7f7bdc15fe50 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7be2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc169720 con 0x7f7bdc0b1e60 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42114/0 (socket says 172.21.15.18:42114) 2024-04-25T10:05:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 -- 172.21.15.18:0/1973520957 learned_addr learned my addr 172.21.15.18:0/1973520957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bdbe00640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 0x7f7bdc0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bdb400640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc164770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 -- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 msgr2=0x7f7bdc164770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc164770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 -- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 msgr2=0x7f7bdc0b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 0x7f7bdc0b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 -- 172.21.15.18:0/1973520957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc166e60 con 0x7f7bdc145270 2024-04-25T10:05:58.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bdbe00640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 0x7f7bdc0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3e00640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c460 tx=0x7f7bc400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.104+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40052d0 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4005490 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4012850 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bdc167140 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc1618f0 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc0745d0 con 0x7f7bdc145270 2024-04-25T10:05:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7bc40129f0 con 0x7f7bdc145270 2024-04-25T10:05:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bd3400640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 0x7f7bb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7bc4084f10 con 0x7f7bdc145270 2024-04-25T10:05:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.108+0000 7f7bdb400640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 0x7f7bb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.112+0000 7f7bdb400640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 0x7f7bb8069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0011f0 tx=0x7f7bcc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.112+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7bc4055c60 con 0x7f7bdc145270 2024-04-25T10:05:58.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.272+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7bdc0cc2c0 con 0x7f7bb8066f60 2024-04-25T10:05:58.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.276+0000 7f7bd3400640 1 -- 172.21.15.18:0/1973520957 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251920 (secure 0 0 0) 0x7f7bdc0cc2c0 con 0x7f7bb8066f60 2024-04-25T10:05:58.291 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:58.292 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:05:58.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 msgr2=0x7f7bb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 0x7f7bb8069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0011f0 tx=0x7f7bcc009040 comp rx=0 tx=0).stop 2024-04-25T10:05:58.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 msgr2=0x7f7bdc0b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400c460 tx=0x7f7bc400c920 comp rx=0 tx=0).stop 2024-04-25T10:05:58.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 shutdown_connections 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bdc15fe50 0x7f7bdc0b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7bdc145270 0x7f7bdc0b36a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7bb8066f60 0x7f7bb8069420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 --2- 172.21.15.18:0/1973520957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7bdc0b1e60 0x7f7bdc164770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 >> 172.21.15.18:0/1973520957 conn(0x7f7bdc066fa0 msgr2=0x7f7bdc15d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 shutdown_connections 2024-04-25T10:05:58.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.280+0000 7f7be2000640 1 -- 172.21.15.18:0/1973520957 wait complete. 2024-04-25T10:05:58.311 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2024-04-25T10:05:57.424674+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243056,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731664,"statfs":{"total":773094113280,"available":772845223936,"internally_reserved":0,"allocated":6234112,"data_stored":3409404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.169401"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273860+0000","last_change":"2024-04-25T10:05:49.285079+0000","last_active":"2024-04-25T10:05:50.273860+0000","last_peered":"2024-04-25T10:05:50.273860+0000","last_clean":"2024-04-25T10:05:50.273860+0000","last_became_active":"2024-04-25T10:05:49.284804+0000","last_became_peered":"2024-04-25T10:05:49.284804+0000","last_unstale":"2024-04-25T10:05:50.273860+0000","last_undegraded":"2024-04-25T10:05:50.273860+0000","last_fullsized":"2024-04-25T10:05:50.273860+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754014+0000","last_change":"2024-04-25T10:05:49.296260+0000","last_active":"2024-04-25T10:05:50.754014+0000","last_peered":"2024-04-25T10:05:50.754014+0000","last_clean":"2024-04-25T10:05:50.754014+0000","last_became_active":"2024-04-25T10:05:49.296015+0000","last_became_peered":"2024-04-25T10:05:49.296015+0000","last_unstale":"2024-04-25T10:05:50.754014+0000","last_undegraded":"2024-04-25T10:05:50.754014+0000","last_fullsized":"2024-04-25T10:05:50.754014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753632+0000","last_change":"2024-04-25T10:05:49.287086+0000","last_active":"2024-04-25T10:05:50.753632+0000","last_peered":"2024-04-25T10:05:50.753632+0000","last_clean":"2024-04-25T10:05:50.753632+0000","last_became_active":"2024-04-25T10:05:49.285731+0000","last_became_peered":"2024-04-25T10:05:49.285731+0000","last_unstale":"2024-04-25T10:05:50.753632+0000","last_undegraded":"2024-04-25T10:05:50.753632+0000","last_fullsized":"2024-04-25T10:05:50.753632+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:16.613534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753858+0000","last_change":"2024-04-25T10:05:49.291728+0000","last_active":"2024-04-25T10:05:50.753858+0000","last_peered":"2024-04-25T10:05:50.753858+0000","last_clean":"2024-04-25T10:05:50.753858+0000","last_became_active":"2024-04-25T10:05:49.291403+0000","last_became_peered":"2024-04-25T10:05:49.291403+0000","last_unstale":"2024-04-25T10:05:50.753858+0000","last_undegraded":"2024-04-25T10:05:50.753858+0000","last_fullsized":"2024-04-25T10:05:50.753858+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.275902+0000","last_change":"2024-04-25T10:05:49.283847+0000","last_active":"2024-04-25T10:05:50.275902+0000","last_peered":"2024-04-25T10:05:50.275902+0000","last_clean":"2024-04-25T10:05:50.275902+0000","last_became_active":"2024-04-25T10:05:49.283570+0000","last_became_peered":"2024-04-25T10:05:49.283570+0000","last_unstale":"2024-04-25T10:05:50.275902+0000","last_undegraded":"2024-04-25T10:05:50.275902+0000","last_fullsized":"2024-04-25T10:05:50.275902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:39.048517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273516+0000","last_change":"2024-04-25T10:05:49.282396+0000","last_active":"2024-04-25T10:05:50.273516+0000","last_peered":"2024-04-25T10:05:50.273516+0000","last_clean":"2024-04-25T10:05:50.273516+0000","last_became_active":"2024-04-25T10:05:49.281398+0000","last_became_peered":"2024-04-25T10:05:49.281398+0000","last_unstale":"2024-04-25T10:05:50.273516+0000","last_undegraded":"2024-04-25T10:05:50.273516+0000","last_fullsized":"2024-04-25T10:05:50.273516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.475074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752757+0000","last_change":"2024-04-25T10:05:49.286501+0000","last_active":"2024-04-25T10:05:50.752757+0000","last_peered":"2024-04-25T10:05:50.752757+0000","last_clean":"2024-04-25T10:05:50.752757+0000","last_became_active":"2024-04-25T10:05:49.286244+0000","last_became_peered":"2024-04-25T10:05:49.286244+0000","last_unstale":"2024-04-25T10:05:50.752757+0000","last_undegraded":"2024-04-25T10:05:50.752757+0000","last_fullsized":"2024-04-25T10:05:50.752757+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:27:26.167353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752551+0000","last_change":"2024-04-25T10:05:49.292415+0000","last_active":"2024-04-25T10:05:50.752551+0000","last_peered":"2024-04-25T10:05:50.752551+0000","last_clean":"2024-04-25T10:05:50.752551+0000","last_became_active":"2024-04-25T10:05:49.292210+0000","last_became_peered":"2024-04-25T10:05:49.292210+0000","last_unstale":"2024-04-25T10:05:50.752551+0000","last_undegraded":"2024-04-25T10:05:50.752551+0000","last_fullsized":"2024-04-25T10:05:50.752551+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:42.412711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753322+0000","last_change":"2024-04-25T10:05:49.294200+0000","last_active":"2024-04-25T10:05:50.753322+0000","last_peered":"2024-04-25T10:05:50.753322+0000","last_clean":"2024-04-25T10:05:50.753322+0000","last_became_active":"2024-04-25T10:05:49.293943+0000","last_became_peered":"2024-04-25T10:05:49.293943+0000","last_unstale":"2024-04-25T10:05:50.753322+0000","last_undegraded":"2024-04-25T10:05:50.753322+0000","last_fullsized":"2024-04-25T10:05:50.753322+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:20.041919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273688+0000","last_change":"2024-04-25T10:05:49.275464+0000","last_active":"2024-04-25T10:05:50.273688+0000","last_peered":"2024-04-25T10:05:50.273688+0000","last_clean":"2024-04-25T10:05:50.273688+0000","last_became_active":"2024-04-25T10:05:49.274039+0000","last_became_peered":"2024-04-25T10:05:49.274039+0000","last_unstale":"2024-04-25T10:05:50.273688+0000","last_undegraded":"2024-04-25T10:05:50.273688+0000","last_fullsized":"2024-04-25T10:05:50.273688+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752801+0000","last_change":"2024-04-25T10:05:49.282389+0000","last_active":"2024-04-25T10:05:50.752801+0000","last_peered":"2024-04-25T10:05:50.752801+0000","last_clean":"2024-04-25T10:05:50.752801+0000","last_became_active":"2024-04-25T10:05:49.282122+0000","last_became_peered":"2024-04-25T10:05:49.282122+0000","last_unstale":"2024-04-25T10:05:50.752801+0000","last_undegraded":"2024-04-25T10:05:50.752801+0000","last_fullsized":"2024-04-25T10:05:50.752801+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:07:15.551190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753119+0000","last_change":"2024-04-25T10:05:49.286972+0000","last_active":"2024-04-25T10:05:50.753119+0000","last_peered":"2024-04-25T10:05:50.753119+0000","last_clean":"2024-04-25T10:05:50.753119+0000","last_became_active":"2024-04-25T10:05:49.286632+0000","last_became_peered":"2024-04-25T10:05:49.286632+0000","last_unstale":"2024-04-25T10:05:50.753119+0000","last_undegraded":"2024-04-25T10:05:50.753119+0000","last_fullsized":"2024-04-25T10:05:50.753119+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:13:57.536288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273434+0000","last_change":"2024-04-25T10:05:49.269276+0000","last_active":"2024-04-25T10:05:50.273434+0000","last_peered":"2024-04-25T10:05:50.273434+0000","last_clean":"2024-04-25T10:05:50.273434+0000","last_became_active":"2024-04-25T10:05:49.269012+0000","last_became_peered":"2024-04-25T10:05:49.269012+0000","last_unstale":"2024-04-25T10:05:50.273434+0000","last_undegraded":"2024-04-25T10:05:50.273434+0000","last_fullsized":"2024-04-25T10:05:50.273434+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:37.910181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753593+0000","last_change":"2024-04-25T10:05:49.293545+0000","last_active":"2024-04-25T10:05:50.753593+0000","last_peered":"2024-04-25T10:05:50.753593+0000","last_clean":"2024-04-25T10:05:50.753593+0000","last_became_active":"2024-04-25T10:05:49.292750+0000","last_became_peered":"2024-04-25T10:05:49.292750+0000","last_unstale":"2024-04-25T10:05:50.753593+0000","last_undegraded":"2024-04-25T10:05:50.753593+0000","last_fullsized":"2024-04-25T10:05:50.753593+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:51.143210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753633+0000","last_change":"2024-04-25T10:05:49.286722+0000","last_active":"2024-04-25T10:05:50.753633+0000","last_peered":"2024-04-25T10:05:50.753633+0000","last_clean":"2024-04-25T10:05:50.753633+0000","last_became_active":"2024-04-25T10:05:49.286408+0000","last_became_peered":"2024-04-25T10:05:49.286408+0000","last_unstale":"2024-04-25T10:05:50.753633+0000","last_undegraded":"2024-04-25T10:05:50.753633+0000","last_fullsized":"2024-04-25T10:05:50.753633+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:32.475074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273381+0000","last_change":"2024-04-25T10:05:49.266345+0000","last_active":"2024-04-25T10:05:50.273381+0000","last_peered":"2024-04-25T10:05:50.273381+0000","last_clean":"2024-04-25T10:05:50.273381+0000","last_became_active":"2024-04-25T10:05:49.266113+0000","last_became_peered":"2024-04-25T10:05:49.266113+0000","last_unstale":"2024-04-25T10:05:50.273381+0000","last_undegraded":"2024-04-25T10:05:50.273381+0000","last_fullsized":"2024-04-25T10:05:50.273381+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:39.048517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754014+0000","last_change":"2024-04-25T10:05:49.290847+0000","last_active":"2024-04-25T10:05:50.754014+0000","last_peered":"2024-04-25T10:05:50.754014+0000","last_clean":"2024-04-25T10:05:50.754014+0000","last_became_active":"2024-04-25T10:05:49.289958+0000","last_became_peered":"2024-04-25T10:05:49.289958+0000","last_unstale":"2024-04-25T10:05:50.754014+0000","last_undegraded":"2024-04-25T10:05:50.754014+0000","last_fullsized":"2024-04-25T10:05:50.754014+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:15.945832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754034+0000","last_change":"2024-04-25T10:05:49.296245+0000","last_active":"2024-04-25T10:05:50.754034+0000","last_peered":"2024-04-25T10:05:50.754034+0000","last_clean":"2024-04-25T10:05:50.754034+0000","last_became_active":"2024-04-25T10:05:49.296009+0000","last_became_peered":"2024-04-25T10:05:49.296009+0000","last_unstale":"2024-04-25T10:05:50.754034+0000","last_undegraded":"2024-04-25T10:05:50.754034+0000","last_fullsized":"2024-04-25T10:05:50.754034+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:20.264595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753810+0000","last_change":"2024-04-25T10:05:49.286035+0000","last_active":"2024-04-25T10:05:50.753810+0000","last_peered":"2024-04-25T10:05:50.753810+0000","last_clean":"2024-04-25T10:05:50.753810+0000","last_became_active":"2024-04-25T10:05:49.285407+0000","last_became_peered":"2024-04-25T10:05:49.285407+0000","last_unstale":"2024-04-25T10:05:50.753810+0000","last_undegraded":"2024-04-25T10:05:50.753810+0000","last_fullsized":"2024-04-25T10:05:50.753810+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:01.390046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276566+0000","last_change":"2024-04-25T10:05:49.274531+0000","last_active":"2024-04-25T10:05:50.276566+0000","last_peered":"2024-04-25T10:05:50.276566+0000","last_clean":"2024-04-25T10:05:50.276566+0000","last_became_active":"2024-04-25T10:05:49.274222+0000","last_became_peered":"2024-04-25T10:05:49.274222+0000","last_unstale":"2024-04-25T10:05:50.276566+0000","last_undegraded":"2024-04-25T10:05:50.276566+0000","last_fullsized":"2024-04-25T10:05:50.276566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:02.799897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276392+0000","last_change":"2024-04-25T10:05:49.286601+0000","last_active":"2024-04-25T10:05:50.276392+0000","last_peered":"2024-04-25T10:05:50.276392+0000","last_clean":"2024-04-25T10:05:50.276392+0000","last_became_active":"2024-04-25T10:05:49.286299+0000","last_became_peered":"2024-04-25T10:05:49.286299+0000","last_unstale":"2024-04-25T10:05:50.276392+0000","last_undegraded":"2024-04-25T10:05:50.276392+0000","last_fullsized":"2024-04-25T10:05:50.276392+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:57.084402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752422+0000","last_change":"2024-04-25T10:05:49.290986+0000","last_active":"2024-04-25T10:05:50.752422+0000","last_peered":"2024-04-25T10:05:50.752422+0000","last_clean":"2024-04-25T10:05:50.752422+0000","last_became_active":"2024-04-25T10:05:49.290722+0000","last_became_peered":"2024-04-25T10:05:49.290722+0000","last_unstale":"2024-04-25T10:05:50.752422+0000","last_undegraded":"2024-04-25T10:05:50.752422+0000","last_fullsized":"2024-04-25T10:05:50.752422+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:59.740245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752349+0000","last_change":"2024-04-25T10:05:49.281828+0000","last_active":"2024-04-25T10:05:50.752349+0000","last_peered":"2024-04-25T10:05:50.752349+0000","last_clean":"2024-04-25T10:05:50.752349+0000","last_became_active":"2024-04-25T10:05:49.281534+0000","last_became_peered":"2024-04-25T10:05:49.281534+0000","last_unstale":"2024-04-25T10:05:50.752349+0000","last_undegraded":"2024-04-25T10:05:50.752349+0000","last_fullsized":"2024-04-25T10:05:50.752349+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:03:56.168674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753622+0000","last_change":"2024-04-25T10:05:49.280300+0000","last_active":"2024-04-25T10:05:50.753622+0000","last_peered":"2024-04-25T10:05:50.753622+0000","last_clean":"2024-04-25T10:05:50.753622+0000","last_became_active":"2024-04-25T10:05:49.280086+0000","last_became_peered":"2024-04-25T10:05:49.280086+0000","last_unstale":"2024-04-25T10:05:50.753622+0000","last_undegraded":"2024-04-25T10:05:50.753622+0000","last_fullsized":"2024-04-25T10:05:50.753622+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:09.855084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754070+0000","last_change":"2024-04-25T10:05:49.290270+0000","last_active":"2024-04-25T10:05:50.754070+0000","last_peered":"2024-04-25T10:05:50.754070+0000","last_clean":"2024-04-25T10:05:50.754070+0000","last_became_active":"2024-04-25T10:05:49.289680+0000","last_became_peered":"2024-04-25T10:05:49.289680+0000","last_unstale":"2024-04-25T10:05:50.754070+0000","last_undegraded":"2024-04-25T10:05:50.754070+0000","last_fullsized":"2024-04-25T10:05:50.754070+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:12:33.485998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752875+0000","last_change":"2024-04-25T10:05:49.280231+0000","last_active":"2024-04-25T10:05:50.752875+0000","last_peered":"2024-04-25T10:05:50.752875+0000","last_clean":"2024-04-25T10:05:50.752875+0000","last_became_active":"2024-04-25T10:05:49.279570+0000","last_became_peered":"2024-04-25T10:05:49.279570+0000","last_unstale":"2024-04-25T10:05:50.752875+0000","last_undegraded":"2024-04-25T10:05:50.752875+0000","last_fullsized":"2024-04-25T10:05:50.752875+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:50.752809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273943+0000","last_change":"2024-04-25T10:05:49.288396+0000","last_active":"2024-04-25T10:05:50.273943+0000","last_peered":"2024-04-25T10:05:50.273943+0000","last_clean":"2024-04-25T10:05:50.273943+0000","last_became_active":"2024-04-25T10:05:49.287993+0000","last_became_peered":"2024-04-25T10:05:49.287993+0000","last_unstale":"2024-04-25T10:05:50.273943+0000","last_undegraded":"2024-04-25T10:05:50.273943+0000","last_fullsized":"2024-04-25T10:05:50.273943+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276731+0000","last_change":"2024-04-25T10:05:49.274263+0000","last_active":"2024-04-25T10:05:50.276731+0000","last_peered":"2024-04-25T10:05:50.276731+0000","last_clean":"2024-04-25T10:05:50.276731+0000","last_became_active":"2024-04-25T10:05:49.273972+0000","last_became_peered":"2024-04-25T10:05:49.273972+0000","last_unstale":"2024-04-25T10:05:50.276731+0000","last_undegraded":"2024-04-25T10:05:50.276731+0000","last_fullsized":"2024-04-25T10:05:50.276731+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:44.878259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752992+0000","last_change":"2024-04-25T10:05:49.281466+0000","last_active":"2024-04-25T10:05:50.752992+0000","last_peered":"2024-04-25T10:05:50.752992+0000","last_clean":"2024-04-25T10:05:50.752992+0000","last_became_active":"2024-04-25T10:05:49.281165+0000","last_became_peered":"2024-04-25T10:05:49.281165+0000","last_unstale":"2024-04-25T10:05:50.752992+0000","last_undegraded":"2024-04-25T10:05:50.752992+0000","last_fullsized":"2024-04-25T10:05:50.752992+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:11.398600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754043+0000","last_change":"2024-04-25T10:05:49.290751+0000","last_active":"2024-04-25T10:05:50.754043+0000","last_peered":"2024-04-25T10:05:50.754043+0000","last_clean":"2024-04-25T10:05:50.754043+0000","last_became_active":"2024-04-25T10:05:49.290500+0000","last_became_peered":"2024-04-25T10:05:49.290500+0000","last_unstale":"2024-04-25T10:05:50.754043+0000","last_undegraded":"2024-04-25T10:05:50.754043+0000","last_fullsized":"2024-04-25T10:05:50.754043+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752900+0000","last_change":"2024-04-25T10:05:49.286018+0000","last_active":"2024-04-25T10:05:50.752900+0000","last_peered":"2024-04-25T10:05:50.752900+0000","last_clean":"2024-04-25T10:05:50.752900+0000","last_became_active":"2024-04-25T10:05:49.285531+0000","last_became_peered":"2024-04-25T10:05:49.285531+0000","last_unstale":"2024-04-25T10:05:50.752900+0000","last_undegraded":"2024-04-25T10:05:50.752900+0000","last_fullsized":"2024-04-25T10:05:50.752900+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:14.155973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742630+0000","last_change":"2024-04-25T10:05:49.283591+0000","last_active":"2024-04-25T10:05:50.742630+0000","last_peered":"2024-04-25T10:05:50.742630+0000","last_clean":"2024-04-25T10:05:50.742630+0000","last_became_active":"2024-04-25T10:05:49.283286+0000","last_became_peered":"2024-04-25T10:05:49.283286+0000","last_unstale":"2024-04-25T10:05:50.742630+0000","last_undegraded":"2024-04-25T10:05:50.742630+0000","last_fullsized":"2024-04-25T10:05:50.742630+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753550+0000","last_change":"2024-04-25T10:05:49.291101+0000","last_active":"2024-04-25T10:05:50.753550+0000","last_peered":"2024-04-25T10:05:50.753550+0000","last_clean":"2024-04-25T10:05:50.753550+0000","last_became_active":"2024-04-25T10:05:49.290798+0000","last_became_peered":"2024-04-25T10:05:49.290798+0000","last_unstale":"2024-04-25T10:05:50.753550+0000","last_undegraded":"2024-04-25T10:05:50.753550+0000","last_fullsized":"2024-04-25T10:05:50.753550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.973080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"52'4","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.277120+0000","last_change":"2024-04-25T10:05:48.269196+0000","last_active":"2024-04-25T10:05:50.277120+0000","last_peered":"2024-04-25T10:05:50.277120+0000","last_clean":"2024-04-25T10:05:50.277120+0000","last_became_active":"2024-04-25T10:05:48.268189+0000","last_became_peered":"2024-04-25T10:05:48.268189+0000","last_unstale":"2024-04-25T10:05:50.277120+0000","last_undegraded":"2024-04-25T10:05:50.277120+0000","last_fullsized":"2024-04-25T10:05:50.277120+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:46:58.587871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742664+0000","last_change":"2024-04-25T10:05:49.286470+0000","last_active":"2024-04-25T10:05:50.742664+0000","last_peered":"2024-04-25T10:05:50.742664+0000","last_clean":"2024-04-25T10:05:50.742664+0000","last_became_active":"2024-04-25T10:05:49.286193+0000","last_became_peered":"2024-04-25T10:05:49.286193+0000","last_unstale":"2024-04-25T10:05:50.742664+0000","last_undegraded":"2024-04-25T10:05:50.742664+0000","last_fullsized":"2024-04-25T10:05:50.742664+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:09:49.433530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273598+0000","last_change":"2024-04-25T10:05:48.275908+0000","last_active":"2024-04-25T10:05:50.273598+0000","last_peered":"2024-04-25T10:05:50.273598+0000","last_clean":"2024-04-25T10:05:50.273598+0000","last_became_active":"2024-04-25T10:05:48.274479+0000","last_became_peered":"2024-04-25T10:05:48.274479+0000","last_unstale":"2024-04-25T10:05:50.273598+0000","last_undegraded":"2024-04-25T10:05:50.273598+0000","last_fullsized":"2024-04-25T10:05:50.273598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:07.573333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276824+0000","last_change":"2024-04-25T10:05:49.282232+0000","last_active":"2024-04-25T10:05:50.276824+0000","last_peered":"2024-04-25T10:05:50.276824+0000","last_clean":"2024-04-25T10:05:50.276824+0000","last_became_active":"2024-04-25T10:05:49.281363+0000","last_became_peered":"2024-04-25T10:05:49.281363+0000","last_unstale":"2024-04-25T10:05:50.276824+0000","last_undegraded":"2024-04-25T10:05:50.276824+0000","last_fullsized":"2024-04-25T10:05:50.276824+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:58.050552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273866+0000","last_change":"2024-04-25T10:05:48.271308+0000","last_active":"2024-04-25T10:05:50.273866+0000","last_peered":"2024-04-25T10:05:50.273866+0000","last_clean":"2024-04-25T10:05:50.273866+0000","last_became_active":"2024-04-25T10:05:48.270922+0000","last_became_peered":"2024-04-25T10:05:48.270922+0000","last_unstale":"2024-04-25T10:05:50.273866+0000","last_undegraded":"2024-04-25T10:05:50.273866+0000","last_fullsized":"2024-04-25T10:05:50.273866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752734+0000","last_change":"2024-04-25T10:05:49.279560+0000","last_active":"2024-04-25T10:05:50.752734+0000","last_peered":"2024-04-25T10:05:50.752734+0000","last_clean":"2024-04-25T10:05:50.752734+0000","last_became_active":"2024-04-25T10:05:49.278516+0000","last_became_peered":"2024-04-25T10:05:49.278516+0000","last_unstale":"2024-04-25T10:05:50.752734+0000","last_undegraded":"2024-04-25T10:05:50.752734+0000","last_fullsized":"2024-04-25T10:05:50.752734+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:10.096617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742758+0000","last_change":"2024-04-25T10:05:48.275810+0000","last_active":"2024-04-25T10:05:50.742758+0000","last_peered":"2024-04-25T10:05:50.742758+0000","last_clean":"2024-04-25T10:05:50.742758+0000","last_became_active":"2024-04-25T10:05:48.275553+0000","last_became_peered":"2024-04-25T10:05:48.275553+0000","last_unstale":"2024-04-25T10:05:50.742758+0000","last_undegraded":"2024-04-25T10:05:50.742758+0000","last_fullsized":"2024-04-25T10:05:50.742758+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:01.796857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276177+0000","last_change":"2024-04-25T10:05:49.288477+0000","last_active":"2024-04-25T10:05:50.276177+0000","last_peered":"2024-04-25T10:05:50.276177+0000","last_clean":"2024-04-25T10:05:50.276177+0000","last_became_active":"2024-04-25T10:05:49.288203+0000","last_became_peered":"2024-04-25T10:05:49.288203+0000","last_unstale":"2024-04-25T10:05:50.276177+0000","last_undegraded":"2024-04-25T10:05:50.276177+0000","last_fullsized":"2024-04-25T10:05:50.276177+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:37:58.050552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753106+0000","last_change":"2024-04-25T10:05:48.276598+0000","last_active":"2024-04-25T10:05:50.753106+0000","last_peered":"2024-04-25T10:05:50.753106+0000","last_clean":"2024-04-25T10:05:50.753106+0000","last_became_active":"2024-04-25T10:05:48.276341+0000","last_became_peered":"2024-04-25T10:05:48.276341+0000","last_unstale":"2024-04-25T10:05:50.753106+0000","last_undegraded":"2024-04-25T10:05:50.753106+0000","last_fullsized":"2024-04-25T10:05:50.753106+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:01.796857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754010+0000","last_change":"2024-04-25T10:05:49.293927+0000","last_active":"2024-04-25T10:05:50.754010+0000","last_peered":"2024-04-25T10:05:50.754010+0000","last_clean":"2024-04-25T10:05:50.754010+0000","last_became_active":"2024-04-25T10:05:49.293642+0000","last_became_peered":"2024-04-25T10:05:49.293642+0000","last_unstale":"2024-04-25T10:05:50.754010+0000","last_undegraded":"2024-04-25T10:05:50.754010+0000","last_fullsized":"2024-04-25T10:05:50.754010+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.275634+0000","last_change":"2024-04-25T10:05:48.268595+0000","last_active":"2024-04-25T10:05:50.275634+0000","last_peered":"2024-04-25T10:05:50.275634+0000","last_clean":"2024-04-25T10:05:50.275634+0000","last_became_active":"2024-04-25T10:05:48.267579+0000","last_became_peered":"2024-04-25T10:05:48.267579+0000","last_unstale":"2024-04-25T10:05:50.275634+0000","last_undegraded":"2024-04-25T10:05:50.275634+0000","last_fullsized":"2024-04-25T10:05:50.275634+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:26.985701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753172+0000","last_change":"2024-04-25T10:05:49.280027+0000","last_active":"2024-04-25T10:05:50.753172+0000","last_peered":"2024-04-25T10:05:50.753172+0000","last_clean":"2024-04-25T10:05:50.753172+0000","last_became_active":"2024-04-25T10:05:49.279193+0000","last_became_peered":"2024-04-25T10:05:49.279193+0000","last_unstale":"2024-04-25T10:05:50.753172+0000","last_undegraded":"2024-04-25T10:05:50.753172+0000","last_fullsized":"2024-04-25T10:05:50.753172+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:45.408345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276453+0000","last_change":"2024-04-25T10:05:48.269624+0000","last_active":"2024-04-25T10:05:50.276453+0000","last_peered":"2024-04-25T10:05:50.276453+0000","last_clean":"2024-04-25T10:05:50.276453+0000","last_became_active":"2024-04-25T10:05:48.266543+0000","last_became_peered":"2024-04-25T10:05:48.266543+0000","last_unstale":"2024-04-25T10:05:50.276453+0000","last_undegraded":"2024-04-25T10:05:50.276453+0000","last_fullsized":"2024-04-25T10:05:50.276453+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:22.619671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753956+0000","last_change":"2024-04-25T10:05:49.299603+0000","last_active":"2024-04-25T10:05:50.753956+0000","last_peered":"2024-04-25T10:05:50.753956+0000","last_clean":"2024-04-25T10:05:50.753956+0000","last_became_active":"2024-04-25T10:05:49.299345+0000","last_became_peered":"2024-04-25T10:05:49.299345+0000","last_unstale":"2024-04-25T10:05:50.753956+0000","last_undegraded":"2024-04-25T10:05:50.753956+0000","last_fullsized":"2024-04-25T10:05:50.753956+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:26:25.184689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752986+0000","last_change":"2024-04-25T10:05:48.283483+0000","last_active":"2024-04-25T10:05:50.752986+0000","last_peered":"2024-04-25T10:05:50.752986+0000","last_clean":"2024-04-25T10:05:50.752986+0000","last_became_active":"2024-04-25T10:05:48.283232+0000","last_became_peered":"2024-04-25T10:05:48.283232+0000","last_unstale":"2024-04-25T10:05:50.752986+0000","last_undegraded":"2024-04-25T10:05:50.752986+0000","last_fullsized":"2024-04-25T10:05:50.752986+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276093+0000","last_change":"2024-04-25T10:05:49.279841+0000","last_active":"2024-04-25T10:05:50.276093+0000","last_peered":"2024-04-25T10:05:50.276093+0000","last_clean":"2024-04-25T10:05:50.276093+0000","last_became_active":"2024-04-25T10:05:49.279561+0000","last_became_peered":"2024-04-25T10:05:49.279561+0000","last_unstale":"2024-04-25T10:05:50.276093+0000","last_undegraded":"2024-04-25T10:05:50.276093+0000","last_fullsized":"2024-04-25T10:05:50.276093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.896204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753988+0000","last_change":"2024-04-25T10:05:48.274485+0000","last_active":"2024-04-25T10:05:50.753988+0000","last_peered":"2024-04-25T10:05:50.753988+0000","last_clean":"2024-04-25T10:05:50.753988+0000","last_became_active":"2024-04-25T10:05:48.274200+0000","last_became_peered":"2024-04-25T10:05:48.274200+0000","last_unstale":"2024-04-25T10:05:50.753988+0000","last_undegraded":"2024-04-25T10:05:50.753988+0000","last_fullsized":"2024-04-25T10:05:50.753988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742572+0000","last_change":"2024-04-25T10:05:49.276843+0000","last_active":"2024-04-25T10:05:50.742572+0000","last_peered":"2024-04-25T10:05:50.742572+0000","last_clean":"2024-04-25T10:05:50.742572+0000","last_became_active":"2024-04-25T10:05:49.276550+0000","last_became_peered":"2024-04-25T10:05:49.276550+0000","last_unstale":"2024-04-25T10:05:50.742572+0000","last_undegraded":"2024-04-25T10:05:50.742572+0000","last_fullsized":"2024-04-25T10:05:50.742572+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:20.264595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276191+0000","last_change":"2024-04-25T10:05:48.283403+0000","last_active":"2024-04-25T10:05:50.276191+0000","last_peered":"2024-04-25T10:05:50.276191+0000","last_clean":"2024-04-25T10:05:50.276191+0000","last_became_active":"2024-04-25T10:05:48.283065+0000","last_became_peered":"2024-04-25T10:05:48.283065+0000","last_unstale":"2024-04-25T10:05:50.276191+0000","last_undegraded":"2024-04-25T10:05:50.276191+0000","last_fullsized":"2024-04-25T10:05:50.276191+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:29.366370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753410+0000","last_change":"2024-04-25T10:05:49.289134+0000","last_active":"2024-04-25T10:05:50.753410+0000","last_peered":"2024-04-25T10:05:50.753410+0000","last_clean":"2024-04-25T10:05:50.753410+0000","last_became_active":"2024-04-25T10:05:49.288846+0000","last_became_peered":"2024-04-25T10:05:49.288846+0000","last_unstale":"2024-04-25T10:05:50.753410+0000","last_undegraded":"2024-04-25T10:05:50.753410+0000","last_fullsized":"2024-04-25T10:05:50.753410+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:34.488235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"52'3","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754037+0000","last_change":"2024-04-25T10:05:48.279091+0000","last_active":"2024-04-25T10:05:50.754037+0000","last_peered":"2024-04-25T10:05:50.754037+0000","last_clean":"2024-04-25T10:05:50.754037+0000","last_became_active":"2024-04-25T10:05:48.278825+0000","last_became_peered":"2024-04-25T10:05:48.278825+0000","last_unstale":"2024-04-25T10:05:50.754037+0000","last_undegraded":"2024-04-25T10:05:50.754037+0000","last_fullsized":"2024-04-25T10:05:50.754037+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:02.210078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.275930+0000","last_change":"2024-04-25T10:05:49.269968+0000","last_active":"2024-04-25T10:05:50.275930+0000","last_peered":"2024-04-25T10:05:50.275930+0000","last_clean":"2024-04-25T10:05:50.275930+0000","last_became_active":"2024-04-25T10:05:49.269614+0000","last_became_peered":"2024-04-25T10:05:49.269614+0000","last_unstale":"2024-04-25T10:05:50.275930+0000","last_undegraded":"2024-04-25T10:05:50.275930+0000","last_fullsized":"2024-04-25T10:05:50.275930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:44.878259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"52'6","reported_seq":20,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753403+0000","last_change":"2024-04-25T10:05:48.272940+0000","last_active":"2024-04-25T10:05:50.753403+0000","last_peered":"2024-04-25T10:05:50.753403+0000","last_clean":"2024-04-25T10:05:50.753403+0000","last_became_active":"2024-04-25T10:05:48.272660+0000","last_became_peered":"2024-04-25T10:05:48.272660+0000","last_unstale":"2024-04-25T10:05:50.753403+0000","last_undegraded":"2024-04-25T10:05:50.753403+0000","last_fullsized":"2024-04-25T10:05:50.753403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:23:56.495702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742624+0000","last_change":"2024-04-25T10:05:49.285809+0000","last_active":"2024-04-25T10:05:50.742624+0000","last_peered":"2024-04-25T10:05:50.742624+0000","last_clean":"2024-04-25T10:05:50.742624+0000","last_became_active":"2024-04-25T10:05:49.285550+0000","last_became_peered":"2024-04-25T10:05:49.285550+0000","last_unstale":"2024-04-25T10:05:50.742624+0000","last_undegraded":"2024-04-25T10:05:50.742624+0000","last_fullsized":"2024-04-25T10:05:50.742624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753204+0000","last_change":"2024-04-25T10:05:48.280067+0000","last_active":"2024-04-25T10:05:50.753204+0000","last_peered":"2024-04-25T10:05:50.753204+0000","last_clean":"2024-04-25T10:05:50.753204+0000","last_became_active":"2024-04-25T10:05:48.279765+0000","last_became_peered":"2024-04-25T10:05:48.279765+0000","last_unstale":"2024-04-25T10:05:50.753204+0000","last_undegraded":"2024-04-25T10:05:50.753204+0000","last_fullsized":"2024-04-25T10:05:50.753204+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:43.875220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753804+0000","last_change":"2024-04-25T10:05:49.286825+0000","last_active":"2024-04-25T10:05:50.753804+0000","last_peered":"2024-04-25T10:05:50.753804+0000","last_clean":"2024-04-25T10:05:50.753804+0000","last_became_active":"2024-04-25T10:05:49.277289+0000","last_became_peered":"2024-04-25T10:05:49.277289+0000","last_unstale":"2024-04-25T10:05:50.753804+0000","last_undegraded":"2024-04-25T10:05:50.753804+0000","last_fullsized":"2024-04-25T10:05:50.753804+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:06.112197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276920+0000","last_change":"2024-04-25T10:05:48.283276+0000","last_active":"2024-04-25T10:05:50.276920+0000","last_peered":"2024-04-25T10:05:50.276920+0000","last_clean":"2024-04-25T10:05:50.276920+0000","last_became_active":"2024-04-25T10:05:48.282966+0000","last_became_peered":"2024-04-25T10:05:48.282966+0000","last_unstale":"2024-04-25T10:05:50.276920+0000","last_undegraded":"2024-04-25T10:05:50.276920+0000","last_fullsized":"2024-04-25T10:05:50.276920+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:00.616733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753012+0000","last_change":"2024-04-25T10:05:49.279816+0000","last_active":"2024-04-25T10:05:50.753012+0000","last_peered":"2024-04-25T10:05:50.753012+0000","last_clean":"2024-04-25T10:05:50.753012+0000","last_became_active":"2024-04-25T10:05:49.278817+0000","last_became_peered":"2024-04-25T10:05:49.278817+0000","last_unstale":"2024-04-25T10:05:50.753012+0000","last_undegraded":"2024-04-25T10:05:50.753012+0000","last_fullsized":"2024-04-25T10:05:50.753012+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:19.953916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753666+0000","last_change":"2024-04-25T10:05:48.274031+0000","last_active":"2024-04-25T10:05:50.753666+0000","last_peered":"2024-04-25T10:05:50.753666+0000","last_clean":"2024-04-25T10:05:50.753666+0000","last_became_active":"2024-04-25T10:05:48.273773+0000","last_became_peered":"2024-04-25T10:05:48.273773+0000","last_unstale":"2024-04-25T10:05:50.753666+0000","last_undegraded":"2024-04-25T10:05:50.753666+0000","last_fullsized":"2024-04-25T10:05:50.753666+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:29.366370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753930+0000","last_change":"2024-04-25T10:05:49.292075+0000","last_active":"2024-04-25T10:05:50.753930+0000","last_peered":"2024-04-25T10:05:50.753930+0000","last_clean":"2024-04-25T10:05:50.753930+0000","last_became_active":"2024-04-25T10:05:49.290568+0000","last_became_peered":"2024-04-25T10:05:49.290568+0000","last_unstale":"2024-04-25T10:05:50.753930+0000","last_undegraded":"2024-04-25T10:05:50.753930+0000","last_fullsized":"2024-04-25T10:05:50.753930+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:14.833904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"52'8","reported_seq":22,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752608+0000","last_change":"2024-04-25T10:05:48.265471+0000","last_active":"2024-04-25T10:05:50.752608+0000","last_peered":"2024-04-25T10:05:50.752608+0000","last_clean":"2024-04-25T10:05:50.752608+0000","last_became_active":"2024-04-25T10:05:48.265206+0000","last_became_peered":"2024-04-25T10:05:48.265206+0000","last_unstale":"2024-04-25T10:05:50.752608+0000","last_undegraded":"2024-04-25T10:05:50.752608+0000","last_fullsized":"2024-04-25T10:05:50.752608+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:25.065657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752783+0000","last_change":"2024-04-25T10:05:49.287611+0000","last_active":"2024-04-25T10:05:50.752783+0000","last_peered":"2024-04-25T10:05:50.752783+0000","last_clean":"2024-04-25T10:05:50.752783+0000","last_became_active":"2024-04-25T10:05:49.287212+0000","last_became_peered":"2024-04-25T10:05:49.287212+0000","last_unstale":"2024-04-25T10:05:50.752783+0000","last_undegraded":"2024-04-25T10:05:50.752783+0000","last_fullsized":"2024-04-25T10:05:50.752783+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:09.073227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754064+0000","last_change":"2024-04-25T10:05:48.282046+0000","last_active":"2024-04-25T10:05:50.754064+0000","last_peered":"2024-04-25T10:05:50.754064+0000","last_clean":"2024-04-25T10:05:50.754064+0000","last_became_active":"2024-04-25T10:05:48.279856+0000","last_became_peered":"2024-04-25T10:05:48.279856+0000","last_unstale":"2024-04-25T10:05:50.754064+0000","last_undegraded":"2024-04-25T10:05:50.754064+0000","last_fullsized":"2024-04-25T10:05:50.754064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:36.907141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273399+0000","last_change":"2024-04-25T10:05:49.288251+0000","last_active":"2024-04-25T10:05:50.273399+0000","last_peered":"2024-04-25T10:05:50.273399+0000","last_clean":"2024-04-25T10:05:50.273399+0000","last_became_active":"2024-04-25T10:05:49.287944+0000","last_became_peered":"2024-04-25T10:05:49.287944+0000","last_unstale":"2024-04-25T10:05:50.273399+0000","last_undegraded":"2024-04-25T10:05:50.273399+0000","last_fullsized":"2024-04-25T10:05:50.273399+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:05.168013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753178+0000","last_change":"2024-04-25T10:05:48.270200+0000","last_active":"2024-04-25T10:05:50.753178+0000","last_peered":"2024-04-25T10:05:50.753178+0000","last_clean":"2024-04-25T10:05:50.753178+0000","last_became_active":"2024-04-25T10:05:48.269876+0000","last_became_peered":"2024-04-25T10:05:48.269876+0000","last_unstale":"2024-04-25T10:05:50.753178+0000","last_undegraded":"2024-04-25T10:05:50.753178+0000","last_fullsized":"2024-04-25T10:05:50.753178+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:19.393383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.275901+0000","last_change":"2024-04-25T10:05:49.297068+0000","last_active":"2024-04-25T10:05:50.275901+0000","last_peered":"2024-04-25T10:05:50.275901+0000","last_clean":"2024-04-25T10:05:50.275901+0000","last_became_active":"2024-04-25T10:05:49.296774+0000","last_became_peered":"2024-04-25T10:05:49.296774+0000","last_unstale":"2024-04-25T10:05:50.275901+0000","last_undegraded":"2024-04-25T10:05:50.275901+0000","last_fullsized":"2024-04-25T10:05:50.275901+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:35.212916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276917+0000","last_change":"2024-04-25T10:05:48.271962+0000","last_active":"2024-04-25T10:05:50.276917+0000","last_peered":"2024-04-25T10:05:50.276917+0000","last_clean":"2024-04-25T10:05:50.276917+0000","last_became_active":"2024-04-25T10:05:48.271483+0000","last_became_peered":"2024-04-25T10:05:48.271483+0000","last_unstale":"2024-04-25T10:05:50.276917+0000","last_undegraded":"2024-04-25T10:05:50.276917+0000","last_fullsized":"2024-04-25T10:05:50.276917+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:07.298325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273599+0000","last_change":"2024-04-25T10:05:49.273945+0000","last_active":"2024-04-25T10:05:50.273599+0000","last_peered":"2024-04-25T10:05:50.273599+0000","last_clean":"2024-04-25T10:05:50.273599+0000","last_became_active":"2024-04-25T10:05:49.273627+0000","last_became_peered":"2024-04-25T10:05:49.273627+0000","last_unstale":"2024-04-25T10:05:50.273599+0000","last_undegraded":"2024-04-25T10:05:50.273599+0000","last_fullsized":"2024-04-25T10:05:50.273599+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:06.775556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276673+0000","last_change":"2024-04-25T10:05:48.267427+0000","last_active":"2024-04-25T10:05:50.276673+0000","last_peered":"2024-04-25T10:05:50.276673+0000","last_clean":"2024-04-25T10:05:50.276673+0000","last_became_active":"2024-04-25T10:05:48.267151+0000","last_became_peered":"2024-04-25T10:05:48.267151+0000","last_unstale":"2024-04-25T10:05:50.276673+0000","last_undegraded":"2024-04-25T10:05:50.276673+0000","last_fullsized":"2024-04-25T10:05:50.276673+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:19.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742710+0000","last_change":"2024-04-25T10:05:49.277489+0000","last_active":"2024-04-25T10:05:50.742710+0000","last_peered":"2024-04-25T10:05:50.742710+0000","last_clean":"2024-04-25T10:05:50.742710+0000","last_became_active":"2024-04-25T10:05:49.277231+0000","last_became_peered":"2024-04-25T10:05:49.277231+0000","last_unstale":"2024-04-25T10:05:50.742710+0000","last_undegraded":"2024-04-25T10:05:50.742710+0000","last_fullsized":"2024-04-25T10:05:50.742710+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:57.828443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273648+0000","last_change":"2024-04-25T10:05:48.270641+0000","last_active":"2024-04-25T10:05:50.273648+0000","last_peered":"2024-04-25T10:05:50.273648+0000","last_clean":"2024-04-25T10:05:50.273648+0000","last_became_active":"2024-04-25T10:05:48.270317+0000","last_became_peered":"2024-04-25T10:05:48.270317+0000","last_unstale":"2024-04-25T10:05:50.273648+0000","last_undegraded":"2024-04-25T10:05:50.273648+0000","last_fullsized":"2024-04-25T10:05:50.273648+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276816+0000","last_change":"2024-04-25T10:05:49.278569+0000","last_active":"2024-04-25T10:05:50.276816+0000","last_peered":"2024-04-25T10:05:50.276816+0000","last_clean":"2024-04-25T10:05:50.276816+0000","last_became_active":"2024-04-25T10:05:49.278261+0000","last_became_peered":"2024-04-25T10:05:49.278261+0000","last_unstale":"2024-04-25T10:05:50.276816+0000","last_undegraded":"2024-04-25T10:05:50.276816+0000","last_fullsized":"2024-04-25T10:05:50.276816+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:06.896204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752480+0000","last_change":"2024-04-25T10:05:48.269712+0000","last_active":"2024-04-25T10:05:50.752480+0000","last_peered":"2024-04-25T10:05:50.752480+0000","last_clean":"2024-04-25T10:05:50.752480+0000","last_became_active":"2024-04-25T10:05:48.269322+0000","last_became_peered":"2024-04-25T10:05:48.269322+0000","last_unstale":"2024-04-25T10:05:50.752480+0000","last_undegraded":"2024-04-25T10:05:50.752480+0000","last_fullsized":"2024-04-25T10:05:50.752480+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:36:04.949669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754039+0000","last_change":"2024-04-25T10:05:49.287123+0000","last_active":"2024-04-25T10:05:50.754039+0000","last_peered":"2024-04-25T10:05:50.754039+0000","last_clean":"2024-04-25T10:05:50.754039+0000","last_became_active":"2024-04-25T10:05:49.286843+0000","last_became_peered":"2024-04-25T10:05:49.286843+0000","last_unstale":"2024-04-25T10:05:50.754039+0000","last_undegraded":"2024-04-25T10:05:50.754039+0000","last_fullsized":"2024-04-25T10:05:50.754039+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:26:22.087955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752866+0000","last_change":"2024-04-25T10:05:48.281874+0000","last_active":"2024-04-25T10:05:50.752866+0000","last_peered":"2024-04-25T10:05:50.752866+0000","last_clean":"2024-04-25T10:05:50.752866+0000","last_became_active":"2024-04-25T10:05:48.281609+0000","last_became_peered":"2024-04-25T10:05:48.281609+0000","last_unstale":"2024-04-25T10:05:50.752866+0000","last_undegraded":"2024-04-25T10:05:50.752866+0000","last_fullsized":"2024-04-25T10:05:50.752866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:56.081362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273809+0000","last_change":"2024-04-25T10:05:49.283100+0000","last_active":"2024-04-25T10:05:50.273809+0000","last_peered":"2024-04-25T10:05:50.273809+0000","last_clean":"2024-04-25T10:05:50.273809+0000","last_became_active":"2024-04-25T10:05:49.282848+0000","last_became_peered":"2024-04-25T10:05:49.282848+0000","last_unstale":"2024-04-25T10:05:50.273809+0000","last_undegraded":"2024-04-25T10:05:50.273809+0000","last_fullsized":"2024-04-25T10:05:50.273809+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752169+0000","last_change":"2024-04-25T10:05:48.272439+0000","last_active":"2024-04-25T10:05:50.752169+0000","last_peered":"2024-04-25T10:05:50.752169+0000","last_clean":"2024-04-25T10:05:50.752169+0000","last_became_active":"2024-04-25T10:05:48.272138+0000","last_became_peered":"2024-04-25T10:05:48.272138+0000","last_unstale":"2024-04-25T10:05:50.752169+0000","last_undegraded":"2024-04-25T10:05:50.752169+0000","last_fullsized":"2024-04-25T10:05:50.752169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:37.575727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742885+0000","last_change":"2024-04-25T10:05:49.283010+0000","last_active":"2024-04-25T10:05:50.742885+0000","last_peered":"2024-04-25T10:05:50.742885+0000","last_clean":"2024-04-25T10:05:50.742885+0000","last_became_active":"2024-04-25T10:05:49.281445+0000","last_became_peered":"2024-04-25T10:05:49.281445+0000","last_unstale":"2024-04-25T10:05:50.742885+0000","last_undegraded":"2024-04-25T10:05:50.742885+0000","last_fullsized":"2024-04-25T10:05:50.742885+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:50.788753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"52'2","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.277080+0000","last_change":"2024-04-25T10:05:48.283226+0000","last_active":"2024-04-25T10:05:50.277080+0000","last_peered":"2024-04-25T10:05:50.277080+0000","last_clean":"2024-04-25T10:05:50.277080+0000","last_became_active":"2024-04-25T10:05:48.282936+0000","last_became_peered":"2024-04-25T10:05:48.282936+0000","last_unstale":"2024-04-25T10:05:50.277080+0000","last_undegraded":"2024-04-25T10:05:50.277080+0000","last_fullsized":"2024-04-25T10:05:50.277080+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:18.317820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.273466+0000","last_change":"2024-04-25T10:05:49.267528+0000","last_active":"2024-04-25T10:05:50.273466+0000","last_peered":"2024-04-25T10:05:50.273466+0000","last_clean":"2024-04-25T10:05:50.273466+0000","last_became_active":"2024-04-25T10:05:49.267253+0000","last_became_peered":"2024-04-25T10:05:49.267253+0000","last_unstale":"2024-04-25T10:05:50.273466+0000","last_undegraded":"2024-04-25T10:05:50.273466+0000","last_fullsized":"2024-04-25T10:05:50.273466+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.973080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.754138+0000","last_change":"2024-04-25T10:05:48.281960+0000","last_active":"2024-04-25T10:05:50.754138+0000","last_peered":"2024-04-25T10:05:50.754138+0000","last_clean":"2024-04-25T10:05:50.754138+0000","last_became_active":"2024-04-25T10:05:48.281643+0000","last_became_peered":"2024-04-25T10:05:48.281643+0000","last_unstale":"2024-04-25T10:05:50.754138+0000","last_undegraded":"2024-04-25T10:05:50.754138+0000","last_fullsized":"2024-04-25T10:05:50.754138+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:38.776052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753397+0000","last_change":"2024-04-25T10:05:49.278775+0000","last_active":"2024-04-25T10:05:50.753397+0000","last_peered":"2024-04-25T10:05:50.753397+0000","last_clean":"2024-04-25T10:05:50.753397+0000","last_became_active":"2024-04-25T10:05:49.278156+0000","last_became_peered":"2024-04-25T10:05:49.278156+0000","last_unstale":"2024-04-25T10:05:50.753397+0000","last_undegraded":"2024-04-25T10:05:50.753397+0000","last_fullsized":"2024-04-25T10:05:50.753397+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:58.539784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753377+0000","last_change":"2024-04-25T10:05:48.284598+0000","last_active":"2024-04-25T10:05:50.753377+0000","last_peered":"2024-04-25T10:05:50.753377+0000","last_clean":"2024-04-25T10:05:50.753377+0000","last_became_active":"2024-04-25T10:05:48.284293+0000","last_became_peered":"2024-04-25T10:05:48.284293+0000","last_unstale":"2024-04-25T10:05:50.753377+0000","last_undegraded":"2024-04-25T10:05:50.753377+0000","last_fullsized":"2024-04-25T10:05:50.753377+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:55.962777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753276+0000","last_change":"2024-04-25T10:05:49.279763+0000","last_active":"2024-04-25T10:05:50.753276+0000","last_peered":"2024-04-25T10:05:50.753276+0000","last_clean":"2024-04-25T10:05:50.753276+0000","last_became_active":"2024-04-25T10:05:49.279445+0000","last_became_peered":"2024-04-25T10:05:49.279445+0000","last_unstale":"2024-04-25T10:05:50.753276+0000","last_undegraded":"2024-04-25T10:05:50.753276+0000","last_fullsized":"2024-04-25T10:05:50.753276+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:58.135720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753442+0000","last_change":"2024-04-25T10:05:48.268661+0000","last_active":"2024-04-25T10:05:50.753442+0000","last_peered":"2024-04-25T10:05:50.753442+0000","last_clean":"2024-04-25T10:05:50.753442+0000","last_became_active":"2024-04-25T10:05:48.268385+0000","last_became_peered":"2024-04-25T10:05:48.268385+0000","last_unstale":"2024-04-25T10:05:50.753442+0000","last_undegraded":"2024-04-25T10:05:50.753442+0000","last_fullsized":"2024-04-25T10:05:50.753442+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:25.882935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742624+0000","last_change":"2024-04-25T10:05:49.280429+0000","last_active":"2024-04-25T10:05:50.742624+0000","last_peered":"2024-04-25T10:05:50.742624+0000","last_clean":"2024-04-25T10:05:50.742624+0000","last_became_active":"2024-04-25T10:05:49.280171+0000","last_became_peered":"2024-04-25T10:05:49.280171+0000","last_unstale":"2024-04-25T10:05:50.742624+0000","last_undegraded":"2024-04-25T10:05:50.742624+0000","last_fullsized":"2024-04-25T10:05:50.742624+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:51:07.580723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.752574+0000","last_change":"2024-04-25T10:05:48.275050+0000","last_active":"2024-04-25T10:05:50.752574+0000","last_peered":"2024-04-25T10:05:50.752574+0000","last_clean":"2024-04-25T10:05:50.752574+0000","last_became_active":"2024-04-25T10:05:48.274788+0000","last_became_peered":"2024-04-25T10:05:48.274788+0000","last_unstale":"2024-04-25T10:05:50.752574+0000","last_undegraded":"2024-04-25T10:05:50.752574+0000","last_fullsized":"2024-04-25T10:05:50.752574+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:10.415099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753846+0000","last_change":"2024-04-25T10:05:49.281926+0000","last_active":"2024-04-25T10:05:50.753846+0000","last_peered":"2024-04-25T10:05:50.753846+0000","last_clean":"2024-04-25T10:05:50.753846+0000","last_became_active":"2024-04-25T10:05:49.281693+0000","last_became_peered":"2024-04-25T10:05:49.281693+0000","last_unstale":"2024-04-25T10:05:50.753846+0000","last_undegraded":"2024-04-25T10:05:50.753846+0000","last_fullsized":"2024-04-25T10:05:50.753846+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:25.453805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.275630+0000","last_change":"2024-04-25T10:05:48.276064+0000","last_active":"2024-04-25T10:05:50.275630+0000","last_peered":"2024-04-25T10:05:50.275630+0000","last_clean":"2024-04-25T10:05:50.275630+0000","last_became_active":"2024-04-25T10:05:48.275744+0000","last_became_peered":"2024-04-25T10:05:48.275744+0000","last_unstale":"2024-04-25T10:05:50.275630+0000","last_undegraded":"2024-04-25T10:05:50.275630+0000","last_fullsized":"2024-04-25T10:05:50.275630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:24:58.960414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753468+0000","last_change":"2024-04-25T10:05:49.297061+0000","last_active":"2024-04-25T10:05:50.753468+0000","last_peered":"2024-04-25T10:05:50.753468+0000","last_clean":"2024-04-25T10:05:50.753468+0000","last_became_active":"2024-04-25T10:05:49.294500+0000","last_became_peered":"2024-04-25T10:05:49.294500+0000","last_unstale":"2024-04-25T10:05:50.753468+0000","last_undegraded":"2024-04-25T10:05:50.753468+0000","last_fullsized":"2024-04-25T10:05:50.753468+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.086551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.742981+0000","last_change":"2024-04-25T10:05:48.277544+0000","last_active":"2024-04-25T10:05:50.742981+0000","last_peered":"2024-04-25T10:05:50.742981+0000","last_clean":"2024-04-25T10:05:50.742981+0000","last_became_active":"2024-04-25T10:05:48.277305+0000","last_became_peered":"2024-04-25T10:05:48.277305+0000","last_unstale":"2024-04-25T10:05:50.742981+0000","last_undegraded":"2024-04-25T10:05:50.742981+0000","last_fullsized":"2024-04-25T10:05:50.742981+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:55.962777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.276473+0000","last_change":"2024-04-25T10:05:49.271195+0000","last_active":"2024-04-25T10:05:50.276473+0000","last_peered":"2024-04-25T10:05:50.276473+0000","last_clean":"2024-04-25T10:05:50.276473+0000","last_became_active":"2024-04-25T10:05:49.270927+0000","last_became_peered":"2024-04-25T10:05:49.270927+0000","last_unstale":"2024-04-25T10:05:50.276473+0000","last_undegraded":"2024-04-25T10:05:50.276473+0000","last_fullsized":"2024-04-25T10:05:50.276473+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:48.244110+0000","last_clean_scrub_stamp":"2024-04-25T10:05:48.244110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:00:56.965817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753974+0000","last_change":"2024-04-25T10:05:48.280958+0000","last_active":"2024-04-25T10:05:50.753974+0000","last_peered":"2024-04-25T10:05:50.753974+0000","last_clean":"2024-04-25T10:05:50.753974+0000","last_became_active":"2024-04-25T10:05:48.280282+0000","last_became_peered":"2024-04-25T10:05:48.280282+0000","last_unstale":"2024-04-25T10:05:50.753974+0000","last_undegraded":"2024-04-25T10:05:50.753974+0000","last_fullsized":"2024-04-25T10:05:50.753974+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:05:47.241071+0000","last_clean_scrub_stamp":"2024-04-25T10:05:47.241071+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:05.893165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":228,"reported_epoch":53,"state":"active+clean","last_fresh":"2024-04-25T10:05:50.753534+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:05:50.753534+0000","last_peered":"2024-04-25T10:05:50.753534+0000","last_clean":"2024-04-25T10:05:50.753534+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:05:50.753534+0000","last_undegraded":"2024-04-25T10:05:50.753534+0000","last_fullsized":"2024-04-25T10:05:50.753534+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509470,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":868473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509471,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":630784,"data_stored":278633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":622592,"data_stored":277981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509468,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":278563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":624,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":638976,"data_stored":279615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":279593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":278141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542173,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1224704,"data_stored":868405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:05:58.317 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:05:58.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:05:58.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.488+0000 7f6f07400640 1 Processor -- start 2024-04-25T10:05:58.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.488+0000 7f6f07400640 1 -- start start 2024-04-25T10:05:58.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f07400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6f0015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f07400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0015bc40 con 0x7f6f0015ee60 2024-04-25T10:05:58.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f07400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f0015b3a0 con 0x7f6f00144120 2024-04-25T10:05:58.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f07400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015e490 con 0x7f6f0015acd0 2024-04-25T10:05:58.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f05400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6f0015ee60 0x7f6f000b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47694/0 (socket says 172.21.15.18:47694) 2024-04-25T10:05:58.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f05400640 1 -- 172.21.15.18:0/2896844655 learned_addr learned my addr 172.21.15.18:0/2896844655 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:05:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6effe00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6f0015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375470873 0 0) 0x7f6f0015bc40 con 0x7f6f0015ee60 2024-04-25T10:05:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ee8005740 con 0x7f6f0015ee60 2024-04-25T10:05:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648468901 0 0) 0x7f6f0015b3a0 con 0x7f6f00144120 2024-04-25T10:05:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0015bc40 con 0x7f6f00144120 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 63432206 0 0) 0x7f6ee8005740 con 0x7f6f0015ee60 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 msgr2=0x7f6f0015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6f0015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 >> v1:172.21.15.167:6789/0 conn(0x7f6f00144120 legacy=0x7f6f000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0015b680 con 0x7f6f0015ee60 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6ef8001980 con 0x7f6f0015ee60 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 >> v1:172.21.15.18:6789/0 conn(0x7f6f0015ee60 legacy=0x7f6f000b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8005d90 0x7f6ee8006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6ee8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8006f60 0x7f6ee80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0015e490 con 0x7f6ee8005d90 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee800dd70 con 0x7f6ee8006f60 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee800df40 con 0x7f6f0015acd0 2024-04-25T10:05:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8005d90 0x7f6ee8006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f05400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8006f60 0x7f6ee80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6effe00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6ee8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 -- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 msgr2=0x7f6ee8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6ee8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 -- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8006f60 msgr2=0x7f6ee80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8006f60 0x7f6ee80073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6f04a00640 1 -- 172.21.15.18:0/2896844655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8005740 con 0x7f6ee8005d90 2024-04-25T10:05:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.492+0000 7f6effe00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f0015acd0 0x7f6ee8006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f04a00640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8005d90 0x7f6ee8006190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4001900 tx=0x7f6ef401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f07cae635155e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4001520 con 0x7f6ee8005d90 2024-04-25T10:05:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef40052f0 con 0x7f6ee8005d90 2024-04-25T10:05:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6eff400640 1 -- 172.21.15.18:0/2896844655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4003840 con 0x7f6ee8005d90 2024-04-25T10:05:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 -- 172.21.15.18:0/2896844655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8005d90 msgr2=0x7f6ee8006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 --2- 172.21.15.18:0/2896844655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee8005d90 0x7f6ee8006190 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f6ef4001900 tx=0x7f6ef401c580 comp rx=0 tx=0).stop 2024-04-25T10:05:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f05400640 1 -- 172.21.15.18:0/2896844655 reap_dead start 2024-04-25T10:05:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 -- 172.21.15.18:0/2896844655 shutdown_connections 2024-04-25T10:05:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 -- 172.21.15.18:0/2896844655 >> 172.21.15.18:0/2896844655 conn(0x7f6f00067080 msgr2=0x7f6f0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 -- 172.21.15.18:0/2896844655 shutdown_connections 2024-04-25T10:05:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.496+0000 7f6f07400640 1 -- 172.21.15.18:0/2896844655 wait complete. 2024-04-25T10:05:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 Processor -- start 2024-04-25T10:05:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- start start 2024-04-25T10:05:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 0x7f6f000b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 0x7f6f00142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006dc60 con 0x7f6f000afe00 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006dae0 con 0x7f6ee8005d90 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0006dde0 con 0x7f6f000add40 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42128/0 (socket says 172.21.15.18:42128) 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 -- 172.21.15.18:0/1290632556 learned_addr learned my addr 172.21.15.18:0/1290632556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f04a00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 0x7f6f000b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f05400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 0x7f6f00142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 -- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 msgr2=0x7f6f00142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 0x7f6f00142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 -- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 msgr2=0x7f6f000b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 0x7f6f000b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 -- 172.21.15.18:0/1290632556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f000b0f00 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f05400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 0x7f6f00142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f04a00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 0x7f6f000b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6effe00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0116a0 tx=0x7f6eec011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec004220 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec0043c0 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00f9e0 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f000af320 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f000af8e0 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.500+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f000745d0 con 0x7f6f000afe00 2024-04-25T10:05:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.504+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6eec00fb80 con 0x7f6f000afe00 2024-04-25T10:05:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.504+0000 7f6efcc00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 0x7f6ee0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.504+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6eec085940 con 0x7f6f000afe00 2024-04-25T10:05:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.504+0000 7f6f04a00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 0x7f6ee0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.504+0000 7f6f04a00640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 0x7f6ee0069420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40ac000 tx=0x7f6ef40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.508+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6eec019030 con 0x7f6f000afe00 2024-04-25T10:05:58.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.728+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6f0015d9c0 con 0x7f6f000afe00 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6efcc00640 1 -- 172.21.15.18:0/1290632556 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6eec0567b0 con 0x7f6f000afe00 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:05:58.742 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:05:58.743 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:05:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 msgr2=0x7f6ee0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 0x7f6ee0069420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40ac000 tx=0x7f6ef40a6000 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 msgr2=0x7f6f00159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0116a0 tx=0x7f6eec011b60 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 shutdown_connections 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ee0066f60 0x7f6ee0069420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f000add40 0x7f6f00142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f000afe00 0x7f6f00159e10 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 --2- 172.21.15.18:0/1290632556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ee8005d90 0x7f6f000b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 >> 172.21.15.18:0/1290632556 conn(0x7f6f00067080 msgr2=0x7f6f000b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 shutdown_connections 2024-04-25T10:05:58.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.732+0000 7f6f07400640 1 -- 172.21.15.18:0/1290632556 wait complete. 2024-04-25T10:05:58.764 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:05:58.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.892+0000 7f35ea000640 1 Processor -- start 2024-04-25T10:05:58.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.892+0000 7f35ea000640 1 -- start start 2024-04-25T10:05:58.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35ea000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35e4099a60 0x7f35e415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35ea000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35e409a600 0x7f35e40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35ea000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e415c310 con 0x7f35e40cf370 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35ea000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e40d0410 con 0x7f35e409a600 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35ea000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e40cf800 con 0x7f35e4099a60 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35e409a600 0x7f35e40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35e409a600 0x7f35e40cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42136/0 (socket says 172.21.15.18:42136) 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 -- 172.21.15.18:0/1304860957 learned_addr learned my addr 172.21.15.18:0/1304860957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3400640 1 --2- 172.21.15.18:0/1304860957 >> v2:172.21.15.167:3300/0 conn(0x7f35e4099a60 0x7f35e415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 -- 172.21.15.18:0/1304860957 >> v2:172.21.15.167:3300/0 conn(0x7f35e4099a60 msgr2=0x7f35e415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1304860957 >> v2:172.21.15.167:3300/0 conn(0x7f35e4099a60 0x7f35e415bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 -- 172.21.15.18:0/1304860957 >> v1:172.21.15.167:6789/0 conn(0x7f35e40cf370 legacy=0x7f35e4099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:58.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 -- 172.21.15.18:0/1304860957 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40cfae0 con 0x7f35e409a600 2024-04-25T10:05:58.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.896+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1304860957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e409a600 0x7f35e40cc2b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f35e4072740 tx=0x7f35dc01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7723390f769eade server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35e2a00640 1 -- 172.21.15.18:0/1304860957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0a5550 con 0x7f35e409a600 2024-04-25T10:05:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35e2a00640 1 -- 172.21.15.18:0/1304860957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0a56f0 con 0x7f35e409a600 2024-04-25T10:05:58.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35e2a00640 1 -- 172.21.15.18:0/1304860957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0a5ac0 con 0x7f35e409a600 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- 172.21.15.18:0/1304860957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e409a600 msgr2=0x7f35e40cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- 172.21.15.18:0/1304860957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e409a600 0x7f35e40cc2b0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f35e4072740 tx=0x7f35dc01c710 comp rx=0 tx=0).stop 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- 172.21.15.18:0/1304860957 shutdown_connections 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- 172.21.15.18:0/1304860957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e409a600 0x7f35e40cc2b0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- 172.21.15.18:0/1304860957 >> v2:172.21.15.167:3300/0 conn(0x7f35e4099a60 0x7f35e415bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- 172.21.15.18:0/1304860957 >> 172.21.15.18:0/1304860957 conn(0x7f35e40d17a0 msgr2=0x7f35e40d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- 172.21.15.18:0/1304860957 shutdown_connections 2024-04-25T10:05:58.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- 172.21.15.18:0/1304860957 wait complete. 2024-04-25T10:05:58.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 Processor -- start 2024-04-25T10:05:58.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- start start 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e4099a60 0x7f35e4150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e409a600 0x7f35e4150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40cd390 con 0x7f35e40ae540 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40cd210 con 0x7f35e409a600 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.900+0000 7f35ea000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40cd510 con 0x7f35e4099a60 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42138/0 (socket says 172.21.15.18:42138) 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 -- 172.21.15.18:0/2695585665 learned_addr learned my addr 172.21.15.18:0/2695585665 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3400640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e4099a60 0x7f35e4150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35dbe00640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e409a600 0x7f35e4150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 -- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e4099a60 msgr2=0x7f35e4150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e4099a60 0x7f35e4150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 -- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e409a600 msgr2=0x7f35e4150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e409a600 0x7f35e4150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 -- 172.21.15.18:0/2695585665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e40cb140 con 0x7f35e40ae540 2024-04-25T10:05:58.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35e3e00640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af040 tx=0x7f35dc0194b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0bc020 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0b8690 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e40cb420 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc009510 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e40c8cf0 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e40745d0 con 0x7f35e40ae540 2024-04-25T10:05:58.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35dc0bf020 con 0x7f35e40ae540 2024-04-25T10:05:58.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:58.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.904+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f35dc11fff0 con 0x7f35e40ae540 2024-04-25T10:05:58.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.908+0000 7f35e3400640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:58.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.908+0000 7f35e3400640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 0x7f35c0069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f35e415b2c0 tx=0x7f35d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:58.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:58.908+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35dc0c6030 con 0x7f35e40ae540 2024-04-25T10:05:59.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.104+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35e40cc5a0 con 0x7f35e40ae540 2024-04-25T10:05:59.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.104+0000 7f35db400640 1 -- 172.21.15.18:0/2695585665 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f35e415c310 con 0x7f35e40ae540 2024-04-25T10:05:59.118 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:05:59.118 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 msgr2=0x7f35c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 0x7f35c0069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f35e415b2c0 tx=0x7f35d4008040 comp rx=0 tx=0).stop 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 msgr2=0x7f35e40c9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af040 tx=0x7f35dc0194b0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 shutdown_connections 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35e40ae540 0x7f35e40c9210 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35e409a600 0x7f35e4150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c0066f60 0x7f35c0069420 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 --2- 172.21.15.18:0/2695585665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35e4099a60 0x7f35e4150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 >> 172.21.15.18:0/2695585665 conn(0x7f35e40d17a0 msgr2=0x7f35e41549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 shutdown_connections 2024-04-25T10:05:59.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.108+0000 7f35ea000640 1 -- 172.21.15.18:0/2695585665 wait complete. 2024-04-25T10:05:59.541 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:05:48.647555+0000', 'modified': '2024-04-25T10:05:51.669546+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35177}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35177': {'gid': 35177, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6836/322178907', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 322178907}, {'type': 'v1', 'addr': '172.21.15.167:6836', 'nonce': 322178907}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:05:59.541 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:05:59.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:05:59.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.672+0000 7f086d600640 1 Processor -- start 2024-04-25T10:05:59.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.672+0000 7f086d600640 1 -- start start 2024-04-25T10:05:59.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f086d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f086815acd0 0x7f086815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f086d600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f086815ee60 0x7f08680b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f086d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086815bc40 con 0x7f0868144120 2024-04-25T10:05:59.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f086d600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086815e490 con 0x7f086815ee60 2024-04-25T10:05:59.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f086d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086815b150 con 0x7f086815acd0 2024-04-25T10:05:59.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f086815ee60 0x7f08680b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f086815ee60 0x7f08680b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:33330/0 (socket says 172.21.15.18:33330) 2024-04-25T10:05:59.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 -- 172.21.15.18:0/1962580169 learned_addr learned my addr 172.21.15.18:0/1962580169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f085fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f086815acd0 0x7f086815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 -- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f086815acd0 msgr2=0x7f086815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 --2- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f086815acd0 0x7f086815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 -- 172.21.15.18:0/1962580169 >> v1:172.21.15.167:6789/0 conn(0x7f0868144120 legacy=0x7f08680ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.676+0000 7f0867400640 1 -- 172.21.15.18:0/1962580169 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086815b3a0 con 0x7f086815ee60 2024-04-25T10:05:59.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f0867400640 1 --2- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815ee60 0x7f08680b3090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086001c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e86914f0741adf8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f0866000640 1 -- 172.21.15.18:0/1962580169 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5660 con 0x7f086815ee60 2024-04-25T10:05:59.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f0866000640 1 -- 172.21.15.18:0/1962580169 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600a5800 con 0x7f086815ee60 2024-04-25T10:05:59.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f0866000640 1 -- 172.21.15.18:0/1962580169 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5bd0 con 0x7f086815ee60 2024-04-25T10:05:59.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815ee60 msgr2=0x7f08680b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 --2- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815ee60 0x7f08680b3090 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0860009e50 tx=0x7f086001c9a0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- 172.21.15.18:0/1962580169 shutdown_connections 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 --2- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815ee60 0x7f08680b3090 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 --2- 172.21.15.18:0/1962580169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f086815acd0 0x7f086815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- 172.21.15.18:0/1962580169 >> 172.21.15.18:0/1962580169 conn(0x7f0868067080 msgr2=0x7f086806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- 172.21.15.18:0/1962580169 shutdown_connections 2024-04-25T10:05:59.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- 172.21.15.18:0/1962580169 wait complete. 2024-04-25T10:05:59.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 Processor -- start 2024-04-25T10:05:59.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.680+0000 7f086d600640 1 -- start start 2024-04-25T10:05:59.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0868144120 0x7f08680ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815acd0 0x7f086813f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681677d0 con 0x7f086815ee60 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868167650 con 0x7f086815acd0 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0868167950 con 0x7f0868144120 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42140/0 (socket says 172.21.15.18:42140) 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 -- 172.21.15.18:0/3573438127 learned_addr learned my addr 172.21.15.18:0/3573438127 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0866a00640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0868144120 0x7f08680ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f085fe00640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815acd0 0x7f086813f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 -- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0868144120 msgr2=0x7f08680ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0868144120 0x7f08680ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 -- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815acd0 msgr2=0x7f086813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815acd0 0x7f086813f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 -- 172.21.15.18:0/3573438127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086806b150 con 0x7f086815ee60 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f0867400640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08600af040 tx=0x7f0860019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f085ea00640 1 -- 172.21.15.18:0/3573438127 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860009510 con 0x7f086815ee60 2024-04-25T10:05:59.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f085ea00640 1 -- 172.21.15.18:0/3573438127 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600be070 con 0x7f086815ee60 2024-04-25T10:05:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086815f630 con 0x7f086815ee60 2024-04-25T10:05:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f085ea00640 1 -- 172.21.15.18:0/3573438127 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600b88d0 con 0x7f086815ee60 2024-04-25T10:05:59.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.684+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086815fbf0 con 0x7f086815ee60 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f085ea00640 1 -- 172.21.15.18:0/3573438127 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08600b8a70 con 0x7f086815ee60 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f085ea00640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 0x7f0844069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f085ea00640 1 -- 172.21.15.18:0/3573438127 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0860120430 con 0x7f086815ee60 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 Processor -- start 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0866a00640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 0x7f0844069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 -- start start 2024-04-25T10:05:59.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0866a00640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 0x7f0844069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0858001810 tx=0x7f0858009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea7bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea319f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e9195f0 con 0x557c8ea31f30 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e880da0 con 0x557c8ea7c240 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c8e809150 con 0x557c8ea7b920 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42144/0 (socket says 172.21.15.18:42144) 2024-04-25T10:05:59.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 -- 172.21.15.18:0/4074486218 learned_addr learned my addr 172.21.15.18:0/4074486218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0866a00640 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea7bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f085fe00640 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 -- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 msgr2=0x557c8ea7bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea7bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 -- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 msgr2=0x557c8ea319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea319f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.688+0000 7f0867400640 1 -- 172.21.15.18:0/4074486218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8e822ca0 con 0x557c8ea31f30 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0867400640 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f086001cf10 tx=0x7f08600b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1bc33032ebb2dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0857400640 1 -- 172.21.15.18:0/4074486218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600f4c70 con 0x557c8ea31f30 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0857400640 1 -- 172.21.15.18:0/4074486218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600f1e50 con 0x557c8ea31f30 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0857400640 1 -- 172.21.15.18:0/4074486218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600f92c0 con 0x557c8ea31f30 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- 172.21.15.18:0/4074486218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 msgr2=0x557c8ea32310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f086001cf10 tx=0x7f08600b8000 comp rx=0 tx=0).stop 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- 172.21.15.18:0/4074486218 shutdown_connections 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea32310 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea319f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- 172.21.15.18:0/4074486218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea7bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- 172.21.15.18:0/4074486218 >> 172.21.15.18:0/4074486218 conn(0x557c8ea382a0 msgr2=0x557c8ea302d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- 172.21.15.18:0/4074486218 shutdown_connections 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- 172.21.15.18:0/4074486218 wait complete. 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- start start 2024-04-25T10:05:59.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 Processor -- start 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea82c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea35aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e83b990 con 0x557c8ea7b920 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e87ce40 con 0x557c8ea7c240 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c8e80c900 con 0x557c8ea31f30 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0870ab9000 10 client.0 _ll_register_callbacks cb 0x557c8e9341c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42146/0 (socket says 172.21.15.18:42146) 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 -- 172.21.15.18:0/423124205 learned_addr learned my addr 172.21.15.18:0/423124205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0866a00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea82c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f0867400640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea35aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 -- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 msgr2=0x557c8ea82c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea82c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 -- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 msgr2=0x557c8ea35aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea35aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.692+0000 7f085fe00640 1 -- 172.21.15.18:0/423124205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c8e839630 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f085fe00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08500149d0 tx=0x7f0850014e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d971362749734d73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850022060 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0850012b80 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08600f1e50 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0850028050 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 10 client.5889 fetch_fsmap learned FSMap version 26 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x557c8e8093a0 con 0x557c8ea7b920 2024-04-25T10:05:59.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600f1e50 con 0x557c8ea7b920 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f085002b020 con 0x557c8ea7b920 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 10 client.5889 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 10 client.5889 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 20 client.5889 populate_metadata read hostname 'smithi018' 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea364b0 0x557c8ea36890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 4 client.5889 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c8e81ca50 con 0x557c8ea364b0 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0866a00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea364b0 0x557c8ea36890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0866a00640 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea364b0 0x557c8ea36890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a3a5bb6b1ceed85 server_cookie=5881b339f435de26 in_seq=0 out_seq=0 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 10 client.5889 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 1 -- 172.21.15.18:0/423124205 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557c8e81ca50 con 0x557c8ea364b0 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 10 client.5889 handle_command_reply: tid=0 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 client.5889 shutdown 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 msgr2=0x557c8ea831c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08500149d0 tx=0x7f0850014e90 comp rx=0 tx=0).stop 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 shutdown_connections 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea364b0 0x557c8ea36890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea35aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea831c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f084be00640 0 client.5889 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 --2- 172.21.15.18:0/423124205 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea82c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 >> 172.21.15.18:0/423124205 conn(0x557c8ea382a0 msgr2=0x557c8ea309e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 shutdown_connections 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 1 -- 172.21.15.18:0/423124205 wait complete. 2024-04-25T10:05:59.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.696+0000 7f0870ab9000 20 client.5889 trim_cache size 0 max 16384 2024-04-25T10:05:59.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.712+0000 7f0870ab9000 1 Processor -- start 2024-04-25T10:05:59.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.712+0000 7f0870ab9000 1 -- start start 2024-04-25T10:05:59.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea79ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08682029e0 con 0x557c8ea7b920 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086815caa0 con 0x557c8ea7c240 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086815d0a0 con 0x557c8ea31f30 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42162/0 (socket says 172.21.15.18:42162) 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 -- 172.21.15.18:0/3680594473 learned_addr learned my addr 172.21.15.18:0/3680594473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 -- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 msgr2=0x557c8ea79ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea79ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 -- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 msgr2=0x557c8ea85830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 -- 172.21.15.18:0/3680594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c8ea7c070 con 0x557c8ea7b920 2024-04-25T10:05:59.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f085fe00640 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c10 tx=0x7f0850017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a6f68af270334b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0856a00640 1 -- 172.21.15.18:0/3680594473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850012700 con 0x557c8ea7b920 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0856a00640 1 -- 172.21.15.18:0/3680594473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850014110 con 0x557c8ea7b920 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0856a00640 1 -- 172.21.15.18:0/3680594473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850005ba0 con 0x557c8ea7b920 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- 172.21.15.18:0/3680594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 msgr2=0x557c8ea7a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0850000c10 tx=0x7f0850017000 comp rx=0 tx=0).stop 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- 172.21.15.18:0/3680594473 shutdown_connections 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea85830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea7b920 0x557c8ea7a220 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- 172.21.15.18:0/3680594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea31f30 0x557c8ea79ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- 172.21.15.18:0/3680594473 >> 172.21.15.18:0/3680594473 conn(0x557c8ea382a0 msgr2=0x557c8ea35220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- 172.21.15.18:0/3680594473 shutdown_connections 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- 172.21.15.18:0/3680594473 wait complete. 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 -- start start 2024-04-25T10:05:59.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 Processor -- start 2024-04-25T10:05:59.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.716+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea97330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea97870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e8853d0 con 0x557c8ea31f30 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c8e93cd50 con 0x557c8ea7c240 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c8e81b980 con 0x557c8ea7b920 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 10 client.0 _ll_register_callbacks cb 0x7f08600092e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42172/0 (socket says 172.21.15.18:42172) 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 -- 172.21.15.18:0/2853501079 learned_addr learned my addr 172.21.15.18:0/2853501079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0867400640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea97870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f085fe00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea97330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 -- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 msgr2=0x557c8ea97330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea97330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 -- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 msgr2=0x557c8ea97870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea97870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 -- 172.21.15.18:0/2853501079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c8e902600 con 0x557c8ea31f30 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0866a00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f085800f5a0 tx=0x7f0858007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacfef9de7bbea7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0858015cf0 con 0x557c8ea31f30 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0858010040 con 0x557c8ea31f30 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0850014110 con 0x557c8ea31f30 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0858036050 con 0x557c8ea31f30 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 10 client.5895 fetch_fsmap learned FSMap version 26 2024-04-25T10:05:59.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x557c8e8159b0 con 0x557c8ea31f30 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0850014110 con 0x557c8ea31f30 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0858039020 con 0x557c8ea31f30 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 10 client.5895 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 10 client.5895 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 20 client.5895 populate_metadata read hostname 'smithi018' 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea97db0 0x557c8eadc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 4 client.5895 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557c8e88e2e0 con 0x557c8ea97db0 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f085fe00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea97db0 0x557c8eadc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f085fe00640 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea97db0 0x557c8eadc2e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3945b80b3b8f038 server_cookie=4d21853972de44d6 in_seq=0 out_seq=0 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 10 client.5895 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 1 -- 172.21.15.18:0/2853501079 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557c8e88e2e0 con 0x557c8ea97db0 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 10 client.5895 handle_command_reply: tid=0 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 client.5895 shutdown 2024-04-25T10:05:59.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 msgr2=0x557c8ea888c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f085800f5a0 tx=0x7f0858007e60 comp rx=0 tx=0).stop 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 shutdown_connections 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x557c8ea97db0 0x557c8eadc2e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557c8ea7c240 0x557c8ea97870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557c8ea7b920 0x557c8ea97330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 --2- 172.21.15.18:0/2853501079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c8ea31f30 0x557c8ea888c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f084be00640 0 client.5895 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 >> 172.21.15.18:0/2853501079 conn(0x557c8ea382a0 msgr2=0x557c8ea78cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 shutdown_connections 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 1 -- 172.21.15.18:0/2853501079 wait complete. 2024-04-25T10:05:59.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.720+0000 7f0870ab9000 20 client.5895 trim_cache size 0 max 16384 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 35177, 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 10.472269774000001, 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 26, 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 53, 2024-04-25T10:05:59.737 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 53, 2024-04-25T10:05:59.738 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 15.327293081000001 2024-04-25T10:05:59.738 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 msgr2=0x7f0844069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 0x7f0844069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0858001810 tx=0x7f0858009040 comp rx=0 tx=0).stop 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 msgr2=0x7f08680ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f08600af040 tx=0x7f0860019740 comp rx=0 tx=0).stop 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 shutdown_connections 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f086815ee60 0x7f08680ad920 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f086815acd0 0x7f086813f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0844066f60 0x7f0844069420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 --2- 172.21.15.18:0/3573438127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0868144120 0x7f08680ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 >> 172.21.15.18:0/3573438127 conn(0x7f0868067080 msgr2=0x7f08680b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 shutdown_connections 2024-04-25T10:05:59.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.724+0000 7f086d600640 1 -- 172.21.15.18:0/3573438127 wait complete. 2024-04-25T10:05:59.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:05:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 Processor -- start 2024-04-25T10:05:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 -- start start 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c144140 0x7f950c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f950c0ced60 0x7f950c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f950c06e900 0x7f950c15e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c06ed70 con 0x7f950c06e900 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950c15ac60 con 0x7f950c0ced60 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9512a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c0cf3e0 con 0x7f950c144140 2024-04-25T10:05:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f950c06e900 0x7f950c15e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f950c06e900 0x7f950c15e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42176/0 (socket says 172.21.15.18:42176) 2024-04-25T10:05:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 -- 172.21.15.18:0/3958193503 learned_addr learned my addr 172.21.15.18:0/3958193503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f950be00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c144140 0x7f950c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9503e00640 1 --2- 172.21.15.18:0/3958193503 >> v2:172.21.15.167:3300/0 conn(0x7f950c0ced60 0x7f950c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 -- 172.21.15.18:0/3958193503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c144140 msgr2=0x7f950c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c144140 0x7f950c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 -- 172.21.15.18:0/3958193503 >> v2:172.21.15.167:3300/0 conn(0x7f950c0ced60 msgr2=0x7f950c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:05:59.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 --2- 172.21.15.18:0/3958193503 >> v2:172.21.15.167:3300/0 conn(0x7f950c0ced60 0x7f950c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.884+0000 7f9510a00640 1 -- 172.21.15.18:0/3958193503 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c15af20 con 0x7f950c06e900 2024-04-25T10:05:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9510a00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c06e900 0x7f950c15e250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f950c06f6d0 tx=0x7f950401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a290a87f0770b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f950b400640 1 -- 172.21.15.18:0/3958193503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040ac070 con 0x7f950c06e900 2024-04-25T10:05:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f950b400640 1 -- 172.21.15.18:0/3958193503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95040a8420 con 0x7f950c06e900 2024-04-25T10:05:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f950b400640 1 -- 172.21.15.18:0/3958193503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040a87f0 con 0x7f950c06e900 2024-04-25T10:05:59.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 -- 172.21.15.18:0/3958193503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c06e900 msgr2=0x7f950c15e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c06e900 0x7f950c15e250 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f950c06f6d0 tx=0x7f950401c730 comp rx=0 tx=0).stop 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 -- 172.21.15.18:0/3958193503 shutdown_connections 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c06e900 0x7f950c15e250 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 --2- 172.21.15.18:0/3958193503 >> v2:172.21.15.167:3300/0 conn(0x7f950c0ced60 0x7f950c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 --2- 172.21.15.18:0/3958193503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c144140 0x7f950c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 -- 172.21.15.18:0/3958193503 >> 172.21.15.18:0/3958193503 conn(0x7f950c066fa0 msgr2=0x7f950c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:05:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 -- 172.21.15.18:0/3958193503 shutdown_connections 2024-04-25T10:05:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.888+0000 7f9512a00640 1 -- 172.21.15.18:0/3958193503 wait complete. 2024-04-25T10:05:59.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 Processor -- start 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- start start 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c06e900 0x7f950c13ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f950c144140 0x7f950c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15ba00 con 0x7f950c0ced60 2024-04-25T10:05:59.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950c144520 con 0x7f950c144140 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950c15bb80 con 0x7f950c06e900 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42178/0 (socket says 172.21.15.18:42178) 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 -- 172.21.15.18:0/1788732927 learned_addr learned my addr 172.21.15.18:0/1788732927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f950be00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c06e900 0x7f950c13ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9510a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f950c144140 0x7f950c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 -- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c06e900 msgr2=0x7f950c13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c06e900 0x7f950c13ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 -- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f950c144140 msgr2=0x7f950c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f950c144140 0x7f950c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 -- 172.21.15.18:0/1788732927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c157070 con 0x7f950c0ced60 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9503e00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f94f400d830 tx=0x7f94f400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400b6c0 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4019070 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f400ba60 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950c157350 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.892+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c157910 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950c0745d0 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94f401e460 con 0x7f950c0ced60 2024-04-25T10:05:59.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f9508c00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 0x7f94e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:05:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f94f4085800 con 0x7f950c0ced60 2024-04-25T10:05:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f950be00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 0x7f94e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:05:59.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.896+0000 7f950be00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 0x7f94e8069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f950c0b29c0 tx=0x7f94fc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:05:59.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:05:59.900+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94f4055f90 con 0x7f950c0ced60 2024-04-25T10:06:00.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.136+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f950c154e90 con 0x7f950c0ced60 2024-04-25T10:06:00.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.136+0000 7f9508c00640 1 -- 172.21.15.18:0/1788732927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94f405a030 con 0x7f950c0ced60 2024-04-25T10:06:00.147 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:06:00.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 msgr2=0x7f94e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 0x7f94e8069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f950c0b29c0 tx=0x7f94fc009190 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 msgr2=0x7f950c1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f94f400d830 tx=0x7f94f400dcf0 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 shutdown_connections 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f950c144140 0x7f950c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f950c0ced60 0x7f950c1432b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f94e8066f60 0x7f94e8069420 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 --2- 172.21.15.18:0/1788732927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f950c06e900 0x7f950c13ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 >> 172.21.15.18:0/1788732927 conn(0x7f950c066fa0 msgr2=0x7f950c152140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 shutdown_connections 2024-04-25T10:06:00.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:00.140+0000 7f9512a00640 1 -- 172.21.15.18:0/1788732927 wait complete. 2024-04-25T10:06:00.169 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:06:00.169 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:06:00.169 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:06:00.169 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:06:00.169 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:06:00.170 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:06:00.170 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:06:00.170 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:06:00.170 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:06:00.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.170 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:06:00.179 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42344sec preferred_lft 42344sec 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:06:00.180 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:06:00.181 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.182 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:06:00.182 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:06:00.182 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:06:00.182 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:06:00.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.183 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:06:00.242 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:06:00.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.244 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:06:00.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:06:00.299 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:06:00.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.394 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:06:00.403 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:06:00.403 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:06:00.404 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:06:00.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:06:00.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:06:00.472 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:06:00.524 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:06:00.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:06:00.525 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:06:00.576 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:06:00.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:06:00.666 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:06:00.666 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:06:00.679 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:06:00.679 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:06:00.679 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:06:00.680 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:06:00.680 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:06:00.683 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:06:00.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:06:00.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.704 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:06:00.768 INFO:teuthology.orchestra.run.smithi018.stdout:client5698 2024-04-25T10:06:00.769 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:00.769 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:00.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.825 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T10:06:00.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:00.889 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T10:06:00.944 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:06:00.944 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:06:00.945 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:06:00.945 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:06:00.945 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T10:06:00.945 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:06:01.054 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:06:01.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:06:01.064 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:01.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.232+0000 7fb935c00640 1 Processor -- start 2024-04-25T10:06:01.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.232+0000 7fb935c00640 1 -- start start 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb935c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb9300b3950 0x7fb93006b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb935c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93015def0 con 0x7fb9300b2dc0 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb935c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93015e1b0 con 0x7fb93015b2f0 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb935c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93015e490 con 0x7fb9300b3950 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb927e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb9300b2dc0 0x7fb93006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47706/0 (socket says 172.21.15.18:47706) 2024-04-25T10:06:01.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb927e00640 1 -- 172.21.15.18:0/4269003766 learned_addr learned my addr 172.21.15.18:0/4269003766 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92f400640 1 --2- 172.21.15.18:0/4269003766 >> v2:172.21.15.167:3300/0 conn(0x7fb9300b3950 0x7fb93006b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389511678 0 0) 0x7fb93015def0 con 0x7fb9300b2dc0 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb914003530 con 0x7fb9300b2dc0 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124382477 0 0) 0x7fb914003530 con 0x7fb9300b2dc0 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 >> v2:172.21.15.167:3300/0 conn(0x7fb9300b3950 msgr2=0x7fb93006b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 --2- 172.21.15.18:0/4269003766 >> v2:172.21.15.167:3300/0 conn(0x7fb9300b3950 0x7fb93006b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 >> v1:172.21.15.167:6789/0 conn(0x7fb93015b2f0 legacy=0x7fb9300b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93015e770 con 0x7fb9300b2dc0 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fb918001680 con 0x7fb9300b2dc0 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92f400640 1 --2- 172.21.15.18:0/4269003766 >> v2:172.21.15.167:3300/0 conn(0x7fb9300b3950 0x7fb93006b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 >> v1:172.21.15.18:6789/0 conn(0x7fb9300b2dc0 legacy=0x7fb93006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 0x7fb914003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb914004810 0x7fb914004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140051d0 0x7fb91400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93015e490 con 0x7fb9140039c0 2024-04-25T10:06:01.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91400c070 con 0x7fb9140051d0 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91400c270 con 0x7fb914004810 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 0x7fb914003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb927e00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb914004810 0x7fb914004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92f400640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140051d0 0x7fb91400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 -- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb914004810 msgr2=0x7fb914004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb914004810 0x7fb914004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 -- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140051d0 msgr2=0x7fb91400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140051d0 0x7fb91400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92f400640 1 -- 172.21.15.18:0/4269003766 reap_dead start 2024-04-25T10:06:01.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.236+0000 7fb92ea00640 1 -- 172.21.15.18:0/4269003766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914003530 con 0x7fb9140039c0 2024-04-25T10:06:01.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb92ea00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 0x7fb914003de0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb920001780 tx=0x7fb92001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca1c2b6ed6849b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9200013a0 con 0x7fb9140039c0 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9200052f0 con 0x7fb9140039c0 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb92e000640 1 -- 172.21.15.18:0/4269003766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb920003840 con 0x7fb9140039c0 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 -- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 msgr2=0x7fb914003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 0x7fb914003de0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb920001780 tx=0x7fb92001c390 comp rx=0 tx=0).stop 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 -- 172.21.15.18:0/4269003766 shutdown_connections 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 --2- 172.21.15.18:0/4269003766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9140039c0 0x7fb914003de0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 -- 172.21.15.18:0/4269003766 >> 172.21.15.18:0/4269003766 conn(0x7fb9300b23b0 msgr2=0x7fb9300cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 -- 172.21.15.18:0/4269003766 shutdown_connections 2024-04-25T10:06:01.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.240+0000 7fb935c00640 1 -- 172.21.15.18:0/4269003766 wait complete. 2024-04-25T10:06:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 Processor -- start 2024-04-25T10:06:01.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- start start 2024-04-25T10:06:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140039c0 0x7fb9300cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 0x7fb930157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9301614e0 con 0x7fb9300ce070 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93015b8e0 con 0x7fb9140039c0 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb930161660 con 0x7fb9300cdbf0 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42196/0 (socket says 172.21.15.18:42196) 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 -- 172.21.15.18:0/3755050587 learned_addr learned my addr 172.21.15.18:0/3755050587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb927e00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 0x7fb930157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92ea00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140039c0 0x7fb9300cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 -- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 msgr2=0x7fb930157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 0x7fb930157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 -- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140039c0 msgr2=0x7fb9300cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140039c0 0x7fb9300cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 -- 172.21.15.18:0/3755050587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9300cd720 con 0x7fb9300ce070 2024-04-25T10:06:01.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb927e00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 0x7fb930157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb92f400640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b4ee0 tx=0x7fb928009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9280039a0 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928003b40 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928004020 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93015a390 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9300cc9e0 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.244+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9300745d0 con 0x7fb9300ce070 2024-04-25T10:06:01.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.248+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb9280041c0 con 0x7fb9300ce070 2024-04-25T10:06:01.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.248+0000 7fb926a00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.248+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb928085ec0 con 0x7fb9300ce070 2024-04-25T10:06:01.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.248+0000 7fb92ea00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.248+0000 7fb92ea00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 0x7fb90c069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb920001750 tx=0x7fb9200011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.252+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb928019030 con 0x7fb9300ce070 2024-04-25T10:06:01.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb93015def0 con 0x7fb9300ce070 2024-04-25T10:06:01.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb926a00640 1 -- 172.21.15.18:0/3755050587 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fb928010040 con 0x7fb9300ce070 2024-04-25T10:06:01.461 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:01.462 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:01.462 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 msgr2=0x7fb90c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 0x7fb90c069420 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb920001750 tx=0x7fb9200011a0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 msgr2=0x7fb930157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb9300b4ee0 tx=0x7fb928009f90 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 shutdown_connections 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9300ce070 0x7fb930157ab0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb90c066f60 0x7fb90c069420 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9300cdbf0 0x7fb930157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 --2- 172.21.15.18:0/3755050587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9140039c0 0x7fb9300cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 >> 172.21.15.18:0/3755050587 conn(0x7fb9300b23b0 msgr2=0x7fb9300b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 shutdown_connections 2024-04-25T10:06:01.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.452+0000 7fb935c00640 1 -- 172.21.15.18:0/3755050587 wait complete. 2024-04-25T10:06:01.484 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T10:06:01.653 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:06:01.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:06:01.654 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T10:06:01.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.688+0000 7f5114014080 1 Processor -- start 2024-04-25T10:06:01.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.688+0000 7f5114014080 1 -- start start 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f46490 0x55fd90f428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 0x55fd90f42e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd90e329f0 con 0x55fd90f43d40 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd90e36950 con 0x55fd90f46490 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd90f44870 con 0x55fd90f64890 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48246/0 (socket says 172.21.15.18:48246) 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 -- 172.21.15.18:0/79889748 learned_addr learned my addr 172.21.15.18:0/79889748 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f510be00640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f46490 0x55fd90f428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111c00640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 0x55fd90f42e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 -- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 msgr2=0x55fd90f42e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 0x55fd90f42e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 -- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f46490 msgr2=0x55fd90f428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f46490 0x55fd90f428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 -- 172.21.15.18:0/79889748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd90eb75a0 con 0x55fd90f43d40 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111c00640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 0x55fd90f42e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f510400b2d0 tx=0x7f510400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6450d6885d62874 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f510aa00640 1 -- 172.21.15.18:0/79889748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400a040 con 0x55fd90f43d40 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f510aa00640 1 -- 172.21.15.18:0/79889748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400f620 con 0x55fd90f43d40 2024-04-25T10:06:01.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f510aa00640 1 -- 172.21.15.18:0/79889748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510400f9f0 con 0x55fd90f43d40 2024-04-25T10:06:01.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- 172.21.15.18:0/79889748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 msgr2=0x55fd90eb6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f510400b2d0 tx=0x7f510400b790 comp rx=0 tx=0).stop 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- 172.21.15.18:0/79889748 shutdown_connections 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f64890 0x55fd90f42e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f46490 0x55fd90f428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- 172.21.15.18:0/79889748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90eb6c70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- 172.21.15.18:0/79889748 >> 172.21.15.18:0/79889748 conn(0x55fd90e8c400 msgr2=0x55fd90e8d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- 172.21.15.18:0/79889748 shutdown_connections 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- 172.21.15.18:0/79889748 wait complete. 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 Processor -- start 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- start start 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90f6a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f46490 0x55fd90f5b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f64890 0x55fd90f5f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd90eb7ae0 con 0x55fd90f43d40 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd90eb7840 con 0x55fd90f64890 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5114014080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fd90eb71b0 con 0x55fd90f46490 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.692+0000 7f5111200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90f6a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90f6a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48260/0 (socket says 172.21.15.18:48260) 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 -- 172.21.15.18:0/1891445730 learned_addr learned my addr 172.21.15.18:0/1891445730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111c00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f64890 0x55fd90f5f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f510be00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f46490 0x55fd90f5b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 -- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f46490 msgr2=0x55fd90f5b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55fd90f46490 0x55fd90f5b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 -- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f64890 msgr2=0x55fd90f5f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd90f64890 0x55fd90f5f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 -- 172.21.15.18:0/1891445730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd90f69840 con 0x55fd90f43d40 2024-04-25T10:06:01.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5111200640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90f6a760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f510400e620 tx=0x7f5104000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 -- 172.21.15.18:0/1891445730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5104020070 con 0x55fd90f43d40 2024-04-25T10:06:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 -- 172.21.15.18:0/1891445730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510400ec10 con 0x55fd90f43d40 2024-04-25T10:06:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 -- 172.21.15.18:0/1891445730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f510401c440 con 0x55fd90f43d40 2024-04-25T10:06:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fd90f69ae0 con 0x55fd90f43d40 2024-04-25T10:06:01.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fd90f6a020 con 0x55fd90f43d40 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 -- 172.21.15.18:0/1891445730 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5104023070 con 0x55fd90f43d40 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f50f0065940 0x7f50f0067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.696+0000 7f5109600640 1 -- 172.21.15.18:0/1891445730 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5104085aa0 con 0x55fd90f43d40 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55fd90f6b6d0 0x55fd90ffc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53) v9 -- 0x55fd90ffcc00 con 0x55fd90f6b6d0 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f510be00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f50f0065940 0x7f50f0067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5111c00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55fd90f6b6d0 0x55fd90ffc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5111c00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55fd90f6b6d0 0x55fd90ffc6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f510be00640 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f50f0065940 0x7f50f0067e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ac000 tx=0x7f50fc0a5000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5111c00640 1 -- 172.21.15.18:0/1891445730 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f510c004550 con 0x55fd90f6b6d0 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55fd90f6b6d0 msgr2=0x55fd90ffc6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55fd90f6b6d0 0x55fd90ffc6c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f50f0065940 msgr2=0x7f50f0067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f50f0065940 0x7f50f0067e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0ac000 tx=0x7f50fc0a5000 comp rx=0 tx=0).stop 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 msgr2=0x55fd90f6a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 --2- 172.21.15.18:0/1891445730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd90f43d40 0x55fd90f6a760 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f510400e620 tx=0x7f5104000bd0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5111c00640 1 -- 172.21.15.18:0/1891445730 reap_dead start 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 shutdown_connections 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 >> 172.21.15.18:0/1891445730 conn(0x55fd90e8c400 msgr2=0x55fd90e8d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 shutdown_connections 2024-04-25T10:06:01.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.700+0000 7f5114014080 1 -- 172.21.15.18:0/1891445730 wait complete. 2024-04-25T10:06:01.714 INFO:teuthology.orchestra.run.smithi018.stdout:Yalphaparent_a 2024-04-25T10:06:01.715 DEBUG:teuthology.orchestra.run.smithi018:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "ancestors": [ 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1099511627776, 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "alpha", 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 2 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1, 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "parent_a", 2024-04-25T10:06:01.808 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 4 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 8, 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout: "old_pools": [] 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:01.809 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:01.812 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T10:06:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 Processor -- start 2024-04-25T10:06:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 -- start start 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c41bc3b0 0x55b7c41b7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc790 0x55b7c41129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c41be190 con 0x55b7c4117a00 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c408d9f0 con 0x55b7c41bc790 2024-04-25T10:06:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7c41be310 con 0x55b7c41bc3b0 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e0000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48282/0 (socket says 172.21.15.18:48282) 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e0000640 1 -- 172.21.15.18:0/3780165832 learned_addr learned my addr 172.21.15.18:0/3780165832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12e0a00640 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc790 0x55b7c41129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.888+0000 7f12df600640 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c41bc3b0 0x55b7c41b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c41bc3b0 msgr2=0x55b7c41b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c41bc3b0 0x55b7c41b7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc790 msgr2=0x55b7c41129b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc790 0x55b7c41129b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/3780165832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c40e67d0 con 0x55b7c4117a00 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f12d000a750 tx=0x7f12d000ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed2caf406cb9283 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12de200640 1 -- 172.21.15.18:0/3780165832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000ae60 con 0x55b7c4117a00 2024-04-25T10:06:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12de200640 1 -- 172.21.15.18:0/3780165832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d0008c00 con 0x55b7c4117a00 2024-04-25T10:06:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12de200640 1 -- 172.21.15.18:0/3780165832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d00133f0 con 0x55b7c4117a00 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- 172.21.15.18:0/3780165832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 msgr2=0x55b7c41b6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f12d000a750 tx=0x7f12d000ac10 comp rx=0 tx=0).stop 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- 172.21.15.18:0/3780165832 shutdown_connections 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc790 0x55b7c41129b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c41bc3b0 0x55b7c41b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/3780165832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c4117a00 0x55b7c41b6480 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- 172.21.15.18:0/3780165832 >> 172.21.15.18:0/3780165832 conn(0x55b7c4111c50 msgr2=0x55b7c4112030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- 172.21.15.18:0/3780165832 shutdown_connections 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- 172.21.15.18:0/3780165832 wait complete. 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 Processor -- start 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- start start 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 0x55b7c41b55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc3b0 0x55b7c412cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c41bc790 0x55b7c412d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c40e6d10 con 0x55b7c41bc790 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c40e6a70 con 0x55b7c41bc3b0 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e2e2b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7c40e6500 con 0x55b7c4117a00 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c41bc790 0x55b7c412d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 0x55b7c41b55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12df600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc3b0 0x55b7c412cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 0x55b7c41b55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:55482/0 (socket says 172.21.15.18:55482) 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/846480661 learned_addr learned my addr 172.21.15.18:0/846480661 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc3b0 msgr2=0x55b7c412cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7c41bc3b0 0x55b7c412cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c41bc790 msgr2=0x55b7c412d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c41bc790 0x55b7c412d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0000640 1 -- 172.21.15.18:0/846480661 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c412a5c0 con 0x55b7c4117a00 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.892+0000 7f12e0a00640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7c41bc790 0x55b7c412d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12e0000640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 0x55b7c41b55a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12d0013d90 tx=0x7f12d0003030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 -- 172.21.15.18:0/846480661 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d0020020 con 0x55b7c4117a00 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 -- 172.21.15.18:0/846480661 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d001c430 con 0x55b7c4117a00 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 -- 172.21.15.18:0/846480661 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000ae60 con 0x55b7c4117a00 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7c412a860 con 0x55b7c4117a00 2024-04-25T10:06:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7c412ada0 con 0x55b7c4117a00 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 -- 172.21.15.18:0/846480661 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f12d0023020 con 0x55b7c4117a00 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12c0065940 0x7f12c0067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12dce00640 1 -- 172.21.15.18:0/846480661 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f12d0010020 con 0x55b7c4117a00 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12df600640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12c0065940 0x7f12c0067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b7c41b5ae0 0x55b7c4261050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.896+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53) v9 -- 0x55b7c41c1810 con 0x55b7c41b5ae0 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12df600640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12c0065940 0x7f12c0067e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f70 tx=0x7f12cc0016e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e0a00640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b7c41b5ae0 0x55b7c4261050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e0a00640 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b7c41b5ae0 0x55b7c4261050 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:01.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e0a00640 1 -- 172.21.15.18:0/846480661 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v53'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f12d80aa410 con 0x55b7c41b5ae0 2024-04-25T10:06:01.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b7c41b5ae0 msgr2=0x55b7c4261050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b7c41b5ae0 0x55b7c4261050 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12c0065940 msgr2=0x7f12c0067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12c0065940 0x7f12c0067e00 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f12cc000f70 tx=0x7f12cc0016e0 comp rx=0 tx=0).stop 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 msgr2=0x55b7c41b55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 --2- 172.21.15.18:0/846480661 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7c4117a00 0x55b7c41b55a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f12d0013d90 tx=0x7f12d0003030 comp rx=0 tx=0).stop 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e0a00640 1 -- 172.21.15.18:0/846480661 reap_dead start 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 shutdown_connections 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 >> 172.21.15.18:0/846480661 conn(0x55b7c4111c50 msgr2=0x55b7c41129b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 shutdown_connections 2024-04-25T10:06:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:01.900+0000 7f12e2e2b080 1 -- 172.21.15.18:0/846480661 wait complete. 2024-04-25T10:06:01.916 DEBUG:teuthology.orchestra.run.smithi018:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T10:06:01.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:01.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T10:06:02.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.052+0000 7f1cda600640 1 Processor -- start 2024-04-25T10:06:02.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.052+0000 7f1cda600640 1 -- start start 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cda600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1cd415b6d0 0x7f1cd40cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cda600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1cd40d1220 0x7f1cd4070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cda600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd415f7d0 con 0x7f1cd4071b30 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cda600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40ce4d0 con 0x7f1cd415b6d0 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cda600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd415fab0 con 0x7f1cd40d1220 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1cd415b6d0 0x7f1cd40cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1cd415b6d0 0x7f1cd40cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48306/0 (socket says 172.21.15.18:48306) 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 -- 172.21.15.18:0/194752926 learned_addr learned my addr 172.21.15.18:0/194752926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/194752926 >> v2:172.21.15.167:3300/0 conn(0x7f1cd40d1220 0x7f1cd4070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 -- 172.21.15.18:0/194752926 >> v2:172.21.15.167:3300/0 conn(0x7f1cd40d1220 msgr2=0x7f1cd4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 --2- 172.21.15.18:0/194752926 >> v2:172.21.15.167:3300/0 conn(0x7f1cd40d1220 0x7f1cd4070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 -- 172.21.15.18:0/194752926 >> v1:172.21.15.167:6789/0 conn(0x7f1cd4071b30 legacy=0x7f1cd40b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.056+0000 7f1cd3400640 1 -- 172.21.15.18:0/194752926 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd415fd90 con 0x7f1cd415b6d0 2024-04-25T10:06:02.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cd3400640 1 --2- 172.21.15.18:0/194752926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd40cdf90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1cd406efe0 tx=0x7f1cc401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d949dfec1cf42f3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cd2a00640 1 -- 172.21.15.18:0/194752926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40b0070 con 0x7f1cd415b6d0 2024-04-25T10:06:02.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cd2a00640 1 -- 172.21.15.18:0/194752926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40ab600 con 0x7f1cd415b6d0 2024-04-25T10:06:02.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cd2a00640 1 -- 172.21.15.18:0/194752926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40ab9d0 con 0x7f1cd415b6d0 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- 172.21.15.18:0/194752926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 msgr2=0x7f1cd40cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 --2- 172.21.15.18:0/194752926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd40cdf90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1cd406efe0 tx=0x7f1cc401c520 comp rx=0 tx=0).stop 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- 172.21.15.18:0/194752926 shutdown_connections 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 --2- 172.21.15.18:0/194752926 >> v2:172.21.15.167:3300/0 conn(0x7f1cd40d1220 0x7f1cd4070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 --2- 172.21.15.18:0/194752926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd40cdf90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- 172.21.15.18:0/194752926 >> 172.21.15.18:0/194752926 conn(0x7f1cd406f510 msgr2=0x7f1cd406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- 172.21.15.18:0/194752926 shutdown_connections 2024-04-25T10:06:02.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- 172.21.15.18:0/194752926 wait complete. 2024-04-25T10:06:02.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 Processor -- start 2024-04-25T10:06:02.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.060+0000 7f1cda600640 1 -- start start 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cd40d1220 0x7f1cd41497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd414b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415f360 con 0x7f1cd415b6d0 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415bcc0 con 0x7f1cd4071b30 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415f4e0 con 0x7f1cd40d1220 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd414b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:58986/0 (socket says 172.21.15.18:58986) 2024-04-25T10:06:02.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3400640 1 -- 172.21.15.18:0/3956958194 learned_addr learned my addr 172.21.15.18:0/3956958194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cd40d1220 0x7f1cd41497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cd40d1220 msgr2=0x7f1cd41497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cd40d1220 0x7f1cd41497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 msgr2=0x7f1cd406c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3956958194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd406cd60 con 0x7f1cd415b6d0 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd414b0f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c700 tx=0x7f1ccc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1ccbe00640 1 -- 172.21.15.18:0/3956958194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc003b80 con 0x7f1cd415b6d0 2024-04-25T10:06:02.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1ccbe00640 1 -- 172.21.15.18:0/3956958194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc003d20 con 0x7f1cd415b6d0 2024-04-25T10:06:02.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd406d040 con 0x7f1cd415b6d0 2024-04-25T10:06:02.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1ccbe00640 1 -- 172.21.15.18:0/3956958194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc00aa30 con 0x7f1cd415b6d0 2024-04-25T10:06:02.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.064+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd406d600 con 0x7f1cd415b6d0 2024-04-25T10:06:02.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1ccbe00640 1 -- 172.21.15.18:0/3956958194 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ccc00abd0 con 0x7f1cd415b6d0 2024-04-25T10:06:02.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1ccbe00640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 0x7f1cb0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 Processor -- start 2024-04-25T10:06:02.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1ccbe00640 1 -- 172.21.15.18:0/3956958194 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ccc084ec0 con 0x7f1cd415b6d0 2024-04-25T10:06:02.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 -- start start 2024-04-25T10:06:02.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 0x7f1cb0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c040070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c0405b0 0x55ed7bff5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7bff6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed7bedcf40 con 0x55ed7bff6290 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed7be44070 con 0x55ed7c0405b0 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed7bdcc1a0 con 0x55ed7c03fc90 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 0x7f1cb0069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cc401c560 tx=0x7f1cc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c040070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7bff6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1ccaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c0405b0 0x55ed7bff5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c040070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:55500/0 (socket says 172.21.15.18:55500) 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3400640 1 -- 172.21.15.18:0/229563345 learned_addr learned my addr 172.21.15.18:0/229563345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 -- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 msgr2=0x55ed7c040070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c040070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 -- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c0405b0 msgr2=0x55ed7bff5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c0405b0 0x55ed7bff5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 -- 172.21.15.18:0/229563345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed7bdca510 con 0x55ed7bff6290 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7bff6670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc083340 tx=0x7f1ccc055780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a6b153f8ede93a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cc3e00640 1 -- 172.21.15.18:0/229563345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc05dde0 con 0x55ed7bff6290 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cc3e00640 1 -- 172.21.15.18:0/229563345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00ce10 con 0x55ed7bff6290 2024-04-25T10:06:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.068+0000 7f1cc3e00640 1 -- 172.21.15.18:0/229563345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc053a80 con 0x55ed7bff6290 2024-04-25T10:06:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/229563345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 msgr2=0x55ed7bff6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7bff6670 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc083340 tx=0x7f1ccc055780 comp rx=0 tx=0).stop 2024-04-25T10:06:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/229563345 shutdown_connections 2024-04-25T10:06:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7bff6670 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c0405b0 0x55ed7bff5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- 172.21.15.18:0/229563345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c040070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/229563345 >> 172.21.15.18:0/229563345 conn(0x55ed7bff2240 msgr2=0x55ed7bff4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/229563345 shutdown_connections 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/229563345 wait complete. 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- start start 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 Processor -- start 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7bff6290 0x55ed7c000e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c001370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed7bdfe6c0 con 0x55ed7c0405b0 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed7be40110 con 0x55ed7c03fc90 2024-04-25T10:06:02.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed7befaf20 con 0x55ed7bff6290 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 10 client.0 _ll_register_callbacks cb 0x55ed7bfe1570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48336/0 (socket says 172.21.15.18:48336) 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3236879022 learned_addr learned my addr 172.21.15.18:0/3236879022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7bff6290 0x55ed7c000e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c001370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7bff6290 msgr2=0x55ed7c000e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7bff6290 0x55ed7c000e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 msgr2=0x55ed7c001370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c001370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3236879022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed7bdcc3b0 con 0x55ed7c0405b0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc051be0 tx=0x7f1ccc001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee617b76ca6855c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc051df0 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ccc054bd0 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.072+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ccc00ce10 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ccc051f90 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 10 client.5943 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ed7bec5e00 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ccc00ce10 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ccc073b10 con 0x55ed7c0405b0 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 10 client.5943 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 10 client.5943 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 20 client.5943 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c002150 0x55ed7c051410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 4 client.5943 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:06:02.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed7bddfd60 con 0x55ed7c002150 2024-04-25T10:06:02.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c002150 0x55ed7c051410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c002150 0x55ed7c051410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d306649145641e0 server_cookie=266e645a9943fc61 in_seq=0 out_seq=0 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 10 client.5943 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3236879022 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ed7bddfd60 con 0x55ed7c002150 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 10 client.5943 handle_command_reply: tid=0 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 client.5943 shutdown 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 msgr2=0x55ed7c0018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc051be0 tx=0x7f1ccc001260 comp rx=0 tx=0).stop 2024-04-25T10:06:02.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 shutdown_connections 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c002150 0x55ed7c051410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c0018b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c001370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3236879022 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7bff6290 0x55ed7c000e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 >> 172.21.15.18:0/3236879022 conn(0x55ed7bff2240 msgr2=0x55ed7bff4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cc0c00640 0 client.5943 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 shutdown_connections 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 1 -- 172.21.15.18:0/3236879022 wait complete. 2024-04-25T10:06:02.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.076+0000 7f1cdda63000 20 client.5943 trim_cache size 0 max 16384 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 Processor -- start 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 -- start start 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 0x7f45a00c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 0x7f45a006c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a0071600 con 0x7f45a015e0b0 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a00713c0 con 0x7f45a006bf30 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a7c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00718e0 con 0x7f45a015b680 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f459fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f45a015e0b0 0x7f45a0070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60850/0 (socket says 172.21.15.18:60850) 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f459fe00640 1 -- 172.21.15.18:0/1461551728 learned_addr learned my addr 172.21.15.18:0/1461551728 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5c00640 1 --2- 172.21.15.18:0/1461551728 >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 0x7f45a006c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5200640 1 --2- 172.21.15.18:0/1461551728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 0x7f45a00c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961067203 0 0) 0x7f45a0071600 con 0x7f45a015e0b0 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4588003530 con 0x7f45a015e0b0 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5200640 1 -- 172.21.15.18:0/1461551728 >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 msgr2=0x7f45a006c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5200640 1 --2- 172.21.15.18:0/1461551728 >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 0x7f45a006c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1483183223 0 0) 0x7f4588003530 con 0x7f45a015e0b0 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5200640 1 -- 172.21.15.18:0/1461551728 >> v1:172.21.15.18:6789/0 conn(0x7f45a015e0b0 legacy=0x7f45a0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5200640 1 -- 172.21.15.18:0/1461551728 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0071bc0 con 0x7f45a015b680 2024-04-25T10:06:02.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.080+0000 7f45a5c00640 1 --2- 172.21.15.18:0/1461551728 >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 0x7f45a006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a5200640 1 --2- 172.21.15.18:0/1461551728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 0x7f45a00c6b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45940097c0 tx=0x7f459401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=174f9196f480b436 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940b0070 con 0x7f45a015b680 2024-04-25T10:06:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45940ab400 con 0x7f45a015b680 2024-04-25T10:06:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f459f400640 1 -- 172.21.15.18:0/1461551728 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458c001680 con 0x7f45a015b680 2024-04-25T10:06:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 -- 172.21.15.18:0/1461551728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 msgr2=0x7f45a00c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 --2- 172.21.15.18:0/1461551728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 0x7f45a00c6b40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f45940097c0 tx=0x7f459401c3c0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 -- 172.21.15.18:0/1461551728 shutdown_connections 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 --2- 172.21.15.18:0/1461551728 >> v2:172.21.15.167:3300/0 conn(0x7f45a006bf30 0x7f45a006c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 --2- 172.21.15.18:0/1461551728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015b680 0x7f45a00c6b40 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 -- 172.21.15.18:0/1461551728 >> 172.21.15.18:0/1461551728 conn(0x7f45a00b3400 msgr2=0x7f45a00b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 -- 172.21.15.18:0/1461551728 shutdown_connections 2024-04-25T10:06:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.084+0000 7f45a7c00640 1 -- 172.21.15.18:0/1461551728 wait complete. 2024-04-25T10:06:02.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 Processor -- start 2024-04-25T10:06:02.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- start start 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45a006bf30 0x7f45a014a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a015b680 0x7f45a015d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015e0b0 0x7f45a00c7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00cf6e0 con 0x7f45a006bf30 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00cf560 con 0x7f45a015b680 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a00d0650 con 0x7f45a015e0b0 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45a006bf30 0x7f45a014a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45a006bf30 0x7f45a014a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48348/0 (socket says 172.21.15.18:48348) 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 -- 172.21.15.18:0/1207145562 learned_addr learned my addr 172.21.15.18:0/1207145562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5c00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015e0b0 0x7f45a00c7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f459fe00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a015b680 0x7f45a015d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 -- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015e0b0 msgr2=0x7f45a00c7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015e0b0 0x7f45a00c7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 -- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a015b680 msgr2=0x7f45a015d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45a015b680 0x7f45a015d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 -- 172.21.15.18:0/1207145562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a015d9c0 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5c00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f45a015e0b0 0x7f45a00c7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a5200640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45a006bf30 0x7f45a014a470 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f45940097c0 tx=0x7f4594019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940b0040 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45940b9070 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45940b4890 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- 172.21.15.18:0/1207145562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a0160480 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- 172.21.15.18:0/1207145562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a0160d90 con 0x7f45a006bf30 2024-04-25T10:06:02.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.088+0000 7f45a7c00640 1 -- 172.21.15.18:0/1207145562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f45a0160fd0 con 0x7f45a006bf30 2024-04-25T10:06:02.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45940b4a30 con 0x7f45a006bf30 2024-04-25T10:06:02.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459cc00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4580066f60 0x7f4580069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f459411fac0 con 0x7f45a006bf30 2024-04-25T10:06:02.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7f4594015fb0 con 0x7f45a006bf30 2024-04-25T10:06:02.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459fe00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4580066f60 0x7f4580069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f45a7c00640 1 -- 172.21.15.18:0/1207145562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f45a00745d0 con 0x7f45a006bf30 2024-04-25T10:06:02.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.092+0000 7f459fe00640 1 --2- 172.21.15.18:0/1207145562 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4580066f60 0x7f4580069420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f458c0011f0 tx=0x7f458c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 Processor -- start 2024-04-25T10:06:02.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- start start 2024-04-25T10:06:02.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c09c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c0405b0 0x55ed7c09c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4203990 con 0x55ed7bff6290 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4202b50 con 0x55ed7c03fc90 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4151a00 con 0x55ed7c0405b0 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48364/0 (socket says 172.21.15.18:48364) 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 -- 172.21.15.18:0/2175391288 learned_addr learned my addr 172.21.15.18:0/2175391288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c09c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c0405b0 0x55ed7c09c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 -- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c0405b0 msgr2=0x55ed7c09c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c0405b0 0x55ed7c09c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 -- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 msgr2=0x55ed7c09c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c09c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 -- 172.21.15.18:0/2175391288 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed7be9bc50 con 0x55ed7bff6290 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c09c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:02.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cd3400640 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4097df0 tx=0x7f1cc4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6659d8410fa37705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cc3400640 1 -- 172.21.15.18:0/2175391288 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40ce070 con 0x55ed7bff6290 2024-04-25T10:06:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cc3400640 1 -- 172.21.15.18:0/2175391288 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40b7ba0 con 0x55ed7bff6290 2024-04-25T10:06:02.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cc3400640 1 -- 172.21.15.18:0/2175391288 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40b0040 con 0x55ed7bff6290 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- 172.21.15.18:0/2175391288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 msgr2=0x55ed7c09bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4097df0 tx=0x7f1cc4004740 comp rx=0 tx=0).stop 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- 172.21.15.18:0/2175391288 shutdown_connections 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c0405b0 0x55ed7c09c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7c03fc90 0x55ed7c09c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 --2- 172.21.15.18:0/2175391288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7bff6290 0x55ed7c09bce0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- 172.21.15.18:0/2175391288 >> 172.21.15.18:0/2175391288 conn(0x55ed7bff2240 msgr2=0x55ed7c03e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- 172.21.15.18:0/2175391288 shutdown_connections 2024-04-25T10:06:02.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.096+0000 7f1cdda63000 1 -- 172.21.15.18:0/2175391288 wait complete. 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- start start 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 Processor -- start 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 0x55ed7c09fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c0a0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed7bde6bd0 con 0x55ed7c0405b0 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4152000 con 0x55ed7bff6290 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ed7bff20c0 con 0x55ed7c03fc90 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 10 client.0 _ll_register_callbacks cb 0x7f1ccc051a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 0x55ed7c09fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48368/0 (socket says 172.21.15.18:48368) 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3201970732 learned_addr learned my addr 172.21.15.18:0/3201970732 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 0x55ed7c09fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:59062/0 (socket says 172.21.15.18:59062) 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1ccaa00640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c0a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 msgr2=0x55ed7c0a0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c0a0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 msgr2=0x55ed7c09fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 0x55ed7c09fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 -- 172.21.15.18:0/3201970732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed7be0c120 con 0x55ed7c0405b0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3e00640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc05d8b0 tx=0x7f1ccc0014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41087728219847d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ccc051df0 con 0x55ed7c0405b0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ccc0516d0 con 0x55ed7c0405b0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1cc40b7ba0 con 0x55ed7c0405b0 2024-04-25T10:06:02.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ccc054ec0 con 0x55ed7c0405b0 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 10 client.5955 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55ed7bdeb170 con 0x55ed7c0405b0 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40b7ba0 con 0x55ed7c0405b0 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1ccc0690f0 con 0x55ed7c0405b0 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 10 client.5955 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 10 client.5955 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 20 client.5955 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c05b880 0x55ed7c05bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 4 client.5955 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55ed7be515b0 con 0x55ed7c05b880 2024-04-25T10:06:02.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.100+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c05b880 0x55ed7c05bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.116 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:06:02.109+0000 7f940aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5698=0-4194304@1} caps={5698=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5698 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55ba65e63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cd3400640 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c05b880 0x55ed7c05bc60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9bf4801332cda5 server_cookie=6972fc8a5279524c in_seq=0 out_seq=0 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cc0c00640 10 client.5955 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cc0c00640 1 -- 172.21.15.18:0/3201970732 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ed7be515b0 con 0x55ed7c05b880 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cc0c00640 10 client.5955 handle_command_reply: tid=0 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 client.5955 shutdown 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 msgr2=0x55ed7c05ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc05d8b0 tx=0x7f1ccc0014b0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 shutdown_connections 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55ed7c05b880 0x55ed7c05bc60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ed7c0405b0 0x55ed7c05ae90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ed7c03fc90 0x55ed7c0a0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 --2- 172.21.15.18:0/3201970732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed7bff6290 0x55ed7c09fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 >> 172.21.15.18:0/3201970732 conn(0x55ed7bff2240 msgr2=0x55ed7c03ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cc0c00640 0 client.5955 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 shutdown_connections 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 1 -- 172.21.15.18:0/3201970732 wait complete. 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cdda63000 20 client.5955 trim_cache size 0 max 16384 2024-04-25T10:06:02.118 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:06:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "95d108e8-79a8-40fa-935c-67e7f41bee49", 2024-04-25T10:06:02.119 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:06:02.119 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 msgr2=0x7f1cb0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 0x7f1cb0069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cc401c560 tx=0x7f1cc4008040 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 msgr2=0x7f1cd414b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd414b0f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f1ccc00c700 tx=0x7f1ccc00cbc0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 shutdown_connections 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1cd415b6d0 0x7f1cd414b0f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1cb0066f60 0x7f1cb0069420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1cd40d1220 0x7f1cd41497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 --2- 172.21.15.18:0/3956958194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1cd4071b30 0x7f1cd406c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 >> 172.21.15.18:0/3956958194 conn(0x7f1cd406f510 msgr2=0x7f1cd40b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 shutdown_connections 2024-04-25T10:06:02.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.104+0000 7f1cda600640 1 -- 172.21.15.18:0/3956958194 wait complete. 2024-04-25T10:06:02.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:02.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T10:06:02.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 Processor -- start 2024-04-25T10:06:02.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 -- start start 2024-04-25T10:06:02.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c6c15acd0 0x7f1c6c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 0x7f1c6c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c15bc40 con 0x7f1c6c144120 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c15e490 con 0x7f1c6c15acd0 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c73e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c15b150 con 0x7f1c6c15ee60 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1c6c144120 0x7f1c6c0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:60854/0 (socket says 172.21.15.18:60854) 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71400640 1 -- 172.21.15.18:0/2572716157 learned_addr learned my addr 172.21.15.18:0/2572716157 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71e00640 1 --2- 172.21.15.18:0/2572716157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 0x7f1c6c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c70a00640 1 --2- 172.21.15.18:0/2572716157 >> v2:172.21.15.167:3300/0 conn(0x7f1c6c15acd0 0x7f1c6c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c6be00640 1 -- 172.21.15.18:0/2572716157 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587626804 0 0) 0x7f1c6c15bc40 con 0x7f1c6c144120 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c6be00640 1 -- 172.21.15.18:0/2572716157 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c54003530 con 0x7f1c6c144120 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71e00640 1 -- 172.21.15.18:0/2572716157 >> v2:172.21.15.167:3300/0 conn(0x7f1c6c15acd0 msgr2=0x7f1c6c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71e00640 1 --2- 172.21.15.18:0/2572716157 >> v2:172.21.15.167:3300/0 conn(0x7f1c6c15acd0 0x7f1c6c15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71e00640 1 -- 172.21.15.18:0/2572716157 >> v1:172.21.15.18:6789/0 conn(0x7f1c6c144120 legacy=0x7f1c6c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.268+0000 7f1c71e00640 1 -- 172.21.15.18:0/2572716157 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c15b3a0 con 0x7f1c6c15ee60 2024-04-25T10:06:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c71e00640 1 --2- 172.21.15.18:0/2572716157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 0x7f1c6c0b3090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009d90 tx=0x7f1c6401c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dde58d761bc1fbdb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c6be00640 1 -- 172.21.15.18:0/2572716157 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640b2070 con 0x7f1c6c15ee60 2024-04-25T10:06:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c6be00640 1 -- 172.21.15.18:0/2572716157 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640a57a0 con 0x7f1c6c15ee60 2024-04-25T10:06:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c6be00640 1 -- 172.21.15.18:0/2572716157 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a5b70 con 0x7f1c6c15ee60 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 -- 172.21.15.18:0/2572716157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 msgr2=0x7f1c6c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 --2- 172.21.15.18:0/2572716157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 0x7f1c6c0b3090 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009d90 tx=0x7f1c6401c8e0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 -- 172.21.15.18:0/2572716157 shutdown_connections 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 --2- 172.21.15.18:0/2572716157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15ee60 0x7f1c6c0b3090 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 --2- 172.21.15.18:0/2572716157 >> v2:172.21.15.167:3300/0 conn(0x7f1c6c15acd0 0x7f1c6c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 -- 172.21.15.18:0/2572716157 >> 172.21.15.18:0/2572716157 conn(0x7f1c6c067080 msgr2=0x7f1c6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 -- 172.21.15.18:0/2572716157 shutdown_connections 2024-04-25T10:06:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.272+0000 7f1c73e00640 1 -- 172.21.15.18:0/2572716157 wait complete. 2024-04-25T10:06:02.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 Processor -- start 2024-04-25T10:06:02.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- start start 2024-04-25T10:06:02.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c144120 0x7f1c6c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15acd0 0x7f1c6c13cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c06d450 con 0x7f1c6c15ee60 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c06d2d0 con 0x7f1c6c144120 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c06d5d0 con 0x7f1c6c15acd0 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c144120 0x7f1c6c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48374/0 (socket says 172.21.15.18:48374) 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 -- 172.21.15.18:0/3659164823 learned_addr learned my addr 172.21.15.18:0/3659164823 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15acd0 0x7f1c6c13cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 -- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15acd0 msgr2=0x7f1c6c13cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15acd0 0x7f1c6c13cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 -- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c144120 msgr2=0x7f1c6c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c144120 0x7f1c6c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 -- 172.21.15.18:0/3659164823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c13f6f0 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c71e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1c6401af90 tx=0x7f1c64019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c69600640 1 -- 172.21.15.18:0/3659164823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640bd020 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c69600640 1 -- 172.21.15.18:0/3659164823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640b8470 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c13ee50 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c69600640 1 -- 172.21.15.18:0/3659164823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640b2040 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.276+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c13f410 con 0x7f1c6c15ee60 2024-04-25T10:06:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c69600640 1 -- 172.21.15.18:0/3659164823 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1c640c0020 con 0x7f1c6c15ee60 2024-04-25T10:06:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c69600640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 0x7f1c4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c69600640 1 -- 172.21.15.18:0/3659164823 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c6411fce0 con 0x7f1c6c15ee60 2024-04-25T10:06:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c71400640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 0x7f1c4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 Processor -- start 2024-04-25T10:06:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 -- start start 2024-04-25T10:06:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c71400640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 0x7f1c4c069420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007fd0 tx=0x7f1c60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cffd9d0 0x55f57cffddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57ce00ff0 con 0x55f57cfb40a0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cd89150 con 0x55f57cffd9d0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.280+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57cdfd090 con 0x55f57cffe2f0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cffd9d0 0x55f57cffddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48386/0 (socket says 172.21.15.18:48386) 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 -- 172.21.15.18:0/639527033 learned_addr learned my addr 172.21.15.18:0/639527033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c70a00640 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 -- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 msgr2=0x55f57cfb3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 -- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cffd9d0 msgr2=0x55f57cffddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cffd9d0 0x55f57cffddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 -- 172.21.15.18:0/639527033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57cf970d0 con 0x55f57cfb40a0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1c640f8630 tx=0x7f1c64009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98040296fe7e6c1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c5e000640 1 -- 172.21.15.18:0/639527033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640f45a0 con 0x55f57cfb40a0 2024-04-25T10:06:02.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c5e000640 1 -- 172.21.15.18:0/639527033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640f8b60 con 0x55f57cfb40a0 2024-04-25T10:06:02.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c5e000640 1 -- 172.21.15.18:0/639527033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640ecb70 con 0x55f57cfb40a0 2024-04-25T10:06:02.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- 172.21.15.18:0/639527033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 msgr2=0x55f57cfb4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1c640f8630 tx=0x7f1c64009450 comp rx=0 tx=0).stop 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- 172.21.15.18:0/639527033 shutdown_connections 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cfb40a0 0x55f57cfb4480 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- 172.21.15.18:0/639527033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cffd9d0 0x55f57cffddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- 172.21.15.18:0/639527033 >> 172.21.15.18:0/639527033 conn(0x55f57cfb0020 msgr2=0x55f57cfb2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- 172.21.15.18:0/639527033 shutdown_connections 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- 172.21.15.18:0/639527033 wait complete. 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- start start 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 Processor -- start 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfe27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfe3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cdc5250 con 0x55f57cffd9d0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cdbb690 con 0x55f57cfb40a0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57cd89a40 con 0x55f57cffe2f0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c771f6000 10 client.0 _ll_register_callbacks cb 0x55f57cf9ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48388/0 (socket says 172.21.15.18:48388) 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c70a00640 1 -- 172.21.15.18:0/620121806 learned_addr learned my addr 172.21.15.18:0/620121806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71400640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfe27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.284+0000 7f1c71e00640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfe3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 -- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 msgr2=0x55f57cfe3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfe3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 -- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 msgr2=0x55f57cfe27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfe27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 -- 172.21.15.18:0/620121806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57ceae1c0 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c70a00640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1c580149d0 tx=0x7f1c58014e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8806be56455b5dee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58022060 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c58012b80 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c640f8b60 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c58028050 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 10 client.5967 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55f57ceaa170 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640f8b60 con 0x55f57cffd9d0 2024-04-25T10:06:02.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c5802b020 con 0x55f57cffd9d0 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 10 client.5967 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 10 client.5967 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 20 client.5967 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d00dc80 0x55f57d010070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 4 client.5967 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f57cd9cc60 con 0x55f57d00dc80 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c71400640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d00dc80 0x55f57d010070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c71400640 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d00dc80 0x55f57d010070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f03a892fe523006d server_cookie=2c43874b59c16f07 in_seq=0 out_seq=0 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 10 client.5967 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 1 -- 172.21.15.18:0/620121806 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f57cd9cc60 con 0x55f57d00dc80 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 10 client.5967 handle_command_reply: tid=0 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 client.5967 shutdown 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 msgr2=0x55f57cfe2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1c580149d0 tx=0x7f1c58014e90 comp rx=0 tx=0).stop 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 shutdown_connections 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d00dc80 0x55f57d010070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfe3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfe2d30 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 --2- 172.21.15.18:0/620121806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfe27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c52a00640 0 client.5967 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 >> 172.21.15.18:0/620121806 conn(0x55f57cfb0020 msgr2=0x55f57cfb2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 shutdown_connections 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 1 -- 172.21.15.18:0/620121806 wait complete. 2024-04-25T10:06:02.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.288+0000 7f1c771f6000 20 client.5967 trim_cache size 0 max 16384 2024-04-25T10:06:02.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 Processor -- start 2024-04-25T10:06:02.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 -- start start 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfb2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c203660 con 0x55f57cffd9d0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c2027e0 con 0x55f57cfb40a0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b0330 con 0x55f57cffe2f0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c70a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48402/0 (socket says 172.21.15.18:48402) 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.304+0000 7f1c70a00640 1 -- 172.21.15.18:0/1002322259 learned_addr learned my addr 172.21.15.18:0/1002322259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c71400640 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfb2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c71e00640 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 -- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 msgr2=0x55f57cfb2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 -- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 msgr2=0x55f57cfb2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfb2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 -- 172.21.15.18:0/1002322259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f57ce47de0 con 0x55f57cffd9d0 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c70a00640 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1c580096c0 tx=0x7f1c58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13eaf5bafdd3589 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c5d600640 1 -- 172.21.15.18:0/1002322259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58031070 con 0x55f57cffd9d0 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c5d600640 1 -- 172.21.15.18:0/1002322259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58012700 con 0x55f57cffd9d0 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c5d600640 1 -- 172.21.15.18:0/1002322259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5801d440 con 0x55f57cffd9d0 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- 172.21.15.18:0/1002322259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 msgr2=0x55f57cfb2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f1c580096c0 tx=0x7f1c58017000 comp rx=0 tx=0).stop 2024-04-25T10:06:02.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- 172.21.15.18:0/1002322259 shutdown_connections 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffe2f0 0x55f57cfb2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffd9d0 0x55f57cfb2950 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1002322259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57cfb2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- 172.21.15.18:0/1002322259 >> 172.21.15.18:0/1002322259 conn(0x55f57cfb0020 msgr2=0x55f57d00afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- 172.21.15.18:0/1002322259 shutdown_connections 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- 172.21.15.18:0/1002322259 wait complete. 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- start start 2024-04-25T10:06:02.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 Processor -- start 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57d05da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffd9d0 0x55f57d05df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f57cd9be00 con 0x55f57cffe2f0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b0930 con 0x55f57cfb40a0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f57ce00300 con 0x55f57cffd9d0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c771f6000 10 client.0 _ll_register_callbacks cb 0x55f57cf7f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48408/0 (socket says 172.21.15.18:48408) 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.308+0000 7f1c71e00640 1 -- 172.21.15.18:0/1882213653 learned_addr learned my addr 172.21.15.18:0/1882213653 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c70a00640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffd9d0 0x55f57d05df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71400640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57d05da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 -- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffd9d0 msgr2=0x55f57d05df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffd9d0 0x55f57d05df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 -- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 msgr2=0x55f57d05da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57d05da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 -- 172.21.15.18:0/1882213653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f57cda28e0 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71e00640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009d90 tx=0x7f1c64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bcb02764b28885 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640f4320 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c640f86d0 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c58012700 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c640f8b60 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 10 client.5973 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55f57ce5a8f0 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58012700 con 0x55f57cffe2f0 2024-04-25T10:06:02.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1c6c06ebf0 con 0x55f57cffe2f0 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 10 client.5973 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 10 client.5973 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 20 client.5973 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d010920 0x55f57d010d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 4 client.5973 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f57ce0e530 con 0x55f57d010920 2024-04-25T10:06:02.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71400640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d010920 0x55f57d010d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c71400640 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d010920 0x55f57d010d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=387af783c034d564 server_cookie=ad46bf9e4a83fc99 in_seq=0 out_seq=0 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 10 client.5973 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 1 -- 172.21.15.18:0/1882213653 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55f57ce0e530 con 0x55f57d010920 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 10 client.5973 handle_command_reply: tid=0 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 client.5973 shutdown 2024-04-25T10:06:02.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 msgr2=0x55f57d00ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1c64009d90 tx=0x7f1c64009750 comp rx=0 tx=0).stop 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 shutdown_connections 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x55f57d010920 0x55f57d010d30 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f57cffe2f0 0x55f57d00ffc0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f57cffd9d0 0x55f57d05df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c52a00640 0 client.5973 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 --2- 172.21.15.18:0/1882213653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f57cfb40a0 0x55f57d05da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 >> 172.21.15.18:0/1882213653 conn(0x55f57cfb0020 msgr2=0x55f57cffc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 shutdown_connections 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 1 -- 172.21.15.18:0/1882213653 wait complete. 2024-04-25T10:06:02.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.312+0000 7f1c771f6000 20 client.5973 trim_cache size 0 max 16384 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "95d108e8-79a8-40fa-935c-67e7f41bee49": { 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "95d108e8-79a8-40fa-935c-67e7f41bee49", 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:02.328 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 msgr2=0x7f1c4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 0x7f1c4c069420 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1c60007fd0 tx=0x7f1c60009040 comp rx=0 tx=0).stop 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 msgr2=0x7f1c6c13d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1c6401af90 tx=0x7f1c64019680 comp rx=0 tx=0).stop 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 shutdown_connections 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c6c15ee60 0x7f1c6c13d0b0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c4c066f60 0x7f1c4c069420 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c6c15acd0 0x7f1c6c13cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 --2- 172.21.15.18:0/3659164823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c6c144120 0x7f1c6c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:02.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 >> 172.21.15.18:0/3659164823 conn(0x7f1c6c067080 msgr2=0x7f1c6c140420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:02.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 shutdown_connections 2024-04-25T10:06:02.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:02.316+0000 7f1c73e00640 1 -- 172.21.15.18:0/3659164823 wait complete. 2024-04-25T10:06:02.344 INFO:tasks.cephfs.filesystem:scrub status for tag:95d108e8-79a8-40fa-935c-67e7f41bee49 - {'path': '/', 'tag': '95d108e8-79a8-40fa-935c-67e7f41bee49', 'options': 'recursive,repair'} 2024-04-25T10:06:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:03.320+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T10:06:02.109477+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f4594120000 con 0x7f45a006bf30 2024-04-25T10:06:03.330 INFO:teuthology.orchestra.run.smithi018.stdout: cluster: 2024-04-25T10:06:03.330 INFO:teuthology.orchestra.run.smithi018.stdout: id: a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:06:03.330 INFO:teuthology.orchestra.run.smithi018.stdout: health: HEALTH_OK 2024-04-25T10:06:03.330 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: services: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: mgr: x(active, since 2m), standbys: y 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: data: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: volumes: 1/1 healthy 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: pools: 3 pools, 97 pgs 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: objects: 24 objects, 579 KiB 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: usage: 237 MiB used, 720 GiB / 720 GiB avail 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: pgs: 97 active+clean 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: io: 2024-04-25T10:06:03.331 INFO:teuthology.orchestra.run.smithi018.stdout: client: 1.4 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.109477+0000 mds.d [INF] scrub queued for path: / 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.109480+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.109483+0000 mds.d [INF] scrub summary: active paths [/] 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.110445+0000 mds.d [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.110455+0000 mds.d [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T10:06:03.332 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:02.110815+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:06:06.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:06.328+0000 7f459cc00640 1 -- 172.21.15.18:0/1207145562 <== mon.0 v2:172.21.15.18:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-25T10:06:04.404248+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f45940bce10 con 0x7f45a006bf30 2024-04-25T10:06:06.339 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:06:04.404248+0000 mds.d [INF] scrub summary: idle 2024-04-25T10:06:20.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:06:20.577 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:06:32.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:32.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T10:06:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 Processor -- start 2024-04-25T10:06:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 -- start start 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f644415bcf0 0x7f6444099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440d02a0 con 0x7f644415b910 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440cc350 con 0x7f64440cf3c0 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.503+0000 7f6449c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64440cc630 con 0x7f644415bcf0 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6442a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f644415b910 0x7f64440cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36074/0 (socket says 172.21.15.18:36074) 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6442a00640 1 -- 172.21.15.18:0/1435720823 learned_addr learned my addr 172.21.15.18:0/1435720823 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6443400640 1 --2- 172.21.15.18:0/1435720823 >> v2:172.21.15.18:3300/0 conn(0x7f644415bcf0 0x7f6444099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6441600640 1 -- 172.21.15.18:0/1435720823 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255469957 0 0) 0x7f64440d02a0 con 0x7f644415b910 2024-04-25T10:06:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6441600640 1 -- 172.21.15.18:0/1435720823 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6428003530 con 0x7f644415b910 2024-04-25T10:06:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6443400640 1 -- 172.21.15.18:0/1435720823 >> v1:172.21.15.167:6789/0 conn(0x7f64440cf3c0 legacy=0x7f64440cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6443400640 1 -- 172.21.15.18:0/1435720823 >> v1:172.21.15.18:6789/0 conn(0x7f644415b910 legacy=0x7f64440cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6443400640 1 -- 172.21.15.18:0/1435720823 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440cc910 con 0x7f644415bcf0 2024-04-25T10:06:32.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6443400640 1 --2- 172.21.15.18:0/1435720823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f644415bcf0 0x7f6444099a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f643c009d90 tx=0x7f643c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a63b7d7c7e71992 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6441600640 1 -- 172.21.15.18:0/1435720823 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0b2070 con 0x7f644415bcf0 2024-04-25T10:06:32.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6441600640 1 -- 172.21.15.18:0/1435720823 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0a5830 con 0x7f644415bcf0 2024-04-25T10:06:32.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.507+0000 7f6441600640 1 -- 172.21.15.18:0/1435720823 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0a5be0 con 0x7f644415bcf0 2024-04-25T10:06:32.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- 172.21.15.18:0/1435720823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f644415bcf0 msgr2=0x7f6444099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 --2- 172.21.15.18:0/1435720823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f644415bcf0 0x7f6444099a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f643c009d90 tx=0x7f643c01c970 comp rx=0 tx=0).stop 2024-04-25T10:06:32.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- 172.21.15.18:0/1435720823 shutdown_connections 2024-04-25T10:06:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 --2- 172.21.15.18:0/1435720823 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f644415bcf0 0x7f6444099a60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- 172.21.15.18:0/1435720823 >> 172.21.15.18:0/1435720823 conn(0x7f64440b3200 msgr2=0x7f64440b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- 172.21.15.18:0/1435720823 shutdown_connections 2024-04-25T10:06:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- 172.21.15.18:0/1435720823 wait complete. 2024-04-25T10:06:32.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 Processor -- start 2024-04-25T10:06:32.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- start start 2024-04-25T10:06:32.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 0x7f644406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f644415bcf0 0x7f64440b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444169d40 con 0x7f64440cf3c0 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444169bc0 con 0x7f644415bcf0 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6449c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6444169ec0 con 0x7f644415b910 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38030/0 (socket says 172.21.15.18:38030) 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.511+0000 7f6442a00640 1 -- 172.21.15.18:0/3197560317 learned_addr learned my addr 172.21.15.18:0/3197560317 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442000640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 0x7f644406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6443400640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f644415bcf0 0x7f64440b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 -- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 msgr2=0x7f644406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 0x7f644406bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 -- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f644415bcf0 msgr2=0x7f64440b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f644415bcf0 0x7f64440b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 -- 172.21.15.18:0/3197560317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644406cda0 con 0x7f64440cf3c0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442000640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 0x7f644406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6442a00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f643400c4d0 tx=0x7f643400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f643aa00640 1 -- 172.21.15.18:0/3197560317 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434017070 con 0x7f64440cf3c0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f643aa00640 1 -- 172.21.15.18:0/3197560317 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434005cf0 con 0x7f64440cf3c0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f643aa00640 1 -- 172.21.15.18:0/3197560317 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434007270 con 0x7f64440cf3c0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644406c7e0 con 0x7f64440cf3c0 2024-04-25T10:06:32.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64440b59a0 con 0x7f64440cf3c0 2024-04-25T10:06:32.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.515+0000 7f643aa00640 1 -- 172.21.15.18:0/3197560317 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f643401a070 con 0x7f64440cf3c0 2024-04-25T10:06:32.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f643aa00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 0x7f6424069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f643aa00640 1 -- 172.21.15.18:0/3197560317 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f64340844b0 con 0x7f64440cf3c0 2024-04-25T10:06:32.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442000640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 0x7f6424069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 Processor -- start 2024-04-25T10:06:32.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- start start 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442000640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 0x7f6424069420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6444099b80 tx=0x7f6430009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x5641578ffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x564157900480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56415774cff0 con 0x5641579499d0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641576d5150 con 0x56415794a2f0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564157749090 con 0x5641579000a0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38038/0 (socket says 172.21.15.18:38038) 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 -- 172.21.15.18:0/1284615483 learned_addr learned my addr 172.21.15.18:0/1284615483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442000640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x5641578ffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 -- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 msgr2=0x564157900480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6443400640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x564157900480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x564157900480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 -- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 msgr2=0x5641578ffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x5641578ffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 -- 172.21.15.18:0/1284615483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641578e30d0 con 0x5641579499d0 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442000640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x5641578ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6443400640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x564157900480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f6442a00640 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6434054c60 tx=0x7f6434054e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e0f8cc805bf75c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f642f400640 1 -- 172.21.15.18:0/1284615483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434051340 con 0x5641579499d0 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f642f400640 1 -- 172.21.15.18:0/1284615483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434068be0 con 0x5641579499d0 2024-04-25T10:06:32.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f642f400640 1 -- 172.21.15.18:0/1284615483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340514e0 con 0x5641579499d0 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- 172.21.15.18:0/1284615483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 msgr2=0x564157949db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6434054c60 tx=0x7f6434054e50 comp rx=0 tx=0).stop 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- 172.21.15.18:0/1284615483 shutdown_connections 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x564157900480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x5641578ffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 --2- 172.21.15.18:0/1284615483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157949db0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.519+0000 7f644d167000 1 -- 172.21.15.18:0/1284615483 >> 172.21.15.18:0/1284615483 conn(0x5641578fc020 msgr2=0x5641578fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- 172.21.15.18:0/1284615483 shutdown_connections 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- 172.21.15.18:0/1284615483 wait complete. 2024-04-25T10:06:32.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- start start 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 Processor -- start 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x56415792e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579499d0 0x56415792ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157711250 con 0x56415794a2f0 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564157707690 con 0x5641579499d0 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641576d5a40 con 0x5641579000a0 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 10 client.0 _ll_register_callbacks cb 0x5641578eae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38044/0 (socket says 172.21.15.18:38044) 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 -- 172.21.15.18:0/800775207 learned_addr learned my addr 172.21.15.18:0/800775207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6442000640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579499d0 0x56415792ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6442a00640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x56415792e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 -- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 msgr2=0x56415792e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x56415792e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 -- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579499d0 msgr2=0x56415792ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579499d0 0x56415792ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 -- 172.21.15.18:0/800775207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641577fa1c0 con 0x56415794a2f0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6443400640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f643c01c9b0 tx=0x7f643c01b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8355aa394ce0b1bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c0bd070 con 0x56415794a2f0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f643c004240 con 0x56415794a2f0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6434068be0 con 0x56415794a2f0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f643c0c8050 con 0x56415794a2f0 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 10 client.5988 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:32.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5641577f6170 con 0x56415794a2f0 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6434068be0 con 0x56415794a2f0 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.523+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f643c0cb020 con 0x56415794a2f0 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 10 client.5988 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 10 client.5988 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 20 client.5988 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x564157959c80 0x56415795c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 4 client.5988 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641576e8c60 con 0x564157959c80 2024-04-25T10:06:32.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6442a00640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x564157959c80 0x56415795c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6442a00640 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x564157959c80 0x56415795c070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704a30a7ec59c3fd server_cookie=6974fd2c59606722 in_seq=0 out_seq=0 2024-04-25T10:06:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6423e00640 10 client.5988 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:32.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6423e00640 1 -- 172.21.15.18:0/800775207 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5641576e8c60 con 0x564157959c80 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6423e00640 10 client.5988 handle_command_reply: tid=0 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 client.5988 shutdown 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 msgr2=0x56415792f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f643c01c9b0 tx=0x7f643c01b1b0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 shutdown_connections 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x564157959c80 0x56415795c070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56415794a2f0 0x56415792f270 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579499d0 0x56415792ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 --2- 172.21.15.18:0/800775207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579000a0 0x56415792e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f6423e00640 0 client.5988 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 >> 172.21.15.18:0/800775207 conn(0x5641578fc020 msgr2=0x5641578feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 shutdown_connections 2024-04-25T10:06:32.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 1 -- 172.21.15.18:0/800775207 wait complete. 2024-04-25T10:06:32.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.527+0000 7f644d167000 20 client.5988 trim_cache size 0 max 16384 2024-04-25T10:06:32.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 Processor -- start 2024-04-25T10:06:32.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 -- start start 2024-04-25T10:06:32.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579000a0 0x5641578ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56415794a2f0 0x564157957380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64442038a0 con 0x5641579499d0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444202a70 con 0x5641579000a0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440cae10 con 0x56415794a2f0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38058/0 (socket says 172.21.15.18:38058) 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 -- 172.21.15.18:0/1530200041 learned_addr learned my addr 172.21.15.18:0/1530200041 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442a00640 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579000a0 0x5641578ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6443400640 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56415794a2f0 0x564157957380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 -- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56415794a2f0 msgr2=0x564157957380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56415794a2f0 0x564157957380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 -- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579000a0 msgr2=0x5641578ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579000a0 0x5641578ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 -- 172.21.15.18:0/1530200041 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564157793de0 con 0x5641579499d0 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f6442000640 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6430005340 tx=0x7f6430012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d3b81948699f6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f642ea00640 1 -- 172.21.15.18:0/1530200041 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430028070 con 0x5641579499d0 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f642ea00640 1 -- 172.21.15.18:0/1530200041 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6430003810 con 0x5641579499d0 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.543+0000 7f642ea00640 1 -- 172.21.15.18:0/1530200041 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6430003bc0 con 0x5641579499d0 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1530200041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 msgr2=0x564157956e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6430005340 tx=0x7f6430012000 comp rx=0 tx=0).stop 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1530200041 shutdown_connections 2024-04-25T10:06:32.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56415794a2f0 0x564157957380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579499d0 0x564157956e40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- 172.21.15.18:0/1530200041 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641579000a0 0x5641578ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1530200041 >> 172.21.15.18:0/1530200041 conn(0x5641578fc020 msgr2=0x564157956730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1530200041 shutdown_connections 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1530200041 wait complete. 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- start start 2024-04-25T10:06:32.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 Processor -- start 2024-04-25T10:06:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579499d0 0x5641579a9c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x56415795bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641576e7e00 con 0x5641579000a0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440b5040 con 0x56415794a2f0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56415774c300 con 0x5641579499d0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 10 client.0 _ll_register_callbacks cb 0x5641578cb040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38070/0 (socket says 172.21.15.18:38070) 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 -- 172.21.15.18:0/1483910158 learned_addr learned my addr 172.21.15.18:0/1483910158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6443400640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x56415795bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442000640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579499d0 0x5641579a9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 -- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579499d0 msgr2=0x5641579a9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579499d0 0x5641579a9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 -- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 msgr2=0x56415795bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x56415795bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 -- 172.21.15.18:0/1483910158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5641576ee8e0 con 0x5641579000a0 2024-04-25T10:06:32.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6442a00640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6434054c60 tx=0x7f6434000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89fc743d127729b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6423e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6434068be0 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6434051340 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6430003810 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6434054f30 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 10 client.5994 fetch_fsmap learned FSMap version 26 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.547+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x5641577a68f0 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6430003810 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 26) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f643405cea0 con 0x5641579000a0 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 10 client.5994 fetch_fsmap finished waiting for FSMap version 26 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 10 client.5994 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.d 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 20 client.5994 populate_metadata read hostname 'smithi018' 2024-04-25T10:06:32.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x56415795c410 0x56415795c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 4 client.5994 mds_command: new command op to 35177 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:06:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 --> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56415775a530 con 0x56415795c410 2024-04-25T10:06:32.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6442000640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x56415795c410 0x56415795c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6442000640 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x56415795c410 0x56415795c820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4f7003b94873a1a server_cookie=ba326bf21fd317c8 in_seq=0 out_seq=0 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 10 client.5994 ms_handle_connect on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 1 -- 172.21.15.18:0/1483910158 <== mds.0 v2:172.21.15.167:6834/322178907 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56415775a530 con 0x56415795c410 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 10 client.5994 handle_command_reply: tid=0 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 client.5994 shutdown 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 msgr2=0x5641579a9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f6434054c60 tx=0x7f6434000ee0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 shutdown_connections 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:6834/322178907,v1:172.21.15.167:6836/322178907] conn(0x56415795c410 0x56415795c820 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56415794a2f0 0x56415795bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5641579499d0 0x5641579a9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 --2- 172.21.15.18:0/1483910158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5641579000a0 0x5641579a9720 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6423e00640 0 client.5994 ms_handle_reset on v2:172.21.15.167:6834/322178907 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 >> 172.21.15.18:0/1483910158 conn(0x5641578fc020 msgr2=0x564157956fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 shutdown_connections 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 1 -- 172.21.15.18:0/1483910158 wait complete. 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f644d167000 20 client.5994 trim_cache size 0 max 16384 2024-04-25T10:06:32.566 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:32.567 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:06:32.567 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:06:32.567 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 msgr2=0x7f6424069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 0x7f6424069420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6444099b80 tx=0x7f6430009040 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 msgr2=0x7f644415a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f643400c4d0 tx=0x7f643400c990 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 shutdown_connections 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f644415bcf0 0x7f64440b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6424066f60 0x7f6424069420 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f644415b910 0x7f644406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 --2- 172.21.15.18:0/3197560317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64440cf3c0 0x7f644415a960 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 >> 172.21.15.18:0/3197560317 conn(0x7f64440b3200 msgr2=0x7f64440736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 shutdown_connections 2024-04-25T10:06:32.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.551+0000 7f6449c00640 1 -- 172.21.15.18:0/3197560317 wait complete. 2024-04-25T10:06:32.584 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:06:32.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:32.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 Processor -- start 2024-04-25T10:06:32.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 -- start start 2024-04-25T10:06:32.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 0x7fbab8143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab806d090 con 0x7fbab8071800 2024-04-25T10:06:32.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab8162390 con 0x7fbab80713c0 2024-04-25T10:06:32.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbabe200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab8161af0 con 0x7fbab8070fe0 2024-04-25T10:06:32.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbaaea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 0x7fbab8143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:35154/0 (socket says 172.21.15.18:35154) 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbaaea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 0x7fbab8143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:45960/0 (socket says 172.21.15.18:45960) 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 -- 172.21.15.18:0/1188564688 learned_addr learned my addr 172.21.15.18:0/1188564688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7e00640 1 --1- 172.21.15.18:0/1188564688 >> v1:172.21.15.167:6789/0 conn(0x7fbab8071800 0x7fbab815e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:55022/0 (socket says 172.21.15.18:55022) 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 -- 172.21.15.18:0/1188564688 >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 msgr2=0x7fbab8143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 --2- 172.21.15.18:0/1188564688 >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 0x7fbab8143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 -- 172.21.15.18:0/1188564688 >> v1:172.21.15.167:6789/0 conn(0x7fbab8071800 legacy=0x7fbab815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.815+0000 7fbab7400640 1 -- 172.21.15.18:0/1188564688 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab8161dd0 con 0x7fbab8070fe0 2024-04-25T10:06:32.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbab7400640 1 --2- 172.21.15.18:0/1188564688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009870 tx=0x7fbaa801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dce3062005e7f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbab6a00640 1 -- 172.21.15.18:0/1188564688 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80a95f0 con 0x7fbab8070fe0 2024-04-25T10:06:32.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbab6a00640 1 -- 172.21.15.18:0/1188564688 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa80a9790 con 0x7fbab8070fe0 2024-04-25T10:06:32.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbab6a00640 1 -- 172.21.15.18:0/1188564688 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80a9b60 con 0x7fbab8070fe0 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 -- 172.21.15.18:0/1188564688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 msgr2=0x7fbab8161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 --2- 172.21.15.18:0/1188564688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009870 tx=0x7fbaa801c530 comp rx=0 tx=0).stop 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 -- 172.21.15.18:0/1188564688 shutdown_connections 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 --2- 172.21.15.18:0/1188564688 >> v2:172.21.15.167:3300/0 conn(0x7fbab80713c0 0x7fbab8143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 --2- 172.21.15.18:0/1188564688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab8070fe0 0x7fbab8161510 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 -- 172.21.15.18:0/1188564688 >> 172.21.15.18:0/1188564688 conn(0x7fbab80b3390 msgr2=0x7fbab80b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 -- 172.21.15.18:0/1188564688 shutdown_connections 2024-04-25T10:06:32.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.819+0000 7fbabe200640 1 -- 172.21.15.18:0/1188564688 wait complete. 2024-04-25T10:06:32.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 Processor -- start 2024-04-25T10:06:32.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- start start 2024-04-25T10:06:32.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab80713c0 0x7fbab8137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 0x7fbab8138210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80b0540 con 0x7fbab8070fe0 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80b06c0 con 0x7fbab8071800 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab80b0840 con 0x7fbab80713c0 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38078/0 (socket says 172.21.15.18:38078) 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 -- 172.21.15.18:0/3633111362 learned_addr learned my addr 172.21.15.18:0/3633111362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7e00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 0x7fbab8138210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbaaea00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab80713c0 0x7fbab8137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 -- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab80713c0 msgr2=0x7fbab8137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab80713c0 0x7fbab8137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 -- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 msgr2=0x7fbab8138210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 0x7fbab8138210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 -- 172.21.15.18:0/3633111362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab81615f0 con 0x7fbab8070fe0 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7e00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 0x7fbab8138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbab7400640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbaa801a160 tx=0x7fbaa801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80a95f0 con 0x7fbab8070fe0 2024-04-25T10:06:32.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa80b1820 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa80b1c10 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab815f5c0 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab8160cc0 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.823+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab80745d0 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.827+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbaa80c53f0 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.827+0000 7fbaafe00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 0x7fba94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.827+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbaa811fcb0 con 0x7fbab8070fe0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.827+0000 7fbaaea00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 0x7fba94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:32.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.827+0000 7fbaaea00640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 0x7fba94069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbab80b7170 tx=0x7fbaa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:32.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:32.831+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbab815f5c0 con 0x7fbab8070fe0 2024-04-25T10:06:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbab8143c30 con 0x7fbab8070fe0 2024-04-25T10:06:33.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbaafe00640 1 -- 172.21.15.18:0/3633111362 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fbaa80ad020 con 0x7fbab8070fe0 2024-04-25T10:06:33.043 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:33.043 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 msgr2=0x7fba94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 0x7fba94069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbab80b7170 tx=0x7fbaa0008040 comp rx=0 tx=0).stop 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 msgr2=0x7fbab813b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fbaa801a160 tx=0x7fbaa801ad70 comp rx=0 tx=0).stop 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 shutdown_connections 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbab8071800 0x7fbab8138210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba94066f60 0x7fba94069420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbab80713c0 0x7fbab8137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 --2- 172.21.15.18:0/3633111362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbab8070fe0 0x7fbab813b250 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 >> 172.21.15.18:0/3633111362 conn(0x7fbab80b3390 msgr2=0x7fbab80cc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:33.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 shutdown_connections 2024-04-25T10:06:33.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.031+0000 7fbabe200640 1 -- 172.21.15.18:0/3633111362 wait complete. 2024-04-25T10:06:33.063 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T10:06:33.234 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:06:33.234 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:06:33.234 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T10:06:33.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 Processor -- start 2024-04-25T10:06:33.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- start start 2024-04-25T10:06:33.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da51750 0x56048da6ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048da68280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56048d9c8910 con 0x56048da53670 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56048d93f9f0 con 0x56048da51750 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56048d9c8a90 con 0x56048da53a50 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38106/0 (socket says 172.21.15.18:38106) 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 -- 172.21.15.18:0/2159883466 learned_addr learned my addr 172.21.15.18:0/2159883466 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c1800640 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da51750 0x56048da6ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c2200640 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048da68280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 -- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 msgr2=0x56048da68280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:33.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048da68280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 -- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da51750 msgr2=0x56048da6ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da51750 0x56048da6ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 -- 172.21.15.18:0/2159883466 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56048d9c4ef0 con 0x56048da53670 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c0e00640 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14b000a590 tx=0x7f14b0003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1999e17224d91e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14bb400640 1 -- 172.21.15.18:0/2159883466 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00af040 con 0x56048da53670 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14bb400640 1 -- 172.21.15.18:0/2159883466 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b00b9070 con 0x56048da53670 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14bb400640 1 -- 172.21.15.18:0/2159883466 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b00aacd0 con 0x56048da53670 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- 172.21.15.18:0/2159883466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 msgr2=0x56048da50480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f14b000a590 tx=0x7f14b0003030 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- 172.21.15.18:0/2159883466 shutdown_connections 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048da68280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da53670 0x56048da50480 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 --2- 172.21.15.18:0/2159883466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da51750 0x56048da6ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- 172.21.15.18:0/2159883466 >> 172.21.15.18:0/2159883466 conn(0x56048d999400 msgr2=0x56048da51b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:33.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- 172.21.15.18:0/2159883466 shutdown_connections 2024-04-25T10:06:33.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 -- 172.21.15.18:0/2159883466 wait complete. 2024-04-25T10:06:33.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.271+0000 7f14c46b8080 1 Processor -- start 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- start start 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 0x56048da4ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da53670 0x56048d9da7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048d9dad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56048da4faa0 con 0x56048da51750 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56048da4f800 con 0x56048da53670 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56048da4fd40 con 0x56048da53a50 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 0x56048da4ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 0x56048da4ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38110/0 (socket says 172.21.15.18:38110) 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 -- 172.21.15.18:0/144653366 learned_addr learned my addr 172.21.15.18:0/144653366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c2200640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048d9dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c0e00640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da53670 0x56048d9da7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 -- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 msgr2=0x56048d9dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56048da53a50 0x56048d9dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 -- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da53670 msgr2=0x56048d9da7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56048da53670 0x56048d9da7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 -- 172.21.15.18:0/144653366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56048da77790 con 0x56048da51750 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c1800640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 0x56048da4ebb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f14b4008740 tx=0x7f14b4008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14ba000640 1 -- 172.21.15.18:0/144653366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b4006b70 con 0x56048da51750 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14ba000640 1 -- 172.21.15.18:0/144653366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4019070 con 0x56048da51750 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14ba000640 1 -- 172.21.15.18:0/144653366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b40143f0 con 0x56048da51750 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56048d9dd710 con 0x56048da51750 2024-04-25T10:06:33.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.275+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56048d9ddc50 con 0x56048da51750 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14ba000640 1 -- 172.21.15.18:0/144653366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f14b4014590 con 0x56048da51750 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14ba000640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f14a4065970 0x7f14a4067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14ba000640 1 -- 172.21.15.18:0/144653366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f14b4084360 con 0x56048da51750 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56048d9de390 0x56048d9de7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c0e00640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f14a4065970 0x7f14a4067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e53) v9 -- 0x56048d9dece0 con 0x56048d9de390 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c2200640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56048d9de390 0x56048d9de7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c0e00640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f14a4065970 0x7f14a4067e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14b0019a50 tx=0x7f14b00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c2200640 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56048d9de390 0x56048d9de7a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c2200640 1 -- 172.21.15.18:0/144653366 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f14bc010650 con 0x56048d9de390 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56048d9de390 msgr2=0x56048d9de7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56048d9de390 0x56048d9de7a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f14a4065970 msgr2=0x7f14a4067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f14a4065970 0x7f14a4067e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f14b0019a50 tx=0x7f14b00a7000 comp rx=0 tx=0).stop 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 msgr2=0x56048da4ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 --2- 172.21.15.18:0/144653366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56048da51750 0x56048da4ebb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f14b4008740 tx=0x7f14b4008c00 comp rx=0 tx=0).stop 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c2200640 1 -- 172.21.15.18:0/144653366 reap_dead start 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 shutdown_connections 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 >> 172.21.15.18:0/144653366 conn(0x56048d999400 msgr2=0x56048da50410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 shutdown_connections 2024-04-25T10:06:33.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.279+0000 7f14c46b8080 1 -- 172.21.15.18:0/144653366 wait complete. 2024-04-25T10:06:33.296 INFO:teuthology.orchestra.run.smithi018.stdout:Yalphaparent_a 2024-04-25T10:06:33.296 DEBUG:teuthology.orchestra.run.smithi018:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "ancestors": [ 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1099511627776, 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "alpha", 2024-04-25T10:06:33.385 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 2 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1, 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "parent_a", 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 4 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 8, 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: "old_pools": [] 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:33.386 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:33.391 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:06:33.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:06:33.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:06:33.592 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:06:33.592 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:33.592 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:33.602 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:33.602 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:33.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.823+0000 7f4e3e800640 1 Processor -- start 2024-04-25T10:06:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.823+0000 7f4e3e800640 1 -- start start 2024-04-25T10:06:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 0x7f4e3815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 0x7f4e380cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e380b1750 0x7f4e380b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e380b20e0 con 0x7f4e380b1750 2024-04-25T10:06:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e38145650 con 0x7f4e380cd4d0 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e3e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e380cc4e0 con 0x7f4e38145270 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e380b1750 0x7f4e380b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e380b1750 0x7f4e380b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38122/0 (socket says 172.21.15.18:38122) 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 -- 172.21.15.18:0/259553163 learned_addr learned my addr 172.21.15.18:0/259553163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37400640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 0x7f4e3815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e2fe00640 1 --2- 172.21.15.18:0/259553163 >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 0x7f4e380cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 -- 172.21.15.18:0/259553163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 msgr2=0x7f4e3815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 0x7f4e3815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 -- 172.21.15.18:0/259553163 >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 msgr2=0x7f4e380cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 --2- 172.21.15.18:0/259553163 >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 0x7f4e380cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37e00640 1 -- 172.21.15.18:0/259553163 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380ce040 con 0x7f4e380b1750 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e37400640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 0x7f4e3815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:33.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.827+0000 7f4e2fe00640 1 --2- 172.21.15.18:0/259553163 >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 0x7f4e380cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e37e00640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380b1750 0x7f4e380b1ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b23c0 tx=0x7f4e3001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b29cd8c7e451019 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e36a00640 1 -- 172.21.15.18:0/259553163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a5760 con 0x7f4e380b1750 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e36a00640 1 -- 172.21.15.18:0/259553163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e300a5900 con 0x7f4e380b1750 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e36a00640 1 -- 172.21.15.18:0/259553163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300a5cd0 con 0x7f4e380b1750 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- 172.21.15.18:0/259553163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380b1750 msgr2=0x7f4e380b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380b1750 0x7f4e380b1ba0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4e380b23c0 tx=0x7f4e3001c9f0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- 172.21.15.18:0/259553163 shutdown_connections 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380b1750 0x7f4e380b1ba0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 --2- 172.21.15.18:0/259553163 >> v2:172.21.15.167:3300/0 conn(0x7f4e380cd4d0 0x7f4e380cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 --2- 172.21.15.18:0/259553163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e38145270 0x7f4e3815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- 172.21.15.18:0/259553163 >> 172.21.15.18:0/259553163 conn(0x7f4e38066fa0 msgr2=0x7f4e3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- 172.21.15.18:0/259553163 shutdown_connections 2024-04-25T10:06:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- 172.21.15.18:0/259553163 wait complete. 2024-04-25T10:06:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 Processor -- start 2024-04-25T10:06:33.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.831+0000 7f4e3e800640 1 -- start start 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e380b1750 0x7f4e3815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 0x7f4e380b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3815c590 con 0x7f4e380cd4d0 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3815f930 con 0x7f4e38145270 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3815c710 con 0x7f4e380b1750 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38136/0 (socket says 172.21.15.18:38136) 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 -- 172.21.15.18:0/1191653880 learned_addr learned my addr 172.21.15.18:0/1191653880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e37400640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e380b1750 0x7f4e3815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e37e00640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 0x7f4e380b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 -- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e380b1750 msgr2=0x7f4e3815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e380b1750 0x7f4e3815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 -- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 msgr2=0x7f4e380b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 0x7f4e380b2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 -- 172.21.15.18:0/1191653880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3813cee0 con 0x7f4e380cd4d0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e37e00640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 0x7f4e380b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2fe00640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000e810 tx=0x7f4e2000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e2000f040 con 0x7f4e380cd4d0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3813d470 con 0x7f4e380cd4d0 2024-04-25T10:06:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e20004030 con 0x7f4e380cd4d0 2024-04-25T10:06:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e20004400 con 0x7f4e380cd4d0 2024-04-25T10:06:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3813da30 con 0x7f4e380cd4d0 2024-04-25T10:06:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e380745d0 con 0x7f4e380cd4d0 2024-04-25T10:06:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.835+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e2000c6d0 con 0x7f4e380cd4d0 2024-04-25T10:06:33.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.839+0000 7f4e2f400640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.839+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4e20084ec0 con 0x7f4e380cd4d0 2024-04-25T10:06:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.839+0000 7f4e37400640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:33.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.839+0000 7f4e37400640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 0x7f4e14069420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4e280045f0 tx=0x7f4e28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:33.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:33.843+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e20017020 con 0x7f4e380cd4d0 2024-04-25T10:06:34.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.007+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e3806b8e0 con 0x7f4e380cd4d0 2024-04-25T10:06:34.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.007+0000 7f4e2f400640 1 -- 172.21.15.18:0/1191653880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16918 (secure 0 0 0) 0x7f4e200555d0 con 0x7f4e380cd4d0 2024-04-25T10:06:34.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:34.019 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":53,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:50.266838+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 msgr2=0x7f4e14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 0x7f4e14069420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4e280045f0 tx=0x7f4e28008040 comp rx=0 tx=0).stop 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 msgr2=0x7f4e381f6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f4e2000e810 tx=0x7f4e2000ecd0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 shutdown_connections 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e38145270 0x7f4e380b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e380cd4d0 0x7f4e381f6830 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e14066f60 0x7f4e14069420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 --2- 172.21.15.18:0/1191653880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e380b1750 0x7f4e3815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 >> 172.21.15.18:0/1191653880 conn(0x7f4e38066fa0 msgr2=0x7f4e380b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 shutdown_connections 2024-04-25T10:06:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.011+0000 7f4e3e800640 1 -- 172.21.15.18:0/1191653880 wait complete. 2024-04-25T10:06:34.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:05:47.057907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:05:47.647552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:06:34.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:06:34.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 Processor -- start 2024-04-25T10:06:34.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 -- start start 2024-04-25T10:06:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 0x7f88fc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc15bc40 con 0x7f88fc144120 2024-04-25T10:06:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc15b3a0 con 0x7f88fc15acd0 2024-04-25T10:06:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8903000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc15e490 con 0x7f88fc0b3090 2024-04-25T10:06:34.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f88fbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f88fc144120 0x7f88fc0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36082/0 (socket says 172.21.15.18:36082) 2024-04-25T10:06:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f88fbe00640 1 -- 172.21.15.18:0/2421615895 learned_addr learned my addr 172.21.15.18:0/2421615895 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8901000640 1 --2- 172.21.15.18:0/2421615895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 0x7f88fc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160442133 0 0) 0x7f88fc15bc40 con 0x7f88fc144120 2024-04-25T10:06:34.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0005740 con 0x7f88fc144120 2024-04-25T10:06:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282833051 0 0) 0x7f88fc15b3a0 con 0x7f88fc15acd0 2024-04-25T10:06:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8901000640 1 -- 172.21.15.18:0/2421615895 >> v1:172.21.15.167:6789/0 conn(0x7f88fc15acd0 legacy=0x7f88fc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8901000640 1 -- 172.21.15.18:0/2421615895 >> v1:172.21.15.18:6789/0 conn(0x7f88fc144120 legacy=0x7f88fc0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.175+0000 7f8901000640 1 -- 172.21.15.18:0/2421615895 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc15b680 con 0x7f88fc0b3090 2024-04-25T10:06:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8901000640 1 --2- 172.21.15.18:0/2421615895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 0x7f88fc0b3520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f88fc15e610 tx=0x7f88f401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb7bbb2d829037bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec001680 con 0x7f88fc0b3090 2024-04-25T10:06:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40a8430 con 0x7f88fc0b3090 2024-04-25T10:06:34.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f88fb400640 1 -- 172.21.15.18:0/2421615895 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40a8800 con 0x7f88fc0b3090 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 -- 172.21.15.18:0/2421615895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 msgr2=0x7f88fc0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 --2- 172.21.15.18:0/2421615895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 0x7f88fc0b3520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f88fc15e610 tx=0x7f88f401c740 comp rx=0 tx=0).stop 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 -- 172.21.15.18:0/2421615895 shutdown_connections 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 --2- 172.21.15.18:0/2421615895 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc0b3090 0x7f88fc0b3520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 -- 172.21.15.18:0/2421615895 >> 172.21.15.18:0/2421615895 conn(0x7f88fc067080 msgr2=0x7f88fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 -- 172.21.15.18:0/2421615895 shutdown_connections 2024-04-25T10:06:34.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 -- 172.21.15.18:0/2421615895 wait complete. 2024-04-25T10:06:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.179+0000 7f8903000640 1 Processor -- start 2024-04-25T10:06:34.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- start start 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc144120 0x7f88fc15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88fc15acd0 0x7f88fc0a9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc06deb0 con 0x7f88fc0b3090 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc06dd30 con 0x7f88fc15acd0 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc06e030 con 0x7f88fc144120 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38146/0 (socket says 172.21.15.18:38146) 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 -- 172.21.15.18:0/2711048232 learned_addr learned my addr 172.21.15.18:0/2711048232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8901000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88fc15acd0 0x7f88fc0a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88f3400640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc144120 0x7f88fc15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 -- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc144120 msgr2=0x7f88fc15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc144120 0x7f88fc15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 -- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88fc15acd0 msgr2=0x7f88fc0a9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88fc15acd0 0x7f88fc0a9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 -- 172.21.15.18:0/2711048232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0a85f0 con 0x7f88fc0b3090 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88fbe00640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c7c0 tx=0x7f88ec00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec018070 con 0x7f88fc0b3090 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec0074e0 con 0x7f88fc0b3090 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc0aa600 con 0x7f88fc0b3090 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec004a10 con 0x7f88fc0b3090 2024-04-25T10:06:34.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc0a8b70 con 0x7f88fc0b3090 2024-04-25T10:06:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.183+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc0a8d70 con 0x7f88fc0b3090 2024-04-25T10:06:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.187+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88ec01b070 con 0x7f88fc0b3090 2024-04-25T10:06:34.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.187+0000 7f88f8c00640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.187+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88ec0847b0 con 0x7f88fc0b3090 2024-04-25T10:06:34.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.187+0000 7f88f3400640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.187+0000 7f88f3400640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f88fc15d100 tx=0x7f88e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.191+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88fc0a8d70 con 0x7f88fc0b3090 2024-04-25T10:06:34.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.355+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88fc0b3520 con 0x7f88fc0b3090 2024-04-25T10:06:34.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.355+0000 7f88f8c00640 1 -- 172.21.15.18:0/2711048232 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88ec054fd0 con 0x7f88fc0b3090 2024-04-25T10:06:34.368 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:06:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 msgr2=0x7f88d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 0x7f88d8069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f88fc15d100 tx=0x7f88e4009040 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 msgr2=0x7f88fc1f6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00c7c0 tx=0x7f88ec00cc80 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 shutdown_connections 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88fc15acd0 0x7f88fc0a9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88d8066f60 0x7f88d8069420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88fc144120 0x7f88fc15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 --2- 172.21.15.18:0/2711048232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88fc0b3090 0x7f88fc1f6b00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 >> 172.21.15.18:0/2711048232 conn(0x7f88fc067080 msgr2=0x7f88fc0b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 shutdown_connections 2024-04-25T10:06:34.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.359+0000 7f8903000640 1 -- 172.21.15.18:0/2711048232 wait complete. 2024-04-25T10:06:34.389 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:06:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 Processor -- start 2024-04-25T10:06:34.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 -- start start 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad40cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8ad40cf3c0 0x7f8ad40cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ad40d02a0 con 0x7f8ad40cd370 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ad40cc350 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad8e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad40cc630 con 0x7f8ad415b910 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8ad40cf3c0 0x7f8ad40cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad2800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8ad40cd370 0x7f8ad4099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36096/0 (socket says 172.21.15.18:36096) 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad2800640 1 -- 172.21.15.18:0/2293930350 learned_addr learned my addr 172.21.15.18:0/2293930350 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1e00640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad40cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1400640 1 -- 172.21.15.18:0/2293930350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 msgr2=0x7f8ad40cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1400640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad40cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1400640 1 -- 172.21.15.18:0/2293930350 >> v1:172.21.15.18:6789/0 conn(0x7f8ad40cd370 legacy=0x7f8ad4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad1400640 1 -- 172.21.15.18:0/2293930350 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40cc910 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.523+0000 7f8ad0a00640 1 -- 172.21.15.18:0/2293930350 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279859904 0 0) 0x7f8ad40d02a0 con 0x7f8ad40cd370 2024-04-25T10:06:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad1400640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cce30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912b41fa9946a25c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad0a00640 1 -- 172.21.15.18:0/2293930350 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00b1070 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad0a00640 1 -- 172.21.15.18:0/2293930350 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac00ac410 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad0a00640 1 -- 172.21.15.18:0/2293930350 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac00ac7e0 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- 172.21.15.18:0/2293930350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cf3c0 msgr2=0x7f8ad40cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cce30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00097c0 tx=0x7f8ac001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- 172.21.15.18:0/2293930350 shutdown_connections 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cce30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/2293930350 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad40cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- 172.21.15.18:0/2293930350 >> 172.21.15.18:0/2293930350 conn(0x7f8ad40b3200 msgr2=0x7f8ad40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- 172.21.15.18:0/2293930350 shutdown_connections 2024-04-25T10:06:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- 172.21.15.18:0/2293930350 wait complete. 2024-04-25T10:06:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 Processor -- start 2024-04-25T10:06:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.527+0000 7f8ad8e00640 1 -- start start 2024-04-25T10:06:34.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad409a2f0 con 0x7f8ad40cd370 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad409a170 con 0x7f8ad40cf3c0 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad415bcf0 con 0x7f8ad415b910 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38154/0 (socket says 172.21.15.18:38154) 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 -- 172.21.15.18:0/1869675515 learned_addr learned my addr 172.21.15.18:0/1869675515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1400640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad2800640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 -- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 msgr2=0x7f8ad414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad414d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 -- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad40cf3c0 msgr2=0x7f8ad40cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 -- 172.21.15.18:0/1869675515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad40ca500 con 0x7f8ad40cd370 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad1e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400d830 tx=0x7f8ac400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400b660 con 0x7f8ad40cd370 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ac4019070 con 0x7f8ad40cd370 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac400ba00 con 0x7f8ad40cd370 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ad40ca7e0 con 0x7f8ad40cd370 2024-04-25T10:06:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ad414cb70 con 0x7f8ad40cd370 2024-04-25T10:06:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.531+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ad40745d0 con 0x7f8ad40cd370 2024-04-25T10:06:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.535+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ac401e460 con 0x7f8ad40cd370 2024-04-25T10:06:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.535+0000 7f8aca000640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 0x7f8ab4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.535+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8ac4085860 con 0x7f8ad40cd370 2024-04-25T10:06:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.535+0000 7f8ad1400640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 0x7f8ab4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.535+0000 7f8ad1400640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 0x7f8ab4069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ae000 tx=0x7f8ac0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.539+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ac40566d0 con 0x7f8ad40cd370 2024-04-25T10:06:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.695+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ad40cdcd0 con 0x7f8ad40cd370 2024-04-25T10:06:34.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8aca000640 1 -- 172.21.15.18:0/1869675515 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ac4055fd0 con 0x7f8ad40cd370 2024-04-25T10:06:34.709 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:06:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 msgr2=0x7f8ab4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 0x7f8ab4069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8ac00ae000 tx=0x7f8ac0008040 comp rx=0 tx=0).stop 2024-04-25T10:06:34.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 msgr2=0x7f8ad414c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8ac400d830 tx=0x7f8ac400dcf0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 shutdown_connections 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ab4066f60 0x7f8ab4069420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8ad415b910 0x7f8ad414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8ad40cf3c0 0x7f8ad40cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 --2- 172.21.15.18:0/1869675515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ad40cd370 0x7f8ad414c630 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 >> 172.21.15.18:0/1869675515 conn(0x7f8ad40b3200 msgr2=0x7f8ad415ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 shutdown_connections 2024-04-25T10:06:34.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.699+0000 7f8ad8e00640 1 -- 172.21.15.18:0/1869675515 wait complete. 2024-04-25T10:06:34.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:06:34.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 Processor -- start 2024-04-25T10:06:34.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 -- start start 2024-04-25T10:06:34.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26a006e010 0x7f26a006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a015fc00 con 0x7f26a0159320 2024-04-25T10:06:34.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a006d640 con 0x7f26a006e010 2024-04-25T10:06:34.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a015fee0 con 0x7f26a015c9b0 2024-04-25T10:06:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26a006e010 0x7f26a006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26a006e010 0x7f26a006e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:46018/0 (socket says 172.21.15.18:46018) 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 -- 172.21.15.18:0/529080827 learned_addr learned my addr 172.21.15.18:0/529080827 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f26a0159320 0x7f26a015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:55056/0 (socket says 172.21.15.18:55056) 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:35262/0 (socket says 172.21.15.18:35262) 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 -- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 msgr2=0x7f26a006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 -- 172.21.15.18:0/529080827 >> v1:172.21.15.167:6789/0 conn(0x7f26a0159320 legacy=0x7f26a015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a5e00640 1 -- 172.21.15.18:0/529080827 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a01601c0 con 0x7f26a006e010 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f269fe00640 1 -- 172.21.15.18:0/529080827 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58422973 0 0) 0x7f26a015fc00 con 0x7f26a0159320 2024-04-25T10:06:34.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.863+0000 7f26a4a00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:34.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a5e00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e50 tx=0x7f269801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6af21616cb75343 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f269fe00640 1 -- 172.21.15.18:0/529080827 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980a5700 con 0x7f26a006e010 2024-04-25T10:06:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f269fe00640 1 -- 172.21.15.18:0/529080827 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26980a58a0 con 0x7f26a006e010 2024-04-25T10:06:34.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f269fe00640 1 -- 172.21.15.18:0/529080827 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980a5c70 con 0x7f26a006e010 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 -- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 msgr2=0x7f26a006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a006e4a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2698009e50 tx=0x7f269801ca30 comp rx=0 tx=0).stop 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 -- 172.21.15.18:0/529080827 shutdown_connections 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a006e4a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 --2- 172.21.15.18:0/529080827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 -- 172.21.15.18:0/529080827 >> 172.21.15.18:0/529080827 conn(0x7f26a0067080 msgr2=0x7f26a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:34.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 -- 172.21.15.18:0/529080827 shutdown_connections 2024-04-25T10:06:34.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.867+0000 7f26a7e00640 1 -- 172.21.15.18:0/529080827 wait complete. 2024-04-25T10:06:34.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 Processor -- start 2024-04-25T10:06:34.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- start start 2024-04-25T10:06:34.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a013c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a0143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0168920 con 0x7f26a0159320 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01687a0 con 0x7f26a006e010 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a0168aa0 con 0x7f26a015c9b0 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38168/0 (socket says 172.21.15.18:38168) 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 -- 172.21.15.18:0/2044622922 learned_addr learned my addr 172.21.15.18:0/2044622922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a5400640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a013c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a5e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a0143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 -- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 msgr2=0x7f26a0143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a0143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 -- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 msgr2=0x7f26a013c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a013c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:34.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 -- 172.21.15.18:0/2044622922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a01f6450 con 0x7f26a0159320 2024-04-25T10:06:34.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a4a00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f268c00ec10 tx=0x7f268c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c017070 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f268c00cc30 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f268c013470 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a01f9df0 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.871+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a01fa3b0 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a00745d0 con 0x7f26a0159320 2024-04-25T10:06:34.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f268c01a070 con 0x7f26a0159320 2024-04-25T10:06:34.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f269d600640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 0x7f2680069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:34.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f268c085540 con 0x7f26a0159320 2024-04-25T10:06:34.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f26a5400640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 0x7f2680069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:34.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.875+0000 7f26a5400640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 0x7f2680069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2694007fd0 tx=0x7f2694007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:34.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:34.879+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f268c055cd0 con 0x7f26a0159320 2024-04-25T10:06:35.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f26a01f9a80 con 0x7f26a0159320 2024-04-25T10:06:35.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f269d600640 1 -- 172.21.15.18:0/2044622922 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f268c059d70 con 0x7f26a0159320 2024-04-25T10:06:35.054 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:06:35.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 msgr2=0x7f2680069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 0x7f2680069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2694007fd0 tx=0x7f2694007d60 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 msgr2=0x7f26a00b3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f268c00ec10 tx=0x7f268c00c520 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 shutdown_connections 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2680066f60 0x7f2680069420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26a015c9b0 0x7f26a0143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26a0159320 0x7f26a00b3b60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 --2- 172.21.15.18:0/2044622922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26a006e010 0x7f26a013c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 >> 172.21.15.18:0/2044622922 conn(0x7f26a0067080 msgr2=0x7f26a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 shutdown_connections 2024-04-25T10:06:35.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.043+0000 7f26a7e00640 1 -- 172.21.15.18:0/2044622922 wait complete. 2024-04-25T10:06:35.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:06:35.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 Processor -- start 2024-04-25T10:06:35.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 -- start start 2024-04-25T10:06:35.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 0x7fd61015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd61015ee60 0x7fd6100b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd61015bc40 con 0x7fd610144120 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61015e490 con 0x7fd61015ee60 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd618000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61015b150 con 0x7fd61015acd0 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd61015ee60 0x7fd6100b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd615600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd610144120 0x7fd6100ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36100/0 (socket says 172.21.15.18:36100) 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd615600640 1 -- 172.21.15.18:0/3649190368 learned_addr learned my addr 172.21.15.18:0/3649190368 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 --2- 172.21.15.18:0/3649190368 >> v2:172.21.15.18:3300/0 conn(0x7fd61015ee60 0x7fd6100b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38174/0 (socket says 172.21.15.18:38174) 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd614c00640 1 --2- 172.21.15.18:0/3649190368 >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 0x7fd61015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 -- 172.21.15.18:0/3649190368 >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 msgr2=0x7fd61015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 --2- 172.21.15.18:0/3649190368 >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 0x7fd61015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 -- 172.21.15.18:0/3649190368 >> v1:172.21.15.18:6789/0 conn(0x7fd610144120 legacy=0x7fd6100ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd616000640 1 -- 172.21.15.18:0/3649190368 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61015b3a0 con 0x7fd61015ee60 2024-04-25T10:06:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd614c00640 1 --2- 172.21.15.18:0/3649190368 >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 0x7fd61015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:35.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.207+0000 7fd60fe00640 1 -- 172.21.15.18:0/3649190368 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182954018 0 0) 0x7fd61015bc40 con 0x7fd610144120 2024-04-25T10:06:35.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd616000640 1 --2- 172.21.15.18:0/3649190368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b3090 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd61006b870 tx=0x7fd60801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2bce74d950f2fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd60fe00640 1 -- 172.21.15.18:0/3649190368 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080b2070 con 0x7fd61015ee60 2024-04-25T10:06:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd60fe00640 1 -- 172.21.15.18:0/3649190368 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6080a5760 con 0x7fd61015ee60 2024-04-25T10:06:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd60fe00640 1 -- 172.21.15.18:0/3649190368 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080a5b30 con 0x7fd61015ee60 2024-04-25T10:06:35.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 -- 172.21.15.18:0/3649190368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 msgr2=0x7fd6100b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 --2- 172.21.15.18:0/3649190368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b3090 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd61006b870 tx=0x7fd60801c8a0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 -- 172.21.15.18:0/3649190368 shutdown_connections 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 --2- 172.21.15.18:0/3649190368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b3090 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 --2- 172.21.15.18:0/3649190368 >> v2:172.21.15.167:3300/0 conn(0x7fd61015acd0 0x7fd61015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 -- 172.21.15.18:0/3649190368 >> 172.21.15.18:0/3649190368 conn(0x7fd610067080 msgr2=0x7fd61006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 -- 172.21.15.18:0/3649190368 shutdown_connections 2024-04-25T10:06:35.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.211+0000 7fd618000640 1 -- 172.21.15.18:0/3649190368 wait complete. 2024-04-25T10:06:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 Processor -- start 2024-04-25T10:06:35.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- start start 2024-04-25T10:06:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 0x7fd610164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61015acd0 0x7fd6100b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610165fd0 con 0x7fd61015ee60 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd610165e50 con 0x7fd61015acd0 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd610166150 con 0x7fd610144120 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38186/0 (socket says 172.21.15.18:38186) 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 -- 172.21.15.18:0/182370092 learned_addr learned my addr 172.21.15.18:0/182370092 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd614c00640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61015acd0 0x7fd6100b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd615600640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 0x7fd610164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 -- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 msgr2=0x7fd610164470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 0x7fd610164470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 -- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61015acd0 msgr2=0x7fd6100b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61015acd0 0x7fd6100b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 -- 172.21.15.18:0/182370092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610159b70 con 0x7fd61015ee60 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd615600640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 0x7fd610164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd616000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd6080b0040 tx=0x7fd608019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080bd030 con 0x7fd61015ee60 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6080a5560 con 0x7fd61015ee60 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6080b2040 con 0x7fd61015ee60 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd610159e50 con 0x7fd61015ee60 2024-04-25T10:06:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.215+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd610166b40 con 0x7fd61015ee60 2024-04-25T10:06:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6100745d0 con 0x7fd61015ee60 2024-04-25T10:06:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6080c0070 con 0x7fd61015ee60 2024-04-25T10:06:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd60d600640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 0x7fd5f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd60811ff80 con 0x7fd61015ee60 2024-04-25T10:06:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd615600640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 0x7fd5f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.219+0000 7fd615600640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 0x7fd5f0069450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd604000f70 tx=0x7fd604007cb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.223+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd608016520 con 0x7fd61015ee60 2024-04-25T10:06:35.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.395+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd61015e010 con 0x7fd61015ee60 2024-04-25T10:06:35.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd60d600640 1 -- 172.21.15.18:0/182370092 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6080f0d70 con 0x7fd61015ee60 2024-04-25T10:06:35.409 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 msgr2=0x7fd5f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 0x7fd5f0069450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fd604000f70 tx=0x7fd604007cb0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 msgr2=0x7fd6100b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd6080b0040 tx=0x7fd608019640 comp rx=0 tx=0).stop 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 shutdown_connections 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd61015ee60 0x7fd6100b1820 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd61015acd0 0x7fd6100b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd5f0066f90 0x7fd5f0069450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 --2- 172.21.15.18:0/182370092 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd610144120 0x7fd610164470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 >> 172.21.15.18:0/182370092 conn(0x7fd610067080 msgr2=0x7fd61013cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:35.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 shutdown_connections 2024-04-25T10:06:35.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.399+0000 7fd618000640 1 -- 172.21.15.18:0/182370092 wait complete. 2024-04-25T10:06:35.431 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:06:35.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:35.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:06:35.481 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:06:35.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:06:35.481 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:06:35.538 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:06:35.538 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:35.547 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:06:35.547 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:35.547 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:35.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:06:35.593 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:06:35.593 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:35.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:06:35.602 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:35.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 Processor -- start 2024-04-25T10:06:35.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 -- start start 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f374c15dcd0 0x7f374c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c06d740 con 0x7f374c0b06c0 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0cbfc0 con 0x7f374c15dcd0 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3752000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c06cea0 con 0x7f374c09a7a0 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f374c15dcd0 0x7f374c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f374c15dcd0 0x7f374c099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38188/0 (socket says 172.21.15.18:38188) 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 -- 172.21.15.18:0/3021377685 learned_addr learned my addr 172.21.15.18:0/3021377685 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 -- 172.21.15.18:0/3021377685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 msgr2=0x7f374c099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3743e00640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 -- 172.21.15.18:0/3021377685 >> v1:172.21.15.167:6789/0 conn(0x7f374c0b06c0 legacy=0x7f374c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3750c00640 1 -- 172.21.15.18:0/3021377685 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c06d180 con 0x7f374c15dcd0 2024-04-25T10:06:35.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.771+0000 7f3743e00640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3750c00640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c099a60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f373c009870 tx=0x7f373c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4a04fa99f4df2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f374be00640 1 -- 172.21.15.18:0/3021377685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0aa610 con 0x7f374c15dcd0 2024-04-25T10:06:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f374be00640 1 -- 172.21.15.18:0/3021377685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c0af070 con 0x7f374c15dcd0 2024-04-25T10:06:35.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f374be00640 1 -- 172.21.15.18:0/3021377685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c0aa9d0 con 0x7f374c15dcd0 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- 172.21.15.18:0/3021377685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 msgr2=0x7f374c099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c099a60 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f373c009870 tx=0x7f373c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- 172.21.15.18:0/3021377685 shutdown_connections 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 --2- 172.21.15.18:0/3021377685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c099a60 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- 172.21.15.18:0/3021377685 >> 172.21.15.18:0/3021377685 conn(0x7f374c0b3050 msgr2=0x7f374c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- 172.21.15.18:0/3021377685 shutdown_connections 2024-04-25T10:06:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- 172.21.15.18:0/3021377685 wait complete. 2024-04-25T10:06:35.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 Processor -- start 2024-04-25T10:06:35.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.775+0000 7f3752000640 1 -- start start 2024-04-25T10:06:35.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c0b06c0 0x7f374c151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c16aa20 con 0x7f374c15dcd0 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c16a8a0 con 0x7f374c0b06c0 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c16aba0 con 0x7f374c09a7a0 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3750c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38196/0 (socket says 172.21.15.18:38196) 2024-04-25T10:06:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 -- 172.21.15.18:0/3369045577 learned_addr learned my addr 172.21.15.18:0/3369045577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3743e00640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c0b06c0 0x7f374c151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 -- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 msgr2=0x7f374c15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c15cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 -- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c0b06c0 msgr2=0x7f374c151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c0b06c0 0x7f374c151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 -- 172.21.15.18:0/3369045577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c15c160 con 0x7f374c15dcd0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3751600640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f374400b970 tx=0x7f374400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744019070 con 0x7f374c15dcd0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400cb40 con 0x7f374c15dcd0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744014440 con 0x7f374c15dcd0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c15c440 con 0x7f374c15dcd0 2024-04-25T10:06:35.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c0c87b0 con 0x7f374c15dcd0 2024-04-25T10:06:35.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c04efa0 con 0x7f374c15dcd0 2024-04-25T10:06:35.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.779+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f374401c070 con 0x7f374c15dcd0 2024-04-25T10:06:35.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.783+0000 7f3749600640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:35.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.783+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3744084e10 con 0x7f374c15dcd0 2024-04-25T10:06:35.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.783+0000 7f3750c00640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:35.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.783+0000 7f3750c00640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 0x7f3728069420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ae000 tx=0x7f373c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:35.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.787+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3744088030 con 0x7f374c15dcd0 2024-04-25T10:06:35.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.979+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f374c15a9b0 con 0x7f374c15dcd0 2024-04-25T10:06:35.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.979+0000 7f3749600640 1 -- 172.21.15.18:0/3369045577 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f37440555a0 con 0x7f374c15dcd0 2024-04-25T10:06:35.992 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:35.992 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:35.992 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 msgr2=0x7f3728069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 0x7f3728069420 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f373c0ae000 tx=0x7f373c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 msgr2=0x7f374c152100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f374400b970 tx=0x7f374400be30 comp rx=0 tx=0).stop 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 shutdown_connections 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f374c15dcd0 0x7f374c152100 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f374c0b06c0 0x7f374c151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3728066f60 0x7f3728069420 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 --2- 172.21.15.18:0/3369045577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f374c09a7a0 0x7f374c15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:35.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 >> 172.21.15.18:0/3369045577 conn(0x7f374c0b3050 msgr2=0x7f374c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:35.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 shutdown_connections 2024-04-25T10:06:35.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:35.983+0000 7f3752000640 1 -- 172.21.15.18:0/3369045577 wait complete. 2024-04-25T10:06:36.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:36.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 Processor -- start 2024-04-25T10:06:36.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 -- start start 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4b015b2f0 0x7fd4b00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd4b00b2dc0 0x7fd4b00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b015def0 con 0x7fd4b006dad0 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b015e1b0 con 0x7fd4b015b2f0 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4b4c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b015e490 con 0x7fd4b00b2dc0 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4ade00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4b015b2f0 0x7fd4b00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4ade00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4b015b2f0 0x7fd4b00b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38200/0 (socket says 172.21.15.18:38200) 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4ade00640 1 -- 172.21.15.18:0/2527607552 learned_addr learned my addr 172.21.15.18:0/2527607552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.143+0000 7fd4a7e00640 1 --2- 172.21.15.18:0/2527607552 >> v2:172.21.15.167:3300/0 conn(0x7fd4b00b2dc0 0x7fd4b00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ade00640 1 -- 172.21.15.18:0/2527607552 >> v2:172.21.15.167:3300/0 conn(0x7fd4b00b2dc0 msgr2=0x7fd4b00b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:36.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ade00640 1 --2- 172.21.15.18:0/2527607552 >> v2:172.21.15.167:3300/0 conn(0x7fd4b00b2dc0 0x7fd4b00b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ade00640 1 -- 172.21.15.18:0/2527607552 >> v1:172.21.15.167:6789/0 conn(0x7fd4b006dad0 legacy=0x7fd4b006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ade00640 1 -- 172.21.15.18:0/2527607552 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b015e770 con 0x7fd4b015b2f0 2024-04-25T10:06:36.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ade00640 1 --2- 172.21.15.18:0/2527607552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00b3240 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0067200 tx=0x7fd4a001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f865325d99eab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ad400640 1 -- 172.21.15.18:0/2527607552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b015b8e0 con 0x7fd4b015b2f0 2024-04-25T10:06:36.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ad400640 1 -- 172.21.15.18:0/2527607552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a00af070 con 0x7fd4b015b2f0 2024-04-25T10:06:36.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4ad400640 1 -- 172.21.15.18:0/2527607552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00aa890 con 0x7fd4b015b2f0 2024-04-25T10:06:36.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 -- 172.21.15.18:0/2527607552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b015b2f0 msgr2=0x7fd4b00b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/2527607552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00b3240 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0067200 tx=0x7fd4a001c4f0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 -- 172.21.15.18:0/2527607552 shutdown_connections 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/2527607552 >> v2:172.21.15.167:3300/0 conn(0x7fd4b00b2dc0 0x7fd4b00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/2527607552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00b3240 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 -- 172.21.15.18:0/2527607552 >> 172.21.15.18:0/2527607552 conn(0x7fd4b00b23b0 msgr2=0x7fd4b00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 -- 172.21.15.18:0/2527607552 shutdown_connections 2024-04-25T10:06:36.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.147+0000 7fd4b4c00640 1 -- 172.21.15.18:0/2527607552 wait complete. 2024-04-25T10:06:36.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 Processor -- start 2024-04-25T10:06:36.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 -- start start 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 0x7fd4b01522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b016a880 con 0x7fd4b006dad0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b01616f0 con 0x7fd4b015b2f0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4b4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b016aa00 con 0x7fd4b00b2dc0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38212/0 (socket says 172.21.15.18:38212) 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 -- 172.21.15.18:0/1891366690 learned_addr learned my addr 172.21.15.18:0/1891366690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4a7e00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 0x7fd4b01522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ae800640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 -- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 msgr2=0x7fd4b01522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 0x7fd4b01522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 -- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 msgr2=0x7fd4b00affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 -- 172.21.15.18:0/1891366690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0152c10 con 0x7fd4b006dad0 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4a7e00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 0x7fd4b01522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:36.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ae800640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4ade00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0019100 tx=0x7fd4a001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00bd5f0 con 0x7fd4b006dad0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a00bd790 con 0x7fd4b006dad0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.151+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a00bdb80 con 0x7fd4b006dad0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b0152ef0 con 0x7fd4b006dad0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b01534b0 con 0x7fd4b006dad0 2024-04-25T10:06:36.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b00745d0 con 0x7fd4b006dad0 2024-04-25T10:06:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4a00b33f0 con 0x7fd4b006dad0 2024-04-25T10:06:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4a6000640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 0x7fd48c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd4a0120130 con 0x7fd4b006dad0 2024-04-25T10:06:36.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4a7e00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 0x7fd48c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.155+0000 7fd4a7e00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 0x7fd48c069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0153f50 tx=0x7fd498008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.159+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4a00c3060 con 0x7fd4b006dad0 2024-04-25T10:06:36.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.327+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4b00d0ab0 con 0x7fd4b006dad0 2024-04-25T10:06:36.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.327+0000 7fd4a6000640 1 -- 172.21.15.18:0/1891366690 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16918 (secure 0 0 0) 0x7fd4a0117e20 con 0x7fd4b006dad0 2024-04-25T10:06:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:36.340 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":53,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:05:50.266838+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:36.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 msgr2=0x7fd48c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 0x7fd48c069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0153f50 tx=0x7fd498008040 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 msgr2=0x7fd4b0151a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0019100 tx=0x7fd4a001ad30 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 shutdown_connections 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b015b2f0 0x7fd4b00affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd48c066f60 0x7fd48c069420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd4b00b2dc0 0x7fd4b01522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 --2- 172.21.15.18:0/1891366690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4b006dad0 0x7fd4b0151a90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 >> 172.21.15.18:0/1891366690 conn(0x7fd4b00b23b0 msgr2=0x7fd4b006dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 shutdown_connections 2024-04-25T10:06:36.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.331+0000 7fd4b4c00640 1 -- 172.21.15.18:0/1891366690 wait complete. 2024-04-25T10:06:36.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:05:47.057907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:05:47.647552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:06:36.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:06:36.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 Processor -- start 2024-04-25T10:06:36.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 -- start start 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 0x7fa06806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06815fc00 con 0x7fa06815c9b0 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06815fee0 con 0x7fa068159320 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.495+0000 7fa06da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06806ee50 con 0x7fa06806e4a0 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa05e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa06815c9b0 0x7fa06806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36110/0 (socket says 172.21.15.18:36110) 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa05e000640 1 -- 172.21.15.18:0/1490955277 learned_addr learned my addr 172.21.15.18:0/1490955277 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa067400640 1 --2- 172.21.15.18:0/1490955277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 0x7fa06806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa066000640 1 -- 172.21.15.18:0/1490955277 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609051803 0 0) 0x7fa06815fc00 con 0x7fa06815c9b0 2024-04-25T10:06:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa066000640 1 -- 172.21.15.18:0/1490955277 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa04c003530 con 0x7fa06815c9b0 2024-04-25T10:06:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa067400640 1 -- 172.21.15.18:0/1490955277 >> v1:172.21.15.167:6789/0 conn(0x7fa068159320 legacy=0x7fa06815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa067400640 1 -- 172.21.15.18:0/1490955277 >> v1:172.21.15.18:6789/0 conn(0x7fa06815c9b0 legacy=0x7fa06806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa067400640 1 -- 172.21.15.18:0/1490955277 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0681601c0 con 0x7fa06806e4a0 2024-04-25T10:06:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.499+0000 7fa067400640 1 --2- 172.21.15.18:0/1490955277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 0x7fa06806e910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0600097f0 tx=0x7fa06001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90e4f3338aa4078e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa066000640 1 -- 172.21.15.18:0/1490955277 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600b0070 con 0x7fa06806e4a0 2024-04-25T10:06:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa066000640 1 -- 172.21.15.18:0/1490955277 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0600ab600 con 0x7fa06806e4a0 2024-04-25T10:06:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa066000640 1 -- 172.21.15.18:0/1490955277 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600ab9d0 con 0x7fa06806e4a0 2024-04-25T10:06:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- 172.21.15.18:0/1490955277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 msgr2=0x7fa06806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 --2- 172.21.15.18:0/1490955277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 0x7fa06806e910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa0600097f0 tx=0x7fa06001c4e0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- 172.21.15.18:0/1490955277 shutdown_connections 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 --2- 172.21.15.18:0/1490955277 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06806e4a0 0x7fa06806e910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- 172.21.15.18:0/1490955277 >> 172.21.15.18:0/1490955277 conn(0x7fa068067080 msgr2=0x7fa06806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- 172.21.15.18:0/1490955277 shutdown_connections 2024-04-25T10:06:36.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- 172.21.15.18:0/1490955277 wait complete. 2024-04-25T10:06:36.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 Processor -- start 2024-04-25T10:06:36.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- start start 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 0x7fa0680afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06815c9b0 0x7fa06815e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa068169720 con 0x7fa068159320 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681695a0 con 0x7fa06806e4a0 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa06da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0681698a0 con 0x7fa06815c9b0 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa05e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa05e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38218/0 (socket says 172.21.15.18:38218) 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa05e000640 1 -- 172.21.15.18:0/1932556607 learned_addr learned my addr 172.21.15.18:0/1932556607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa066a00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 0x7fa0680afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.503+0000 7fa067400640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06815c9b0 0x7fa06815e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 -- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06815c9b0 msgr2=0x7fa06815e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06815c9b0 0x7fa06815e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 -- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 msgr2=0x7fa0680afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 0x7fa0680afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 -- 172.21.15.18:0/1932556607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0680af940 con 0x7fa068159320 2024-04-25T10:06:36.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa066a00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 0x7fa0680afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05e000640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c4d0 tx=0x7fa05000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050017070 con 0x7fa068159320 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050005cf0 con 0x7fa068159320 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0680b01c0 con 0x7fa068159320 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050007270 con 0x7fa068159320 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0680b3280 con 0x7fa068159320 2024-04-25T10:06:36.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.507+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0680745d0 con 0x7fa068159320 2024-04-25T10:06:36.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.511+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa05001a070 con 0x7fa068159320 2024-04-25T10:06:36.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.511+0000 7fa05f400640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 0x7fa044069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.511+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa050084990 con 0x7fa068159320 2024-04-25T10:06:36.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.511+0000 7fa066a00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 0x7fa044069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.511+0000 7fa066a00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 0x7fa044069450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa058001d70 tx=0x7fa058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.515+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa050055170 con 0x7fa068159320 2024-04-25T10:06:36.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.675+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa068073e70 con 0x7fa068159320 2024-04-25T10:06:36.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.675+0000 7fa05f400640 1 -- 172.21.15.18:0/1932556607 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa050059210 con 0x7fa068159320 2024-04-25T10:06:36.688 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 msgr2=0x7fa044069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 0x7fa044069450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa058001d70 tx=0x7fa058009040 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 msgr2=0x7fa06813d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c4d0 tx=0x7fa05000c990 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 shutdown_connections 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa044066f90 0x7fa044069450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa06815c9b0 0x7fa06815e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa068159320 0x7fa06813d100 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 --2- 172.21.15.18:0/1932556607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa06806e4a0 0x7fa0680afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 >> 172.21.15.18:0/1932556607 conn(0x7fa068067080 msgr2=0x7fa06806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 shutdown_connections 2024-04-25T10:06:36.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.679+0000 7fa06da00640 1 -- 172.21.15.18:0/1932556607 wait complete. 2024-04-25T10:06:36.709 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:06:36.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 Processor -- start 2024-04-25T10:06:36.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 -- start start 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 0x7f853c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f853c06e4a0 0x7f853c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853c15fc00 con 0x7f853c15f440 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c06d640 con 0x7f853c06e4a0 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8544800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f853c06ee10 con 0x7f853c159320 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f853c06e4a0 0x7f853c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f853c06e4a0 0x7f853c06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38220/0 (socket says 172.21.15.18:38220) 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 -- 172.21.15.18:0/3027693669 learned_addr learned my addr 172.21.15.18:0/3027693669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8541e00640 1 --2- 172.21.15.18:0/3027693669 >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 0x7f853c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 -- 172.21.15.18:0/3027693669 >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 msgr2=0x7f853c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 --2- 172.21.15.18:0/3027693669 >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 0x7f853c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 -- 172.21.15.18:0/3027693669 >> v1:172.21.15.167:6789/0 conn(0x7f853c15f440 legacy=0x7f853c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8542800640 1 -- 172.21.15.18:0/3027693669 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c15fee0 con 0x7f853c06e4a0 2024-04-25T10:06:36.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.843+0000 7f8541e00640 1 --2- 172.21.15.18:0/3027693669 >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 0x7f853c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:36.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8542800640 1 --2- 172.21.15.18:0/3027693669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c06e8d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f853c06e470 tx=0x7f853801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66248202354953b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8540a00640 1 -- 172.21.15.18:0/3027693669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380a57f0 con 0x7f853c06e4a0 2024-04-25T10:06:36.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8540a00640 1 -- 172.21.15.18:0/3027693669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85380a5990 con 0x7f853c06e4a0 2024-04-25T10:06:36.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8540a00640 1 -- 172.21.15.18:0/3027693669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85380a5d60 con 0x7f853c06e4a0 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- 172.21.15.18:0/3027693669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 msgr2=0x7f853c06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 --2- 172.21.15.18:0/3027693669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c06e8d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f853c06e470 tx=0x7f853801c930 comp rx=0 tx=0).stop 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- 172.21.15.18:0/3027693669 shutdown_connections 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 --2- 172.21.15.18:0/3027693669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c06e8d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 --2- 172.21.15.18:0/3027693669 >> v2:172.21.15.167:3300/0 conn(0x7f853c159320 0x7f853c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- 172.21.15.18:0/3027693669 >> 172.21.15.18:0/3027693669 conn(0x7f853c067080 msgr2=0x7f853c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- 172.21.15.18:0/3027693669 shutdown_connections 2024-04-25T10:06:36.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- 172.21.15.18:0/3027693669 wait complete. 2024-04-25T10:06:36.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 Processor -- start 2024-04-25T10:06:36.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.847+0000 7f8544800640 1 -- start start 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c159320 0x7f853c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f853c15f440 0x7f853c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c15f820 con 0x7f853c06e4a0 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f853c159700 con 0x7f853c159320 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853c15f9a0 con 0x7f853c15f440 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38232/0 (socket says 172.21.15.18:38232) 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 -- 172.21.15.18:0/1538788135 learned_addr learned my addr 172.21.15.18:0/1538788135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 -- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f853c15f440 msgr2=0x7f853c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f853c15f440 0x7f853c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 -- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c159320 msgr2=0x7f853c0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:36.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c159320 0x7f853c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:36.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 -- 172.21.15.18:0/1538788135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c145040 con 0x7f853c06e4a0 2024-04-25T10:06:36.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8541e00640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f853000e810 tx=0x7f853000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530017070 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000c8d0 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000f040 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f853c0af9d0 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853c0aff90 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f853c0745d0 con 0x7f853c06e4a0 2024-04-25T10:06:36.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.851+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f853001a070 con 0x7f853c06e4a0 2024-04-25T10:06:36.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.855+0000 7f8536000640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 0x7f8520069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:36.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.855+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8530084e30 con 0x7f853c06e4a0 2024-04-25T10:06:36.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.855+0000 7f8541400640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 0x7f8520069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:36.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.855+0000 7f8541400640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 0x7f8520069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f852c000f70 tx=0x7f852c0079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:36.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:36.859+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8530055be0 con 0x7f853c06e4a0 2024-04-25T10:06:37.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.015+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f853c15dbe0 con 0x7f853c06e4a0 2024-04-25T10:06:37.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.015+0000 7f8536000640 1 -- 172.21.15.18:0/1538788135 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85300554e0 con 0x7f853c06e4a0 2024-04-25T10:06:37.028 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:06:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 msgr2=0x7f8520069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 0x7f8520069450 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f852c000f70 tx=0x7f852c0079e0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 msgr2=0x7f853c1f4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f853000e810 tx=0x7f853000ecd0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 shutdown_connections 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8520066f90 0x7f8520069450 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f853c15f440 0x7f853c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f853c159320 0x7f853c0b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 --2- 172.21.15.18:0/1538788135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f853c06e4a0 0x7f853c1f4540 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 >> 172.21.15.18:0/1538788135 conn(0x7f853c067080 msgr2=0x7f853c165d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 shutdown_connections 2024-04-25T10:06:37.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.019+0000 7f8544800640 1 -- 172.21.15.18:0/1538788135 wait complete. 2024-04-25T10:06:37.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:06:37.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.179+0000 7f8b59c00640 1 Processor -- start 2024-04-25T10:06:37.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.179+0000 7f8b59c00640 1 -- start start 2024-04-25T10:06:37.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415dc00 0x7f8b540af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 0x7f8b540c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 0x7f8b5406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540c7540 con 0x7f8b5415dc00 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b540cd860 con 0x7f8b540d0150 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b59c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b30d0 con 0x7f8b540c70d0 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415dc00 0x7f8b540af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415dc00 0x7f8b540af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38246/0 (socket says 172.21.15.18:38246) 2024-04-25T10:06:37.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 -- 172.21.15.18:0/466941587 learned_addr learned my addr 172.21.15.18:0/466941587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 -- 172.21.15.18:0/466941587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 msgr2=0x7f8b5406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b4be00640 1 --2- 172.21.15.18:0/466941587 >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 0x7f8b540c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b53400640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 0x7f8b5406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 0x7f8b5406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 -- 172.21.15.18:0/466941587 >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 msgr2=0x7f8b540c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 --2- 172.21.15.18:0/466941587 >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 0x7f8b540c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b52a00640 1 -- 172.21.15.18:0/466941587 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540ccf30 con 0x7f8b5415dc00 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b4be00640 1 --2- 172.21.15.18:0/466941587 >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 0x7f8b540c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.183+0000 7f8b53400640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 0x7f8b5406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b52a00640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415dc00 0x7f8b540af770 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b54072850 tx=0x7f8b4401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e65fc7d79f492 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b52000640 1 -- 172.21.15.18:0/466941587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440b0070 con 0x7f8b5415dc00 2024-04-25T10:06:37.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b52000640 1 -- 172.21.15.18:0/466941587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440ab600 con 0x7f8b5415dc00 2024-04-25T10:06:37.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b52000640 1 -- 172.21.15.18:0/466941587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440ab9d0 con 0x7f8b5415dc00 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- 172.21.15.18:0/466941587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415dc00 msgr2=0x7f8b540af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415dc00 0x7f8b540af770 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f8b54072850 tx=0x7f8b4401c260 comp rx=0 tx=0).stop 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- 172.21.15.18:0/466941587 shutdown_connections 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b540c70d0 0x7f8b5406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 --2- 172.21.15.18:0/466941587 >> v2:172.21.15.167:3300/0 conn(0x7f8b540d0150 0x7f8b540c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 --2- 172.21.15.18:0/466941587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415dc00 0x7f8b540af770 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- 172.21.15.18:0/466941587 >> 172.21.15.18:0/466941587 conn(0x7f8b540b2240 msgr2=0x7f8b540b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- 172.21.15.18:0/466941587 shutdown_connections 2024-04-25T10:06:37.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- 172.21.15.18:0/466941587 wait complete. 2024-04-25T10:06:37.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 Processor -- start 2024-04-25T10:06:37.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.187+0000 7f8b59c00640 1 -- start start 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 0x7f8b54155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b5415dc00 0x7f8b54156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540cde70 con 0x7f8b540c70d0 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540cdcf0 con 0x7f8b540d0150 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540c54b0 con 0x7f8b5415dc00 2024-04-25T10:06:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38260/0 (socket says 172.21.15.18:38260) 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 -- 172.21.15.18:0/586927898 learned_addr learned my addr 172.21.15.18:0/586927898 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4be00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 0x7f8b54155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 -- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b5415dc00 msgr2=0x7f8b54156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b5415dc00 0x7f8b54156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 -- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 msgr2=0x7f8b54155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 0x7f8b54155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 -- 172.21.15.18:0/586927898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540b2070 con 0x7f8b540c70d0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4be00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 0x7f8b54155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b52a00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ae040 tx=0x7f8b4401aaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440ba020 con 0x7f8b540c70d0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b440b6640 con 0x7f8b540c70d0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5415d410 con 0x7f8b540c70d0 2024-04-25T10:06:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440b0040 con 0x7f8b540c70d0 2024-04-25T10:06:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5414a2a0 con 0x7f8b540c70d0 2024-04-25T10:06:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b540745d0 con 0x7f8b540c70d0 2024-04-25T10:06:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.191+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b440bd020 con 0x7f8b540c70d0 2024-04-25T10:06:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.195+0000 7f8b4aa00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 0x7f8b30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.195+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8b4411f4d0 con 0x7f8b540c70d0 2024-04-25T10:06:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.195+0000 7f8b4be00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 0x7f8b30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.195+0000 7f8b4be00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 0x7f8b30069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8b541576c0 tx=0x7f8b3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.199+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b440c4030 con 0x7f8b540c70d0 2024-04-25T10:06:37.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.363+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b54151da0 con 0x7f8b540c70d0 2024-04-25T10:06:37.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.363+0000 7f8b4aa00640 1 -- 172.21.15.18:0/586927898 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b44016110 con 0x7f8b540c70d0 2024-04-25T10:06:37.377 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 msgr2=0x7f8b30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 0x7f8b30069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f8b541576c0 tx=0x7f8b3c008040 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 msgr2=0x7f8b541498c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8b440ae040 tx=0x7f8b4401aaa0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 shutdown_connections 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f60 0x7f8b30069420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b5415dc00 0x7f8b54156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b540d0150 0x7f8b54155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 --2- 172.21.15.18:0/586927898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b540c70d0 0x7f8b541498c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 >> 172.21.15.18:0/586927898 conn(0x7f8b540b2240 msgr2=0x7f8b5414ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 shutdown_connections 2024-04-25T10:06:37.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.367+0000 7f8b59c00640 1 -- 172.21.15.18:0/586927898 wait complete. 2024-04-25T10:06:37.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.535+0000 7f8b58a00640 1 Processor -- start 2024-04-25T10:06:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.535+0000 7f8b58a00640 1 -- start start 2024-04-25T10:06:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.535+0000 7f8b58a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 0x7f8b54099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.535+0000 7f8b58a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415ee00 0x7f8b5406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b58a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5409a380 con 0x7f8b541616a0 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b58a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5406c650 con 0x7f8b5415ee00 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b58a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5406c930 con 0x7f8b54099a60 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415ee00 0x7f8b5406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b5415ee00 0x7f8b5406bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38266/0 (socket says 172.21.15.18:38266) 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 -- 172.21.15.18:0/22627467 learned_addr learned my addr 172.21.15.18:0/22627467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b51e00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 0x7f8b54099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 -- 172.21.15.18:0/22627467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 msgr2=0x7f8b54099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 0x7f8b54099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 -- 172.21.15.18:0/22627467 >> v1:172.21.15.167:6789/0 conn(0x7f8b541616a0 legacy=0x7f8b54161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 -- 172.21.15.18:0/22627467 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5406cc10 con 0x7f8b5415ee00 2024-04-25T10:06:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b51e00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 0x7f8b54099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b4be00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b5406bd20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e328e1e997d884 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b51400640 1 -- 172.21.15.18:0/22627467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b2070 con 0x7f8b5415ee00 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b51400640 1 -- 172.21.15.18:0/22627467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0ad640 con 0x7f8b5415ee00 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.539+0000 7f8b51400640 1 -- 172.21.15.18:0/22627467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0ada10 con 0x7f8b5415ee00 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- 172.21.15.18:0/22627467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 msgr2=0x7f8b5406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b5406bd20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c009870 tx=0x7f8b3c01c520 comp rx=0 tx=0).stop 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- 172.21.15.18:0/22627467 shutdown_connections 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b5406bd20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- 172.21.15.18:0/22627467 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b54099a60 0x7f8b54099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- 172.21.15.18:0/22627467 >> 172.21.15.18:0/22627467 conn(0x7f8b540d17a0 msgr2=0x7f8b540d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- 172.21.15.18:0/22627467 shutdown_connections 2024-04-25T10:06:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- 172.21.15.18:0/22627467 wait complete. 2024-04-25T10:06:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 Processor -- start 2024-04-25T10:06:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- start start 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54099a60 0x7f8b54151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b541616a0 0x7f8b54153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5406c3e0 con 0x7f8b5415ee00 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5406c260 con 0x7f8b54099a60 2024-04-25T10:06:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b58a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5416b210 con 0x7f8b541616a0 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b4be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b4be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38280/0 (socket says 172.21.15.18:38280) 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b4be00640 1 -- 172.21.15.18:0/1487228175 learned_addr learned my addr 172.21.15.18:0/1487228175 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b51e00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54099a60 0x7f8b54151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.543+0000 7f8b52800640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b541616a0 0x7f8b54153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 -- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b541616a0 msgr2=0x7f8b54153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b541616a0 0x7f8b54153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 -- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54099a60 msgr2=0x7f8b54151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54099a60 0x7f8b54151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 -- 172.21.15.18:0/1487228175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540c8130 con 0x7f8b5415ee00 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4be00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c01cdc0 tx=0x7f8b3c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b2070 con 0x7f8b5415ee00 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c0b6790 con 0x7f8b5415ee00 2024-04-25T10:06:37.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c0b6b80 con 0x7f8b5415ee00 2024-04-25T10:06:37.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b54150e70 con 0x7f8b5415ee00 2024-04-25T10:06:37.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b54151430 con 0x7f8b5415ee00 2024-04-25T10:06:37.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b540745d0 con 0x7f8b5415ee00 2024-04-25T10:06:37.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b3c0bf060 con 0x7f8b5415ee00 2024-04-25T10:06:37.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.547+0000 7f8b4a000640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.551+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8b3c11edd0 con 0x7f8b5415ee00 2024-04-25T10:06:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.551+0000 7f8b51e00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.551+0000 7f8b51e00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 0x7f8b30069450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400ab60 tx=0x7f8b44008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.555+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b3c016110 con 0x7f8b5415ee00 2024-04-25T10:06:37.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.751+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b5409ae10 con 0x7f8b5415ee00 2024-04-25T10:06:37.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.751+0000 7f8b4a000640 1 -- 172.21.15.18:0/1487228175 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f8b3c120020 con 0x7f8b5415ee00 2024-04-25T10:06:37.764 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:37.764 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:37.764 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 msgr2=0x7f8b30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 0x7f8b30069450 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400ab60 tx=0x7f8b44008040 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 msgr2=0x7f8b540c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8b3c01cdc0 tx=0x7f8b3c0192c0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 shutdown_connections 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b541616a0 0x7f8b54153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b5415ee00 0x7f8b540c5880 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 --2- 172.21.15.18:0/1487228175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b54099a60 0x7f8b54151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 >> 172.21.15.18:0/1487228175 conn(0x7f8b540d17a0 msgr2=0x7f8b540ceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 shutdown_connections 2024-04-25T10:06:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.755+0000 7f8b58a00640 1 -- 172.21.15.18:0/1487228175 wait complete. 2024-04-25T10:06:37.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:37.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 Processor -- start 2024-04-25T10:06:37.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 -- start start 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40ec0cc440 0x7f40ec166730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0ce7f0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40ec0cead0 con 0x7f40ec15b980 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40f1600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40ec0ce5b0 con 0x7f40ec0cc440 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40ec0cc440 0x7f40ec166730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eaa00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f40ec15b5a0 0x7f40ec0cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36122/0 (socket says 172.21.15.18:36122) 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eaa00640 1 -- 172.21.15.18:0/4264080683 learned_addr learned my addr 172.21.15.18:0/4264080683 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eb400640 1 -- 172.21.15.18:0/4264080683 >> v1:172.21.15.167:6789/0 conn(0x7f40ec15b980 legacy=0x7f40ec0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eb400640 1 -- 172.21.15.18:0/4264080683 >> v1:172.21.15.18:6789/0 conn(0x7f40ec15b5a0 legacy=0x7f40ec0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.915+0000 7f40eb400640 1 -- 172.21.15.18:0/4264080683 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec0cf960 con 0x7f40ec0cc440 2024-04-25T10:06:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40eb400640 1 --2- 172.21.15.18:0/4264080683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec0cc440 0x7f40ec166730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4240a23a39b5ea9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40ea000640 1 -- 172.21.15.18:0/4264080683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40b1070 con 0x7f40ec0cc440 2024-04-25T10:06:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40ea000640 1 -- 172.21.15.18:0/4264080683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e40ac410 con 0x7f40ec0cc440 2024-04-25T10:06:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40ea000640 1 -- 172.21.15.18:0/4264080683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e40ac7e0 con 0x7f40ec0cc440 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 -- 172.21.15.18:0/4264080683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec0cc440 msgr2=0x7f40ec166730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 --2- 172.21.15.18:0/4264080683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec0cc440 0x7f40ec166730 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f40e40097c0 tx=0x7f40e401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 -- 172.21.15.18:0/4264080683 shutdown_connections 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 --2- 172.21.15.18:0/4264080683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec0cc440 0x7f40ec166730 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 -- 172.21.15.18:0/4264080683 >> 172.21.15.18:0/4264080683 conn(0x7f40ec0b3390 msgr2=0x7f40ec0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 -- 172.21.15.18:0/4264080683 shutdown_connections 2024-04-25T10:06:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.919+0000 7f40f1600640 1 -- 172.21.15.18:0/4264080683 wait complete. 2024-04-25T10:06:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 Processor -- start 2024-04-25T10:06:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- start start 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 0x7f40ec1481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 0x7f40ec0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec169820 con 0x7f40ec15b5a0 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1696a0 con 0x7f40ec0cc440 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec1699a0 con 0x7f40ec15b980 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38302/0 (socket says 172.21.15.18:38302) 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 -- 172.21.15.18:0/117242062 learned_addr learned my addr 172.21.15.18:0/117242062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40eaa00640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 0x7f40ec1481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40eb400640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 0x7f40ec0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 -- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 msgr2=0x7f40ec0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 0x7f40ec0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 -- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 msgr2=0x7f40ec1481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 0x7f40ec1481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 -- 172.21.15.18:0/117242062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec15c000 con 0x7f40ec15b5a0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40eb400640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 0x7f40ec0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40eaa00640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 0x7f40ec1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e2000640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c450 tx=0x7f40d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4016020 con 0x7f40ec15b5a0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d40052d0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d4007260 con 0x7f40ec15b5a0 2024-04-25T10:06:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec15c2e0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec15cdc0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.923+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec0745d0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.927+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40d4007400 con 0x7f40ec15b5a0 2024-04-25T10:06:37.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.927+0000 7f40e3400640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 0x7f40c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:37.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.927+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f40d4084ae0 con 0x7f40ec15b5a0 2024-04-25T10:06:37.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.927+0000 7f40eaa00640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 0x7f40c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:37.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.927+0000 7f40eaa00640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 0x7f40c8069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005c10 tx=0x7f40dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:37.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:37.931+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40d4020020 con 0x7f40ec15b5a0 2024-04-25T10:06:38.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.091+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40ec0cc960 con 0x7f40ec15b5a0 2024-04-25T10:06:38.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40e3400640 1 -- 172.21.15.18:0/117242062 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17014 (secure 0 0 0) 0x7f40d4005480 con 0x7f40ec15b5a0 2024-04-25T10:06:38.106 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":55,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:37.521279+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1f","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 msgr2=0x7f40c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 0x7f40c8069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f40dc005c10 tx=0x7f40dc009040 comp rx=0 tx=0).stop 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 msgr2=0x7f40ec0b4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c450 tx=0x7f40d400c910 comp rx=0 tx=0).stop 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 shutdown_connections 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40c8066f60 0x7f40c8069420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40ec15b980 0x7f40ec0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec15b5a0 0x7f40ec0b4a20 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 --2- 172.21.15.18:0/117242062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40ec0cc440 0x7f40ec1481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 >> 172.21.15.18:0/117242062 conn(0x7f40ec0b3390 msgr2=0x7f40ec070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 shutdown_connections 2024-04-25T10:06:38.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.095+0000 7f40f1600640 1 -- 172.21.15.18:0/117242062 wait complete. 2024-04-25T10:06:38.127 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:06:38.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.255+0000 7f7297200640 1 Processor -- start 2024-04-25T10:06:38.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.255+0000 7f7297200640 1 -- start start 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7297200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7290145270 0x7f729015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7297200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900cc4e0 con 0x7f72900b1e60 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7297200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72900ce040 con 0x7f72900cd4d0 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7297200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7290145650 con 0x7f7290145270 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7290145270 0x7f729015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7295200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f72900b1e60 0x7f729015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36132/0 (socket says 172.21.15.18:36132) 2024-04-25T10:06:38.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f7295200640 1 -- 172.21.15.18:0/2505839980 learned_addr learned my addr 172.21.15.18:0/2505839980 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728fe00640 1 -- 172.21.15.18:0/2505839980 >> v1:172.21.15.167:6789/0 conn(0x7f72900cd4d0 legacy=0x7f72900b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728fe00640 1 -- 172.21.15.18:0/2505839980 >> v1:172.21.15.18:6789/0 conn(0x7f72900b1e60 legacy=0x7f729015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728f400640 1 -- 172.21.15.18:0/2505839980 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4161184172 0 0) 0x7f72900cc4e0 con 0x7f72900b1e60 2024-04-25T10:06:38.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728fe00640 1 -- 172.21.15.18:0/2505839980 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72900ce320 con 0x7f7290145270 2024-04-25T10:06:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.259+0000 7f728fe00640 1 --2- 172.21.15.18:0/2505839980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7290145270 0x7f729015fe50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f72800097c0 tx=0x7f728001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb101ef7f2be2a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f728f400640 1 -- 172.21.15.18:0/2505839980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800ab430 con 0x7f7290145270 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f728f400640 1 -- 172.21.15.18:0/2505839980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72800b0070 con 0x7f7290145270 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f728f400640 1 -- 172.21.15.18:0/2505839980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800ab7f0 con 0x7f7290145270 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- 172.21.15.18:0/2505839980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7290145270 msgr2=0x7f729015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 --2- 172.21.15.18:0/2505839980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7290145270 0x7f729015fe50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f72800097c0 tx=0x7f728001c430 comp rx=0 tx=0).stop 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- 172.21.15.18:0/2505839980 shutdown_connections 2024-04-25T10:06:38.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 --2- 172.21.15.18:0/2505839980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7290145270 0x7f729015fe50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- 172.21.15.18:0/2505839980 >> 172.21.15.18:0/2505839980 conn(0x7f7290066fa0 msgr2=0x7f729006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:38.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- 172.21.15.18:0/2505839980 shutdown_connections 2024-04-25T10:06:38.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- 172.21.15.18:0/2505839980 wait complete. 2024-04-25T10:06:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 Processor -- start 2024-04-25T10:06:38.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- start start 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 0x7f729013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7290145270 0x7f72900ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7290169720 con 0x7f72900cd4d0 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72900cdd40 con 0x7f7290145270 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7297200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72901698a0 con 0x7f72900b1e60 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7287e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7287e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38324/0 (socket says 172.21.15.18:38324) 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.263+0000 7f7287e00640 1 -- 172.21.15.18:0/408622451 learned_addr learned my addr 172.21.15.18:0/408622451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:38.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7295200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7290145270 0x7f72900ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728fe00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 0x7f729013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 -- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 msgr2=0x7f729013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 0x7f729013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 -- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7290145270 msgr2=0x7f72900ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7290145270 0x7f72900ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 -- 172.21.15.18:0/408622451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729013ef00 con 0x7f72900cd4d0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728fe00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 0x7f729013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7287e00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f727800c450 tx=0x7f727800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278011790 con 0x7f72900cd4d0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7278017070 con 0x7f72900cd4d0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729013f1e0 con 0x7f72900cd4d0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278011b90 con 0x7f72900cd4d0 2024-04-25T10:06:38.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729013f7a0 con 0x7f72900cd4d0 2024-04-25T10:06:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72900745d0 con 0x7f72900cd4d0 2024-04-25T10:06:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7278011d30 con 0x7f72900cd4d0 2024-04-25T10:06:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 0x7f726c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.267+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f72780850b0 con 0x7f72900cd4d0 2024-04-25T10:06:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.271+0000 7f728fe00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 0x7f726c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.271+0000 7f728fe00640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 0x7f726c069450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f72800af000 tx=0x7f7280008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.271+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7278055e60 con 0x7f72900cd4d0 2024-04-25T10:06:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f729006b8e0 con 0x7f72900cd4d0 2024-04-25T10:06:38.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f728cc00640 1 -- 172.21.15.18:0/408622451 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f7278055760 con 0x7f72900cd4d0 2024-04-25T10:06:38.482 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:38.482 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 msgr2=0x7f726c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 0x7f726c069450 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f72800af000 tx=0x7f7280008040 comp rx=0 tx=0).stop 2024-04-25T10:06:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 msgr2=0x7f729013ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f727800c450 tx=0x7f727800c910 comp rx=0 tx=0).stop 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 shutdown_connections 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7290145270 0x7f72900ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72900cd4d0 0x7f729013ceb0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f726c066f90 0x7f726c069450 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 --2- 172.21.15.18:0/408622451 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72900b1e60 0x7f729013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 >> 172.21.15.18:0/408622451 conn(0x7f7290066fa0 msgr2=0x7f729006e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 shutdown_connections 2024-04-25T10:06:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.471+0000 7f7297200640 1 -- 172.21.15.18:0/408622451 wait complete. 2024-04-25T10:06:38.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:38.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.631+0000 7feebf600640 1 Processor -- start 2024-04-25T10:06:38.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.631+0000 7feebf600640 1 -- start start 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebf600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 0x7feeb80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebf600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80cc4e0 con 0x7feeb80b1c90 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebf600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80ce040 con 0x7feeb8145270 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebf600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80b20e0 con 0x7feeb815fe50 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebd600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feeb80b1c90 0x7feeb815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36142/0 (socket says 172.21.15.18:36142) 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feebd600640 1 -- 172.21.15.18:0/3863731041 learned_addr learned my addr 172.21.15.18:0/3863731041 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:38.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeafe00640 1 --2- 172.21.15.18:0/3863731041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 0x7feeb80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009257223 0 0) 0x7feeb80cc4e0 con 0x7feeb80b1c90 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee9c003530 con 0x7feeb80b1c90 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeafe00640 1 -- 172.21.15.18:0/3863731041 >> v1:172.21.15.167:6789/0 conn(0x7feeb8145270 legacy=0x7feeb80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455968172 0 0) 0x7feeb80ce040 con 0x7feeb8145270 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeafe00640 1 -- 172.21.15.18:0/3863731041 >> v1:172.21.15.18:6789/0 conn(0x7feeb80b1c90 legacy=0x7feeb815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.635+0000 7feeafe00640 1 -- 172.21.15.18:0/3863731041 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80ce320 con 0x7feeb815fe50 2024-04-25T10:06:38.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feeafe00640 1 --2- 172.21.15.18:0/3863731041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 0x7feeb80b1750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feea00097f0 tx=0x7feea001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b315aaab5a9bdcf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00b0070 con 0x7feeb815fe50 2024-04-25T10:06:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea00ab600 con 0x7feeb815fe50 2024-04-25T10:06:38.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feeb7e00640 1 -- 172.21.15.18:0/3863731041 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea00ab9d0 con 0x7feeb815fe50 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- 172.21.15.18:0/3863731041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 msgr2=0x7feeb80b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 --2- 172.21.15.18:0/3863731041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 0x7feeb80b1750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feea00097f0 tx=0x7feea001c4e0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- 172.21.15.18:0/3863731041 shutdown_connections 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 --2- 172.21.15.18:0/3863731041 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb815fe50 0x7feeb80b1750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- 172.21.15.18:0/3863731041 >> 172.21.15.18:0/3863731041 conn(0x7feeb8066fa0 msgr2=0x7feeb806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- 172.21.15.18:0/3863731041 shutdown_connections 2024-04-25T10:06:38.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- 172.21.15.18:0/3863731041 wait complete. 2024-04-25T10:06:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 Processor -- start 2024-04-25T10:06:38.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- start start 2024-04-25T10:06:38.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 0x7feeb80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 0x7feeb8134b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cdd60 con 0x7feeb80b1c90 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80cdbe0 con 0x7feeb815fe50 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.639+0000 7feebf600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8169720 con 0x7feeb8145270 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38326/0 (socket says 172.21.15.18:38326) 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 -- 172.21.15.18:0/3909534533 learned_addr learned my addr 172.21.15.18:0/3909534533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeafe00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 0x7feeb80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebd600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 0x7feeb8134b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 -- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 msgr2=0x7feeb80b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 0x7feeb80b3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 -- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 msgr2=0x7feeb8134b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 0x7feeb8134b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 -- 172.21.15.18:0/3909534533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb815bac0 con 0x7feeb80b1c90 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeafe00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 0x7feeb80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebd600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 0x7feeb8134b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebcc00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feea800c4b0 tx=0x7feea800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8005480 con 0x7feeb80b1c90 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8003600 con 0x7feeb80b1c90 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80039f0 con 0x7feeb80b1c90 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb8138b30 con 0x7feeb80b1c90 2024-04-25T10:06:38.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb81390f0 con 0x7feeb80b1c90 2024-04-25T10:06:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80745d0 con 0x7feeb80b1c90 2024-04-25T10:06:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feea8003b90 con 0x7feeb80b1c90 2024-04-25T10:06:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 0x7fee94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:38.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.643+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7feea8084ef0 con 0x7feeb80b1c90 2024-04-25T10:06:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.647+0000 7feeafe00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 0x7fee94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:38.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.647+0000 7feeafe00640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 0x7fee94069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feea00ad000 tx=0x7feea0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:38.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.647+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feea8055ca0 con 0x7feeb80b1c90 2024-04-25T10:06:38.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.847+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeb806b8e0 con 0x7feeb80b1c90 2024-04-25T10:06:38.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feeb5600640 1 -- 172.21.15.18:0/3909534533 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4941 (secure 0 0 0) 0x7feea80555a0 con 0x7feeb80b1c90 2024-04-25T10:06:38.861 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:38.861 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:05:48.647555+0000","modified":"2024-04-25T10:05:51.669546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35177},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35177":{"gid":35177,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6836/322178907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":322178907},{"type":"v1","addr":"172.21.15.167:6836","nonce":322178907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T10:06:38.862 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 26 2024-04-25T10:06:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 msgr2=0x7fee94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 0x7fee94069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feea00ad000 tx=0x7feea0008040 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 msgr2=0x7feeb815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7feea800c4b0 tx=0x7feea800c970 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 shutdown_connections 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feeb815fe50 0x7feeb8134b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fee94066f60 0x7fee94069420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feeb8145270 0x7feeb80b3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 --2- 172.21.15.18:0/3909534533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feeb80b1c90 0x7feeb815b4e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 >> 172.21.15.18:0/3909534533 conn(0x7feeb8066fa0 msgr2=0x7feeb8142ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 shutdown_connections 2024-04-25T10:06:38.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:38.851+0000 7feebf600640 1 -- 172.21.15.18:0/3909534533 wait complete. 2024-04-25T10:06:38.883 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.011+0000 7f6086e00640 1 Processor -- start 2024-04-25T10:06:39.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.011+0000 7f6086e00640 1 -- start start 2024-04-25T10:06:39.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6086e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6086e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608015ee00 0x7f608006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6086e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f608009a380 con 0x7f60801616a0 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6086e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f608006c650 con 0x7f608015ee00 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6086e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608006c930 con 0x7f6080099a60 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608015ee00 0x7f608006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f608015ee00 0x7f608006bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38332/0 (socket says 172.21.15.18:38332) 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 -- 172.21.15.18:0/1846172788 learned_addr learned my addr 172.21.15.18:0/1846172788 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f607fe00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 -- 172.21.15.18:0/1846172788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 msgr2=0x7f6080099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 -- 172.21.15.18:0/1846172788 >> v1:172.21.15.167:6789/0 conn(0x7f60801616a0 legacy=0x7f6080161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 -- 172.21.15.18:0/1846172788 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f608006cc10 con 0x7f608015ee00 2024-04-25T10:06:39.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f607fe00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:39.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f6077e00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f608006bd20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1343ffa55da1ecf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f607f400640 1 -- 172.21.15.18:0/1846172788 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680b2070 con 0x7f608015ee00 2024-04-25T10:06:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f607f400640 1 -- 172.21.15.18:0/1846172788 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680ad640 con 0x7f608015ee00 2024-04-25T10:06:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.015+0000 7f607f400640 1 -- 172.21.15.18:0/1846172788 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680ada10 con 0x7f608015ee00 2024-04-25T10:06:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- 172.21.15.18:0/1846172788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 msgr2=0x7f608006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f608006bd20 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6068009870 tx=0x7f606801c520 comp rx=0 tx=0).stop 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- 172.21.15.18:0/1846172788 shutdown_connections 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f608006bd20 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- 172.21.15.18:0/1846172788 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- 172.21.15.18:0/1846172788 >> 172.21.15.18:0/1846172788 conn(0x7f60800d17a0 msgr2=0x7f60800d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- 172.21.15.18:0/1846172788 shutdown_connections 2024-04-25T10:06:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- 172.21.15.18:0/1846172788 wait complete. 2024-04-25T10:06:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 Processor -- start 2024-04-25T10:06:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- start start 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60801616a0 0x7f60801547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608006c3e0 con 0x7f608015ee00 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f608006c260 con 0x7f60801616a0 2024-04-25T10:06:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6086e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608016b210 con 0x7f6080099a60 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38338/0 (socket says 172.21.15.18:38338) 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 -- 172.21.15.18:0/1703453038 learned_addr learned my addr 172.21.15.18:0/1703453038 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f607fe00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6084e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60801616a0 0x7f60801547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 -- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 msgr2=0x7f6080151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 -- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60801616a0 msgr2=0x7f60801547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60801616a0 0x7f60801547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.019+0000 7f6077e00640 1 -- 172.21.15.18:0/1703453038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6080156cd0 con 0x7f608015ee00 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f6077e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f60680b0040 tx=0x7f60680192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680bd070 con 0x7f608015ee00 2024-04-25T10:06:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680b6790 con 0x7f608015ee00 2024-04-25T10:06:39.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60680b2070 con 0x7f608015ee00 2024-04-25T10:06:39.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f608015cac0 con 0x7f608015ee00 2024-04-25T10:06:39.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f608015d080 con 0x7f608015ee00 2024-04-25T10:06:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6080156ea0 con 0x7f608015ee00 2024-04-25T10:06:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60680c0070 con 0x7f608015ee00 2024-04-25T10:06:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 0x7f605c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f606811f0f0 con 0x7f608015ee00 2024-04-25T10:06:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.023+0000 7f607fe00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 0x7f605c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.027+0000 7f607fe00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 0x7f605c069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f607000a9a0 tx=0x7f6070008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.027+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6068016110 con 0x7f608015ee00 2024-04-25T10:06:39.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.191+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60800745d0 con 0x7f608015ee00 2024-04-25T10:06:39.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f607cc00640 1 -- 172.21.15.18:0/1703453038 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+17014 (secure 0 0 0) 0x7f60680eff30 con 0x7f608015ee00 2024-04-25T10:06:39.207 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:39.207 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":55,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:37.521279+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:05:47.057907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T10:05:47.647552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.1f","mappings":[{"from":0,"to":6}]},{"pgid":"8.27","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 msgr2=0x7f605c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 0x7f605c069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f607000a9a0 tx=0x7f6070008040 comp rx=0 tx=0).stop 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 msgr2=0x7f6080154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f60680b0040 tx=0x7f60680192c0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 shutdown_connections 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60801616a0 0x7f60801547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f608015ee00 0x7f6080154280 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f605c066f60 0x7f605c069420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 --2- 172.21.15.18:0/1703453038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6080099a60 0x7f6080151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 >> 172.21.15.18:0/1703453038 conn(0x7f60800d17a0 msgr2=0x7f60800d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 shutdown_connections 2024-04-25T10:06:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.195+0000 7f6086e00640 1 -- 172.21.15.18:0/1703453038 wait complete. 2024-04-25T10:06:39.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:06:39.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 Processor -- start 2024-04-25T10:06:39.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 -- start start 2024-04-25T10:06:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 0x7fec2c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fec2c06bf30 0x7fec2c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c15e040 con 0x7fec2c15dc60 2024-04-25T10:06:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0cff80 con 0x7fec2c06bf30 2024-04-25T10:06:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec34400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0d0260 con 0x7fec2c09a170 2024-04-25T10:06:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec31a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fec2c15dc60 0x7fec2c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36150/0 (socket says 172.21.15.18:36150) 2024-04-25T10:06:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec31a00640 1 -- 172.21.15.18:0/115651971 learned_addr learned my addr 172.21.15.18:0/115651971 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec32400640 1 --2- 172.21.15.18:0/115651971 >> v2:172.21.15.18:3300/0 conn(0x7fec2c06bf30 0x7fec2c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec32400640 1 -- 172.21.15.18:0/115651971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 msgr2=0x7fec2c0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec31000640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 0x7fec2c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec2be00640 1 -- 172.21.15.18:0/115651971 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886716782 0 0) 0x7fec2c15e040 con 0x7fec2c15dc60 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec32400640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 0x7fec2c0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec32400640 1 -- 172.21.15.18:0/115651971 >> v1:172.21.15.18:6789/0 conn(0x7fec2c15dc60 legacy=0x7fec2c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec32400640 1 -- 172.21.15.18:0/115651971 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0d0540 con 0x7fec2c06bf30 2024-04-25T10:06:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.359+0000 7fec31000640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 0x7fec2c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec32400640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c06bf30 0x7fec2c0cf8a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d90 tx=0x7fec2401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8effc76439268a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec2be00640 1 -- 172.21.15.18:0/115651971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240b2070 con 0x7fec2c06bf30 2024-04-25T10:06:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec2be00640 1 -- 172.21.15.18:0/115651971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec240a5970 con 0x7fec2c06bf30 2024-04-25T10:06:39.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec2be00640 1 -- 172.21.15.18:0/115651971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240a5d40 con 0x7fec2c06bf30 2024-04-25T10:06:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 -- 172.21.15.18:0/115651971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c06bf30 msgr2=0x7fec2c0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c06bf30 0x7fec2c0cf8a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d90 tx=0x7fec2401c8b0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 -- 172.21.15.18:0/115651971 shutdown_connections 2024-04-25T10:06:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c06bf30 0x7fec2c0cf8a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 --2- 172.21.15.18:0/115651971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c09a170 0x7fec2c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 -- 172.21.15.18:0/115651971 >> 172.21.15.18:0/115651971 conn(0x7fec2c0b3200 msgr2=0x7fec2c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 -- 172.21.15.18:0/115651971 shutdown_connections 2024-04-25T10:06:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.363+0000 7fec34400640 1 -- 172.21.15.18:0/115651971 wait complete. 2024-04-25T10:06:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 Processor -- start 2024-04-25T10:06:39.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- start start 2024-04-25T10:06:39.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2c06bf30 0x7fec2c09ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c15dc60 0x7fec2c09bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cc6f0 con 0x7fec2c09a170 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cc570 con 0x7fec2c06bf30 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cc870 con 0x7fec2c15dc60 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38356/0 (socket says 172.21.15.18:38356) 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 -- 172.21.15.18:0/545229820 learned_addr learned my addr 172.21.15.18:0/545229820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 -- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c15dc60 msgr2=0x7fec2c09bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c15dc60 0x7fec2c09bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 -- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2c06bf30 msgr2=0x7fec2c09ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2c06bf30 0x7fec2c09ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 -- 172.21.15.18:0/545229820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0ca740 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec31000640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c7c0 tx=0x7fec1800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18007a30 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18007bd0 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec180113f0 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c0caa20 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.367+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0cafe0 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c0745d0 con 0x7fec2c09a170 2024-04-25T10:06:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec18011590 con 0x7fec2c09a170 2024-04-25T10:06:39.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec29600640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 0x7fec0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fec180854b0 con 0x7fec2c09a170 2024-04-25T10:06:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec31a00640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 0x7fec0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.371+0000 7fec31a00640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 0x7fec0c069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec200015a0 tx=0x7fec20007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.375+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec18015020 con 0x7fec2c09a170 2024-04-25T10:06:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.583+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fec2c0cb1e0 con 0x7fec2c09a170 2024-04-25T10:06:39.593 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:06:39.583+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:06:39.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.583+0000 7fec29600640 1 -- 172.21.15.18:0/545229820 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fec2c0cb1e0 con 0x7fec2c09a170 2024-04-25T10:06:39.595 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:06:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 msgr2=0x7fec0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 0x7fec0c069420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fec200015a0 tx=0x7fec20007970 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 msgr2=0x7fec2c09b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c7c0 tx=0x7fec1800cc80 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 shutdown_connections 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec0c066f60 0x7fec0c069420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2c15dc60 0x7fec2c09bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2c09a170 0x7fec2c09b9a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 --2- 172.21.15.18:0/545229820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2c06bf30 0x7fec2c09ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 >> 172.21.15.18:0/545229820 conn(0x7fec2c0b3200 msgr2=0x7fec2c0cde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 shutdown_connections 2024-04-25T10:06:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.587+0000 7fec34400640 1 -- 172.21.15.18:0/545229820 wait complete. 2024-04-25T10:06:39.610 INFO:tasks.ceph.mds.d.smithi167.stderr: -6042> 2024-04-25T10:05:51.225+0000 7f940fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:06:39.615 INFO:tasks.ceph.mds.d.smithi167.stderr: -3181> 2024-04-25T10:06:02.109+0000 7f940aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5698=0-4194304@1} caps={5698=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5698 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55ba65e63700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:06:39.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:06:39.662 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:06:39.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.747+0000 7f27fd800640 1 Processor -- start 2024-04-25T10:06:39.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.747+0000 7f27fd800640 1 -- start start 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fd800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27f80b4190 0x7f27f80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fd800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80b30f0 con 0x7f27f80b0c90 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fd800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f80b33d0 con 0x7f27f8144e20 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fd800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f80b1100 con 0x7f27f80b4190 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fce00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27f80b0c90 0x7f27f815bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36164/0 (socket says 172.21.15.18:36164) 2024-04-25T10:06:39.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27fce00640 1 -- 172.21.15.18:0/3776206481 learned_addr learned my addr 172.21.15.18:0/3776206481 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:39.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27ef400640 1 --2- 172.21.15.18:0/3776206481 >> v2:172.21.15.167:3300/0 conn(0x7f27f80b4190 0x7f27f80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107310700 0 0) 0x7f27f80b30f0 con 0x7f27f80b0c90 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003530 con 0x7f27f80b0c90 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529438494 0 0) 0x7f27f80b33d0 con 0x7f27f8144e20 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f80b30f0 con 0x7f27f8144e20 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27ef400640 1 -- 172.21.15.18:0/3776206481 >> v1:172.21.15.167:6789/0 conn(0x7f27f8144e20 legacy=0x7f27f806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27ef400640 1 -- 172.21.15.18:0/3776206481 >> v1:172.21.15.18:6789/0 conn(0x7f27f80b0c90 legacy=0x7f27f815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 955126347 0 0) 0x7f27dc003530 con 0x7f27f80b0c90 2024-04-25T10:06:39.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.751+0000 7f27ef400640 1 -- 172.21.15.18:0/3776206481 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f80b36b0 con 0x7f27f80b4190 2024-04-25T10:06:39.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27ef400640 1 --2- 172.21.15.18:0/3776206481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b4190 0x7f27f80b0750 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097c0 tx=0x7f27e001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c48b0eccf8c8885a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b1070 con 0x7f27f80b4190 2024-04-25T10:06:39.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00ac440 con 0x7f27f80b4190 2024-04-25T10:06:39.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27f7400640 1 -- 172.21.15.18:0/3776206481 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0001680 con 0x7f27f80b4190 2024-04-25T10:06:39.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- 172.21.15.18:0/3776206481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b4190 msgr2=0x7f27f80b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 --2- 172.21.15.18:0/3776206481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b4190 0x7f27f80b0750 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f27e00097c0 tx=0x7f27e001c390 comp rx=0 tx=0).stop 2024-04-25T10:06:39.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- 172.21.15.18:0/3776206481 shutdown_connections 2024-04-25T10:06:39.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 --2- 172.21.15.18:0/3776206481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b4190 0x7f27f80b0750 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- 172.21.15.18:0/3776206481 >> 172.21.15.18:0/3776206481 conn(0x7f27f8066fa0 msgr2=0x7f27f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:39.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- 172.21.15.18:0/3776206481 shutdown_connections 2024-04-25T10:06:39.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- 172.21.15.18:0/3776206481 wait complete. 2024-04-25T10:06:39.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 Processor -- start 2024-04-25T10:06:39.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.755+0000 7f27fd800640 1 -- start start 2024-04-25T10:06:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 0x7f27f813cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27f8144e20 0x7f27f8142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b2eb0 con 0x7f27f80b4190 2024-04-25T10:06:39.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f80b2d30 con 0x7f27f80b0c90 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f8145200 con 0x7f27f8144e20 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38372/0 (socket says 172.21.15.18:38372) 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 -- 172.21.15.18:0/3567598405 learned_addr learned my addr 172.21.15.18:0/3567598405 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 0x7f27f813cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fce00640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27f8144e20 0x7f27f8142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 -- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27f8144e20 msgr2=0x7f27f8142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27f8144e20 0x7f27f8142890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 -- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 msgr2=0x7f27f813cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 0x7f27f813cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 -- 172.21.15.18:0/3567598405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f813a920 con 0x7f27f80b4190 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f7e00640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 0x7f27f813cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:39.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27ef400640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f27e0019fc0 tx=0x7f27e0019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b1040 con 0x7f27f80b4190 2024-04-25T10:06:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e00bc070 con 0x7f27f80b4190 2024-04-25T10:06:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e00b66c0 con 0x7f27f80b4190 2024-04-25T10:06:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f813ac00 con 0x7f27f80b4190 2024-04-25T10:06:39.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f813b1c0 con 0x7f27f80b4190 2024-04-25T10:06:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f80745d0 con 0x7f27f80b4190 2024-04-25T10:06:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.759+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27e00b4070 con 0x7f27f80b4190 2024-04-25T10:06:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.763+0000 7f27f4c00640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 0x7f27d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.763+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f27e011ecd0 con 0x7f27f80b4190 2024-04-25T10:06:39.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.763+0000 7f27f7e00640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 0x7f27d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:39.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.763+0000 7f27f7e00640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 0x7f27d4069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:39.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.767+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27e0015fb0 con 0x7f27f80b4190 2024-04-25T10:06:39.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:39.963+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f27f80ccea0 con 0x7f27f80b4190 2024-04-25T10:06:40.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27f4c00640 1 -- 172.21.15.18:0/3567598405 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f27e00ef470 con 0x7f27f80b4190 2024-04-25T10:06:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 msgr2=0x7f27d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 0x7f27d4069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8009040 comp rx=0 tx=0).stop 2024-04-25T10:06:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 msgr2=0x7f27f80cb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f27e0019fc0 tx=0x7f27e0019130 comp rx=0 tx=0).stop 2024-04-25T10:06:40.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 shutdown_connections 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27d4066f60 0x7f27d4069420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27f8144e20 0x7f27f8142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f80b4190 0x7f27f80cb5b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 --2- 172.21.15.18:0/3567598405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27f80b0c90 0x7f27f813cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 >> 172.21.15.18:0/3567598405 conn(0x7f27f8066fa0 msgr2=0x7f27f8143760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 shutdown_connections 2024-04-25T10:06:40.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.587+0000 7f27fd800640 1 -- 172.21.15.18:0/3567598405 wait complete. 2024-04-25T10:06:40.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:06:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 Processor -- start 2024-04-25T10:06:40.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- start start 2024-04-25T10:06:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9dc071250 0x7fb9dc0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc15ccc0 con 0x7fb9dc071630 2024-04-25T10:06:40.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9dc160200 con 0x7fb9dc071250 2024-04-25T10:06:40.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc15c9e0 con 0x7fb9dc15c4a0 2024-04-25T10:06:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9dc071250 0x7fb9dc0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9dc071250 0x7fb9dc0cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38378/0 (socket says 172.21.15.18:38378) 2024-04-25T10:06:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 -- 172.21.15.18:0/3080081650 learned_addr learned my addr 172.21.15.18:0/3080081650 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e1000640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 -- 172.21.15.18:0/3080081650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 msgr2=0x7fb9dc15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc15cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 -- 172.21.15.18:0/3080081650 >> v1:172.21.15.167:6789/0 conn(0x7fb9dc071630 legacy=0x7fb9dc15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 -- 172.21.15.18:0/3080081650 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0cd4b0 con 0x7fb9dc071250 2024-04-25T10:06:40.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9dbe00640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc0cdf90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009870 tx=0x7fb9cc01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271fe6c3a24f6a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9db400640 1 -- 172.21.15.18:0/3080081650 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b0070 con 0x7fb9dc071250 2024-04-25T10:06:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9db400640 1 -- 172.21.15.18:0/3080081650 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0ab600 con 0x7fb9dc071250 2024-04-25T10:06:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9db400640 1 -- 172.21.15.18:0/3080081650 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0ab9d0 con 0x7fb9dc071250 2024-04-25T10:06:40.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- 172.21.15.18:0/3080081650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 msgr2=0x7fb9dc0cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc0cdf90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc009870 tx=0x7fb9cc01c440 comp rx=0 tx=0).stop 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- 172.21.15.18:0/3080081650 shutdown_connections 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc15cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 --2- 172.21.15.18:0/3080081650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc0cdf90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- 172.21.15.18:0/3080081650 >> 172.21.15.18:0/3080081650 conn(0x7fb9dc06ac10 msgr2=0x7fb9dc06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- 172.21.15.18:0/3080081650 shutdown_connections 2024-04-25T10:06:40.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.763+0000 7fb9e3000640 1 -- 172.21.15.18:0/3080081650 wait complete. 2024-04-25T10:06:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 Processor -- start 2024-04-25T10:06:40.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- start start 2024-04-25T10:06:40.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc071630 0x7fb9dc150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc168620 con 0x7fb9dc071250 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1684a0 con 0x7fb9dc071630 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc1687a0 con 0x7fb9dc15c4a0 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38388/0 (socket says 172.21.15.18:38388) 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 -- 172.21.15.18:0/576478238 learned_addr learned my addr 172.21.15.18:0/576478238 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9d3400640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc071630 0x7fb9dc150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e1000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 -- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 msgr2=0x7fb9dc150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 -- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc071630 msgr2=0x7fb9dc150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc071630 0x7fb9dc150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 -- 172.21.15.18:0/576478238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc152ee0 con 0x7fb9dc071250 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9dbe00640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0ae040 tx=0x7fb9cc01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:40.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0ba020 con 0x7fb9dc071250 2024-04-25T10:06:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0b6420 con 0x7fb9dc071250 2024-04-25T10:06:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b0040 con 0x7fb9dc071250 2024-04-25T10:06:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc153150 con 0x7fb9dc071250 2024-04-25T10:06:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.767+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc153710 con 0x7fb9dc071250 2024-04-25T10:06:40.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.771+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc0745d0 con 0x7fb9dc071250 2024-04-25T10:06:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.771+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb9cc0bd020 con 0x7fb9dc071250 2024-04-25T10:06:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.771+0000 7fb9d8c00640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 0x7fb9b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:40.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.771+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fb9cc11f3e0 con 0x7fb9dc071250 2024-04-25T10:06:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.771+0000 7fb9d3400640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 0x7fb9b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:40.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.775+0000 7fb9d3400640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 0x7fb9b8069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0ae840 tx=0x7fb9c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:40.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.775+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9cc0c4030 con 0x7fb9dc071250 2024-04-25T10:06:40.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:40.939+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9dc1538e0 con 0x7fb9dc071250 2024-04-25T10:06:41.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.595+0000 7fb9d8c00640 1 -- 172.21.15.18:0/576478238 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v57) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb9cc016150 con 0x7fb9dc071250 2024-04-25T10:06:41.602 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:06:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 msgr2=0x7fb9b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 0x7fb9b8069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0ae840 tx=0x7fb9c4009040 comp rx=0 tx=0).stop 2024-04-25T10:06:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 msgr2=0x7fb9dc1519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0ae040 tx=0x7fb9cc01ac80 comp rx=0 tx=0).stop 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 shutdown_connections 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb9b8066f60 0x7fb9b8069420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9dc15c4a0 0x7fb9dc150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb9dc071630 0x7fb9dc150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 --2- 172.21.15.18:0/576478238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9dc071250 0x7fb9dc1519c0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 >> 172.21.15.18:0/576478238 conn(0x7fb9dc06ac10 msgr2=0x7fb9dc15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 shutdown_connections 2024-04-25T10:06:41.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.599+0000 7fb9e3000640 1 -- 172.21.15.18:0/576478238 wait complete. 2024-04-25T10:06:41.634 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:06:41.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 Processor -- start 2024-04-25T10:06:41.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 -- start start 2024-04-25T10:06:41.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c74070590 0x7f7c7406fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:41.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740711f0 con 0x7f7c740cc4a0 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740cf320 con 0x7f7c7415eda0 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c7a000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c740714d0 con 0x7f7c74070590 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c6be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c74070590 0x7f7c7406fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c79600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7c740cc4a0 0x7f7c740cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46646/0 (socket says 172.21.15.18:46646) 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c79600640 1 -- 172.21.15.18:0/802079632 learned_addr learned my addr 172.21.15.18:0/802079632 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c6be00640 1 -- 172.21.15.18:0/802079632 >> v1:172.21.15.167:6789/0 conn(0x7f7c7415eda0 legacy=0x7f7c7406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c6be00640 1 -- 172.21.15.18:0/802079632 >> v1:172.21.15.18:6789/0 conn(0x7f7c740cc4a0 legacy=0x7f7c740cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c6be00640 1 -- 172.21.15.18:0/802079632 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740cf600 con 0x7f7c74070590 2024-04-25T10:06:41.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.779+0000 7f7c73e00640 1 -- 172.21.15.18:0/802079632 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100747261 0 0) 0x7f7c740711f0 con 0x7f7c740cc4a0 2024-04-25T10:06:41.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c6be00640 1 --2- 172.21.15.18:0/802079632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406fb00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0097c0 tx=0x7f7c5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebfaf207a08af46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:41.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c73e00640 1 -- 172.21.15.18:0/802079632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0b0070 con 0x7f7c74070590 2024-04-25T10:06:41.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c73e00640 1 -- 172.21.15.18:0/802079632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c0ab600 con 0x7f7c74070590 2024-04-25T10:06:41.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c73e00640 1 -- 172.21.15.18:0/802079632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0ab9d0 con 0x7f7c74070590 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- 172.21.15.18:0/802079632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 msgr2=0x7f7c7406fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 --2- 172.21.15.18:0/802079632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406fb00 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0097c0 tx=0x7f7c5c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- 172.21.15.18:0/802079632 shutdown_connections 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 --2- 172.21.15.18:0/802079632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406fb00 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- 172.21.15.18:0/802079632 >> 172.21.15.18:0/802079632 conn(0x7f7c740d15b0 msgr2=0x7f7c740d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- 172.21.15.18:0/802079632 shutdown_connections 2024-04-25T10:06:41.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- 172.21.15.18:0/802079632 wait complete. 2024-04-25T10:06:41.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 Processor -- start 2024-04-25T10:06:41.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.783+0000 7f7c7a000640 1 -- start start 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c740cc4a0 0x7f7c740b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 0x7f7c74153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740701c0 con 0x7f7c74070590 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74070040 con 0x7f7c740cc4a0 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7416a430 con 0x7f7c7415eda0 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39102/0 (socket says 172.21.15.18:39102) 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 -- 172.21.15.18:0/493495509 learned_addr learned my addr 172.21.15.18:0/493495509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c6be00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c740cc4a0 0x7f7c740b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c79600640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 0x7f7c74153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 -- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 msgr2=0x7f7c74153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 0x7f7c74153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 -- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c740cc4a0 msgr2=0x7f7c740b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c740cc4a0 0x7f7c740b61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 -- 172.21.15.18:0/493495509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7406dcf0 con 0x7f7c74070590 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c79600640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 0x7f7c74153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c78c00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c530 tx=0x7f7c6400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64016020 con 0x7f7c74070590 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64005220 con 0x7f7c74070590 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c740b53e0 con 0x7f7c74070590 2024-04-25T10:06:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64007030 con 0x7f7c74070590 2024-04-25T10:06:41.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c740b59a0 con 0x7f7c74070590 2024-04-25T10:06:41.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c740745d0 con 0x7f7c74070590 2024-04-25T10:06:41.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.787+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c640071d0 con 0x7f7c74070590 2024-04-25T10:06:41.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.791+0000 7f7c71600640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 0x7f7c50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:41.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.791+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5807+0+0 (secure 0 0 0) 0x7f7c64084ac0 con 0x7f7c74070590 2024-04-25T10:06:41.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.791+0000 7f7c6be00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 0x7f7c50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:41.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.791+0000 7f7c6be00640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 0x7f7c50069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0ad000 tx=0x7f7c5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.795+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c64020020 con 0x7f7c74070590 2024-04-25T10:06:41.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:41.955+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c7406bea0 con 0x7f7c74070590 2024-04-25T10:06:42.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.599+0000 7f7c71600640 1 -- 172.21.15.18:0/493495509 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v58) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c640074c0 con 0x7f7c74070590 2024-04-25T10:06:42.608 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 msgr2=0x7f7c50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 0x7f7c50069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0ad000 tx=0x7f7c5c008040 comp rx=0 tx=0).stop 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 msgr2=0x7f7c7406d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c530 tx=0x7f7c6400c9f0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 shutdown_connections 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c50066f60 0x7f7c50069420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7415eda0 0x7f7c74153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c740cc4a0 0x7f7c740b61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 --2- 172.21.15.18:0/493495509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c74070590 0x7f7c7406d710 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 >> 172.21.15.18:0/493495509 conn(0x7f7c740d15b0 msgr2=0x7f7c74157ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 shutdown_connections 2024-04-25T10:06:42.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.603+0000 7f7c7a000640 1 -- 172.21.15.18:0/493495509 wait complete. 2024-04-25T10:06:42.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:06:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.775+0000 7fc4e7e00640 1 Processor -- start 2024-04-25T10:06:42.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.775+0000 7fc4e7e00640 1 -- start start 2024-04-25T10:06:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4e015dd90 0x7fc4e0071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e7e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4e0161e90 0x7fc4e00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e7e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e0072460 con 0x7fc4e0072040 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e7e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00b2dc0 con 0x7fc4e015dd90 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e7e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e006ac10 con 0x7fc4e0161e90 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4e015dd90 0x7fc4e0071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e4a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4e0072040 0x7fc4e0161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46648/0 (socket says 172.21.15.18:46648) 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e4a00640 1 -- 172.21.15.18:0/3271150394 learned_addr learned my addr 172.21.15.18:0/3271150394 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5e00640 1 --2- 172.21.15.18:0/3271150394 >> v2:172.21.15.167:3300/0 conn(0x7fc4e0161e90 0x7fc4e00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5400640 1 -- 172.21.15.18:0/3271150394 >> v2:172.21.15.167:3300/0 conn(0x7fc4e0161e90 msgr2=0x7fc4e00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5400640 1 --2- 172.21.15.18:0/3271150394 >> v2:172.21.15.167:3300/0 conn(0x7fc4e0161e90 0x7fc4e00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5400640 1 -- 172.21.15.18:0/3271150394 >> v1:172.21.15.18:6789/0 conn(0x7fc4e0072040 legacy=0x7fc4e0161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.779+0000 7fc4e5400640 1 -- 172.21.15.18:0/3271150394 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e006aeb0 con 0x7fc4e015dd90 2024-04-25T10:06:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e5400640 1 --2- 172.21.15.18:0/3271150394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e0071b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0162820 tx=0x7fc4d401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301ffc7bc7732482 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4dfe00640 1 -- 172.21.15.18:0/3271150394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40b0070 con 0x7fc4e015dd90 2024-04-25T10:06:42.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4dfe00640 1 -- 172.21.15.18:0/3271150394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d40ab600 con 0x7fc4e015dd90 2024-04-25T10:06:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4dfe00640 1 -- 172.21.15.18:0/3271150394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d40ab9d0 con 0x7fc4e015dd90 2024-04-25T10:06:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- 172.21.15.18:0/3271150394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 msgr2=0x7fc4e0071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/3271150394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e0071b00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fc4e0162820 tx=0x7fc4d401c3f0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- 172.21.15.18:0/3271150394 shutdown_connections 2024-04-25T10:06:42.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/3271150394 >> v2:172.21.15.167:3300/0 conn(0x7fc4e0161e90 0x7fc4e00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/3271150394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e0071b00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- 172.21.15.18:0/3271150394 >> 172.21.15.18:0/3271150394 conn(0x7fc4e00cfd90 msgr2=0x7fc4e00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:42.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- 172.21.15.18:0/3271150394 shutdown_connections 2024-04-25T10:06:42.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- 172.21.15.18:0/3271150394 wait complete. 2024-04-25T10:06:42.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 Processor -- start 2024-04-25T10:06:42.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.783+0000 7fc4e7e00640 1 -- start start 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 0x7fc4e01537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0161e90 0x7fc4e01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e016ac40 con 0x7fc4e015dd90 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e016aac0 con 0x7fc4e0161e90 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e016adc0 con 0x7fc4e0072040 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39120/0 (socket says 172.21.15.18:39120) 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 -- 172.21.15.18:0/1826921614 learned_addr learned my addr 172.21.15.18:0/1826921614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:42.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e5400640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 0x7fc4e01537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e5e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0161e90 0x7fc4e01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 -- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 msgr2=0x7fc4e01537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 0x7fc4e01537b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 -- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0161e90 msgr2=0x7fc4e01515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0161e90 0x7fc4e01515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 -- 172.21.15.18:0/1826921614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0155dd0 con 0x7fc4e015dd90 2024-04-25T10:06:42.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e5400640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 0x7fc4e01537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e4a00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c370 tx=0x7fc4cc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc017070 con 0x7fc4e015dd90 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc005cf0 con 0x7fc4e015dd90 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc0072f0 con 0x7fc4e015dd90 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e01560b0 con 0x7fc4e015dd90 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e0156670 con 0x7fc4e015dd90 2024-04-25T10:06:42.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.787+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0072700 con 0x7fc4e015dd90 2024-04-25T10:06:42.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.791+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4cc01a070 con 0x7fc4e015dd90 2024-04-25T10:06:42.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.791+0000 7fc4dd600640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:42.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.791+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc4cc084100 con 0x7fc4e015dd90 2024-04-25T10:06:42.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.791+0000 7fc4e5400640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:42.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.791+0000 7fc4e5400640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40ad000 tx=0x7fc4d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.795+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4cc054c20 con 0x7fc4e015dd90 2024-04-25T10:06:42.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.959+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc4e00d02f0 con 0x7fc4e015dd90 2024-04-25T10:06:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.959+0000 7fc4dd600640 1 -- 172.21.15.18:0/1826921614 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc4cc058cc0 con 0x7fc4e015dd90 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 msgr2=0x7fc4c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 0x7fc4c0069420 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40ad000 tx=0x7fc4d4008040 comp rx=0 tx=0).stop 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 msgr2=0x7fc4e01510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00c370 tx=0x7fc4cc00c830 comp rx=0 tx=0).stop 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 shutdown_connections 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0161e90 0x7fc4e01515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e015dd90 0x7fc4e01510a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4c0066f60 0x7fc4c0069420 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 --2- 172.21.15.18:0/1826921614 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e0072040 0x7fc4e01537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:42.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 >> 172.21.15.18:0/1826921614 conn(0x7fc4e00cfd90 msgr2=0x7fc4e00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:42.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 shutdown_connections 2024-04-25T10:06:42.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:42.963+0000 7fc4e7e00640 1 -- 172.21.15.18:0/1826921614 wait complete. 2024-04-25T10:06:42.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T10:06:43.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.123+0000 7f95dce00640 1 Processor -- start 2024-04-25T10:06:43.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.123+0000 7f95dce00640 1 -- start start 2024-04-25T10:06:43.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95dce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d80669a0 0x7f95d80ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95dce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95d8066e00 0x7f95d815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95dce00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95d80aec70 con 0x7f95d8159e20 2024-04-25T10:06:43.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95dce00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95d806b540 con 0x7f95d8066e00 2024-04-25T10:06:43.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95dce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d806ac10 con 0x7f95d80669a0 2024-04-25T10:06:43.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95d5e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f95d8159e20 0x7f95d80b2dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:44262/0 (socket says 172.21.15.18:44262) 2024-04-25T10:06:43.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.127+0000 7f95d5e00640 1 -- 172.21.15.18:0/1373220916 learned_addr learned my addr 172.21.15.18:0/1373220916 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d6800640 1 --2- 172.21.15.18:0/1373220916 >> v2:172.21.15.18:3300/0 conn(0x7f95d8066e00 0x7f95d815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d5400640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d80669a0 0x7f95d80ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d6800640 1 -- 172.21.15.18:0/1373220916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d80669a0 msgr2=0x7f95d80ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d6800640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d80669a0 0x7f95d80ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d6800640 1 -- 172.21.15.18:0/1373220916 >> v1:172.21.15.167:6789/0 conn(0x7f95d8159e20 legacy=0x7f95d80b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.131+0000 7f95d6800640 1 -- 172.21.15.18:0/1373220916 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d806aef0 con 0x7f95d8066e00 2024-04-25T10:06:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95d6800640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8066e00 0x7f95d815da00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009d90 tx=0x7f95d001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1848aa313418e15f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95d4a00640 1 -- 172.21.15.18:0/1373220916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00b2070 con 0x7f95d8066e00 2024-04-25T10:06:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95d4a00640 1 -- 172.21.15.18:0/1373220916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d00a58b0 con 0x7f95d8066e00 2024-04-25T10:06:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95d4a00640 1 -- 172.21.15.18:0/1373220916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d00a5c80 con 0x7f95d8066e00 2024-04-25T10:06:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95dce00640 1 -- 172.21.15.18:0/1373220916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8066e00 msgr2=0x7f95d815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.135+0000 7f95dce00640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8066e00 0x7f95d815da00 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f95d0009d90 tx=0x7f95d001c8b0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 -- 172.21.15.18:0/1373220916 shutdown_connections 2024-04-25T10:06:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8066e00 0x7f95d815da00 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 --2- 172.21.15.18:0/1373220916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d80669a0 0x7f95d80ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 -- 172.21.15.18:0/1373220916 >> 172.21.15.18:0/1373220916 conn(0x7f95d80b23b0 msgr2=0x7f95d80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 -- 172.21.15.18:0/1373220916 shutdown_connections 2024-04-25T10:06:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 -- 172.21.15.18:0/1373220916 wait complete. 2024-04-25T10:06:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 Processor -- start 2024-04-25T10:06:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.139+0000 7f95dce00640 1 -- start start 2024-04-25T10:06:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d80669a0 0x7f95d8140610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 0x7f95d806e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815e6c0 con 0x7f95d8159e20 2024-04-25T10:06:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815a200 con 0x7f95d80669a0 2024-04-25T10:06:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d815e840 con 0x7f95d8066e00 2024-04-25T10:06:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:46162/0 (socket says 172.21.15.18:46162) 2024-04-25T10:06:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 -- 172.21.15.18:0/216174618 learned_addr learned my addr 172.21.15.18:0/216174618 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d6800640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 0x7f95d806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5e00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d80669a0 0x7f95d8140610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 -- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d80669a0 msgr2=0x7f95d8140610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d80669a0 0x7f95d8140610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 -- 172.21.15.18:0/216174618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 msgr2=0x7f95d806e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 0x7f95d806e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 -- 172.21.15.18:0/216174618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d806f0c0 con 0x7f95d8066e00 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d6800640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 0x7f95d806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:06:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95d5400640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d800 tx=0x7f95c400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400b6c0 con 0x7f95d8066e00 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c4019070 con 0x7f95d8066e00 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95d806f3a0 con 0x7f95d8066e00 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.143+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c400ba60 con 0x7f95d8066e00 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95d80cdb50 con 0x7f95d8066e00 2024-04-25T10:06:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95d80745d0 con 0x7f95d8066e00 2024-04-25T10:06:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95c400bc00 con 0x7f95d8066e00 2024-04-25T10:06:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95ce000640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 0x7f95b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f95c40854b0 con 0x7f95d8066e00 2024-04-25T10:06:43.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.147+0000 7f95d5e00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 0x7f95b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.151+0000 7f95d5e00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 0x7f95b8069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95c8000f70 tx=0x7f95c8009e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.151+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95c4056050 con 0x7f95d8066e00 2024-04-25T10:06:43.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.371+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f95d80adc20 con 0x7f95d8066e00 2024-04-25T10:06:43.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95ce000640 1 -- 172.21.15.18:0/216174618 <== mon.2 v2:172.21.15.167:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v168) v1 ==== 149+0+0 (secure 0 0 0) 0x7f95c405a0f0 con 0x7f95d8066e00 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 msgr2=0x7f95b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 0x7f95b8069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f95c8000f70 tx=0x7f95c8009e60 comp rx=0 tx=0).stop 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 msgr2=0x7f95d8145b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f95c400d800 tx=0x7f95c400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 shutdown_connections 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95d8159e20 0x7f95d806e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f95b8066f60 0x7f95b8069420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f95d8066e00 0x7f95d8145b50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 --2- 172.21.15.18:0/216174618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d80669a0 0x7f95d8140610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 >> 172.21.15.18:0/216174618 conn(0x7f95d80b23b0 msgr2=0x7f95d80b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 shutdown_connections 2024-04-25T10:06:43.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.607+0000 7f95dce00640 1 -- 172.21.15.18:0/216174618 wait complete. 2024-04-25T10:06:43.635 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T10:06:43.635 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T10:06:43.635 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:06:43.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:43.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 Processor -- start 2024-04-25T10:06:43.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 -- start start 2024-04-25T10:06:43.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f399c15b980 0x7f399c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0ce7f0 con 0x7f399c071970 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399c0cead0 con 0x7f399c15b5a0 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f39a2000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f399c0ce5b0 con 0x7f399c15b980 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f399be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f399c071970 0x7f399c0d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46652/0 (socket says 172.21.15.18:46652) 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f399be00640 1 -- 172.21.15.18:0/1784035831 learned_addr learned my addr 172.21.15.18:0/1784035831 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f3992a00640 1 --2- 172.21.15.18:0/1784035831 >> v2:172.21.15.167:3300/0 conn(0x7f399c15b980 0x7f399c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f399aa00640 1 -- 172.21.15.18:0/1784035831 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810102157 0 0) 0x7f399c0ce7f0 con 0x7f399c071970 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f399aa00640 1 -- 172.21.15.18:0/1784035831 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980003530 con 0x7f399c071970 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f3992a00640 1 -- 172.21.15.18:0/1784035831 >> v1:172.21.15.167:6789/0 conn(0x7f399c15b5a0 legacy=0x7f399c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f3992a00640 1 -- 172.21.15.18:0/1784035831 >> v1:172.21.15.18:6789/0 conn(0x7f399c071970 legacy=0x7f399c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.771+0000 7f3992a00640 1 -- 172.21.15.18:0/1784035831 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c0cf960 con 0x7f399c15b980 2024-04-25T10:06:43.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f3992a00640 1 --2- 172.21.15.18:0/1784035831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b980 0x7f399c0cbd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f39840097c0 tx=0x7f398401c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f273216b017c66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f399aa00640 1 -- 172.21.15.18:0/1784035831 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840b0070 con 0x7f399c15b980 2024-04-25T10:06:43.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f399aa00640 1 -- 172.21.15.18:0/1784035831 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39840ab600 con 0x7f399c15b980 2024-04-25T10:06:43.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f399aa00640 1 -- 172.21.15.18:0/1784035831 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39840a4e60 con 0x7f399c15b980 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 -- 172.21.15.18:0/1784035831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b980 msgr2=0x7f399c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 --2- 172.21.15.18:0/1784035831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b980 0x7f399c0cbd30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f39840097c0 tx=0x7f398401c2c0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 -- 172.21.15.18:0/1784035831 shutdown_connections 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 --2- 172.21.15.18:0/1784035831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b980 0x7f399c0cbd30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 -- 172.21.15.18:0/1784035831 >> 172.21.15.18:0/1784035831 conn(0x7f399c0b3390 msgr2=0x7f399c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 -- 172.21.15.18:0/1784035831 shutdown_connections 2024-04-25T10:06:43.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.775+0000 7f39a2000640 1 -- 172.21.15.18:0/1784035831 wait complete. 2024-04-25T10:06:43.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 Processor -- start 2024-04-25T10:06:43.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- start start 2024-04-25T10:06:43.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b5a0 0x7f399c1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399c15b980 0x7f399c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0d1490 con 0x7f399c071970 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399c0d1310 con 0x7f399c15b5a0 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399c169750 con 0x7f399c15b980 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39142/0 (socket says 172.21.15.18:39142) 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 -- 172.21.15.18:0/3389975403 learned_addr learned my addr 172.21.15.18:0/3389975403 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 -- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399c15b980 msgr2=0x7f399c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399c15b980 0x7f399c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 -- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b5a0 msgr2=0x7f399c1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b5a0 0x7f399c1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 -- 172.21.15.18:0/3389975403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c15c0b0 con 0x7f399c071970 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f399b400640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c530 tx=0x7f398c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c016020 con 0x7f399c071970 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c005220 con 0x7f399c071970 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399c15c390 con 0x7f399c071970 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c007030 con 0x7f399c071970 2024-04-25T10:06:43.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399c155390 con 0x7f399c071970 2024-04-25T10:06:43.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.779+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399c06deb0 con 0x7f399c071970 2024-04-25T10:06:43.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.783+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f398c0071d0 con 0x7f399c071970 2024-04-25T10:06:43.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.783+0000 7f3993e00640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 0x7f3978069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:43.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.783+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f398c084850 con 0x7f399c071970 2024-04-25T10:06:43.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.783+0000 7f3992a00640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 0x7f3978069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:43.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.783+0000 7f3992a00640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 0x7f3978069450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39840ad000 tx=0x7f3984004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:43.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.787+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f398c020020 con 0x7f399c071970 2024-04-25T10:06:43.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f399c0745d0 con 0x7f399c071970 2024-04-25T10:06:43.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f3993e00640 1 -- 172.21.15.18:0/3389975403 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+13269 (secure 0 0 0) 0x7f398c0074c0 con 0x7f399c071970 2024-04-25T10:06:43.959 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:43.959 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":58,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:42.597377+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6836/322178907":"2024-04-26T10:06:39.588324+0000","172.21.15.167:6834/322178907":"2024-04-26T10:06:39.588324+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:43.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 msgr2=0x7f3978069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 0x7f3978069450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39840ad000 tx=0x7f3984004740 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 msgr2=0x7f399c13bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f398c00c530 tx=0x7f398c00c9f0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 shutdown_connections 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3978066f90 0x7f3978069450 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f399c15b980 0x7f399c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f399c15b5a0 0x7f399c1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 --2- 172.21.15.18:0/3389975403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f399c071970 0x7f399c13bc50 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 >> 172.21.15.18:0/3389975403 conn(0x7f399c0b3390 msgr2=0x7f399c0caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 shutdown_connections 2024-04-25T10:06:43.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:43.951+0000 7f39a2000640 1 -- 172.21.15.18:0/3389975403 wait complete. 2024-04-25T10:06:43.981 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:06:43.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:06:44.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 Processor -- start 2024-04-25T10:06:44.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 -- start start 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ab015dc60 0x7f5ab00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab009a170 0x7f5ab00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab015e040 con 0x7f5ab006bf30 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab00cff80 con 0x7f5ab015dc60 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00d0260 con 0x7f5ab009a170 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ab015dc60 0x7f5ab00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ab006bf30 0x7f5ab0099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46664/0 (socket says 172.21.15.18:46664) 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5200640 1 -- 172.21.15.18:0/2318996048 learned_addr learned my addr 172.21.15.18:0/2318996048 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab6600640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab009a170 0x7f5ab00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5c00640 1 -- 172.21.15.18:0/2318996048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab009a170 msgr2=0x7f5ab00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5c00640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab009a170 0x7f5ab00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5c00640 1 -- 172.21.15.18:0/2318996048 >> v1:172.21.15.18:6789/0 conn(0x7f5ab006bf30 legacy=0x7f5ab0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5ab5c00640 1 -- 172.21.15.18:0/2318996048 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab00d0540 con 0x7f5ab015dc60 2024-04-25T10:06:44.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.119+0000 7f5aafe00640 1 -- 172.21.15.18:0/2318996048 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822347145 0 0) 0x7f5ab015e040 con 0x7f5ab006bf30 2024-04-25T10:06:44.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab5c00640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab00d1020 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40097c0 tx=0x7f5aa401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d522a12ad47f028b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5aafe00640 1 -- 172.21.15.18:0/2318996048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40b1070 con 0x7f5ab015dc60 2024-04-25T10:06:44.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5aafe00640 1 -- 172.21.15.18:0/2318996048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40a8050 con 0x7f5ab015dc60 2024-04-25T10:06:44.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5aafe00640 1 -- 172.21.15.18:0/2318996048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40ac860 con 0x7f5ab015dc60 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- 172.21.15.18:0/2318996048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 msgr2=0x7f5ab00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab00d1020 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40097c0 tx=0x7f5aa401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- 172.21.15.18:0/2318996048 shutdown_connections 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab009a170 0x7f5ab00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 --2- 172.21.15.18:0/2318996048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab00d1020 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- 172.21.15.18:0/2318996048 >> 172.21.15.18:0/2318996048 conn(0x7f5ab00b3200 msgr2=0x7f5ab00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- 172.21.15.18:0/2318996048 shutdown_connections 2024-04-25T10:06:44.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- 172.21.15.18:0/2318996048 wait complete. 2024-04-25T10:06:44.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 Processor -- start 2024-04-25T10:06:44.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.123+0000 7f5ab8600640 1 -- start start 2024-04-25T10:06:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab006bf30 0x7f5ab0154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab009a170 0x7f5ab01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00cc6f0 con 0x7f5ab015dc60 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00cc570 con 0x7f5ab009a170 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab00cc870 con 0x7f5ab006bf30 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39166/0 (socket says 172.21.15.18:39166) 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 -- 172.21.15.18:0/3616295690 learned_addr learned my addr 172.21.15.18:0/3616295690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab5c00640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab006bf30 0x7f5ab0154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab5200640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab009a170 0x7f5ab01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 -- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab006bf30 msgr2=0x7f5ab0154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab006bf30 0x7f5ab0154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 -- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab009a170 msgr2=0x7f5ab01555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab009a170 0x7f5ab01555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 -- 172.21.15.18:0/3616295690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab01552f0 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab6600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007e30 tx=0x7f5aa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8014620 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8019070 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8014a00 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab00b6d10 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab009cb60 con 0x7f5ab015dc60 2024-04-25T10:06:44.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.127+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab00b7230 con 0x7f5ab015dc60 2024-04-25T10:06:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.131+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5aa8014ba0 con 0x7f5ab015dc60 2024-04-25T10:06:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.131+0000 7f5aad600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 0x7f5a90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.131+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f5aa8085640 con 0x7f5ab015dc60 2024-04-25T10:06:44.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.131+0000 7f5ab5c00640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 0x7f5a90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.131+0000 7f5ab5c00640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 0x7f5a90069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40ae000 tx=0x7f5aa40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.135+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5aa8056160 con 0x7f5ab015dc60 2024-04-25T10:06:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.295+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ab00745d0 con 0x7f5ab015dc60 2024-04-25T10:06:44.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5aad600640 1 -- 172.21.15.18:0/3616295690 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5aa805a200 con 0x7f5ab015dc60 2024-04-25T10:06:44.305 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 msgr2=0x7f5a90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 0x7f5a90069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5aa40ae000 tx=0x7f5aa40a7000 comp rx=0 tx=0).stop 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 msgr2=0x7f5ab009c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8007e30 tx=0x7f5aa800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 shutdown_connections 2024-04-25T10:06:44.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ab015dc60 0x7f5ab009c620 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ab009a170 0x7f5ab01555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a90066f60 0x7f5a90069420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 --2- 172.21.15.18:0/3616295690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ab006bf30 0x7f5ab0154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 >> 172.21.15.18:0/3616295690 conn(0x7f5ab00b3200 msgr2=0x7f5ab006c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 shutdown_connections 2024-04-25T10:06:44.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.299+0000 7f5ab8600640 1 -- 172.21.15.18:0/3616295690 wait complete. 2024-04-25T10:06:44.326 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T10:06:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 Processor -- start 2024-04-25T10:06:44.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 -- start start 2024-04-25T10:06:44.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1084145270 0x7f108415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10840cd4d0 0x7f10840cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10840cc4e0 con 0x7f10840b1750 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1084145650 con 0x7f1084145270 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.459+0000 7f108c800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10840ce040 con 0x7f10840cd4d0 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1084145270 0x7f108415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1084145270 0x7f108415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39170/0 (socket says 172.21.15.18:39170) 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 -- 172.21.15.18:0/3229935878 learned_addr learned my addr 172.21.15.18:0/3229935878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:44.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089400640 1 --2- 172.21.15.18:0/3229935878 >> v2:172.21.15.167:3300/0 conn(0x7f10840cd4d0 0x7f10840cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 -- 172.21.15.18:0/3229935878 >> v2:172.21.15.167:3300/0 conn(0x7f10840cd4d0 msgr2=0x7f10840cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 --2- 172.21.15.18:0/3229935878 >> v2:172.21.15.167:3300/0 conn(0x7f10840cd4d0 0x7f10840cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 -- 172.21.15.18:0/3229935878 >> v1:172.21.15.167:6789/0 conn(0x7f10840b1750 legacy=0x7f10840b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 -- 172.21.15.18:0/3229935878 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840ce320 con 0x7f1084145270 2024-04-25T10:06:44.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1089e00640 1 --2- 172.21.15.18:0/3229935878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108415fe50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f10840b24b0 tx=0x7f107801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a65dd5221c6fb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1088a00640 1 -- 172.21.15.18:0/3229935878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780ab610 con 0x7f1084145270 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1088a00640 1 -- 172.21.15.18:0/3229935878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10780b0070 con 0x7f1084145270 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.463+0000 7f1088a00640 1 -- 172.21.15.18:0/3229935878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10780ab9d0 con 0x7f1084145270 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- 172.21.15.18:0/3229935878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 msgr2=0x7f108415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- 172.21.15.18:0/3229935878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108415fe50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f10840b24b0 tx=0x7f107801c520 comp rx=0 tx=0).stop 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- 172.21.15.18:0/3229935878 shutdown_connections 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- 172.21.15.18:0/3229935878 >> v2:172.21.15.167:3300/0 conn(0x7f10840cd4d0 0x7f10840cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- 172.21.15.18:0/3229935878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108415fe50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- 172.21.15.18:0/3229935878 >> 172.21.15.18:0/3229935878 conn(0x7f1084066fa0 msgr2=0x7f108406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- 172.21.15.18:0/3229935878 shutdown_connections 2024-04-25T10:06:44.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- 172.21.15.18:0/3229935878 wait complete. 2024-04-25T10:06:44.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 Processor -- start 2024-04-25T10:06:44.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- start start 2024-04-25T10:06:44.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10840b1750 0x7f108415b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 0x7f10841f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108415c710 con 0x7f1084145270 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108415c590 con 0x7f10840cd4d0 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108415c890 con 0x7f10840b1750 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f1089e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10840b1750 0x7f108415b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f1089400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 0x7f10841f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39174/0 (socket says 172.21.15.18:39174) 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f1089400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 0x7f10841f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:41258/0 (socket says 172.21.15.18:41258) 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 -- 172.21.15.18:0/926440985 learned_addr learned my addr 172.21.15.18:0/926440985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 -- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10840b1750 msgr2=0x7f108415b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10840b1750 0x7f108415b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 -- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 msgr2=0x7f10841f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 0x7f10841f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:44.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.467+0000 7f108a800640 1 -- 172.21.15.18:0/926440985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108413d490 con 0x7f1084145270 2024-04-25T10:06:44.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f108a800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f108000c770 tx=0x7f108000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1080003b80 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1080003d20 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10840b3230 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108000aa90 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1084141280 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10840745d0 con 0x7f1084145270 2024-04-25T10:06:44.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f108000ac30 con 0x7f1084145270 2024-04-25T10:06:44.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 0x7f1068069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:44.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f1080084cb0 con 0x7f1084145270 2024-04-25T10:06:44.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.471+0000 7f1089e00640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 0x7f1068069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.475+0000 7f1089e00640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 0x7f1068069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f10780af000 tx=0x7f10780a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:44.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.475+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f108413d490 con 0x7f1084145270 2024-04-25T10:06:44.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:44.695+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f108406b8e0 con 0x7f1084145270 2024-04-25T10:06:45.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f107e000640 1 -- 172.21.15.18:0/926440985 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v170) v1 ==== 172+0+0 (secure 0 0 0) 0x7f10800557e0 con 0x7f1084145270 2024-04-25T10:06:45.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 msgr2=0x7f1068069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 0x7f1068069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f10780af000 tx=0x7f10780a7000 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 msgr2=0x7f108406d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f108000c770 tx=0x7f108000cc30 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 shutdown_connections 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1084145270 0x7f108406d2b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10840cd4d0 0x7f10841f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1068066f60 0x7f1068069420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 --2- 172.21.15.18:0/926440985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10840b1750 0x7f108415b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 >> 172.21.15.18:0/926440985 conn(0x7f1084066fa0 msgr2=0x7f10840b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 shutdown_connections 2024-04-25T10:06:45.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.611+0000 7f108c800640 1 -- 172.21.15.18:0/926440985 wait complete. 2024-04-25T10:06:45.645 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:06:45.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 Processor -- start 2024-04-25T10:06:45.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 -- start start 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9de415dc00 0x7f9de40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9de40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40b30d0 con 0x7f9de40d0150 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40cd860 con 0x7f9de415dc00 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dec000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40ccf30 con 0x7f9de40c72a0 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de8c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9de40d0150 0x7f9de40c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46668/0 (socket says 172.21.15.18:46668) 2024-04-25T10:06:45.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de8c00640 1 -- 172.21.15.18:0/547814571 learned_addr learned my addr 172.21.15.18:0/547814571 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de9600640 1 --2- 172.21.15.18:0/547814571 >> v2:172.21.15.167:3300/0 conn(0x7f9de415dc00 0x7f9de40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dea000640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9de40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762636688 0 0) 0x7f9de40b30d0 con 0x7f9de40d0150 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc003530 con 0x7f9de40d0150 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935631823 0 0) 0x7f9dcc003530 con 0x7f9de40d0150 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 msgr2=0x7f9de40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9de40c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 >> v2:172.21.15.167:3300/0 conn(0x7f9de415dc00 msgr2=0x7f9de40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 --2- 172.21.15.18:0/547814571 >> v2:172.21.15.167:3300/0 conn(0x7f9de415dc00 0x7f9de40af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40cd210 con 0x7f9de40d0150 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f9dd0001680 con 0x7f9de40d0150 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 >> v1:172.21.15.18:6789/0 conn(0x7f9de40d0150 legacy=0x7f9de40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9dcc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40cd860 con 0x7f9dcc0039c0 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40ccf30 con 0x7f9dcc004d50 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc00b9d0 con 0x7f9de40c72a0 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de9600640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9de8c00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9dcc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.787+0000 7f9dea000640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 -- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 msgr2=0x7f9dcc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9dcc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 -- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc004d50 msgr2=0x7f9dcc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 -- 172.21.15.18:0/547814571 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc003530 con 0x7f9dcc0039c0 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de8c00640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9de40c72a0 0x7f9dcc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dea000640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dcc004d50 0x7f9dcc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de9600640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009b10 tx=0x7f9dd801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f6c03d11b51fa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80096b0 con 0x7f9dcc0039c0 2024-04-25T10:06:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd80a6490 con 0x7f9dcc0039c0 2024-04-25T10:06:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9de3e00640 1 -- 172.21.15.18:0/547814571 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80a6880 con 0x7f9dcc0039c0 2024-04-25T10:06:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 -- 172.21.15.18:0/547814571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dcc0039c0 msgr2=0x7f9dcc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 --2- 172.21.15.18:0/547814571 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9dcc0039c0 0x7f9dcc003de0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009b10 tx=0x7f9dd801cab0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dea000640 1 -- 172.21.15.18:0/547814571 reap_dead start 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 -- 172.21.15.18:0/547814571 shutdown_connections 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 -- 172.21.15.18:0/547814571 >> 172.21.15.18:0/547814571 conn(0x7f9de40b2240 msgr2=0x7f9de40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 -- 172.21.15.18:0/547814571 shutdown_connections 2024-04-25T10:06:45.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.791+0000 7f9dec000640 1 -- 172.21.15.18:0/547814571 wait complete. 2024-04-25T10:06:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 Processor -- start 2024-04-25T10:06:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 -- start start 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0039c0 0x7f9de415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9de415a8b0 0x7f9de41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40c5cc0 con 0x7f9de40b0c00 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40cdee0 con 0x7f9de415a8b0 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40c5e40 con 0x7f9dcc0039c0 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39190/0 (socket says 172.21.15.18:39190) 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 -- 172.21.15.18:0/3485668769 learned_addr learned my addr 172.21.15.18:0/3485668769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9de9600640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0039c0 0x7f9de415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9de8c00640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9de415a8b0 0x7f9de41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 -- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0039c0 msgr2=0x7f9de415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0039c0 0x7f9de415bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 -- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9de415a8b0 msgr2=0x7f9de41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9de415a8b0 0x7f9de41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 -- 172.21.15.18:0/3485668769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de4157140 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dea000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9de4072330 tx=0x7f9ddc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc007e60 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc01c070 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.795+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de40b6870 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc016470 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de415b100 con 0x7f9de40b0c00 2024-04-25T10:06:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de406ccb0 con 0x7f9de40b0c00 2024-04-25T10:06:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ddc016610 con 0x7f9de40b0c00 2024-04-25T10:06:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de1600640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 0x7f9dc4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9ddc0858a0 con 0x7f9de40b0c00 2024-04-25T10:06:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de9600640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 0x7f9dc4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.799+0000 7f9de9600640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 0x7f9dc4069450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80ad000 tx=0x7f9dd80b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:45.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.803+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ddc026020 con 0x7f9de40b0c00 2024-04-25T10:06:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.963+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9de40745d0 con 0x7f9de40b0c00 2024-04-25T10:06:45.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.967+0000 7f9de1600640 1 -- 172.21.15.18:0/3485668769 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9ddc0562b0 con 0x7f9de40b0c00 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 msgr2=0x7f9dc4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 0x7f9dc4069450 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80ad000 tx=0x7f9dd80b3040 comp rx=0 tx=0).stop 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 msgr2=0x7f9de40b1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f9de4072330 tx=0x7f9ddc0115a0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 shutdown_connections 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de40b0c00 0x7f9de40b1080 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9de415a8b0 0x7f9de41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9dc4066f90 0x7f9dc4069450 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 --2- 172.21.15.18:0/3485668769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9dcc0039c0 0x7f9de415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 >> 172.21.15.18:0/3485668769 conn(0x7f9de40b2240 msgr2=0x7f9de40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 shutdown_connections 2024-04-25T10:06:45.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:45.971+0000 7f9dec000640 1 -- 172.21.15.18:0/3485668769 wait complete. 2024-04-25T10:06:45.998 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:06:45.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:06:46.095 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:06:46.189 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:06:46.189 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:46.189 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:46.198 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:06:46.198 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:06:46.199 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:46.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:06:46.208 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:06:46.208 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:46.249 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:06:46.249 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:06:46.249 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:06:46.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:06:46.258 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:06:46.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:06:46.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 Processor -- start 2024-04-25T10:06:46.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 -- start start 2024-04-25T10:06:46.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c7c15e550 0x7f7c7c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c06d090 con 0x7f7c7c070fe0 2024-04-25T10:06:46.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c071ad0 con 0x7f7c7c161510 2024-04-25T10:06:46.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c84000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c162390 con 0x7f7c7c15e550 2024-04-25T10:06:46.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c81600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7c7c070fe0 0x7f7c7c0713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46674/0 (socket says 172.21.15.18:46674) 2024-04-25T10:06:46.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c81600640 1 -- 172.21.15.18:0/792819103 learned_addr learned my addr 172.21.15.18:0/792819103 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4210799019 0 0) 0x7f7c70001120 con 0x7f7c7c070fe0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c64003530 con 0x7f7c7c070fe0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c82000640 1 --2- 172.21.15.18:0/792819103 >> v2:172.21.15.167:3300/0 conn(0x7f7c7c15e550 0x7f7c7c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2300075368 0 0) 0x7f7c64003530 con 0x7f7c7c070fe0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 >> v2:172.21.15.167:3300/0 conn(0x7f7c7c15e550 msgr2=0x7f7c7c15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 --2- 172.21.15.18:0/792819103 >> v2:172.21.15.167:3300/0 conn(0x7f7c7c15e550 0x7f7c7c15e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 >> v1:172.21.15.167:6789/0 conn(0x7f7c7c161510 legacy=0x7f7c7c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c161af0 con 0x7f7c7c070fe0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f7c70001850 con 0x7f7c7c070fe0 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 >> v1:172.21.15.18:6789/0 conn(0x7f7c7c070fe0 legacy=0x7f7c7c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c640039c0 0x7f7c64003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c64004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c640051d0 0x7f7c6400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c162390 con 0x7f7c64004810 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6400c120 con 0x7f7c640051d0 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6400c320 con 0x7f7c640039c0 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c82000640 1 --2- 172.21.15.18:0/792819103 >> v2:172.21.15.167:3300/0 conn(0x7f7c7c15e550 0x7f7c7c15e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c64004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c81600640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c640039c0 0x7f7c64003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c82000640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c640051d0 0x7f7c6400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 -- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c640039c0 msgr2=0x7f7c64003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c640039c0 0x7f7c64003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 -- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c640051d0 msgr2=0x7f7c6400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:46.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c640051d0 0x7f7c6400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c80c00640 1 -- 172.21.15.18:0/792819103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c64003530 con 0x7f7c64004810 2024-04-25T10:06:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c82000640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c640051d0 0x7f7c6400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:46.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.431+0000 7f7c82000640 1 -- 172.21.15.18:0/792819103 reap_dead start 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c80c00640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c64004c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7c68001780 tx=0x7f7c6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1a0cff12304afa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680013a0 con 0x7f7c64004810 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c680052f0 con 0x7f7c64004810 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c7be00640 1 -- 172.21.15.18:0/792819103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68003840 con 0x7f7c64004810 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 -- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 msgr2=0x7f7c64004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c64004c90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7c68001780 tx=0x7f7c6801c400 comp rx=0 tx=0).stop 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 -- 172.21.15.18:0/792819103 shutdown_connections 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 --2- 172.21.15.18:0/792819103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c64004c90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 -- 172.21.15.18:0/792819103 >> 172.21.15.18:0/792819103 conn(0x7f7c7c0b3390 msgr2=0x7f7c7c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:46.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 -- 172.21.15.18:0/792819103 shutdown_connections 2024-04-25T10:06:46.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.435+0000 7f7c84000640 1 -- 172.21.15.18:0/792819103 wait complete. 2024-04-25T10:06:46.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 Processor -- start 2024-04-25T10:06:46.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- start start 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 0x7f7c7c142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7c1429a0 0x7f7c7c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c15e030 con 0x7f7c64004810 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c1620b0 con 0x7f7c7c15c8e0 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c15e980 con 0x7f7c7c1429a0 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39216/0 (socket says 172.21.15.18:39216) 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 -- 172.21.15.18:0/2595532528 learned_addr learned my addr 172.21.15.18:0/2595532528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c80c00640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 0x7f7c7c142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 -- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7c1429a0 msgr2=0x7f7c7c143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7c1429a0 0x7f7c7c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 -- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 msgr2=0x7f7c7c142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 0x7f7c7c142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 -- 172.21.15.18:0/2595532528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c1f4200 con 0x7f7c64004810 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c80c00640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 0x7f7c7c142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c81600640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7c700019c0 tx=0x7f7c70012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7001c070 con 0x7f7c64004810 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c70014550 con 0x7f7c64004810 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70014920 con 0x7f7c64004810 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c1f44e0 con 0x7f7c64004810 2024-04-25T10:06:46.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.439+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c1f4aa0 con 0x7f7c64004810 2024-04-25T10:06:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c0745d0 con 0x7f7c64004810 2024-04-25T10:06:46.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c70014ac0 con 0x7f7c64004810 2024-04-25T10:06:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c79600640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 0x7f7c5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7c700876a0 con 0x7f7c64004810 2024-04-25T10:06:46.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c80c00640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 0x7f7c5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:46.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.443+0000 7f7c80c00640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 0x7f7c5c069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c68001750 tx=0x7f7c680011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:46.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.447+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c7c06d090 con 0x7f7c64004810 2024-04-25T10:06:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.643+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c7c0b28b0 con 0x7f7c64004810 2024-04-25T10:06:46.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.643+0000 7f7c79600640 1 -- 172.21.15.18:0/2595532528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f7c70058780 con 0x7f7c64004810 2024-04-25T10:06:46.652 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:46.652 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5548,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2013656848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2013656848},{"type":"v1","addr":"172.21.15.167:6837","nonce":2013656848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5718,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2280015667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2280015667},{"type":"v1","addr":"172.21.15.18:6833","nonce":2280015667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21},{"gid":5727,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/877917238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":877917238},{"type":"v1","addr":"172.21.15.18:6835","nonce":877917238}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5875,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2635016142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2635016142},{"type":"v1","addr":"172.21.15.167:6836","nonce":2635016142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[]} 2024-04-25T10:06:46.652 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 msgr2=0x7f7c5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 0x7f7c5c069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7c68001750 tx=0x7f7c680011a0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 msgr2=0x7f7c7c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7c700019c0 tx=0x7f7c70012920 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 shutdown_connections 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c5c066f60 0x7f7c5c069420 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c7c1429a0 0x7f7c7c143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7c15c8e0 0x7f7c7c142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 --2- 172.21.15.18:0/2595532528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c64004810 0x7f7c7c0b4690 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 >> 172.21.15.18:0/2595532528 conn(0x7f7c7c0b3390 msgr2=0x7f7c7c140130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 shutdown_connections 2024-04-25T10:06:46.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:46.647+0000 7f7c84000640 1 -- 172.21.15.18:0/2595532528 wait complete. 2024-04-25T10:06:46.674 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:06:46.674 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:06:46.674 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:06:46.674 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:06:46.675 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:06:46.675 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:06:46.675 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:06:46.675 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:06:46.675 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:06:46.675 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:06:46.675 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:06:46.676 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:06:46.676 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:06:46.676 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:06:46.676 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:06:46.676 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:06:46.691 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:06:46.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:06:46.692 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:06:46.692 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:06:46.694 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:06:46.694 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:06:46.739 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:06:46.739 DEBUG:teuthology.parallel:result is None 2024-04-25T10:06:46.740 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:06:46.740 DEBUG:teuthology.parallel:result is None 2024-04-25T10:06:46.741 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:06:46.741 DEBUG:teuthology.parallel:result is None 2024-04-25T10:06:46.825 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:06:46.831 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:06:46.831 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:06:50.636 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:06:50.640 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:06:52.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T10:06:52.691 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:06:52.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:06:52.695 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:06:52.695 DEBUG:teuthology.parallel:result is None 2024-04-25T10:06:52.695 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:06:52.790 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:06:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 Processor -- start 2024-04-25T10:06:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 -- start start 2024-04-25T10:06:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda9c06bc20 0x7fda9c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c066de0 0x7fda9c161c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c06c540 con 0x7fda9c0669a0 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15ed10 con 0x7fda9c06bc20 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15e100 con 0x7fda9c066de0 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda9c06bc20 0x7fda9c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda9c06bc20 0x7fda9c06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51550/0 (socket says 172.21.15.18:51550) 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 -- 172.21.15.18:0/2530225838 learned_addr learned my addr 172.21.15.18:0/2530225838 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:52.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa2200640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c066de0 0x7fda9c161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 -- 172.21.15.18:0/2530225838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c066de0 msgr2=0x7fda9c161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c066de0 0x7fda9c161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 -- 172.21.15.18:0/2530225838 >> v1:172.21.15.167:6789/0 conn(0x7fda9c0669a0 legacy=0x7fda9c161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.843+0000 7fdaa1800640 1 -- 172.21.15.18:0/2530225838 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c15e3e0 con 0x7fda9c06bc20 2024-04-25T10:06:52.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa1800640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c06bc20 0x7fda9c06c000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda90009e50 tx=0x7fda9001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0d6e03112da2db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:52.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fda9be00640 1 -- 172.21.15.18:0/2530225838 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900a57f0 con 0x7fda9c06bc20 2024-04-25T10:06:52.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fda9be00640 1 -- 172.21.15.18:0/2530225838 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda900a5990 con 0x7fda9c06bc20 2024-04-25T10:06:52.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fda9be00640 1 -- 172.21.15.18:0/2530225838 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900a5d60 con 0x7fda9c06bc20 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 -- 172.21.15.18:0/2530225838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c06bc20 msgr2=0x7fda9c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c06bc20 0x7fda9c06c000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fda90009e50 tx=0x7fda9001ca30 comp rx=0 tx=0).stop 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 -- 172.21.15.18:0/2530225838 shutdown_connections 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c066de0 0x7fda9c161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/2530225838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c06bc20 0x7fda9c06c000 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 -- 172.21.15.18:0/2530225838 >> 172.21.15.18:0/2530225838 conn(0x7fda9c071950 msgr2=0x7fda9c071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 -- 172.21.15.18:0/2530225838 shutdown_connections 2024-04-25T10:06:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 -- 172.21.15.18:0/2530225838 wait complete. 2024-04-25T10:06:52.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.847+0000 7fdaa2c00640 1 Processor -- start 2024-04-25T10:06:52.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- start start 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda9c066de0 0x7fda9c159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c06bc20 0x7fda9c1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15b900 con 0x7fda9c0669a0 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15b780 con 0x7fda9c066de0 2024-04-25T10:06:52.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c162150 con 0x7fda9c06bc20 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51564/0 (socket says 172.21.15.18:51564) 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 -- 172.21.15.18:0/507943027 learned_addr learned my addr 172.21.15.18:0/507943027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa0e00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda9c066de0 0x7fda9c159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2200640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c06bc20 0x7fda9c1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 -- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c06bc20 msgr2=0x7fda9c1486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c06bc20 0x7fda9c1486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 -- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda9c066de0 msgr2=0x7fda9c159cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda9c066de0 0x7fda9c159cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 -- 172.21.15.18:0/507943027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c149a10 con 0x7fda9c0669a0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa1800640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fda900af040 tx=0x7fda900197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900b8670 con 0x7fda9c0669a0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda900be070 con 0x7fda9c0669a0 2024-04-25T10:06:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda900b8a70 con 0x7fda9c0669a0 2024-04-25T10:06:52.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda9c149cf0 con 0x7fda9c0669a0 2024-04-25T10:06:52.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c148c20 con 0x7fda9c0669a0 2024-04-25T10:06:52.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.851+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c155340 con 0x7fda9c0669a0 2024-04-25T10:06:52.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.855+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda900b8c10 con 0x7fda9c0669a0 2024-04-25T10:06:52.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.855+0000 7fda99600640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 0x7fda7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:52.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.855+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fda90120140 con 0x7fda9c0669a0 2024-04-25T10:06:52.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.855+0000 7fdaa0e00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 0x7fda7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:52.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.855+0000 7fdaa0e00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 0x7fda7c069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fda88001770 tx=0x7fda88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:52.859+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda90016620 con 0x7fda9c0669a0 2024-04-25T10:06:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:53.031+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fda9c0745d0 con 0x7fda9c0669a0 2024-04-25T10:06:54.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fda99600640 1 -- 172.21.15.18:0/507943027 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) v1 ==== 97+0+0 (secure 0 0 0) 0x7fda900f1220 con 0x7fda9c0669a0 2024-04-25T10:06:54.650 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 msgr2=0x7fda7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 0x7fda7c069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fda88001770 tx=0x7fda88009040 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 msgr2=0x7fda9c15abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fda900af040 tx=0x7fda900197d0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 shutdown_connections 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fda7c066f60 0x7fda7c069420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda9c06bc20 0x7fda9c1486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda9c066de0 0x7fda9c159cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 --2- 172.21.15.18:0/507943027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda9c0669a0 0x7fda9c15abc0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.643+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 >> 172.21.15.18:0/507943027 conn(0x7fda9c071950 msgr2=0x7fda9c15bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.647+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 shutdown_connections 2024-04-25T10:06:54.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.647+0000 7fdaa2c00640 1 -- 172.21.15.18:0/507943027 wait complete. 2024-04-25T10:06:54.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:06:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.815+0000 7f852d800640 1 Processor -- start 2024-04-25T10:06:54.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.815+0000 7f852d800640 1 -- start start 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f852d800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8528145270 0x7f852815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f852d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f85280cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f852d800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85280cc4e0 con 0x7f85280b1750 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f852d800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8528145650 con 0x7f8528145270 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f852d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280ce040 con 0x7f85280cd4d0 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f85280b1750 0x7f852815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50106/0 (socket says 172.21.15.18:50106) 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 -- 172.21.15.18:0/822985741 learned_addr learned my addr 172.21.15.18:0/822985741 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526a00640 1 --2- 172.21.15.18:0/822985741 >> v2:172.21.15.167:3300/0 conn(0x7f8528145270 0x7f852815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f851fe00640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f85280cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103579224 0 0) 0x7f85280cc4e0 con 0x7f85280b1750 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f850c003530 con 0x7f85280b1750 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817313311 0 0) 0x7f850c003530 con 0x7f85280b1750 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 msgr2=0x7f85280cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f85280cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 >> v2:172.21.15.167:3300/0 conn(0x7f8528145270 msgr2=0x7f852815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 --2- 172.21.15.18:0/822985741 >> v2:172.21.15.167:3300/0 conn(0x7f8528145270 0x7f852815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85280ce320 con 0x7f85280b1750 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f8520001a00 con 0x7f85280b1750 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 >> v1:172.21.15.18:6789/0 conn(0x7f85280b1750 legacy=0x7f852815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f850c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f850c003f90 0x7f850c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850c004d50 0x7f850c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8528145650 con 0x7f850c004d50 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85280ce040 con 0x7f850c003f90 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850c00b9d0 con 0x7f85280cd4d0 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850c004d50 0x7f850c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f851fe00640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f850c003f90 0x7f850c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8526a00640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f850c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 -- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 msgr2=0x7f850c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f85280cd4d0 0x7f850c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 -- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f850c003f90 msgr2=0x7f850c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:54.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f850c003f90 0x7f850c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.819+0000 7f8527400640 1 -- 172.21.15.18:0/822985741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c003530 con 0x7f850c004d50 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f8527400640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850c004d50 0x7f850c0051d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f852000a7d0 tx=0x7f852001d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c360af8373c65f69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852000a3f0 con 0x7f850c004d50 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85200ad650 con 0x7f850c004d50 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f8526000640 1 -- 172.21.15.18:0/822985741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85200ada40 con 0x7f850c004d50 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 -- 172.21.15.18:0/822985741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850c004d50 msgr2=0x7f850c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 --2- 172.21.15.18:0/822985741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850c004d50 0x7f850c0051d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f852000a7d0 tx=0x7f852001d2c0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f8527400640 1 -- 172.21.15.18:0/822985741 reap_dead start 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 -- 172.21.15.18:0/822985741 shutdown_connections 2024-04-25T10:06:54.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 -- 172.21.15.18:0/822985741 >> 172.21.15.18:0/822985741 conn(0x7f8528066fa0 msgr2=0x7f852806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 -- 172.21.15.18:0/822985741 shutdown_connections 2024-04-25T10:06:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 -- 172.21.15.18:0/822985741 wait complete. 2024-04-25T10:06:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.823+0000 7f852d800640 1 Processor -- start 2024-04-25T10:06:54.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- start start 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f850c004d50 0x7f85280b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8528152ef0 0x7f852806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852815f930 con 0x7f852813fea0 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852815f650 con 0x7f8528152ef0 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85280cd930 con 0x7f850c004d50 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51582/0 (socket says 172.21.15.18:51582) 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 -- 172.21.15.18:0/3079856510 learned_addr learned my addr 172.21.15.18:0/3079856510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 -- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f850c004d50 msgr2=0x7f85280b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f850c004d50 0x7f85280b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 -- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8528152ef0 msgr2=0x7f852806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8528152ef0 0x7f852806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 -- 172.21.15.18:0/3079856510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f852813aac0 con 0x7f852813fea0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851fe00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f85100119d0 tx=0x7f8510011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000fad0 con 0x7f852813fea0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000fc70 con 0x7f852813fea0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85280af5e0 con 0x7f852813fea0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510014440 con 0x7f852813fea0 2024-04-25T10:06:54.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85280afba0 con 0x7f852813fea0 2024-04-25T10:06:54.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.827+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85280745d0 con 0x7f852813fea0 2024-04-25T10:06:54.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.831+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8510012040 con 0x7f852813fea0 2024-04-25T10:06:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.831+0000 7f851ea00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 0x7f8504069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.831+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8510085470 con 0x7f852813fea0 2024-04-25T10:06:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.831+0000 7f8526a00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 0x7f8504069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:54.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.831+0000 7f8526a00640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 0x7f8504069420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8518006e90 tx=0x7f8518006e00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:54.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:54.835+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8510019030 con 0x7f852813fea0 2024-04-25T10:06:55.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.051+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8528140b80 con 0x7f852813fea0 2024-04-25T10:06:55.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f851ea00640 1 -- 172.21.15.18:0/3079856510 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f85100566f0 con 0x7f852813fea0 2024-04-25T10:06:55.061 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:55.061 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:06:55.063 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.064 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:06:55.065 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.067 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.068 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.069 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:06:55.070 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:06:55.071 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.072 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.074 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:06:55.075 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.076 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:55.076 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:06:55.076 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:06:55.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 msgr2=0x7f8504069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 0x7f8504069420 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8518006e90 tx=0x7f8518006e00 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 msgr2=0x7f85280aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f85100119d0 tx=0x7f8510011e90 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 shutdown_connections 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8528152ef0 0x7f852806d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f852813fea0 0x7f85280aec20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8504066f60 0x7f8504069420 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 --2- 172.21.15.18:0/3079856510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f850c004d50 0x7f85280b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 >> 172.21.15.18:0/3079856510 conn(0x7f8528066fa0 msgr2=0x7f852815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 shutdown_connections 2024-04-25T10:06:55.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.055+0000 7f852d800640 1 -- 172.21.15.18:0/3079856510 wait complete. 2024-04-25T10:06:55.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:55.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 Processor -- start 2024-04-25T10:06:55.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 -- start start 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f70d815fe50 0x7f70d80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70d80b1c90 0x7f70d815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d80b20a0 con 0x7f70d8145270 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d8145650 con 0x7f70d80b1c90 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.215+0000 7f70dfa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d81602b0 con 0x7f70d815fe50 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70d80b1c90 0x7f70d815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70d80b1c90 0x7f70d815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51584/0 (socket says 172.21.15.18:51584) 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 -- 172.21.15.18:0/3772174752 learned_addr learned my addr 172.21.15.18:0/3772174752 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dd000640 1 --1- 172.21.15.18:0/3772174752 >> v1:172.21.15.18:6789/0 conn(0x7f70d8145270 0x7f70d80cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50108/0 (socket says 172.21.15.18:50108) 2024-04-25T10:06:55.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70d7e00640 1 --2- 172.21.15.18:0/3772174752 >> v2:172.21.15.167:3300/0 conn(0x7f70d815fe50 0x7f70d80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 -- 172.21.15.18:0/3772174752 >> v2:172.21.15.167:3300/0 conn(0x7f70d815fe50 msgr2=0x7f70d80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:55.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 --2- 172.21.15.18:0/3772174752 >> v2:172.21.15.167:3300/0 conn(0x7f70d815fe50 0x7f70d80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 -- 172.21.15.18:0/3772174752 >> v1:172.21.15.18:6789/0 conn(0x7f70d8145270 legacy=0x7f70d80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 -- 172.21.15.18:0/3772174752 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80cc4e0 con 0x7f70d80b1c90 2024-04-25T10:06:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70dda00640 1 --2- 172.21.15.18:0/3772174752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d815bd80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f70d80b24b0 tx=0x7f70d001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae9bbe102b72e8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70d7400640 1 -- 172.21.15.18:0/3772174752 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a5880 con 0x7f70d80b1c90 2024-04-25T10:06:55.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70d7400640 1 -- 172.21.15.18:0/3772174752 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d00a5a20 con 0x7f70d80b1c90 2024-04-25T10:06:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.219+0000 7f70d7400640 1 -- 172.21.15.18:0/3772174752 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d00a5df0 con 0x7f70d80b1c90 2024-04-25T10:06:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- 172.21.15.18:0/3772174752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 msgr2=0x7f70d815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- 172.21.15.18:0/3772174752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d815bd80 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f70d80b24b0 tx=0x7f70d001c9c0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- 172.21.15.18:0/3772174752 shutdown_connections 2024-04-25T10:06:55.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- 172.21.15.18:0/3772174752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d815bd80 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- 172.21.15.18:0/3772174752 >> v2:172.21.15.167:3300/0 conn(0x7f70d815fe50 0x7f70d80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- 172.21.15.18:0/3772174752 >> 172.21.15.18:0/3772174752 conn(0x7f70d8066fa0 msgr2=0x7f70d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- 172.21.15.18:0/3772174752 shutdown_connections 2024-04-25T10:06:55.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- 172.21.15.18:0/3772174752 wait complete. 2024-04-25T10:06:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 Processor -- start 2024-04-25T10:06:55.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- start start 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d8145270 0x7f70d813c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d815fe50 0x7f70d815a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d815f930 con 0x7f70d80b1c90 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d815f650 con 0x7f70d8145270 2024-04-25T10:06:55.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dfa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d80cdbe0 con 0x7f70d815fe50 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51590/0 (socket says 172.21.15.18:51590) 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 -- 172.21.15.18:0/1227699888 learned_addr learned my addr 172.21.15.18:0/1227699888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dda00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d815fe50 0x7f70d815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70d7e00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d8145270 0x7f70d813c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 -- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d815fe50 msgr2=0x7f70d815a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d815fe50 0x7f70d815a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 -- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d8145270 msgr2=0x7f70d813c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d8145270 0x7f70d813c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.223+0000 7f70dd000640 1 -- 172.21.15.18:0/1227699888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d815b450 con 0x7f70d80b1c90 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70dd000640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00c450 tx=0x7f70cc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc018070 con 0x7f70d80b1c90 2024-04-25T10:06:55.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70cc007480 con 0x7f70d80b1c90 2024-04-25T10:06:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d81415d0 con 0x7f70d80b1c90 2024-04-25T10:06:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70cc0047f0 con 0x7f70d80b1c90 2024-04-25T10:06:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d815a040 con 0x7f70d80b1c90 2024-04-25T10:06:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d80745d0 con 0x7f70d80b1c90 2024-04-25T10:06:55.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f70cc01b070 con 0x7f70d80b1c90 2024-04-25T10:06:55.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 0x7f70b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f70cc084110 con 0x7f70d80b1c90 2024-04-25T10:06:55.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.227+0000 7f70d7e00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 0x7f70b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.231+0000 7f70d7e00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 0x7f70b8069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f70d8141b50 tx=0x7f70c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.231+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70d815b450 con 0x7f70d80b1c90 2024-04-25T10:06:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.395+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70d806b8e0 con 0x7f70d80b1c90 2024-04-25T10:06:55.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.395+0000 7f70d4c00640 1 -- 172.21.15.18:0/1227699888 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13140 (secure 0 0 0) 0x7f70d80b20a0 con 0x7f70d80b1c90 2024-04-25T10:06:55.404 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:55.404 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":63,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:54.642578+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 msgr2=0x7f70b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 0x7f70b8069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f70d8141b50 tx=0x7f70c4008040 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 msgr2=0x7f70d81f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f70cc00c450 tx=0x7f70cc00c910 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 shutdown_connections 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f70b8066f60 0x7f70b8069420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f70d815fe50 0x7f70d815a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70d8145270 0x7f70d813c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 --2- 172.21.15.18:0/1227699888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70d80b1c90 0x7f70d81f8510 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 >> 172.21.15.18:0/1227699888 conn(0x7f70d8066fa0 msgr2=0x7f70d813e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 shutdown_connections 2024-04-25T10:06:55.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.399+0000 7f70dfa00640 1 -- 172.21.15.18:0/1227699888 wait complete. 2024-04-25T10:06:55.425 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:06:55.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:06:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 Processor -- start 2024-04-25T10:06:55.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 -- start start 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6cac15c9b0 0x7f6cac06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6cac06e010 0x7f6cac06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac15fc00 con 0x7f6cac159320 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac06d640 con 0x7f6cac06e010 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb4200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac15fee0 con 0x7f6cac15c9b0 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb1800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6cac159320 0x7f6cac15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50122/0 (socket says 172.21.15.18:50122) 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb1800640 1 -- 172.21.15.18:0/2750149711 learned_addr learned my addr 172.21.15.18:0/2750149711 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2750149711 >> v2:172.21.15.18:3300/0 conn(0x7f6cac06e010 0x7f6cac06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb0e00640 1 --2- 172.21.15.18:0/2750149711 >> v2:172.21.15.167:3300/0 conn(0x7f6cac15c9b0 0x7f6cac06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cabe00640 1 -- 172.21.15.18:0/2750149711 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974568182 0 0) 0x7f6cac15fc00 con 0x7f6cac159320 2024-04-25T10:06:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cabe00640 1 -- 172.21.15.18:0/2750149711 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c94003530 con 0x7f6cac159320 2024-04-25T10:06:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb2200640 1 -- 172.21.15.18:0/2750149711 >> v2:172.21.15.167:3300/0 conn(0x7f6cac15c9b0 msgr2=0x7f6cac06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2750149711 >> v2:172.21.15.167:3300/0 conn(0x7f6cac15c9b0 0x7f6cac06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb2200640 1 -- 172.21.15.18:0/2750149711 >> v1:172.21.15.18:6789/0 conn(0x7f6cac159320 legacy=0x7f6cac15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.563+0000 7f6cb2200640 1 -- 172.21.15.18:0/2750149711 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac1601c0 con 0x7f6cac06e010 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2750149711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac06e010 0x7f6cac06e4a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0b4b50 tx=0x7f6ca401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b44d7337c06e331 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cabe00640 1 -- 172.21.15.18:0/2750149711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40b2070 con 0x7f6cac06e010 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cabe00640 1 -- 172.21.15.18:0/2750149711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40a57f0 con 0x7f6cac06e010 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cabe00640 1 -- 172.21.15.18:0/2750149711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40a5ba0 con 0x7f6cac06e010 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 -- 172.21.15.18:0/2750149711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac06e010 msgr2=0x7f6cac06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2750149711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac06e010 0x7f6cac06e4a0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0b4b50 tx=0x7f6ca401c930 comp rx=0 tx=0).stop 2024-04-25T10:06:55.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 -- 172.21.15.18:0/2750149711 shutdown_connections 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2750149711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac06e010 0x7f6cac06e4a0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2750149711 >> v2:172.21.15.167:3300/0 conn(0x7f6cac15c9b0 0x7f6cac06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 -- 172.21.15.18:0/2750149711 >> 172.21.15.18:0/2750149711 conn(0x7f6cac067080 msgr2=0x7f6cac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 -- 172.21.15.18:0/2750149711 shutdown_connections 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.567+0000 7f6cb4200640 1 -- 172.21.15.18:0/2750149711 wait complete. 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 Processor -- start 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- start start 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cac06e010 0x7f6cac1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cac159320 0x7f6cac0ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac168920 con 0x7f6cac15c9b0 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac1687a0 con 0x7f6cac06e010 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac168aa0 con 0x7f6cac159320 2024-04-25T10:06:55.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51610/0 (socket says 172.21.15.18:51610) 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 -- 172.21.15.18:0/2047672636 learned_addr learned my addr 172.21.15.18:0/2047672636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb1800640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cac06e010 0x7f6cac1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb0e00640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cac159320 0x7f6cac0ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 -- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cac159320 msgr2=0x7f6cac0ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cac159320 0x7f6cac0ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 -- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cac06e010 msgr2=0x7f6cac1f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cac06e010 0x7f6cac1f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 -- 172.21.15.18:0/2047672636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0b03f0 con 0x7f6cac15c9b0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb2200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4019540 tx=0x7f6ca40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40b2050 con 0x7f6cac15c9b0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40be070 con 0x7f6cac15c9b0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca40ad870 con 0x7f6cac15c9b0 2024-04-25T10:06:55.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac0b06d0 con 0x7f6cac15c9b0 2024-04-25T10:06:55.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.571+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac0b0c90 con 0x7f6cac15c9b0 2024-04-25T10:06:55.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.575+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac0745d0 con 0x7f6cac15c9b0 2024-04-25T10:06:55.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.575+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ca40ada10 con 0x7f6cac15c9b0 2024-04-25T10:06:55.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.575+0000 7f6ca9600640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 0x7f6c8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.575+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6ca411feb0 con 0x7f6cac15c9b0 2024-04-25T10:06:55.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.575+0000 7f6cb1800640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 0x7f6c8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.579+0000 7f6cb1800640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 0x7f6c8c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007fd0 tx=0x7f6ca0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.579+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ca4016520 con 0x7f6cac15c9b0 2024-04-25T10:06:55.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.743+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cac1f6530 con 0x7f6cac15c9b0 2024-04-25T10:06:55.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6ca9600640 1 -- 172.21.15.18:0/2047672636 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ca40add00 con 0x7f6cac15c9b0 2024-04-25T10:06:55.753 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:06:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 msgr2=0x7f6c8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 0x7f6c8c069420 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0007fd0 tx=0x7f6ca0009040 comp rx=0 tx=0).stop 2024-04-25T10:06:55.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 msgr2=0x7f6cac0a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4019540 tx=0x7f6ca40196d0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 shutdown_connections 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6cac15c9b0 0x7f6cac0a9230 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c8c066f60 0x7f6c8c069420 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6cac159320 0x7f6cac0ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 --2- 172.21.15.18:0/2047672636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6cac06e010 0x7f6cac1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 >> 172.21.15.18:0/2047672636 conn(0x7f6cac067080 msgr2=0x7f6cac15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 shutdown_connections 2024-04-25T10:06:55.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.747+0000 7f6cb4200640 1 -- 172.21.15.18:0/2047672636 wait complete. 2024-04-25T10:06:55.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:06:55.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.907+0000 7f74a6200640 1 Processor -- start 2024-04-25T10:06:55.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.907+0000 7f74a6200640 1 -- start start 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f74a6200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a0141d20 0x7f74a015c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f74a6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a00acda0 0x7f74a00ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f74a6200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a006e1e0 con 0x7f74a00af140 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f74a6200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a006ac10 con 0x7f74a0141d20 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f74a6200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a006ae60 con 0x7f74a00acda0 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a0141d20 0x7f74a015c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f7496a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f74a00af140 0x7f74a006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50136/0 (socket says 172.21.15.18:50136) 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74a0141d20 0x7f74a015c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51618/0 (socket says 172.21.15.18:51618) 2024-04-25T10:06:55.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f7496a00640 1 -- 172.21.15.18:0/3966812316 learned_addr learned my addr 172.21.15.18:0/3966812316 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749fe00640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a00acda0 0x7f74a00ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 -- 172.21.15.18:0/3966812316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a00acda0 msgr2=0x7f74a00ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a00acda0 0x7f74a00ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 -- 172.21.15.18:0/3966812316 >> v1:172.21.15.18:6789/0 conn(0x7f74a00af140 legacy=0x7f74a006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749f400640 1 -- 172.21.15.18:0/3966812316 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a006b140 con 0x7f74a0141d20 2024-04-25T10:06:55.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.911+0000 7f749ea00640 1 -- 172.21.15.18:0/3966812316 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132674783 0 0) 0x7f74a006e1e0 con 0x7f74a00af140 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f749f400640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a0141d20 0x7f74a015c8a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f74900097c0 tx=0x7f749001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32a353a237379db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f749ea00640 1 -- 172.21.15.18:0/3966812316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900b0070 con 0x7f74a0141d20 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f749ea00640 1 -- 172.21.15.18:0/3966812316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74900ab600 con 0x7f74a0141d20 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f749ea00640 1 -- 172.21.15.18:0/3966812316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900ab9d0 con 0x7f74a0141d20 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- 172.21.15.18:0/3966812316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a0141d20 msgr2=0x7f74a015c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a0141d20 0x7f74a015c8a0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f74900097c0 tx=0x7f749001c410 comp rx=0 tx=0).stop 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- 172.21.15.18:0/3966812316 shutdown_connections 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a00acda0 0x7f74a00ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- 172.21.15.18:0/3966812316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a0141d20 0x7f74a015c8a0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- 172.21.15.18:0/3966812316 >> 172.21.15.18:0/3966812316 conn(0x7f74a00b23b0 msgr2=0x7f74a00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- 172.21.15.18:0/3966812316 shutdown_connections 2024-04-25T10:06:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- 172.21.15.18:0/3966812316 wait complete. 2024-04-25T10:06:55.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 Processor -- start 2024-04-25T10:06:55.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- start start 2024-04-25T10:06:55.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a00acda0 0x7f74a00ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 0x7f74a01579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a01688a0 con 0x7f74a00af140 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0168720 con 0x7f74a00acda0 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.915+0000 7f74a6200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a0168a20 con 0x7f74a0141d20 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51628/0 (socket says 172.21.15.18:51628) 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 -- 172.21.15.18:0/2257310471 learned_addr learned my addr 172.21.15.18:0/2257310471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f749f400640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a00acda0 0x7f74a00ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f749fe00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 0x7f74a01579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 -- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 msgr2=0x7f74a01579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 0x7f74a01579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 -- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a00acda0 msgr2=0x7f74a00ce0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a00acda0 0x7f74a00ce0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 -- 172.21.15.18:0/2257310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a00cdc60 con 0x7f74a00af140 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f749fe00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 0x7f74a01579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7496a00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f74880011f0 tx=0x7f748800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488018070 con 0x7f74a00af140 2024-04-25T10:06:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74880074e0 con 0x7f74a00af140 2024-04-25T10:06:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a00ce690 con 0x7f74a00af140 2024-04-25T10:06:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488004a10 con 0x7f74a00af140 2024-04-25T10:06:55.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a00cec50 con 0x7f74a00af140 2024-04-25T10:06:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a00745d0 con 0x7f74a00af140 2024-04-25T10:06:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.919+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f748801b070 con 0x7f74a00af140 2024-04-25T10:06:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.923+0000 7f7497e00640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 0x7f747c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:55.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.923+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7488084130 con 0x7f74a00af140 2024-04-25T10:06:55.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.923+0000 7f749f400640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 0x7f747c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:55.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.923+0000 7f749f400640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 0x7f747c069450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f74900ad000 tx=0x7f74900a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:55.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:55.923+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7488054cb0 con 0x7f74a00af140 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.087+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74a00d0960 con 0x7f74a00af140 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f7497e00640 1 -- 172.21.15.18:0/2257310471 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v63) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7488058d50 con 0x7f74a00af140 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:06:56.097 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:06:56.098 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:06:56.098 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:06:56.098 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 msgr2=0x7f747c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 0x7f747c069450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f74900ad000 tx=0x7f74900a6000 comp rx=0 tx=0).stop 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 msgr2=0x7f74a00cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f74880011f0 tx=0x7f748800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 shutdown_connections 2024-04-25T10:06:56.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f747c066f90 0x7f747c069450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74a0141d20 0x7f74a01579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74a00af140 0x7f74a00cd720 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 --2- 172.21.15.18:0/2257310471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a00acda0 0x7f74a00ce0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 >> 172.21.15.18:0/2257310471 conn(0x7f74a00b23b0 msgr2=0x7f74a015a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 shutdown_connections 2024-04-25T10:06:56.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.091+0000 7f74a6200640 1 -- 172.21.15.18:0/2257310471 wait complete. 2024-04-25T10:06:56.118 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:06:56.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:06:56.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 Processor -- start 2024-04-25T10:06:56.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 -- start start 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 0x7f1ab80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ab806ead0 0x7f1ab80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80cf490 con 0x7f1ab8071e40 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80719b0 con 0x7f1ab806ead0 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abf000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80cf1b0 con 0x7f1ab8144080 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ab806ead0 0x7f1ab80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ab806ead0 0x7f1ab80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51634/0 (socket says 172.21.15.18:51634) 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 -- 172.21.15.18:0/2390865547 learned_addr learned my addr 172.21.15.18:0/2390865547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:56.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1aaf400640 1 --1- 172.21.15.18:0/2390865547 >> v1:172.21.15.18:6789/0 conn(0x7f1ab8071e40 0x7f1ab806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50148/0 (socket says 172.21.15.18:50148) 2024-04-25T10:06:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 0x7f1ab80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 -- 172.21.15.18:0/2390865547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 msgr2=0x7f1ab80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 0x7f1ab80ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 -- 172.21.15.18:0/2390865547 >> v1:172.21.15.18:6789/0 conn(0x7f1ab8071e40 legacy=0x7f1ab806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1ab7400640 1 -- 172.21.15.18:0/2390865547 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2201817161 0 0) 0x7f1ab80cf490 con 0x7f1ab8071e40 2024-04-25T10:06:56.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1abd000640 1 -- 172.21.15.18:0/2390865547 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8071360 con 0x7f1ab806ead0 2024-04-25T10:06:56.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.255+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 0x7f1ab80ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abd000640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab806ead0 0x7f1ab80ceba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8071b30 tx=0x7f1ab001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f9422c70ecaf3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1ab7400640 1 -- 172.21.15.18:0/2390865547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5890 con 0x7f1ab806ead0 2024-04-25T10:06:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1ab7400640 1 -- 172.21.15.18:0/2390865547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00a5a30 con 0x7f1ab806ead0 2024-04-25T10:06:56.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1ab7400640 1 -- 172.21.15.18:0/2390865547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5e00 con 0x7f1ab806ead0 2024-04-25T10:06:56.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 -- 172.21.15.18:0/2390865547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab806ead0 msgr2=0x7f1ab80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab806ead0 0x7f1ab80ceba0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8071b30 tx=0x7f1ab001c9e0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 -- 172.21.15.18:0/2390865547 shutdown_connections 2024-04-25T10:06:56.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab806ead0 0x7f1ab80ceba0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 --2- 172.21.15.18:0/2390865547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab8144080 0x7f1ab80ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 -- 172.21.15.18:0/2390865547 >> 172.21.15.18:0/2390865547 conn(0x7f1ab806ac10 msgr2=0x7f1ab806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:56.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 -- 172.21.15.18:0/2390865547 shutdown_connections 2024-04-25T10:06:56.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.259+0000 7f1abf000640 1 -- 172.21.15.18:0/2390865547 wait complete. 2024-04-25T10:06:56.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 Processor -- start 2024-04-25T10:06:56.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- start start 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 0x7f1ab8139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 0x7f1ab8139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab815eb90 con 0x7f1ab8144080 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab815ea10 con 0x7f1ab8071e40 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab815ed10 con 0x7f1ab806ead0 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51646/0 (socket says 172.21.15.18:51646) 2024-04-25T10:06:56.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 -- 172.21.15.18:0/832074423 learned_addr learned my addr 172.21.15.18:0/832074423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 0x7f1ab8139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1aaf400640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 0x7f1ab8139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 -- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 msgr2=0x7f1ab8139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 0x7f1ab8139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 -- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 msgr2=0x7f1ab8139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 0x7f1ab8139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 -- 172.21.15.18:0/832074423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab813a110 con 0x7f1ab8144080 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 0x7f1ab8139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1aaf400640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 0x7f1ab8139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abd000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00af040 tx=0x7f1ab0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00b8880 con 0x7f1ab8144080 2024-04-25T10:06:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00be070 con 0x7f1ab8144080 2024-04-25T10:06:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00b8c80 con 0x7f1ab8144080 2024-04-25T10:06:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab813ad00 con 0x7f1ab8144080 2024-04-25T10:06:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.263+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab813b2c0 con 0x7f1ab8144080 2024-04-25T10:06:56.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.267+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab80745d0 con 0x7f1ab8144080 2024-04-25T10:06:56.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.267+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ab00c3460 con 0x7f1ab8144080 2024-04-25T10:06:56.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.267+0000 7f1ab4c00640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 0x7f1a94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.267+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1ab01202a0 con 0x7f1ab8144080 2024-04-25T10:06:56.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.267+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 0x7f1a94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.271+0000 7f1ab7e00640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 0x7f1a94069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8008890 tx=0x7f1aa8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.271+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ab0016600 con 0x7f1ab8144080 2024-04-25T10:06:56.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.435+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1ab80b4580 con 0x7f1ab8144080 2024-04-25T10:06:56.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.659+0000 7f1ab4c00640 1 -- 172.21.15.18:0/832074423 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v64) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1ab00f13d0 con 0x7f1ab8144080 2024-04-25T10:06:56.668 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 msgr2=0x7f1a94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 0x7f1a94069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8008890 tx=0x7f1aa8008040 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 msgr2=0x7f1ab81fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00af040 tx=0x7f1ab0019780 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 shutdown_connections 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ab8144080 0x7f1ab81fa7d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab8071e40 0x7f1ab8139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a94066f60 0x7f1a94069420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 --2- 172.21.15.18:0/832074423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1ab806ead0 0x7f1ab8139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 >> 172.21.15.18:0/832074423 conn(0x7f1ab806ac10 msgr2=0x7f1ab8143390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:56.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 shutdown_connections 2024-04-25T10:06:56.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.663+0000 7f1abf000640 1 -- 172.21.15.18:0/832074423 wait complete. 2024-04-25T10:06:56.693 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:06:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.831+0000 7f6c86c00640 1 Processor -- start 2024-04-25T10:06:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86c00640 1 -- start start 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c8006ac10 0x7f6c800cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c80070270 con 0x7f6c8006fe90 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c8006b0a0 con 0x7f6c800cf6f0 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8006b380 con 0x7f6c8006ac10 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c85800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6c8006fe90 0x7f6c800cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50160/0 (socket says 172.21.15.18:50160) 2024-04-25T10:06:56.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c85800640 1 -- 172.21.15.18:0/2419214393 learned_addr learned my addr 172.21.15.18:0/2419214393 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c8006ac10 0x7f6c800cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821162841 0 0) 0x7f6c80070270 con 0x7f6c8006fe90 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c68003530 con 0x7f6c8006fe90 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4196292067 0 0) 0x7f6c68003530 con 0x7f6c8006fe90 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c8006ac10 msgr2=0x7f6c800cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c8006ac10 0x7f6c800cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 >> v1:172.21.15.167:6789/0 conn(0x7f6c800cf6f0 legacy=0x7f6c800cfba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8006b660 con 0x7f6c8006fe90 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6c74001680 con 0x7f6c8006fe90 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 >> v1:172.21.15.18:6789/0 conn(0x7f6c8006fe90 legacy=0x7f6c800cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c680039f0 0x7f6c68003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c68004310 0x7f6c68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c68004fa0 0x7f6c6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8006b380 con 0x7f6c68004310 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800bf10 con 0x7f6c68004fa0 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6800c090 con 0x7f6c680039f0 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c85800640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c680039f0 0x7f6c68003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c68004310 0x7f6c68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c86200640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c68004fa0 0x7f6c6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 -- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c680039f0 msgr2=0x7f6c68003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c680039f0 0x7f6c68003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 -- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c68004fa0 msgr2=0x7f6c6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c68004fa0 0x7f6c6800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.835+0000 7f6c84e00640 1 -- 172.21.15.18:0/2419214393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68003530 con 0x7f6c68004310 2024-04-25T10:06:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c68004310 0x7f6c68004810 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ae0 tx=0x7f6c6c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a3444ff52a1edb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0b2070 con 0x7f6c68004310 2024-04-25T10:06:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c0a5660 con 0x7f6c68004310 2024-04-25T10:06:56.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c7fe00640 1 -- 172.21.15.18:0/2419214393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0096b0 con 0x7f6c68004310 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 -- 172.21.15.18:0/2419214393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c68004310 msgr2=0x7f6c68004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2419214393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c68004310 0x7f6c68004810 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ae0 tx=0x7f6c6c01ca70 comp rx=0 tx=0).stop 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86200640 1 -- 172.21.15.18:0/2419214393 reap_dead start 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 -- 172.21.15.18:0/2419214393 shutdown_connections 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 -- 172.21.15.18:0/2419214393 >> 172.21.15.18:0/2419214393 conn(0x7f6c80099a60 msgr2=0x7f6c800b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 -- 172.21.15.18:0/2419214393 shutdown_connections 2024-04-25T10:06:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.839+0000 7f6c86c00640 1 -- 172.21.15.18:0/2419214393 wait complete. 2024-04-25T10:06:56.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 Processor -- start 2024-04-25T10:06:56.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- start start 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c68004310 0x7f6c801f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c800affc0 0x7f6c800b0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800cc5d0 con 0x7f6c800c7ec0 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800cd1f0 con 0x7f6c800affc0 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c800cc750 con 0x7f6c68004310 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51660/0 (socket says 172.21.15.18:51660) 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 -- 172.21.15.18:0/2798498097 learned_addr learned my addr 172.21.15.18:0/2798498097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c85800640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c68004310 0x7f6c801f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86200640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c800affc0 0x7f6c800b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 -- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c68004310 msgr2=0x7f6c801f5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c68004310 0x7f6c801f5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 -- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c800affc0 msgr2=0x7f6c800b0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c800affc0 0x7f6c800b0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 -- 172.21.15.18:0/2798498097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8006ba90 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c84e00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ae0 tx=0x7f6c68005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0b2040 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6c004020 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c0096b0 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c801f31a0 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.843+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c801f3720 con 0x7f6c800c7ec0 2024-04-25T10:06:56.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c8004efa0 con 0x7f6c800c7ec0 2024-04-25T10:06:56.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c6c0c0060 con 0x7f6c800c7ec0 2024-04-25T10:06:56.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c7d600640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 0x7f6c60069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:56.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f6c6c11ea10 con 0x7f6c800c7ec0 2024-04-25T10:06:56.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c85800640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 0x7f6c60069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:56.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.847+0000 7f6c85800640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 0x7f6c60069450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c10 tx=0x7f6c74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:56.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:56.851+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c6c016780 con 0x7f6c800c7ec0 2024-04-25T10:06:57.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.015+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6c800ce6e0 con 0x7f6c800c7ec0 2024-04-25T10:06:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.667+0000 7f6c7d600640 1 -- 172.21.15.18:0/2798498097 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v65) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6c6c0efb70 con 0x7f6c800c7ec0 2024-04-25T10:06:57.676 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 msgr2=0x7f6c60069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 0x7f6c60069450 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6c74000c10 tx=0x7f6c74009040 comp rx=0 tx=0).stop 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 msgr2=0x7f6c800c8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009ae0 tx=0x7f6c68005840 comp rx=0 tx=0).stop 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 shutdown_connections 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c800affc0 0x7f6c800b0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c800c7ec0 0x7f6c800c8340 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c60066f90 0x7f6c60069450 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 --2- 172.21.15.18:0/2798498097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c68004310 0x7f6c801f5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 >> 172.21.15.18:0/2798498097 conn(0x7f6c80099a60 msgr2=0x7f6c800737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 shutdown_connections 2024-04-25T10:06:57.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.671+0000 7f6c86c00640 1 -- 172.21.15.18:0/2798498097 wait complete. 2024-04-25T10:06:57.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:06:57.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.859+0000 7f76bea00640 1 Processor -- start 2024-04-25T10:06:57.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.859+0000 7f76bea00640 1 -- start start 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 0x7f76b806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76b806e010 0x7f76b806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bea00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b815fc00 con 0x7f76b8159320 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bea00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b806d640 con 0x7f76b806e010 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815fee0 con 0x7f76b815c9b0 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76b806e010 0x7f76b806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76b7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f76b8159320 0x7f76b815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50162/0 (socket says 172.21.15.18:50162) 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76b806e010 0x7f76b806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51668/0 (socket says 172.21.15.18:51668) 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76b7e00640 1 -- 172.21.15.18:0/905317099 learned_addr learned my addr 172.21.15.18:0/905317099 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 -- 172.21.15.18:0/905317099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 msgr2=0x7f76b806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76afe00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 0x7f76b806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 0x7f76b806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 -- 172.21.15.18:0/905317099 >> v1:172.21.15.18:6789/0 conn(0x7f76b8159320 legacy=0x7f76b815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76b7400640 1 -- 172.21.15.18:0/905317099 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939015525 0 0) 0x7f76b815fc00 con 0x7f76b8159320 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76bca00640 1 -- 172.21.15.18:0/905317099 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b81601c0 con 0x7f76b806e010 2024-04-25T10:06:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.863+0000 7f76afe00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 0x7f76b806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bca00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b806e010 0x7f76b806e4a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d90 tx=0x7f76b001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c26f8f3f4d7496 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76b7400640 1 -- 172.21.15.18:0/905317099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00b2070 con 0x7f76b806e010 2024-04-25T10:06:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76b7400640 1 -- 172.21.15.18:0/905317099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b00a5830 con 0x7f76b806e010 2024-04-25T10:06:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76b7400640 1 -- 172.21.15.18:0/905317099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b00a5c00 con 0x7f76b806e010 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- 172.21.15.18:0/905317099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b806e010 msgr2=0x7f76b806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b806e010 0x7f76b806e4a0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f76b0009d90 tx=0x7f76b001c970 comp rx=0 tx=0).stop 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- 172.21.15.18:0/905317099 shutdown_connections 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b806e010 0x7f76b806e4a0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- 172.21.15.18:0/905317099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b815c9b0 0x7f76b806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- 172.21.15.18:0/905317099 >> 172.21.15.18:0/905317099 conn(0x7f76b8067080 msgr2=0x7f76b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- 172.21.15.18:0/905317099 shutdown_connections 2024-04-25T10:06:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- 172.21.15.18:0/905317099 wait complete. 2024-04-25T10:06:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 Processor -- start 2024-04-25T10:06:57.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- start start 2024-04-25T10:06:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b806e010 0x7f76b815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b815c9b0 0x7f76b8157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8168920 con 0x7f76b8159320 2024-04-25T10:06:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b81687a0 con 0x7f76b815c9b0 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.867+0000 7f76bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8168aa0 con 0x7f76b806e010 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51674/0 (socket says 172.21.15.18:51674) 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 -- 172.21.15.18:0/1049168027 learned_addr learned my addr 172.21.15.18:0/1049168027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76b7e00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b806e010 0x7f76b815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76bca00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b815c9b0 0x7f76b8157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 -- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b806e010 msgr2=0x7f76b815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b806e010 0x7f76b815e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 -- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b815c9b0 msgr2=0x7f76b8157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b815c9b0 0x7f76b8157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 -- 172.21.15.18:0/1049168027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b81415a0 con 0x7f76b8159320 2024-04-25T10:06:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76afe00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c7f0 tx=0x7f76a000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0015070 con 0x7f76b8159320 2024-04-25T10:06:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a0007820 con 0x7f76b8159320 2024-04-25T10:06:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a0007c10 con 0x7f76b8159320 2024-04-25T10:06:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b8141880 con 0x7f76b8159320 2024-04-25T10:06:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b8141e40 con 0x7f76b8159320 2024-04-25T10:06:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80745d0 con 0x7f76b8159320 2024-04-25T10:06:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.871+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f76a0018070 con 0x7f76b8159320 2024-04-25T10:06:57.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.875+0000 7f76b4c00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 0x7f7694069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.875+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f76a0085220 con 0x7f76b8159320 2024-04-25T10:06:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.875+0000 7f76b7e00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 0x7f7694069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.875+0000 7f76b7e00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 0x7f7694069420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007fd0 tx=0x7f76a8007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:57.879+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f76a0055ab0 con 0x7f76b8159320 2024-04-25T10:06:58.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.071+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f76b81426e0 con 0x7f76b8159320 2024-04-25T10:06:58.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.671+0000 7f76b4c00640 1 -- 172.21.15.18:0/1049168027 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v32) v1 ==== 173+0+0 (secure 0 0 0) 0x7f76a0059b50 con 0x7f76b8159320 2024-04-25T10:06:58.678 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 msgr2=0x7f7694069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 0x7f7694069420 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f76a8007fd0 tx=0x7f76a8007d60 comp rx=0 tx=0).stop 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 msgr2=0x7f76b8164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f76a000c7f0 tx=0x7f76a000ccb0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 shutdown_connections 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76b815c9b0 0x7f76b8157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76b8159320 0x7f76b8164bc0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7694066f60 0x7f7694069420 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 --2- 172.21.15.18:0/1049168027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f76b806e010 0x7f76b815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 >> 172.21.15.18:0/1049168027 conn(0x7f76b8067080 msgr2=0x7f76b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:58.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 shutdown_connections 2024-04-25T10:06:58.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.675+0000 7f76bea00640 1 -- 172.21.15.18:0/1049168027 wait complete. 2024-04-25T10:06:58.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:58.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 Processor -- start 2024-04-25T10:06:58.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 -- start start 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5340b1e60 0x7fe53415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340cc4e0 con 0x7fe534145270 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5340ce040 con 0x7fe53415fe50 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe539200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe534145650 con 0x7fe5340b1e60 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe531e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe534145270 0x7fe5340cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50174/0 (socket says 172.21.15.18:50174) 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe531e00640 1 -- 172.21.15.18:0/3341970205 learned_addr learned my addr 172.21.15.18:0/3341970205 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:58.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe532800640 1 --2- 172.21.15.18:0/3341970205 >> v2:172.21.15.18:3300/0 conn(0x7fe5340b1e60 0x7fe53415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:58.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe531400640 1 -- 172.21.15.18:0/3341970205 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1946550204 0 0) 0x7fe5340cc4e0 con 0x7fe534145270 2024-04-25T10:06:58.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe531400640 1 -- 172.21.15.18:0/3341970205 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe518003530 con 0x7fe534145270 2024-04-25T10:06:58.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.867+0000 7fe532800640 1 -- 172.21.15.18:0/3341970205 >> v1:172.21.15.167:6789/0 conn(0x7fe53415fe50 legacy=0x7fe5340b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:58.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe532800640 1 -- 172.21.15.18:0/3341970205 >> v1:172.21.15.18:6789/0 conn(0x7fe534145270 legacy=0x7fe5340cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe532800640 1 -- 172.21.15.18:0/3341970205 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340ce320 con 0x7fe5340b1e60 2024-04-25T10:06:58.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe532800640 1 --2- 172.21.15.18:0/3341970205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5340b1e60 0x7fe53415bd80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009d90 tx=0x7fe52c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dc31f0e7358150 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe531400640 1 -- 172.21.15.18:0/3341970205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0b2070 con 0x7fe5340b1e60 2024-04-25T10:06:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe531400640 1 -- 172.21.15.18:0/3341970205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0a5920 con 0x7fe5340b1e60 2024-04-25T10:06:58.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe531400640 1 -- 172.21.15.18:0/3341970205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0a5cf0 con 0x7fe5340b1e60 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 -- 172.21.15.18:0/3341970205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5340b1e60 msgr2=0x7fe53415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 --2- 172.21.15.18:0/3341970205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5340b1e60 0x7fe53415bd80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fe52c009d90 tx=0x7fe52c01c970 comp rx=0 tx=0).stop 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 -- 172.21.15.18:0/3341970205 shutdown_connections 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 --2- 172.21.15.18:0/3341970205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5340b1e60 0x7fe53415bd80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 -- 172.21.15.18:0/3341970205 >> 172.21.15.18:0/3341970205 conn(0x7fe534066fa0 msgr2=0x7fe53406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 -- 172.21.15.18:0/3341970205 shutdown_connections 2024-04-25T10:06:58.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.871+0000 7fe539200640 1 -- 172.21.15.18:0/3341970205 wait complete. 2024-04-25T10:06:58.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 Processor -- start 2024-04-25T10:06:58.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- start start 2024-04-25T10:06:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5340b1e60 0x7fe534130300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe534145270 0x7fe534164b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cdd60 con 0x7fe53415fe50 2024-04-25T10:06:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5340cdbe0 con 0x7fe534145270 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe534169720 con 0x7fe5340b1e60 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51690/0 (socket says 172.21.15.18:51690) 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 -- 172.21.15.18:0/2536492610 learned_addr learned my addr 172.21.15.18:0/2536492610 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe531e00640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5340b1e60 0x7fe534130300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe52be00640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe534145270 0x7fe534164b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 -- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5340b1e60 msgr2=0x7fe534130300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5340b1e60 0x7fe534130300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 -- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe534145270 msgr2=0x7fe534164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe534145270 0x7fe534164b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 -- 172.21.15.18:0/2536492610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534142120 con 0x7fe53415fe50 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe532800640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe52c01a5a0 tx=0x7fe52c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0b2050 con 0x7fe53415fe50 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52c0be070 con 0x7fe53415fe50 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5341652a0 con 0x7fe53415fe50 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c0ada50 con 0x7fe53415fe50 2024-04-25T10:06:58.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.875+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53412f820 con 0x7fe53415fe50 2024-04-25T10:06:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5340745d0 con 0x7fe53415fe50 2024-04-25T10:06:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe52c0adbf0 con 0x7fe53415fe50 2024-04-25T10:06:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe52a000640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 0x7fe510069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:58.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe52c120360 con 0x7fe53415fe50 2024-04-25T10:06:58.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe531e00640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 0x7fe510069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:58.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.879+0000 7fe531e00640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 0x7fe510069420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe5240011f0 tx=0x7fe524009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:58.883+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe534142120 con 0x7fe53415fe50 2024-04-25T10:06:59.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.047+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe53406b8e0 con 0x7fe53415fe50 2024-04-25T10:06:59.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe52a000640 1 -- 172.21.15.18:0/2536492610 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16873 (secure 0 0 0) 0x7fe52c016560 con 0x7fe53415fe50 2024-04-25T10:06:59.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:59.058 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":66,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:58.074821+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 msgr2=0x7fe510069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 0x7fe510069420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe5240011f0 tx=0x7fe524009040 comp rx=0 tx=0).stop 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 msgr2=0x7fe53415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fe52c01a5a0 tx=0x7fe52c019710 comp rx=0 tx=0).stop 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 shutdown_connections 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53415fe50 0x7fe53415b360 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe534145270 0x7fe534164b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe510066f60 0x7fe510069420 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 --2- 172.21.15.18:0/2536492610 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe5340b1e60 0x7fe534130300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 >> 172.21.15.18:0/2536492610 conn(0x7fe534066fa0 msgr2=0x7fe5340b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 shutdown_connections 2024-04-25T10:06:59.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.051+0000 7fe539200640 1 -- 172.21.15.18:0/2536492610 wait complete. 2024-04-25T10:06:59.073 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T10:06:59.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:06:59.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 Processor -- start 2024-04-25T10:06:59.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 -- start start 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f040ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f0406ead0 0x7f7f040b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0415ac60 con 0x7f7f040ced60 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f040cf3e0 con 0x7f7f0406ead0 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f08c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0415af20 con 0x7f7f04144140 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7f02800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f0406ead0 0x7f7f040b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.211+0000 7f7efbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7f040ced60 0x7f7f0406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50180/0 (socket says 172.21.15.18:50180) 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7efbe00640 1 -- 172.21.15.18:0/3482485624 learned_addr learned my addr 172.21.15.18:0/3482485624 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:06:59.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f01e00640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f040ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f02800640 1 -- 172.21.15.18:0/3482485624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 msgr2=0x7f7f040ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f02800640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f040ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f02800640 1 -- 172.21.15.18:0/3482485624 >> v1:172.21.15.18:6789/0 conn(0x7f7f040ced60 legacy=0x7f7f0406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f02800640 1 -- 172.21.15.18:0/3482485624 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0415b200 con 0x7f7f0406ead0 2024-04-25T10:06:59.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f01400640 1 -- 172.21.15.18:0/3482485624 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 251377163 0 0) 0x7f7f0415ac60 con 0x7f7f040ced60 2024-04-25T10:06:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f02800640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f040b0760 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f8d50b76f3262d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f01400640 1 -- 172.21.15.18:0/3482485624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0aa610 con 0x7f7f0406ead0 2024-04-25T10:06:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f01400640 1 -- 172.21.15.18:0/3482485624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc0af070 con 0x7f7f0406ead0 2024-04-25T10:06:59.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.215+0000 7f7f01400640 1 -- 172.21.15.18:0/3482485624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc0aa9d0 con 0x7f7f0406ead0 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- 172.21.15.18:0/3482485624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 msgr2=0x7f7f040b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f040b0760 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009d90 tx=0x7f7efc01c970 comp rx=0 tx=0).stop 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- 172.21.15.18:0/3482485624 shutdown_connections 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f040b0760 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3482485624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f040ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- 172.21.15.18:0/3482485624 >> 172.21.15.18:0/3482485624 conn(0x7f7f04066fa0 msgr2=0x7f7f0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- 172.21.15.18:0/3482485624 shutdown_connections 2024-04-25T10:06:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- 172.21.15.18:0/3482485624 wait complete. 2024-04-25T10:06:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 Processor -- start 2024-04-25T10:06:59.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- start start 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f040ced60 0x7f7f0415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f0415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0415bb80 con 0x7f7f0406ead0 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0415ba00 con 0x7f7f040ced60 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f08c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f041653d0 con 0x7f7f04144140 2024-04-25T10:06:59.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51718/0 (socket says 172.21.15.18:51718) 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 -- 172.21.15.18:0/3592426797 learned_addr learned my addr 172.21.15.18:0/3592426797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7efbe00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f040ced60 0x7f7f0415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f02800640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f0415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 -- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 msgr2=0x7f7f0415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f0415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 -- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f040ced60 msgr2=0x7f7f0415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f040ced60 0x7f7f0415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 -- 172.21.15.18:0/3592426797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0413f3b0 con 0x7f7f0406ead0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f02800640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f0415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.219+0000 7f7f01e00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400d5f0 tx=0x7f7ef400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40125f0 con 0x7f7f0406ead0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef4019070 con 0x7f7f0406ead0 2024-04-25T10:06:59.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f04163110 con 0x7f7f0406ead0 2024-04-25T10:06:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40129b0 con 0x7f7f0406ead0 2024-04-25T10:06:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f04163670 con 0x7f7f0406ead0 2024-04-25T10:06:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f040745d0 con 0x7f7f0406ead0 2024-04-25T10:06:59.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ef4012b50 con 0x7f7f0406ead0 2024-04-25T10:06:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 0x7f7ee0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7ef4085600 con 0x7f7f0406ead0 2024-04-25T10:06:59.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.223+0000 7f7efbe00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 0x7f7ee0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.227+0000 7f7efbe00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 0x7f7ee0069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f04143b60 tx=0x7f7eec007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.227+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7f04163110 con 0x7f7f0406ead0 2024-04-25T10:06:59.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.391+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7f0415ed90 con 0x7f7f0406ead0 2024-04-25T10:06:59.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.391+0000 7f7efa000640 1 -- 172.21.15.18:0/3592426797 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16873 (secure 0 0 0) 0x7f7f0413f3b0 con 0x7f7f0406ead0 2024-04-25T10:06:59.400 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:06:59.400 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":66,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:58.074821+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 msgr2=0x7f7ee0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 0x7f7ee0069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7f04143b60 tx=0x7f7eec007b80 comp rx=0 tx=0).stop 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 msgr2=0x7f7f0413eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7ef400d5f0 tx=0x7f7ef400dab0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 shutdown_connections 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7ee0066f60 0x7f7ee0069420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7f04144140 0x7f7f0415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7f040ced60 0x7f7f0415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 --2- 172.21.15.18:0/3592426797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f0406ead0 0x7f7f0413eb10 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 >> 172.21.15.18:0/3592426797 conn(0x7f7f04066fa0 msgr2=0x7f7f0406dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 shutdown_connections 2024-04-25T10:06:59.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.395+0000 7f7f08c00640 1 -- 172.21.15.18:0/3592426797 wait complete. 2024-04-25T10:06:59.422 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:06:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 Processor -- start 2024-04-25T10:06:59.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 -- start start 2024-04-25T10:06:59.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff29415e8b0 0x7ff29406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 0x7ff2940b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff29406e900 con 0x7ff2940af2f0 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29415ed30 con 0x7ff29415e8b0 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2940b2ce0 con 0x7ff29406c160 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff29415e8b0 0x7ff29406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff29415e8b0 0x7ff29406bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51722/0 (socket says 172.21.15.18:51722) 2024-04-25T10:06:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 -- 172.21.15.18:0/2099590027 learned_addr learned my addr 172.21.15.18:0/2099590027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299000640 1 --2- 172.21.15.18:0/2099590027 >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 0x7ff2940b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 -- 172.21.15.18:0/2099590027 >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 msgr2=0x7ff2940b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 --2- 172.21.15.18:0/2099590027 >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 0x7ff2940b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 -- 172.21.15.18:0/2099590027 >> v1:172.21.15.167:6789/0 conn(0x7ff2940af2f0 legacy=0x7ff29406e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff293400640 1 -- 172.21.15.18:0/2099590027 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29406ebe0 con 0x7ff29415e8b0 2024-04-25T10:06:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.559+0000 7ff299000640 1 --2- 172.21.15.18:0/2099590027 >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 0x7ff2940b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff293400640 1 --2- 172.21.15.18:0/2099590027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29415e8b0 0x7ff29406bc20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff29415b8d0 tx=0x7ff28001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b67d985f07bbab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff292a00640 1 -- 172.21.15.18:0/2099590027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800b0070 con 0x7ff29415e8b0 2024-04-25T10:06:59.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff292a00640 1 -- 172.21.15.18:0/2099590027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2800ab600 con 0x7ff29415e8b0 2024-04-25T10:06:59.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff292a00640 1 -- 172.21.15.18:0/2099590027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800ab9d0 con 0x7ff29415e8b0 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 -- 172.21.15.18:0/2099590027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29415e8b0 msgr2=0x7ff29406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 --2- 172.21.15.18:0/2099590027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29415e8b0 0x7ff29406bc20 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff29415b8d0 tx=0x7ff28001c520 comp rx=0 tx=0).stop 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 -- 172.21.15.18:0/2099590027 shutdown_connections 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 --2- 172.21.15.18:0/2099590027 >> v2:172.21.15.167:3300/0 conn(0x7ff29406c160 0x7ff2940b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 --2- 172.21.15.18:0/2099590027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29415e8b0 0x7ff29406bc20 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 -- 172.21.15.18:0/2099590027 >> 172.21.15.18:0/2099590027 conn(0x7ff294071930 msgr2=0x7ff294071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 -- 172.21.15.18:0/2099590027 shutdown_connections 2024-04-25T10:06:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 -- 172.21.15.18:0/2099590027 wait complete. 2024-04-25T10:06:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.563+0000 7ff299a00640 1 Processor -- start 2024-04-25T10:06:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- start start 2024-04-25T10:06:59.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 0x7ff29415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 0x7ff29415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940b4250 con 0x7ff29406c160 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940b40d0 con 0x7ff2940af2f0 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940b43d0 con 0x7ff29415e8b0 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51724/0 (socket says 172.21.15.18:51724) 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 -- 172.21.15.18:0/2781381270 learned_addr learned my addr 172.21.15.18:0/2781381270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299000640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 0x7ff29415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293400640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 0x7ff29415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 -- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 msgr2=0x7ff29415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 0x7ff29415cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 -- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 msgr2=0x7ff29415b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 0x7ff29415b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:06:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 -- 172.21.15.18:0/2781381270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29415bf90 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299000640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 0x7ff29415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293400640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 0x7ff29415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff293e00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c420 tx=0x7ff28400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2840052d0 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284005470 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284007260 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29415c270 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff294156eb0 con 0x7ff29406c160 2024-04-25T10:06:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.567+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29415c790 con 0x7ff29406c160 2024-04-25T10:06:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.571+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff284007400 con 0x7ff29406c160 2024-04-25T10:06:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.571+0000 7ff28be00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 0x7ff274069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:06:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.571+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff2840846d0 con 0x7ff29406c160 2024-04-25T10:06:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.571+0000 7ff293400640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 0x7ff274069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:06:59.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.571+0000 7ff293400640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 0x7ff274069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff2800ad000 tx=0x7ff280008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:06:59.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.575+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff29415c790 con 0x7ff29406c160 2024-04-25T10:06:59.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:06:59.775+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2940b0260 con 0x7ff29406c160 2024-04-25T10:07:00.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.695+0000 7ff28be00640 1 -- 172.21.15.18:0/2781381270 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff284059e20 con 0x7ff29406c160 2024-04-25T10:07:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 msgr2=0x7ff274069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 0x7ff274069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff2800ad000 tx=0x7ff280008040 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 msgr2=0x7ff294147820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c420 tx=0x7ff28400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 shutdown_connections 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff274066f60 0x7ff274069420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff29415e8b0 0x7ff29415cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2940af2f0 0x7ff29415b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 --2- 172.21.15.18:0/2781381270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff29406c160 0x7ff294147820 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 >> 172.21.15.18:0/2781381270 conn(0x7ff294071930 msgr2=0x7ff2940af920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 shutdown_connections 2024-04-25T10:07:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.699+0000 7ff299a00640 1 -- 172.21.15.18:0/2781381270 wait complete. 2024-04-25T10:07:00.726 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:07:00.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:07:00.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.863+0000 7f730c000640 1 Processor -- start 2024-04-25T10:07:00.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.863+0000 7f730c000640 1 -- start start 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415b7b0 0x7f73040cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730c000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f730415fa90 0x7f730415ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730c000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73040b5310 con 0x7f73040b4400 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730c000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730415f600 con 0x7f730415fa90 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73040b4a70 con 0x7f730415b7b0 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f730415fa90 0x7f730415ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f7308c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f73040b4400 0x7f730406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50196/0 (socket says 172.21.15.18:50196) 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f7308c00640 1 -- 172.21.15.18:0/1250836556 learned_addr learned my addr 172.21.15.18:0/1250836556 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:00.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f7309600640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415b7b0 0x7f73040cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730a000640 1 -- 172.21.15.18:0/1250836556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415b7b0 msgr2=0x7f73040cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730a000640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415b7b0 0x7f73040cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730a000640 1 -- 172.21.15.18:0/1250836556 >> v1:172.21.15.18:6789/0 conn(0x7f73040b4400 legacy=0x7f730406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.867+0000 7f730a000640 1 -- 172.21.15.18:0/1250836556 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040b4d50 con 0x7f730415fa90 2024-04-25T10:07:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730a000640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f730415fa90 0x7f730415ff20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009d90 tx=0x7f72fc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87207569ab794325 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:00.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f7303e00640 1 -- 172.21.15.18:0/1250836556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0b2070 con 0x7f730415fa90 2024-04-25T10:07:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f7303e00640 1 -- 172.21.15.18:0/1250836556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc0a5840 con 0x7f730415fa90 2024-04-25T10:07:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f7303e00640 1 -- 172.21.15.18:0/1250836556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc0a5c10 con 0x7f730415fa90 2024-04-25T10:07:00.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- 172.21.15.18:0/1250836556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f730415fa90 msgr2=0x7f730415ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f730415fa90 0x7f730415ff20 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009d90 tx=0x7f72fc01c970 comp rx=0 tx=0).stop 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- 172.21.15.18:0/1250836556 shutdown_connections 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f730415fa90 0x7f730415ff20 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 --2- 172.21.15.18:0/1250836556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415b7b0 0x7f73040cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- 172.21.15.18:0/1250836556 >> 172.21.15.18:0/1250836556 conn(0x7f73040cfd90 msgr2=0x7f73040d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- 172.21.15.18:0/1250836556 shutdown_connections 2024-04-25T10:07:00.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- 172.21.15.18:0/1250836556 wait complete. 2024-04-25T10:07:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 Processor -- start 2024-04-25T10:07:00.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.871+0000 7f730c000640 1 -- start start 2024-04-25T10:07:00.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f730415b7b0 0x7f730415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 0x7f730415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730415bd10 con 0x7f73040b4400 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730415bb90 con 0x7f730415b7b0 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7304168800 con 0x7f730415fa90 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51748/0 (socket says 172.21.15.18:51748) 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 -- 172.21.15.18:0/186480050 learned_addr learned my addr 172.21.15.18:0/186480050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7308c00640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f730415b7b0 0x7f730415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730a000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 0x7f730415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 -- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 msgr2=0x7f730415e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 0x7f730415e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 -- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f730415b7b0 msgr2=0x7f730415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f730415b7b0 0x7f730415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 -- 172.21.15.18:0/186480050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73041519a0 con 0x7f73040b4400 2024-04-25T10:07:00.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730a000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 0x7f730415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7309600640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e960 tx=0x7f72f800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8017070 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800ca00 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800cdb0 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730415cdf0 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73040b0750 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73040745d0 con 0x7f73040b4400 2024-04-25T10:07:00.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.875+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72f801a070 con 0x7f73040b4400 2024-04-25T10:07:00.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.879+0000 7f7301600640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 0x7f72e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:00.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.879+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72f80852b0 con 0x7f73040b4400 2024-04-25T10:07:00.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.879+0000 7f7308c00640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 0x7f72e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:00.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.879+0000 7f7308c00640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 0x7f72e4069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f73040cf9b0 tx=0x7f72f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:00.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:00.883+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72f8056090 con 0x7f73040b4400 2024-04-25T10:07:01.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.079+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f730409dab0 con 0x7f73040b4400 2024-04-25T10:07:01.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f7301600640 1 -- 172.21.15.18:0/186480050 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72f8055990 con 0x7f73040b4400 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 msgr2=0x7f72e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 0x7f72e4069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f73040cf9b0 tx=0x7f72f0009040 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 msgr2=0x7f730415c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f72f800e960 tx=0x7f72f800ee20 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 shutdown_connections 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72e4066f60 0x7f72e4069420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f730415fa90 0x7f730415e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f730415b7b0 0x7f730415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 --2- 172.21.15.18:0/186480050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73040b4400 0x7f730415c8b0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 >> 172.21.15.18:0/186480050 conn(0x7f73040cfd90 msgr2=0x7f73040adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 shutdown_connections 2024-04-25T10:07:01.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.707+0000 7f730c000640 1 -- 172.21.15.18:0/186480050 wait complete. 2024-04-25T10:07:01.738 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:07:01.738 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:07:01.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 Processor -- start 2024-04-25T10:07:01.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 -- start start 2024-04-25T10:07:01.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d4099a60 0x7f58d4099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:01.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d409a380 con 0x7f58d40cff30 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d406c650 con 0x7f58d415ee00 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d9a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d406c430 con 0x7f58d4099a60 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d4099a60 0x7f58d4099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58d4099a60 0x7f58d4099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45304/0 (socket says 172.21.15.18:45304) 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.875+0000 7f58d3400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f58d40cff30 0x7f58d40d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59468/0 (socket says 172.21.15.18:59468) 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2a00640 1 -- 172.21.15.18:0/2065686703 learned_addr learned my addr 172.21.15.18:0/2065686703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2a00640 1 -- 172.21.15.18:0/2065686703 >> v1:172.21.15.167:6789/0 conn(0x7f58d415ee00 legacy=0x7f58d406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:01.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2a00640 1 -- 172.21.15.18:0/2065686703 >> v1:172.21.15.18:6789/0 conn(0x7f58d40cff30 legacy=0x7f58d40d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2a00640 1 -- 172.21.15.18:0/2065686703 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d406c930 con 0x7f58d4099a60 2024-04-25T10:07:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2a00640 1 --2- 172.21.15.18:0/2065686703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4099e40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009870 tx=0x7f58c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f94218b6dfe840e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2000640 1 -- 172.21.15.18:0/2065686703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40ab610 con 0x7f58d4099a60 2024-04-25T10:07:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2000640 1 -- 172.21.15.18:0/2065686703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c40b0070 con 0x7f58d4099a60 2024-04-25T10:07:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d2000640 1 -- 172.21.15.18:0/2065686703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40ab9d0 con 0x7f58d4099a60 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d9a00640 1 -- 172.21.15.18:0/2065686703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 msgr2=0x7f58d4099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.879+0000 7f58d9a00640 1 --2- 172.21.15.18:0/2065686703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4099e40 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f58c4009870 tx=0x7f58c401c520 comp rx=0 tx=0).stop 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- 172.21.15.18:0/2065686703 shutdown_connections 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 --2- 172.21.15.18:0/2065686703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4099e40 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- 172.21.15.18:0/2065686703 >> 172.21.15.18:0/2065686703 conn(0x7f58d40d17a0 msgr2=0x7f58d40d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- 172.21.15.18:0/2065686703 shutdown_connections 2024-04-25T10:07:01.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- 172.21.15.18:0/2065686703 wait complete. 2024-04-25T10:07:01.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 Processor -- start 2024-04-25T10:07:01.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- start start 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d40cff30 0x7f58d414fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d415ee00 0x7f58d4158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415e000 con 0x7f58d4099a60 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d415de80 con 0x7f58d40cff30 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d416ba10 con 0x7f58d415ee00 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45308/0 (socket says 172.21.15.18:45308) 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 -- 172.21.15.18:0/565003520 learned_addr learned my addr 172.21.15.18:0/565003520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58cbe00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d40cff30 0x7f58d414fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d3400640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d415ee00 0x7f58d4158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 -- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d415ee00 msgr2=0x7f58d4158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d415ee00 0x7f58d4158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 -- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d40cff30 msgr2=0x7f58d414fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d40cff30 0x7f58d414fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 -- 172.21.15.18:0/565003520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d40b6890 con 0x7f58d4099a60 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.883+0000 7f58d2a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f58c40ad040 tx=0x7f58c401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40be5f0 con 0x7f58d4099a60 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c40be7b0 con 0x7f58d4099a60 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40beba0 con 0x7f58d4099a60 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d40b5ad0 con 0x7f58d4099a60 2024-04-25T10:07:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d40b6090 con 0x7f58d4099a60 2024-04-25T10:07:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d40745d0 con 0x7f58d4099a60 2024-04-25T10:07:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58c40b4600 con 0x7f58d4099a60 2024-04-25T10:07:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 0x7f58b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58c411fb70 con 0x7f58d4099a60 2024-04-25T10:07:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.887+0000 7f58cbe00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 0x7f58b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.891+0000 7f58cbe00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 0x7f58b0069450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f58d4157cb0 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:01.891+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f58c40a8050 con 0x7f58d4099a60 2024-04-25T10:07:02.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.087+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58d40745d0 con 0x7f58d4099a60 2024-04-25T10:07:02.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.087+0000 7f58caa00640 1 -- 172.21.15.18:0/565003520 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f58c4016110 con 0x7f58d4099a60 2024-04-25T10:07:02.096 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:02.096 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:01.082291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:07:02.097 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 36 2024-04-25T10:07:02.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 msgr2=0x7f58b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 0x7f58b0069450 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f58d4157cb0 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2024-04-25T10:07:02.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 msgr2=0x7f58d4157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f58c40ad040 tx=0x7f58c401ad60 comp rx=0 tx=0).stop 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 shutdown_connections 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58b0066f90 0x7f58b0069450 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f58d415ee00 0x7f58d4158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f58d40cff30 0x7f58d414fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 --2- 172.21.15.18:0/565003520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58d4099a60 0x7f58d4157770 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 >> 172.21.15.18:0/565003520 conn(0x7f58d40d17a0 msgr2=0x7f58d4070d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 shutdown_connections 2024-04-25T10:07:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.091+0000 7f58d9a00640 1 -- 172.21.15.18:0/565003520 wait complete. 2024-04-25T10:07:02.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 Processor -- start 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 -- start start 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcd80ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efcd806ac10 0x7efcd806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80b2870 con 0x7efcd80cf9f0 2024-04-25T10:07:02.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd815ded0 con 0x7efcd806ac10 2024-04-25T10:07:02.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcde600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80ca860 con 0x7efcd815daf0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efcd80cf9f0 0x7efcd80ca150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59476/0 (socket says 172.21.15.18:59476) 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 -- 172.21.15.18:0/89164856 learned_addr learned my addr 172.21.15.18:0/89164856 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcddc00640 1 --2- 172.21.15.18:0/89164856 >> v2:172.21.15.167:3300/0 conn(0x7efcd806ac10 0x7efcd806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcdd200640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcd80ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337955953 0 0) 0x7efcd80b2870 con 0x7efcd80cf9f0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcc0003530 con 0x7efcd80cf9f0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041030424 0 0) 0x7efcc0003530 con 0x7efcd80cf9f0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 msgr2=0x7efcd80ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcd80ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 >> v2:172.21.15.167:3300/0 conn(0x7efcd806ac10 msgr2=0x7efcd806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 --2- 172.21.15.18:0/89164856 >> v2:172.21.15.167:3300/0 conn(0x7efcd806ac10 0x7efcd806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80b2ae0 con 0x7efcd80cf9f0 2024-04-25T10:07:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7efcc4001680 con 0x7efcd80cf9f0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 >> v1:172.21.15.18:6789/0 conn(0x7efcd80cf9f0 legacy=0x7efcd80ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcc00039c0 0x7efcc0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc0004810 0x7efcc0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80ca860 con 0x7efcc0004810 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcc000b9d0 con 0x7efcc00039c0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcc000bb50 con 0x7efcd815daf0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc0004810 0x7efcc0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcdd200640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcc00039c0 0x7efcc0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcddc00640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 -- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 msgr2=0x7efcc00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcd815daf0 0x7efcc00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 -- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcc00039c0 msgr2=0x7efcc0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcc00039c0 0x7efcc0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.251+0000 7efcd7e00640 1 -- 172.21.15.18:0/89164856 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc0003530 con 0x7efcc0004810 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcd7e00640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc0004810 0x7efcc0004c90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c210 tx=0x7efcc401f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b53ecb788648416f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4007d60 con 0x7efcc0004810 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4005b00 con 0x7efcc0004810 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcd7400640 1 -- 172.21.15.18:0/89164856 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4007070 con 0x7efcc0004810 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 -- 172.21.15.18:0/89164856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc0004810 msgr2=0x7efcc0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 --2- 172.21.15.18:0/89164856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcc0004810 0x7efcc0004c90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7efcc400c210 tx=0x7efcc401f3f0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcddc00640 1 -- 172.21.15.18:0/89164856 reap_dead start 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 -- 172.21.15.18:0/89164856 shutdown_connections 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 -- 172.21.15.18:0/89164856 >> 172.21.15.18:0/89164856 conn(0x7efcd8099a60 msgr2=0x7efcd80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 -- 172.21.15.18:0/89164856 shutdown_connections 2024-04-25T10:07:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.255+0000 7efcde600640 1 -- 172.21.15.18:0/89164856 wait complete. 2024-04-25T10:07:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 Processor -- start 2024-04-25T10:07:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- start start 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcc0004810 0x7efcd80b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd81f03d0 0x7efcd81f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80ce1a0 con 0x7efcd81f0850 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80ce4f0 con 0x7efcd81f03d0 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80ad3a0 con 0x7efcc0004810 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45326/0 (socket says 172.21.15.18:45326) 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 -- 172.21.15.18:0/2604300255 learned_addr learned my addr 172.21.15.18:0/2604300255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcdd200640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcc0004810 0x7efcd80b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcd7e00640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd81f03d0 0x7efcd81f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 -- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcc0004810 msgr2=0x7efcd80b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcc0004810 0x7efcd80b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 -- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd81f03d0 msgr2=0x7efcd81f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd81f03d0 0x7efcd81f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 -- 172.21.15.18:0/2604300255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd81f3b80 con 0x7efcd81f0850 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcddc00640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efcd8099f60 tx=0x7efcd00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0011e40 con 0x7efcd81f0850 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd001b070 con 0x7efcd81f0850 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd81f3e60 con 0x7efcd81f0850 2024-04-25T10:07:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd00039a0 con 0x7efcd81f0850 2024-04-25T10:07:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.259+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd80b5310 con 0x7efcd81f0850 2024-04-25T10:07:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd80b5510 con 0x7efcd81f0850 2024-04-25T10:07:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efcd0003b40 con 0x7efcd81f0850 2024-04-25T10:07:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcd4c00640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efcd0085a90 con 0x7efcd81f0850 2024-04-25T10:07:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcdd200640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.263+0000 7efcdd200640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcd81573f0 tx=0x7efccc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.267+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efcd80b5510 con 0x7efcd81f0850 2024-04-25T10:07:02.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.427+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcd80b4e20 con 0x7efcd81f0850 2024-04-25T10:07:02.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcd4c00640 1 -- 172.21.15.18:0/2604300255 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+16860 (secure 0 0 0) 0x7efcd0085070 con 0x7efcd81f0850 2024-04-25T10:07:02.437 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:02.437 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":67,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:06:59.681372+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:07:02.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 msgr2=0x7efcb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7efcd81573f0 tx=0x7efccc009190 comp rx=0 tx=0).stop 2024-04-25T10:07:02.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 msgr2=0x7efcd815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7efcd8099f60 tx=0x7efcd00115a0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 shutdown_connections 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd81f0850 0x7efcd815c6c0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcd81f03d0 0x7efcd81f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 --2- 172.21.15.18:0/2604300255 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcc0004810 0x7efcd80b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 >> 172.21.15.18:0/2604300255 conn(0x7efcd8099a60 msgr2=0x7efcd80af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 shutdown_connections 2024-04-25T10:07:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.431+0000 7efcde600640 1 -- 172.21.15.18:0/2604300255 wait complete. 2024-04-25T10:07:02.459 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:07:02.459 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:07:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 Processor -- start 2024-04-25T10:07:02.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 -- start start 2024-04-25T10:07:02.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67c80b1e60 0x7f67c80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c80cc4e0 con 0x7f67c80cd4d0 2024-04-25T10:07:02.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c8145650 con 0x7f67c80b1e60 2024-04-25T10:07:02.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67cec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c80ce040 con 0x7f67c8145270 2024-04-25T10:07:02.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67ccc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67c80b1e60 0x7f67c80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67ccc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f67c80b1e60 0x7f67c80cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45334/0 (socket says 172.21.15.18:45334) 2024-04-25T10:07:02.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.591+0000 7f67ccc00640 1 -- 172.21.15.18:0/230693806 learned_addr learned my addr 172.21.15.18:0/230693806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:02.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67c7e00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67ccc00640 1 -- 172.21.15.18:0/230693806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 msgr2=0x7f67c815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67ccc00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67ccc00640 1 -- 172.21.15.18:0/230693806 >> v1:172.21.15.167:6789/0 conn(0x7f67c80cd4d0 legacy=0x7f67c80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67ccc00640 1 -- 172.21.15.18:0/230693806 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80ce320 con 0x7f67c80b1e60 2024-04-25T10:07:02.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67ccc00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c80cd930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e50 tx=0x7f67c001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ce2aab756f7aca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67c7400640 1 -- 172.21.15.18:0/230693806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c00a57f0 con 0x7f67c80b1e60 2024-04-25T10:07:02.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67c7400640 1 -- 172.21.15.18:0/230693806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c00a5990 con 0x7f67c80b1e60 2024-04-25T10:07:02.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67c7400640 1 -- 172.21.15.18:0/230693806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c00a5d60 con 0x7f67c80b1e60 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67cec00640 1 -- 172.21.15.18:0/230693806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 msgr2=0x7f67c80cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.595+0000 7f67cec00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c80cd930 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f67c0009e50 tx=0x7f67c001ca30 comp rx=0 tx=0).stop 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- 172.21.15.18:0/230693806 shutdown_connections 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c80cd930 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 --2- 172.21.15.18:0/230693806 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- 172.21.15.18:0/230693806 >> 172.21.15.18:0/230693806 conn(0x7f67c8066fa0 msgr2=0x7f67c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- 172.21.15.18:0/230693806 shutdown_connections 2024-04-25T10:07:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- 172.21.15.18:0/230693806 wait complete. 2024-04-25T10:07:02.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 Processor -- start 2024-04-25T10:07:02.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- start start 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c80cd4d0 0x7f67c813d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c80b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815c710 con 0x7f67c80b1e60 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815c590 con 0x7f67c80cd4d0 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67cec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c815c890 con 0x7f67c8145270 2024-04-25T10:07:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45338/0 (socket says 172.21.15.18:45338) 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 -- 172.21.15.18:0/1788857915 learned_addr learned my addr 172.21.15.18:0/1788857915 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67bf400640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c80cd4d0 0x7f67c813d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67ccc00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c80b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 -- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 msgr2=0x7f67c80b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c80b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 -- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c80cd4d0 msgr2=0x7f67c813d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c80cd4d0 0x7f67c813d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.599+0000 7f67c7e00640 1 -- 172.21.15.18:0/1788857915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c813ef00 con 0x7f67c80b1e60 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c7e00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d5f0 tx=0x7f67b800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80125f0 con 0x7f67c80b1e60 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b8019070 con 0x7f67c80b1e60 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b80129b0 con 0x7f67c80b1e60 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c813f1e0 con 0x7f67c80b1e60 2024-04-25T10:07:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c813f7a0 con 0x7f67c80b1e60 2024-04-25T10:07:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c80745d0 con 0x7f67c80b1e60 2024-04-25T10:07:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67b8012b50 con 0x7f67c80b1e60 2024-04-25T10:07:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 0x7f67a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f67b8085390 con 0x7f67c80b1e60 2024-04-25T10:07:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.603+0000 7f67bf400640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 0x7f67a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.607+0000 7f67bf400640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 0x7f67a4069450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67c815bc80 tx=0x7f67b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.607+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67b8055c50 con 0x7f67c80b1e60 2024-04-25T10:07:02.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.767+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67c8160250 con 0x7f67a4066f90 2024-04-25T10:07:02.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67c4c00640 1 -- 172.21.15.18:0/1788857915 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243419 (secure 0 0 0) 0x7f67b0001450 con 0x7f67a4066f90 2024-04-25T10:07:02.784 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:02.786 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 msgr2=0x7f67a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 0x7f67a4069450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f67c815bc80 tx=0x7f67b0009040 comp rx=0 tx=0).stop 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 msgr2=0x7f67c813e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f67b800d5f0 tx=0x7f67b800dab0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 shutdown_connections 2024-04-25T10:07:02.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f67a4066f90 0x7f67a4069450 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f67c8145270 0x7f67c80b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f67c80cd4d0 0x7f67c813d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 --2- 172.21.15.18:0/1788857915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67c80b1e60 0x7f67c813e440 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.775+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 >> 172.21.15.18:0/1788857915 conn(0x7f67c8066fa0 msgr2=0x7f67c81420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.779+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 shutdown_connections 2024-04-25T10:07:02.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.779+0000 7f67cec00640 1 -- 172.21.15.18:0/1788857915 wait complete. 2024-04-25T10:07:02.804 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T10:07:01.440193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":244164,"kb_used_data":7180,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730556,"statfs":{"total":773094113280,"available":772844089344,"internally_reserved":0,"allocated":7352320,"data_stored":3950027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.775698"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.687272+0000","last_change":"2024-04-25T10:06:57.687272+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.687272+0000","last_undegraded":"2024-04-25T10:06:57.687272+0000","last_fullsized":"2024-04-25T10:06:57.687272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.680109+0000","last_change":"2024-04-25T10:06:57.680109+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.680109+0000","last_undegraded":"2024-04-25T10:06:57.680109+0000","last_fullsized":"2024-04-25T10:06:57.680109+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678782+0000","last_change":"2024-04-25T10:06:57.678782+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678782+0000","last_undegraded":"2024-04-25T10:06:57.678782+0000","last_fullsized":"2024-04-25T10:06:57.678782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.682962+0000","last_change":"2024-04-25T10:06:57.682962+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.682962+0000","last_undegraded":"2024-04-25T10:06:57.682962+0000","last_fullsized":"2024-04-25T10:06:57.682962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685460+0000","last_change":"2024-04-25T10:06:57.685460+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685460+0000","last_undegraded":"2024-04-25T10:06:57.685460+0000","last_fullsized":"2024-04-25T10:06:57.685460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684944+0000","last_change":"2024-04-25T10:06:57.684944+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684944+0000","last_undegraded":"2024-04-25T10:06:57.684944+0000","last_fullsized":"2024-04-25T10:06:57.684944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677731+0000","last_change":"2024-04-25T10:06:57.677731+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677731+0000","last_undegraded":"2024-04-25T10:06:57.677731+0000","last_fullsized":"2024-04-25T10:06:57.677731+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686756+0000","last_change":"2024-04-25T10:06:57.686756+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686756+0000","last_undegraded":"2024-04-25T10:06:57.686756+0000","last_fullsized":"2024-04-25T10:06:57.686756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684716+0000","last_change":"2024-04-25T10:06:57.684716+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684716+0000","last_undegraded":"2024-04-25T10:06:57.684716+0000","last_fullsized":"2024-04-25T10:06:57.684716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.683844+0000","last_change":"2024-04-25T10:06:57.683844+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.683844+0000","last_undegraded":"2024-04-25T10:06:57.683844+0000","last_fullsized":"2024-04-25T10:06:57.683844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684263+0000","last_change":"2024-04-25T10:06:57.684263+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684263+0000","last_undegraded":"2024-04-25T10:06:57.684263+0000","last_fullsized":"2024-04-25T10:06:57.684263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678552+0000","last_change":"2024-04-25T10:06:57.678552+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678552+0000","last_undegraded":"2024-04-25T10:06:57.678552+0000","last_fullsized":"2024-04-25T10:06:57.678552+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678305+0000","last_change":"2024-04-25T10:06:57.678305+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678305+0000","last_undegraded":"2024-04-25T10:06:57.678305+0000","last_fullsized":"2024-04-25T10:06:57.678305+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684196+0000","last_change":"2024-04-25T10:06:57.684196+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684196+0000","last_undegraded":"2024-04-25T10:06:57.684196+0000","last_fullsized":"2024-04-25T10:06:57.684196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.688161+0000","last_change":"2024-04-25T10:06:57.688161+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.688161+0000","last_undegraded":"2024-04-25T10:06:57.688161+0000","last_fullsized":"2024-04-25T10:06:57.688161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685492+0000","last_change":"2024-04-25T10:06:57.685492+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685492+0000","last_undegraded":"2024-04-25T10:06:57.685492+0000","last_fullsized":"2024-04-25T10:06:57.685492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685857+0000","last_change":"2024-04-25T10:06:57.685857+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685857+0000","last_undegraded":"2024-04-25T10:06:57.685857+0000","last_fullsized":"2024-04-25T10:06:57.685857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677293+0000","last_change":"2024-04-25T10:06:57.677293+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677293+0000","last_undegraded":"2024-04-25T10:06:57.677293+0000","last_fullsized":"2024-04-25T10:06:57.677293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686323+0000","last_change":"2024-04-25T10:06:57.686323+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686323+0000","last_undegraded":"2024-04-25T10:06:57.686323+0000","last_fullsized":"2024-04-25T10:06:57.686323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684473+0000","last_change":"2024-04-25T10:06:57.684473+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684473+0000","last_undegraded":"2024-04-25T10:06:57.684473+0000","last_fullsized":"2024-04-25T10:06:57.684473+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.679757+0000","last_change":"2024-04-25T10:06:57.679757+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.679757+0000","last_undegraded":"2024-04-25T10:06:57.679757+0000","last_fullsized":"2024-04-25T10:06:57.679757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676258+0000","last_change":"2024-04-25T10:06:57.676258+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676258+0000","last_undegraded":"2024-04-25T10:06:57.676258+0000","last_fullsized":"2024-04-25T10:06:57.676258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667858+0000","last_change":"2024-04-25T10:06:56.667858+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667858+0000","last_undegraded":"2024-04-25T10:06:56.667858+0000","last_fullsized":"2024-04-25T10:06:56.667858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676821+0000","last_change":"2024-04-25T10:06:57.676821+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676821+0000","last_undegraded":"2024-04-25T10:06:57.676821+0000","last_fullsized":"2024-04-25T10:06:57.676821+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676839+0000","last_change":"2024-04-25T10:06:56.676839+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676839+0000","last_undegraded":"2024-04-25T10:06:56.676839+0000","last_fullsized":"2024-04-25T10:06:56.676839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.677527+0000","last_change":"2024-04-25T10:06:56.677527+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.677527+0000","last_undegraded":"2024-04-25T10:06:56.677527+0000","last_fullsized":"2024-04-25T10:06:56.677527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685929+0000","last_change":"2024-04-25T10:06:57.685929+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685929+0000","last_undegraded":"2024-04-25T10:06:57.685929+0000","last_fullsized":"2024-04-25T10:06:57.685929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676848+0000","last_change":"2024-04-25T10:06:56.676848+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676848+0000","last_undegraded":"2024-04-25T10:06:56.676848+0000","last_fullsized":"2024-04-25T10:06:56.676848+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674507+0000","last_change":"2024-04-25T10:06:56.674507+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674507+0000","last_undegraded":"2024-04-25T10:06:56.674507+0000","last_fullsized":"2024-04-25T10:06:56.674507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674998+0000","last_change":"2024-04-25T10:06:56.674998+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674998+0000","last_undegraded":"2024-04-25T10:06:56.674998+0000","last_fullsized":"2024-04-25T10:06:56.674998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677444+0000","last_change":"2024-04-25T10:06:57.677444+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677444+0000","last_undegraded":"2024-04-25T10:06:57.677444+0000","last_fullsized":"2024-04-25T10:06:57.677444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.675056+0000","last_change":"2024-04-25T10:06:56.675056+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.675056+0000","last_undegraded":"2024-04-25T10:06:56.675056+0000","last_fullsized":"2024-04-25T10:06:56.675056+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.698464+0000","last_change":"2024-04-25T10:06:57.695087+0000","last_active":"2024-04-25T10:06:57.698464+0000","last_peered":"2024-04-25T10:06:57.698464+0000","last_clean":"2024-04-25T10:06:57.698464+0000","last_became_active":"2024-04-25T10:06:57.694780+0000","last_became_peered":"2024-04-25T10:06:57.694780+0000","last_unstale":"2024-04-25T10:06:57.698464+0000","last_undegraded":"2024-04-25T10:06:57.698464+0000","last_fullsized":"2024-04-25T10:06:57.698464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:09.801885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703456+0000","last_change":"2024-04-25T10:06:57.702505+0000","last_active":"2024-04-25T10:06:57.703456+0000","last_peered":"2024-04-25T10:06:57.703456+0000","last_clean":"2024-04-25T10:06:57.703456+0000","last_became_active":"2024-04-25T10:06:57.702181+0000","last_became_peered":"2024-04-25T10:06:57.702181+0000","last_unstale":"2024-04-25T10:06:57.703456+0000","last_undegraded":"2024-04-25T10:06:57.703456+0000","last_fullsized":"2024-04-25T10:06:57.703456+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:25.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700305+0000","last_change":"2024-04-25T10:06:57.698329+0000","last_active":"2024-04-25T10:06:57.700305+0000","last_peered":"2024-04-25T10:06:57.700305+0000","last_clean":"2024-04-25T10:06:57.700305+0000","last_became_active":"2024-04-25T10:06:57.697990+0000","last_became_peered":"2024-04-25T10:06:57.697990+0000","last_unstale":"2024-04-25T10:06:57.700305+0000","last_undegraded":"2024-04-25T10:06:57.700305+0000","last_fullsized":"2024-04-25T10:06:57.700305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:33.865645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676787+0000","last_change":"2024-04-25T10:06:57.676787+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676787+0000","last_undegraded":"2024-04-25T10:06:57.676787+0000","last_fullsized":"2024-04-25T10:06:57.676787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703123+0000","last_change":"2024-04-25T10:06:57.701358+0000","last_active":"2024-04-25T10:06:57.703123+0000","last_peered":"2024-04-25T10:06:57.703123+0000","last_clean":"2024-04-25T10:06:57.703123+0000","last_became_active":"2024-04-25T10:06:57.700998+0000","last_became_peered":"2024-04-25T10:06:57.700998+0000","last_unstale":"2024-04-25T10:06:57.703123+0000","last_undegraded":"2024-04-25T10:06:57.703123+0000","last_fullsized":"2024-04-25T10:06:57.703123+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.679106+0000","last_change":"2024-04-25T10:06:57.679106+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.679106+0000","last_undegraded":"2024-04-25T10:06:57.679106+0000","last_fullsized":"2024-04-25T10:06:57.679106+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.668284+0000","last_change":"2024-04-25T10:06:56.668284+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.668284+0000","last_undegraded":"2024-04-25T10:06:56.668284+0000","last_fullsized":"2024-04-25T10:06:56.668284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676998+0000","last_change":"2024-04-25T10:06:57.676998+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676998+0000","last_undegraded":"2024-04-25T10:06:57.676998+0000","last_fullsized":"2024-04-25T10:06:57.676998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702553+0000","last_change":"2024-04-25T10:06:57.699763+0000","last_active":"2024-04-25T10:06:57.702553+0000","last_peered":"2024-04-25T10:06:57.702553+0000","last_clean":"2024-04-25T10:06:57.702553+0000","last_became_active":"2024-04-25T10:06:57.699453+0000","last_became_peered":"2024-04-25T10:06:57.699453+0000","last_unstale":"2024-04-25T10:06:57.702553+0000","last_undegraded":"2024-04-25T10:06:57.702553+0000","last_fullsized":"2024-04-25T10:06:57.702553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.134651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.683545+0000","last_change":"2024-04-25T10:06:57.683545+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.683545+0000","last_undegraded":"2024-04-25T10:06:57.683545+0000","last_fullsized":"2024-04-25T10:06:57.683545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702326+0000","last_change":"2024-04-25T10:06:57.699687+0000","last_active":"2024-04-25T10:06:57.702326+0000","last_peered":"2024-04-25T10:06:57.702326+0000","last_clean":"2024-04-25T10:06:57.702326+0000","last_became_active":"2024-04-25T10:06:57.699195+0000","last_became_peered":"2024-04-25T10:06:57.699195+0000","last_unstale":"2024-04-25T10:06:57.702326+0000","last_undegraded":"2024-04-25T10:06:57.702326+0000","last_fullsized":"2024-04-25T10:06:57.702326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.134651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677000+0000","last_change":"2024-04-25T10:06:57.677000+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677000+0000","last_undegraded":"2024-04-25T10:06:57.677000+0000","last_fullsized":"2024-04-25T10:06:57.677000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702690+0000","last_change":"2024-04-25T10:06:57.699729+0000","last_active":"2024-04-25T10:06:57.702690+0000","last_peered":"2024-04-25T10:06:57.702690+0000","last_clean":"2024-04-25T10:06:57.702690+0000","last_became_active":"2024-04-25T10:06:57.697804+0000","last_became_peered":"2024-04-25T10:06:57.697804+0000","last_unstale":"2024-04-25T10:06:57.702690+0000","last_undegraded":"2024-04-25T10:06:57.702690+0000","last_fullsized":"2024-04-25T10:06:57.702690+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:51.088017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.697487+0000","last_change":"2024-04-25T10:06:57.695831+0000","last_active":"2024-04-25T10:06:57.697487+0000","last_peered":"2024-04-25T10:06:57.697487+0000","last_clean":"2024-04-25T10:06:57.697487+0000","last_became_active":"2024-04-25T10:06:57.694960+0000","last_became_peered":"2024-04-25T10:06:57.694960+0000","last_unstale":"2024-04-25T10:06:57.697487+0000","last_undegraded":"2024-04-25T10:06:57.697487+0000","last_fullsized":"2024-04-25T10:06:57.697487+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:09.801885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686749+0000","last_change":"2024-04-25T10:06:57.686749+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686749+0000","last_undegraded":"2024-04-25T10:06:57.686749+0000","last_fullsized":"2024-04-25T10:06:57.686749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702736+0000","last_change":"2024-04-25T10:06:57.701226+0000","last_active":"2024-04-25T10:06:57.702736+0000","last_peered":"2024-04-25T10:06:57.702736+0000","last_clean":"2024-04-25T10:06:57.702736+0000","last_became_active":"2024-04-25T10:06:57.700923+0000","last_became_peered":"2024-04-25T10:06:57.700923+0000","last_unstale":"2024-04-25T10:06:57.702736+0000","last_undegraded":"2024-04-25T10:06:57.702736+0000","last_fullsized":"2024-04-25T10:06:57.702736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676293+0000","last_change":"2024-04-25T10:06:57.676293+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676293+0000","last_undegraded":"2024-04-25T10:06:57.676293+0000","last_fullsized":"2024-04-25T10:06:57.676293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700137+0000","last_change":"2024-04-25T10:06:57.698613+0000","last_active":"2024-04-25T10:06:57.700137+0000","last_peered":"2024-04-25T10:06:57.700137+0000","last_clean":"2024-04-25T10:06:57.700137+0000","last_became_active":"2024-04-25T10:06:57.698073+0000","last_became_peered":"2024-04-25T10:06:57.698073+0000","last_unstale":"2024-04-25T10:06:57.700137+0000","last_undegraded":"2024-04-25T10:06:57.700137+0000","last_fullsized":"2024-04-25T10:06:57.700137+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:17.468580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678108+0000","last_change":"2024-04-25T10:06:57.678108+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678108+0000","last_undegraded":"2024-04-25T10:06:57.678108+0000","last_fullsized":"2024-04-25T10:06:57.678108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703141+0000","last_change":"2024-04-25T10:06:57.701710+0000","last_active":"2024-04-25T10:06:57.703141+0000","last_peered":"2024-04-25T10:06:57.703141+0000","last_clean":"2024-04-25T10:06:57.703141+0000","last_became_active":"2024-04-25T10:06:57.701340+0000","last_became_peered":"2024-04-25T10:06:57.701340+0000","last_unstale":"2024-04-25T10:06:57.703141+0000","last_undegraded":"2024-04-25T10:06:57.703141+0000","last_fullsized":"2024-04-25T10:06:57.703141+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:35.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677703+0000","last_change":"2024-04-25T10:06:57.677703+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677703+0000","last_undegraded":"2024-04-25T10:06:57.677703+0000","last_fullsized":"2024-04-25T10:06:57.677703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674568+0000","last_change":"2024-04-25T10:06:56.674568+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674568+0000","last_undegraded":"2024-04-25T10:06:56.674568+0000","last_fullsized":"2024-04-25T10:06:56.674568+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676859+0000","last_change":"2024-04-25T10:06:56.676859+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676859+0000","last_undegraded":"2024-04-25T10:06:56.676859+0000","last_fullsized":"2024-04-25T10:06:56.676859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.682891+0000","last_change":"2024-04-25T10:06:57.682891+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.682891+0000","last_undegraded":"2024-04-25T10:06:57.682891+0000","last_fullsized":"2024-04-25T10:06:57.682891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700387+0000","last_change":"2024-04-25T10:06:57.699439+0000","last_active":"2024-04-25T10:06:57.700387+0000","last_peered":"2024-04-25T10:06:57.700387+0000","last_clean":"2024-04-25T10:06:57.700387+0000","last_became_active":"2024-04-25T10:06:57.698847+0000","last_became_peered":"2024-04-25T10:06:57.698847+0000","last_unstale":"2024-04-25T10:06:57.700387+0000","last_undegraded":"2024-04-25T10:06:57.700387+0000","last_fullsized":"2024-04-25T10:06:57.700387+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:51.088017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676229+0000","last_change":"2024-04-25T10:06:57.676229+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676229+0000","last_undegraded":"2024-04-25T10:06:57.676229+0000","last_fullsized":"2024-04-25T10:06:57.676229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.677061+0000","last_change":"2024-04-25T10:06:56.677061+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.677061+0000","last_undegraded":"2024-04-25T10:06:56.677061+0000","last_fullsized":"2024-04-25T10:06:56.677061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.699832+0000","last_change":"2024-04-25T10:06:57.696956+0000","last_active":"2024-04-25T10:06:57.699832+0000","last_peered":"2024-04-25T10:06:57.699832+0000","last_clean":"2024-04-25T10:06:57.699832+0000","last_became_active":"2024-04-25T10:06:57.696670+0000","last_became_peered":"2024-04-25T10:06:57.696670+0000","last_unstale":"2024-04-25T10:06:57.699832+0000","last_undegraded":"2024-04-25T10:06:57.699832+0000","last_fullsized":"2024-04-25T10:06:57.699832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:32.702224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.693974+0000","last_change":"2024-04-25T10:06:57.691781+0000","last_active":"2024-04-25T10:06:57.693974+0000","last_peered":"2024-04-25T10:06:57.693974+0000","last_clean":"2024-04-25T10:06:57.693974+0000","last_became_active":"2024-04-25T10:06:57.690812+0000","last_became_peered":"2024-04-25T10:06:57.690812+0000","last_unstale":"2024-04-25T10:06:57.693974+0000","last_undegraded":"2024-04-25T10:06:57.693974+0000","last_fullsized":"2024-04-25T10:06:57.693974+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:17.468580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685367+0000","last_change":"2024-04-25T10:06:57.685367+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685367+0000","last_undegraded":"2024-04-25T10:06:57.685367+0000","last_fullsized":"2024-04-25T10:06:57.685367+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676855+0000","last_change":"2024-04-25T10:06:56.676855+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676855+0000","last_undegraded":"2024-04-25T10:06:56.676855+0000","last_fullsized":"2024-04-25T10:06:56.676855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677248+0000","last_change":"2024-04-25T10:06:57.677248+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677248+0000","last_undegraded":"2024-04-25T10:06:57.677248+0000","last_fullsized":"2024-04-25T10:06:57.677248+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667858+0000","last_change":"2024-04-25T10:06:56.667858+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667858+0000","last_undegraded":"2024-04-25T10:06:56.667858+0000","last_fullsized":"2024-04-25T10:06:56.667858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678200+0000","last_change":"2024-04-25T10:06:57.678200+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678200+0000","last_undegraded":"2024-04-25T10:06:57.678200+0000","last_fullsized":"2024-04-25T10:06:57.678200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.701738+0000","last_change":"2024-04-25T10:06:57.699267+0000","last_active":"2024-04-25T10:06:57.701738+0000","last_peered":"2024-04-25T10:06:57.701738+0000","last_clean":"2024-04-25T10:06:57.701738+0000","last_became_active":"2024-04-25T10:06:57.698971+0000","last_became_peered":"2024-04-25T10:06:57.698971+0000","last_unstale":"2024-04-25T10:06:57.701738+0000","last_undegraded":"2024-04-25T10:06:57.701738+0000","last_fullsized":"2024-04-25T10:06:57.701738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:32.702224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676473+0000","last_change":"2024-04-25T10:06:57.676473+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676473+0000","last_undegraded":"2024-04-25T10:06:57.676473+0000","last_fullsized":"2024-04-25T10:06:57.676473+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674461+0000","last_change":"2024-04-25T10:06:56.674461+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674461+0000","last_undegraded":"2024-04-25T10:06:56.674461+0000","last_fullsized":"2024-04-25T10:06:56.674461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674483+0000","last_change":"2024-04-25T10:06:56.674483+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674483+0000","last_undegraded":"2024-04-25T10:06:56.674483+0000","last_fullsized":"2024-04-25T10:06:56.674483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667702+0000","last_change":"2024-04-25T10:06:56.667702+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667702+0000","last_undegraded":"2024-04-25T10:06:56.667702+0000","last_fullsized":"2024-04-25T10:06:56.667702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676243+0000","last_change":"2024-04-25T10:06:57.676243+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676243+0000","last_undegraded":"2024-04-25T10:06:57.676243+0000","last_fullsized":"2024-04-25T10:06:57.676243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674515+0000","last_change":"2024-04-25T10:06:56.674515+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674515+0000","last_undegraded":"2024-04-25T10:06:56.674515+0000","last_fullsized":"2024-04-25T10:06:56.674515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":250,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.688984+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:06:57.688984+0000","last_peered":"2024-04-25T10:06:57.688984+0000","last_clean":"2024-04-25T10:06:57.688984+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:06:57.688984+0000","last_undegraded":"2024-04-25T10:06:57.688984+0000","last_fullsized":"2024-04-25T10:06:57.688984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":4},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":940635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":927767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:07:02.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:07:02.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 Processor -- start 2024-04-25T10:07:02.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 -- start start 2024-04-25T10:07:02.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f547c15b5a0 0x7f547c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f547c0cc440 0x7f547c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c0ce7f0 con 0x7f547c15b980 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0cfcd0 con 0x7f547c15b5a0 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5483e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0cead0 con 0x7f547c0cc440 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f547c15b5a0 0x7f547c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5480a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f547c15b980 0x7f547c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59478/0 (socket says 172.21.15.18:59478) 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5480a00640 1 -- 172.21.15.18:0/1240359905 learned_addr learned my addr 172.21.15.18:0/1240359905 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481e00640 1 --2- 172.21.15.18:0/1240359905 >> v2:172.21.15.167:3300/0 conn(0x7f547c0cc440 0x7f547c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481400640 1 -- 172.21.15.18:0/1240359905 >> v2:172.21.15.167:3300/0 conn(0x7f547c0cc440 msgr2=0x7f547c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481400640 1 --2- 172.21.15.18:0/1240359905 >> v2:172.21.15.167:3300/0 conn(0x7f547c0cc440 0x7f547c0d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481400640 1 -- 172.21.15.18:0/1240359905 >> v1:172.21.15.18:6789/0 conn(0x7f547c15b980 legacy=0x7f547c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f5481400640 1 -- 172.21.15.18:0/1240359905 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c0cf960 con 0x7f547c15b5a0 2024-04-25T10:07:02.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.979+0000 7f547be00640 1 -- 172.21.15.18:0/1240359905 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219659594 0 0) 0x7f547c0ce7f0 con 0x7f547c15b980 2024-04-25T10:07:02.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5481400640 1 --2- 172.21.15.18:0/1240359905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c0cdea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f547c070860 tx=0x7f547001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffd742b31b69c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f547be00640 1 -- 172.21.15.18:0/1240359905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aa600 con 0x7f547c15b5a0 2024-04-25T10:07:02.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f547be00640 1 -- 172.21.15.18:0/1240359905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54700af070 con 0x7f547c15b5a0 2024-04-25T10:07:02.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f547be00640 1 -- 172.21.15.18:0/1240359905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700aa9c0 con 0x7f547c15b5a0 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 -- 172.21.15.18:0/1240359905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 msgr2=0x7f547c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 --2- 172.21.15.18:0/1240359905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c0cdea0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f547c070860 tx=0x7f547001c480 comp rx=0 tx=0).stop 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 -- 172.21.15.18:0/1240359905 shutdown_connections 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 --2- 172.21.15.18:0/1240359905 >> v2:172.21.15.167:3300/0 conn(0x7f547c0cc440 0x7f547c0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 --2- 172.21.15.18:0/1240359905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c0cdea0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 -- 172.21.15.18:0/1240359905 >> 172.21.15.18:0/1240359905 conn(0x7f547c0b3390 msgr2=0x7f547c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 -- 172.21.15.18:0/1240359905 shutdown_connections 2024-04-25T10:07:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.983+0000 7f5483e00640 1 -- 172.21.15.18:0/1240359905 wait complete. 2024-04-25T10:07:02.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 Processor -- start 2024-04-25T10:07:02.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- start start 2024-04-25T10:07:02.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c0cc440 0x7f547c151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 0x7f547c148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0d1240 con 0x7f547c15b5a0 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0d10c0 con 0x7f547c15b980 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0d13c0 con 0x7f547c0cc440 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45362/0 (socket says 172.21.15.18:45362) 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 -- 172.21.15.18:0/689870474 learned_addr learned my addr 172.21.15.18:0/689870474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5481e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 0x7f547c148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5481400640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c0cc440 0x7f547c151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 -- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c0cc440 msgr2=0x7f547c151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c0cc440 0x7f547c151630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 -- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 msgr2=0x7f547c148fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 0x7f547c148fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 -- 172.21.15.18:0/689870474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c15ac90 con 0x7f547c15b5a0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5481e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 0x7f547c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5480a00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f54680011f0 tx=0x7f546800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468018070 con 0x7f547c15b5a0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54680074e0 con 0x7f547c15b5a0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468004a10 con 0x7f547c15b5a0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c151c30 con 0x7f547c15b5a0 2024-04-25T10:07:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c14a7c0 con 0x7f547c15b5a0 2024-04-25T10:07:02.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.987+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c0745d0 con 0x7f547c15b5a0 2024-04-25T10:07:02.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.991+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f546801b070 con 0x7f547c15b5a0 2024-04-25T10:07:02.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.991+0000 7f5479600640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 0x7f545c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:02.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.991+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5468084590 con 0x7f547c15b5a0 2024-04-25T10:07:02.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.991+0000 7f5481400640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 0x7f545c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:02.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.991+0000 7f5481400640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 0x7f545c069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f54700ae000 tx=0x7f54700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:02.995+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5468055400 con 0x7f547c15b5a0 2024-04-25T10:07:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.155+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f547c0cc960 con 0x7f545c066f60 2024-04-25T10:07:03.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5479600640 1 -- 172.21.15.18:0/689870474 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243419 (secure 0 0 0) 0x7f547c0cc960 con 0x7f545c066f60 2024-04-25T10:07:03.172 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:03.173 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:07:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 msgr2=0x7f545c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 0x7f545c069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f54700ae000 tx=0x7f54700a7000 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 msgr2=0x7f547c15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f54680011f0 tx=0x7f546800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 shutdown_connections 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f547c15b980 0x7f547c148fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f547c15b5a0 0x7f547c15a750 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f545c066f60 0x7f545c069420 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 --2- 172.21.15.18:0/689870474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f547c0cc440 0x7f547c151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.163+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 >> 172.21.15.18:0/689870474 conn(0x7f547c0b3390 msgr2=0x7f547c0b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.167+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 shutdown_connections 2024-04-25T10:07:03.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.167+0000 7f5483e00640 1 -- 172.21.15.18:0/689870474 wait complete. 2024-04-25T10:07:03.193 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-04-25T10:07:01.440193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":5,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":244164,"kb_used_data":7180,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730556,"statfs":{"total":773094113280,"available":772844089344,"internally_reserved":0,"allocated":7352320,"data_stored":3950027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.775698"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.687272+0000","last_change":"2024-04-25T10:06:57.687272+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.687272+0000","last_undegraded":"2024-04-25T10:06:57.687272+0000","last_fullsized":"2024-04-25T10:06:57.687272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.680109+0000","last_change":"2024-04-25T10:06:57.680109+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.680109+0000","last_undegraded":"2024-04-25T10:06:57.680109+0000","last_fullsized":"2024-04-25T10:06:57.680109+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678782+0000","last_change":"2024-04-25T10:06:57.678782+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678782+0000","last_undegraded":"2024-04-25T10:06:57.678782+0000","last_fullsized":"2024-04-25T10:06:57.678782+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.682962+0000","last_change":"2024-04-25T10:06:57.682962+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.682962+0000","last_undegraded":"2024-04-25T10:06:57.682962+0000","last_fullsized":"2024-04-25T10:06:57.682962+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685460+0000","last_change":"2024-04-25T10:06:57.685460+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685460+0000","last_undegraded":"2024-04-25T10:06:57.685460+0000","last_fullsized":"2024-04-25T10:06:57.685460+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684944+0000","last_change":"2024-04-25T10:06:57.684944+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684944+0000","last_undegraded":"2024-04-25T10:06:57.684944+0000","last_fullsized":"2024-04-25T10:06:57.684944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677731+0000","last_change":"2024-04-25T10:06:57.677731+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677731+0000","last_undegraded":"2024-04-25T10:06:57.677731+0000","last_fullsized":"2024-04-25T10:06:57.677731+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686756+0000","last_change":"2024-04-25T10:06:57.686756+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686756+0000","last_undegraded":"2024-04-25T10:06:57.686756+0000","last_fullsized":"2024-04-25T10:06:57.686756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684716+0000","last_change":"2024-04-25T10:06:57.684716+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684716+0000","last_undegraded":"2024-04-25T10:06:57.684716+0000","last_fullsized":"2024-04-25T10:06:57.684716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.683844+0000","last_change":"2024-04-25T10:06:57.683844+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.683844+0000","last_undegraded":"2024-04-25T10:06:57.683844+0000","last_fullsized":"2024-04-25T10:06:57.683844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684263+0000","last_change":"2024-04-25T10:06:57.684263+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684263+0000","last_undegraded":"2024-04-25T10:06:57.684263+0000","last_fullsized":"2024-04-25T10:06:57.684263+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678552+0000","last_change":"2024-04-25T10:06:57.678552+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678552+0000","last_undegraded":"2024-04-25T10:06:57.678552+0000","last_fullsized":"2024-04-25T10:06:57.678552+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678305+0000","last_change":"2024-04-25T10:06:57.678305+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678305+0000","last_undegraded":"2024-04-25T10:06:57.678305+0000","last_fullsized":"2024-04-25T10:06:57.678305+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684196+0000","last_change":"2024-04-25T10:06:57.684196+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684196+0000","last_undegraded":"2024-04-25T10:06:57.684196+0000","last_fullsized":"2024-04-25T10:06:57.684196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.688161+0000","last_change":"2024-04-25T10:06:57.688161+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.688161+0000","last_undegraded":"2024-04-25T10:06:57.688161+0000","last_fullsized":"2024-04-25T10:06:57.688161+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685492+0000","last_change":"2024-04-25T10:06:57.685492+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685492+0000","last_undegraded":"2024-04-25T10:06:57.685492+0000","last_fullsized":"2024-04-25T10:06:57.685492+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685857+0000","last_change":"2024-04-25T10:06:57.685857+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685857+0000","last_undegraded":"2024-04-25T10:06:57.685857+0000","last_fullsized":"2024-04-25T10:06:57.685857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677293+0000","last_change":"2024-04-25T10:06:57.677293+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677293+0000","last_undegraded":"2024-04-25T10:06:57.677293+0000","last_fullsized":"2024-04-25T10:06:57.677293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686323+0000","last_change":"2024-04-25T10:06:57.686323+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686323+0000","last_undegraded":"2024-04-25T10:06:57.686323+0000","last_fullsized":"2024-04-25T10:06:57.686323+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.684473+0000","last_change":"2024-04-25T10:06:57.684473+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.684473+0000","last_undegraded":"2024-04-25T10:06:57.684473+0000","last_fullsized":"2024-04-25T10:06:57.684473+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.679757+0000","last_change":"2024-04-25T10:06:57.679757+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.679757+0000","last_undegraded":"2024-04-25T10:06:57.679757+0000","last_fullsized":"2024-04-25T10:06:57.679757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676258+0000","last_change":"2024-04-25T10:06:57.676258+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676258+0000","last_undegraded":"2024-04-25T10:06:57.676258+0000","last_fullsized":"2024-04-25T10:06:57.676258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667858+0000","last_change":"2024-04-25T10:06:56.667858+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667858+0000","last_undegraded":"2024-04-25T10:06:56.667858+0000","last_fullsized":"2024-04-25T10:06:56.667858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676821+0000","last_change":"2024-04-25T10:06:57.676821+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676821+0000","last_undegraded":"2024-04-25T10:06:57.676821+0000","last_fullsized":"2024-04-25T10:06:57.676821+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676839+0000","last_change":"2024-04-25T10:06:56.676839+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676839+0000","last_undegraded":"2024-04-25T10:06:56.676839+0000","last_fullsized":"2024-04-25T10:06:56.676839+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.677527+0000","last_change":"2024-04-25T10:06:56.677527+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.677527+0000","last_undegraded":"2024-04-25T10:06:56.677527+0000","last_fullsized":"2024-04-25T10:06:56.677527+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685929+0000","last_change":"2024-04-25T10:06:57.685929+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685929+0000","last_undegraded":"2024-04-25T10:06:57.685929+0000","last_fullsized":"2024-04-25T10:06:57.685929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676848+0000","last_change":"2024-04-25T10:06:56.676848+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676848+0000","last_undegraded":"2024-04-25T10:06:56.676848+0000","last_fullsized":"2024-04-25T10:06:56.676848+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674507+0000","last_change":"2024-04-25T10:06:56.674507+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674507+0000","last_undegraded":"2024-04-25T10:06:56.674507+0000","last_fullsized":"2024-04-25T10:06:56.674507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674998+0000","last_change":"2024-04-25T10:06:56.674998+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674998+0000","last_undegraded":"2024-04-25T10:06:56.674998+0000","last_fullsized":"2024-04-25T10:06:56.674998+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677444+0000","last_change":"2024-04-25T10:06:57.677444+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677444+0000","last_undegraded":"2024-04-25T10:06:57.677444+0000","last_fullsized":"2024-04-25T10:06:57.677444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.675056+0000","last_change":"2024-04-25T10:06:56.675056+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.675056+0000","last_undegraded":"2024-04-25T10:06:56.675056+0000","last_fullsized":"2024-04-25T10:06:56.675056+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.698464+0000","last_change":"2024-04-25T10:06:57.695087+0000","last_active":"2024-04-25T10:06:57.698464+0000","last_peered":"2024-04-25T10:06:57.698464+0000","last_clean":"2024-04-25T10:06:57.698464+0000","last_became_active":"2024-04-25T10:06:57.694780+0000","last_became_peered":"2024-04-25T10:06:57.694780+0000","last_unstale":"2024-04-25T10:06:57.698464+0000","last_undegraded":"2024-04-25T10:06:57.698464+0000","last_fullsized":"2024-04-25T10:06:57.698464+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:09.801885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703456+0000","last_change":"2024-04-25T10:06:57.702505+0000","last_active":"2024-04-25T10:06:57.703456+0000","last_peered":"2024-04-25T10:06:57.703456+0000","last_clean":"2024-04-25T10:06:57.703456+0000","last_became_active":"2024-04-25T10:06:57.702181+0000","last_became_peered":"2024-04-25T10:06:57.702181+0000","last_unstale":"2024-04-25T10:06:57.703456+0000","last_undegraded":"2024-04-25T10:06:57.703456+0000","last_fullsized":"2024-04-25T10:06:57.703456+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:25.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700305+0000","last_change":"2024-04-25T10:06:57.698329+0000","last_active":"2024-04-25T10:06:57.700305+0000","last_peered":"2024-04-25T10:06:57.700305+0000","last_clean":"2024-04-25T10:06:57.700305+0000","last_became_active":"2024-04-25T10:06:57.697990+0000","last_became_peered":"2024-04-25T10:06:57.697990+0000","last_unstale":"2024-04-25T10:06:57.700305+0000","last_undegraded":"2024-04-25T10:06:57.700305+0000","last_fullsized":"2024-04-25T10:06:57.700305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:33.865645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676787+0000","last_change":"2024-04-25T10:06:57.676787+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676787+0000","last_undegraded":"2024-04-25T10:06:57.676787+0000","last_fullsized":"2024-04-25T10:06:57.676787+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703123+0000","last_change":"2024-04-25T10:06:57.701358+0000","last_active":"2024-04-25T10:06:57.703123+0000","last_peered":"2024-04-25T10:06:57.703123+0000","last_clean":"2024-04-25T10:06:57.703123+0000","last_became_active":"2024-04-25T10:06:57.700998+0000","last_became_peered":"2024-04-25T10:06:57.700998+0000","last_unstale":"2024-04-25T10:06:57.703123+0000","last_undegraded":"2024-04-25T10:06:57.703123+0000","last_fullsized":"2024-04-25T10:06:57.703123+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.679106+0000","last_change":"2024-04-25T10:06:57.679106+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.679106+0000","last_undegraded":"2024-04-25T10:06:57.679106+0000","last_fullsized":"2024-04-25T10:06:57.679106+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.668284+0000","last_change":"2024-04-25T10:06:56.668284+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.668284+0000","last_undegraded":"2024-04-25T10:06:56.668284+0000","last_fullsized":"2024-04-25T10:06:56.668284+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676998+0000","last_change":"2024-04-25T10:06:57.676998+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676998+0000","last_undegraded":"2024-04-25T10:06:57.676998+0000","last_fullsized":"2024-04-25T10:06:57.676998+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702553+0000","last_change":"2024-04-25T10:06:57.699763+0000","last_active":"2024-04-25T10:06:57.702553+0000","last_peered":"2024-04-25T10:06:57.702553+0000","last_clean":"2024-04-25T10:06:57.702553+0000","last_became_active":"2024-04-25T10:06:57.699453+0000","last_became_peered":"2024-04-25T10:06:57.699453+0000","last_unstale":"2024-04-25T10:06:57.702553+0000","last_undegraded":"2024-04-25T10:06:57.702553+0000","last_fullsized":"2024-04-25T10:06:57.702553+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.134651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.683545+0000","last_change":"2024-04-25T10:06:57.683545+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.683545+0000","last_undegraded":"2024-04-25T10:06:57.683545+0000","last_fullsized":"2024-04-25T10:06:57.683545+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702326+0000","last_change":"2024-04-25T10:06:57.699687+0000","last_active":"2024-04-25T10:06:57.702326+0000","last_peered":"2024-04-25T10:06:57.702326+0000","last_clean":"2024-04-25T10:06:57.702326+0000","last_became_active":"2024-04-25T10:06:57.699195+0000","last_became_peered":"2024-04-25T10:06:57.699195+0000","last_unstale":"2024-04-25T10:06:57.702326+0000","last_undegraded":"2024-04-25T10:06:57.702326+0000","last_fullsized":"2024-04-25T10:06:57.702326+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.134651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677000+0000","last_change":"2024-04-25T10:06:57.677000+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677000+0000","last_undegraded":"2024-04-25T10:06:57.677000+0000","last_fullsized":"2024-04-25T10:06:57.677000+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702690+0000","last_change":"2024-04-25T10:06:57.699729+0000","last_active":"2024-04-25T10:06:57.702690+0000","last_peered":"2024-04-25T10:06:57.702690+0000","last_clean":"2024-04-25T10:06:57.702690+0000","last_became_active":"2024-04-25T10:06:57.697804+0000","last_became_peered":"2024-04-25T10:06:57.697804+0000","last_unstale":"2024-04-25T10:06:57.702690+0000","last_undegraded":"2024-04-25T10:06:57.702690+0000","last_fullsized":"2024-04-25T10:06:57.702690+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:51.088017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.697487+0000","last_change":"2024-04-25T10:06:57.695831+0000","last_active":"2024-04-25T10:06:57.697487+0000","last_peered":"2024-04-25T10:06:57.697487+0000","last_clean":"2024-04-25T10:06:57.697487+0000","last_became_active":"2024-04-25T10:06:57.694960+0000","last_became_peered":"2024-04-25T10:06:57.694960+0000","last_unstale":"2024-04-25T10:06:57.697487+0000","last_undegraded":"2024-04-25T10:06:57.697487+0000","last_fullsized":"2024-04-25T10:06:57.697487+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:09.801885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.686749+0000","last_change":"2024-04-25T10:06:57.686749+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.686749+0000","last_undegraded":"2024-04-25T10:06:57.686749+0000","last_fullsized":"2024-04-25T10:06:57.686749+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.702736+0000","last_change":"2024-04-25T10:06:57.701226+0000","last_active":"2024-04-25T10:06:57.702736+0000","last_peered":"2024-04-25T10:06:57.702736+0000","last_clean":"2024-04-25T10:06:57.702736+0000","last_became_active":"2024-04-25T10:06:57.700923+0000","last_became_peered":"2024-04-25T10:06:57.700923+0000","last_unstale":"2024-04-25T10:06:57.702736+0000","last_undegraded":"2024-04-25T10:06:57.702736+0000","last_fullsized":"2024-04-25T10:06:57.702736+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676293+0000","last_change":"2024-04-25T10:06:57.676293+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676293+0000","last_undegraded":"2024-04-25T10:06:57.676293+0000","last_fullsized":"2024-04-25T10:06:57.676293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700137+0000","last_change":"2024-04-25T10:06:57.698613+0000","last_active":"2024-04-25T10:06:57.700137+0000","last_peered":"2024-04-25T10:06:57.700137+0000","last_clean":"2024-04-25T10:06:57.700137+0000","last_became_active":"2024-04-25T10:06:57.698073+0000","last_became_peered":"2024-04-25T10:06:57.698073+0000","last_unstale":"2024-04-25T10:06:57.700137+0000","last_undegraded":"2024-04-25T10:06:57.700137+0000","last_fullsized":"2024-04-25T10:06:57.700137+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:17.468580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678108+0000","last_change":"2024-04-25T10:06:57.678108+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678108+0000","last_undegraded":"2024-04-25T10:06:57.678108+0000","last_fullsized":"2024-04-25T10:06:57.678108+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.703141+0000","last_change":"2024-04-25T10:06:57.701710+0000","last_active":"2024-04-25T10:06:57.703141+0000","last_peered":"2024-04-25T10:06:57.703141+0000","last_clean":"2024-04-25T10:06:57.703141+0000","last_became_active":"2024-04-25T10:06:57.701340+0000","last_became_peered":"2024-04-25T10:06:57.701340+0000","last_unstale":"2024-04-25T10:06:57.703141+0000","last_undegraded":"2024-04-25T10:06:57.703141+0000","last_fullsized":"2024-04-25T10:06:57.703141+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:35.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677703+0000","last_change":"2024-04-25T10:06:57.677703+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677703+0000","last_undegraded":"2024-04-25T10:06:57.677703+0000","last_fullsized":"2024-04-25T10:06:57.677703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674568+0000","last_change":"2024-04-25T10:06:56.674568+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674568+0000","last_undegraded":"2024-04-25T10:06:56.674568+0000","last_fullsized":"2024-04-25T10:06:56.674568+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676859+0000","last_change":"2024-04-25T10:06:56.676859+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676859+0000","last_undegraded":"2024-04-25T10:06:56.676859+0000","last_fullsized":"2024-04-25T10:06:56.676859+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.682891+0000","last_change":"2024-04-25T10:06:57.682891+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.682891+0000","last_undegraded":"2024-04-25T10:06:57.682891+0000","last_fullsized":"2024-04-25T10:06:57.682891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.700387+0000","last_change":"2024-04-25T10:06:57.699439+0000","last_active":"2024-04-25T10:06:57.700387+0000","last_peered":"2024-04-25T10:06:57.700387+0000","last_clean":"2024-04-25T10:06:57.700387+0000","last_became_active":"2024-04-25T10:06:57.698847+0000","last_became_peered":"2024-04-25T10:06:57.698847+0000","last_unstale":"2024-04-25T10:06:57.700387+0000","last_undegraded":"2024-04-25T10:06:57.700387+0000","last_fullsized":"2024-04-25T10:06:57.700387+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:51.088017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676229+0000","last_change":"2024-04-25T10:06:57.676229+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676229+0000","last_undegraded":"2024-04-25T10:06:57.676229+0000","last_fullsized":"2024-04-25T10:06:57.676229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.677061+0000","last_change":"2024-04-25T10:06:56.677061+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.677061+0000","last_undegraded":"2024-04-25T10:06:56.677061+0000","last_fullsized":"2024-04-25T10:06:56.677061+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.699832+0000","last_change":"2024-04-25T10:06:57.696956+0000","last_active":"2024-04-25T10:06:57.699832+0000","last_peered":"2024-04-25T10:06:57.699832+0000","last_clean":"2024-04-25T10:06:57.699832+0000","last_became_active":"2024-04-25T10:06:57.696670+0000","last_became_peered":"2024-04-25T10:06:57.696670+0000","last_unstale":"2024-04-25T10:06:57.699832+0000","last_undegraded":"2024-04-25T10:06:57.699832+0000","last_fullsized":"2024-04-25T10:06:57.699832+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:32.702224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.693974+0000","last_change":"2024-04-25T10:06:57.691781+0000","last_active":"2024-04-25T10:06:57.693974+0000","last_peered":"2024-04-25T10:06:57.693974+0000","last_clean":"2024-04-25T10:06:57.693974+0000","last_became_active":"2024-04-25T10:06:57.690812+0000","last_became_peered":"2024-04-25T10:06:57.690812+0000","last_unstale":"2024-04-25T10:06:57.693974+0000","last_undegraded":"2024-04-25T10:06:57.693974+0000","last_fullsized":"2024-04-25T10:06:57.693974+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:17.468580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.685367+0000","last_change":"2024-04-25T10:06:57.685367+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.685367+0000","last_undegraded":"2024-04-25T10:06:57.685367+0000","last_fullsized":"2024-04-25T10:06:57.685367+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.676855+0000","last_change":"2024-04-25T10:06:56.676855+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.676855+0000","last_undegraded":"2024-04-25T10:06:56.676855+0000","last_fullsized":"2024-04-25T10:06:56.676855+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.677248+0000","last_change":"2024-04-25T10:06:57.677248+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.677248+0000","last_undegraded":"2024-04-25T10:06:57.677248+0000","last_fullsized":"2024-04-25T10:06:57.677248+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667858+0000","last_change":"2024-04-25T10:06:56.667858+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667858+0000","last_undegraded":"2024-04-25T10:06:56.667858+0000","last_fullsized":"2024-04-25T10:06:56.667858+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.678200+0000","last_change":"2024-04-25T10:06:57.678200+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.678200+0000","last_undegraded":"2024-04-25T10:06:57.678200+0000","last_fullsized":"2024-04-25T10:06:57.678200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.701738+0000","last_change":"2024-04-25T10:06:57.699267+0000","last_active":"2024-04-25T10:06:57.701738+0000","last_peered":"2024-04-25T10:06:57.701738+0000","last_clean":"2024-04-25T10:06:57.701738+0000","last_became_active":"2024-04-25T10:06:57.698971+0000","last_became_peered":"2024-04-25T10:06:57.698971+0000","last_unstale":"2024-04-25T10:06:57.701738+0000","last_undegraded":"2024-04-25T10:06:57.701738+0000","last_fullsized":"2024-04-25T10:06:57.701738+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:32.702224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676473+0000","last_change":"2024-04-25T10:06:57.676473+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676473+0000","last_undegraded":"2024-04-25T10:06:57.676473+0000","last_fullsized":"2024-04-25T10:06:57.676473+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674461+0000","last_change":"2024-04-25T10:06:56.674461+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674461+0000","last_undegraded":"2024-04-25T10:06:56.674461+0000","last_fullsized":"2024-04-25T10:06:56.674461+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674483+0000","last_change":"2024-04-25T10:06:56.674483+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674483+0000","last_undegraded":"2024-04-25T10:06:56.674483+0000","last_fullsized":"2024-04-25T10:06:56.674483+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:06:57.662849+0000","last_change":"2024-04-25T10:06:57.662849+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.662849+0000","last_undegraded":"2024-04-25T10:06:57.662849+0000","last_fullsized":"2024-04-25T10:06:57.662849+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.667702+0000","last_change":"2024-04-25T10:06:56.667702+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.667702+0000","last_undegraded":"2024-04-25T10:06:56.667702+0000","last_fullsized":"2024-04-25T10:06:56.667702+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":65,"state":"creating+peering","last_fresh":"2024-04-25T10:06:57.676243+0000","last_change":"2024-04-25T10:06:57.676243+0000","last_active":"2024-04-25T10:06:57.662849+0000","last_peered":"2024-04-25T10:06:57.662849+0000","last_clean":"2024-04-25T10:06:57.662849+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:57.676243+0000","last_undegraded":"2024-04-25T10:06:57.676243+0000","last_fullsized":"2024-04-25T10:06:57.676243+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":64,"state":"creating+peering","last_fresh":"2024-04-25T10:06:56.674515+0000","last_change":"2024-04-25T10:06:56.674515+0000","last_active":"2024-04-25T10:06:56.655949+0000","last_peered":"2024-04-25T10:06:56.655949+0000","last_clean":"2024-04-25T10:06:56.655949+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:06:56.674515+0000","last_undegraded":"2024-04-25T10:06:56.674515+0000","last_fullsized":"2024-04-25T10:06:56.674515+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":250,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-04-25T10:06:57.688984+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:06:57.688984+0000","last_peered":"2024-04-25T10:06:57.688984+0000","last_clean":"2024-04-25T10:06:57.688984+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:06:57.688984+0000","last_undegraded":"2024-04-25T10:06:57.688984+0000","last_fullsized":"2024-04-25T10:06:57.688984+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":4},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509483,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32520,"kb_used_data":1340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339320,"statfs":{"total":96636764160,"available":96603463680,"internally_reserved":0,"allocated":1372160,"data_stored":940635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509484,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509482,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":778240,"data_stored":350267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":765952,"data_stored":343608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1347584,"data_stored":927767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:07:03.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:07:03.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.371+0000 7f5983e00640 1 Processor -- start 2024-04-25T10:07:03.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.371+0000 7f5983e00640 1 -- start start 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5983e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 0x7f597c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5983e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f597c06e900 0x7f597c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5983e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f597c15ac60 con 0x7f597c144140 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5983e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c06ed50 con 0x7f597c06e900 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5983e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f597c0cf3e0 con 0x7f597c0cef30 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f597c06e900 0x7f597c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f597c06e900 0x7f597c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45366/0 (socket says 172.21.15.18:45366) 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 -- 172.21.15.18:0/3378785354 learned_addr learned my addr 172.21.15.18:0/3378785354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5980a00640 1 --2- 172.21.15.18:0/3378785354 >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 0x7f597c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 -- 172.21.15.18:0/3378785354 >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 msgr2=0x7f597c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 --2- 172.21.15.18:0/3378785354 >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 0x7f597c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 -- 172.21.15.18:0/3378785354 >> v1:172.21.15.167:6789/0 conn(0x7f597c144140 legacy=0x7f597c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5981e00640 1 -- 172.21.15.18:0/3378785354 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c15af20 con 0x7f597c06e900 2024-04-25T10:07:03.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.375+0000 7f5980a00640 1 --2- 172.21.15.18:0/3378785354 >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 0x7f597c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:03.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5981e00640 1 --2- 172.21.15.18:0/3378785354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c0b0760 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f597c06efb0 tx=0x7f597401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84802e9fe514f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f597be00640 1 -- 172.21.15.18:0/3378785354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740ac070 con 0x7f597c06e900 2024-04-25T10:07:03.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f597be00640 1 -- 172.21.15.18:0/3378785354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59740a8440 con 0x7f597c06e900 2024-04-25T10:07:03.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f597be00640 1 -- 172.21.15.18:0/3378785354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59740a8810 con 0x7f597c06e900 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- 172.21.15.18:0/3378785354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 msgr2=0x7f597c0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- 172.21.15.18:0/3378785354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c0b0760 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f597c06efb0 tx=0x7f597401c9f0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- 172.21.15.18:0/3378785354 shutdown_connections 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- 172.21.15.18:0/3378785354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c0b0760 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- 172.21.15.18:0/3378785354 >> v2:172.21.15.167:3300/0 conn(0x7f597c0cef30 0x7f597c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- 172.21.15.18:0/3378785354 >> 172.21.15.18:0/3378785354 conn(0x7f597c066fa0 msgr2=0x7f597c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- 172.21.15.18:0/3378785354 shutdown_connections 2024-04-25T10:07:03.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- 172.21.15.18:0/3378785354 wait complete. 2024-04-25T10:07:03.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 Processor -- start 2024-04-25T10:07:03.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- start start 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c0cef30 0x7f597c161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c144140 0x7f597c154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c15ba00 con 0x7f597c06e900 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597c144520 con 0x7f597c144140 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.379+0000 7f5983e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f597c15bb80 con 0x7f597c0cef30 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45370/0 (socket says 172.21.15.18:45370) 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5980a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c0cef30 0x7f597c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 -- 172.21.15.18:0/4278188625 learned_addr learned my addr 172.21.15.18:0/4278188625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:03.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c144140 0x7f597c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 -- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c0cef30 msgr2=0x7f597c161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c0cef30 0x7f597c161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 -- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c144140 msgr2=0x7f597c154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c144140 0x7f597c154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 -- 172.21.15.18:0/4278188625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f597c135910 con 0x7f597c06e900 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5981400640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f597000c3a0 tx=0x7f597000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59700052d0 con 0x7f597c06e900 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5970005470 con 0x7f597c06e900 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5970007260 con 0x7f597c06e900 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f597c163390 con 0x7f597c06e900 2024-04-25T10:07:03.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f597c163910 con 0x7f597c06e900 2024-04-25T10:07:03.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597c0745d0 con 0x7f597c06e900 2024-04-25T10:07:03.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.383+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5970007400 con 0x7f597c06e900 2024-04-25T10:07:03.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.387+0000 7f5979600640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 0x7f595c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.387+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59700845b0 con 0x7f597c06e900 2024-04-25T10:07:03.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.387+0000 7f5980a00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 0x7f595c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.387+0000 7f5980a00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 0x7f595c069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f597c141b40 tx=0x7f5968008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.387+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f597c135910 con 0x7f597c06e900 2024-04-25T10:07:03.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.547+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f597c073aa0 con 0x7f595c066f60 2024-04-25T10:07:03.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.555+0000 7f5979600640 1 -- 172.21.15.18:0/4278188625 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252020 (secure 0 0 0) 0x7f597c073aa0 con 0x7f595c066f60 2024-04-25T10:07:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:03.568 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 msgr2=0x7f595c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 0x7f595c069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f597c141b40 tx=0x7f5968008040 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 msgr2=0x7f597c1646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f597000c3a0 tx=0x7f597000c860 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 shutdown_connections 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f597c144140 0x7f597c154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f595c066f60 0x7f595c069420 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f597c0cef30 0x7f597c161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 --2- 172.21.15.18:0/4278188625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f597c06e900 0x7f597c1646d0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 >> 172.21.15.18:0/4278188625 conn(0x7f597c066fa0 msgr2=0x7f597c06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 shutdown_connections 2024-04-25T10:07:03.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.559+0000 7f5983e00640 1 -- 172.21.15.18:0/4278188625 wait complete. 2024-04-25T10:07:03.586 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-25T10:07:03.440667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244472,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730248,"statfs":{"total":773094113280,"available":772843773952,"internally_reserved":0,"allocated":7675904,"data_stored":4098564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965809+0000","last_change":"2024-04-25T10:06:58.705372+0000","last_active":"2024-04-25T10:06:59.965809+0000","last_peered":"2024-04-25T10:06:59.965809+0000","last_clean":"2024-04-25T10:06:59.965809+0000","last_became_active":"2024-04-25T10:06:58.704968+0000","last_became_peered":"2024-04-25T10:06:58.704968+0000","last_unstale":"2024-04-25T10:06:59.965809+0000","last_undegraded":"2024-04-25T10:06:59.965809+0000","last_fullsized":"2024-04-25T10:06:59.965809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965823+0000","last_change":"2024-04-25T10:06:58.696356+0000","last_active":"2024-04-25T10:06:59.965823+0000","last_peered":"2024-04-25T10:06:59.965823+0000","last_clean":"2024-04-25T10:06:59.965823+0000","last_became_active":"2024-04-25T10:06:58.696044+0000","last_became_peered":"2024-04-25T10:06:58.696044+0000","last_unstale":"2024-04-25T10:06:59.965823+0000","last_undegraded":"2024-04-25T10:06:59.965823+0000","last_fullsized":"2024-04-25T10:06:59.965823+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966465+0000","last_change":"2024-04-25T10:06:58.720278+0000","last_active":"2024-04-25T10:06:59.966465+0000","last_peered":"2024-04-25T10:06:59.966465+0000","last_clean":"2024-04-25T10:06:59.966465+0000","last_became_active":"2024-04-25T10:06:58.720003+0000","last_became_peered":"2024-04-25T10:06:58.720003+0000","last_unstale":"2024-04-25T10:06:59.966465+0000","last_undegraded":"2024-04-25T10:06:59.966465+0000","last_fullsized":"2024-04-25T10:06:59.966465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697379+0000","last_change":"2024-04-25T10:06:58.700874+0000","last_active":"2024-04-25T10:06:59.697379+0000","last_peered":"2024-04-25T10:06:59.697379+0000","last_clean":"2024-04-25T10:06:59.697379+0000","last_became_active":"2024-04-25T10:06:58.700259+0000","last_became_peered":"2024-04-25T10:06:58.700259+0000","last_unstale":"2024-04-25T10:06:59.697379+0000","last_undegraded":"2024-04-25T10:06:59.697379+0000","last_fullsized":"2024-04-25T10:06:59.697379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696875+0000","last_change":"2024-04-25T10:06:58.702172+0000","last_active":"2024-04-25T10:06:59.696875+0000","last_peered":"2024-04-25T10:06:59.696875+0000","last_clean":"2024-04-25T10:06:59.696875+0000","last_became_active":"2024-04-25T10:06:58.701887+0000","last_became_peered":"2024-04-25T10:06:58.701887+0000","last_unstale":"2024-04-25T10:06:59.696875+0000","last_undegraded":"2024-04-25T10:06:59.696875+0000","last_fullsized":"2024-04-25T10:06:59.696875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688868+0000","last_change":"2024-04-25T10:06:58.713377+0000","last_active":"2024-04-25T10:06:59.688868+0000","last_peered":"2024-04-25T10:06:59.688868+0000","last_clean":"2024-04-25T10:06:59.688868+0000","last_became_active":"2024-04-25T10:06:58.710148+0000","last_became_peered":"2024-04-25T10:06:58.710148+0000","last_unstale":"2024-04-25T10:06:59.688868+0000","last_undegraded":"2024-04-25T10:06:59.688868+0000","last_fullsized":"2024-04-25T10:06:59.688868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:37.678342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965020+0000","last_change":"2024-04-25T10:06:58.719847+0000","last_active":"2024-04-25T10:06:59.965020+0000","last_peered":"2024-04-25T10:06:59.965020+0000","last_clean":"2024-04-25T10:06:59.965020+0000","last_became_active":"2024-04-25T10:06:58.719376+0000","last_became_peered":"2024-04-25T10:06:58.719376+0000","last_unstale":"2024-04-25T10:06:59.965020+0000","last_undegraded":"2024-04-25T10:06:59.965020+0000","last_fullsized":"2024-04-25T10:06:59.965020+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:07.469291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967270+0000","last_change":"2024-04-25T10:06:58.717916+0000","last_active":"2024-04-25T10:06:59.967270+0000","last_peered":"2024-04-25T10:06:59.967270+0000","last_clean":"2024-04-25T10:06:59.967270+0000","last_became_active":"2024-04-25T10:06:58.717585+0000","last_became_peered":"2024-04-25T10:06:58.717585+0000","last_unstale":"2024-04-25T10:06:59.967270+0000","last_undegraded":"2024-04-25T10:06:59.967270+0000","last_fullsized":"2024-04-25T10:06:59.967270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967324+0000","last_change":"2024-04-25T10:06:58.720739+0000","last_active":"2024-04-25T10:06:59.967324+0000","last_peered":"2024-04-25T10:06:59.967324+0000","last_clean":"2024-04-25T10:06:59.967324+0000","last_became_active":"2024-04-25T10:06:58.720347+0000","last_became_peered":"2024-04-25T10:06:58.720347+0000","last_unstale":"2024-04-25T10:06:59.967324+0000","last_undegraded":"2024-04-25T10:06:59.967324+0000","last_fullsized":"2024-04-25T10:06:59.967324+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:35.495854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966972+0000","last_change":"2024-04-25T10:06:58.718041+0000","last_active":"2024-04-25T10:06:59.966972+0000","last_peered":"2024-04-25T10:06:59.966972+0000","last_clean":"2024-04-25T10:06:59.966972+0000","last_became_active":"2024-04-25T10:06:58.717762+0000","last_became_peered":"2024-04-25T10:06:58.717762+0000","last_unstale":"2024-04-25T10:06:59.966972+0000","last_undegraded":"2024-04-25T10:06:59.966972+0000","last_fullsized":"2024-04-25T10:06:59.966972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697087+0000","last_change":"2024-04-25T10:06:58.695522+0000","last_active":"2024-04-25T10:06:59.697087+0000","last_peered":"2024-04-25T10:06:59.697087+0000","last_clean":"2024-04-25T10:06:59.697087+0000","last_became_active":"2024-04-25T10:06:58.695191+0000","last_became_peered":"2024-04-25T10:06:58.695191+0000","last_unstale":"2024-04-25T10:06:59.697087+0000","last_undegraded":"2024-04-25T10:06:59.697087+0000","last_fullsized":"2024-04-25T10:06:59.697087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966218+0000","last_change":"2024-04-25T10:06:58.717128+0000","last_active":"2024-04-25T10:06:59.966218+0000","last_peered":"2024-04-25T10:06:59.966218+0000","last_clean":"2024-04-25T10:06:59.966218+0000","last_became_active":"2024-04-25T10:06:58.716890+0000","last_became_peered":"2024-04-25T10:06:58.716890+0000","last_unstale":"2024-04-25T10:06:59.966218+0000","last_undegraded":"2024-04-25T10:06:59.966218+0000","last_fullsized":"2024-04-25T10:06:59.966218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966345+0000","last_change":"2024-04-25T10:06:58.707784+0000","last_active":"2024-04-25T10:06:59.966345+0000","last_peered":"2024-04-25T10:06:59.966345+0000","last_clean":"2024-04-25T10:06:59.966345+0000","last_became_active":"2024-04-25T10:06:58.707504+0000","last_became_peered":"2024-04-25T10:06:58.707504+0000","last_unstale":"2024-04-25T10:06:59.966345+0000","last_undegraded":"2024-04-25T10:06:59.966345+0000","last_fullsized":"2024-04-25T10:06:59.966345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966624+0000","last_change":"2024-04-25T10:06:58.720546+0000","last_active":"2024-04-25T10:06:59.966624+0000","last_peered":"2024-04-25T10:06:59.966624+0000","last_clean":"2024-04-25T10:06:59.966624+0000","last_became_active":"2024-04-25T10:06:58.720240+0000","last_became_peered":"2024-04-25T10:06:58.720240+0000","last_unstale":"2024-04-25T10:06:59.966624+0000","last_undegraded":"2024-04-25T10:06:59.966624+0000","last_fullsized":"2024-04-25T10:06:59.966624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966686+0000","last_change":"2024-04-25T10:06:58.718552+0000","last_active":"2024-04-25T10:06:59.966686+0000","last_peered":"2024-04-25T10:06:59.966686+0000","last_clean":"2024-04-25T10:06:59.966686+0000","last_became_active":"2024-04-25T10:06:58.718321+0000","last_became_peered":"2024-04-25T10:06:58.718321+0000","last_unstale":"2024-04-25T10:06:59.966686+0000","last_undegraded":"2024-04-25T10:06:59.966686+0000","last_fullsized":"2024-04-25T10:06:59.966686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965137+0000","last_change":"2024-04-25T10:06:58.709296+0000","last_active":"2024-04-25T10:06:59.965137+0000","last_peered":"2024-04-25T10:06:59.965137+0000","last_clean":"2024-04-25T10:06:59.965137+0000","last_became_active":"2024-04-25T10:06:58.709069+0000","last_became_peered":"2024-04-25T10:06:58.709069+0000","last_unstale":"2024-04-25T10:06:59.965137+0000","last_undegraded":"2024-04-25T10:06:59.965137+0000","last_fullsized":"2024-04-25T10:06:59.965137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:48.467256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965767+0000","last_change":"2024-04-25T10:06:58.695924+0000","last_active":"2024-04-25T10:06:59.965767+0000","last_peered":"2024-04-25T10:06:59.965767+0000","last_clean":"2024-04-25T10:06:59.965767+0000","last_became_active":"2024-04-25T10:06:58.695600+0000","last_became_peered":"2024-04-25T10:06:58.695600+0000","last_unstale":"2024-04-25T10:06:59.965767+0000","last_undegraded":"2024-04-25T10:06:59.965767+0000","last_fullsized":"2024-04-25T10:06:59.965767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.833782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697723+0000","last_change":"2024-04-25T10:06:58.693299+0000","last_active":"2024-04-25T10:06:59.697723+0000","last_peered":"2024-04-25T10:06:59.697723+0000","last_clean":"2024-04-25T10:06:59.697723+0000","last_became_active":"2024-04-25T10:06:58.692997+0000","last_became_peered":"2024-04-25T10:06:58.692997+0000","last_unstale":"2024-04-25T10:06:59.697723+0000","last_undegraded":"2024-04-25T10:06:59.697723+0000","last_fullsized":"2024-04-25T10:06:59.697723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698053+0000","last_change":"2024-04-25T10:06:58.697369+0000","last_active":"2024-04-25T10:06:59.698053+0000","last_peered":"2024-04-25T10:06:59.698053+0000","last_clean":"2024-04-25T10:06:59.698053+0000","last_became_active":"2024-04-25T10:06:58.697095+0000","last_became_peered":"2024-04-25T10:06:58.697095+0000","last_unstale":"2024-04-25T10:06:59.698053+0000","last_undegraded":"2024-04-25T10:06:59.698053+0000","last_fullsized":"2024-04-25T10:06:59.698053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965080+0000","last_change":"2024-04-25T10:06:58.690618+0000","last_active":"2024-04-25T10:06:59.965080+0000","last_peered":"2024-04-25T10:06:59.965080+0000","last_clean":"2024-04-25T10:06:59.965080+0000","last_became_active":"2024-04-25T10:06:58.690358+0000","last_became_peered":"2024-04-25T10:06:58.690358+0000","last_unstale":"2024-04-25T10:06:59.965080+0000","last_undegraded":"2024-04-25T10:06:59.965080+0000","last_fullsized":"2024-04-25T10:06:59.965080+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:00.498296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966539+0000","last_change":"2024-04-25T10:06:58.707064+0000","last_active":"2024-04-25T10:06:59.966539+0000","last_peered":"2024-04-25T10:06:59.966539+0000","last_clean":"2024-04-25T10:06:59.966539+0000","last_became_active":"2024-04-25T10:06:58.706556+0000","last_became_peered":"2024-04-25T10:06:58.706556+0000","last_unstale":"2024-04-25T10:06:59.966539+0000","last_undegraded":"2024-04-25T10:06:59.966539+0000","last_fullsized":"2024-04-25T10:06:59.966539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964447+0000","last_change":"2024-04-25T10:06:58.711407+0000","last_active":"2024-04-25T10:06:59.964447+0000","last_peered":"2024-04-25T10:06:59.964447+0000","last_clean":"2024-04-25T10:06:59.964447+0000","last_became_active":"2024-04-25T10:06:58.711087+0000","last_became_peered":"2024-04-25T10:06:58.711087+0000","last_unstale":"2024-04-25T10:06:59.964447+0000","last_undegraded":"2024-04-25T10:06:59.964447+0000","last_fullsized":"2024-04-25T10:06:59.964447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:33.657603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964419+0000","last_change":"2024-04-25T10:06:58.711445+0000","last_active":"2024-04-25T10:06:59.964419+0000","last_peered":"2024-04-25T10:06:59.964419+0000","last_clean":"2024-04-25T10:06:59.964419+0000","last_became_active":"2024-04-25T10:06:58.711173+0000","last_became_peered":"2024-04-25T10:06:58.711173+0000","last_unstale":"2024-04-25T10:06:59.964419+0000","last_undegraded":"2024-04-25T10:06:59.964419+0000","last_fullsized":"2024-04-25T10:06:59.964419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:04.645548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966448+0000","last_change":"2024-04-25T10:06:58.719459+0000","last_active":"2024-04-25T10:06:59.966448+0000","last_peered":"2024-04-25T10:06:59.966448+0000","last_clean":"2024-04-25T10:06:59.966448+0000","last_became_active":"2024-04-25T10:06:58.719198+0000","last_became_peered":"2024-04-25T10:06:58.719198+0000","last_unstale":"2024-04-25T10:06:59.966448+0000","last_undegraded":"2024-04-25T10:06:59.966448+0000","last_fullsized":"2024-04-25T10:06:59.966448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966486+0000","last_change":"2024-04-25T10:06:58.706847+0000","last_active":"2024-04-25T10:06:59.966486+0000","last_peered":"2024-04-25T10:06:59.966486+0000","last_clean":"2024-04-25T10:06:59.966486+0000","last_became_active":"2024-04-25T10:06:58.706622+0000","last_became_peered":"2024-04-25T10:06:58.706622+0000","last_unstale":"2024-04-25T10:06:59.966486+0000","last_undegraded":"2024-04-25T10:06:59.966486+0000","last_fullsized":"2024-04-25T10:06:59.966486+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966891+0000","last_change":"2024-04-25T10:06:58.704612+0000","last_active":"2024-04-25T10:06:59.966891+0000","last_peered":"2024-04-25T10:06:59.966891+0000","last_clean":"2024-04-25T10:06:59.966891+0000","last_became_active":"2024-04-25T10:06:58.704054+0000","last_became_peered":"2024-04-25T10:06:58.704054+0000","last_unstale":"2024-04-25T10:06:59.966891+0000","last_undegraded":"2024-04-25T10:06:59.966891+0000","last_fullsized":"2024-04-25T10:06:59.966891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697310+0000","last_change":"2024-04-25T10:06:58.698467+0000","last_active":"2024-04-25T10:06:59.697310+0000","last_peered":"2024-04-25T10:06:59.697310+0000","last_clean":"2024-04-25T10:06:59.697310+0000","last_became_active":"2024-04-25T10:06:58.698124+0000","last_became_peered":"2024-04-25T10:06:58.698124+0000","last_unstale":"2024-04-25T10:06:59.697310+0000","last_undegraded":"2024-04-25T10:06:59.697310+0000","last_fullsized":"2024-04-25T10:06:59.697310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965890+0000","last_change":"2024-04-25T10:06:58.690963+0000","last_active":"2024-04-25T10:06:59.965890+0000","last_peered":"2024-04-25T10:06:59.965890+0000","last_clean":"2024-04-25T10:06:59.965890+0000","last_became_active":"2024-04-25T10:06:58.690707+0000","last_became_peered":"2024-04-25T10:06:58.690707+0000","last_unstale":"2024-04-25T10:06:59.965890+0000","last_undegraded":"2024-04-25T10:06:59.965890+0000","last_fullsized":"2024-04-25T10:06:59.965890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966915+0000","last_change":"2024-04-25T10:06:58.721660+0000","last_active":"2024-04-25T10:06:59.966915+0000","last_peered":"2024-04-25T10:06:59.966915+0000","last_clean":"2024-04-25T10:06:59.966915+0000","last_became_active":"2024-04-25T10:06:58.720823+0000","last_became_peered":"2024-04-25T10:06:58.720823+0000","last_unstale":"2024-04-25T10:06:59.966915+0000","last_undegraded":"2024-04-25T10:06:59.966915+0000","last_fullsized":"2024-04-25T10:06:59.966915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967207+0000","last_change":"2024-04-25T10:06:58.718038+0000","last_active":"2024-04-25T10:06:59.967207+0000","last_peered":"2024-04-25T10:06:59.967207+0000","last_clean":"2024-04-25T10:06:59.967207+0000","last_became_active":"2024-04-25T10:06:58.717740+0000","last_became_peered":"2024-04-25T10:06:58.717740+0000","last_unstale":"2024-04-25T10:06:59.967207+0000","last_undegraded":"2024-04-25T10:06:59.967207+0000","last_fullsized":"2024-04-25T10:06:59.967207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696349+0000","last_change":"2024-04-25T10:06:58.692099+0000","last_active":"2024-04-25T10:06:59.696349+0000","last_peered":"2024-04-25T10:06:59.696349+0000","last_clean":"2024-04-25T10:06:59.696349+0000","last_became_active":"2024-04-25T10:06:58.691715+0000","last_became_peered":"2024-04-25T10:06:58.691715+0000","last_unstale":"2024-04-25T10:06:59.696349+0000","last_undegraded":"2024-04-25T10:06:59.696349+0000","last_fullsized":"2024-04-25T10:06:59.696349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:09.378673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688706+0000","last_change":"2024-04-25T10:06:58.690467+0000","last_active":"2024-04-25T10:06:59.688706+0000","last_peered":"2024-04-25T10:06:59.688706+0000","last_clean":"2024-04-25T10:06:59.688706+0000","last_became_active":"2024-04-25T10:06:58.690119+0000","last_became_peered":"2024-04-25T10:06:58.690119+0000","last_unstale":"2024-04-25T10:06:59.688706+0000","last_undegraded":"2024-04-25T10:06:59.688706+0000","last_fullsized":"2024-04-25T10:06:59.688706+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:14.984702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696965+0000","last_change":"2024-04-25T10:06:58.689820+0000","last_active":"2024-04-25T10:06:59.696965+0000","last_peered":"2024-04-25T10:06:59.696965+0000","last_clean":"2024-04-25T10:06:59.696965+0000","last_became_active":"2024-04-25T10:06:58.689376+0000","last_became_peered":"2024-04-25T10:06:58.689376+0000","last_unstale":"2024-04-25T10:06:59.696965+0000","last_undegraded":"2024-04-25T10:06:59.696965+0000","last_fullsized":"2024-04-25T10:06:59.696965+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965824+0000","last_change":"2024-04-25T10:06:57.698629+0000","last_active":"2024-04-25T10:06:59.965824+0000","last_peered":"2024-04-25T10:06:59.965824+0000","last_clean":"2024-04-25T10:06:59.965824+0000","last_became_active":"2024-04-25T10:06:57.698261+0000","last_became_peered":"2024-04-25T10:06:57.698261+0000","last_unstale":"2024-04-25T10:06:59.965824+0000","last_undegraded":"2024-04-25T10:06:59.965824+0000","last_fullsized":"2024-04-25T10:06:59.965824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697713+0000","last_change":"2024-04-25T10:06:58.697286+0000","last_active":"2024-04-25T10:06:59.697713+0000","last_peered":"2024-04-25T10:06:59.697713+0000","last_clean":"2024-04-25T10:06:59.697713+0000","last_became_active":"2024-04-25T10:06:58.697004+0000","last_became_peered":"2024-04-25T10:06:58.697004+0000","last_unstale":"2024-04-25T10:06:59.697713+0000","last_undegraded":"2024-04-25T10:06:59.697713+0000","last_fullsized":"2024-04-25T10:06:59.697713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689203+0000","last_change":"2024-04-25T10:06:57.691190+0000","last_active":"2024-04-25T10:06:59.689203+0000","last_peered":"2024-04-25T10:06:59.689203+0000","last_clean":"2024-04-25T10:06:59.689203+0000","last_became_active":"2024-04-25T10:06:57.690855+0000","last_became_peered":"2024-04-25T10:06:57.690855+0000","last_unstale":"2024-04-25T10:06:59.689203+0000","last_undegraded":"2024-04-25T10:06:59.689203+0000","last_fullsized":"2024-04-25T10:06:59.689203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:25.526631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689206+0000","last_change":"2024-04-25T10:06:58.697310+0000","last_active":"2024-04-25T10:06:59.689206+0000","last_peered":"2024-04-25T10:06:59.689206+0000","last_clean":"2024-04-25T10:06:59.689206+0000","last_became_active":"2024-04-25T10:06:58.696969+0000","last_became_peered":"2024-04-25T10:06:58.696969+0000","last_unstale":"2024-04-25T10:06:59.689206+0000","last_undegraded":"2024-04-25T10:06:59.689206+0000","last_fullsized":"2024-04-25T10:06:59.689206+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:01.976117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689025+0000","last_change":"2024-04-25T10:06:57.689281+0000","last_active":"2024-04-25T10:06:59.689025+0000","last_peered":"2024-04-25T10:06:59.689025+0000","last_clean":"2024-04-25T10:06:59.689025+0000","last_became_active":"2024-04-25T10:06:57.688082+0000","last_became_peered":"2024-04-25T10:06:57.688082+0000","last_unstale":"2024-04-25T10:06:59.689025+0000","last_undegraded":"2024-04-25T10:06:59.689025+0000","last_fullsized":"2024-04-25T10:06:59.689025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:05.576681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967095+0000","last_change":"2024-04-25T10:06:58.720697+0000","last_active":"2024-04-25T10:06:59.967095+0000","last_peered":"2024-04-25T10:06:59.967095+0000","last_clean":"2024-04-25T10:06:59.967095+0000","last_became_active":"2024-04-25T10:06:58.719949+0000","last_became_peered":"2024-04-25T10:06:58.719949+0000","last_unstale":"2024-04-25T10:06:59.967095+0000","last_undegraded":"2024-04-25T10:06:59.967095+0000","last_fullsized":"2024-04-25T10:06:59.967095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688962+0000","last_change":"2024-04-25T10:06:57.696268+0000","last_active":"2024-04-25T10:06:59.688962+0000","last_peered":"2024-04-25T10:06:59.688962+0000","last_clean":"2024-04-25T10:06:59.688962+0000","last_became_active":"2024-04-25T10:06:57.695960+0000","last_became_peered":"2024-04-25T10:06:57.695960+0000","last_unstale":"2024-04-25T10:06:59.688962+0000","last_undegraded":"2024-04-25T10:06:59.688962+0000","last_fullsized":"2024-04-25T10:06:59.688962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:34.488954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965281+0000","last_change":"2024-04-25T10:06:58.694993+0000","last_active":"2024-04-25T10:06:59.965281+0000","last_peered":"2024-04-25T10:06:59.965281+0000","last_clean":"2024-04-25T10:06:59.965281+0000","last_became_active":"2024-04-25T10:06:58.694736+0000","last_became_peered":"2024-04-25T10:06:58.694736+0000","last_unstale":"2024-04-25T10:06:59.965281+0000","last_undegraded":"2024-04-25T10:06:59.965281+0000","last_fullsized":"2024-04-25T10:06:59.965281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:14.586752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964893+0000","last_change":"2024-04-25T10:06:57.682797+0000","last_active":"2024-04-25T10:06:59.964893+0000","last_peered":"2024-04-25T10:06:59.964893+0000","last_clean":"2024-04-25T10:06:59.964893+0000","last_became_active":"2024-04-25T10:06:57.682495+0000","last_became_peered":"2024-04-25T10:06:57.682495+0000","last_unstale":"2024-04-25T10:06:59.964893+0000","last_undegraded":"2024-04-25T10:06:59.964893+0000","last_fullsized":"2024-04-25T10:06:59.964893+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:17.201159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965340+0000","last_change":"2024-04-25T10:06:58.696287+0000","last_active":"2024-04-25T10:06:59.965340+0000","last_peered":"2024-04-25T10:06:59.965340+0000","last_clean":"2024-04-25T10:06:59.965340+0000","last_became_active":"2024-04-25T10:06:58.696017+0000","last_became_peered":"2024-04-25T10:06:58.696017+0000","last_unstale":"2024-04-25T10:06:59.965340+0000","last_undegraded":"2024-04-25T10:06:59.965340+0000","last_fullsized":"2024-04-25T10:06:59.965340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964318+0000","last_change":"2024-04-25T10:06:57.692552+0000","last_active":"2024-04-25T10:06:59.964318+0000","last_peered":"2024-04-25T10:06:59.964318+0000","last_clean":"2024-04-25T10:06:59.964318+0000","last_became_active":"2024-04-25T10:06:57.692263+0000","last_became_peered":"2024-04-25T10:06:57.692263+0000","last_unstale":"2024-04-25T10:06:59.964318+0000","last_undegraded":"2024-04-25T10:06:59.964318+0000","last_fullsized":"2024-04-25T10:06:59.964318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:42.735001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697648+0000","last_change":"2024-04-25T10:06:58.685391+0000","last_active":"2024-04-25T10:06:59.697648+0000","last_peered":"2024-04-25T10:06:59.697648+0000","last_clean":"2024-04-25T10:06:59.697648+0000","last_became_active":"2024-04-25T10:06:58.684828+0000","last_became_peered":"2024-04-25T10:06:58.684828+0000","last_unstale":"2024-04-25T10:06:59.697648+0000","last_undegraded":"2024-04-25T10:06:59.697648+0000","last_fullsized":"2024-04-25T10:06:59.697648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964473+0000","last_change":"2024-04-25T10:06:57.687120+0000","last_active":"2024-04-25T10:06:59.964473+0000","last_peered":"2024-04-25T10:06:59.964473+0000","last_clean":"2024-04-25T10:06:59.964473+0000","last_became_active":"2024-04-25T10:06:57.686825+0000","last_became_peered":"2024-04-25T10:06:57.686825+0000","last_unstale":"2024-04-25T10:06:59.964473+0000","last_undegraded":"2024-04-25T10:06:59.964473+0000","last_fullsized":"2024-04-25T10:06:59.964473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:29.000330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964840+0000","last_change":"2024-04-25T10:06:58.699015+0000","last_active":"2024-04-25T10:06:59.964840+0000","last_peered":"2024-04-25T10:06:59.964840+0000","last_clean":"2024-04-25T10:06:59.964840+0000","last_became_active":"2024-04-25T10:06:58.698743+0000","last_became_peered":"2024-04-25T10:06:58.698743+0000","last_unstale":"2024-04-25T10:06:59.964840+0000","last_undegraded":"2024-04-25T10:06:59.964840+0000","last_fullsized":"2024-04-25T10:06:59.964840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:50.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696354+0000","last_change":"2024-04-25T10:06:57.695087+0000","last_active":"2024-04-25T10:06:59.696354+0000","last_peered":"2024-04-25T10:06:59.696354+0000","last_clean":"2024-04-25T10:06:59.696354+0000","last_became_active":"2024-04-25T10:06:57.694780+0000","last_became_peered":"2024-04-25T10:06:57.694780+0000","last_unstale":"2024-04-25T10:06:59.696354+0000","last_undegraded":"2024-04-25T10:06:59.696354+0000","last_fullsized":"2024-04-25T10:06:59.696354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965632+0000","last_change":"2024-04-25T10:06:58.690284+0000","last_active":"2024-04-25T10:06:59.965632+0000","last_peered":"2024-04-25T10:06:59.965632+0000","last_clean":"2024-04-25T10:06:59.965632+0000","last_became_active":"2024-04-25T10:06:58.689469+0000","last_became_peered":"2024-04-25T10:06:58.689469+0000","last_unstale":"2024-04-25T10:06:59.965632+0000","last_undegraded":"2024-04-25T10:06:59.965632+0000","last_fullsized":"2024-04-25T10:06:59.965632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967269+0000","last_change":"2024-04-25T10:06:57.702505+0000","last_active":"2024-04-25T10:06:59.967269+0000","last_peered":"2024-04-25T10:06:59.967269+0000","last_clean":"2024-04-25T10:06:59.967269+0000","last_became_active":"2024-04-25T10:06:57.702181+0000","last_became_peered":"2024-04-25T10:06:57.702181+0000","last_unstale":"2024-04-25T10:06:59.967269+0000","last_undegraded":"2024-04-25T10:06:59.967269+0000","last_fullsized":"2024-04-25T10:06:59.967269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:22.097393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965289+0000","last_change":"2024-04-25T10:06:58.701710+0000","last_active":"2024-04-25T10:06:59.965289+0000","last_peered":"2024-04-25T10:06:59.965289+0000","last_clean":"2024-04-25T10:06:59.965289+0000","last_became_active":"2024-04-25T10:06:58.701430+0000","last_became_peered":"2024-04-25T10:06:58.701430+0000","last_unstale":"2024-04-25T10:06:59.965289+0000","last_undegraded":"2024-04-25T10:06:59.965289+0000","last_fullsized":"2024-04-25T10:06:59.965289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:22.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697912+0000","last_change":"2024-04-25T10:06:57.698329+0000","last_active":"2024-04-25T10:06:59.697912+0000","last_peered":"2024-04-25T10:06:59.697912+0000","last_clean":"2024-04-25T10:06:59.697912+0000","last_became_active":"2024-04-25T10:06:57.697990+0000","last_became_peered":"2024-04-25T10:06:57.697990+0000","last_unstale":"2024-04-25T10:06:59.697912+0000","last_undegraded":"2024-04-25T10:06:59.697912+0000","last_fullsized":"2024-04-25T10:06:59.697912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697334+0000","last_change":"2024-04-25T10:06:58.698953+0000","last_active":"2024-04-25T10:06:59.697334+0000","last_peered":"2024-04-25T10:06:59.697334+0000","last_clean":"2024-04-25T10:06:59.697334+0000","last_became_active":"2024-04-25T10:06:58.698687+0000","last_became_peered":"2024-04-25T10:06:58.698687+0000","last_unstale":"2024-04-25T10:06:59.697334+0000","last_undegraded":"2024-04-25T10:06:59.697334+0000","last_fullsized":"2024-04-25T10:06:59.697334+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966594+0000","last_change":"2024-04-25T10:06:57.701358+0000","last_active":"2024-04-25T10:06:59.966594+0000","last_peered":"2024-04-25T10:06:59.966594+0000","last_clean":"2024-04-25T10:06:59.966594+0000","last_became_active":"2024-04-25T10:06:57.700998+0000","last_became_peered":"2024-04-25T10:06:57.700998+0000","last_unstale":"2024-04-25T10:06:59.966594+0000","last_undegraded":"2024-04-25T10:06:59.966594+0000","last_fullsized":"2024-04-25T10:06:59.966594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698293+0000","last_change":"2024-04-25T10:06:58.696461+0000","last_active":"2024-04-25T10:06:59.698293+0000","last_peered":"2024-04-25T10:06:59.698293+0000","last_clean":"2024-04-25T10:06:59.698293+0000","last_became_active":"2024-04-25T10:06:58.696183+0000","last_became_peered":"2024-04-25T10:06:58.696183+0000","last_unstale":"2024-04-25T10:06:59.698293+0000","last_undegraded":"2024-04-25T10:06:59.698293+0000","last_fullsized":"2024-04-25T10:06:59.698293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965750+0000","last_change":"2024-04-25T10:06:57.695636+0000","last_active":"2024-04-25T10:06:59.965750+0000","last_peered":"2024-04-25T10:06:59.965750+0000","last_clean":"2024-04-25T10:06:59.965750+0000","last_became_active":"2024-04-25T10:06:57.695251+0000","last_became_peered":"2024-04-25T10:06:57.695251+0000","last_unstale":"2024-04-25T10:06:59.965750+0000","last_undegraded":"2024-04-25T10:06:59.965750+0000","last_fullsized":"2024-04-25T10:06:59.965750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:35.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696578+0000","last_change":"2024-04-25T10:06:58.712359+0000","last_active":"2024-04-25T10:06:59.696578+0000","last_peered":"2024-04-25T10:06:59.696578+0000","last_clean":"2024-04-25T10:06:59.696578+0000","last_became_active":"2024-04-25T10:06:58.712062+0000","last_became_peered":"2024-04-25T10:06:58.712062+0000","last_unstale":"2024-04-25T10:06:59.696578+0000","last_undegraded":"2024-04-25T10:06:59.696578+0000","last_fullsized":"2024-04-25T10:06:59.696578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966938+0000","last_change":"2024-04-25T10:06:57.699763+0000","last_active":"2024-04-25T10:06:59.966938+0000","last_peered":"2024-04-25T10:06:59.966938+0000","last_clean":"2024-04-25T10:06:59.966938+0000","last_became_active":"2024-04-25T10:06:57.699453+0000","last_became_peered":"2024-04-25T10:06:57.699453+0000","last_unstale":"2024-04-25T10:06:59.966938+0000","last_undegraded":"2024-04-25T10:06:59.966938+0000","last_fullsized":"2024-04-25T10:06:59.966938+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:37.795052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966159+0000","last_change":"2024-04-25T10:06:58.707487+0000","last_active":"2024-04-25T10:06:59.966159+0000","last_peered":"2024-04-25T10:06:59.966159+0000","last_clean":"2024-04-25T10:06:59.966159+0000","last_became_active":"2024-04-25T10:06:58.706159+0000","last_became_peered":"2024-04-25T10:06:58.706159+0000","last_unstale":"2024-04-25T10:06:59.966159+0000","last_undegraded":"2024-04-25T10:06:59.966159+0000","last_fullsized":"2024-04-25T10:06:59.966159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967305+0000","last_change":"2024-04-25T10:06:57.699687+0000","last_active":"2024-04-25T10:06:59.967305+0000","last_peered":"2024-04-25T10:06:59.967305+0000","last_clean":"2024-04-25T10:06:59.967305+0000","last_became_active":"2024-04-25T10:06:57.699195+0000","last_became_peered":"2024-04-25T10:06:57.699195+0000","last_unstale":"2024-04-25T10:06:59.967305+0000","last_undegraded":"2024-04-25T10:06:59.967305+0000","last_fullsized":"2024-04-25T10:06:59.967305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697852+0000","last_change":"2024-04-25T10:06:58.689239+0000","last_active":"2024-04-25T10:06:59.697852+0000","last_peered":"2024-04-25T10:06:59.697852+0000","last_clean":"2024-04-25T10:06:59.697852+0000","last_became_active":"2024-04-25T10:06:58.688969+0000","last_became_peered":"2024-04-25T10:06:58.688969+0000","last_unstale":"2024-04-25T10:06:59.697852+0000","last_undegraded":"2024-04-25T10:06:59.697852+0000","last_fullsized":"2024-04-25T10:06:59.697852+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966797+0000","last_change":"2024-04-25T10:06:57.699729+0000","last_active":"2024-04-25T10:06:59.966797+0000","last_peered":"2024-04-25T10:06:59.966797+0000","last_clean":"2024-04-25T10:06:59.966797+0000","last_became_active":"2024-04-25T10:06:57.697804+0000","last_became_peered":"2024-04-25T10:06:57.697804+0000","last_unstale":"2024-04-25T10:06:59.966797+0000","last_undegraded":"2024-04-25T10:06:59.966797+0000","last_fullsized":"2024-04-25T10:06:59.966797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965540+0000","last_change":"2024-04-25T10:06:58.713114+0000","last_active":"2024-04-25T10:06:59.965540+0000","last_peered":"2024-04-25T10:06:59.965540+0000","last_clean":"2024-04-25T10:06:59.965540+0000","last_became_active":"2024-04-25T10:06:58.712830+0000","last_became_peered":"2024-04-25T10:06:58.712830+0000","last_unstale":"2024-04-25T10:06:59.965540+0000","last_undegraded":"2024-04-25T10:06:59.965540+0000","last_fullsized":"2024-04-25T10:06:59.965540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696296+0000","last_change":"2024-04-25T10:06:57.695831+0000","last_active":"2024-04-25T10:06:59.696296+0000","last_peered":"2024-04-25T10:06:59.696296+0000","last_clean":"2024-04-25T10:06:59.696296+0000","last_became_active":"2024-04-25T10:06:57.694960+0000","last_became_peered":"2024-04-25T10:06:57.694960+0000","last_unstale":"2024-04-25T10:06:59.696296+0000","last_undegraded":"2024-04-25T10:06:59.696296+0000","last_fullsized":"2024-04-25T10:06:59.696296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:23.245743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967097+0000","last_change":"2024-04-25T10:06:58.721709+0000","last_active":"2024-04-25T10:06:59.967097+0000","last_peered":"2024-04-25T10:06:59.967097+0000","last_clean":"2024-04-25T10:06:59.967097+0000","last_became_active":"2024-04-25T10:06:58.720942+0000","last_became_peered":"2024-04-25T10:06:58.720942+0000","last_unstale":"2024-04-25T10:06:59.967097+0000","last_undegraded":"2024-04-25T10:06:59.967097+0000","last_fullsized":"2024-04-25T10:06:59.967097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966592+0000","last_change":"2024-04-25T10:06:57.701226+0000","last_active":"2024-04-25T10:06:59.966592+0000","last_peered":"2024-04-25T10:06:59.966592+0000","last_clean":"2024-04-25T10:06:59.966592+0000","last_became_active":"2024-04-25T10:06:57.700923+0000","last_became_peered":"2024-04-25T10:06:57.700923+0000","last_unstale":"2024-04-25T10:06:59.966592+0000","last_undegraded":"2024-04-25T10:06:59.966592+0000","last_fullsized":"2024-04-25T10:06:59.966592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698092+0000","last_change":"2024-04-25T10:06:58.698155+0000","last_active":"2024-04-25T10:06:59.698092+0000","last_peered":"2024-04-25T10:06:59.698092+0000","last_clean":"2024-04-25T10:06:59.698092+0000","last_became_active":"2024-04-25T10:06:58.697758+0000","last_became_peered":"2024-04-25T10:06:58.697758+0000","last_unstale":"2024-04-25T10:06:59.698092+0000","last_undegraded":"2024-04-25T10:06:59.698092+0000","last_fullsized":"2024-04-25T10:06:59.698092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967177+0000","last_change":"2024-04-25T10:06:57.698613+0000","last_active":"2024-04-25T10:06:59.967177+0000","last_peered":"2024-04-25T10:06:59.967177+0000","last_clean":"2024-04-25T10:06:59.967177+0000","last_became_active":"2024-04-25T10:06:57.698073+0000","last_became_peered":"2024-04-25T10:06:57.698073+0000","last_unstale":"2024-04-25T10:06:59.967177+0000","last_undegraded":"2024-04-25T10:06:59.967177+0000","last_fullsized":"2024-04-25T10:06:59.967177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697932+0000","last_change":"2024-04-25T10:06:58.698012+0000","last_active":"2024-04-25T10:06:59.697932+0000","last_peered":"2024-04-25T10:06:59.697932+0000","last_clean":"2024-04-25T10:06:59.697932+0000","last_became_active":"2024-04-25T10:06:58.697512+0000","last_became_peered":"2024-04-25T10:06:58.697512+0000","last_unstale":"2024-04-25T10:06:59.697932+0000","last_undegraded":"2024-04-25T10:06:59.697932+0000","last_fullsized":"2024-04-25T10:06:59.697932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966715+0000","last_change":"2024-04-25T10:06:57.701710+0000","last_active":"2024-04-25T10:06:59.966715+0000","last_peered":"2024-04-25T10:06:59.966715+0000","last_clean":"2024-04-25T10:06:59.966715+0000","last_became_active":"2024-04-25T10:06:57.701340+0000","last_became_peered":"2024-04-25T10:06:57.701340+0000","last_unstale":"2024-04-25T10:06:59.966715+0000","last_undegraded":"2024-04-25T10:06:59.966715+0000","last_fullsized":"2024-04-25T10:06:59.966715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697192+0000","last_change":"2024-04-25T10:06:58.700861+0000","last_active":"2024-04-25T10:06:59.697192+0000","last_peered":"2024-04-25T10:06:59.697192+0000","last_clean":"2024-04-25T10:06:59.697192+0000","last_became_active":"2024-04-25T10:06:58.700159+0000","last_became_peered":"2024-04-25T10:06:58.700159+0000","last_unstale":"2024-04-25T10:06:59.697192+0000","last_undegraded":"2024-04-25T10:06:59.697192+0000","last_fullsized":"2024-04-25T10:06:59.697192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964701+0000","last_change":"2024-04-25T10:06:57.686262+0000","last_active":"2024-04-25T10:06:59.964701+0000","last_peered":"2024-04-25T10:06:59.964701+0000","last_clean":"2024-04-25T10:06:59.964701+0000","last_became_active":"2024-04-25T10:06:57.685887+0000","last_became_peered":"2024-04-25T10:06:57.685887+0000","last_unstale":"2024-04-25T10:06:59.964701+0000","last_undegraded":"2024-04-25T10:06:59.964701+0000","last_fullsized":"2024-04-25T10:06:59.964701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:05.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688713+0000","last_change":"2024-04-25T10:06:58.688181+0000","last_active":"2024-04-25T10:06:59.688713+0000","last_peered":"2024-04-25T10:06:59.688713+0000","last_clean":"2024-04-25T10:06:59.688713+0000","last_became_active":"2024-04-25T10:06:58.687826+0000","last_became_peered":"2024-04-25T10:06:58.687826+0000","last_unstale":"2024-04-25T10:06:59.688713+0000","last_undegraded":"2024-04-25T10:06:59.688713+0000","last_fullsized":"2024-04-25T10:06:59.688713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:49.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688687+0000","last_change":"2024-04-25T10:06:57.687256+0000","last_active":"2024-04-25T10:06:59.688687+0000","last_peered":"2024-04-25T10:06:59.688687+0000","last_clean":"2024-04-25T10:06:59.688687+0000","last_became_active":"2024-04-25T10:06:57.686955+0000","last_became_peered":"2024-04-25T10:06:57.686955+0000","last_unstale":"2024-04-25T10:06:59.688687+0000","last_undegraded":"2024-04-25T10:06:59.688687+0000","last_fullsized":"2024-04-25T10:06:59.688687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.068517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966655+0000","last_change":"2024-04-25T10:06:58.698543+0000","last_active":"2024-04-25T10:06:59.966655+0000","last_peered":"2024-04-25T10:06:59.966655+0000","last_clean":"2024-04-25T10:06:59.966655+0000","last_became_active":"2024-04-25T10:06:58.698269+0000","last_became_peered":"2024-04-25T10:06:58.698269+0000","last_unstale":"2024-04-25T10:06:59.966655+0000","last_undegraded":"2024-04-25T10:06:59.966655+0000","last_fullsized":"2024-04-25T10:06:59.966655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967356+0000","last_change":"2024-04-25T10:06:57.699439+0000","last_active":"2024-04-25T10:06:59.967356+0000","last_peered":"2024-04-25T10:06:59.967356+0000","last_clean":"2024-04-25T10:06:59.967356+0000","last_became_active":"2024-04-25T10:06:57.698847+0000","last_became_peered":"2024-04-25T10:06:57.698847+0000","last_unstale":"2024-04-25T10:06:59.967356+0000","last_undegraded":"2024-04-25T10:06:59.967356+0000","last_fullsized":"2024-04-25T10:06:59.967356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698010+0000","last_change":"2024-04-25T10:06:58.685134+0000","last_active":"2024-04-25T10:06:59.698010+0000","last_peered":"2024-04-25T10:06:59.698010+0000","last_clean":"2024-04-25T10:06:59.698010+0000","last_became_active":"2024-04-25T10:06:58.684392+0000","last_became_peered":"2024-04-25T10:06:58.684392+0000","last_unstale":"2024-04-25T10:06:59.698010+0000","last_undegraded":"2024-04-25T10:06:59.698010+0000","last_fullsized":"2024-04-25T10:06:59.698010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688796+0000","last_change":"2024-04-25T10:06:57.690397+0000","last_active":"2024-04-25T10:06:59.688796+0000","last_peered":"2024-04-25T10:06:59.688796+0000","last_clean":"2024-04-25T10:06:59.688796+0000","last_became_active":"2024-04-25T10:06:57.690018+0000","last_became_peered":"2024-04-25T10:06:57.690018+0000","last_unstale":"2024-04-25T10:06:59.688796+0000","last_undegraded":"2024-04-25T10:06:59.688796+0000","last_fullsized":"2024-04-25T10:06:59.688796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:40.284763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688987+0000","last_change":"2024-04-25T10:06:58.693304+0000","last_active":"2024-04-25T10:06:59.688987+0000","last_peered":"2024-04-25T10:06:59.688987+0000","last_clean":"2024-04-25T10:06:59.688987+0000","last_became_active":"2024-04-25T10:06:58.692927+0000","last_became_peered":"2024-04-25T10:06:58.692927+0000","last_unstale":"2024-04-25T10:06:59.688987+0000","last_undegraded":"2024-04-25T10:06:59.688987+0000","last_fullsized":"2024-04-25T10:06:59.688987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:53.579162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966781+0000","last_change":"2024-04-25T10:06:57.696956+0000","last_active":"2024-04-25T10:06:59.966781+0000","last_peered":"2024-04-25T10:06:59.966781+0000","last_clean":"2024-04-25T10:06:59.966781+0000","last_became_active":"2024-04-25T10:06:57.696670+0000","last_became_peered":"2024-04-25T10:06:57.696670+0000","last_unstale":"2024-04-25T10:06:59.966781+0000","last_undegraded":"2024-04-25T10:06:59.966781+0000","last_fullsized":"2024-04-25T10:06:59.966781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965607+0000","last_change":"2024-04-25T10:06:58.698761+0000","last_active":"2024-04-25T10:06:59.965607+0000","last_peered":"2024-04-25T10:06:59.965607+0000","last_clean":"2024-04-25T10:06:59.965607+0000","last_became_active":"2024-04-25T10:06:58.698485+0000","last_became_peered":"2024-04-25T10:06:58.698485+0000","last_unstale":"2024-04-25T10:06:59.965607+0000","last_undegraded":"2024-04-25T10:06:59.965607+0000","last_fullsized":"2024-04-25T10:06:59.965607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:47.328920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967246+0000","last_change":"2024-04-25T10:06:57.691781+0000","last_active":"2024-04-25T10:06:59.967246+0000","last_peered":"2024-04-25T10:06:59.967246+0000","last_clean":"2024-04-25T10:06:59.967246+0000","last_became_active":"2024-04-25T10:06:57.690812+0000","last_became_peered":"2024-04-25T10:06:57.690812+0000","last_unstale":"2024-04-25T10:06:59.967246+0000","last_undegraded":"2024-04-25T10:06:59.967246+0000","last_fullsized":"2024-04-25T10:06:59.967246+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967038+0000","last_change":"2024-04-25T10:06:58.708252+0000","last_active":"2024-04-25T10:06:59.967038+0000","last_peered":"2024-04-25T10:06:59.967038+0000","last_clean":"2024-04-25T10:06:59.967038+0000","last_became_active":"2024-04-25T10:06:58.707939+0000","last_became_peered":"2024-04-25T10:06:58.707939+0000","last_unstale":"2024-04-25T10:06:59.967038+0000","last_undegraded":"2024-04-25T10:06:59.967038+0000","last_fullsized":"2024-04-25T10:06:59.967038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689071+0000","last_change":"2024-04-25T10:06:57.688349+0000","last_active":"2024-04-25T10:06:59.689071+0000","last_peered":"2024-04-25T10:06:59.689071+0000","last_clean":"2024-04-25T10:06:59.689071+0000","last_became_active":"2024-04-25T10:06:57.688060+0000","last_became_peered":"2024-04-25T10:06:57.688060+0000","last_unstale":"2024-04-25T10:06:59.689071+0000","last_undegraded":"2024-04-25T10:06:59.689071+0000","last_fullsized":"2024-04-25T10:06:59.689071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:13.676304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697349+0000","last_change":"2024-04-25T10:06:58.701071+0000","last_active":"2024-04-25T10:06:59.697349+0000","last_peered":"2024-04-25T10:06:59.697349+0000","last_clean":"2024-04-25T10:06:59.697349+0000","last_became_active":"2024-04-25T10:06:58.700600+0000","last_became_peered":"2024-04-25T10:06:58.700600+0000","last_unstale":"2024-04-25T10:06:59.697349+0000","last_undegraded":"2024-04-25T10:06:59.697349+0000","last_fullsized":"2024-04-25T10:06:59.697349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965841+0000","last_change":"2024-04-25T10:06:57.695574+0000","last_active":"2024-04-25T10:06:59.965841+0000","last_peered":"2024-04-25T10:06:59.965841+0000","last_clean":"2024-04-25T10:06:59.965841+0000","last_became_active":"2024-04-25T10:06:57.694766+0000","last_became_peered":"2024-04-25T10:06:57.694766+0000","last_unstale":"2024-04-25T10:06:59.965841+0000","last_undegraded":"2024-04-25T10:06:59.965841+0000","last_fullsized":"2024-04-25T10:06:59.965841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:25.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696682+0000","last_change":"2024-04-25T10:06:58.690072+0000","last_active":"2024-04-25T10:06:59.696682+0000","last_peered":"2024-04-25T10:06:59.696682+0000","last_clean":"2024-04-25T10:06:59.696682+0000","last_became_active":"2024-04-25T10:06:58.689759+0000","last_became_peered":"2024-04-25T10:06:58.689759+0000","last_unstale":"2024-04-25T10:06:59.696682+0000","last_undegraded":"2024-04-25T10:06:59.696682+0000","last_fullsized":"2024-04-25T10:06:59.696682+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967052+0000","last_change":"2024-04-25T10:06:57.699267+0000","last_active":"2024-04-25T10:06:59.967052+0000","last_peered":"2024-04-25T10:06:59.967052+0000","last_clean":"2024-04-25T10:06:59.967052+0000","last_became_active":"2024-04-25T10:06:57.698971+0000","last_became_peered":"2024-04-25T10:06:57.698971+0000","last_unstale":"2024-04-25T10:06:59.967052+0000","last_undegraded":"2024-04-25T10:06:59.967052+0000","last_fullsized":"2024-04-25T10:06:59.967052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696644+0000","last_change":"2024-04-25T10:06:58.716464+0000","last_active":"2024-04-25T10:06:59.696644+0000","last_peered":"2024-04-25T10:06:59.696644+0000","last_clean":"2024-04-25T10:06:59.696644+0000","last_became_active":"2024-04-25T10:06:58.716201+0000","last_became_peered":"2024-04-25T10:06:58.716201+0000","last_unstale":"2024-04-25T10:06:59.696644+0000","last_undegraded":"2024-04-25T10:06:59.696644+0000","last_fullsized":"2024-04-25T10:06:59.696644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964501+0000","last_change":"2024-04-25T10:06:57.695875+0000","last_active":"2024-04-25T10:06:59.964501+0000","last_peered":"2024-04-25T10:06:59.964501+0000","last_clean":"2024-04-25T10:06:59.964501+0000","last_became_active":"2024-04-25T10:06:57.695300+0000","last_became_peered":"2024-04-25T10:06:57.695300+0000","last_unstale":"2024-04-25T10:06:59.964501+0000","last_undegraded":"2024-04-25T10:06:59.964501+0000","last_fullsized":"2024-04-25T10:06:59.964501+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:12.751178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965349+0000","last_change":"2024-04-25T10:06:58.700662+0000","last_active":"2024-04-25T10:06:59.965349+0000","last_peered":"2024-04-25T10:06:59.965349+0000","last_clean":"2024-04-25T10:06:59.965349+0000","last_became_active":"2024-04-25T10:06:58.700339+0000","last_became_peered":"2024-04-25T10:06:58.700339+0000","last_unstale":"2024-04-25T10:06:59.965349+0000","last_undegraded":"2024-04-25T10:06:59.965349+0000","last_fullsized":"2024-04-25T10:06:59.965349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964573+0000","last_change":"2024-04-25T10:06:57.683425+0000","last_active":"2024-04-25T10:06:59.964573+0000","last_peered":"2024-04-25T10:06:59.964573+0000","last_clean":"2024-04-25T10:06:59.964573+0000","last_became_active":"2024-04-25T10:06:57.683160+0000","last_became_peered":"2024-04-25T10:06:57.683160+0000","last_unstale":"2024-04-25T10:06:59.964573+0000","last_undegraded":"2024-04-25T10:06:59.964573+0000","last_fullsized":"2024-04-25T10:06:59.964573+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:30.076875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965117+0000","last_change":"2024-04-25T10:06:58.704305+0000","last_active":"2024-04-25T10:06:59.965117+0000","last_peered":"2024-04-25T10:06:59.965117+0000","last_clean":"2024-04-25T10:06:59.965117+0000","last_became_active":"2024-04-25T10:06:58.703953+0000","last_became_peered":"2024-04-25T10:06:58.703953+0000","last_unstale":"2024-04-25T10:06:59.965117+0000","last_undegraded":"2024-04-25T10:06:59.965117+0000","last_fullsized":"2024-04-25T10:06:59.965117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:44.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965096+0000","last_change":"2024-04-25T10:06:57.691893+0000","last_active":"2024-04-25T10:06:59.965096+0000","last_peered":"2024-04-25T10:06:59.965096+0000","last_clean":"2024-04-25T10:06:59.965096+0000","last_became_active":"2024-04-25T10:06:57.691599+0000","last_became_peered":"2024-04-25T10:06:57.691599+0000","last_unstale":"2024-04-25T10:06:59.965096+0000","last_undegraded":"2024-04-25T10:06:59.965096+0000","last_fullsized":"2024-04-25T10:06:59.965096+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697038+0000","last_change":"2024-04-25T10:06:58.702014+0000","last_active":"2024-04-25T10:06:59.697038+0000","last_peered":"2024-04-25T10:06:59.697038+0000","last_clean":"2024-04-25T10:06:59.697038+0000","last_became_active":"2024-04-25T10:06:58.701696+0000","last_became_peered":"2024-04-25T10:06:58.701696+0000","last_unstale":"2024-04-25T10:06:59.697038+0000","last_undegraded":"2024-04-25T10:06:59.697038+0000","last_fullsized":"2024-04-25T10:06:59.697038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964267+0000","last_change":"2024-04-25T10:06:57.685927+0000","last_active":"2024-04-25T10:06:59.964267+0000","last_peered":"2024-04-25T10:06:59.964267+0000","last_clean":"2024-04-25T10:06:59.964267+0000","last_became_active":"2024-04-25T10:06:57.685624+0000","last_became_peered":"2024-04-25T10:06:57.685624+0000","last_unstale":"2024-04-25T10:06:59.964267+0000","last_undegraded":"2024-04-25T10:06:59.964267+0000","last_fullsized":"2024-04-25T10:06:59.964267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:27.308952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966717+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:06:59.966717+0000","last_peered":"2024-04-25T10:06:59.966717+0000","last_clean":"2024-04-25T10:06:59.966717+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:06:59.966717+0000","last_undegraded":"2024-04-25T10:06:59.966717+0000","last_fullsized":"2024-04-25T10:06:59.966717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":955270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":365738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":366502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":954494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:07:03.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:07:03.644 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T10:07:03.636+0000 7f0428800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:07:03.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.759+0000 7f40cfe00640 1 Processor -- start 2024-04-25T10:07:03.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.759+0000 7f40cfe00640 1 -- start start 2024-04-25T10:07:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40d015b710 0x7f40d0071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00cce20 0x7f40d015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cfe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d006e030 con 0x7f40d00719c0 2024-04-25T10:07:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cfe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d0071e20 con 0x7f40d015b710 2024-04-25T10:07:03.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cfe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006e310 con 0x7f40d00cce20 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40d015b710 0x7f40d0071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f40d015b710 0x7f40d0071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45376/0 (socket says 172.21.15.18:45376) 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 -- 172.21.15.18:0/3479168373 learned_addr learned my addr 172.21.15.18:0/3479168373 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40c7e00640 1 --1- 172.21.15.18:0/3479168373 >> v1:172.21.15.167:6789/0 conn(0x7f40d00719c0 0x7f40d00cc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:38978/0 (socket says 172.21.15.18:38978) 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cf400640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00cce20 0x7f40d015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 -- 172.21.15.18:0/3479168373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00cce20 msgr2=0x7f40d015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00cce20 0x7f40d015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 -- 172.21.15.18:0/3479168373 >> v1:172.21.15.167:6789/0 conn(0x7f40d00719c0 legacy=0x7f40d00cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 -- 172.21.15.18:0/3479168373 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d006e5f0 con 0x7f40d015b710 2024-04-25T10:07:03.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.763+0000 7f40cea00640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0071480 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009870 tx=0x7f40c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b77022e56b1ab4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40ce000640 1 -- 172.21.15.18:0/3479168373 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00b1070 con 0x7f40d015b710 2024-04-25T10:07:03.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40ce000640 1 -- 172.21.15.18:0/3479168373 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00ac620 con 0x7f40d015b710 2024-04-25T10:07:03.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40ce000640 1 -- 172.21.15.18:0/3479168373 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00ac9f0 con 0x7f40d015b710 2024-04-25T10:07:03.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- 172.21.15.18:0/3479168373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 msgr2=0x7f40d0071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0071480 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009870 tx=0x7f40c001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- 172.21.15.18:0/3479168373 shutdown_connections 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00cce20 0x7f40d015baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- 172.21.15.18:0/3479168373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0071480 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- 172.21.15.18:0/3479168373 >> 172.21.15.18:0/3479168373 conn(0x7f40d00cfdc0 msgr2=0x7f40d00b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- 172.21.15.18:0/3479168373 shutdown_connections 2024-04-25T10:07:03.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- 172.21.15.18:0/3479168373 wait complete. 2024-04-25T10:07:03.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 Processor -- start 2024-04-25T10:07:03.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- start start 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00719c0 0x7f40d0143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00cce20 0x7f40d0150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015c840 con 0x7f40d015b710 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d006f320 con 0x7f40d00cce20 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cfe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015c9c0 con 0x7f40d00719c0 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45378/0 (socket says 172.21.15.18:45378) 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cf400640 1 -- 172.21.15.18:0/921298959 learned_addr learned my addr 172.21.15.18:0/921298959 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:03.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40c7e00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00cce20 0x7f40d0150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.767+0000 7f40cea00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00719c0 0x7f40d0143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 -- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00719c0 msgr2=0x7f40d0143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00719c0 0x7f40d0143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 -- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00cce20 msgr2=0x7f40d0150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00cce20 0x7f40d0150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 -- 172.21.15.18:0/921298959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d01438d0 con 0x7f40d015b710 2024-04-25T10:07:03.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cf400640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f40c800efc0 tx=0x7f40c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8018020 con 0x7f40d015b710 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8014480 con 0x7f40d015b710 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8014870 con 0x7f40d015b710 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d00afea0 con 0x7f40d015b710 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d00b0460 con 0x7f40d015b710 2024-04-25T10:07:03.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d004efa0 con 0x7f40d015b710 2024-04-25T10:07:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40c801b020 con 0x7f40d015b710 2024-04-25T10:07:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 0x7f40ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:03.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.771+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f40c8085e10 con 0x7f40d015b710 2024-04-25T10:07:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.775+0000 7f40cea00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 0x7f40ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:03.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.775+0000 7f40cea00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 0x7f40ac069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40c00ae000 tx=0x7f40c00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:03.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.775+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f40c8089030 con 0x7f40d015b710 2024-04-25T10:07:04.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.995+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f40d0158290 con 0x7f40d015b710 2024-04-25T10:07:04.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.995+0000 7f40c6a00640 1 -- 172.21.15.18:0/921298959 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f40c8022030 con 0x7f40d015b710 2024-04-25T10:07:04.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:04.005 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":212,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":67,"num_osds":8,"num_up_osds":8,"osd_up_since":1714039422,"num_in_osds":8,"osd_in_since":1714039413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":250339328,"bytes_avail":772843773952,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":36,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":35462}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2024-04-25T10:06:47.437526+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T10:07:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 msgr2=0x7f40ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 0x7f40ac069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40c00ae000 tx=0x7f40c00a7000 comp rx=0 tx=0).stop 2024-04-25T10:07:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 msgr2=0x7f40d0151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f40c800efc0 tx=0x7f40c800c490 comp rx=0 tx=0).stop 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 shutdown_connections 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40d015b710 0x7f40d0151370 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40d00cce20 0x7f40d0150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40ac066f60 0x7f40ac069420 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 --2- 172.21.15.18:0/921298959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f40d00719c0 0x7f40d0143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 >> 172.21.15.18:0/921298959 conn(0x7f40d00cfdc0 msgr2=0x7f40d00b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 shutdown_connections 2024-04-25T10:07:04.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:03.999+0000 7f40cfe00640 1 -- 172.21.15.18:0/921298959 wait complete. 2024-04-25T10:07:04.026 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:07:04.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:07:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 Processor -- start 2024-04-25T10:07:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 -- start start 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d3415fe50 0x7f4d340b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340b20a0 con 0x7f4d34145270 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d340cc4e0 con 0x7f4d340b1c90 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d3a000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d34145650 con 0x7f4d3415fe50 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d2aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d3415fe50 0x7f4d340b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d33400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4d34145270 0x7f4d340cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59490/0 (socket says 172.21.15.18:59490) 2024-04-25T10:07:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d33400640 1 -- 172.21.15.18:0/3379080436 learned_addr learned my addr 172.21.15.18:0/3379080436 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d2aa00640 1 -- 172.21.15.18:0/3379080436 >> v1:172.21.15.167:6789/0 conn(0x7f4d340b1c90 legacy=0x7f4d3415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d2aa00640 1 -- 172.21.15.18:0/3379080436 >> v1:172.21.15.18:6789/0 conn(0x7f4d34145270 legacy=0x7f4d340cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d2aa00640 1 -- 172.21.15.18:0/3379080436 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340ce040 con 0x7f4d3415fe50 2024-04-25T10:07:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.159+0000 7f4d32a00640 1 -- 172.21.15.18:0/3379080436 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258346467 0 0) 0x7f4d24001120 con 0x7f4d34145270 2024-04-25T10:07:04.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d2aa00640 1 --2- 172.21.15.18:0/3379080436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d340b1750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097c0 tx=0x7f4d1c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5605ab9e44771627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:04.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d32a00640 1 -- 172.21.15.18:0/3379080436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0b1070 con 0x7f4d3415fe50 2024-04-25T10:07:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d32a00640 1 -- 172.21.15.18:0/3379080436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0ac5f0 con 0x7f4d3415fe50 2024-04-25T10:07:04.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d32a00640 1 -- 172.21.15.18:0/3379080436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ac9c0 con 0x7f4d3415fe50 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 -- 172.21.15.18:0/3379080436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 msgr2=0x7f4d340b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3379080436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d340b1750 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0097c0 tx=0x7f4d1c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 -- 172.21.15.18:0/3379080436 shutdown_connections 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3379080436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d340b1750 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 -- 172.21.15.18:0/3379080436 >> 172.21.15.18:0/3379080436 conn(0x7f4d34066fa0 msgr2=0x7f4d3406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 -- 172.21.15.18:0/3379080436 shutdown_connections 2024-04-25T10:07:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.163+0000 7f4d3a000640 1 -- 172.21.15.18:0/3379080436 wait complete. 2024-04-25T10:07:04.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 Processor -- start 2024-04-25T10:07:04.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- start start 2024-04-25T10:07:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d340b1c90 0x7f4d341f9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d34145270 0x7f4d340aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:04.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340cdbe0 con 0x7f4d3415fe50 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415f930 con 0x7f4d340b1c90 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340cdd60 con 0x7f4d34145270 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45402/0 (socket says 172.21.15.18:45402) 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 -- 172.21.15.18:0/3661380284 learned_addr learned my addr 172.21.15.18:0/3661380284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d2aa00640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d34145270 0x7f4d340aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33400640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d340b1c90 0x7f4d341f9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 -- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d34145270 msgr2=0x7f4d340aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d34145270 0x7f4d340aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 -- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d340b1c90 msgr2=0x7f4d341f9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d340b1c90 0x7f4d341f9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 -- 172.21.15.18:0/3661380284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d341fa610 con 0x7f4d3415fe50 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d33e00640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c770 tx=0x7f4d2c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c003b80 con 0x7f4d3415fe50 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c003d20 con 0x7f4d3415fe50 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00aa90 con 0x7f4d3415fe50 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d341fa8f0 con 0x7f4d3415fe50 2024-04-25T10:07:04.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.167+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3413a670 con 0x7f4d3415fe50 2024-04-25T10:07:04.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d340745d0 con 0x7f4d3415fe50 2024-04-25T10:07:04.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d2c00ac30 con 0x7f4d3415fe50 2024-04-25T10:07:04.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d2be00640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:04.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4d2c085200 con 0x7f4d3415fe50 2024-04-25T10:07:04.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d33400640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:04.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.171+0000 7f4d33400640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 0x7f4d10069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007fd0 tx=0x7f4d24007980 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:04.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.175+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d2c055fe0 con 0x7f4d3415fe50 2024-04-25T10:07:04.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.331+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d3413a960 con 0x7f4d10066f60 2024-04-25T10:07:04.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.339+0000 7f4d2be00640 1 -- 172.21.15.18:0/3661380284 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252020 (secure 0 0 0) 0x7f4d3413a960 con 0x7f4d10066f60 2024-04-25T10:07:04.351 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:04.353 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:07:04.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 msgr2=0x7f4d10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 0x7f4d10069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d24007fd0 tx=0x7f4d24007980 comp rx=0 tx=0).stop 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 msgr2=0x7f4d3413a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00c770 tx=0x7f4d2c00cc30 comp rx=0 tx=0).stop 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 shutdown_connections 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d3415fe50 0x7f4d3413a130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d10066f60 0x7f4d10069420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d34145270 0x7f4d340aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 --2- 172.21.15.18:0/3661380284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d340b1c90 0x7f4d341f9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 >> 172.21.15.18:0/3661380284 conn(0x7f4d34066fa0 msgr2=0x7f4d340acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 shutdown_connections 2024-04-25T10:07:04.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:04.343+0000 7f4d3a000640 1 -- 172.21.15.18:0/3661380284 wait complete. 2024-04-25T10:07:04.370 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-04-25T10:07:03.440667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":182,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244472,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730248,"statfs":{"total":773094113280,"available":772843773952,"internally_reserved":0,"allocated":7675904,"data_stored":4098564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001317"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965809+0000","last_change":"2024-04-25T10:06:58.705372+0000","last_active":"2024-04-25T10:06:59.965809+0000","last_peered":"2024-04-25T10:06:59.965809+0000","last_clean":"2024-04-25T10:06:59.965809+0000","last_became_active":"2024-04-25T10:06:58.704968+0000","last_became_peered":"2024-04-25T10:06:58.704968+0000","last_unstale":"2024-04-25T10:06:59.965809+0000","last_undegraded":"2024-04-25T10:06:59.965809+0000","last_fullsized":"2024-04-25T10:06:59.965809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965823+0000","last_change":"2024-04-25T10:06:58.696356+0000","last_active":"2024-04-25T10:06:59.965823+0000","last_peered":"2024-04-25T10:06:59.965823+0000","last_clean":"2024-04-25T10:06:59.965823+0000","last_became_active":"2024-04-25T10:06:58.696044+0000","last_became_peered":"2024-04-25T10:06:58.696044+0000","last_unstale":"2024-04-25T10:06:59.965823+0000","last_undegraded":"2024-04-25T10:06:59.965823+0000","last_fullsized":"2024-04-25T10:06:59.965823+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966465+0000","last_change":"2024-04-25T10:06:58.720278+0000","last_active":"2024-04-25T10:06:59.966465+0000","last_peered":"2024-04-25T10:06:59.966465+0000","last_clean":"2024-04-25T10:06:59.966465+0000","last_became_active":"2024-04-25T10:06:58.720003+0000","last_became_peered":"2024-04-25T10:06:58.720003+0000","last_unstale":"2024-04-25T10:06:59.966465+0000","last_undegraded":"2024-04-25T10:06:59.966465+0000","last_fullsized":"2024-04-25T10:06:59.966465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697379+0000","last_change":"2024-04-25T10:06:58.700874+0000","last_active":"2024-04-25T10:06:59.697379+0000","last_peered":"2024-04-25T10:06:59.697379+0000","last_clean":"2024-04-25T10:06:59.697379+0000","last_became_active":"2024-04-25T10:06:58.700259+0000","last_became_peered":"2024-04-25T10:06:58.700259+0000","last_unstale":"2024-04-25T10:06:59.697379+0000","last_undegraded":"2024-04-25T10:06:59.697379+0000","last_fullsized":"2024-04-25T10:06:59.697379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696875+0000","last_change":"2024-04-25T10:06:58.702172+0000","last_active":"2024-04-25T10:06:59.696875+0000","last_peered":"2024-04-25T10:06:59.696875+0000","last_clean":"2024-04-25T10:06:59.696875+0000","last_became_active":"2024-04-25T10:06:58.701887+0000","last_became_peered":"2024-04-25T10:06:58.701887+0000","last_unstale":"2024-04-25T10:06:59.696875+0000","last_undegraded":"2024-04-25T10:06:59.696875+0000","last_fullsized":"2024-04-25T10:06:59.696875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688868+0000","last_change":"2024-04-25T10:06:58.713377+0000","last_active":"2024-04-25T10:06:59.688868+0000","last_peered":"2024-04-25T10:06:59.688868+0000","last_clean":"2024-04-25T10:06:59.688868+0000","last_became_active":"2024-04-25T10:06:58.710148+0000","last_became_peered":"2024-04-25T10:06:58.710148+0000","last_unstale":"2024-04-25T10:06:59.688868+0000","last_undegraded":"2024-04-25T10:06:59.688868+0000","last_fullsized":"2024-04-25T10:06:59.688868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:37.678342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965020+0000","last_change":"2024-04-25T10:06:58.719847+0000","last_active":"2024-04-25T10:06:59.965020+0000","last_peered":"2024-04-25T10:06:59.965020+0000","last_clean":"2024-04-25T10:06:59.965020+0000","last_became_active":"2024-04-25T10:06:58.719376+0000","last_became_peered":"2024-04-25T10:06:58.719376+0000","last_unstale":"2024-04-25T10:06:59.965020+0000","last_undegraded":"2024-04-25T10:06:59.965020+0000","last_fullsized":"2024-04-25T10:06:59.965020+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:07.469291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967270+0000","last_change":"2024-04-25T10:06:58.717916+0000","last_active":"2024-04-25T10:06:59.967270+0000","last_peered":"2024-04-25T10:06:59.967270+0000","last_clean":"2024-04-25T10:06:59.967270+0000","last_became_active":"2024-04-25T10:06:58.717585+0000","last_became_peered":"2024-04-25T10:06:58.717585+0000","last_unstale":"2024-04-25T10:06:59.967270+0000","last_undegraded":"2024-04-25T10:06:59.967270+0000","last_fullsized":"2024-04-25T10:06:59.967270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967324+0000","last_change":"2024-04-25T10:06:58.720739+0000","last_active":"2024-04-25T10:06:59.967324+0000","last_peered":"2024-04-25T10:06:59.967324+0000","last_clean":"2024-04-25T10:06:59.967324+0000","last_became_active":"2024-04-25T10:06:58.720347+0000","last_became_peered":"2024-04-25T10:06:58.720347+0000","last_unstale":"2024-04-25T10:06:59.967324+0000","last_undegraded":"2024-04-25T10:06:59.967324+0000","last_fullsized":"2024-04-25T10:06:59.967324+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:35.495854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966972+0000","last_change":"2024-04-25T10:06:58.718041+0000","last_active":"2024-04-25T10:06:59.966972+0000","last_peered":"2024-04-25T10:06:59.966972+0000","last_clean":"2024-04-25T10:06:59.966972+0000","last_became_active":"2024-04-25T10:06:58.717762+0000","last_became_peered":"2024-04-25T10:06:58.717762+0000","last_unstale":"2024-04-25T10:06:59.966972+0000","last_undegraded":"2024-04-25T10:06:59.966972+0000","last_fullsized":"2024-04-25T10:06:59.966972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697087+0000","last_change":"2024-04-25T10:06:58.695522+0000","last_active":"2024-04-25T10:06:59.697087+0000","last_peered":"2024-04-25T10:06:59.697087+0000","last_clean":"2024-04-25T10:06:59.697087+0000","last_became_active":"2024-04-25T10:06:58.695191+0000","last_became_peered":"2024-04-25T10:06:58.695191+0000","last_unstale":"2024-04-25T10:06:59.697087+0000","last_undegraded":"2024-04-25T10:06:59.697087+0000","last_fullsized":"2024-04-25T10:06:59.697087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966218+0000","last_change":"2024-04-25T10:06:58.717128+0000","last_active":"2024-04-25T10:06:59.966218+0000","last_peered":"2024-04-25T10:06:59.966218+0000","last_clean":"2024-04-25T10:06:59.966218+0000","last_became_active":"2024-04-25T10:06:58.716890+0000","last_became_peered":"2024-04-25T10:06:58.716890+0000","last_unstale":"2024-04-25T10:06:59.966218+0000","last_undegraded":"2024-04-25T10:06:59.966218+0000","last_fullsized":"2024-04-25T10:06:59.966218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966345+0000","last_change":"2024-04-25T10:06:58.707784+0000","last_active":"2024-04-25T10:06:59.966345+0000","last_peered":"2024-04-25T10:06:59.966345+0000","last_clean":"2024-04-25T10:06:59.966345+0000","last_became_active":"2024-04-25T10:06:58.707504+0000","last_became_peered":"2024-04-25T10:06:58.707504+0000","last_unstale":"2024-04-25T10:06:59.966345+0000","last_undegraded":"2024-04-25T10:06:59.966345+0000","last_fullsized":"2024-04-25T10:06:59.966345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966624+0000","last_change":"2024-04-25T10:06:58.720546+0000","last_active":"2024-04-25T10:06:59.966624+0000","last_peered":"2024-04-25T10:06:59.966624+0000","last_clean":"2024-04-25T10:06:59.966624+0000","last_became_active":"2024-04-25T10:06:58.720240+0000","last_became_peered":"2024-04-25T10:06:58.720240+0000","last_unstale":"2024-04-25T10:06:59.966624+0000","last_undegraded":"2024-04-25T10:06:59.966624+0000","last_fullsized":"2024-04-25T10:06:59.966624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966686+0000","last_change":"2024-04-25T10:06:58.718552+0000","last_active":"2024-04-25T10:06:59.966686+0000","last_peered":"2024-04-25T10:06:59.966686+0000","last_clean":"2024-04-25T10:06:59.966686+0000","last_became_active":"2024-04-25T10:06:58.718321+0000","last_became_peered":"2024-04-25T10:06:58.718321+0000","last_unstale":"2024-04-25T10:06:59.966686+0000","last_undegraded":"2024-04-25T10:06:59.966686+0000","last_fullsized":"2024-04-25T10:06:59.966686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965137+0000","last_change":"2024-04-25T10:06:58.709296+0000","last_active":"2024-04-25T10:06:59.965137+0000","last_peered":"2024-04-25T10:06:59.965137+0000","last_clean":"2024-04-25T10:06:59.965137+0000","last_became_active":"2024-04-25T10:06:58.709069+0000","last_became_peered":"2024-04-25T10:06:58.709069+0000","last_unstale":"2024-04-25T10:06:59.965137+0000","last_undegraded":"2024-04-25T10:06:59.965137+0000","last_fullsized":"2024-04-25T10:06:59.965137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:48.467256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965767+0000","last_change":"2024-04-25T10:06:58.695924+0000","last_active":"2024-04-25T10:06:59.965767+0000","last_peered":"2024-04-25T10:06:59.965767+0000","last_clean":"2024-04-25T10:06:59.965767+0000","last_became_active":"2024-04-25T10:06:58.695600+0000","last_became_peered":"2024-04-25T10:06:58.695600+0000","last_unstale":"2024-04-25T10:06:59.965767+0000","last_undegraded":"2024-04-25T10:06:59.965767+0000","last_fullsized":"2024-04-25T10:06:59.965767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.833782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697723+0000","last_change":"2024-04-25T10:06:58.693299+0000","last_active":"2024-04-25T10:06:59.697723+0000","last_peered":"2024-04-25T10:06:59.697723+0000","last_clean":"2024-04-25T10:06:59.697723+0000","last_became_active":"2024-04-25T10:06:58.692997+0000","last_became_peered":"2024-04-25T10:06:58.692997+0000","last_unstale":"2024-04-25T10:06:59.697723+0000","last_undegraded":"2024-04-25T10:06:59.697723+0000","last_fullsized":"2024-04-25T10:06:59.697723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698053+0000","last_change":"2024-04-25T10:06:58.697369+0000","last_active":"2024-04-25T10:06:59.698053+0000","last_peered":"2024-04-25T10:06:59.698053+0000","last_clean":"2024-04-25T10:06:59.698053+0000","last_became_active":"2024-04-25T10:06:58.697095+0000","last_became_peered":"2024-04-25T10:06:58.697095+0000","last_unstale":"2024-04-25T10:06:59.698053+0000","last_undegraded":"2024-04-25T10:06:59.698053+0000","last_fullsized":"2024-04-25T10:06:59.698053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965080+0000","last_change":"2024-04-25T10:06:58.690618+0000","last_active":"2024-04-25T10:06:59.965080+0000","last_peered":"2024-04-25T10:06:59.965080+0000","last_clean":"2024-04-25T10:06:59.965080+0000","last_became_active":"2024-04-25T10:06:58.690358+0000","last_became_peered":"2024-04-25T10:06:58.690358+0000","last_unstale":"2024-04-25T10:06:59.965080+0000","last_undegraded":"2024-04-25T10:06:59.965080+0000","last_fullsized":"2024-04-25T10:06:59.965080+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:00.498296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966539+0000","last_change":"2024-04-25T10:06:58.707064+0000","last_active":"2024-04-25T10:06:59.966539+0000","last_peered":"2024-04-25T10:06:59.966539+0000","last_clean":"2024-04-25T10:06:59.966539+0000","last_became_active":"2024-04-25T10:06:58.706556+0000","last_became_peered":"2024-04-25T10:06:58.706556+0000","last_unstale":"2024-04-25T10:06:59.966539+0000","last_undegraded":"2024-04-25T10:06:59.966539+0000","last_fullsized":"2024-04-25T10:06:59.966539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964447+0000","last_change":"2024-04-25T10:06:58.711407+0000","last_active":"2024-04-25T10:06:59.964447+0000","last_peered":"2024-04-25T10:06:59.964447+0000","last_clean":"2024-04-25T10:06:59.964447+0000","last_became_active":"2024-04-25T10:06:58.711087+0000","last_became_peered":"2024-04-25T10:06:58.711087+0000","last_unstale":"2024-04-25T10:06:59.964447+0000","last_undegraded":"2024-04-25T10:06:59.964447+0000","last_fullsized":"2024-04-25T10:06:59.964447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:33.657603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964419+0000","last_change":"2024-04-25T10:06:58.711445+0000","last_active":"2024-04-25T10:06:59.964419+0000","last_peered":"2024-04-25T10:06:59.964419+0000","last_clean":"2024-04-25T10:06:59.964419+0000","last_became_active":"2024-04-25T10:06:58.711173+0000","last_became_peered":"2024-04-25T10:06:58.711173+0000","last_unstale":"2024-04-25T10:06:59.964419+0000","last_undegraded":"2024-04-25T10:06:59.964419+0000","last_fullsized":"2024-04-25T10:06:59.964419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:04.645548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966448+0000","last_change":"2024-04-25T10:06:58.719459+0000","last_active":"2024-04-25T10:06:59.966448+0000","last_peered":"2024-04-25T10:06:59.966448+0000","last_clean":"2024-04-25T10:06:59.966448+0000","last_became_active":"2024-04-25T10:06:58.719198+0000","last_became_peered":"2024-04-25T10:06:58.719198+0000","last_unstale":"2024-04-25T10:06:59.966448+0000","last_undegraded":"2024-04-25T10:06:59.966448+0000","last_fullsized":"2024-04-25T10:06:59.966448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966486+0000","last_change":"2024-04-25T10:06:58.706847+0000","last_active":"2024-04-25T10:06:59.966486+0000","last_peered":"2024-04-25T10:06:59.966486+0000","last_clean":"2024-04-25T10:06:59.966486+0000","last_became_active":"2024-04-25T10:06:58.706622+0000","last_became_peered":"2024-04-25T10:06:58.706622+0000","last_unstale":"2024-04-25T10:06:59.966486+0000","last_undegraded":"2024-04-25T10:06:59.966486+0000","last_fullsized":"2024-04-25T10:06:59.966486+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966891+0000","last_change":"2024-04-25T10:06:58.704612+0000","last_active":"2024-04-25T10:06:59.966891+0000","last_peered":"2024-04-25T10:06:59.966891+0000","last_clean":"2024-04-25T10:06:59.966891+0000","last_became_active":"2024-04-25T10:06:58.704054+0000","last_became_peered":"2024-04-25T10:06:58.704054+0000","last_unstale":"2024-04-25T10:06:59.966891+0000","last_undegraded":"2024-04-25T10:06:59.966891+0000","last_fullsized":"2024-04-25T10:06:59.966891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697310+0000","last_change":"2024-04-25T10:06:58.698467+0000","last_active":"2024-04-25T10:06:59.697310+0000","last_peered":"2024-04-25T10:06:59.697310+0000","last_clean":"2024-04-25T10:06:59.697310+0000","last_became_active":"2024-04-25T10:06:58.698124+0000","last_became_peered":"2024-04-25T10:06:58.698124+0000","last_unstale":"2024-04-25T10:06:59.697310+0000","last_undegraded":"2024-04-25T10:06:59.697310+0000","last_fullsized":"2024-04-25T10:06:59.697310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965890+0000","last_change":"2024-04-25T10:06:58.690963+0000","last_active":"2024-04-25T10:06:59.965890+0000","last_peered":"2024-04-25T10:06:59.965890+0000","last_clean":"2024-04-25T10:06:59.965890+0000","last_became_active":"2024-04-25T10:06:58.690707+0000","last_became_peered":"2024-04-25T10:06:58.690707+0000","last_unstale":"2024-04-25T10:06:59.965890+0000","last_undegraded":"2024-04-25T10:06:59.965890+0000","last_fullsized":"2024-04-25T10:06:59.965890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966915+0000","last_change":"2024-04-25T10:06:58.721660+0000","last_active":"2024-04-25T10:06:59.966915+0000","last_peered":"2024-04-25T10:06:59.966915+0000","last_clean":"2024-04-25T10:06:59.966915+0000","last_became_active":"2024-04-25T10:06:58.720823+0000","last_became_peered":"2024-04-25T10:06:58.720823+0000","last_unstale":"2024-04-25T10:06:59.966915+0000","last_undegraded":"2024-04-25T10:06:59.966915+0000","last_fullsized":"2024-04-25T10:06:59.966915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967207+0000","last_change":"2024-04-25T10:06:58.718038+0000","last_active":"2024-04-25T10:06:59.967207+0000","last_peered":"2024-04-25T10:06:59.967207+0000","last_clean":"2024-04-25T10:06:59.967207+0000","last_became_active":"2024-04-25T10:06:58.717740+0000","last_became_peered":"2024-04-25T10:06:58.717740+0000","last_unstale":"2024-04-25T10:06:59.967207+0000","last_undegraded":"2024-04-25T10:06:59.967207+0000","last_fullsized":"2024-04-25T10:06:59.967207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696349+0000","last_change":"2024-04-25T10:06:58.692099+0000","last_active":"2024-04-25T10:06:59.696349+0000","last_peered":"2024-04-25T10:06:59.696349+0000","last_clean":"2024-04-25T10:06:59.696349+0000","last_became_active":"2024-04-25T10:06:58.691715+0000","last_became_peered":"2024-04-25T10:06:58.691715+0000","last_unstale":"2024-04-25T10:06:59.696349+0000","last_undegraded":"2024-04-25T10:06:59.696349+0000","last_fullsized":"2024-04-25T10:06:59.696349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:09.378673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688706+0000","last_change":"2024-04-25T10:06:58.690467+0000","last_active":"2024-04-25T10:06:59.688706+0000","last_peered":"2024-04-25T10:06:59.688706+0000","last_clean":"2024-04-25T10:06:59.688706+0000","last_became_active":"2024-04-25T10:06:58.690119+0000","last_became_peered":"2024-04-25T10:06:58.690119+0000","last_unstale":"2024-04-25T10:06:59.688706+0000","last_undegraded":"2024-04-25T10:06:59.688706+0000","last_fullsized":"2024-04-25T10:06:59.688706+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:14.984702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696965+0000","last_change":"2024-04-25T10:06:58.689820+0000","last_active":"2024-04-25T10:06:59.696965+0000","last_peered":"2024-04-25T10:06:59.696965+0000","last_clean":"2024-04-25T10:06:59.696965+0000","last_became_active":"2024-04-25T10:06:58.689376+0000","last_became_peered":"2024-04-25T10:06:58.689376+0000","last_unstale":"2024-04-25T10:06:59.696965+0000","last_undegraded":"2024-04-25T10:06:59.696965+0000","last_fullsized":"2024-04-25T10:06:59.696965+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965824+0000","last_change":"2024-04-25T10:06:57.698629+0000","last_active":"2024-04-25T10:06:59.965824+0000","last_peered":"2024-04-25T10:06:59.965824+0000","last_clean":"2024-04-25T10:06:59.965824+0000","last_became_active":"2024-04-25T10:06:57.698261+0000","last_became_peered":"2024-04-25T10:06:57.698261+0000","last_unstale":"2024-04-25T10:06:59.965824+0000","last_undegraded":"2024-04-25T10:06:59.965824+0000","last_fullsized":"2024-04-25T10:06:59.965824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697713+0000","last_change":"2024-04-25T10:06:58.697286+0000","last_active":"2024-04-25T10:06:59.697713+0000","last_peered":"2024-04-25T10:06:59.697713+0000","last_clean":"2024-04-25T10:06:59.697713+0000","last_became_active":"2024-04-25T10:06:58.697004+0000","last_became_peered":"2024-04-25T10:06:58.697004+0000","last_unstale":"2024-04-25T10:06:59.697713+0000","last_undegraded":"2024-04-25T10:06:59.697713+0000","last_fullsized":"2024-04-25T10:06:59.697713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689203+0000","last_change":"2024-04-25T10:06:57.691190+0000","last_active":"2024-04-25T10:06:59.689203+0000","last_peered":"2024-04-25T10:06:59.689203+0000","last_clean":"2024-04-25T10:06:59.689203+0000","last_became_active":"2024-04-25T10:06:57.690855+0000","last_became_peered":"2024-04-25T10:06:57.690855+0000","last_unstale":"2024-04-25T10:06:59.689203+0000","last_undegraded":"2024-04-25T10:06:59.689203+0000","last_fullsized":"2024-04-25T10:06:59.689203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:25.526631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689206+0000","last_change":"2024-04-25T10:06:58.697310+0000","last_active":"2024-04-25T10:06:59.689206+0000","last_peered":"2024-04-25T10:06:59.689206+0000","last_clean":"2024-04-25T10:06:59.689206+0000","last_became_active":"2024-04-25T10:06:58.696969+0000","last_became_peered":"2024-04-25T10:06:58.696969+0000","last_unstale":"2024-04-25T10:06:59.689206+0000","last_undegraded":"2024-04-25T10:06:59.689206+0000","last_fullsized":"2024-04-25T10:06:59.689206+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:01.976117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689025+0000","last_change":"2024-04-25T10:06:57.689281+0000","last_active":"2024-04-25T10:06:59.689025+0000","last_peered":"2024-04-25T10:06:59.689025+0000","last_clean":"2024-04-25T10:06:59.689025+0000","last_became_active":"2024-04-25T10:06:57.688082+0000","last_became_peered":"2024-04-25T10:06:57.688082+0000","last_unstale":"2024-04-25T10:06:59.689025+0000","last_undegraded":"2024-04-25T10:06:59.689025+0000","last_fullsized":"2024-04-25T10:06:59.689025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:05.576681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967095+0000","last_change":"2024-04-25T10:06:58.720697+0000","last_active":"2024-04-25T10:06:59.967095+0000","last_peered":"2024-04-25T10:06:59.967095+0000","last_clean":"2024-04-25T10:06:59.967095+0000","last_became_active":"2024-04-25T10:06:58.719949+0000","last_became_peered":"2024-04-25T10:06:58.719949+0000","last_unstale":"2024-04-25T10:06:59.967095+0000","last_undegraded":"2024-04-25T10:06:59.967095+0000","last_fullsized":"2024-04-25T10:06:59.967095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688962+0000","last_change":"2024-04-25T10:06:57.696268+0000","last_active":"2024-04-25T10:06:59.688962+0000","last_peered":"2024-04-25T10:06:59.688962+0000","last_clean":"2024-04-25T10:06:59.688962+0000","last_became_active":"2024-04-25T10:06:57.695960+0000","last_became_peered":"2024-04-25T10:06:57.695960+0000","last_unstale":"2024-04-25T10:06:59.688962+0000","last_undegraded":"2024-04-25T10:06:59.688962+0000","last_fullsized":"2024-04-25T10:06:59.688962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:34.488954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965281+0000","last_change":"2024-04-25T10:06:58.694993+0000","last_active":"2024-04-25T10:06:59.965281+0000","last_peered":"2024-04-25T10:06:59.965281+0000","last_clean":"2024-04-25T10:06:59.965281+0000","last_became_active":"2024-04-25T10:06:58.694736+0000","last_became_peered":"2024-04-25T10:06:58.694736+0000","last_unstale":"2024-04-25T10:06:59.965281+0000","last_undegraded":"2024-04-25T10:06:59.965281+0000","last_fullsized":"2024-04-25T10:06:59.965281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:14.586752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964893+0000","last_change":"2024-04-25T10:06:57.682797+0000","last_active":"2024-04-25T10:06:59.964893+0000","last_peered":"2024-04-25T10:06:59.964893+0000","last_clean":"2024-04-25T10:06:59.964893+0000","last_became_active":"2024-04-25T10:06:57.682495+0000","last_became_peered":"2024-04-25T10:06:57.682495+0000","last_unstale":"2024-04-25T10:06:59.964893+0000","last_undegraded":"2024-04-25T10:06:59.964893+0000","last_fullsized":"2024-04-25T10:06:59.964893+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:17.201159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965340+0000","last_change":"2024-04-25T10:06:58.696287+0000","last_active":"2024-04-25T10:06:59.965340+0000","last_peered":"2024-04-25T10:06:59.965340+0000","last_clean":"2024-04-25T10:06:59.965340+0000","last_became_active":"2024-04-25T10:06:58.696017+0000","last_became_peered":"2024-04-25T10:06:58.696017+0000","last_unstale":"2024-04-25T10:06:59.965340+0000","last_undegraded":"2024-04-25T10:06:59.965340+0000","last_fullsized":"2024-04-25T10:06:59.965340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964318+0000","last_change":"2024-04-25T10:06:57.692552+0000","last_active":"2024-04-25T10:06:59.964318+0000","last_peered":"2024-04-25T10:06:59.964318+0000","last_clean":"2024-04-25T10:06:59.964318+0000","last_became_active":"2024-04-25T10:06:57.692263+0000","last_became_peered":"2024-04-25T10:06:57.692263+0000","last_unstale":"2024-04-25T10:06:59.964318+0000","last_undegraded":"2024-04-25T10:06:59.964318+0000","last_fullsized":"2024-04-25T10:06:59.964318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:42.735001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697648+0000","last_change":"2024-04-25T10:06:58.685391+0000","last_active":"2024-04-25T10:06:59.697648+0000","last_peered":"2024-04-25T10:06:59.697648+0000","last_clean":"2024-04-25T10:06:59.697648+0000","last_became_active":"2024-04-25T10:06:58.684828+0000","last_became_peered":"2024-04-25T10:06:58.684828+0000","last_unstale":"2024-04-25T10:06:59.697648+0000","last_undegraded":"2024-04-25T10:06:59.697648+0000","last_fullsized":"2024-04-25T10:06:59.697648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964473+0000","last_change":"2024-04-25T10:06:57.687120+0000","last_active":"2024-04-25T10:06:59.964473+0000","last_peered":"2024-04-25T10:06:59.964473+0000","last_clean":"2024-04-25T10:06:59.964473+0000","last_became_active":"2024-04-25T10:06:57.686825+0000","last_became_peered":"2024-04-25T10:06:57.686825+0000","last_unstale":"2024-04-25T10:06:59.964473+0000","last_undegraded":"2024-04-25T10:06:59.964473+0000","last_fullsized":"2024-04-25T10:06:59.964473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:29.000330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964840+0000","last_change":"2024-04-25T10:06:58.699015+0000","last_active":"2024-04-25T10:06:59.964840+0000","last_peered":"2024-04-25T10:06:59.964840+0000","last_clean":"2024-04-25T10:06:59.964840+0000","last_became_active":"2024-04-25T10:06:58.698743+0000","last_became_peered":"2024-04-25T10:06:58.698743+0000","last_unstale":"2024-04-25T10:06:59.964840+0000","last_undegraded":"2024-04-25T10:06:59.964840+0000","last_fullsized":"2024-04-25T10:06:59.964840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:50.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696354+0000","last_change":"2024-04-25T10:06:57.695087+0000","last_active":"2024-04-25T10:06:59.696354+0000","last_peered":"2024-04-25T10:06:59.696354+0000","last_clean":"2024-04-25T10:06:59.696354+0000","last_became_active":"2024-04-25T10:06:57.694780+0000","last_became_peered":"2024-04-25T10:06:57.694780+0000","last_unstale":"2024-04-25T10:06:59.696354+0000","last_undegraded":"2024-04-25T10:06:59.696354+0000","last_fullsized":"2024-04-25T10:06:59.696354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965632+0000","last_change":"2024-04-25T10:06:58.690284+0000","last_active":"2024-04-25T10:06:59.965632+0000","last_peered":"2024-04-25T10:06:59.965632+0000","last_clean":"2024-04-25T10:06:59.965632+0000","last_became_active":"2024-04-25T10:06:58.689469+0000","last_became_peered":"2024-04-25T10:06:58.689469+0000","last_unstale":"2024-04-25T10:06:59.965632+0000","last_undegraded":"2024-04-25T10:06:59.965632+0000","last_fullsized":"2024-04-25T10:06:59.965632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967269+0000","last_change":"2024-04-25T10:06:57.702505+0000","last_active":"2024-04-25T10:06:59.967269+0000","last_peered":"2024-04-25T10:06:59.967269+0000","last_clean":"2024-04-25T10:06:59.967269+0000","last_became_active":"2024-04-25T10:06:57.702181+0000","last_became_peered":"2024-04-25T10:06:57.702181+0000","last_unstale":"2024-04-25T10:06:59.967269+0000","last_undegraded":"2024-04-25T10:06:59.967269+0000","last_fullsized":"2024-04-25T10:06:59.967269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:22.097393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965289+0000","last_change":"2024-04-25T10:06:58.701710+0000","last_active":"2024-04-25T10:06:59.965289+0000","last_peered":"2024-04-25T10:06:59.965289+0000","last_clean":"2024-04-25T10:06:59.965289+0000","last_became_active":"2024-04-25T10:06:58.701430+0000","last_became_peered":"2024-04-25T10:06:58.701430+0000","last_unstale":"2024-04-25T10:06:59.965289+0000","last_undegraded":"2024-04-25T10:06:59.965289+0000","last_fullsized":"2024-04-25T10:06:59.965289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:22.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697912+0000","last_change":"2024-04-25T10:06:57.698329+0000","last_active":"2024-04-25T10:06:59.697912+0000","last_peered":"2024-04-25T10:06:59.697912+0000","last_clean":"2024-04-25T10:06:59.697912+0000","last_became_active":"2024-04-25T10:06:57.697990+0000","last_became_peered":"2024-04-25T10:06:57.697990+0000","last_unstale":"2024-04-25T10:06:59.697912+0000","last_undegraded":"2024-04-25T10:06:59.697912+0000","last_fullsized":"2024-04-25T10:06:59.697912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697334+0000","last_change":"2024-04-25T10:06:58.698953+0000","last_active":"2024-04-25T10:06:59.697334+0000","last_peered":"2024-04-25T10:06:59.697334+0000","last_clean":"2024-04-25T10:06:59.697334+0000","last_became_active":"2024-04-25T10:06:58.698687+0000","last_became_peered":"2024-04-25T10:06:58.698687+0000","last_unstale":"2024-04-25T10:06:59.697334+0000","last_undegraded":"2024-04-25T10:06:59.697334+0000","last_fullsized":"2024-04-25T10:06:59.697334+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966594+0000","last_change":"2024-04-25T10:06:57.701358+0000","last_active":"2024-04-25T10:06:59.966594+0000","last_peered":"2024-04-25T10:06:59.966594+0000","last_clean":"2024-04-25T10:06:59.966594+0000","last_became_active":"2024-04-25T10:06:57.700998+0000","last_became_peered":"2024-04-25T10:06:57.700998+0000","last_unstale":"2024-04-25T10:06:59.966594+0000","last_undegraded":"2024-04-25T10:06:59.966594+0000","last_fullsized":"2024-04-25T10:06:59.966594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698293+0000","last_change":"2024-04-25T10:06:58.696461+0000","last_active":"2024-04-25T10:06:59.698293+0000","last_peered":"2024-04-25T10:06:59.698293+0000","last_clean":"2024-04-25T10:06:59.698293+0000","last_became_active":"2024-04-25T10:06:58.696183+0000","last_became_peered":"2024-04-25T10:06:58.696183+0000","last_unstale":"2024-04-25T10:06:59.698293+0000","last_undegraded":"2024-04-25T10:06:59.698293+0000","last_fullsized":"2024-04-25T10:06:59.698293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965750+0000","last_change":"2024-04-25T10:06:57.695636+0000","last_active":"2024-04-25T10:06:59.965750+0000","last_peered":"2024-04-25T10:06:59.965750+0000","last_clean":"2024-04-25T10:06:59.965750+0000","last_became_active":"2024-04-25T10:06:57.695251+0000","last_became_peered":"2024-04-25T10:06:57.695251+0000","last_unstale":"2024-04-25T10:06:59.965750+0000","last_undegraded":"2024-04-25T10:06:59.965750+0000","last_fullsized":"2024-04-25T10:06:59.965750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:35.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696578+0000","last_change":"2024-04-25T10:06:58.712359+0000","last_active":"2024-04-25T10:06:59.696578+0000","last_peered":"2024-04-25T10:06:59.696578+0000","last_clean":"2024-04-25T10:06:59.696578+0000","last_became_active":"2024-04-25T10:06:58.712062+0000","last_became_peered":"2024-04-25T10:06:58.712062+0000","last_unstale":"2024-04-25T10:06:59.696578+0000","last_undegraded":"2024-04-25T10:06:59.696578+0000","last_fullsized":"2024-04-25T10:06:59.696578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966938+0000","last_change":"2024-04-25T10:06:57.699763+0000","last_active":"2024-04-25T10:06:59.966938+0000","last_peered":"2024-04-25T10:06:59.966938+0000","last_clean":"2024-04-25T10:06:59.966938+0000","last_became_active":"2024-04-25T10:06:57.699453+0000","last_became_peered":"2024-04-25T10:06:57.699453+0000","last_unstale":"2024-04-25T10:06:59.966938+0000","last_undegraded":"2024-04-25T10:06:59.966938+0000","last_fullsized":"2024-04-25T10:06:59.966938+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:37.795052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966159+0000","last_change":"2024-04-25T10:06:58.707487+0000","last_active":"2024-04-25T10:06:59.966159+0000","last_peered":"2024-04-25T10:06:59.966159+0000","last_clean":"2024-04-25T10:06:59.966159+0000","last_became_active":"2024-04-25T10:06:58.706159+0000","last_became_peered":"2024-04-25T10:06:58.706159+0000","last_unstale":"2024-04-25T10:06:59.966159+0000","last_undegraded":"2024-04-25T10:06:59.966159+0000","last_fullsized":"2024-04-25T10:06:59.966159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967305+0000","last_change":"2024-04-25T10:06:57.699687+0000","last_active":"2024-04-25T10:06:59.967305+0000","last_peered":"2024-04-25T10:06:59.967305+0000","last_clean":"2024-04-25T10:06:59.967305+0000","last_became_active":"2024-04-25T10:06:57.699195+0000","last_became_peered":"2024-04-25T10:06:57.699195+0000","last_unstale":"2024-04-25T10:06:59.967305+0000","last_undegraded":"2024-04-25T10:06:59.967305+0000","last_fullsized":"2024-04-25T10:06:59.967305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697852+0000","last_change":"2024-04-25T10:06:58.689239+0000","last_active":"2024-04-25T10:06:59.697852+0000","last_peered":"2024-04-25T10:06:59.697852+0000","last_clean":"2024-04-25T10:06:59.697852+0000","last_became_active":"2024-04-25T10:06:58.688969+0000","last_became_peered":"2024-04-25T10:06:58.688969+0000","last_unstale":"2024-04-25T10:06:59.697852+0000","last_undegraded":"2024-04-25T10:06:59.697852+0000","last_fullsized":"2024-04-25T10:06:59.697852+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966797+0000","last_change":"2024-04-25T10:06:57.699729+0000","last_active":"2024-04-25T10:06:59.966797+0000","last_peered":"2024-04-25T10:06:59.966797+0000","last_clean":"2024-04-25T10:06:59.966797+0000","last_became_active":"2024-04-25T10:06:57.697804+0000","last_became_peered":"2024-04-25T10:06:57.697804+0000","last_unstale":"2024-04-25T10:06:59.966797+0000","last_undegraded":"2024-04-25T10:06:59.966797+0000","last_fullsized":"2024-04-25T10:06:59.966797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965540+0000","last_change":"2024-04-25T10:06:58.713114+0000","last_active":"2024-04-25T10:06:59.965540+0000","last_peered":"2024-04-25T10:06:59.965540+0000","last_clean":"2024-04-25T10:06:59.965540+0000","last_became_active":"2024-04-25T10:06:58.712830+0000","last_became_peered":"2024-04-25T10:06:58.712830+0000","last_unstale":"2024-04-25T10:06:59.965540+0000","last_undegraded":"2024-04-25T10:06:59.965540+0000","last_fullsized":"2024-04-25T10:06:59.965540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696296+0000","last_change":"2024-04-25T10:06:57.695831+0000","last_active":"2024-04-25T10:06:59.696296+0000","last_peered":"2024-04-25T10:06:59.696296+0000","last_clean":"2024-04-25T10:06:59.696296+0000","last_became_active":"2024-04-25T10:06:57.694960+0000","last_became_peered":"2024-04-25T10:06:57.694960+0000","last_unstale":"2024-04-25T10:06:59.696296+0000","last_undegraded":"2024-04-25T10:06:59.696296+0000","last_fullsized":"2024-04-25T10:06:59.696296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:23.245743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967097+0000","last_change":"2024-04-25T10:06:58.721709+0000","last_active":"2024-04-25T10:06:59.967097+0000","last_peered":"2024-04-25T10:06:59.967097+0000","last_clean":"2024-04-25T10:06:59.967097+0000","last_became_active":"2024-04-25T10:06:58.720942+0000","last_became_peered":"2024-04-25T10:06:58.720942+0000","last_unstale":"2024-04-25T10:06:59.967097+0000","last_undegraded":"2024-04-25T10:06:59.967097+0000","last_fullsized":"2024-04-25T10:06:59.967097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966592+0000","last_change":"2024-04-25T10:06:57.701226+0000","last_active":"2024-04-25T10:06:59.966592+0000","last_peered":"2024-04-25T10:06:59.966592+0000","last_clean":"2024-04-25T10:06:59.966592+0000","last_became_active":"2024-04-25T10:06:57.700923+0000","last_became_peered":"2024-04-25T10:06:57.700923+0000","last_unstale":"2024-04-25T10:06:59.966592+0000","last_undegraded":"2024-04-25T10:06:59.966592+0000","last_fullsized":"2024-04-25T10:06:59.966592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698092+0000","last_change":"2024-04-25T10:06:58.698155+0000","last_active":"2024-04-25T10:06:59.698092+0000","last_peered":"2024-04-25T10:06:59.698092+0000","last_clean":"2024-04-25T10:06:59.698092+0000","last_became_active":"2024-04-25T10:06:58.697758+0000","last_became_peered":"2024-04-25T10:06:58.697758+0000","last_unstale":"2024-04-25T10:06:59.698092+0000","last_undegraded":"2024-04-25T10:06:59.698092+0000","last_fullsized":"2024-04-25T10:06:59.698092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967177+0000","last_change":"2024-04-25T10:06:57.698613+0000","last_active":"2024-04-25T10:06:59.967177+0000","last_peered":"2024-04-25T10:06:59.967177+0000","last_clean":"2024-04-25T10:06:59.967177+0000","last_became_active":"2024-04-25T10:06:57.698073+0000","last_became_peered":"2024-04-25T10:06:57.698073+0000","last_unstale":"2024-04-25T10:06:59.967177+0000","last_undegraded":"2024-04-25T10:06:59.967177+0000","last_fullsized":"2024-04-25T10:06:59.967177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697932+0000","last_change":"2024-04-25T10:06:58.698012+0000","last_active":"2024-04-25T10:06:59.697932+0000","last_peered":"2024-04-25T10:06:59.697932+0000","last_clean":"2024-04-25T10:06:59.697932+0000","last_became_active":"2024-04-25T10:06:58.697512+0000","last_became_peered":"2024-04-25T10:06:58.697512+0000","last_unstale":"2024-04-25T10:06:59.697932+0000","last_undegraded":"2024-04-25T10:06:59.697932+0000","last_fullsized":"2024-04-25T10:06:59.697932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966715+0000","last_change":"2024-04-25T10:06:57.701710+0000","last_active":"2024-04-25T10:06:59.966715+0000","last_peered":"2024-04-25T10:06:59.966715+0000","last_clean":"2024-04-25T10:06:59.966715+0000","last_became_active":"2024-04-25T10:06:57.701340+0000","last_became_peered":"2024-04-25T10:06:57.701340+0000","last_unstale":"2024-04-25T10:06:59.966715+0000","last_undegraded":"2024-04-25T10:06:59.966715+0000","last_fullsized":"2024-04-25T10:06:59.966715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697192+0000","last_change":"2024-04-25T10:06:58.700861+0000","last_active":"2024-04-25T10:06:59.697192+0000","last_peered":"2024-04-25T10:06:59.697192+0000","last_clean":"2024-04-25T10:06:59.697192+0000","last_became_active":"2024-04-25T10:06:58.700159+0000","last_became_peered":"2024-04-25T10:06:58.700159+0000","last_unstale":"2024-04-25T10:06:59.697192+0000","last_undegraded":"2024-04-25T10:06:59.697192+0000","last_fullsized":"2024-04-25T10:06:59.697192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964701+0000","last_change":"2024-04-25T10:06:57.686262+0000","last_active":"2024-04-25T10:06:59.964701+0000","last_peered":"2024-04-25T10:06:59.964701+0000","last_clean":"2024-04-25T10:06:59.964701+0000","last_became_active":"2024-04-25T10:06:57.685887+0000","last_became_peered":"2024-04-25T10:06:57.685887+0000","last_unstale":"2024-04-25T10:06:59.964701+0000","last_undegraded":"2024-04-25T10:06:59.964701+0000","last_fullsized":"2024-04-25T10:06:59.964701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:05.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688713+0000","last_change":"2024-04-25T10:06:58.688181+0000","last_active":"2024-04-25T10:06:59.688713+0000","last_peered":"2024-04-25T10:06:59.688713+0000","last_clean":"2024-04-25T10:06:59.688713+0000","last_became_active":"2024-04-25T10:06:58.687826+0000","last_became_peered":"2024-04-25T10:06:58.687826+0000","last_unstale":"2024-04-25T10:06:59.688713+0000","last_undegraded":"2024-04-25T10:06:59.688713+0000","last_fullsized":"2024-04-25T10:06:59.688713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:49.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688687+0000","last_change":"2024-04-25T10:06:57.687256+0000","last_active":"2024-04-25T10:06:59.688687+0000","last_peered":"2024-04-25T10:06:59.688687+0000","last_clean":"2024-04-25T10:06:59.688687+0000","last_became_active":"2024-04-25T10:06:57.686955+0000","last_became_peered":"2024-04-25T10:06:57.686955+0000","last_unstale":"2024-04-25T10:06:59.688687+0000","last_undegraded":"2024-04-25T10:06:59.688687+0000","last_fullsized":"2024-04-25T10:06:59.688687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.068517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966655+0000","last_change":"2024-04-25T10:06:58.698543+0000","last_active":"2024-04-25T10:06:59.966655+0000","last_peered":"2024-04-25T10:06:59.966655+0000","last_clean":"2024-04-25T10:06:59.966655+0000","last_became_active":"2024-04-25T10:06:58.698269+0000","last_became_peered":"2024-04-25T10:06:58.698269+0000","last_unstale":"2024-04-25T10:06:59.966655+0000","last_undegraded":"2024-04-25T10:06:59.966655+0000","last_fullsized":"2024-04-25T10:06:59.966655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967356+0000","last_change":"2024-04-25T10:06:57.699439+0000","last_active":"2024-04-25T10:06:59.967356+0000","last_peered":"2024-04-25T10:06:59.967356+0000","last_clean":"2024-04-25T10:06:59.967356+0000","last_became_active":"2024-04-25T10:06:57.698847+0000","last_became_peered":"2024-04-25T10:06:57.698847+0000","last_unstale":"2024-04-25T10:06:59.967356+0000","last_undegraded":"2024-04-25T10:06:59.967356+0000","last_fullsized":"2024-04-25T10:06:59.967356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698010+0000","last_change":"2024-04-25T10:06:58.685134+0000","last_active":"2024-04-25T10:06:59.698010+0000","last_peered":"2024-04-25T10:06:59.698010+0000","last_clean":"2024-04-25T10:06:59.698010+0000","last_became_active":"2024-04-25T10:06:58.684392+0000","last_became_peered":"2024-04-25T10:06:58.684392+0000","last_unstale":"2024-04-25T10:06:59.698010+0000","last_undegraded":"2024-04-25T10:06:59.698010+0000","last_fullsized":"2024-04-25T10:06:59.698010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688796+0000","last_change":"2024-04-25T10:06:57.690397+0000","last_active":"2024-04-25T10:06:59.688796+0000","last_peered":"2024-04-25T10:06:59.688796+0000","last_clean":"2024-04-25T10:06:59.688796+0000","last_became_active":"2024-04-25T10:06:57.690018+0000","last_became_peered":"2024-04-25T10:06:57.690018+0000","last_unstale":"2024-04-25T10:06:59.688796+0000","last_undegraded":"2024-04-25T10:06:59.688796+0000","last_fullsized":"2024-04-25T10:06:59.688796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:40.284763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688987+0000","last_change":"2024-04-25T10:06:58.693304+0000","last_active":"2024-04-25T10:06:59.688987+0000","last_peered":"2024-04-25T10:06:59.688987+0000","last_clean":"2024-04-25T10:06:59.688987+0000","last_became_active":"2024-04-25T10:06:58.692927+0000","last_became_peered":"2024-04-25T10:06:58.692927+0000","last_unstale":"2024-04-25T10:06:59.688987+0000","last_undegraded":"2024-04-25T10:06:59.688987+0000","last_fullsized":"2024-04-25T10:06:59.688987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:53.579162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966781+0000","last_change":"2024-04-25T10:06:57.696956+0000","last_active":"2024-04-25T10:06:59.966781+0000","last_peered":"2024-04-25T10:06:59.966781+0000","last_clean":"2024-04-25T10:06:59.966781+0000","last_became_active":"2024-04-25T10:06:57.696670+0000","last_became_peered":"2024-04-25T10:06:57.696670+0000","last_unstale":"2024-04-25T10:06:59.966781+0000","last_undegraded":"2024-04-25T10:06:59.966781+0000","last_fullsized":"2024-04-25T10:06:59.966781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965607+0000","last_change":"2024-04-25T10:06:58.698761+0000","last_active":"2024-04-25T10:06:59.965607+0000","last_peered":"2024-04-25T10:06:59.965607+0000","last_clean":"2024-04-25T10:06:59.965607+0000","last_became_active":"2024-04-25T10:06:58.698485+0000","last_became_peered":"2024-04-25T10:06:58.698485+0000","last_unstale":"2024-04-25T10:06:59.965607+0000","last_undegraded":"2024-04-25T10:06:59.965607+0000","last_fullsized":"2024-04-25T10:06:59.965607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:47.328920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967246+0000","last_change":"2024-04-25T10:06:57.691781+0000","last_active":"2024-04-25T10:06:59.967246+0000","last_peered":"2024-04-25T10:06:59.967246+0000","last_clean":"2024-04-25T10:06:59.967246+0000","last_became_active":"2024-04-25T10:06:57.690812+0000","last_became_peered":"2024-04-25T10:06:57.690812+0000","last_unstale":"2024-04-25T10:06:59.967246+0000","last_undegraded":"2024-04-25T10:06:59.967246+0000","last_fullsized":"2024-04-25T10:06:59.967246+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967038+0000","last_change":"2024-04-25T10:06:58.708252+0000","last_active":"2024-04-25T10:06:59.967038+0000","last_peered":"2024-04-25T10:06:59.967038+0000","last_clean":"2024-04-25T10:06:59.967038+0000","last_became_active":"2024-04-25T10:06:58.707939+0000","last_became_peered":"2024-04-25T10:06:58.707939+0000","last_unstale":"2024-04-25T10:06:59.967038+0000","last_undegraded":"2024-04-25T10:06:59.967038+0000","last_fullsized":"2024-04-25T10:06:59.967038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689071+0000","last_change":"2024-04-25T10:06:57.688349+0000","last_active":"2024-04-25T10:06:59.689071+0000","last_peered":"2024-04-25T10:06:59.689071+0000","last_clean":"2024-04-25T10:06:59.689071+0000","last_became_active":"2024-04-25T10:06:57.688060+0000","last_became_peered":"2024-04-25T10:06:57.688060+0000","last_unstale":"2024-04-25T10:06:59.689071+0000","last_undegraded":"2024-04-25T10:06:59.689071+0000","last_fullsized":"2024-04-25T10:06:59.689071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:13.676304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697349+0000","last_change":"2024-04-25T10:06:58.701071+0000","last_active":"2024-04-25T10:06:59.697349+0000","last_peered":"2024-04-25T10:06:59.697349+0000","last_clean":"2024-04-25T10:06:59.697349+0000","last_became_active":"2024-04-25T10:06:58.700600+0000","last_became_peered":"2024-04-25T10:06:58.700600+0000","last_unstale":"2024-04-25T10:06:59.697349+0000","last_undegraded":"2024-04-25T10:06:59.697349+0000","last_fullsized":"2024-04-25T10:06:59.697349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965841+0000","last_change":"2024-04-25T10:06:57.695574+0000","last_active":"2024-04-25T10:06:59.965841+0000","last_peered":"2024-04-25T10:06:59.965841+0000","last_clean":"2024-04-25T10:06:59.965841+0000","last_became_active":"2024-04-25T10:06:57.694766+0000","last_became_peered":"2024-04-25T10:06:57.694766+0000","last_unstale":"2024-04-25T10:06:59.965841+0000","last_undegraded":"2024-04-25T10:06:59.965841+0000","last_fullsized":"2024-04-25T10:06:59.965841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:25.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696682+0000","last_change":"2024-04-25T10:06:58.690072+0000","last_active":"2024-04-25T10:06:59.696682+0000","last_peered":"2024-04-25T10:06:59.696682+0000","last_clean":"2024-04-25T10:06:59.696682+0000","last_became_active":"2024-04-25T10:06:58.689759+0000","last_became_peered":"2024-04-25T10:06:58.689759+0000","last_unstale":"2024-04-25T10:06:59.696682+0000","last_undegraded":"2024-04-25T10:06:59.696682+0000","last_fullsized":"2024-04-25T10:06:59.696682+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967052+0000","last_change":"2024-04-25T10:06:57.699267+0000","last_active":"2024-04-25T10:06:59.967052+0000","last_peered":"2024-04-25T10:06:59.967052+0000","last_clean":"2024-04-25T10:06:59.967052+0000","last_became_active":"2024-04-25T10:06:57.698971+0000","last_became_peered":"2024-04-25T10:06:57.698971+0000","last_unstale":"2024-04-25T10:06:59.967052+0000","last_undegraded":"2024-04-25T10:06:59.967052+0000","last_fullsized":"2024-04-25T10:06:59.967052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696644+0000","last_change":"2024-04-25T10:06:58.716464+0000","last_active":"2024-04-25T10:06:59.696644+0000","last_peered":"2024-04-25T10:06:59.696644+0000","last_clean":"2024-04-25T10:06:59.696644+0000","last_became_active":"2024-04-25T10:06:58.716201+0000","last_became_peered":"2024-04-25T10:06:58.716201+0000","last_unstale":"2024-04-25T10:06:59.696644+0000","last_undegraded":"2024-04-25T10:06:59.696644+0000","last_fullsized":"2024-04-25T10:06:59.696644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964501+0000","last_change":"2024-04-25T10:06:57.695875+0000","last_active":"2024-04-25T10:06:59.964501+0000","last_peered":"2024-04-25T10:06:59.964501+0000","last_clean":"2024-04-25T10:06:59.964501+0000","last_became_active":"2024-04-25T10:06:57.695300+0000","last_became_peered":"2024-04-25T10:06:57.695300+0000","last_unstale":"2024-04-25T10:06:59.964501+0000","last_undegraded":"2024-04-25T10:06:59.964501+0000","last_fullsized":"2024-04-25T10:06:59.964501+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:12.751178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965349+0000","last_change":"2024-04-25T10:06:58.700662+0000","last_active":"2024-04-25T10:06:59.965349+0000","last_peered":"2024-04-25T10:06:59.965349+0000","last_clean":"2024-04-25T10:06:59.965349+0000","last_became_active":"2024-04-25T10:06:58.700339+0000","last_became_peered":"2024-04-25T10:06:58.700339+0000","last_unstale":"2024-04-25T10:06:59.965349+0000","last_undegraded":"2024-04-25T10:06:59.965349+0000","last_fullsized":"2024-04-25T10:06:59.965349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964573+0000","last_change":"2024-04-25T10:06:57.683425+0000","last_active":"2024-04-25T10:06:59.964573+0000","last_peered":"2024-04-25T10:06:59.964573+0000","last_clean":"2024-04-25T10:06:59.964573+0000","last_became_active":"2024-04-25T10:06:57.683160+0000","last_became_peered":"2024-04-25T10:06:57.683160+0000","last_unstale":"2024-04-25T10:06:59.964573+0000","last_undegraded":"2024-04-25T10:06:59.964573+0000","last_fullsized":"2024-04-25T10:06:59.964573+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:30.076875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965117+0000","last_change":"2024-04-25T10:06:58.704305+0000","last_active":"2024-04-25T10:06:59.965117+0000","last_peered":"2024-04-25T10:06:59.965117+0000","last_clean":"2024-04-25T10:06:59.965117+0000","last_became_active":"2024-04-25T10:06:58.703953+0000","last_became_peered":"2024-04-25T10:06:58.703953+0000","last_unstale":"2024-04-25T10:06:59.965117+0000","last_undegraded":"2024-04-25T10:06:59.965117+0000","last_fullsized":"2024-04-25T10:06:59.965117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:44.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965096+0000","last_change":"2024-04-25T10:06:57.691893+0000","last_active":"2024-04-25T10:06:59.965096+0000","last_peered":"2024-04-25T10:06:59.965096+0000","last_clean":"2024-04-25T10:06:59.965096+0000","last_became_active":"2024-04-25T10:06:57.691599+0000","last_became_peered":"2024-04-25T10:06:57.691599+0000","last_unstale":"2024-04-25T10:06:59.965096+0000","last_undegraded":"2024-04-25T10:06:59.965096+0000","last_fullsized":"2024-04-25T10:06:59.965096+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697038+0000","last_change":"2024-04-25T10:06:58.702014+0000","last_active":"2024-04-25T10:06:59.697038+0000","last_peered":"2024-04-25T10:06:59.697038+0000","last_clean":"2024-04-25T10:06:59.697038+0000","last_became_active":"2024-04-25T10:06:58.701696+0000","last_became_peered":"2024-04-25T10:06:58.701696+0000","last_unstale":"2024-04-25T10:06:59.697038+0000","last_undegraded":"2024-04-25T10:06:59.697038+0000","last_fullsized":"2024-04-25T10:06:59.697038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964267+0000","last_change":"2024-04-25T10:06:57.685927+0000","last_active":"2024-04-25T10:06:59.964267+0000","last_peered":"2024-04-25T10:06:59.964267+0000","last_clean":"2024-04-25T10:06:59.964267+0000","last_became_active":"2024-04-25T10:06:57.685624+0000","last_became_peered":"2024-04-25T10:06:57.685624+0000","last_unstale":"2024-04-25T10:06:59.964267+0000","last_undegraded":"2024-04-25T10:06:59.964267+0000","last_fullsized":"2024-04-25T10:06:59.964267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:27.308952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966717+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:06:59.966717+0000","last_peered":"2024-04-25T10:06:59.966717+0000","last_clean":"2024-04-25T10:06:59.966717+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:06:59.966717+0000","last_undegraded":"2024-04-25T10:06:59.966717+0000","last_fullsized":"2024-04-25T10:06:59.966717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":955270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":365738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542186,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542188,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":366502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":954494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:07:07.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:07:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.519+0000 7fdeb5800640 1 Processor -- start 2024-04-25T10:07:07.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.519+0000 7fdeb5800640 1 -- start start 2024-04-25T10:07:07.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 0x7fdeb015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdeb00cd4d0 0x7fdeb00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdeb00b1750 0x7fdeb00b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00b20e0 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb0145650 con 0x7fdeb00b1750 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeb5800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb00cc4e0 con 0x7fdeb0145270 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdeb00cd4d0 0x7fdeb00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdeb00cd4d0 0x7fdeb00cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45410/0 (socket says 172.21.15.18:45410) 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 -- 172.21.15.18:0/2354179047 learned_addr learned my addr 172.21.15.18:0/2354179047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeaea00640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 0x7fdeb015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeaf400640 1 --2- 172.21.15.18:0/2354179047 >> v2:172.21.15.167:3300/0 conn(0x7fdeb00b1750 0x7fdeb00b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 -- 172.21.15.18:0/2354179047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 msgr2=0x7fdeb015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 0x7fdeb015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 -- 172.21.15.18:0/2354179047 >> v2:172.21.15.167:3300/0 conn(0x7fdeb00b1750 msgr2=0x7fdeb00b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 --2- 172.21.15.18:0/2354179047 >> v2:172.21.15.167:3300/0 conn(0x7fdeb00b1750 0x7fdeb00b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdea6000640 1 -- 172.21.15.18:0/2354179047 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00ce040 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.523+0000 7fdeaea00640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 0x7fdeb015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:07.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdea6000640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb00cd930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006b5f0 tx=0x7fde9801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da33d93f9b2bfcd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeae000640 1 -- 172.21.15.18:0/2354179047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980b1070 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeae000640 1 -- 172.21.15.18:0/2354179047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980ac630 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeae000640 1 -- 172.21.15.18:0/2354179047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980a8050 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- 172.21.15.18:0/2354179047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 msgr2=0x7fdeb00cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb00cd930 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fdeb006b5f0 tx=0x7fde9801c520 comp rx=0 tx=0).stop 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- 172.21.15.18:0/2354179047 shutdown_connections 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 --2- 172.21.15.18:0/2354179047 >> v2:172.21.15.167:3300/0 conn(0x7fdeb00b1750 0x7fdeb00b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb00cd930 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 --2- 172.21.15.18:0/2354179047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb0145270 0x7fdeb015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- 172.21.15.18:0/2354179047 >> 172.21.15.18:0/2354179047 conn(0x7fdeb0066fa0 msgr2=0x7fdeb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- 172.21.15.18:0/2354179047 shutdown_connections 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- 172.21.15.18:0/2354179047 wait complete. 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 Processor -- start 2024-04-25T10:07:07.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.527+0000 7fdeb5800640 1 -- start start 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb00b1750 0x7fdeb00af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 0x7fdeb00b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015c590 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015f930 con 0x7fdeb0145270 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015c710 con 0x7fdeb00b1750 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45414/0 (socket says 172.21.15.18:45414) 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 -- 172.21.15.18:0/3377419 learned_addr learned my addr 172.21.15.18:0/3377419 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeaea00640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb00b1750 0x7fdeb00af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeaf400640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 0x7fdeb00b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 -- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb00b1750 msgr2=0x7fdeb00af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb00b1750 0x7fdeb00af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 -- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 msgr2=0x7fdeb00b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 0x7fdeb00b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 -- 172.21.15.18:0/3377419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb0164d10 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeaf400640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 0x7fdeb00b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea6000640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde980af040 tx=0x7fde980192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980bc070 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980ab5e0 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde980b1070 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00b1540 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00b1020 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb00745d0 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.531+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde980bf070 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.535+0000 7fdea7400640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 0x7fde8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.535+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fde9811eab0 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.535+0000 7fdeaea00640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 0x7fde8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.535+0000 7fdeaea00640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 0x7fde8c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009fd0 tx=0x7fdea00097f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.539+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde98016110 con 0x7fdeb00cd4d0 2024-04-25T10:07:07.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.699+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdeb0165870 con 0x7fde8c066f60 2024-04-25T10:07:07.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.707+0000 7fdea7400640 1 -- 172.21.15.18:0/3377419 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251984 (secure 0 0 0) 0x7fdeb0165870 con 0x7fde8c066f60 2024-04-25T10:07:07.717 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:07.718 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:07:07.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 msgr2=0x7fde8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 0x7fde8c069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009fd0 tx=0x7fdea00097f0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 msgr2=0x7fdeb015b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fde980af040 tx=0x7fde980192c0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 shutdown_connections 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdeb0145270 0x7fdeb00b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdeb00cd4d0 0x7fdeb015b440 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde8c066f60 0x7fde8c069420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 --2- 172.21.15.18:0/3377419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdeb00b1750 0x7fdeb00af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 >> 172.21.15.18:0/3377419 conn(0x7fdeb0066fa0 msgr2=0x7fdeb0073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 shutdown_connections 2024-04-25T10:07:07.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.711+0000 7fdeb5800640 1 -- 172.21.15.18:0/3377419 wait complete. 2024-04-25T10:07:07.739 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-04-25T10:07:07.441818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":191,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":244472,"kb_used_data":7496,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754730248,"statfs":{"total":773094113280,"available":772843773952,"internally_reserved":0,"allocated":7675904,"data_stored":4098564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.766345"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965809+0000","last_change":"2024-04-25T10:06:58.705372+0000","last_active":"2024-04-25T10:06:59.965809+0000","last_peered":"2024-04-25T10:06:59.965809+0000","last_clean":"2024-04-25T10:06:59.965809+0000","last_became_active":"2024-04-25T10:06:58.704968+0000","last_became_peered":"2024-04-25T10:06:58.704968+0000","last_unstale":"2024-04-25T10:06:59.965809+0000","last_undegraded":"2024-04-25T10:06:59.965809+0000","last_fullsized":"2024-04-25T10:06:59.965809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965823+0000","last_change":"2024-04-25T10:06:58.696356+0000","last_active":"2024-04-25T10:06:59.965823+0000","last_peered":"2024-04-25T10:06:59.965823+0000","last_clean":"2024-04-25T10:06:59.965823+0000","last_became_active":"2024-04-25T10:06:58.696044+0000","last_became_peered":"2024-04-25T10:06:58.696044+0000","last_unstale":"2024-04-25T10:06:59.965823+0000","last_undegraded":"2024-04-25T10:06:59.965823+0000","last_fullsized":"2024-04-25T10:06:59.965823+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966465+0000","last_change":"2024-04-25T10:06:58.720278+0000","last_active":"2024-04-25T10:06:59.966465+0000","last_peered":"2024-04-25T10:06:59.966465+0000","last_clean":"2024-04-25T10:06:59.966465+0000","last_became_active":"2024-04-25T10:06:58.720003+0000","last_became_peered":"2024-04-25T10:06:58.720003+0000","last_unstale":"2024-04-25T10:06:59.966465+0000","last_undegraded":"2024-04-25T10:06:59.966465+0000","last_fullsized":"2024-04-25T10:06:59.966465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697379+0000","last_change":"2024-04-25T10:06:58.700874+0000","last_active":"2024-04-25T10:06:59.697379+0000","last_peered":"2024-04-25T10:06:59.697379+0000","last_clean":"2024-04-25T10:06:59.697379+0000","last_became_active":"2024-04-25T10:06:58.700259+0000","last_became_peered":"2024-04-25T10:06:58.700259+0000","last_unstale":"2024-04-25T10:06:59.697379+0000","last_undegraded":"2024-04-25T10:06:59.697379+0000","last_fullsized":"2024-04-25T10:06:59.697379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696875+0000","last_change":"2024-04-25T10:06:58.702172+0000","last_active":"2024-04-25T10:06:59.696875+0000","last_peered":"2024-04-25T10:06:59.696875+0000","last_clean":"2024-04-25T10:06:59.696875+0000","last_became_active":"2024-04-25T10:06:58.701887+0000","last_became_peered":"2024-04-25T10:06:58.701887+0000","last_unstale":"2024-04-25T10:06:59.696875+0000","last_undegraded":"2024-04-25T10:06:59.696875+0000","last_fullsized":"2024-04-25T10:06:59.696875+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688868+0000","last_change":"2024-04-25T10:06:58.713377+0000","last_active":"2024-04-25T10:06:59.688868+0000","last_peered":"2024-04-25T10:06:59.688868+0000","last_clean":"2024-04-25T10:06:59.688868+0000","last_became_active":"2024-04-25T10:06:58.710148+0000","last_became_peered":"2024-04-25T10:06:58.710148+0000","last_unstale":"2024-04-25T10:06:59.688868+0000","last_undegraded":"2024-04-25T10:06:59.688868+0000","last_fullsized":"2024-04-25T10:06:59.688868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:37.678342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965020+0000","last_change":"2024-04-25T10:06:58.719847+0000","last_active":"2024-04-25T10:06:59.965020+0000","last_peered":"2024-04-25T10:06:59.965020+0000","last_clean":"2024-04-25T10:06:59.965020+0000","last_became_active":"2024-04-25T10:06:58.719376+0000","last_became_peered":"2024-04-25T10:06:58.719376+0000","last_unstale":"2024-04-25T10:06:59.965020+0000","last_undegraded":"2024-04-25T10:06:59.965020+0000","last_fullsized":"2024-04-25T10:06:59.965020+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:07.469291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967270+0000","last_change":"2024-04-25T10:06:58.717916+0000","last_active":"2024-04-25T10:06:59.967270+0000","last_peered":"2024-04-25T10:06:59.967270+0000","last_clean":"2024-04-25T10:06:59.967270+0000","last_became_active":"2024-04-25T10:06:58.717585+0000","last_became_peered":"2024-04-25T10:06:58.717585+0000","last_unstale":"2024-04-25T10:06:59.967270+0000","last_undegraded":"2024-04-25T10:06:59.967270+0000","last_fullsized":"2024-04-25T10:06:59.967270+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967324+0000","last_change":"2024-04-25T10:06:58.720739+0000","last_active":"2024-04-25T10:06:59.967324+0000","last_peered":"2024-04-25T10:06:59.967324+0000","last_clean":"2024-04-25T10:06:59.967324+0000","last_became_active":"2024-04-25T10:06:58.720347+0000","last_became_peered":"2024-04-25T10:06:58.720347+0000","last_unstale":"2024-04-25T10:06:59.967324+0000","last_undegraded":"2024-04-25T10:06:59.967324+0000","last_fullsized":"2024-04-25T10:06:59.967324+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:35.495854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966972+0000","last_change":"2024-04-25T10:06:58.718041+0000","last_active":"2024-04-25T10:06:59.966972+0000","last_peered":"2024-04-25T10:06:59.966972+0000","last_clean":"2024-04-25T10:06:59.966972+0000","last_became_active":"2024-04-25T10:06:58.717762+0000","last_became_peered":"2024-04-25T10:06:58.717762+0000","last_unstale":"2024-04-25T10:06:59.966972+0000","last_undegraded":"2024-04-25T10:06:59.966972+0000","last_fullsized":"2024-04-25T10:06:59.966972+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697087+0000","last_change":"2024-04-25T10:06:58.695522+0000","last_active":"2024-04-25T10:06:59.697087+0000","last_peered":"2024-04-25T10:06:59.697087+0000","last_clean":"2024-04-25T10:06:59.697087+0000","last_became_active":"2024-04-25T10:06:58.695191+0000","last_became_peered":"2024-04-25T10:06:58.695191+0000","last_unstale":"2024-04-25T10:06:59.697087+0000","last_undegraded":"2024-04-25T10:06:59.697087+0000","last_fullsized":"2024-04-25T10:06:59.697087+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966218+0000","last_change":"2024-04-25T10:06:58.717128+0000","last_active":"2024-04-25T10:06:59.966218+0000","last_peered":"2024-04-25T10:06:59.966218+0000","last_clean":"2024-04-25T10:06:59.966218+0000","last_became_active":"2024-04-25T10:06:58.716890+0000","last_became_peered":"2024-04-25T10:06:58.716890+0000","last_unstale":"2024-04-25T10:06:59.966218+0000","last_undegraded":"2024-04-25T10:06:59.966218+0000","last_fullsized":"2024-04-25T10:06:59.966218+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:03.629663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966345+0000","last_change":"2024-04-25T10:06:58.707784+0000","last_active":"2024-04-25T10:06:59.966345+0000","last_peered":"2024-04-25T10:06:59.966345+0000","last_clean":"2024-04-25T10:06:59.966345+0000","last_became_active":"2024-04-25T10:06:58.707504+0000","last_became_peered":"2024-04-25T10:06:58.707504+0000","last_unstale":"2024-04-25T10:06:59.966345+0000","last_undegraded":"2024-04-25T10:06:59.966345+0000","last_fullsized":"2024-04-25T10:06:59.966345+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966624+0000","last_change":"2024-04-25T10:06:58.720546+0000","last_active":"2024-04-25T10:06:59.966624+0000","last_peered":"2024-04-25T10:06:59.966624+0000","last_clean":"2024-04-25T10:06:59.966624+0000","last_became_active":"2024-04-25T10:06:58.720240+0000","last_became_peered":"2024-04-25T10:06:58.720240+0000","last_unstale":"2024-04-25T10:06:59.966624+0000","last_undegraded":"2024-04-25T10:06:59.966624+0000","last_fullsized":"2024-04-25T10:06:59.966624+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966686+0000","last_change":"2024-04-25T10:06:58.718552+0000","last_active":"2024-04-25T10:06:59.966686+0000","last_peered":"2024-04-25T10:06:59.966686+0000","last_clean":"2024-04-25T10:06:59.966686+0000","last_became_active":"2024-04-25T10:06:58.718321+0000","last_became_peered":"2024-04-25T10:06:58.718321+0000","last_unstale":"2024-04-25T10:06:59.966686+0000","last_undegraded":"2024-04-25T10:06:59.966686+0000","last_fullsized":"2024-04-25T10:06:59.966686+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965137+0000","last_change":"2024-04-25T10:06:58.709296+0000","last_active":"2024-04-25T10:06:59.965137+0000","last_peered":"2024-04-25T10:06:59.965137+0000","last_clean":"2024-04-25T10:06:59.965137+0000","last_became_active":"2024-04-25T10:06:58.709069+0000","last_became_peered":"2024-04-25T10:06:58.709069+0000","last_unstale":"2024-04-25T10:06:59.965137+0000","last_undegraded":"2024-04-25T10:06:59.965137+0000","last_fullsized":"2024-04-25T10:06:59.965137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:48.467256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965767+0000","last_change":"2024-04-25T10:06:58.695924+0000","last_active":"2024-04-25T10:06:59.965767+0000","last_peered":"2024-04-25T10:06:59.965767+0000","last_clean":"2024-04-25T10:06:59.965767+0000","last_became_active":"2024-04-25T10:06:58.695600+0000","last_became_peered":"2024-04-25T10:06:58.695600+0000","last_unstale":"2024-04-25T10:06:59.965767+0000","last_undegraded":"2024-04-25T10:06:59.965767+0000","last_fullsized":"2024-04-25T10:06:59.965767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:56.833782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697723+0000","last_change":"2024-04-25T10:06:58.693299+0000","last_active":"2024-04-25T10:06:59.697723+0000","last_peered":"2024-04-25T10:06:59.697723+0000","last_clean":"2024-04-25T10:06:59.697723+0000","last_became_active":"2024-04-25T10:06:58.692997+0000","last_became_peered":"2024-04-25T10:06:58.692997+0000","last_unstale":"2024-04-25T10:06:59.697723+0000","last_undegraded":"2024-04-25T10:06:59.697723+0000","last_fullsized":"2024-04-25T10:06:59.697723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698053+0000","last_change":"2024-04-25T10:06:58.697369+0000","last_active":"2024-04-25T10:06:59.698053+0000","last_peered":"2024-04-25T10:06:59.698053+0000","last_clean":"2024-04-25T10:06:59.698053+0000","last_became_active":"2024-04-25T10:06:58.697095+0000","last_became_peered":"2024-04-25T10:06:58.697095+0000","last_unstale":"2024-04-25T10:06:59.698053+0000","last_undegraded":"2024-04-25T10:06:59.698053+0000","last_fullsized":"2024-04-25T10:06:59.698053+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965080+0000","last_change":"2024-04-25T10:06:58.690618+0000","last_active":"2024-04-25T10:06:59.965080+0000","last_peered":"2024-04-25T10:06:59.965080+0000","last_clean":"2024-04-25T10:06:59.965080+0000","last_became_active":"2024-04-25T10:06:58.690358+0000","last_became_peered":"2024-04-25T10:06:58.690358+0000","last_unstale":"2024-04-25T10:06:59.965080+0000","last_undegraded":"2024-04-25T10:06:59.965080+0000","last_fullsized":"2024-04-25T10:06:59.965080+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:00.498296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966539+0000","last_change":"2024-04-25T10:06:58.707064+0000","last_active":"2024-04-25T10:06:59.966539+0000","last_peered":"2024-04-25T10:06:59.966539+0000","last_clean":"2024-04-25T10:06:59.966539+0000","last_became_active":"2024-04-25T10:06:58.706556+0000","last_became_peered":"2024-04-25T10:06:58.706556+0000","last_unstale":"2024-04-25T10:06:59.966539+0000","last_undegraded":"2024-04-25T10:06:59.966539+0000","last_fullsized":"2024-04-25T10:06:59.966539+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:40.839379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964447+0000","last_change":"2024-04-25T10:06:58.711407+0000","last_active":"2024-04-25T10:06:59.964447+0000","last_peered":"2024-04-25T10:06:59.964447+0000","last_clean":"2024-04-25T10:06:59.964447+0000","last_became_active":"2024-04-25T10:06:58.711087+0000","last_became_peered":"2024-04-25T10:06:58.711087+0000","last_unstale":"2024-04-25T10:06:59.964447+0000","last_undegraded":"2024-04-25T10:06:59.964447+0000","last_fullsized":"2024-04-25T10:06:59.964447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:39:33.657603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964419+0000","last_change":"2024-04-25T10:06:58.711445+0000","last_active":"2024-04-25T10:06:59.964419+0000","last_peered":"2024-04-25T10:06:59.964419+0000","last_clean":"2024-04-25T10:06:59.964419+0000","last_became_active":"2024-04-25T10:06:58.711173+0000","last_became_peered":"2024-04-25T10:06:58.711173+0000","last_unstale":"2024-04-25T10:06:59.964419+0000","last_undegraded":"2024-04-25T10:06:59.964419+0000","last_fullsized":"2024-04-25T10:06:59.964419+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:39:04.645548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966448+0000","last_change":"2024-04-25T10:06:58.719459+0000","last_active":"2024-04-25T10:06:59.966448+0000","last_peered":"2024-04-25T10:06:59.966448+0000","last_clean":"2024-04-25T10:06:59.966448+0000","last_became_active":"2024-04-25T10:06:58.719198+0000","last_became_peered":"2024-04-25T10:06:58.719198+0000","last_unstale":"2024-04-25T10:06:59.966448+0000","last_undegraded":"2024-04-25T10:06:59.966448+0000","last_fullsized":"2024-04-25T10:06:59.966448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966486+0000","last_change":"2024-04-25T10:06:58.706847+0000","last_active":"2024-04-25T10:06:59.966486+0000","last_peered":"2024-04-25T10:06:59.966486+0000","last_clean":"2024-04-25T10:06:59.966486+0000","last_became_active":"2024-04-25T10:06:58.706622+0000","last_became_peered":"2024-04-25T10:06:58.706622+0000","last_unstale":"2024-04-25T10:06:59.966486+0000","last_undegraded":"2024-04-25T10:06:59.966486+0000","last_fullsized":"2024-04-25T10:06:59.966486+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:22:01.373714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966891+0000","last_change":"2024-04-25T10:06:58.704612+0000","last_active":"2024-04-25T10:06:59.966891+0000","last_peered":"2024-04-25T10:06:59.966891+0000","last_clean":"2024-04-25T10:06:59.966891+0000","last_became_active":"2024-04-25T10:06:58.704054+0000","last_became_peered":"2024-04-25T10:06:58.704054+0000","last_unstale":"2024-04-25T10:06:59.966891+0000","last_undegraded":"2024-04-25T10:06:59.966891+0000","last_fullsized":"2024-04-25T10:06:59.966891+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697310+0000","last_change":"2024-04-25T10:06:58.698467+0000","last_active":"2024-04-25T10:06:59.697310+0000","last_peered":"2024-04-25T10:06:59.697310+0000","last_clean":"2024-04-25T10:06:59.697310+0000","last_became_active":"2024-04-25T10:06:58.698124+0000","last_became_peered":"2024-04-25T10:06:58.698124+0000","last_unstale":"2024-04-25T10:06:59.697310+0000","last_undegraded":"2024-04-25T10:06:59.697310+0000","last_fullsized":"2024-04-25T10:06:59.697310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965890+0000","last_change":"2024-04-25T10:06:58.690963+0000","last_active":"2024-04-25T10:06:59.965890+0000","last_peered":"2024-04-25T10:06:59.965890+0000","last_clean":"2024-04-25T10:06:59.965890+0000","last_became_active":"2024-04-25T10:06:58.690707+0000","last_became_peered":"2024-04-25T10:06:58.690707+0000","last_unstale":"2024-04-25T10:06:59.965890+0000","last_undegraded":"2024-04-25T10:06:59.965890+0000","last_fullsized":"2024-04-25T10:06:59.965890+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:56:14.701889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966915+0000","last_change":"2024-04-25T10:06:58.721660+0000","last_active":"2024-04-25T10:06:59.966915+0000","last_peered":"2024-04-25T10:06:59.966915+0000","last_clean":"2024-04-25T10:06:59.966915+0000","last_became_active":"2024-04-25T10:06:58.720823+0000","last_became_peered":"2024-04-25T10:06:58.720823+0000","last_unstale":"2024-04-25T10:06:59.966915+0000","last_undegraded":"2024-04-25T10:06:59.966915+0000","last_fullsized":"2024-04-25T10:06:59.966915+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:29.075416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967207+0000","last_change":"2024-04-25T10:06:58.718038+0000","last_active":"2024-04-25T10:06:59.967207+0000","last_peered":"2024-04-25T10:06:59.967207+0000","last_clean":"2024-04-25T10:06:59.967207+0000","last_became_active":"2024-04-25T10:06:58.717740+0000","last_became_peered":"2024-04-25T10:06:58.717740+0000","last_unstale":"2024-04-25T10:06:59.967207+0000","last_undegraded":"2024-04-25T10:06:59.967207+0000","last_fullsized":"2024-04-25T10:06:59.967207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696349+0000","last_change":"2024-04-25T10:06:58.692099+0000","last_active":"2024-04-25T10:06:59.696349+0000","last_peered":"2024-04-25T10:06:59.696349+0000","last_clean":"2024-04-25T10:06:59.696349+0000","last_became_active":"2024-04-25T10:06:58.691715+0000","last_became_peered":"2024-04-25T10:06:58.691715+0000","last_unstale":"2024-04-25T10:06:59.696349+0000","last_undegraded":"2024-04-25T10:06:59.696349+0000","last_fullsized":"2024-04-25T10:06:59.696349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:09.378673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688706+0000","last_change":"2024-04-25T10:06:58.690467+0000","last_active":"2024-04-25T10:06:59.688706+0000","last_peered":"2024-04-25T10:06:59.688706+0000","last_clean":"2024-04-25T10:06:59.688706+0000","last_became_active":"2024-04-25T10:06:58.690119+0000","last_became_peered":"2024-04-25T10:06:58.690119+0000","last_unstale":"2024-04-25T10:06:59.688706+0000","last_undegraded":"2024-04-25T10:06:59.688706+0000","last_fullsized":"2024-04-25T10:06:59.688706+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:26:14.984702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696965+0000","last_change":"2024-04-25T10:06:58.689820+0000","last_active":"2024-04-25T10:06:59.696965+0000","last_peered":"2024-04-25T10:06:59.696965+0000","last_clean":"2024-04-25T10:06:59.696965+0000","last_became_active":"2024-04-25T10:06:58.689376+0000","last_became_peered":"2024-04-25T10:06:58.689376+0000","last_unstale":"2024-04-25T10:06:59.696965+0000","last_undegraded":"2024-04-25T10:06:59.696965+0000","last_fullsized":"2024-04-25T10:06:59.696965+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:10.568072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"66'4","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965824+0000","last_change":"2024-04-25T10:06:57.698629+0000","last_active":"2024-04-25T10:06:59.965824+0000","last_peered":"2024-04-25T10:06:59.965824+0000","last_clean":"2024-04-25T10:06:59.965824+0000","last_became_active":"2024-04-25T10:06:57.698261+0000","last_became_peered":"2024-04-25T10:06:57.698261+0000","last_unstale":"2024-04-25T10:06:59.965824+0000","last_undegraded":"2024-04-25T10:06:59.965824+0000","last_fullsized":"2024-04-25T10:06:59.965824+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697713+0000","last_change":"2024-04-25T10:06:58.697286+0000","last_active":"2024-04-25T10:06:59.697713+0000","last_peered":"2024-04-25T10:06:59.697713+0000","last_clean":"2024-04-25T10:06:59.697713+0000","last_became_active":"2024-04-25T10:06:58.697004+0000","last_became_peered":"2024-04-25T10:06:58.697004+0000","last_unstale":"2024-04-25T10:06:59.697713+0000","last_undegraded":"2024-04-25T10:06:59.697713+0000","last_fullsized":"2024-04-25T10:06:59.697713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689203+0000","last_change":"2024-04-25T10:06:57.691190+0000","last_active":"2024-04-25T10:06:59.689203+0000","last_peered":"2024-04-25T10:06:59.689203+0000","last_clean":"2024-04-25T10:06:59.689203+0000","last_became_active":"2024-04-25T10:06:57.690855+0000","last_became_peered":"2024-04-25T10:06:57.690855+0000","last_unstale":"2024-04-25T10:06:59.689203+0000","last_undegraded":"2024-04-25T10:06:59.689203+0000","last_fullsized":"2024-04-25T10:06:59.689203+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:25.526631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689206+0000","last_change":"2024-04-25T10:06:58.697310+0000","last_active":"2024-04-25T10:06:59.689206+0000","last_peered":"2024-04-25T10:06:59.689206+0000","last_clean":"2024-04-25T10:06:59.689206+0000","last_became_active":"2024-04-25T10:06:58.696969+0000","last_became_peered":"2024-04-25T10:06:58.696969+0000","last_unstale":"2024-04-25T10:06:59.689206+0000","last_undegraded":"2024-04-25T10:06:59.689206+0000","last_fullsized":"2024-04-25T10:06:59.689206+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:01.976117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689025+0000","last_change":"2024-04-25T10:06:57.689281+0000","last_active":"2024-04-25T10:06:59.689025+0000","last_peered":"2024-04-25T10:06:59.689025+0000","last_clean":"2024-04-25T10:06:59.689025+0000","last_became_active":"2024-04-25T10:06:57.688082+0000","last_became_peered":"2024-04-25T10:06:57.688082+0000","last_unstale":"2024-04-25T10:06:59.689025+0000","last_undegraded":"2024-04-25T10:06:59.689025+0000","last_fullsized":"2024-04-25T10:06:59.689025+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:05.576681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967095+0000","last_change":"2024-04-25T10:06:58.720697+0000","last_active":"2024-04-25T10:06:59.967095+0000","last_peered":"2024-04-25T10:06:59.967095+0000","last_clean":"2024-04-25T10:06:59.967095+0000","last_became_active":"2024-04-25T10:06:58.719949+0000","last_became_peered":"2024-04-25T10:06:58.719949+0000","last_unstale":"2024-04-25T10:06:59.967095+0000","last_undegraded":"2024-04-25T10:06:59.967095+0000","last_fullsized":"2024-04-25T10:06:59.967095+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:06.583580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688962+0000","last_change":"2024-04-25T10:06:57.696268+0000","last_active":"2024-04-25T10:06:59.688962+0000","last_peered":"2024-04-25T10:06:59.688962+0000","last_clean":"2024-04-25T10:06:59.688962+0000","last_became_active":"2024-04-25T10:06:57.695960+0000","last_became_peered":"2024-04-25T10:06:57.695960+0000","last_unstale":"2024-04-25T10:06:59.688962+0000","last_undegraded":"2024-04-25T10:06:59.688962+0000","last_fullsized":"2024-04-25T10:06:59.688962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:34.488954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965281+0000","last_change":"2024-04-25T10:06:58.694993+0000","last_active":"2024-04-25T10:06:59.965281+0000","last_peered":"2024-04-25T10:06:59.965281+0000","last_clean":"2024-04-25T10:06:59.965281+0000","last_became_active":"2024-04-25T10:06:58.694736+0000","last_became_peered":"2024-04-25T10:06:58.694736+0000","last_unstale":"2024-04-25T10:06:59.965281+0000","last_undegraded":"2024-04-25T10:06:59.965281+0000","last_fullsized":"2024-04-25T10:06:59.965281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:45:14.586752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964893+0000","last_change":"2024-04-25T10:06:57.682797+0000","last_active":"2024-04-25T10:06:59.964893+0000","last_peered":"2024-04-25T10:06:59.964893+0000","last_clean":"2024-04-25T10:06:59.964893+0000","last_became_active":"2024-04-25T10:06:57.682495+0000","last_became_peered":"2024-04-25T10:06:57.682495+0000","last_unstale":"2024-04-25T10:06:59.964893+0000","last_undegraded":"2024-04-25T10:06:59.964893+0000","last_fullsized":"2024-04-25T10:06:59.964893+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:18:17.201159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965340+0000","last_change":"2024-04-25T10:06:58.696287+0000","last_active":"2024-04-25T10:06:59.965340+0000","last_peered":"2024-04-25T10:06:59.965340+0000","last_clean":"2024-04-25T10:06:59.965340+0000","last_became_active":"2024-04-25T10:06:58.696017+0000","last_became_peered":"2024-04-25T10:06:58.696017+0000","last_unstale":"2024-04-25T10:06:59.965340+0000","last_undegraded":"2024-04-25T10:06:59.965340+0000","last_fullsized":"2024-04-25T10:06:59.965340+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964318+0000","last_change":"2024-04-25T10:06:57.692552+0000","last_active":"2024-04-25T10:06:59.964318+0000","last_peered":"2024-04-25T10:06:59.964318+0000","last_clean":"2024-04-25T10:06:59.964318+0000","last_became_active":"2024-04-25T10:06:57.692263+0000","last_became_peered":"2024-04-25T10:06:57.692263+0000","last_unstale":"2024-04-25T10:06:59.964318+0000","last_undegraded":"2024-04-25T10:06:59.964318+0000","last_fullsized":"2024-04-25T10:06:59.964318+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:16:42.735001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697648+0000","last_change":"2024-04-25T10:06:58.685391+0000","last_active":"2024-04-25T10:06:59.697648+0000","last_peered":"2024-04-25T10:06:59.697648+0000","last_clean":"2024-04-25T10:06:59.697648+0000","last_became_active":"2024-04-25T10:06:58.684828+0000","last_became_peered":"2024-04-25T10:06:58.684828+0000","last_unstale":"2024-04-25T10:06:59.697648+0000","last_undegraded":"2024-04-25T10:06:59.697648+0000","last_fullsized":"2024-04-25T10:06:59.697648+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964473+0000","last_change":"2024-04-25T10:06:57.687120+0000","last_active":"2024-04-25T10:06:59.964473+0000","last_peered":"2024-04-25T10:06:59.964473+0000","last_clean":"2024-04-25T10:06:59.964473+0000","last_became_active":"2024-04-25T10:06:57.686825+0000","last_became_peered":"2024-04-25T10:06:57.686825+0000","last_unstale":"2024-04-25T10:06:59.964473+0000","last_undegraded":"2024-04-25T10:06:59.964473+0000","last_fullsized":"2024-04-25T10:06:59.964473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:29.000330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964840+0000","last_change":"2024-04-25T10:06:58.699015+0000","last_active":"2024-04-25T10:06:59.964840+0000","last_peered":"2024-04-25T10:06:59.964840+0000","last_clean":"2024-04-25T10:06:59.964840+0000","last_became_active":"2024-04-25T10:06:58.698743+0000","last_became_peered":"2024-04-25T10:06:58.698743+0000","last_unstale":"2024-04-25T10:06:59.964840+0000","last_undegraded":"2024-04-25T10:06:59.964840+0000","last_fullsized":"2024-04-25T10:06:59.964840+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:50.668603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696354+0000","last_change":"2024-04-25T10:06:57.695087+0000","last_active":"2024-04-25T10:06:59.696354+0000","last_peered":"2024-04-25T10:06:59.696354+0000","last_clean":"2024-04-25T10:06:59.696354+0000","last_became_active":"2024-04-25T10:06:57.694780+0000","last_became_peered":"2024-04-25T10:06:57.694780+0000","last_unstale":"2024-04-25T10:06:59.696354+0000","last_undegraded":"2024-04-25T10:06:59.696354+0000","last_fullsized":"2024-04-25T10:06:59.696354+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965632+0000","last_change":"2024-04-25T10:06:58.690284+0000","last_active":"2024-04-25T10:06:59.965632+0000","last_peered":"2024-04-25T10:06:59.965632+0000","last_clean":"2024-04-25T10:06:59.965632+0000","last_became_active":"2024-04-25T10:06:58.689469+0000","last_became_peered":"2024-04-25T10:06:58.689469+0000","last_unstale":"2024-04-25T10:06:59.965632+0000","last_undegraded":"2024-04-25T10:06:59.965632+0000","last_fullsized":"2024-04-25T10:06:59.965632+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967269+0000","last_change":"2024-04-25T10:06:57.702505+0000","last_active":"2024-04-25T10:06:59.967269+0000","last_peered":"2024-04-25T10:06:59.967269+0000","last_clean":"2024-04-25T10:06:59.967269+0000","last_became_active":"2024-04-25T10:06:57.702181+0000","last_became_peered":"2024-04-25T10:06:57.702181+0000","last_unstale":"2024-04-25T10:06:59.967269+0000","last_undegraded":"2024-04-25T10:06:59.967269+0000","last_fullsized":"2024-04-25T10:06:59.967269+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:22.097393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965289+0000","last_change":"2024-04-25T10:06:58.701710+0000","last_active":"2024-04-25T10:06:59.965289+0000","last_peered":"2024-04-25T10:06:59.965289+0000","last_clean":"2024-04-25T10:06:59.965289+0000","last_became_active":"2024-04-25T10:06:58.701430+0000","last_became_peered":"2024-04-25T10:06:58.701430+0000","last_unstale":"2024-04-25T10:06:59.965289+0000","last_undegraded":"2024-04-25T10:06:59.965289+0000","last_fullsized":"2024-04-25T10:06:59.965289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:22.957555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697912+0000","last_change":"2024-04-25T10:06:57.698329+0000","last_active":"2024-04-25T10:06:59.697912+0000","last_peered":"2024-04-25T10:06:59.697912+0000","last_clean":"2024-04-25T10:06:59.697912+0000","last_became_active":"2024-04-25T10:06:57.697990+0000","last_became_peered":"2024-04-25T10:06:57.697990+0000","last_unstale":"2024-04-25T10:06:59.697912+0000","last_undegraded":"2024-04-25T10:06:59.697912+0000","last_fullsized":"2024-04-25T10:06:59.697912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:24.357672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697334+0000","last_change":"2024-04-25T10:06:58.698953+0000","last_active":"2024-04-25T10:06:59.697334+0000","last_peered":"2024-04-25T10:06:59.697334+0000","last_clean":"2024-04-25T10:06:59.697334+0000","last_became_active":"2024-04-25T10:06:58.698687+0000","last_became_peered":"2024-04-25T10:06:58.698687+0000","last_unstale":"2024-04-25T10:06:59.697334+0000","last_undegraded":"2024-04-25T10:06:59.697334+0000","last_fullsized":"2024-04-25T10:06:59.697334+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:47:23.104293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"66'3","reported_seq":17,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966594+0000","last_change":"2024-04-25T10:06:57.701358+0000","last_active":"2024-04-25T10:06:59.966594+0000","last_peered":"2024-04-25T10:06:59.966594+0000","last_clean":"2024-04-25T10:06:59.966594+0000","last_became_active":"2024-04-25T10:06:57.700998+0000","last_became_peered":"2024-04-25T10:06:57.700998+0000","last_unstale":"2024-04-25T10:06:59.966594+0000","last_undegraded":"2024-04-25T10:06:59.966594+0000","last_fullsized":"2024-04-25T10:06:59.966594+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698293+0000","last_change":"2024-04-25T10:06:58.696461+0000","last_active":"2024-04-25T10:06:59.698293+0000","last_peered":"2024-04-25T10:06:59.698293+0000","last_clean":"2024-04-25T10:06:59.698293+0000","last_became_active":"2024-04-25T10:06:58.696183+0000","last_became_peered":"2024-04-25T10:06:58.696183+0000","last_unstale":"2024-04-25T10:06:59.698293+0000","last_undegraded":"2024-04-25T10:06:59.698293+0000","last_fullsized":"2024-04-25T10:06:59.698293+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"66'6","reported_seq":20,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965750+0000","last_change":"2024-04-25T10:06:57.695636+0000","last_active":"2024-04-25T10:06:59.965750+0000","last_peered":"2024-04-25T10:06:59.965750+0000","last_clean":"2024-04-25T10:06:59.965750+0000","last_became_active":"2024-04-25T10:06:57.695251+0000","last_became_peered":"2024-04-25T10:06:57.695251+0000","last_unstale":"2024-04-25T10:06:59.965750+0000","last_undegraded":"2024-04-25T10:06:59.965750+0000","last_fullsized":"2024-04-25T10:06:59.965750+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:35.319000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696578+0000","last_change":"2024-04-25T10:06:58.712359+0000","last_active":"2024-04-25T10:06:59.696578+0000","last_peered":"2024-04-25T10:06:59.696578+0000","last_clean":"2024-04-25T10:06:59.696578+0000","last_became_active":"2024-04-25T10:06:58.712062+0000","last_became_peered":"2024-04-25T10:06:58.712062+0000","last_unstale":"2024-04-25T10:06:59.696578+0000","last_undegraded":"2024-04-25T10:06:59.696578+0000","last_fullsized":"2024-04-25T10:06:59.696578+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:36.257329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966938+0000","last_change":"2024-04-25T10:06:57.699763+0000","last_active":"2024-04-25T10:06:59.966938+0000","last_peered":"2024-04-25T10:06:59.966938+0000","last_clean":"2024-04-25T10:06:59.966938+0000","last_became_active":"2024-04-25T10:06:57.699453+0000","last_became_peered":"2024-04-25T10:06:57.699453+0000","last_unstale":"2024-04-25T10:06:59.966938+0000","last_undegraded":"2024-04-25T10:06:59.966938+0000","last_fullsized":"2024-04-25T10:06:59.966938+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:37.795052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966159+0000","last_change":"2024-04-25T10:06:58.707487+0000","last_active":"2024-04-25T10:06:59.966159+0000","last_peered":"2024-04-25T10:06:59.966159+0000","last_clean":"2024-04-25T10:06:59.966159+0000","last_became_active":"2024-04-25T10:06:58.706159+0000","last_became_peered":"2024-04-25T10:06:58.706159+0000","last_unstale":"2024-04-25T10:06:59.966159+0000","last_undegraded":"2024-04-25T10:06:59.966159+0000","last_fullsized":"2024-04-25T10:06:59.966159+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:48.227758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967305+0000","last_change":"2024-04-25T10:06:57.699687+0000","last_active":"2024-04-25T10:06:59.967305+0000","last_peered":"2024-04-25T10:06:59.967305+0000","last_clean":"2024-04-25T10:06:59.967305+0000","last_became_active":"2024-04-25T10:06:57.699195+0000","last_became_peered":"2024-04-25T10:06:57.699195+0000","last_unstale":"2024-04-25T10:06:59.967305+0000","last_undegraded":"2024-04-25T10:06:59.967305+0000","last_fullsized":"2024-04-25T10:06:59.967305+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:58:08.371773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697852+0000","last_change":"2024-04-25T10:06:58.689239+0000","last_active":"2024-04-25T10:06:59.697852+0000","last_peered":"2024-04-25T10:06:59.697852+0000","last_clean":"2024-04-25T10:06:59.697852+0000","last_became_active":"2024-04-25T10:06:58.688969+0000","last_became_peered":"2024-04-25T10:06:58.688969+0000","last_unstale":"2024-04-25T10:06:59.697852+0000","last_undegraded":"2024-04-25T10:06:59.697852+0000","last_fullsized":"2024-04-25T10:06:59.697852+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:46:49.016155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966797+0000","last_change":"2024-04-25T10:06:57.699729+0000","last_active":"2024-04-25T10:06:59.966797+0000","last_peered":"2024-04-25T10:06:59.966797+0000","last_clean":"2024-04-25T10:06:59.966797+0000","last_became_active":"2024-04-25T10:06:57.697804+0000","last_became_peered":"2024-04-25T10:06:57.697804+0000","last_unstale":"2024-04-25T10:06:59.966797+0000","last_undegraded":"2024-04-25T10:06:59.966797+0000","last_fullsized":"2024-04-25T10:06:59.966797+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965540+0000","last_change":"2024-04-25T10:06:58.713114+0000","last_active":"2024-04-25T10:06:59.965540+0000","last_peered":"2024-04-25T10:06:59.965540+0000","last_clean":"2024-04-25T10:06:59.965540+0000","last_became_active":"2024-04-25T10:06:58.712830+0000","last_became_peered":"2024-04-25T10:06:58.712830+0000","last_unstale":"2024-04-25T10:06:59.965540+0000","last_undegraded":"2024-04-25T10:06:59.965540+0000","last_fullsized":"2024-04-25T10:06:59.965540+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"66'8","reported_seq":22,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696296+0000","last_change":"2024-04-25T10:06:57.695831+0000","last_active":"2024-04-25T10:06:59.696296+0000","last_peered":"2024-04-25T10:06:59.696296+0000","last_clean":"2024-04-25T10:06:59.696296+0000","last_became_active":"2024-04-25T10:06:57.694960+0000","last_became_peered":"2024-04-25T10:06:57.694960+0000","last_unstale":"2024-04-25T10:06:59.696296+0000","last_undegraded":"2024-04-25T10:06:59.696296+0000","last_fullsized":"2024-04-25T10:06:59.696296+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:23.245743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967097+0000","last_change":"2024-04-25T10:06:58.721709+0000","last_active":"2024-04-25T10:06:59.967097+0000","last_peered":"2024-04-25T10:06:59.967097+0000","last_clean":"2024-04-25T10:06:59.967097+0000","last_became_active":"2024-04-25T10:06:58.720942+0000","last_became_peered":"2024-04-25T10:06:58.720942+0000","last_unstale":"2024-04-25T10:06:59.967097+0000","last_undegraded":"2024-04-25T10:06:59.967097+0000","last_fullsized":"2024-04-25T10:06:59.967097+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:26.533530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966592+0000","last_change":"2024-04-25T10:06:57.701226+0000","last_active":"2024-04-25T10:06:59.966592+0000","last_peered":"2024-04-25T10:06:59.966592+0000","last_clean":"2024-04-25T10:06:59.966592+0000","last_became_active":"2024-04-25T10:06:57.700923+0000","last_became_peered":"2024-04-25T10:06:57.700923+0000","last_unstale":"2024-04-25T10:06:59.966592+0000","last_undegraded":"2024-04-25T10:06:59.966592+0000","last_fullsized":"2024-04-25T10:06:59.966592+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698092+0000","last_change":"2024-04-25T10:06:58.698155+0000","last_active":"2024-04-25T10:06:59.698092+0000","last_peered":"2024-04-25T10:06:59.698092+0000","last_clean":"2024-04-25T10:06:59.698092+0000","last_became_active":"2024-04-25T10:06:58.697758+0000","last_became_peered":"2024-04-25T10:06:58.697758+0000","last_unstale":"2024-04-25T10:06:59.698092+0000","last_undegraded":"2024-04-25T10:06:59.698092+0000","last_fullsized":"2024-04-25T10:06:59.698092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:26.616804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967177+0000","last_change":"2024-04-25T10:06:57.698613+0000","last_active":"2024-04-25T10:06:59.967177+0000","last_peered":"2024-04-25T10:06:59.967177+0000","last_clean":"2024-04-25T10:06:59.967177+0000","last_became_active":"2024-04-25T10:06:57.698073+0000","last_became_peered":"2024-04-25T10:06:57.698073+0000","last_unstale":"2024-04-25T10:06:59.967177+0000","last_undegraded":"2024-04-25T10:06:59.967177+0000","last_fullsized":"2024-04-25T10:06:59.967177+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:09.561173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697932+0000","last_change":"2024-04-25T10:06:58.698012+0000","last_active":"2024-04-25T10:06:59.697932+0000","last_peered":"2024-04-25T10:06:59.697932+0000","last_clean":"2024-04-25T10:06:59.697932+0000","last_became_active":"2024-04-25T10:06:58.697512+0000","last_became_peered":"2024-04-25T10:06:58.697512+0000","last_unstale":"2024-04-25T10:06:59.697932+0000","last_undegraded":"2024-04-25T10:06:59.697932+0000","last_fullsized":"2024-04-25T10:06:59.697932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:16.725194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"66'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966715+0000","last_change":"2024-04-25T10:06:57.701710+0000","last_active":"2024-04-25T10:06:59.966715+0000","last_peered":"2024-04-25T10:06:59.966715+0000","last_clean":"2024-04-25T10:06:59.966715+0000","last_became_active":"2024-04-25T10:06:57.701340+0000","last_became_peered":"2024-04-25T10:06:57.701340+0000","last_unstale":"2024-04-25T10:06:59.966715+0000","last_undegraded":"2024-04-25T10:06:59.966715+0000","last_fullsized":"2024-04-25T10:06:59.966715+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697192+0000","last_change":"2024-04-25T10:06:58.700861+0000","last_active":"2024-04-25T10:06:59.697192+0000","last_peered":"2024-04-25T10:06:59.697192+0000","last_clean":"2024-04-25T10:06:59.697192+0000","last_became_active":"2024-04-25T10:06:58.700159+0000","last_became_peered":"2024-04-25T10:06:58.700159+0000","last_unstale":"2024-04-25T10:06:59.697192+0000","last_undegraded":"2024-04-25T10:06:59.697192+0000","last_fullsized":"2024-04-25T10:06:59.697192+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:38.801951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964701+0000","last_change":"2024-04-25T10:06:57.686262+0000","last_active":"2024-04-25T10:06:59.964701+0000","last_peered":"2024-04-25T10:06:59.964701+0000","last_clean":"2024-04-25T10:06:59.964701+0000","last_became_active":"2024-04-25T10:06:57.685887+0000","last_became_peered":"2024-04-25T10:06:57.685887+0000","last_unstale":"2024-04-25T10:06:59.964701+0000","last_undegraded":"2024-04-25T10:06:59.964701+0000","last_fullsized":"2024-04-25T10:06:59.964701+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:05.253414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688713+0000","last_change":"2024-04-25T10:06:58.688181+0000","last_active":"2024-04-25T10:06:59.688713+0000","last_peered":"2024-04-25T10:06:59.688713+0000","last_clean":"2024-04-25T10:06:59.688713+0000","last_became_active":"2024-04-25T10:06:58.687826+0000","last_became_peered":"2024-04-25T10:06:58.687826+0000","last_unstale":"2024-04-25T10:06:59.688713+0000","last_undegraded":"2024-04-25T10:06:59.688713+0000","last_fullsized":"2024-04-25T10:06:59.688713+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:50:49.070894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688687+0000","last_change":"2024-04-25T10:06:57.687256+0000","last_active":"2024-04-25T10:06:59.688687+0000","last_peered":"2024-04-25T10:06:59.688687+0000","last_clean":"2024-04-25T10:06:59.688687+0000","last_became_active":"2024-04-25T10:06:57.686955+0000","last_became_peered":"2024-04-25T10:06:57.686955+0000","last_unstale":"2024-04-25T10:06:59.688687+0000","last_undegraded":"2024-04-25T10:06:59.688687+0000","last_fullsized":"2024-04-25T10:06:59.688687+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:28.068517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966655+0000","last_change":"2024-04-25T10:06:58.698543+0000","last_active":"2024-04-25T10:06:59.966655+0000","last_peered":"2024-04-25T10:06:59.966655+0000","last_clean":"2024-04-25T10:06:59.966655+0000","last_became_active":"2024-04-25T10:06:58.698269+0000","last_became_peered":"2024-04-25T10:06:58.698269+0000","last_unstale":"2024-04-25T10:06:59.966655+0000","last_undegraded":"2024-04-25T10:06:59.966655+0000","last_fullsized":"2024-04-25T10:06:59.966655+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:41.291663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967356+0000","last_change":"2024-04-25T10:06:57.699439+0000","last_active":"2024-04-25T10:06:59.967356+0000","last_peered":"2024-04-25T10:06:59.967356+0000","last_clean":"2024-04-25T10:06:59.967356+0000","last_became_active":"2024-04-25T10:06:57.698847+0000","last_became_peered":"2024-04-25T10:06:57.698847+0000","last_unstale":"2024-04-25T10:06:59.967356+0000","last_undegraded":"2024-04-25T10:06:59.967356+0000","last_fullsized":"2024-04-25T10:06:59.967356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:54.655593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.698010+0000","last_change":"2024-04-25T10:06:58.685134+0000","last_active":"2024-04-25T10:06:59.698010+0000","last_peered":"2024-04-25T10:06:59.698010+0000","last_clean":"2024-04-25T10:06:59.698010+0000","last_became_active":"2024-04-25T10:06:58.684392+0000","last_became_peered":"2024-04-25T10:06:58.684392+0000","last_unstale":"2024-04-25T10:06:59.698010+0000","last_undegraded":"2024-04-25T10:06:59.698010+0000","last_fullsized":"2024-04-25T10:06:59.698010+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:35.260260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688796+0000","last_change":"2024-04-25T10:06:57.690397+0000","last_active":"2024-04-25T10:06:59.688796+0000","last_peered":"2024-04-25T10:06:59.688796+0000","last_clean":"2024-04-25T10:06:59.688796+0000","last_became_active":"2024-04-25T10:06:57.690018+0000","last_became_peered":"2024-04-25T10:06:57.690018+0000","last_unstale":"2024-04-25T10:06:59.688796+0000","last_undegraded":"2024-04-25T10:06:59.688796+0000","last_fullsized":"2024-04-25T10:06:59.688796+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:40.284763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.688987+0000","last_change":"2024-04-25T10:06:58.693304+0000","last_active":"2024-04-25T10:06:59.688987+0000","last_peered":"2024-04-25T10:06:59.688987+0000","last_clean":"2024-04-25T10:06:59.688987+0000","last_became_active":"2024-04-25T10:06:58.692927+0000","last_became_peered":"2024-04-25T10:06:58.692927+0000","last_unstale":"2024-04-25T10:06:59.688987+0000","last_undegraded":"2024-04-25T10:06:59.688987+0000","last_fullsized":"2024-04-25T10:06:59.688987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:18:53.579162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"66'2","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966781+0000","last_change":"2024-04-25T10:06:57.696956+0000","last_active":"2024-04-25T10:06:59.966781+0000","last_peered":"2024-04-25T10:06:59.966781+0000","last_clean":"2024-04-25T10:06:59.966781+0000","last_became_active":"2024-04-25T10:06:57.696670+0000","last_became_peered":"2024-04-25T10:06:57.696670+0000","last_unstale":"2024-04-25T10:06:59.966781+0000","last_undegraded":"2024-04-25T10:06:59.966781+0000","last_fullsized":"2024-04-25T10:06:59.966781+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965607+0000","last_change":"2024-04-25T10:06:58.698761+0000","last_active":"2024-04-25T10:06:59.965607+0000","last_peered":"2024-04-25T10:06:59.965607+0000","last_clean":"2024-04-25T10:06:59.965607+0000","last_became_active":"2024-04-25T10:06:58.698485+0000","last_became_peered":"2024-04-25T10:06:58.698485+0000","last_unstale":"2024-04-25T10:06:59.965607+0000","last_undegraded":"2024-04-25T10:06:59.965607+0000","last_fullsized":"2024-04-25T10:06:59.965607+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:47.328920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"67'1","reported_seq":15,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967246+0000","last_change":"2024-04-25T10:06:57.691781+0000","last_active":"2024-04-25T10:06:59.967246+0000","last_peered":"2024-04-25T10:06:59.967246+0000","last_clean":"2024-04-25T10:06:59.967246+0000","last_became_active":"2024-04-25T10:06:57.690812+0000","last_became_peered":"2024-04-25T10:06:57.690812+0000","last_unstale":"2024-04-25T10:06:59.967246+0000","last_undegraded":"2024-04-25T10:06:59.967246+0000","last_fullsized":"2024-04-25T10:06:59.967246+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:35.250429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967038+0000","last_change":"2024-04-25T10:06:58.708252+0000","last_active":"2024-04-25T10:06:59.967038+0000","last_peered":"2024-04-25T10:06:59.967038+0000","last_clean":"2024-04-25T10:06:59.967038+0000","last_became_active":"2024-04-25T10:06:58.707939+0000","last_became_peered":"2024-04-25T10:06:58.707939+0000","last_unstale":"2024-04-25T10:06:59.967038+0000","last_undegraded":"2024-04-25T10:06:59.967038+0000","last_fullsized":"2024-04-25T10:06:59.967038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:14.683203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.689071+0000","last_change":"2024-04-25T10:06:57.688349+0000","last_active":"2024-04-25T10:06:59.689071+0000","last_peered":"2024-04-25T10:06:59.689071+0000","last_clean":"2024-04-25T10:06:59.689071+0000","last_became_active":"2024-04-25T10:06:57.688060+0000","last_became_peered":"2024-04-25T10:06:57.688060+0000","last_unstale":"2024-04-25T10:06:59.689071+0000","last_undegraded":"2024-04-25T10:06:59.689071+0000","last_fullsized":"2024-04-25T10:06:59.689071+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:13.676304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697349+0000","last_change":"2024-04-25T10:06:58.701071+0000","last_active":"2024-04-25T10:06:59.697349+0000","last_peered":"2024-04-25T10:06:59.697349+0000","last_clean":"2024-04-25T10:06:59.697349+0000","last_became_active":"2024-04-25T10:06:58.700600+0000","last_became_peered":"2024-04-25T10:06:58.700600+0000","last_unstale":"2024-04-25T10:06:59.697349+0000","last_undegraded":"2024-04-25T10:06:59.697349+0000","last_fullsized":"2024-04-25T10:06:59.697349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:30.780192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965841+0000","last_change":"2024-04-25T10:06:57.695574+0000","last_active":"2024-04-25T10:06:59.965841+0000","last_peered":"2024-04-25T10:06:59.965841+0000","last_clean":"2024-04-25T10:06:59.965841+0000","last_became_active":"2024-04-25T10:06:57.694766+0000","last_became_peered":"2024-04-25T10:06:57.694766+0000","last_unstale":"2024-04-25T10:06:59.965841+0000","last_undegraded":"2024-04-25T10:06:59.965841+0000","last_fullsized":"2024-04-25T10:06:59.965841+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:25.666096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696682+0000","last_change":"2024-04-25T10:06:58.690072+0000","last_active":"2024-04-25T10:06:59.696682+0000","last_peered":"2024-04-25T10:06:59.696682+0000","last_clean":"2024-04-25T10:06:59.696682+0000","last_became_active":"2024-04-25T10:06:58.689759+0000","last_became_peered":"2024-04-25T10:06:58.689759+0000","last_unstale":"2024-04-25T10:06:59.696682+0000","last_undegraded":"2024-04-25T10:06:59.696682+0000","last_fullsized":"2024-04-25T10:06:59.696682+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.967052+0000","last_change":"2024-04-25T10:06:57.699267+0000","last_active":"2024-04-25T10:06:59.967052+0000","last_peered":"2024-04-25T10:06:59.967052+0000","last_clean":"2024-04-25T10:06:59.967052+0000","last_became_active":"2024-04-25T10:06:57.698971+0000","last_became_peered":"2024-04-25T10:06:57.698971+0000","last_unstale":"2024-04-25T10:06:59.967052+0000","last_undegraded":"2024-04-25T10:06:59.967052+0000","last_fullsized":"2024-04-25T10:06:59.967052+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:26.676078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.696644+0000","last_change":"2024-04-25T10:06:58.716464+0000","last_active":"2024-04-25T10:06:59.696644+0000","last_peered":"2024-04-25T10:06:59.696644+0000","last_clean":"2024-04-25T10:06:59.696644+0000","last_became_active":"2024-04-25T10:06:58.716201+0000","last_became_peered":"2024-04-25T10:06:58.716201+0000","last_unstale":"2024-04-25T10:06:59.696644+0000","last_undegraded":"2024-04-25T10:06:59.696644+0000","last_fullsized":"2024-04-25T10:06:59.696644+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:16:55.662493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964501+0000","last_change":"2024-04-25T10:06:57.695875+0000","last_active":"2024-04-25T10:06:59.964501+0000","last_peered":"2024-04-25T10:06:59.964501+0000","last_clean":"2024-04-25T10:06:59.964501+0000","last_became_active":"2024-04-25T10:06:57.695300+0000","last_became_peered":"2024-04-25T10:06:57.695300+0000","last_unstale":"2024-04-25T10:06:59.964501+0000","last_undegraded":"2024-04-25T10:06:59.964501+0000","last_fullsized":"2024-04-25T10:06:59.964501+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:12.751178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965349+0000","last_change":"2024-04-25T10:06:58.700662+0000","last_active":"2024-04-25T10:06:59.965349+0000","last_peered":"2024-04-25T10:06:59.965349+0000","last_clean":"2024-04-25T10:06:59.965349+0000","last_became_active":"2024-04-25T10:06:58.700339+0000","last_became_peered":"2024-04-25T10:06:58.700339+0000","last_unstale":"2024-04-25T10:06:59.965349+0000","last_undegraded":"2024-04-25T10:06:59.965349+0000","last_fullsized":"2024-04-25T10:06:59.965349+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:53.934702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964573+0000","last_change":"2024-04-25T10:06:57.683425+0000","last_active":"2024-04-25T10:06:59.964573+0000","last_peered":"2024-04-25T10:06:59.964573+0000","last_clean":"2024-04-25T10:06:59.964573+0000","last_became_active":"2024-04-25T10:06:57.683160+0000","last_became_peered":"2024-04-25T10:06:57.683160+0000","last_unstale":"2024-04-25T10:06:59.964573+0000","last_undegraded":"2024-04-25T10:06:59.964573+0000","last_fullsized":"2024-04-25T10:06:59.964573+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:30.076875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965117+0000","last_change":"2024-04-25T10:06:58.704305+0000","last_active":"2024-04-25T10:06:59.965117+0000","last_peered":"2024-04-25T10:06:59.965117+0000","last_clean":"2024-04-25T10:06:59.965117+0000","last_became_active":"2024-04-25T10:06:58.703953+0000","last_became_peered":"2024-04-25T10:06:58.703953+0000","last_unstale":"2024-04-25T10:06:59.965117+0000","last_undegraded":"2024-04-25T10:06:59.965117+0000","last_fullsized":"2024-04-25T10:06:59.965117+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:44.631655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.965096+0000","last_change":"2024-04-25T10:06:57.691893+0000","last_active":"2024-04-25T10:06:59.965096+0000","last_peered":"2024-04-25T10:06:59.965096+0000","last_clean":"2024-04-25T10:06:59.965096+0000","last_became_active":"2024-04-25T10:06:57.691599+0000","last_became_peered":"2024-04-25T10:06:57.691599+0000","last_unstale":"2024-04-25T10:06:59.965096+0000","last_undegraded":"2024-04-25T10:06:59.965096+0000","last_fullsized":"2024-04-25T10:06:59.965096+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:31.431194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.697038+0000","last_change":"2024-04-25T10:06:58.702014+0000","last_active":"2024-04-25T10:06:59.697038+0000","last_peered":"2024-04-25T10:06:59.697038+0000","last_clean":"2024-04-25T10:06:59.697038+0000","last_became_active":"2024-04-25T10:06:58.701696+0000","last_became_peered":"2024-04-25T10:06:58.701696+0000","last_unstale":"2024-04-25T10:06:59.697038+0000","last_undegraded":"2024-04-25T10:06:59.697038+0000","last_fullsized":"2024-04-25T10:06:59.697038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:57.662849+0000","last_clean_scrub_stamp":"2024-04-25T10:06:57.662849+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:27.682978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.964267+0000","last_change":"2024-04-25T10:06:57.685927+0000","last_active":"2024-04-25T10:06:59.964267+0000","last_peered":"2024-04-25T10:06:59.964267+0000","last_clean":"2024-04-25T10:06:59.964267+0000","last_became_active":"2024-04-25T10:06:57.685624+0000","last_became_peered":"2024-04-25T10:06:57.685624+0000","last_unstale":"2024-04-25T10:06:59.964267+0000","last_undegraded":"2024-04-25T10:06:59.964267+0000","last_fullsized":"2024-04-25T10:06:59.964267+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:06:56.655949+0000","last_clean_scrub_stamp":"2024-04-25T10:06:56.655949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:27.308952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":254,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-25T10:06:59.966717+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:06:59.966717+0000","last_peered":"2024-04-25T10:06:59.966717+0000","last_clean":"2024-04-25T10:06:59.966717+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:06:59.966717+0000","last_undegraded":"2024-04-25T10:06:59.966717+0000","last_fullsized":"2024-04-25T10:06:59.966717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509484,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":955270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509485,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509483,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":364148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509482,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":365738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542188,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542187,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":364126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":831488,"data_stored":366502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542187,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1396736,"data_stored":954494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:07:07.743 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:07:07.743 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:07:07.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 Processor -- start 2024-04-25T10:07:07.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 -- start start 2024-04-25T10:07:07.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f08b8159320 0x7f08b815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806e4a0 0x7f08b806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b815fc00 con 0x7f08b815f440 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b806d640 con 0x7f08b806e4a0 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.919+0000 7f08bfa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b806ee10 con 0x7f08b8159320 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806e4a0 0x7f08b806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08b806e4a0 0x7f08b806e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45422/0 (socket says 172.21.15.18:45422) 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 -- 172.21.15.18:0/199805397 learned_addr learned my addr 172.21.15.18:0/199805397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bd000640 1 --2- 172.21.15.18:0/199805397 >> v2:172.21.15.167:3300/0 conn(0x7f08b8159320 0x7f08b815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 -- 172.21.15.18:0/199805397 >> v2:172.21.15.167:3300/0 conn(0x7f08b8159320 msgr2=0x7f08b815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 --2- 172.21.15.18:0/199805397 >> v2:172.21.15.167:3300/0 conn(0x7f08b8159320 0x7f08b815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 -- 172.21.15.18:0/199805397 >> v1:172.21.15.167:6789/0 conn(0x7f08b815f440 legacy=0x7f08b806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:07.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 -- 172.21.15.18:0/199805397 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b815fee0 con 0x7f08b806e4a0 2024-04-25T10:07:07.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08bda00640 1 --2- 172.21.15.18:0/199805397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806e4a0 0x7f08b806e8d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f08b806e470 tx=0x7f08b001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6964ac4c7b46a7f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08b7e00640 1 -- 172.21.15.18:0/199805397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00a57b0 con 0x7f08b806e4a0 2024-04-25T10:07:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08b7e00640 1 -- 172.21.15.18:0/199805397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00a5950 con 0x7f08b806e4a0 2024-04-25T10:07:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.923+0000 7f08b7e00640 1 -- 172.21.15.18:0/199805397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00a5d20 con 0x7f08b806e4a0 2024-04-25T10:07:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- 172.21.15.18:0/199805397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806e4a0 msgr2=0x7f08b806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- 172.21.15.18:0/199805397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806e4a0 0x7f08b806e8d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f08b806e470 tx=0x7f08b001c8f0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- 172.21.15.18:0/199805397 shutdown_connections 2024-04-25T10:07:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- 172.21.15.18:0/199805397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b806e4a0 0x7f08b806e8d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- 172.21.15.18:0/199805397 >> v2:172.21.15.167:3300/0 conn(0x7f08b8159320 0x7f08b815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- 172.21.15.18:0/199805397 >> 172.21.15.18:0/199805397 conn(0x7f08b8067080 msgr2=0x7f08b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:07.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- 172.21.15.18:0/199805397 shutdown_connections 2024-04-25T10:07:07.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- 172.21.15.18:0/199805397 wait complete. 2024-04-25T10:07:07.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 Processor -- start 2024-04-25T10:07:07.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- start start 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b806e4a0 0x7f08b8157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8159320 0x7f08b80b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8159700 con 0x7f08b815f440 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815f8a0 con 0x7f08b806e4a0 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bfa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b8168590 con 0x7f08b8159320 2024-04-25T10:07:07.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45436/0 (socket says 172.21.15.18:45436) 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 -- 172.21.15.18:0/1761877850 learned_addr learned my addr 172.21.15.18:0/1761877850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08afe00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8159320 0x7f08b80b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bd000640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b806e4a0 0x7f08b8157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 -- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8159320 msgr2=0x7f08b80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8159320 0x7f08b80b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 -- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b806e4a0 msgr2=0x7f08b8157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b806e4a0 0x7f08b8157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 -- 172.21.15.18:0/1761877850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b8157f90 con 0x7f08b815f440 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.927+0000 7f08bda00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f08b00af040 tx=0x7f08b0019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00bc020 con 0x7f08b815f440 2024-04-25T10:07:07.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b00b8670 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b00b8a40 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b8144480 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b80af750 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80af540 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08b00bf020 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 0x7f0894069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f08b011fb20 con 0x7f08b815f440 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.931+0000 7f08bd000640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 0x7f0894069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:07.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.935+0000 7f08bd000640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 0x7f0894069450 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007a60 tx=0x7f08a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:07.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:07.935+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08b00c7020 con 0x7f08b815f440 2024-04-25T10:07:08.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.155+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f08b80745d0 con 0x7f08b815f440 2024-04-25T10:07:08.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08b5600640 1 -- 172.21.15.18:0/1761877850 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f08b00165a0 con 0x7f08b815f440 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:07:08.166 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:07:08.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 msgr2=0x7f0894069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 0x7f0894069450 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08a8007a60 tx=0x7f08a8008040 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 msgr2=0x7f08b80b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f08b00af040 tx=0x7f08b0019690 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 shutdown_connections 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08b815f440 0x7f08b80b1f40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0894066f90 0x7f0894069450 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f08b8159320 0x7f08b80b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 --2- 172.21.15.18:0/1761877850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b806e4a0 0x7f08b8157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 >> 172.21.15.18:0/1761877850 conn(0x7f08b8067080 msgr2=0x7f08b806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 shutdown_connections 2024-04-25T10:07:08.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.159+0000 7f08bfa00640 1 -- 172.21.15.18:0/1761877850 wait complete. 2024-04-25T10:07:08.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:07:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.319+0000 7f32bf200640 1 Processor -- start 2024-04-25T10:07:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.319+0000 7f32bf200640 1 -- start start 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bf200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 0x7f32b815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bf200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32b80cd4d0 0x7f32b80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bf200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80cc4e0 con 0x7f32b80b1750 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bf200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b8145650 con 0x7f32b80cd4d0 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bf200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b80ce040 con 0x7f32b8145270 2024-04-25T10:07:08.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32b80cd4d0 0x7f32b80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32b80cd4d0 0x7f32b80cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45450/0 (socket says 172.21.15.18:45450) 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 -- 172.21.15.18:0/3205120535 learned_addr learned my addr 172.21.15.18:0/3205120535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32bd200640 1 --1- 172.21.15.18:0/3205120535 >> v1:172.21.15.18:6789/0 conn(0x7f32b80b1750 0x7f32b80b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59506/0 (socket says 172.21.15.18:59506) 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32b7e00640 1 --2- 172.21.15.18:0/3205120535 >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 0x7f32b815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 -- 172.21.15.18:0/3205120535 >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 msgr2=0x7f32b815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 --2- 172.21.15.18:0/3205120535 >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 0x7f32b815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 -- 172.21.15.18:0/3205120535 >> v1:172.21.15.18:6789/0 conn(0x7f32b80b1750 legacy=0x7f32b80b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 -- 172.21.15.18:0/3205120535 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80ce320 con 0x7f32b80cd4d0 2024-04-25T10:07:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32b7e00640 1 --2- 172.21.15.18:0/3205120535 >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 0x7f32b815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32b7400640 1 -- 172.21.15.18:0/3205120535 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4030988112 0 0) 0x7f32b80cc4e0 con 0x7f32b80b1750 2024-04-25T10:07:08.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.323+0000 7f32af400640 1 --2- 172.21.15.18:0/3205120535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b80cd4d0 0x7f32b80cd930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f32b806f3a0 tx=0x7f32a001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0695349645180d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:08.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32b7400640 1 -- 172.21.15.18:0/3205120535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00ab610 con 0x7f32b80cd4d0 2024-04-25T10:07:08.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32b7400640 1 -- 172.21.15.18:0/3205120535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a00b0070 con 0x7f32b80cd4d0 2024-04-25T10:07:08.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32b7400640 1 -- 172.21.15.18:0/3205120535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00ab9d0 con 0x7f32b80cd4d0 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- 172.21.15.18:0/3205120535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b80cd4d0 msgr2=0x7f32b80cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- 172.21.15.18:0/3205120535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b80cd4d0 0x7f32b80cd930 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f32b806f3a0 tx=0x7f32a001c520 comp rx=0 tx=0).stop 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- 172.21.15.18:0/3205120535 shutdown_connections 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- 172.21.15.18:0/3205120535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b80cd4d0 0x7f32b80cd930 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- 172.21.15.18:0/3205120535 >> v2:172.21.15.167:3300/0 conn(0x7f32b8145270 0x7f32b815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- 172.21.15.18:0/3205120535 >> 172.21.15.18:0/3205120535 conn(0x7f32b8066fa0 msgr2=0x7f32b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:08.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- 172.21.15.18:0/3205120535 shutdown_connections 2024-04-25T10:07:08.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- 172.21.15.18:0/3205120535 wait complete. 2024-04-25T10:07:08.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 Processor -- start 2024-04-25T10:07:08.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- start start 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32b80b1750 0x7f32b8141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32b80cd4d0 0x7f32b81584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b815c710 con 0x7f32b8145270 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b815c590 con 0x7f32b80b1750 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bf200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b815c890 con 0x7f32b80cd4d0 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.327+0000 7f32bd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45462/0 (socket says 172.21.15.18:45462) 2024-04-25T10:07:08.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 -- 172.21.15.18:0/3933371479 learned_addr learned my addr 172.21.15.18:0/3933371479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32b7e00640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32b80b1750 0x7f32b8141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32af400640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32b80cd4d0 0x7f32b81584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 -- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32b80cd4d0 msgr2=0x7f32b81584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32b80cd4d0 0x7f32b81584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 -- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32b80b1750 msgr2=0x7f32b8141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32b80b1750 0x7f32b8141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 -- 172.21.15.18:0/3933371479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8141b80 con 0x7f32b8145270 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bd200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c7a0 tx=0x7f32b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b0018070 con 0x7f32b8145270 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b000a640 con 0x7f32b8145270 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b000aab0 con 0x7f32b8145270 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b815a490 con 0x7f32b8145270 2024-04-25T10:07:08.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b813f800 con 0x7f32b8145270 2024-04-25T10:07:08.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b80745d0 con 0x7f32b8145270 2024-04-25T10:07:08.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.331+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32b000ac50 con 0x7f32b8145270 2024-04-25T10:07:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.335+0000 7f32b4c00640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.335+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f32b0084810 con 0x7f32b8145270 2024-04-25T10:07:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.335+0000 7f32b7e00640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.335+0000 7f32b7e00640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 0x7f3294069420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32a80045f0 tx=0x7f32a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.339+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32b0054fa0 con 0x7f32b8145270 2024-04-25T10:07:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.535+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32b806b8e0 con 0x7f32b8145270 2024-04-25T10:07:08.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32b4c00640 1 -- 172.21.15.18:0/3933371479 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f32b0059040 con 0x7f32b8145270 2024-04-25T10:07:08.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:08.546 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:01.082291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:07:08.546 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 36 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 msgr2=0x7f3294069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 0x7f3294069420 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f32a80045f0 tx=0x7f32a8008040 comp rx=0 tx=0).stop 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 msgr2=0x7f32b8159810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32b000c7a0 tx=0x7f32b000cc60 comp rx=0 tx=0).stop 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 shutdown_connections 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32b8145270 0x7f32b8159810 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3294066f60 0x7f3294069420 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32b80cd4d0 0x7f32b81584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 --2- 172.21.15.18:0/3933371479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32b80b1750 0x7f32b8141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 >> 172.21.15.18:0/3933371479 conn(0x7f32b8066fa0 msgr2=0x7f32b8143130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 shutdown_connections 2024-04-25T10:07:08.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:08.539+0000 7f32bf200640 1 -- 172.21.15.18:0/3933371479 wait complete. 2024-04-25T10:07:08.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:06:58.075161+0000', 'modified': '2024-04-25T10:07:01.082291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35462}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35462': {'gid': 35462, 'name': 'b', 'rank': 0, 'incarnation': 32, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6837/343490040', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 343490040}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 343490040}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:07:08.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:07:08.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T10:07:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 Processor -- start 2024-04-25T10:07:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 -- start start 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57f00cc2d0 0x7f57f00b4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00b5310 con 0x7f57f015b7b0 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f00b4a70 con 0x7f57f015fa90 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.107+0000 7f57f7800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f015f600 con 0x7f57f00cc2d0 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57e7e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57f00cc2d0 0x7f57f00b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57f4e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f57f015b7b0 0x7f57f006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59512/0 (socket says 172.21.15.18:59512) 2024-04-25T10:07:09.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57f4e00640 1 -- 172.21.15.18:0/1952021389 learned_addr learned my addr 172.21.15.18:0/1952021389 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:09.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57e7e00640 1 -- 172.21.15.18:0/1952021389 >> v1:172.21.15.167:6789/0 conn(0x7f57f015fa90 legacy=0x7f57f0071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57e7e00640 1 -- 172.21.15.18:0/1952021389 >> v1:172.21.15.18:6789/0 conn(0x7f57f015b7b0 legacy=0x7f57f006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57e7e00640 1 -- 172.21.15.18:0/1952021389 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f00b4d50 con 0x7f57f00cc2d0 2024-04-25T10:07:09.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57efe00640 1 -- 172.21.15.18:0/1952021389 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951463687 0 0) 0x7f57f00b5310 con 0x7f57f015b7b0 2024-04-25T10:07:09.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57e7e00640 1 --2- 172.21.15.18:0/1952021389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f00cc2d0 0x7f57f00b4400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097c0 tx=0x7f57d801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc34adc85c2baa4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57efe00640 1 -- 172.21.15.18:0/1952021389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80b0070 con 0x7f57f00cc2d0 2024-04-25T10:07:09.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57efe00640 1 -- 172.21.15.18:0/1952021389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80ab600 con 0x7f57f00cc2d0 2024-04-25T10:07:09.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.111+0000 7f57efe00640 1 -- 172.21.15.18:0/1952021389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80ab9d0 con 0x7f57f00cc2d0 2024-04-25T10:07:09.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- 172.21.15.18:0/1952021389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f00cc2d0 msgr2=0x7f57f00b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 --2- 172.21.15.18:0/1952021389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f00cc2d0 0x7f57f00b4400 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f57d80097c0 tx=0x7f57d801c3e0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- 172.21.15.18:0/1952021389 shutdown_connections 2024-04-25T10:07:09.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 --2- 172.21.15.18:0/1952021389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f00cc2d0 0x7f57f00b4400 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- 172.21.15.18:0/1952021389 >> 172.21.15.18:0/1952021389 conn(0x7f57f00cfd90 msgr2=0x7f57f00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- 172.21.15.18:0/1952021389 shutdown_connections 2024-04-25T10:07:09.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- 172.21.15.18:0/1952021389 wait complete. 2024-04-25T10:07:09.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 Processor -- start 2024-04-25T10:07:09.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- start start 2024-04-25T10:07:09.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 0x7f57f0150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 0x7f57f0155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f015bd10 con 0x7f57f015b7b0 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f015bb90 con 0x7f57f015fa90 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0072210 con 0x7f57f00cc2d0 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45478/0 (socket says 172.21.15.18:45478) 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 -- 172.21.15.18:0/3372585178 learned_addr learned my addr 172.21.15.18:0/3372585178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f4e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 0x7f57f0150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f5800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 0x7f57f0155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 -- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 msgr2=0x7f57f0150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 0x7f57f0150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 -- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 msgr2=0x7f57f0155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 0x7f57f0155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57e7e00640 1 -- 172.21.15.18:0/3372585178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f0154660 con 0x7f57f015b7b0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f4e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 0x7f57f0150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.115+0000 7f57f5800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 0x7f57f0155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57e7e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f57d80ae040 tx=0x7f57d801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57ed600640 1 -- 172.21.15.18:0/3372585178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80bb070 con 0x7f57f015b7b0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57ed600640 1 -- 172.21.15.18:0/3372585178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d8004020 con 0x7f57f015b7b0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f0154940 con 0x7f57f015b7b0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57ed600640 1 -- 172.21.15.18:0/3372585178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80b0040 con 0x7f57f015b7b0 2024-04-25T10:07:09.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f0154f00 con 0x7f57f015b7b0 2024-04-25T10:07:09.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.119+0000 7f57ed600640 1 -- 172.21.15.18:0/3372585178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57d8003620 con 0x7f57f015b7b0 2024-04-25T10:07:09.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57ed600640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 0x7f57cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57ed600640 1 -- 172.21.15.18:0/3372585178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57d811fa60 con 0x7f57f015b7b0 2024-04-25T10:07:09.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 Processor -- start 2024-04-25T10:07:09.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- start start 2024-04-25T10:07:09.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f4e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 0x7f57cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5f4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d5aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d48d5f0 con 0x55e00d5aa720 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d3f4da0 con 0x55e00d5f46a0 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00d37d150 con 0x55e00d5f3d80 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f4e00640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 0x7f57cc069420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f57e0000f70 tx=0x7f57e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45490/0 (socket says 172.21.15.18:45490) 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 -- 172.21.15.18:0/2038465527 learned_addr learned my addr 172.21.15.18:0/2038465527 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f4e00640 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57e7e00640 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d5aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 -- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 msgr2=0x55e00d5f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 -- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 msgr2=0x55e00d5aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d5aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 -- 172.21.15.18:0/2038465527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d396ca0 con 0x55e00d5aa720 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57f5800640 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f57e8001da0 tx=0x7f57e800d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e161e6913f4c923c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57e5600640 1 -- 172.21.15.18:0/2038465527 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8018070 con 0x55e00d5aa720 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57e5600640 1 -- 172.21.15.18:0/2038465527 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e8003db0 con 0x55e00d5aa720 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57e5600640 1 -- 172.21.15.18:0/2038465527 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e800db80 con 0x55e00d5aa720 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- 172.21.15.18:0/2038465527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 msgr2=0x55e00d5aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f57e8001da0 tx=0x7f57e800d150 comp rx=0 tx=0).stop 2024-04-25T10:07:09.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- 172.21.15.18:0/2038465527 shutdown_connections 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5aa720 0x55e00d5aab00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d5aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2038465527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- 172.21.15.18:0/2038465527 >> 172.21.15.18:0/2038465527 conn(0x55e00d5a66d0 msgr2=0x55e00d5a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- 172.21.15.18:0/2038465527 shutdown_connections 2024-04-25T10:07:09.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.123+0000 7f57fabc6000 1 -- 172.21.15.18:0/2038465527 wait complete. 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- start start 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 Processor -- start 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d5fb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5fb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d3af990 con 0x55e00d5f46a0 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d3f0e40 con 0x55e00d5aa720 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00d3f40b0 con 0x55e00d5f3d80 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 10 client.0 _ll_register_callbacks cb 0x55e00d4a81c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45496/0 (socket says 172.21.15.18:45496) 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 -- 172.21.15.18:0/2245166761 learned_addr learned my addr 172.21.15.18:0/2245166761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57e7e00640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5fb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f4e00640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d5fb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 -- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 msgr2=0x55e00d5fb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5fb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 -- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 msgr2=0x55e00d5fb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d5fb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 -- 172.21.15.18:0/2245166761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00d3ad630 con 0x55e00d5f46a0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f4e00640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d5fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57f5800640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009010 tx=0x7f57e8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8cad68f36a8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8022020 con 0x55e00d5f46a0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57e8003db0 con 0x55e00d5f46a0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57e8013470 con 0x55e00d5f46a0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e802c050 con 0x55e00d5f46a0 2024-04-25T10:07:09.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 10 client.6402 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55e00d37d3a0 con 0x55e00d5f46a0 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e8003db0 con 0x55e00d5f46a0 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f57e802f020 con 0x55e00d5f46a0 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 10 client.6402 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 10 client.6402 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 20 client.6402 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d602e00 0x55e00d6051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 4 client.6402 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.127+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e00d390a50 con 0x55e00d602e00 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57f4e00640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d602e00 0x55e00d6051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57f4e00640 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d602e00 0x55e00d6051f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec3a0667fa10d682 server_cookie=df256f37a8bf4392 in_seq=0 out_seq=0 2024-04-25T10:07:09.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57de000640 10 client.6402 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57de000640 1 -- 172.21.15.18:0/2245166761 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e00d390a50 con 0x55e00d602e00 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57de000640 10 client.6402 handle_command_reply: tid=0 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 client.6402 shutdown 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 msgr2=0x55e00d6000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009010 tx=0x7f57e8001260 comp rx=0 tx=0).stop 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 shutdown_connections 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d602e00 0x55e00d6051f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f46a0 0x55e00d6000f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f3d80 0x55e00d5fb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 --2- 172.21.15.18:0/2245166761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d5fb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57de000640 0 client.6402 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:09.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 >> 172.21.15.18:0/2245166761 conn(0x55e00d5a66d0 msgr2=0x55e00d5ab390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 shutdown_connections 2024-04-25T10:07:09.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 1 -- 172.21.15.18:0/2245166761 wait complete. 2024-04-25T10:07:09.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.131+0000 7f57fabc6000 20 client.6402 trim_cache size 0 max 16384 2024-04-25T10:07:09.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 Processor -- start 2024-04-25T10:07:09.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 -- start start 2024-04-25T10:07:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d64e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f46a0 0x55e00d64f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006f470 con 0x55e00d5f3d80 2024-04-25T10:07:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f0148f80 con 0x55e00d5aa720 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f006ee70 con 0x55e00d5f46a0 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45506/0 (socket says 172.21.15.18:45506) 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 -- 172.21.15.18:0/1709589047 learned_addr learned my addr 172.21.15.18:0/1709589047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57f4e00640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d64e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57f5800640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f46a0 0x55e00d64f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 -- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f46a0 msgr2=0x55e00d64f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f46a0 0x55e00d64f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 -- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 msgr2=0x55e00d64e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d64e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 -- 172.21.15.18:0/1709589047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00d476600 con 0x55e00d5f3d80 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57f4e00640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d64e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e7e00640 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f57d80ec7a0 tx=0x7f57d8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de51c5da9be5b6d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e4c00640 1 -- 172.21.15.18:0/1709589047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80f0a90 con 0x55e00d5f3d80 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e4c00640 1 -- 172.21.15.18:0/1709589047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80f0390 con 0x55e00d5f3d80 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.147+0000 7f57e4c00640 1 -- 172.21.15.18:0/1709589047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d80f44e0 con 0x55e00d5f3d80 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/1709589047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 msgr2=0x55e00d64ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f57d80ec7a0 tx=0x7f57d8009190 comp rx=0 tx=0).stop 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/1709589047 shutdown_connections 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5f46a0 0x55e00d64f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d5f3d80 0x55e00d64ebd0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- 172.21.15.18:0/1709589047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5aa720 0x55e00d64e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/1709589047 >> 172.21.15.18:0/1709589047 conn(0x55e00d5a66d0 msgr2=0x55e00d5a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/1709589047 shutdown_connections 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/1709589047 wait complete. 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- start start 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 Processor -- start 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 0x55e00d608d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d653bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d38d750 con 0x55e00d6540f0 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00d3f93d0 con 0x55e00d5f46a0 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e00d39a4b0 con 0x55e00d5aa720 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 10 client.0 _ll_register_callbacks cb 0x7f57e8001610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 0x55e00d608d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 0x55e00d608d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50632/0 (socket says 172.21.15.18:50632) 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45520/0 (socket says 172.21.15.18:45520) 2024-04-25T10:07:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57e7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d653bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f4e00640 1 -- 172.21.15.18:0/741858905 learned_addr learned my addr 172.21.15.18:0/741858905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 -- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 msgr2=0x55e00d608d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 0x55e00d608d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 -- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 msgr2=0x55e00d653bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d653bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 -- 172.21.15.18:0/741858905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e00d3899b0 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57f5800640 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f57e80012f0 tx=0x7f57e8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c18600cf834c601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57de000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8022070 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f57e80016f0 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57d80f0390 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57e803c050 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 10 client.6408 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.151+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55e00d39c0b0 con 0x55e00d6540f0 2024-04-25T10:07:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d80f0390 con 0x55e00d6540f0 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f57e803f020 con 0x55e00d6540f0 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 10 client.6408 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 10 client.6408 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 20 client.6408 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d650560 0x55e00d650940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 4 client.6408 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e00d4022e0 con 0x55e00d650560 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f4e00640 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d650560 0x55e00d650940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f4e00640 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d650560 0x55e00d650940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b82ff387c79144c server_cookie=effa2323de4d5cb3 in_seq=0 out_seq=0 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 10 client.6408 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 1 -- 172.21.15.18:0/741858905 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55e00d4022e0 con 0x55e00d650560 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 10 client.6408 handle_command_reply: tid=0 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 client.6408 shutdown 2024-04-25T10:07:09.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 msgr2=0x55e00d6544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f57e80012f0 tx=0x7f57e8009040 comp rx=0 tx=0).stop 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 shutdown_connections 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e00d650560 0x55e00d650940 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e00d6540f0 0x55e00d6544d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00d5f46a0 0x55e00d653bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 --2- 172.21.15.18:0/741858905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e00d5aa720 0x55e00d608d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57de000640 0 client.6408 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 >> 172.21.15.18:0/741858905 conn(0x55e00d5a66d0 msgr2=0x55e00d5a9350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 shutdown_connections 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 1 -- 172.21.15.18:0/741858905 wait complete. 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57fabc6000 20 client.6408 trim_cache size 0 max 16384 2024-04-25T10:07:09.171 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 35462, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 10.482812439, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 36, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 67, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 67, 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 22.327117807 2024-04-25T10:07:09.172 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 msgr2=0x7f57cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 0x7f57cc069420 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f57e0000f70 tx=0x7f57e0009040 comp rx=0 tx=0).stop 2024-04-25T10:07:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 msgr2=0x7f57f0153ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f57d80ae040 tx=0x7f57d801ac20 comp rx=0 tx=0).stop 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 shutdown_connections 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f57f015fa90 0x7f57f0155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57f015b7b0 0x7f57f0153ef0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f57cc066f60 0x7f57cc069420 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 --2- 172.21.15.18:0/3372585178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f57f00cc2d0 0x7f57f0150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 >> 172.21.15.18:0/3372585178 conn(0x7f57f00cfd90 msgr2=0x7f57f00ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 shutdown_connections 2024-04-25T10:07:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.155+0000 7f57f7800640 1 -- 172.21.15.18:0/3372585178 wait complete. 2024-04-25T10:07:09.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:07:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 Processor -- start 2024-04-25T10:07:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 -- start start 2024-04-25T10:07:09.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20dc0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0cc4e0 con 0x7f20dc145270 2024-04-25T10:07:09.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20dc0ce040 con 0x7f20dc0b1c90 2024-04-25T10:07:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.315+0000 7f20e3400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0b20e0 con 0x7f20dc15fe50 2024-04-25T10:07:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20e0a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f20dc145270 0x7f20dc0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59516/0 (socket says 172.21.15.18:59516) 2024-04-25T10:07:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20e0a00640 1 -- 172.21.15.18:0/2268324143 learned_addr learned my addr 172.21.15.18:0/2268324143 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:09.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20dc0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226383522 0 0) 0x7f20dc0cc4e0 con 0x7f20dc145270 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20c0003530 con 0x7f20dc145270 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4039240073 0 0) 0x7f20c0003530 con 0x7f20dc145270 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 msgr2=0x7f20dc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20dc0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 >> v1:172.21.15.167:6789/0 conn(0x7f20dc0b1c90 legacy=0x7f20dc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc0ce320 con 0x7f20dc145270 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f20cc001680 con 0x7f20dc145270 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 >> v1:172.21.15.18:6789/0 conn(0x7f20dc145270 legacy=0x7f20dc0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20c00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20c0003f30 0x7f20c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0004d50 0x7f20c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc0b20e0 con 0x7f20c0003f30 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20c000ba30 con 0x7f20c0004d50 2024-04-25T10:07:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20c000bc30 con 0x7f20dc15fe50 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20c0003f30 0x7f20c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20e1400640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0004d50 0x7f20c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20e0a00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20c00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 -- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 msgr2=0x7f20c00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc15fe50 0x7f20c00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 -- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0004d50 msgr2=0x7f20c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0004d50 0x7f20c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.319+0000 7f20d3e00640 1 -- 172.21.15.18:0/2268324143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20c0003530 con 0x7f20c0003f30 2024-04-25T10:07:09.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20d3e00640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20c0003f30 0x7f20c0004810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009ae0 tx=0x7f20c401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20994afbddd7ca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40b2070 con 0x7f20c0003f30 2024-04-25T10:07:09.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c40a55a0 con 0x7f20c0003f30 2024-04-25T10:07:09.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20dbe00640 1 -- 172.21.15.18:0/2268324143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40096b0 con 0x7f20c0003f30 2024-04-25T10:07:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- 172.21.15.18:0/2268324143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20c0003f30 msgr2=0x7f20c0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 --2- 172.21.15.18:0/2268324143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20c0003f30 0x7f20c0004810 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f20c4009ae0 tx=0x7f20c401c9b0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e1400640 1 -- 172.21.15.18:0/2268324143 reap_dead start 2024-04-25T10:07:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- 172.21.15.18:0/2268324143 shutdown_connections 2024-04-25T10:07:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- 172.21.15.18:0/2268324143 >> 172.21.15.18:0/2268324143 conn(0x7f20dc066fa0 msgr2=0x7f20dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- 172.21.15.18:0/2268324143 shutdown_connections 2024-04-25T10:07:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- 172.21.15.18:0/2268324143 wait complete. 2024-04-25T10:07:09.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 Processor -- start 2024-04-25T10:07:09.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.323+0000 7f20e3400640 1 -- start start 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 0x7f20dc13f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc0a93b0 0x7f20dc0a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc1602b0 con 0x7f20dc0aca60 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc145650 con 0x7f20c0003f30 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20dc15f650 con 0x7f20dc0a93b0 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45532/0 (socket says 172.21.15.18:45532) 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 -- 172.21.15.18:0/4066827033 learned_addr learned my addr 172.21.15.18:0/4066827033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20d3e00640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc0a93b0 0x7f20dc0a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e0a00640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 0x7f20dc13f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 -- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc0a93b0 msgr2=0x7f20dc0a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc0a93b0 0x7f20dc0a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 -- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 msgr2=0x7f20dc13f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 0x7f20dc13f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 -- 172.21.15.18:0/4066827033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc13fa80 con 0x7f20dc0aca60 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e0a00640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 0x7f20dc13f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e1400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0b4b90 tx=0x7f20d400ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d401a070 con 0x7f20dc0aca60 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20d4006e30 con 0x7f20dc0aca60 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20dc1efdb0 con 0x7f20dc0aca60 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d4003b80 con 0x7f20dc0aca60 2024-04-25T10:07:09.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20dc0a8bb0 con 0x7f20dc0aca60 2024-04-25T10:07:09.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20dc0745d0 con 0x7f20dc0aca60 2024-04-25T10:07:09.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.327+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f20d401d070 con 0x7f20dc0aca60 2024-04-25T10:07:09.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.331+0000 7f20d9600640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 0x7f20b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:09.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.331+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f20d4087980 con 0x7f20dc0aca60 2024-04-25T10:07:09.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.331+0000 7f20e0a00640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 0x7f20b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:09.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.331+0000 7f20e0a00640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 0x7f20b8069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001060 tx=0x7f20cc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:09.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.335+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f20d4058110 con 0x7f20dc0aca60 2024-04-25T10:07:09.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20dc06b8e0 con 0x7f20dc0aca60 2024-04-25T10:07:09.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20d9600640 1 -- 172.21.15.18:0/4066827033 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f20d405c1b0 con 0x7f20dc0aca60 2024-04-25T10:07:09.539 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 msgr2=0x7f20b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 0x7f20b8069420 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f20cc001060 tx=0x7f20cc009040 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 msgr2=0x7f20dc0acee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f20dc0b4b90 tx=0x7f20d400ae60 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 shutdown_connections 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20dc0aca60 0x7f20dc0acee0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f20b8066f60 0x7f20b8069420 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f20dc0a93b0 0x7f20dc0a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 --2- 172.21.15.18:0/4066827033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f20c0003f30 0x7f20dc13f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 >> 172.21.15.18:0/4066827033 conn(0x7f20dc066fa0 msgr2=0x7f20dc0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 shutdown_connections 2024-04-25T10:07:09.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:09.531+0000 7f20e3400640 1 -- 172.21.15.18:0/4066827033 wait complete. 2024-04-25T10:07:09.560 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:07:09.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:07:09.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:07:09.561 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:07:09.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.561 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.570 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42275sec preferred_lft 42275sec 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:07:09.571 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:07:09.572 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:07:09.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.573 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:07:09.634 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:07:09.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.636 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:07:09.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:07:09.691 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:07:09.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.787 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:07:09.796 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:07:09.796 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:07:09.797 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:07:09.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:07:09.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:07:09.864 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:07:09.917 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:07:09.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:07:09.917 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:07:09.968 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:07:09.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:09.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:07:10.058 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:07:10.059 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:07:10.072 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:07:10.072 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:07:10.072 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:07:10.073 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:07:10.073 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:07:10.077 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:07:10.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:10.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:07:10.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:10.098 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:07:10.168 INFO:teuthology.orchestra.run.smithi018.stdout:client35570 2024-04-25T10:07:10.168 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:07:10.168 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:07:10.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:10.217 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T10:07:10.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:10.282 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T10:07:10.337 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:07:10.338 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:07:10.338 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:07:10.338 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:07:10.338 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T10:07:10.338 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:07:10.445 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:07:10.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:07:10.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:07:10.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 Processor -- start 2024-04-25T10:07:10.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 -- start start 2024-04-25T10:07:10.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffbb40d11b0 0x7ffbb40afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 0x7ffbb40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb415ddf0 con 0x7ffbb415da10 2024-04-25T10:07:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb40b4ba0 con 0x7ffbb40d11b0 2024-04-25T10:07:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbbc400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb406b480 con 0x7ffbb40b4210 2024-04-25T10:07:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbba400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 0x7ffbb40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffbb40d11b0 0x7ffbb40afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ffbb415da10 0x7ffbb406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:39018/0 (socket says 172.21.15.18:39018) 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9a00640 1 -- 172.21.15.18:0/3097683008 learned_addr learned my addr 172.21.15.18:0/3097683008 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9000640 1 -- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 msgr2=0x7ffbb40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9000640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 0x7ffbb40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9000640 1 -- 172.21.15.18:0/3097683008 >> v1:172.21.15.167:6789/0 conn(0x7ffbb415da10 legacy=0x7ffbb406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbb9000640 1 -- 172.21.15.18:0/3097683008 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb40d06d0 con 0x7ffbb40d11b0 2024-04-25T10:07:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.631+0000 7ffbba400640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 0x7ffbb40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:07:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbb9000640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb40afe20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffba00097c0 tx=0x7ffba001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dfd416443adc227 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:10.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbb3e00640 1 -- 172.21.15.18:0/3097683008 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00b0070 con 0x7ffbb40d11b0 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbb3e00640 1 -- 172.21.15.18:0/3097683008 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba00ab600 con 0x7ffbb40d11b0 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbb3e00640 1 -- 172.21.15.18:0/3097683008 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba00ab9d0 con 0x7ffbb40d11b0 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 -- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 msgr2=0x7ffbb40afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb40afe20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ffba00097c0 tx=0x7ffba001c410 comp rx=0 tx=0).stop 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 -- 172.21.15.18:0/3097683008 shutdown_connections 2024-04-25T10:07:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb40b4210 0x7ffbb40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 --2- 172.21.15.18:0/3097683008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb40afe20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 -- 172.21.15.18:0/3097683008 >> 172.21.15.18:0/3097683008 conn(0x7ffbb40b2400 msgr2=0x7ffbb40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 -- 172.21.15.18:0/3097683008 shutdown_connections 2024-04-25T10:07:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.635+0000 7ffbbc400640 1 -- 172.21.15.18:0/3097683008 wait complete. 2024-04-25T10:07:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 Processor -- start 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- start start 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb4156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb415da10 0x7ffbb4142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4162150 con 0x7ffbb40b4210 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb4161fd0 con 0x7ffbb40d11b0 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb41622d0 con 0x7ffbb415da10 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45548/0 (socket says 172.21.15.18:45548) 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 -- 172.21.15.18:0/109744423 learned_addr learned my addr 172.21.15.18:0/109744423 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 -- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb415da10 msgr2=0x7ffbb4142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb415da10 0x7ffbb4142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 -- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 msgr2=0x7ffbb4156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb4156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 -- 172.21.15.18:0/109744423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb415dfc0 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb9a00640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c450 tx=0x7ffba800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba8017070 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffba8005cf0 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffba80072f0 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb415e2a0 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.639+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb415e860 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb40745d0 con 0x7ffbb40b4210 2024-04-25T10:07:10.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffba801a070 con 0x7ffbb40b4210 2024-04-25T10:07:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbb1600640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 0x7ffb94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffba8084600 con 0x7ffbb40b4210 2024-04-25T10:07:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbb9000640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 0x7ffb94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:10.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.643+0000 7ffbb9000640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 0x7ffb94069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffba00ad000 tx=0x7ffba0004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:10.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.647+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffba80553e0 con 0x7ffbb40b4210 2024-04-25T10:07:10.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.843+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbb40b2980 con 0x7ffbb40b4210 2024-04-25T10:07:10.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.843+0000 7ffbb1600640 1 -- 172.21.15.18:0/109744423 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4942 (secure 0 0 0) 0x7ffba8054ce0 con 0x7ffbb40b4210 2024-04-25T10:07:10.853 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:10.853 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:01.082291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:07:10.853 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 36 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 msgr2=0x7ffb94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 0x7ffb94069420 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffba00ad000 tx=0x7ffba0004740 comp rx=0 tx=0).stop 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 msgr2=0x7ffbb40cfd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ffba800c450 tx=0x7ffba800c910 comp rx=0 tx=0).stop 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 shutdown_connections 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb94066f60 0x7ffb94069420 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffbb415da10 0x7ffbb4142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffbb40d11b0 0x7ffbb4156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 --2- 172.21.15.18:0/109744423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffbb40b4210 0x7ffbb40cfd50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 >> 172.21.15.18:0/109744423 conn(0x7ffbb40b2400 msgr2=0x7ffbb40b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 shutdown_connections 2024-04-25T10:07:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:10.847+0000 7ffbbc400640 1 -- 172.21.15.18:0/109744423 wait complete. 2024-04-25T10:07:10.874 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-25T10:07:11.047 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:07:11.048 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:07:11.048 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T10:07:11.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 Processor -- start 2024-04-25T10:07:11.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 -- start start 2024-04-25T10:07:11.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f91e60 0x5574c1fa88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c2043350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1f07200 con 0x5574c1f93670 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1e7f9f0 con 0x5574c1f91e60 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1f07380 con 0x5574c1f93a50 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45554/0 (socket says 172.21.15.18:45554) 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 -- 172.21.15.18:0/4036196134 learned_addr learned my addr 172.21.15.18:0/4036196134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9cc00640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f91e60 0x5574c1fa88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9d600640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c2043350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 -- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 msgr2=0x5574c2043350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c2043350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 -- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f91e60 msgr2=0x5574c1fa88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f91e60 0x5574c1fa88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 -- 172.21.15.18:0/4036196134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574c1fb0be0 con 0x5574c1f93670 2024-04-25T10:07:11.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec9d600640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c2043350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:11.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec97e00640 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fec88006f30 tx=0x7fec8800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745cf340b35a5365 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec96a00640 1 -- 172.21.15.18:0/4036196134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88012070 con 0x5574c1f93670 2024-04-25T10:07:11.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.087+0000 7fec96a00640 1 -- 172.21.15.18:0/4036196134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8800e690 con 0x5574c1f93670 2024-04-25T10:07:11.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec96a00640 1 -- 172.21.15.18:0/4036196134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ea60 con 0x5574c1f93670 2024-04-25T10:07:11.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/4036196134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 msgr2=0x5574c2042e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fec88006f30 tx=0x7fec8800b790 comp rx=0 tx=0).stop 2024-04-25T10:07:11.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/4036196134 shutdown_connections 2024-04-25T10:07:11.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c2043350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f93670 0x5574c2042e10 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/4036196134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f91e60 0x5574c1fa88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/4036196134 >> 172.21.15.18:0/4036196134 conn(0x5574c1ed9400 msgr2=0x5574c1f912f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/4036196134 shutdown_connections 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/4036196134 wait complete. 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 Processor -- start 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- start start 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 0x5574c1fa6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f93670 0x5574c1fb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c1fb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1fae2d0 con 0x5574c1f91e60 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574c1fab820 con 0x5574c1f93670 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574c1fabac0 con 0x5574c1f93a50 2024-04-25T10:07:11.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 0x5574c1fa6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 0x5574c1fa6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45568/0 (socket says 172.21.15.18:45568) 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 -- 172.21.15.18:0/2113510995 learned_addr learned my addr 172.21.15.18:0/2113510995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9d600640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c1fb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec97e00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f93670 0x5574c1fb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 -- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 msgr2=0x5574c1fb70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5574c1f93a50 0x5574c1fb70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 -- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f93670 msgr2=0x5574c1fb6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574c1f93670 0x5574c1fb6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 -- 172.21.15.18:0/2113510995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574c1faf820 con 0x5574c1f91e60 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9cc00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 0x5574c1fa6870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fec9001b340 tx=0x7fec900180a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec95600640 1 -- 172.21.15.18:0/2113510995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900af040 con 0x5574c1f91e60 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec95600640 1 -- 172.21.15.18:0/2113510995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900b58c0 con 0x5574c1f91e60 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec95600640 1 -- 172.21.15.18:0/2113510995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900b5cb0 con 0x5574c1f91e60 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5574c1fafac0 con 0x5574c1f91e60 2024-04-25T10:07:11.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.091+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574c1fb0000 con 0x5574c1f91e60 2024-04-25T10:07:11.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec95600640 1 -- 172.21.15.18:0/2113510995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec900a93a0 con 0x5574c1f91e60 2024-04-25T10:07:11.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec95600640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec7c065940 0x7fec7c067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec95600640 1 -- 172.21.15.18:0/2113510995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fec9011ef30 con 0x5574c1f91e60 2024-04-25T10:07:11.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5574c1fa6db0 0x5574c1f7b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e67) v9 -- 0x5574c1fb0740 con 0x5574c1fa6db0 2024-04-25T10:07:11.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec97e00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec7c065940 0x7fec7c067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec9d600640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5574c1fa6db0 0x5574c1f7b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec97e00640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec7c065940 0x7fec7c067e00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec8800b7d0 tx=0x7fec8800f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.095+0000 7fec9d600640 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5574c1fa6db0 0x5574c1f7b640 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9d600640 1 -- 172.21.15.18:0/2113510995 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7fec98011040 con 0x5574c1fa6db0 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5574c1fa6db0 msgr2=0x5574c1f7b640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5574c1fa6db0 0x5574c1f7b640 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec7c065940 msgr2=0x7fec7c067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec7c065940 0x7fec7c067e00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec8800b7d0 tx=0x7fec8800f000 comp rx=0 tx=0).stop 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 msgr2=0x5574c1fa6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 --2- 172.21.15.18:0/2113510995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5574c1f91e60 0x5574c1fa6870 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fec9001b340 tx=0x7fec900180a0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9d600640 1 -- 172.21.15.18:0/2113510995 reap_dead start 2024-04-25T10:07:11.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 shutdown_connections 2024-04-25T10:07:11.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 >> 172.21.15.18:0/2113510995 conn(0x5574c1ed9400 msgr2=0x5574c1ed74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 shutdown_connections 2024-04-25T10:07:11.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.099+0000 7fec9f9c7080 1 -- 172.21.15.18:0/2113510995 wait complete. 2024-04-25T10:07:11.107 INFO:teuthology.orchestra.run.smithi018.stdout:Xfiledir_test 2024-04-25T10:07:11.110 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:11.110 DEBUG:teuthology.orchestra.run.smithi018:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: "ancestors": [ 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1099511627776, 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "file", 2024-04-25T10:07:11.157 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 2 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: "dirino": 1, 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "dir_test", 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 4 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 10, 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: "old_pools": [] 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:11.158 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:11.162 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T10:07:11.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.247+0000 7fb07f662080 1 Processor -- start 2024-04-25T10:07:11.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.247+0000 7fb07f662080 1 -- start start 2024-04-25T10:07:11.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3de3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3e78e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634b3cb29f0 con 0x5634b3dcb870 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634b3cb6950 con 0x5634b3dcc190 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634b3dc7c10 con 0x7fb064003100 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45590/0 (socket says 172.21.15.18:45590) 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 -- 172.21.15.18:0/1648252097 learned_addr learned my addr 172.21.15.18:0/1648252097 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07c800640 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3de3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07d200640 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3e78e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 -- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 msgr2=0x5634b3de3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3de3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 -- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 msgr2=0x5634b3e78e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3e78e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 -- 172.21.15.18:0/1648252097 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634b3dc6030 con 0x5634b3dcb870 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07be00640 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb068097400 tx=0x5634b3d55230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20427fbf5a984e99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07aa00640 1 -- 172.21.15.18:0/1648252097 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680a46e0 con 0x5634b3dcb870 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07aa00640 1 -- 172.21.15.18:0/1648252097 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0680bb070 con 0x5634b3dcb870 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07aa00640 1 -- 172.21.15.18:0/1648252097 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680a4a80 con 0x5634b3dcb870 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- 172.21.15.18:0/1648252097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 msgr2=0x5634b3dcbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb068097400 tx=0x5634b3d55230 comp rx=0 tx=0).stop 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- 172.21.15.18:0/1648252097 shutdown_connections 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3e78e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3dcbc50 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 --2- 172.21.15.18:0/1648252097 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3de3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- 172.21.15.18:0/1648252097 >> 172.21.15.18:0/1648252097 conn(0x5634b3d0c3b0 msgr2=0x5634b3d0d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- 172.21.15.18:0/1648252097 shutdown_connections 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- 172.21.15.18:0/1648252097 wait complete. 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 Processor -- start 2024-04-25T10:07:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.251+0000 7fb07f662080 1 -- start start 2024-04-25T10:07:11.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3e80040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3dc4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3d2e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634b3d4fb20 con 0x5634b3dcb870 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634b3dcd330 con 0x5634b3dcc190 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5634b3e7f120 con 0x7fb064003100 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3e80040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3e80040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45594/0 (socket says 172.21.15.18:45594) 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 -- 172.21.15.18:0/646636356 learned_addr learned my addr 172.21.15.18:0/646636356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07be00640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3dc4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07d200640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3d2e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 -- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 msgr2=0x5634b3d2e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb064003100 0x5634b3d2e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 -- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 msgr2=0x5634b3dc4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5634b3dcc190 0x5634b3dc4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 -- 172.21.15.18:0/646636356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634b3e7f3c0 con 0x5634b3dcb870 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07c800640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3e80040 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb070007690 tx=0x7fb070007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb079600640 1 -- 172.21.15.18:0/646636356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07001a020 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb079600640 1 -- 172.21.15.18:0/646636356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070006a20 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb079600640 1 -- 172.21.15.18:0/646636356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070006dd0 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5634b3e7f660 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5634b3e7fba0 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.255+0000 7fb079600640 1 -- 172.21.15.18:0/646636356 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb07001d020 con 0x5634b3dcb870 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb079600640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb05c065940 0x7fb05c067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb079600640 1 -- 172.21.15.18:0/646636356 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb070084c90 con 0x5634b3dcb870 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07be00640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb05c065940 0x7fb05c067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5634b3e7e920 0x5634b3d394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67) v9 -- 0x5634b3d39a10 con 0x5634b3e7e920 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07d200640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5634b3e7e920 0x5634b3d394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07be00640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb05c065940 0x7fb05c067e00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0680ba000 tx=0x7fb0680a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07d200640 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5634b3e7e920 0x5634b3d394d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07d200640 1 -- 172.21.15.18:0/646636356 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v67'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb0740143b0 con 0x5634b3e7e920 2024-04-25T10:07:11.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5634b3e7e920 msgr2=0x5634b3d394d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5634b3e7e920 0x5634b3d394d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb05c065940 msgr2=0x7fb05c067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb05c065940 0x7fb05c067e00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb0680ba000 tx=0x7fb0680a6000 comp rx=0 tx=0).stop 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 msgr2=0x5634b3e80040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 --2- 172.21.15.18:0/646636356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5634b3dcb870 0x5634b3e80040 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb070007690 tx=0x7fb070007a90 comp rx=0 tx=0).stop 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07d200640 1 -- 172.21.15.18:0/646636356 reap_dead start 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 shutdown_connections 2024-04-25T10:07:11.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 >> 172.21.15.18:0/646636356 conn(0x5634b3d0c3b0 msgr2=0x5634b3d0d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 shutdown_connections 2024-04-25T10:07:11.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.259+0000 7fb07f662080 1 -- 172.21.15.18:0/646636356 wait complete. 2024-04-25T10:07:11.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:11.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T10:07:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.455+0000 7f9828a00640 1 Processor -- start 2024-04-25T10:07:11.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9828a00640 1 -- start start 2024-04-25T10:07:11.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9828a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f98240c60a0 0x7f98241686e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9828a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240afcf0 con 0x7f982415dd00 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9828a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240c6dc0 con 0x7f98240af860 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9828a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240d0430 con 0x7f98240c60a0 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9821e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f982415dd00 0x7f98240ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59526/0 (socket says 172.21.15.18:59526) 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9821e00640 1 -- 172.21.15.18:0/4030888161 learned_addr learned my addr 172.21.15.18:0/4030888161 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9822800640 1 --2- 172.21.15.18:0/4030888161 >> v2:172.21.15.18:3300/0 conn(0x7f98240c60a0 0x7f98241686e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9820a00640 1 -- 172.21.15.18:0/4030888161 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79364620 0 0) 0x7f98240afcf0 con 0x7f982415dd00 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9822800640 1 -- 172.21.15.18:0/4030888161 >> v1:172.21.15.167:6789/0 conn(0x7f98240af860 legacy=0x7f98240c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9822800640 1 -- 172.21.15.18:0/4030888161 >> v1:172.21.15.18:6789/0 conn(0x7f982415dd00 legacy=0x7f98240ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.459+0000 7f9822800640 1 -- 172.21.15.18:0/4030888161 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240c70a0 con 0x7f98240c60a0 2024-04-25T10:07:11.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9822800640 1 --2- 172.21.15.18:0/4030888161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240c60a0 0x7f98241686e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f981c009d90 tx=0x7f981c01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43bb2fe05d9cc2d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9820a00640 1 -- 172.21.15.18:0/4030888161 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0b2070 con 0x7f98240c60a0 2024-04-25T10:07:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9820a00640 1 -- 172.21.15.18:0/4030888161 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f981c0a5710 con 0x7f98240c60a0 2024-04-25T10:07:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9820a00640 1 -- 172.21.15.18:0/4030888161 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f981c0a5ae0 con 0x7f98240c60a0 2024-04-25T10:07:11.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- 172.21.15.18:0/4030888161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240c60a0 msgr2=0x7f98241686e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 --2- 172.21.15.18:0/4030888161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240c60a0 0x7f98241686e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f981c009d90 tx=0x7f981c01c820 comp rx=0 tx=0).stop 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- 172.21.15.18:0/4030888161 shutdown_connections 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 --2- 172.21.15.18:0/4030888161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240c60a0 0x7f98241686e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- 172.21.15.18:0/4030888161 >> 172.21.15.18:0/4030888161 conn(0x7f98240b2240 msgr2=0x7f98240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- 172.21.15.18:0/4030888161 shutdown_connections 2024-04-25T10:07:11.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- 172.21.15.18:0/4030888161 wait complete. 2024-04-25T10:07:11.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 Processor -- start 2024-04-25T10:07:11.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.463+0000 7f9828a00640 1 -- start start 2024-04-25T10:07:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98240c60a0 0x7f982415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9824150310 0x7f98240ced30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982416b7d0 con 0x7f98240af860 2024-04-25T10:07:11.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982416b650 con 0x7f98240c60a0 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982416b950 con 0x7f9824150310 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45614/0 (socket says 172.21.15.18:45614) 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 -- 172.21.15.18:0/3344246446 learned_addr learned my addr 172.21.15.18:0/3344246446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 -- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9824150310 msgr2=0x7f98240ced30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9824150310 0x7f98240ced30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 -- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98240c60a0 msgr2=0x7f982415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98240c60a0 0x7f982415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 -- 172.21.15.18:0/3344246446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240b32f0 con 0x7f98240af860 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9821e00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f981400c4b0 tx=0x7f981400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f981a000640 1 -- 172.21.15.18:0/3344246446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814018070 con 0x7f98240af860 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f981a000640 1 -- 172.21.15.18:0/3344246446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814007500 con 0x7f98240af860 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f981a000640 1 -- 172.21.15.18:0/3344246446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814004a30 con 0x7f98240af860 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98241564f0 con 0x7f98240af860 2024-04-25T10:07:11.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98241567d0 con 0x7f98240af860 2024-04-25T10:07:11.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.467+0000 7f981a000640 1 -- 172.21.15.18:0/3344246446 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9814004bd0 con 0x7f98240af860 2024-04-25T10:07:11.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f981a000640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 0x7f9804069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f981a000640 1 -- 172.21.15.18:0/3344246446 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9814084450 con 0x7f98240af860 2024-04-25T10:07:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 Processor -- start 2024-04-25T10:07:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821400640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 0x7f9804069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- start start 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821400640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 0x7f9804069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f982406b810 tx=0x7f98100079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08939d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb08942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb06b2fd0 con 0x556bb08af1b0 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb063b170 con 0x556bb08afad0 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bb06af070 con 0x556bb0893f10 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45624/0 (socket says 172.21.15.18:45624) 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 -- 172.21.15.18:0/2202884552 learned_addr learned my addr 172.21.15.18:0/2202884552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 -- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 msgr2=0x556bb08942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb08942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 -- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 msgr2=0x556bb08939d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821400640 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08939d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08939d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 -- 172.21.15.18:0/2202884552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb06f9d20 con 0x556bb08af1b0 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821400640 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f9821e00640 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9814051020 tx=0x7f9814054d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=987189d92a5e8d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f980ea00640 1 -- 172.21.15.18:0/2202884552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814052ec0 con 0x556bb08af1b0 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f980ea00640 1 -- 172.21.15.18:0/2202884552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814001050 con 0x556bb08af1b0 2024-04-25T10:07:11.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f980ea00640 1 -- 172.21.15.18:0/2202884552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814051230 con 0x556bb08af1b0 2024-04-25T10:07:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- 172.21.15.18:0/2202884552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 msgr2=0x556bb08af590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9814051020 tx=0x7f9814054d00 comp rx=0 tx=0).stop 2024-04-25T10:07:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- 172.21.15.18:0/2202884552 shutdown_connections 2024-04-25T10:07:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb08942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08939d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 --2- 172.21.15.18:0/2202884552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb08af590 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- 172.21.15.18:0/2202884552 >> 172.21.15.18:0/2202884552 conn(0x556bb086b710 msgr2=0x556bb086baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- 172.21.15.18:0/2202884552 shutdown_connections 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.471+0000 7f982bf33000 1 -- 172.21.15.18:0/2202884552 wait complete. 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- start start 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 Processor -- start 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb08b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08942f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb0770c10 con 0x556bb0893f10 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb066d680 con 0x556bb08afad0 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bb06b7600 con 0x556bb08af1b0 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 10 client.0 _ll_register_callbacks cb 0x556bb0768080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45628/0 (socket says 172.21.15.18:45628) 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 -- 172.21.15.18:0/89012258 learned_addr learned my addr 172.21.15.18:0/89012258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821400640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb08b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9822800640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08942f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 -- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 msgr2=0x556bb08b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb08b6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 -- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 msgr2=0x556bb08942f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08942f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 -- 172.21.15.18:0/89012258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bb068ad30 con 0x556bb0893f10 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821e00640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9814057010 tx=0x7f9814000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ad9deca600a8e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814052f80 con 0x556bb0893f10 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9814051230 con 0x556bb0893f10 2024-04-25T10:07:11.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9814001050 con 0x556bb0893f10 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9814082bb0 con 0x556bb0893f10 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 10 client.6453 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556bb063b3c0 con 0x556bb0893f10 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814001050 con 0x556bb0893f10 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9814068b80 con 0x556bb0893f10 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 10 client.6453 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 10 client.6453 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 20 client.6453 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0895060 0x556bb0895440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 4 client.6453 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556bb064ee00 con 0x556bb0895060 2024-04-25T10:07:11.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.475+0000 7f9821400640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0895060 0x556bb0895440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f9821400640 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0895060 0x556bb0895440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49dcfa18eddc6897 server_cookie=71edcf7d1fecae3d in_seq=0 out_seq=0 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f9803400640 10 client.6453 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f9803400640 1 -- 172.21.15.18:0/89012258 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556bb064ee00 con 0x556bb0895060 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f9803400640 10 client.6453 handle_command_reply: tid=0 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 client.6453 shutdown 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 msgr2=0x556bb08b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9814057010 tx=0x7f9814000ee0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 shutdown_connections 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0895060 0x556bb0895440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08942f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb08b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 --2- 172.21.15.18:0/89012258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb08b6720 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f9803400640 0 client.6453 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 >> 172.21.15.18:0/89012258 conn(0x556bb086b710 msgr2=0x556bb0863950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 shutdown_connections 2024-04-25T10:07:11.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 1 -- 172.21.15.18:0/89012258 wait complete. 2024-04-25T10:07:11.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.479+0000 7f982bf33000 20 client.6453 trim_cache size 0 max 16384 2024-04-25T10:07:11.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 Processor -- start 2024-04-25T10:07:11.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- start start 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb086af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824203190 con 0x556bb0893f10 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824202390 con 0x556bb08afad0 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9824155290 con 0x556bb08af1b0 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45636/0 (socket says 172.21.15.18:45636) 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 -- 172.21.15.18:0/2854744937 learned_addr learned my addr 172.21.15.18:0/2854744937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821400640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb086af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9822800640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 -- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 msgr2=0x556bb086af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb086af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 -- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 msgr2=0x556bb08ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08ad500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 -- 172.21.15.18:0/2854744937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556bb0894660 con 0x556bb0893f10 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821400640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb086af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9822800640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f9821e00640 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f981405b0a0 tx=0x7f981406a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d48d1bfba8e9e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f980e000640 1 -- 172.21.15.18:0/2854744937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814001050 con 0x556bb0893f10 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f980e000640 1 -- 172.21.15.18:0/2854744937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814068b80 con 0x556bb0893f10 2024-04-25T10:07:11.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f980e000640 1 -- 172.21.15.18:0/2854744937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814054010 con 0x556bb0893f10 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- 172.21.15.18:0/2854744937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 msgr2=0x556bb086aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f981405b0a0 tx=0x7f981406a040 comp rx=0 tx=0).stop 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- 172.21.15.18:0/2854744937 shutdown_connections 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08ad500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb08af1b0 0x556bb086af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 --2- 172.21.15.18:0/2854744937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb0893f10 0x556bb086aa00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- 172.21.15.18:0/2854744937 >> 172.21.15.18:0/2854744937 conn(0x556bb086b710 msgr2=0x556bb0892f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- 172.21.15.18:0/2854744937 shutdown_connections 2024-04-25T10:07:11.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.495+0000 7f982bf33000 1 -- 172.21.15.18:0/2854744937 wait complete. 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- start start 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 Processor -- start 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08653e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb0659d40 con 0x556bb08af1b0 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x556bb06b7600 con 0x556bb08afad0 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x556bb06b22e0 con 0x556bb0893f10 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 10 client.0 _ll_register_callbacks cb 0x556bb0650b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9822800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45646/0 (socket says 172.21.15.18:45646) 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50786/0 (socket says 172.21.15.18:50786) 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821400640 1 -- 172.21.15.18:0/848930760 learned_addr learned my addr 172.21.15.18:0/848930760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 -- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 msgr2=0x556bb08653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 -- 172.21.15.18:0/848930760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 msgr2=0x556bb0864ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 -- 172.21.15.18:0/848930760 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556bb07350f0 con 0x556bb0893f10 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821400640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821e00640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98140016f0 tx=0x7f9814050f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad54ac62eeb33c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9814054010 con 0x556bb0893f10 2024-04-25T10:07:11.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f981405ed60 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9814068b80 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98140541b0 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 10 client.35591 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x556bb0647d20 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9814062070 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9814050910 con 0x556bb0893f10 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 10 client.35591 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 10 client.35591 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 20 client.35591 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0915230 0x556bb0917620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 4 client.35591 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x556bb06c0510 con 0x556bb0915230 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.499+0000 7f9821400640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0915230 0x556bb0917620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9803400640 10 client.35591 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9821400640 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0915230 0x556bb0917620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26cae6350aa6989 server_cookie=9438e486756545f6 in_seq=0 out_seq=0 2024-04-25T10:07:11.512 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T10:07:11.504+0000 7f0423800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={35570=0-4194304@1} caps={35570=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=35570 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f84882b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9803400640 1 -- 172.21.15.18:0/848930760 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556bb06c0510 con 0x556bb0915230 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9803400640 10 client.35591 handle_command_reply: tid=0 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 client.35591 shutdown 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 msgr2=0x556bb0864960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f98140016f0 tx=0x7f9814050f90 comp rx=0 tx=0).stop 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 shutdown_connections 2024-04-25T10:07:11.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x556bb0915230 0x556bb0917620 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bb08afad0 0x556bb08653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556bb08af1b0 0x556bb0864ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 --2- 172.21.15.18:0/848930760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x556bb0893f10 0x556bb0864960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9803400640 0 client.35591 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 >> 172.21.15.18:0/848930760 conn(0x556bb086b710 msgr2=0x556bb0893640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 shutdown_connections 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 1 -- 172.21.15.18:0/848930760 wait complete. 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f982bf33000 20 client.35591 trim_cache size 0 max 16384 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:11.514 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:07:11.515 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "c03debfb-ee4c-48e3-a02f-b160b930e424", 2024-04-25T10:07:11.515 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:07:11.515 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:11.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 msgr2=0x7f9804069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 0x7f9804069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f982406b810 tx=0x7f98100079c0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 msgr2=0x7f982415d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f981400c4b0 tx=0x7f981400c970 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 shutdown_connections 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9804066f60 0x7f9804069420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9824150310 0x7f98240ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f98240c60a0 0x7f982415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 --2- 172.21.15.18:0/3344246446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98240af860 0x7f982415d040 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 >> 172.21.15.18:0/3344246446 conn(0x7f98240b2240 msgr2=0x7f98240b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 shutdown_connections 2024-04-25T10:07:11.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.503+0000 7f9828a00640 1 -- 172.21.15.18:0/3344246446 wait complete. 2024-04-25T10:07:11.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:11.530 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T10:07:11.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.663+0000 7fbdcc200640 1 Processor -- start 2024-04-25T10:07:11.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.663+0000 7fbdcc200640 1 -- start start 2024-04-25T10:07:11.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdcc200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdcc200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc415bc40 con 0x7fbdc4144120 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdcc200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc415b3a0 con 0x7fbdc415acd0 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdcc200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc415e490 con 0x7fbdc40b3090 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc9800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbdc4144120 0x7fbdc40ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55590/0 (socket says 172.21.15.18:55590) 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc9800640 1 -- 172.21.15.18:0/2418751122 learned_addr learned my addr 172.21.15.18:0/2418751122 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdca200640 1 --2- 172.21.15.18:0/2418751122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737509543 0 0) 0x7fbdc415bc40 con 0x7fbdc4144120 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdac005740 con 0x7fbdc4144120 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093137821 0 0) 0x7fbdc415b3a0 con 0x7fbdc415acd0 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdc415bc40 con 0x7fbdc415acd0 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdca200640 1 -- 172.21.15.18:0/2418751122 >> v1:172.21.15.167:6789/0 conn(0x7fbdc415acd0 legacy=0x7fbdc415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdca200640 1 -- 172.21.15.18:0/2418751122 >> v1:172.21.15.18:6789/0 conn(0x7fbdc4144120 legacy=0x7fbdc40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.667+0000 7fbdca200640 1 -- 172.21.15.18:0/2418751122 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc415b680 con 0x7fbdc40b3090 2024-04-25T10:07:11.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdca200640 1 --2- 172.21.15.18:0/2418751122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc40b3520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdc415e610 tx=0x7fbdbc01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d2d6e63aec2966 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0b2070 con 0x7fbdc40b3090 2024-04-25T10:07:11.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc0a58b0 con 0x7fbdc40b3090 2024-04-25T10:07:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdc3e00640 1 -- 172.21.15.18:0/2418751122 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0a5c60 con 0x7fbdc40b3090 2024-04-25T10:07:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- 172.21.15.18:0/2418751122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 msgr2=0x7fbdc40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 --2- 172.21.15.18:0/2418751122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc40b3520 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbdc415e610 tx=0x7fbdbc01c900 comp rx=0 tx=0).stop 2024-04-25T10:07:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- 172.21.15.18:0/2418751122 shutdown_connections 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 --2- 172.21.15.18:0/2418751122 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc40b3520 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- 172.21.15.18:0/2418751122 >> 172.21.15.18:0/2418751122 conn(0x7fbdc4067080 msgr2=0x7fbdc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- 172.21.15.18:0/2418751122 shutdown_connections 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- 172.21.15.18:0/2418751122 wait complete. 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 Processor -- start 2024-04-25T10:07:11.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.671+0000 7fbdcc200640 1 -- start start 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc4140e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc415acd0 0x7fbdc4155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc406dc60 con 0x7fbdc4144120 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc406dae0 con 0x7fbdc415acd0 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc406dde0 con 0x7fbdc40b3090 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35624/0 (socket says 172.21.15.18:35624) 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 -- 172.21.15.18:0/1248959655 learned_addr learned my addr 172.21.15.18:0/1248959655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc9800640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc4140e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdca200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc415acd0 0x7fbdc4155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 -- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 msgr2=0x7fbdc4140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc4140e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 -- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc415acd0 msgr2=0x7fbdc4155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc415acd0 0x7fbdc4155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 -- 172.21.15.18:0/1248959655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc4138200 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c430 tx=0x7fbdb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc1600640 1 -- 172.21.15.18:0/1248959655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0017070 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc1600640 1 -- 172.21.15.18:0/1248959655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb00052f0 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc40b0930 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc1600640 1 -- 172.21.15.18:0/1248959655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0003840 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc4138780 con 0x7fbdc4144120 2024-04-25T10:07:11.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.675+0000 7fbdc1600640 1 -- 172.21.15.18:0/1248959655 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbdb001a070 con 0x7fbdc4144120 2024-04-25T10:07:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc1600640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 0x7fbda4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc1600640 1 -- 172.21.15.18:0/1248959655 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbdb0084490 con 0x7fbdc4144120 2024-04-25T10:07:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc9800640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 0x7fbda4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 Processor -- start 2024-04-25T10:07:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 -- start start 2024-04-25T10:07:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc9800640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 0x7fbda4069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80011f0 tx=0x7fbdb8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64c5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b647b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594b62c3ff0 con 0x5594b64c5750 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594b624c150 con 0x5594b647b4b0 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594b62c0090 con 0x5594b64c4e30 2024-04-25T10:07:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35634/0 (socket says 172.21.15.18:35634) 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 -- 172.21.15.18:0/4040292596 learned_addr learned my addr 172.21.15.18:0/4040292596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc9800640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdca200640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b647b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 -- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 msgr2=0x5594b64c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64c5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 -- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 msgr2=0x5594b647b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b647b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 -- 172.21.15.18:0/4040292596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594b645a0d0 con 0x5594b64c5750 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdca200640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b647b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbdb005cde0 tx=0x7fbdb00054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d4a556361520a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdb6000640 1 -- 172.21.15.18:0/4040292596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb005d310 con 0x5594b64c5750 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdb6000640 1 -- 172.21.15.18:0/4040292596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0052fb0 con 0x5594b64c5750 2024-04-25T10:07:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdb6000640 1 -- 172.21.15.18:0/4040292596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00840b0 con 0x5594b64c5750 2024-04-25T10:07:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 -- 172.21.15.18:0/4040292596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 msgr2=0x5594b647af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.679+0000 7fbdcf663000 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fbdb005cde0 tx=0x7fbdb00054a0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/4040292596 shutdown_connections 2024-04-25T10:07:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b647b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b647af70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- 172.21.15.18:0/4040292596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64c5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/4040292596 >> 172.21.15.18:0/4040292596 conn(0x5594b6473020 msgr2=0x5594b6475440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/4040292596 shutdown_connections 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/4040292596 wait complete. 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- start start 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 Processor -- start 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b64c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b6481360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594b62c8620 con 0x5594b64c5750 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594b627e690 con 0x5594b647b4b0 2024-04-25T10:07:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594b624ca40 con 0x5594b64c4e30 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 10 client.0 _ll_register_callbacks cb 0x5594b6461e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35648/0 (socket says 172.21.15.18:35648) 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 -- 172.21.15.18:0/1589923735 learned_addr learned my addr 172.21.15.18:0/1589923735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 -- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 msgr2=0x5594b6481360 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b6481360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 -- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 msgr2=0x5594b64c47e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b64c47e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 -- 172.21.15.18:0/1589923735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594b63711c0 con 0x5594b64c5750 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdca200640 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b0040 tx=0x7fbdbc01b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c443d3a37180b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0b2040 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbdbc0c5cc0 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbdb0052fb0 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdbc009450 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 10 client.6471 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5594b636d170 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0052fb0 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbdbc0c4480 con 0x5594b64c5750 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 10 client.6471 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 10 client.6471 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 20 client.6471 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64825e0 0x5594b64d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 4 client.6471 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.683+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594b625fc60 con 0x5594b64825e0 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdc9800640 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64825e0 0x5594b64d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdc9800640 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64825e0 0x5594b64d70f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa5a5c4c1b5da68d server_cookie=ec6bcdd981839204 in_seq=0 out_seq=0 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdaaa00640 10 client.6471 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdaaa00640 1 -- 172.21.15.18:0/1589923735 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5594b625fc60 con 0x5594b64825e0 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdaaa00640 10 client.6471 handle_command_reply: tid=0 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 client.6471 shutdown 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 msgr2=0x5594b64818a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b0040 tx=0x7fbdbc01b140 comp rx=0 tx=0).stop 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 shutdown_connections 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64825e0 0x5594b64d70f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c5750 0x5594b64818a0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b6481360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdaaa00640 0 client.6471 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 --2- 172.21.15.18:0/1589923735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b647b4b0 0x5594b64c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 >> 172.21.15.18:0/1589923735 conn(0x5594b6473020 msgr2=0x5594b647c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 shutdown_connections 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 1 -- 172.21.15.18:0/1589923735 wait complete. 2024-04-25T10:07:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.687+0000 7fbdcf663000 20 client.6471 trim_cache size 0 max 16384 2024-04-25T10:07:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 Processor -- start 2024-04-25T10:07:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 -- start start 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64d22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41feae0 con 0x5594b647b4b0 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc41fdce0 con 0x5594b6473020 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40b0050 con 0x5594b64c4e30 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35662/0 (socket says 172.21.15.18:35662) 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdc8e00640 1 -- 172.21.15.18:0/3160518509 learned_addr learned my addr 172.21.15.18:0/3160518509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdc9800640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.703+0000 7fbdca200640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64d22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 -- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 msgr2=0x5594b64d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64d22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 -- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 msgr2=0x5594b64a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 -- 172.21.15.18:0/3160518509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594b630ade0 con 0x5594b647b4b0 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc9800640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbdb005cde0 tx=0x7fbdb0056000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21e061239ccb147 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdb5600640 1 -- 172.21.15.18:0/3160518509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0058d50 con 0x5594b647b4b0 2024-04-25T10:07:11.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdb5600640 1 -- 172.21.15.18:0/3160518509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb007d070 con 0x5594b647b4b0 2024-04-25T10:07:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdb5600640 1 -- 172.21.15.18:0/3160518509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0051320 con 0x5594b647b4b0 2024-04-25T10:07:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- 172.21.15.18:0/3160518509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 msgr2=0x5594b64a4010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fbdb005cde0 tx=0x7fbdb0056000 comp rx=0 tx=0).stop 2024-04-25T10:07:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- 172.21.15.18:0/3160518509 shutdown_connections 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b64c4e30 0x5594b64d22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b647b4b0 0x5594b64a4010 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3160518509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- 172.21.15.18:0/3160518509 >> 172.21.15.18:0/3160518509 conn(0x5594b6472b00 msgr2=0x5594b64d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- 172.21.15.18:0/3160518509 shutdown_connections 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- 172.21.15.18:0/3160518509 wait complete. 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- start start 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 Processor -- start 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 0x5594b64d7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594b625ee00 con 0x5594b64c4e30 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc40b0650 con 0x5594b6473020 2024-04-25T10:07:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594b62c3300 con 0x5594b647b4b0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdcf663000 10 client.0 _ll_register_callbacks cb 0x5594b6442040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 0x5594b64d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35666/0 (socket says 172.21.15.18:35666) 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc9800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 -- 172.21.15.18:0/3648336649 learned_addr learned my addr 172.21.15.18:0/3648336649 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 -- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 msgr2=0x5594b64d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 0x5594b64d7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 -- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 msgr2=0x5594b64d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64d70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdca200640 1 -- 172.21.15.18:0/3648336649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594b62658e0 con 0x5594b64c4e30 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.707+0000 7fbdc8e00640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 0x5594b64d7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdca200640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc01d1a0 tx=0x7fbdbc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f5dcbbd1076538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:11.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc0b2070 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(67..67 src has 1..67) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbdbc0a5c60 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbdb007d070 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdbc0d3070 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 10 client.6477 fetch_fsmap learned FSMap version 36 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5594b631d8f0 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb007d070 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 36) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbdbc0c4ce0 con 0x5594b64c4e30 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 10 client.6477 fetch_fsmap finished waiting for FSMap version 36 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 10 client.6477 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 20 client.6477 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64c5750 0x5594b652cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 4 client.6477 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:07:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594b62d1530 con 0x5594b64c5750 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdc9800640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64c5750 0x5594b652cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdc9800640 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64c5750 0x5594b652cfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1f32060b9dc774c server_cookie=92c071cce5df2e55 in_seq=0 out_seq=0 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 10 client.6477 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 1 -- 172.21.15.18:0/3648336649 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x5594b62d1530 con 0x5594b64c5750 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 10 client.6477 handle_command_reply: tid=0 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 client.6477 shutdown 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 msgr2=0x5594b64d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc01d1a0 tx=0x7fbdbc009750 comp rx=0 tx=0).stop 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 shutdown_connections 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5594b64c5750 0x5594b652cfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5594b64c4e30 0x5594b64d7b70 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5594b647b4b0 0x5594b64d7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 --2- 172.21.15.18:0/3648336649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5594b6473020 0x5594b64d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdaaa00640 0 client.6477 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 >> 172.21.15.18:0/3648336649 conn(0x5594b6472b00 msgr2=0x5594b64d2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 shutdown_connections 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 1 -- 172.21.15.18:0/3648336649 wait complete. 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcf663000 20 client.6477 trim_cache size 0 max 16384 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "c03debfb-ee4c-48e3-a02f-b160b930e424": { 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "c03debfb-ee4c-48e3-a02f-b160b930e424", 2024-04-25T10:07:11.724 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive" 2024-04-25T10:07:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:11.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:11.725 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 msgr2=0x7fbda4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 0x7fbda4069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80011f0 tx=0x7fbdb8007d40 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 msgr2=0x7fbdc4135a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000c430 tx=0x7fbdb000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 shutdown_connections 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdc415acd0 0x7fbdc4155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdc4144120 0x7fbdc4135a90 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda4066f60 0x7fbda4069420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 --2- 172.21.15.18:0/1248959655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdc40b3090 0x7fbdc4140e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 >> 172.21.15.18:0/1248959655 conn(0x7fbdc4067080 msgr2=0x7fbdc40cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 shutdown_connections 2024-04-25T10:07:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:11.711+0000 7fbdcc200640 1 -- 172.21.15.18:0/1248959655 wait complete. 2024-04-25T10:07:11.739 INFO:tasks.cephfs.filesystem:scrub status for tag:c03debfb-ee4c-48e3-a02f-b160b930e424 - {'path': '/', 'tag': 'c03debfb-ee4c-48e3-a02f-b160b930e424', 'options': 'recursive'} 2024-04-25T10:07:14.750 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:07:14.743+0000 7fb22fa00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T10:07:20.719 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:07:20.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:07:41.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:41.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T10:07:41.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.887+0000 7fc45be00640 1 Processor -- start 2024-04-25T10:07:41.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.887+0000 7fc45be00640 1 -- start start 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc45be00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc45415acd0 0x7fc45415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc45be00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45415bc40 con 0x7fc45415ee60 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc45be00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45415b3a0 con 0x7fc454144120 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc45be00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45415e490 con 0x7fc45415acd0 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc45415ee60 0x7fc4540b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56536/0 (socket says 172.21.15.18:56536) 2024-04-25T10:07:41.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459e00640 1 -- 172.21.15.18:0/3986593654 learned_addr learned my addr 172.21.15.18:0/3986593654 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc458a00640 1 --2- 172.21.15.18:0/3986593654 >> v2:172.21.15.167:3300/0 conn(0x7fc45415acd0 0x7fc45415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574554741 0 0) 0x7fc45415bc40 con 0x7fc45415ee60 2024-04-25T10:07:41.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc43c003530 con 0x7fc45415ee60 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496733676 0 0) 0x7fc45415b3a0 con 0x7fc454144120 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc45415bc40 con 0x7fc454144120 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2644945909 0 0) 0x7fc43c003530 con 0x7fc45415ee60 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 >> v2:172.21.15.167:3300/0 conn(0x7fc45415acd0 msgr2=0x7fc45415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 --2- 172.21.15.18:0/3986593654 >> v2:172.21.15.167:3300/0 conn(0x7fc45415acd0 0x7fc45415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 >> v1:172.21.15.167:6789/0 conn(0x7fc454144120 legacy=0x7fc4540ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45415b680 con 0x7fc45415ee60 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fc44c001a00 con 0x7fc45415ee60 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 >> v1:172.21.15.18:6789/0 conn(0x7fc45415ee60 legacy=0x7fc4540b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 0x7fc43c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc43c004810 0x7fc43c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c0051d0 0x7fc43c00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45415e490 con 0x7fc43c003b50 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00e310 con 0x7fc43c0051d0 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43c00e510 con 0x7fc43c004810 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 0x7fc43c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc458a00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc43c004810 0x7fc43c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459e00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c0051d0 0x7fc43c00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 -- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc43c004810 msgr2=0x7fc43c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc43c004810 0x7fc43c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 -- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c0051d0 msgr2=0x7fc43c00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c0051d0 0x7fc43c00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459400640 1 -- 172.21.15.18:0/3986593654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc43c003530 con 0x7fc43c003b50 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459e00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c0051d0 0x7fc43c00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc458a00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc43c004810 0x7fc43c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:41.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.891+0000 7fc459e00640 1 -- 172.21.15.18:0/3986593654 reap_dead start 2024-04-25T10:07:41.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc459400640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 0x7fc43c003f50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc4480018d0 tx=0x7fc44801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f331e234d349b12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448001520 con 0x7fc43c003b50 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480052f0 con 0x7fc43c003b50 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc453e00640 1 -- 172.21.15.18:0/3986593654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448003840 con 0x7fc43c003b50 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 -- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 msgr2=0x7fc43c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 0x7fc43c003f50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fc4480018d0 tx=0x7fc44801c560 comp rx=0 tx=0).stop 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 -- 172.21.15.18:0/3986593654 shutdown_connections 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 --2- 172.21.15.18:0/3986593654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc43c003b50 0x7fc43c003f50 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 -- 172.21.15.18:0/3986593654 >> 172.21.15.18:0/3986593654 conn(0x7fc454067080 msgr2=0x7fc45406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 -- 172.21.15.18:0/3986593654 shutdown_connections 2024-04-25T10:07:41.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.895+0000 7fc45be00640 1 -- 172.21.15.18:0/3986593654 wait complete. 2024-04-25T10:07:41.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 Processor -- start 2024-04-25T10:07:41.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- start start 2024-04-25T10:07:41.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c003b50 0x7fc4540ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45413aa80 0x7fc45413af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540cd180 con 0x7fc45413e640 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540cd000 con 0x7fc43c003b50 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454071270 con 0x7fc45413aa80 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40350/0 (socket says 172.21.15.18:40350) 2024-04-25T10:07:41.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 -- 172.21.15.18:0/2795292841 learned_addr learned my addr 172.21.15.18:0/2795292841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:41.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 -- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45413aa80 msgr2=0x7fc45413af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45413aa80 0x7fc45413af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 -- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c003b50 msgr2=0x7fc4540ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c003b50 0x7fc4540ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 -- 172.21.15.18:0/2795292841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45413f1e0 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc458a00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc440011540 tx=0x7fc440011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc451600640 1 -- 172.21.15.18:0/2795292841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440004220 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc451600640 1 -- 172.21.15.18:0/2795292841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400043c0 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc451600640 1 -- 172.21.15.18:0/2795292841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440015890 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc45413f4c0 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.899+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc45413fa80 con 0x7fc45413e640 2024-04-25T10:07:41.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc451600640 1 -- 172.21.15.18:0/2795292841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc440015a30 con 0x7fc45413e640 2024-04-25T10:07:41.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc451600640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc451600640 1 -- 172.21.15.18:0/2795292841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc4400858d0 con 0x7fc45413e640 2024-04-25T10:07:41.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc459400640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 Processor -- start 2024-04-25T10:07:41.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 -- start start 2024-04-25T10:07:41.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc459400640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 0x7fc434069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc4480ac000 tx=0x7fc4480012e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c482db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c482e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c467aff0 con 0x5600c48779d0 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c4603150 con 0x5600c482e0a0 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c4677090 con 0x5600c48782f0 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc459400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc459400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40358/0 (socket says 172.21.15.18:40358) 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.903+0000 7fc459400640 1 -- 172.21.15.18:0/2034804280 learned_addr learned my addr 172.21.15.18:0/2034804280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 -- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 msgr2=0x5600c482db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c482db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 -- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 msgr2=0x5600c482e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c482e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 -- 172.21.15.18:0/2034804280 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c48110d0 con 0x5600c48779d0 2024-04-25T10:07:41.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc448005040 tx=0x7fc4480a6070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd90cb9e8434832 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc446000640 1 -- 172.21.15.18:0/2034804280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480c6070 con 0x5600c48779d0 2024-04-25T10:07:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc446000640 1 -- 172.21.15.18:0/2034804280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448003bd0 con 0x5600c48779d0 2024-04-25T10:07:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc446000640 1 -- 172.21.15.18:0/2034804280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480b6410 con 0x5600c48779d0 2024-04-25T10:07:41.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2034804280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 msgr2=0x5600c4877db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc448005040 tx=0x7fc4480a6070 comp rx=0 tx=0).stop 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2034804280 shutdown_connections 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c482e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c482db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2034804280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c4877db0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2034804280 >> 172.21.15.18:0/2034804280 conn(0x5600c482a020 msgr2=0x5600c482c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2034804280 shutdown_connections 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2034804280 wait complete. 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- start start 2024-04-25T10:07:41.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 Processor -- start 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c482e0a0 0x5600c485c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c485cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c463f250 con 0x5600c48782f0 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c4635690 con 0x5600c48779d0 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c4603a40 con 0x5600c482e0a0 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc45f1ba000 10 client.0 _ll_register_callbacks cb 0x5600c4818e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40362/0 (socket says 172.21.15.18:40362) 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459e00640 1 -- 172.21.15.18:0/2752159341 learned_addr learned my addr 172.21.15.18:0/2752159341 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc458a00640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c485cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.907+0000 7fc459400640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c482e0a0 0x5600c485c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 -- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c482e0a0 msgr2=0x5600c485c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c482e0a0 0x5600c485c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 -- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 msgr2=0x5600c485cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c485cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 -- 172.21.15.18:0/2752159341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c47281c0 con 0x5600c48782f0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc458a00640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c485cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459e00640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc44c001360 tx=0x7fc44c007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4d0e57bc9d9c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c012590 con 0x5600c48782f0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc44c012730 con 0x5600c48782f0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc448003bd0 con 0x5600c48782f0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc44c020050 con 0x5600c48782f0 2024-04-25T10:07:41.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 10 client.6489 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5600c4724170 con 0x5600c48782f0 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448003bd0 con 0x5600c48782f0 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc44c023020 con 0x5600c48782f0 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 10 client.6489 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 10 client.6489 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 20 client.6489 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c4887c80 0x5600c488a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 4 client.6489 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:41.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600c4616c60 con 0x5600c4887c80 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459400640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c4887c80 0x5600c488a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc459400640 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c4887c80 0x5600c488a070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7343412cbbfe1ab server_cookie=2c86fa667127861a in_seq=0 out_seq=0 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.911+0000 7fc43aa00640 10 client.6489 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc43aa00640 1 -- 172.21.15.18:0/2752159341 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5600c4616c60 con 0x5600c4887c80 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc43aa00640 10 client.6489 handle_command_reply: tid=0 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 client.6489 shutdown 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 msgr2=0x5600c485d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc44c001360 tx=0x7fc44c007760 comp rx=0 tx=0).stop 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 shutdown_connections 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c4887c80 0x5600c488a070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48782f0 0x5600c485d270 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c485cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc43aa00640 0 client.6489 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:41.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2752159341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c482e0a0 0x5600c485c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 >> 172.21.15.18:0/2752159341 conn(0x5600c482a020 msgr2=0x5600c482cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 shutdown_connections 2024-04-25T10:07:41.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2752159341 wait complete. 2024-04-25T10:07:41.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.915+0000 7fc45f1ba000 20 client.6489 trim_cache size 0 max 16384 2024-04-25T10:07:41.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 Processor -- start 2024-04-25T10:07:41.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- start start 2024-04-25T10:07:41.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c48d4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c48d4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454204350 con 0x5600c482e0a0 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454203470 con 0x5600c48779d0 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc454143160 con 0x5600c48782f0 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40378/0 (socket says 172.21.15.18:40378) 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 -- 172.21.15.18:0/2313193540 learned_addr learned my addr 172.21.15.18:0/2313193540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 -- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 msgr2=0x5600c48d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c48d4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 -- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 msgr2=0x5600c48d4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c48d4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 -- 172.21.15.18:0/2313193540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c46c1de0 con 0x5600c482e0a0 2024-04-25T10:07:41.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc459400640 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc44801ca40 tx=0x7fc4480b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e188bfaa2dd599 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc445600640 1 -- 172.21.15.18:0/2313193540 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480c6040 con 0x5600c482e0a0 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc445600640 1 -- 172.21.15.18:0/2313193540 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480b6730 con 0x5600c482e0a0 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc445600640 1 -- 172.21.15.18:0/2313193540 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4480b6410 con 0x5600c482e0a0 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2313193540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 msgr2=0x5600c48d4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc44801ca40 tx=0x7fc4480b6000 comp rx=0 tx=0).stop 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2313193540 shutdown_connections 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c48d4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c48779d0 0x5600c48d4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/2313193540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c482e0a0 0x5600c48d4300 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2313193540 >> 172.21.15.18:0/2313193540 conn(0x5600c482a020 msgr2=0x5600c4884fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2313193540 shutdown_connections 2024-04-25T10:07:41.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- 172.21.15.18:0/2313193540 wait complete. 2024-04-25T10:07:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 -- start start 2024-04-25T10:07:41.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.931+0000 7fc45f1ba000 1 Processor -- start 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c488a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c488ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c4615e00 con 0x5600c48779d0 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc454202e70 con 0x5600c482e0a0 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c467a300 con 0x5600c48782f0 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 10 client.0 _ll_register_callbacks cb 0x5600c47f9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40382/0 (socket says 172.21.15.18:40382) 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 -- 172.21.15.18:0/1101004074 learned_addr learned my addr 172.21.15.18:0/1101004074 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc459400640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c488a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc459e00640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c488ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 -- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 msgr2=0x5600c488ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c488ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 -- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 msgr2=0x5600c488a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c488a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 -- 172.21.15.18:0/1101004074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c461c8e0 con 0x5600c48779d0 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc458a00640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc440012010 tx=0x7fc440055f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559fd10e082df679 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:41.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44006d020 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc44005c2b0 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4480b6730 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc440022040 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 10 client.6495 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5600c46d48f0 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4480b6730 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc440055390 con 0x5600c48779d0 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 10 client.6495 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 10 client.6495 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 20 client.6495 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c488ba60 0x5600c48dff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 4 client.6495 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:07:41.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5600c4688530 con 0x5600c488ba60 2024-04-25T10:07:41.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc459400640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c488ba60 0x5600c48dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc459400640 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c488ba60 0x5600c48dff60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3732317aa40e6bc server_cookie=60496ca167d1748c in_seq=0 out_seq=0 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.935+0000 7fc43aa00640 10 client.6495 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc43aa00640 1 -- 172.21.15.18:0/1101004074 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5600c4688530 con 0x5600c488ba60 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc43aa00640 10 client.6495 handle_command_reply: tid=0 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 client.6495 shutdown 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 msgr2=0x5600c488a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc440012010 tx=0x7fc440055f40 comp rx=0 tx=0).stop 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 shutdown_connections 2024-04-25T10:07:41.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x5600c488ba60 0x5600c48dff60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5600c48782f0 0x5600c488ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5600c48779d0 0x5600c488a8c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 --2- 172.21.15.18:0/1101004074 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5600c482e0a0 0x5600c488a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 >> 172.21.15.18:0/1101004074 conn(0x5600c482a020 msgr2=0x5600c48760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc43aa00640 0 client.6495 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 shutdown_connections 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 1 -- 172.21.15.18:0/1101004074 wait complete. 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45f1ba000 20 client.6495 trim_cache size 0 max 16384 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:07:41.949 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:07:41.950 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 msgr2=0x7fc434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 0x7fc434069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc4480ac000 tx=0x7fc4480012e0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 msgr2=0x7fc45413eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fc440011540 tx=0x7fc440011a00 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 shutdown_connections 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc45413aa80 0x7fc45413af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc45413e640 0x7fc45413eac0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 --2- 172.21.15.18:0/2795292841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc43c003b50 0x7fc4540ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 >> 172.21.15.18:0/2795292841 conn(0x7fc454067080 msgr2=0x7fc45406e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 shutdown_connections 2024-04-25T10:07:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:41.939+0000 7fc45be00640 1 -- 172.21.15.18:0/2795292841 wait complete. 2024-04-25T10:07:41.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:07:41.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:07:42.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 Processor -- start 2024-04-25T10:07:42.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 -- start start 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a200cef30 0x7f5a2006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a200b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a2015ac60 con 0x7f5a20144140 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a2006ed50 con 0x7f5a200cef30 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a26600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a200cf3e0 con 0x7f5a2006e900 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a1f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5a20144140 0x7f5a200ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56544/0 (socket says 172.21.15.18:56544) 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a1f400640 1 -- 172.21.15.18:0/1983984747 learned_addr learned my addr 172.21.15.18:0/1983984747 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a16a00640 1 --2- 172.21.15.18:0/1983984747 >> v2:172.21.15.18:3300/0 conn(0x7f5a200cef30 0x7f5a2006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a1fe00640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a200b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a1ea00640 1 -- 172.21.15.18:0/1983984747 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 994672383 0 0) 0x7f5a2015ac60 con 0x7f5a20144140 2024-04-25T10:07:42.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a1ea00640 1 -- 172.21.15.18:0/1983984747 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a04003530 con 0x7f5a20144140 2024-04-25T10:07:42.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a16a00640 1 -- 172.21.15.18:0/1983984747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 msgr2=0x7f5a200b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a16a00640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a200b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a16a00640 1 -- 172.21.15.18:0/1983984747 >> v1:172.21.15.18:6789/0 conn(0x7f5a20144140 legacy=0x7f5a200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.099+0000 7f5a16a00640 1 -- 172.21.15.18:0/1983984747 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2015af20 con 0x7f5a200cef30 2024-04-25T10:07:42.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a16a00640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a200cef30 0x7f5a2006e3c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5a080097c0 tx=0x7f5a0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e507853a0d5cedd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a1ea00640 1 -- 172.21.15.18:0/1983984747 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080b0070 con 0x7f5a200cef30 2024-04-25T10:07:42.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a1ea00640 1 -- 172.21.15.18:0/1983984747 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080ab600 con 0x7f5a200cef30 2024-04-25T10:07:42.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a1ea00640 1 -- 172.21.15.18:0/1983984747 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080ab9d0 con 0x7f5a200cef30 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 -- 172.21.15.18:0/1983984747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a200cef30 msgr2=0x7f5a2006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a200cef30 0x7f5a2006e3c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5a080097c0 tx=0x7f5a0801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 -- 172.21.15.18:0/1983984747 shutdown_connections 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a200b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 --2- 172.21.15.18:0/1983984747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a200cef30 0x7f5a2006e3c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 -- 172.21.15.18:0/1983984747 >> 172.21.15.18:0/1983984747 conn(0x7f5a20066fa0 msgr2=0x7f5a2006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 -- 172.21.15.18:0/1983984747 shutdown_connections 2024-04-25T10:07:42.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.103+0000 7f5a26600640 1 -- 172.21.15.18:0/1983984747 wait complete. 2024-04-25T10:07:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 Processor -- start 2024-04-25T10:07:42.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- start start 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a201547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 0x7f5a2013ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015ba00 con 0x7f5a20144140 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a20144520 con 0x7f5a200cef30 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a2015bb80 con 0x7f5a2006e900 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40388/0 (socket says 172.21.15.18:40388) 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 -- 172.21.15.18:0/3693995112 learned_addr learned my addr 172.21.15.18:0/3693995112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1f400640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a201547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a16a00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 0x7f5a2013ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 -- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 msgr2=0x7f5a201547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a201547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 -- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 msgr2=0x7f5a2013ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 0x7f5a2013ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 -- 172.21.15.18:0/3693995112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a20153a10 con 0x7f5a20144140 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a16a00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 0x7f5a2013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a1fe00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5a18007e40 tx=0x7f5a1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18014620 con 0x7f5a20144140 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a18019070 con 0x7f5a20144140 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a18014a20 con 0x7f5a20144140 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a20153cf0 con 0x7f5a20144140 2024-04-25T10:07:42.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a201fadb0 con 0x7f5a20144140 2024-04-25T10:07:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.107+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a200745d0 con 0x7f5a20144140 2024-04-25T10:07:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.111+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a18014bc0 con 0x7f5a20144140 2024-04-25T10:07:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.111+0000 7f5a17e00640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.111+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f5a18085ab0 con 0x7f5a20144140 2024-04-25T10:07:42.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.111+0000 7f5a1f400640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.111+0000 7f5a1f400640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 0x7f59fc069420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5a10005890 tx=0x7f5a10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.115+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a18056820 con 0x7f5a20144140 2024-04-25T10:07:42.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.311+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a200b4670 con 0x7f5a20144140 2024-04-25T10:07:42.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a17e00640 1 -- 172.21.15.18:0/3693995112 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f5a18056120 con 0x7f5a20144140 2024-04-25T10:07:42.321 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:42.321 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:14.721197+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:07:42.321 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 37 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 msgr2=0x7f59fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 0x7f59fc069420 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5a10005890 tx=0x7f5a10009040 comp rx=0 tx=0).stop 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 msgr2=0x7f5a20159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f5a18007e40 tx=0x7f5a1800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 shutdown_connections 2024-04-25T10:07:42.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a20144140 0x7f5a20159730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5a200cef30 0x7f5a2013ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59fc066f60 0x7f59fc069420 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 --2- 172.21.15.18:0/3693995112 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5a2006e900 0x7f5a201547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 >> 172.21.15.18:0/3693995112 conn(0x7f5a20066fa0 msgr2=0x7f5a200ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 shutdown_connections 2024-04-25T10:07:42.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.315+0000 7f5a26600640 1 -- 172.21.15.18:0/3693995112 wait complete. 2024-04-25T10:07:42.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-25T10:07:42.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 Processor -- start 2024-04-25T10:07:42.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 -- start start 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa26c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c0b30d0 con 0x7fa26c15dc00 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c0ccf30 con 0x7fa26c0c72a0 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa271400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0cd860 con 0x7fa26c0d0150 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa26a800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa26c15dc00 0x7fa26c0c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56554/0 (socket says 172.21.15.18:56554) 2024-04-25T10:07:42.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa26a800640 1 -- 172.21.15.18:0/2232579838 learned_addr learned my addr 172.21.15.18:0/2232579838 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:42.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.479+0000 7fa261e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa26c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405608176 0 0) 0x7fa26c0b30d0 con 0x7fa26c15dc00 2024-04-25T10:07:42.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa250003530 con 0x7fa26c15dc00 2024-04-25T10:07:42.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 946885169 0 0) 0x7fa250003530 con 0x7fa26c15dc00 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 msgr2=0x7fa26c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa26c0af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 >> v1:172.21.15.167:6789/0 conn(0x7fa26c0c72a0 legacy=0x7fa26c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c0cd210 con 0x7fa26c15dc00 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fa25c001680 con 0x7fa26c15dc00 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 >> v1:172.21.15.18:6789/0 conn(0x7fa26c15dc00 legacy=0x7fa26c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa2500039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa250003f30 0x7fa250004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa250004d50 0x7fa2500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0cd860 con 0x7fa250004d50 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25000ba30 con 0x7fa250003f30 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa25000bc30 con 0x7fa26c0d0150 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa250004d50 0x7fa2500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26a800640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa2500039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa261e00640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa250003f30 0x7fa250004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 -- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 msgr2=0x7fa2500039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa26c0d0150 0x7fa2500039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 -- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa250003f30 msgr2=0x7fa250004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa250003f30 0x7fa250004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.483+0000 7fa26b200640 1 -- 172.21.15.18:0/2232579838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa250003530 con 0x7fa250004d50 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa26b200640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa250004d50 0x7fa2500051d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa26c072330 tx=0x7fa26401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4609d1e3c53f64b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264001c10 con 0x7fa250004d50 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2640a66a0 con 0x7fa250004d50 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa269e00640 1 -- 172.21.15.18:0/2232579838 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640a6a90 con 0x7fa250004d50 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- 172.21.15.18:0/2232579838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa250004d50 msgr2=0x7fa2500051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 --2- 172.21.15.18:0/2232579838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa250004d50 0x7fa2500051d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fa26c072330 tx=0x7fa26401c880 comp rx=0 tx=0).stop 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa26b200640 1 -- 172.21.15.18:0/2232579838 reap_dead start 2024-04-25T10:07:42.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- 172.21.15.18:0/2232579838 shutdown_connections 2024-04-25T10:07:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- 172.21.15.18:0/2232579838 >> 172.21.15.18:0/2232579838 conn(0x7fa26c0b2240 msgr2=0x7fa26c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- 172.21.15.18:0/2232579838 shutdown_connections 2024-04-25T10:07:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- 172.21.15.18:0/2232579838 wait complete. 2024-04-25T10:07:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 Processor -- start 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- start start 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa250004d50 0x7fa26c1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa26c0b5070 0x7fa26c0b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0cdcf0 con 0x7fa26c0ad600 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b2d60 con 0x7fa26c0b5070 2024-04-25T10:07:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa271400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0cde70 con 0x7fa250004d50 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.487+0000 7fa261e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40410/0 (socket says 172.21.15.18:40410) 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 -- 172.21.15.18:0/1133514505 learned_addr learned my addr 172.21.15.18:0/1133514505 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa26a800640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa250004d50 0x7fa26c1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa26b200640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa26c0b5070 0x7fa26c0b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 -- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa250004d50 msgr2=0x7fa26c1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa250004d50 0x7fa26c1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 -- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa26c0b5070 msgr2=0x7fa26c0b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa26c0b5070 0x7fa26c0b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 -- 172.21.15.18:0/1133514505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c1f34f0 con 0x7fa26c0ad600 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa261e00640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa254011a00 tx=0x7fa254011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 -- 172.21.15.18:0/1133514505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400fb50 con 0x7fa26c0ad600 2024-04-25T10:07:42.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 -- 172.21.15.18:0/1133514505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25400fcf0 con 0x7fa26c0ad600 2024-04-25T10:07:42.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 -- 172.21.15.18:0/1133514505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400fea0 con 0x7fa26c0ad600 2024-04-25T10:07:42.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c1f3790 con 0x7fa26c0ad600 2024-04-25T10:07:42.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c1f3d50 con 0x7fa26c0ad600 2024-04-25T10:07:42.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 -- 172.21.15.18:0/1133514505 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa254012040 con 0x7fa26c0ad600 2024-04-25T10:07:42.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 0x7fa248069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.491+0000 7fa263400640 1 -- 172.21.15.18:0/1133514505 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fa254085940 con 0x7fa26c0ad600 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa26a800640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 0x7fa248069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 Processor -- start 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- start start 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa26a800640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 0x7fa248069420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b6470 tx=0x7fa25c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a185cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e63a06cba0 con 0x55e63a1cfc00 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e639fd2090 con 0x55e63a1858e0 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e639f5a160 con 0x55e63a1cf2e0 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40418/0 (socket says 172.21.15.18:40418) 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 -- 172.21.15.18:0/3370324194 learned_addr learned my addr 172.21.15.18:0/3370324194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa26a800640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa26b200640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a185cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 -- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 msgr2=0x55e63a1cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 -- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 msgr2=0x55e63a185cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a185cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 -- 172.21.15.18:0/3370324194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e63a07bc20 con 0x55e63a1cfc00 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa26b200640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a185cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa261e00640 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa254056000 tx=0x7fa2540560f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6c065b0a7e29e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa25b400640 1 -- 172.21.15.18:0/3370324194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254081020 con 0x55e63a1cfc00 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa25b400640 1 -- 172.21.15.18:0/3370324194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254054370 con 0x55e63a1cfc00 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa25b400640 1 -- 172.21.15.18:0/3370324194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254022040 con 0x55e63a1cfc00 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- 172.21.15.18:0/3370324194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 msgr2=0x55e63a1853a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa254056000 tx=0x7fa2540560f0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- 172.21.15.18:0/3370324194 shutdown_connections 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a185cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1853a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 --2- 172.21.15.18:0/3370324194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- 172.21.15.18:0/3370324194 >> 172.21.15.18:0/3370324194 conn(0x55e63a181890 msgr2=0x55e63a183c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- 172.21.15.18:0/3370324194 shutdown_connections 2024-04-25T10:07:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.495+0000 7fa27499e000 1 -- 172.21.15.18:0/3370324194 wait complete. 2024-04-25T10:07:42.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- start start 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 Processor -- start 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a1d6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1d6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e639fce130 con 0x55e63a1cfc00 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e639f96130 con 0x55e63a1858e0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e63a090300 con 0x55e63a1cf2e0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 10 client.0 _ll_register_callbacks cb 0x55e63a170bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa261e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1d6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26a800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a1d6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40426/0 (socket says 172.21.15.18:40426) 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 -- 172.21.15.18:0/520270240 learned_addr learned my addr 172.21.15.18:0/520270240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 -- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 msgr2=0x55e63a1d6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1d6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 -- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 msgr2=0x55e63a1d6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a1d6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 -- 172.21.15.18:0/520270240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e639faf060 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa26b200640 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa26401c6b0 tx=0x7fa26401b0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df389813fc31a73d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264007e00 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa254054370 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fa264001bf0 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2640c3050 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 10 client.6516 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e639f737c0 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa254054370 con 0x55e63a1cfc00 2024-04-25T10:07:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2640c6020 con 0x55e63a1cfc00 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 10 client.6516 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 10 client.6516 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 20 client.6516 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a1bde00 0x55e63a1be1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 4 client.6516 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.499+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e639f6dcd0 con 0x55e63a1bde00 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa26a800640 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a1bde00 0x55e63a1be1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa26a800640 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a1bde00 0x55e63a1be1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1a675c348647c8d server_cookie=b4dcad0c345a31d3 in_seq=0 out_seq=0 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa24fe00640 10 client.6516 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa24fe00640 1 -- 172.21.15.18:0/520270240 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e639f6dcd0 con 0x55e63a1bde00 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa24fe00640 10 client.6516 handle_command_reply: tid=0 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 client.6516 shutdown 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 msgr2=0x55e63a1bd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa26401c6b0 tx=0x7fa26401b0c0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 shutdown_connections 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a1bde00 0x55e63a1be1e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a1bd090 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cf2e0 0x55e63a1d6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 --2- 172.21.15.18:0/520270240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1858e0 0x55e63a1d6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa24fe00640 0 client.6516 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 >> 172.21.15.18:0/520270240 conn(0x55e63a181890 msgr2=0x55e63a184510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 shutdown_connections 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 1 -- 172.21.15.18:0/520270240 wait complete. 2024-04-25T10:07:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.503+0000 7fa27499e000 20 client.6516 trim_cache size 0 max 16384 2024-04-25T10:07:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 Processor -- start 2024-04-25T10:07:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 -- start start 2024-04-25T10:07:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1858e0 0x55e63a1bc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a1bc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c1ffd20 con 0x55e63a1cfc00 2024-04-25T10:07:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c09b6e0 con 0x55e63a1cf2e0 2024-04-25T10:07:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c1ff720 con 0x55e63a1858e0 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40442/0 (socket says 172.21.15.18:40442) 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 -- 172.21.15.18:0/3271131633 learned_addr learned my addr 172.21.15.18:0/3271131633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26a800640 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1858e0 0x55e63a1bc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa261e00640 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a1bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 -- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1858e0 msgr2=0x55e63a1bc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1858e0 0x55e63a1bc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 -- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 msgr2=0x55e63a1bc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a1bc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.515+0000 7fa26b200640 1 -- 172.21.15.18:0/3271131633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e639f8dfc0 con 0x55e63a1cfc00 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26b200640 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa264006d40 tx=0x7fa264005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=133272fd5d6d4b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa25aa00640 1 -- 172.21.15.18:0/3271131633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264007e00 con 0x55e63a1cfc00 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa25aa00640 1 -- 172.21.15.18:0/3271131633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264001bf0 con 0x55e63a1cfc00 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa25aa00640 1 -- 172.21.15.18:0/3271131633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2640052d0 con 0x55e63a1cfc00 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- 172.21.15.18:0/3271131633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 msgr2=0x55e63a183c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa264006d40 tx=0x7fa264005040 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- 172.21.15.18:0/3271131633 shutdown_connections 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1cfc00 0x55e63a183c80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a1bc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- 172.21.15.18:0/3271131633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1858e0 0x55e63a1bc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- 172.21.15.18:0/3271131633 >> 172.21.15.18:0/3271131633 conn(0x55e63a181890 msgr2=0x55e63a1dcd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- 172.21.15.18:0/3271131633 shutdown_connections 2024-04-25T10:07:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- 172.21.15.18:0/3271131633 wait complete. 2024-04-25T10:07:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- start start 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 Processor -- start 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a22f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cfc00 0x55e63a1d3040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e639f6ce70 con 0x55e63a1858e0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e639f5aa50 con 0x55e63a1cf2e0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e639fd13a0 con 0x55e63a1cfc00 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa27499e000 10 client.0 _ll_register_callbacks cb 0x55e639f7e240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40454/0 (socket says 172.21.15.18:40454) 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 -- 172.21.15.18:0/967414773 learned_addr learned my addr 172.21.15.18:0/967414773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa261e00640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a22f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26b200640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cfc00 0x55e63a1d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 -- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cfc00 msgr2=0x55e63a1d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cfc00 0x55e63a1d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 -- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 msgr2=0x55e63a22f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a22f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 -- 172.21.15.18:0/967414773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e63a02b9e0 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa26a800640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa25c001ec0 tx=0x7fa26c0cd100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ec498495eec429 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa24fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.519+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c02d500 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fa25c026cc0 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa264001bf0 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa25c02d6a0 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 10 client.6522 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55e639f71630 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa264001bf0 con 0x55e63a1858e0 2024-04-25T10:07:42.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa25c038480 con 0x55e63a1858e0 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 10 client.6522 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 10 client.6522 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 20 client.6522 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a235990 0x55e63a237d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 4 client.6522 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55e639fdf5d0 con 0x55e63a235990 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa261e00640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a235990 0x55e63a237d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa261e00640 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a235990 0x55e63a237d80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ddf672c549852f server_cookie=42ca528256b5aaaf in_seq=0 out_seq=0 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 10 client.6522 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 1 -- 172.21.15.18:0/967414773 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x55e639fdf5d0 con 0x55e63a235990 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 10 client.6522 handle_command_reply: tid=0 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 client.6522 shutdown 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 msgr2=0x55e63a22eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fa25c001ec0 tx=0x7fa26c0cd100 comp rx=0 tx=0).stop 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 shutdown_connections 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55e63a235990 0x55e63a237d80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e63a1cfc00 0x55e63a1d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e63a1cf2e0 0x55e63a22f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 --2- 172.21.15.18:0/967414773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e63a1858e0 0x55e63a22eb30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa24fe00640 0 client.6522 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 >> 172.21.15.18:0/967414773 conn(0x55e63a181890 msgr2=0x55e63a1ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 shutdown_connections 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 1 -- 172.21.15.18:0/967414773 wait complete. 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa27499e000 20 client.6522 trim_cache size 0 max 16384 2024-04-25T10:07:42.535 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "backtrace", 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 1402207033, 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir_test/file" 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:42.536 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 msgr2=0x7fa248069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 0x7fa248069420 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0b6470 tx=0x7fa25c009040 comp rx=0 tx=0).stop 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 msgr2=0x7fa26c0ada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fa254011a00 tx=0x7fa254011ec0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 shutdown_connections 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa26c0b5070 0x7fa26c0b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26c0ad600 0x7fa26c0ada80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa248066f60 0x7fa248069420 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 --2- 172.21.15.18:0/1133514505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa250004d50 0x7fa26c1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 >> 172.21.15.18:0/1133514505 conn(0x7fa26c0b2240 msgr2=0x7fa26c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 shutdown_connections 2024-04-25T10:07:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.523+0000 7fa271400640 1 -- 172.21.15.18:0/1133514505 wait complete. 2024-04-25T10:07:42.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:07:42.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.683+0000 7f93f8600640 1 Processor -- start 2024-04-25T10:07:42.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.683+0000 7f93f8600640 1 -- start start 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.683+0000 7f93f8600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f93f015da10 0x7f93f00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f8600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f015ddf0 con 0x7f93f00d11b0 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f8600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00b4ba0 con 0x7f93f015da10 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f006b480 con 0x7f93f00b4210 2024-04-25T10:07:42.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f93f00d11b0 0x7f93f006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56566/0 (socket says 172.21.15.18:56566) 2024-04-25T10:07:42.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5200640 1 -- 172.21.15.18:0/1991204909 learned_addr learned my addr 172.21.15.18:0/1991204909 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 --2- 172.21.15.18:0/1991204909 >> v2:172.21.15.167:3300/0 conn(0x7f93f015da10 0x7f93f00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f6600640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93efe00640 1 -- 172.21.15.18:0/1991204909 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228068439 0 0) 0x7f93f015ddf0 con 0x7f93f00d11b0 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93efe00640 1 -- 172.21.15.18:0/1991204909 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93d8003530 con 0x7f93f00d11b0 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 -- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 msgr2=0x7f93f00b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f00b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 -- 172.21.15.18:0/1991204909 >> v1:172.21.15.18:6789/0 conn(0x7f93f00d11b0 legacy=0x7f93f006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 -- 172.21.15.18:0/1991204909 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00d06d0 con 0x7f93f015da10 2024-04-25T10:07:42.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.687+0000 7f93f5c00640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f00afe20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097c0 tx=0x7f93e401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8c94f36cdbd8a2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93efe00640 1 -- 172.21.15.18:0/1991204909 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40b0070 con 0x7f93f015da10 2024-04-25T10:07:42.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93efe00640 1 -- 172.21.15.18:0/1991204909 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40ab600 con 0x7f93f015da10 2024-04-25T10:07:42.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93efe00640 1 -- 172.21.15.18:0/1991204909 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e40ab9d0 con 0x7f93f015da10 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 msgr2=0x7f93f00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f00afe20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f93e40097c0 tx=0x7f93e401c410 comp rx=0 tx=0).stop 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- 172.21.15.18:0/1991204909 shutdown_connections 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- 172.21.15.18:0/1991204909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f00afe20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- 172.21.15.18:0/1991204909 >> 172.21.15.18:0/1991204909 conn(0x7f93f00b2400 msgr2=0x7f93f00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- 172.21.15.18:0/1991204909 shutdown_connections 2024-04-25T10:07:42.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- 172.21.15.18:0/1991204909 wait complete. 2024-04-25T10:07:42.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 Processor -- start 2024-04-25T10:07:42.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- start start 2024-04-25T10:07:42.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f0160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f0139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0162150 con 0x7f93f00d11b0 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0161fd0 con 0x7f93f015da10 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f8600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f01622d0 con 0x7f93f00b4210 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40460/0 (socket says 172.21.15.18:40460) 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.691+0000 7f93f5200640 1 -- 172.21.15.18:0/3216868760 learned_addr learned my addr 172.21.15.18:0/3216868760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5c00640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f0160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f6600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f0139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 -- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 msgr2=0x7f93f0160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f0160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 -- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 msgr2=0x7f93f0139bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f0139bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 -- 172.21.15.18:0/3216868760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00ce9c0 con 0x7f93f00d11b0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f5200640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c450 tx=0x7f93dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc017070 con 0x7f93f00d11b0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc005cf0 con 0x7f93f00d11b0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f00ceca0 con 0x7f93f00d11b0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc007290 con 0x7f93f00d11b0 2024-04-25T10:07:42.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f00cf260 con 0x7f93f00d11b0 2024-04-25T10:07:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f00745d0 con 0x7f93f00d11b0 2024-04-25T10:07:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f93dc01a070 con 0x7f93f00d11b0 2024-04-25T10:07:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 0x7f93d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.695+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f93dc0845f0 con 0x7f93f00d11b0 2024-04-25T10:07:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.699+0000 7f93f5c00640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 0x7f93d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.699+0000 7f93f5c00640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 0x7f93d0069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93e40ad000 tx=0x7f93e40a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.699+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93dc054c80 con 0x7f93f00d11b0 2024-04-25T10:07:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.899+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f93f00b5640 con 0x7f93f00d11b0 2024-04-25T10:07:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.899+0000 7f93ed600640 1 -- 172.21.15.18:0/3216868760 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f93dc058d20 con 0x7f93f00d11b0 2024-04-25T10:07:42.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:07:42.908 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 msgr2=0x7f93d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 0x7f93d0069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f93e40ad000 tx=0x7f93e40a4f90 comp rx=0 tx=0).stop 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 msgr2=0x7f93f014c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f93dc00c450 tx=0x7f93dc00c910 comp rx=0 tx=0).stop 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 shutdown_connections 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93f015da10 0x7f93f0139bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f93f00d11b0 0x7f93f014c190 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f93d0066f60 0x7f93d0069420 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 --2- 172.21.15.18:0/3216868760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93f00b4210 0x7f93f0160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 >> 172.21.15.18:0/3216868760 conn(0x7f93f00b2400 msgr2=0x7f93f0156a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 shutdown_connections 2024-04-25T10:07:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:42.903+0000 7f93f8600640 1 -- 172.21.15.18:0/3216868760 wait complete. 2024-04-25T10:07:42.929 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:07:42.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:42.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T10:07:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 Processor -- start 2024-04-25T10:07:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 -- start start 2024-04-25T10:07:43.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f30071e40 0x7f1f3006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006e900 0x7f1f3015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f300cf490 con 0x7f1f30144080 2024-04-25T10:07:43.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3006ed70 con 0x7f1f30071e40 2024-04-25T10:07:43.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f35400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300719b0 con 0x7f1f3006e900 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f2f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006e900 0x7f1f3015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f30071e40 0x7f1f3006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f30071e40 0x7f1f3006e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:52864/0 (socket says 172.21.15.18:52864) 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 -- 172.21.15.18:0/2098519225 learned_addr learned my addr 172.21.15.18:0/2098519225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f2e800640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f1f30144080 0x7f1f300ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:37874/0 (socket says 172.21.15.18:37874) 2024-04-25T10:07:43.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 -- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006e900 msgr2=0x7f1f3015e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 --2- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006e900 0x7f1f3015e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 -- 172.21.15.18:0/2098519225 >> v1:172.21.15.167:6789/0 conn(0x7f1f30144080 legacy=0x7f1f300ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.067+0000 7f1f27e00640 1 -- 172.21.15.18:0/2098519225 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300cf1b0 con 0x7f1f30071e40 2024-04-25T10:07:43.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f27e00640 1 --2- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3006e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009870 tx=0x7f1f1801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83e7b89bb4a1e12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f2de00640 1 -- 172.21.15.18:0/2098519225 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180a95f0 con 0x7f1f30071e40 2024-04-25T10:07:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f2de00640 1 -- 172.21.15.18:0/2098519225 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f180a9790 con 0x7f1f30071e40 2024-04-25T10:07:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f2de00640 1 -- 172.21.15.18:0/2098519225 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180a9b60 con 0x7f1f30071e40 2024-04-25T10:07:43.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 -- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 msgr2=0x7f1f3006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 --2- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3006e3c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009870 tx=0x7f1f1801c530 comp rx=0 tx=0).stop 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 -- 172.21.15.18:0/2098519225 shutdown_connections 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 --2- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006e900 0x7f1f3015e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 --2- 172.21.15.18:0/2098519225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3006e3c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 -- 172.21.15.18:0/2098519225 >> 172.21.15.18:0/2098519225 conn(0x7f1f3006ac10 msgr2=0x7f1f3006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 -- 172.21.15.18:0/2098519225 shutdown_connections 2024-04-25T10:07:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.071+0000 7f1f35400640 1 -- 172.21.15.18:0/2098519225 wait complete. 2024-04-25T10:07:43.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 Processor -- start 2024-04-25T10:07:43.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- start start 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3013d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f30144080 0x7f1f300a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b4ad0 con 0x7f1f3006e900 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b4950 con 0x7f1f30071e40 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300ced70 con 0x7f1f30144080 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40466/0 (socket says 172.21.15.18:40466) 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 -- 172.21.15.18:0/1775835586 learned_addr learned my addr 172.21.15.18:0/1775835586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f27e00640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3013d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2f200640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f30144080 0x7f1f300a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 -- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f30144080 msgr2=0x7f1f300a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f30144080 0x7f1f300a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 -- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 msgr2=0x7f1f3013d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3013d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 -- 172.21.15.18:0/1775835586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3013c560 con 0x7f1f3006e900 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f2e800640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c370 tx=0x7f1f2000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f26a00640 1 -- 172.21.15.18:0/1775835586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200074e0 con 0x7f1f3006e900 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f26a00640 1 -- 172.21.15.18:0/1775835586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20007680 con 0x7f1f3006e900 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f26a00640 1 -- 172.21.15.18:0/1775835586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20004a30 con 0x7f1f3006e900 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3013c800 con 0x7f1f3006e900 2024-04-25T10:07:43.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.075+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3013d0a0 con 0x7f1f3006e900 2024-04-25T10:07:43.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f26a00640 1 -- 172.21.15.18:0/1775835586 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f2001a020 con 0x7f1f3006e900 2024-04-25T10:07:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f26a00640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 0x7f1f0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f26a00640 1 -- 172.21.15.18:0/1775835586 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1f20084950 con 0x7f1f3006e900 2024-04-25T10:07:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 Processor -- start 2024-04-25T10:07:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f27e00640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 0x7f1f0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 -- start start 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f27e00640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 0x7f1f0c069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ae000 tx=0x7f1f180b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2d6c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2bb9d00 con 0x55a8e2d6c970 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2b41df0 con 0x55a8e2db5520 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2bb5da0 con 0x55a8e2db5e40 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f2f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2d6c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f2f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40470/0 (socket says 172.21.15.18:40470) 2024-04-25T10:07:43.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.079+0000 7f1f2f200640 1 -- 172.21.15.18:0/927153342 learned_addr learned my addr 172.21.15.18:0/927153342 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 -- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 msgr2=0x55a8e2d6c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2d6c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 -- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 msgr2=0x55a8e2db5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 -- 172.21.15.18:0/927153342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e2b74580 con 0x55a8e2d6c970 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f27e00640 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2d6c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:07:43.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1f28011580 tx=0x7f1f28009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebcc2c0da3c7357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f1f400640 1 -- 172.21.15.18:0/927153342 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28015900 con 0x55a8e2d6c970 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f1f400640 1 -- 172.21.15.18:0/927153342 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28015aa0 con 0x55a8e2d6c970 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f1f400640 1 -- 172.21.15.18:0/927153342 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28015e50 con 0x55a8e2d6c970 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- 172.21.15.18:0/927153342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 msgr2=0x55a8e2d6cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1f28011580 tx=0x7f1f28009750 comp rx=0 tx=0).stop 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- 172.21.15.18:0/927153342 shutdown_connections 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2d6cd50 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2d6c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- 172.21.15.18:0/927153342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- 172.21.15.18:0/927153342 >> 172.21.15.18:0/927153342 conn(0x55a8e2c53c10 msgr2=0x55a8e2d6ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- 172.21.15.18:0/927153342 shutdown_connections 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- 172.21.15.18:0/927153342 wait complete. 2024-04-25T10:07:43.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- start start 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 Processor -- start 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5520 0x55a8e2d70e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2d71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2b526d0 con 0x55a8e2d6c970 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2b74950 con 0x55a8e2db5e40 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2bb9010 con 0x55a8e2db5520 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f387e0000 10 client.0 _ll_register_callbacks cb 0x55a8e2d58030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40486/0 (socket says 172.21.15.18:40486) 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2e800640 1 -- 172.21.15.18:0/2946416293 learned_addr learned my addr 172.21.15.18:0/2946416293 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f2f200640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2d71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.083+0000 7f1f27e00640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5520 0x55a8e2d70e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 -- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5520 msgr2=0x55a8e2d70e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5520 0x55a8e2d70e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 -- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 msgr2=0x55a8e2d71370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2d71370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 -- 172.21.15.18:0/2946416293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e2b56d40 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f2e800640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cd30 tx=0x7f1f20059190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a61b08f3d96e51b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20081060 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1f20004bd0 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f28015aa0 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f20071050 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 10 client.6537 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a8e2bb4cf0 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f28015aa0 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1f20057040 con 0x55a8e2d6c970 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 10 client.6537 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:43.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 10 client.6537 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 20 client.6537 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2d720e0 0x55a8e2dc67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 4 client.6537 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8e2b559d0 con 0x55a8e2d720e0 2024-04-25T10:07:43.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f27e00640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2d720e0 0x55a8e2dc67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f27e00640 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2d720e0 0x55a8e2dc67d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ab85b15cfe85c7c server_cookie=4a93b010a1caa95d in_seq=0 out_seq=0 2024-04-25T10:07:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 10 client.6537 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 1 -- 172.21.15.18:0/2946416293 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8e2b559d0 con 0x55a8e2d720e0 2024-04-25T10:07:43.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 10 client.6537 handle_command_reply: tid=0 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 client.6537 shutdown 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 msgr2=0x55a8e2db4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000cd30 tx=0x7f1f20059190 comp rx=0 tx=0).stop 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 shutdown_connections 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2d720e0 0x55a8e2dc67d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2d71370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5520 0x55a8e2d70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 --2- 172.21.15.18:0/2946416293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db4ee0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 >> 172.21.15.18:0/2946416293 conn(0x55a8e2c53c10 msgr2=0x55a8e2d6b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f13e00640 0 client.6537 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 shutdown_connections 2024-04-25T10:07:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 1 -- 172.21.15.18:0/2946416293 wait complete. 2024-04-25T10:07:43.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.087+0000 7f1f387e0000 20 client.6537 trim_cache size 0 max 16384 2024-04-25T10:07:43.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 Processor -- start 2024-04-25T10:07:43.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 -- start start 2024-04-25T10:07:43.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2dc57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30203620 con 0x55a8e2d6c970 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3013bc80 con 0x55a8e2db5520 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3013b080 con 0x55a8e2db5e40 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.103+0000 7f1f2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40494/0 (socket says 172.21.15.18:40494) 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 -- 172.21.15.18:0/174594463 learned_addr learned my addr 172.21.15.18:0/174594463 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2f200640 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2dc57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f27e00640 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 -- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 msgr2=0x55a8e2dc57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2dc57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 -- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 msgr2=0x55a8e2db4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 -- 172.21.15.18:0/174594463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e2db5c70 con 0x55a8e2d6c970 2024-04-25T10:07:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1f20051480 tx=0x7f1f2005d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b7b794920cbc84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f1ea00640 1 -- 172.21.15.18:0/174594463 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20081030 con 0x55a8e2d6c970 2024-04-25T10:07:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f1ea00640 1 -- 172.21.15.18:0/174594463 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2005d240 con 0x55a8e2d6c970 2024-04-25T10:07:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f1ea00640 1 -- 172.21.15.18:0/174594463 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200544c0 con 0x55a8e2d6c970 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- 172.21.15.18:0/174594463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 msgr2=0x55a8e2db3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f1f20051480 tx=0x7f1f2005d850 comp rx=0 tx=0).stop 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- 172.21.15.18:0/174594463 shutdown_connections 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2db5e40 0x55a8e2dc57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5520 0x55a8e2db4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- 172.21.15.18:0/174594463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2d6c970 0x55a8e2db3bd0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- 172.21.15.18:0/174594463 >> 172.21.15.18:0/174594463 conn(0x55a8e2c53c10 msgr2=0x55a8e2db34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- 172.21.15.18:0/174594463 shutdown_connections 2024-04-25T10:07:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- 172.21.15.18:0/174594463 wait complete. 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- start start 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 Processor -- start 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2d6c970 0x55a8e2e12380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2e12e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2b526d0 con 0x55a8e2db5520 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3013b680 con 0x55a8e2db5e40 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e2bb9010 con 0x55a8e2d6c970 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f387e0000 10 client.0 _ll_register_callbacks cb 0x7f1f28009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f27e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40504/0 (socket says 172.21.15.18:40504) 2024-04-25T10:07:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f27e00640 1 -- 172.21.15.18:0/120549012 learned_addr learned my addr 172.21.15.18:0/120549012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2e800640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2d6c970 0x55a8e2e12380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.107+0000 7f1f2f200640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2e12e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 -- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2d6c970 msgr2=0x55a8e2e12380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2d6c970 0x55a8e2e12380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 -- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 msgr2=0x55a8e2e12e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2e12e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 -- 172.21.15.18:0/120549012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e2c3cd30 con 0x55a8e2db5520 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f27e00640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801a160 tx=0x7f1f1801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490bee75387a1e58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180bbc50 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1f180bbdf0 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f2005d240 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f180cc130 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 10 client.6543 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a8e2b865a0 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f180d9070 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1f180cc2d0 con 0x55a8e2db5520 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 10 client.6543 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 10 client.6543 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 20 client.6543 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2e13340 0x55a8e2e13750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 4 client.6543 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x55a8e2b96610 con 0x55a8e2e13340 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f2e800640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2e13340 0x55a8e2e13750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f2e800640 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2e13340 0x55a8e2e13750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=761c36ed1444e8e7 server_cookie=370ff59615497b23 in_seq=0 out_seq=0 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 10 client.6543 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 1 -- 172.21.15.18:0/120549012 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a8e2b96610 con 0x55a8e2e13340 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 10 client.6543 handle_command_reply: tid=0 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 client.6543 shutdown 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 msgr2=0x55a8e2e128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f1f1801a160 tx=0x7f1f1801ad70 comp rx=0 tx=0).stop 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 shutdown_connections 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55a8e2e13340 0x55a8e2e13750 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e2db5e40 0x55a8e2e12e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e2db5520 0x55a8e2e128c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f13e00640 0 client.6543 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 --2- 172.21.15.18:0/120549012 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e2d6c970 0x55a8e2e12380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 >> 172.21.15.18:0/120549012 conn(0x55a8e2c53c10 msgr2=0x55a8e2db3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 shutdown_connections 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 1 -- 172.21.15.18:0/120549012 wait complete. 2024-04-25T10:07:43.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.111+0000 7f1f387e0000 20 client.6543 trim_cache size 0 max 16384 2024-04-25T10:07:43.125 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:07:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "29f1dce9-b190-4fc8-bc76-4a61a968d8a5", 2024-04-25T10:07:43.125 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:07:43.125 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 msgr2=0x7f1f0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 0x7f1f0c069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f1f180ae000 tx=0x7f1f180b3040 comp rx=0 tx=0).stop 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 msgr2=0x7f1f3015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000c370 tx=0x7f1f2000c830 comp rx=0 tx=0).stop 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 shutdown_connections 2024-04-25T10:07:43.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f60 0x7f1f0c069420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f30144080 0x7f1f300a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f30071e40 0x7f1f3013d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 --2- 172.21.15.18:0/1775835586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3006e900 0x7f1f3015c5c0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 >> 172.21.15.18:0/1775835586 conn(0x7f1f3006ac10 msgr2=0x7f1f300b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 shutdown_connections 2024-04-25T10:07:43.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.115+0000 7f1f35400640 1 -- 172.21.15.18:0/1775835586 wait complete. 2024-04-25T10:07:43.127 INFO:tasks.ceph.mds.b.smithi167.stderr:2024-04-25T10:07:43.112+0000 7f0423800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={35570=0-4194304@1} caps={35570=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=35570 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f84882b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:07:43.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:07:43.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T10:07:43.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 Processor -- start 2024-04-25T10:07:43.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 -- start start 2024-04-25T10:07:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc000cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efc000cf3c0 0x7efc000cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000d02a0 con 0x7efc000cd370 2024-04-25T10:07:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000cc350 con 0x7efc000cf3c0 2024-04-25T10:07:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efc05c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000cc630 con 0x7efc0015b910 2024-04-25T10:07:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbfea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc000cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbff400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7efc000cd370 0x7efc00099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:37880/0 (socket says 172.21.15.18:37880) 2024-04-25T10:07:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbff400640 1 -- 172.21.15.18:0/201598649 learned_addr learned my addr 172.21.15.18:0/201598649 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:07:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbf6000640 1 --2- 172.21.15.18:0/201598649 >> v2:172.21.15.167:3300/0 conn(0x7efc000cf3c0 0x7efc000cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbfe000640 1 -- 172.21.15.18:0/201598649 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710247143 0 0) 0x7efc000d02a0 con 0x7efc000cd370 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbfe000640 1 -- 172.21.15.18:0/201598649 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbe4003530 con 0x7efc000cd370 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbf6000640 1 -- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 msgr2=0x7efc000cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbf6000640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc000cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbf6000640 1 -- 172.21.15.18:0/201598649 >> v1:172.21.15.167:6789/0 conn(0x7efc000cd370 legacy=0x7efc00099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbf6000640 1 -- 172.21.15.18:0/201598649 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cc910 con 0x7efc000cf3c0 2024-04-25T10:07:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.275+0000 7efbfea00640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc000cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efbf6000640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc000cce30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097c0 tx=0x7efbe801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e62b56ccb5f9954 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efbfe000640 1 -- 172.21.15.18:0/201598649 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80b1070 con 0x7efc000cf3c0 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efbfe000640 1 -- 172.21.15.18:0/201598649 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe80ac410 con 0x7efc000cf3c0 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efbfe000640 1 -- 172.21.15.18:0/201598649 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80ac7c0 con 0x7efc000cf3c0 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 -- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 msgr2=0x7efc000cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc000cce30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efbe80097c0 tx=0x7efbe801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 -- 172.21.15.18:0/201598649 shutdown_connections 2024-04-25T10:07:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc000cce30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 --2- 172.21.15.18:0/201598649 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc000cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 -- 172.21.15.18:0/201598649 >> 172.21.15.18:0/201598649 conn(0x7efc000b3200 msgr2=0x7efc000b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 -- 172.21.15.18:0/201598649 shutdown_connections 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.279+0000 7efc05c00640 1 -- 172.21.15.18:0/201598649 wait complete. 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 Processor -- start 2024-04-25T10:07:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- start start 2024-04-25T10:07:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc0015d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc0006ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0009a2f0 con 0x7efc000cd370 2024-04-25T10:07:43.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0009a170 con 0x7efc000cf3c0 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015bcf0 con 0x7efc0015b910 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40508/0 (socket says 172.21.15.18:40508) 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 -- 172.21.15.18:0/3383736721 learned_addr learned my addr 172.21.15.18:0/3383736721 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbf6000640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc0015d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbff400640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc0006ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 -- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 msgr2=0x7efc0006ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc0006ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 -- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 msgr2=0x7efc0015d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc0015d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 -- 172.21.15.18:0/3383736721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cb620 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbfea00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efbf000e980 tx=0x7efbf000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbf7400640 1 -- 172.21.15.18:0/3383736721 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0017070 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbf7400640 1 -- 172.21.15.18:0/3383736721 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000ca00 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efbf7400640 1 -- 172.21.15.18:0/3383736721 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000cdd0 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc000ca580 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.283+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc000cab40 con 0x7efc000cd370 2024-04-25T10:07:43.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbf7400640 1 -- 172.21.15.18:0/3383736721 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efbf001a070 con 0x7efc000cd370 2024-04-25T10:07:43.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbf7400640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 0x7efbdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbf7400640 1 -- 172.21.15.18:0/3383736721 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efbf0085080 con 0x7efc000cd370 2024-04-25T10:07:43.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 Processor -- start 2024-04-25T10:07:43.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbf6000640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 0x7efbdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 -- start start 2024-04-25T10:07:43.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbf6000640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 0x7efbdc069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efbe80ae000 tx=0x7efbe80a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5a9d0 0x56496dd5adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496dd10b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496db5dff0 con 0x56496dd110a0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496dae6150 con 0x56496dd5b2f0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496db5a090 con 0x56496dd5a9d0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40520/0 (socket says 172.21.15.18:40520) 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.287+0000 7efbff400640 1 -- 172.21.15.18:0/413338989 learned_addr learned my addr 172.21.15.18:0/413338989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbfea00640 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5a9d0 0x56496dd5adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbf6000640 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496dd10b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 -- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5a9d0 msgr2=0x56496dd5adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5a9d0 0x56496dd5adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 -- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 msgr2=0x56496dd10b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496dd10b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 -- 172.21.15.18:0/413338989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56496dcf40d0 con 0x56496dd110a0 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efbf8001fc0 tx=0x7efbf800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6afa938129abba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbef400640 1 -- 172.21.15.18:0/413338989 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8019070 con 0x56496dd110a0 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbef400640 1 -- 172.21.15.18:0/413338989 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800ee50 con 0x56496dd110a0 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbef400640 1 -- 172.21.15.18:0/413338989 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8014680 con 0x56496dd110a0 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- 172.21.15.18:0/413338989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 msgr2=0x56496dd11480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7efbf8001fc0 tx=0x7efbf800e530 comp rx=0 tx=0).stop 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- 172.21.15.18:0/413338989 shutdown_connections 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496dd11480 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496dd10b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- 172.21.15.18:0/413338989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5a9d0 0x56496dd5adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- 172.21.15.18:0/413338989 >> 172.21.15.18:0/413338989 conn(0x56496dd0d020 msgr2=0x56496dd0f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- 172.21.15.18:0/413338989 shutdown_connections 2024-04-25T10:07:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- 172.21.15.18:0/413338989 wait complete. 2024-04-25T10:07:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- start start 2024-04-25T10:07:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 Processor -- start 2024-04-25T10:07:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496dd3f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496dd3fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496db22250 con 0x56496dd5b2f0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496db18690 con 0x56496dd5a9d0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496dae6a40 con 0x56496dd110a0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efc09095000 10 client.0 _ll_register_callbacks cb 0x56496dcfbe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40530/0 (socket says 172.21.15.18:40530) 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.291+0000 7efbff400640 1 -- 172.21.15.18:0/340733503 learned_addr learned my addr 172.21.15.18:0/340733503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbfea00640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496dd3f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbf6000640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496dd3fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 -- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 msgr2=0x56496dd3f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496dd3f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 -- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 msgr2=0x56496dd3fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496dd3fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 -- 172.21.15.18:0/340733503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56496dc0b1c0 con 0x56496dd5b2f0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbff400640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009010 tx=0x7efbf8001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be406059f00e920 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8024020 con 0x56496dd5b2f0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efbf8014a40 con 0x56496dd5b2f0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbf800ee50 con 0x56496dd5b2f0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf802e050 con 0x56496dd5b2f0 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 10 client.6552 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x56496dc07170 con 0x56496dd5b2f0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800ee50 con 0x56496dd5b2f0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efbf8031020 con 0x56496dd5b2f0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 10 client.6552 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 10 client.6552 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 20 client.6552 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd6ac80 0x56496dd6d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 4 client.6552 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56496daf9c60 con 0x56496dd6ac80 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbfea00640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd6ac80 0x56496dd6d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbfea00640 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd6ac80 0x56496dd6d070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f58d067a252eee0 server_cookie=e83b1cf5e0ec0175 in_seq=0 out_seq=0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 10 client.6552 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 1 -- 172.21.15.18:0/340733503 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56496daf9c60 con 0x56496dd6ac80 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 10 client.6552 handle_command_reply: tid=0 2024-04-25T10:07:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 client.6552 shutdown 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 msgr2=0x56496dd40270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009010 tx=0x7efbf8001260 comp rx=0 tx=0).stop 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 shutdown_connections 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd6ac80 0x56496dd6d070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5b2f0 0x56496dd40270 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496dd3fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 --2- 172.21.15.18:0/340733503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496dd3f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efbe3e00640 0 client.6552 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.295+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 >> 172.21.15.18:0/340733503 conn(0x56496dd0d020 msgr2=0x56496dd0fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.299+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 shutdown_connections 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.299+0000 7efc09095000 1 -- 172.21.15.18:0/340733503 wait complete. 2024-04-25T10:07:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.299+0000 7efc09095000 20 client.6552 trim_cache size 0 max 16384 2024-04-25T10:07:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 Processor -- start 2024-04-25T10:07:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 -- start start 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496ddbb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496ddbbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc002010d0 con 0x56496dd5a9d0 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc00200250 con 0x56496dd5b2f0 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.311+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015cdc0 con 0x56496dd110a0 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40546/0 (socket says 172.21.15.18:40546) 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 -- 172.21.15.18:0/3733363409 learned_addr learned my addr 172.21.15.18:0/3733363409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbfea00640 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496ddbb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbff400640 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496ddbbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 -- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 msgr2=0x56496ddbb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496ddbb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 -- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 msgr2=0x56496ddbbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496ddbbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 -- 172.21.15.18:0/3733363409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56496dba4de0 con 0x56496dd5a9d0 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efbe801ab50 tx=0x7efbe80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee4e3a0cea90722 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbeea00640 1 -- 172.21.15.18:0/3733363409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80c9070 con 0x56496dd5a9d0 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbeea00640 1 -- 172.21.15.18:0/3733363409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8004360 con 0x56496dd5a9d0 2024-04-25T10:07:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbeea00640 1 -- 172.21.15.18:0/3733363409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe80b1040 con 0x56496dd5a9d0 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- 172.21.15.18:0/3733363409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 msgr2=0x56496ddbba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7efbe801ab50 tx=0x7efbe80a7000 comp rx=0 tx=0).stop 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- 172.21.15.18:0/3733363409 shutdown_connections 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5b2f0 0x56496ddbbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd5a9d0 0x56496ddbba90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- 172.21.15.18:0/3733363409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd110a0 0x56496ddbb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- 172.21.15.18:0/3733363409 >> 172.21.15.18:0/3733363409 conn(0x56496dd0d020 msgr2=0x56496dd67fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- 172.21.15.18:0/3733363409 shutdown_connections 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- 172.21.15.18:0/3733363409 wait complete. 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- start start 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 Processor -- start 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496ddbf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5b2f0 0x56496dd7ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56496daf8e00 con 0x56496dd110a0 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc001ffce0 con 0x56496dd5a9d0 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56496db5d300 con 0x56496dd5b2f0 2024-04-25T10:07:43.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efc09095000 10 client.0 _ll_register_callbacks cb 0x56496dcdc040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbfea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbfea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40554/0 (socket says 172.21.15.18:40554) 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbfea00640 1 -- 172.21.15.18:0/3301840876 learned_addr learned my addr 172.21.15.18:0/3301840876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbff400640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5b2f0 0x56496dd7ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.315+0000 7efbf6000640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496ddbf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 -- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5b2f0 msgr2=0x56496dd7ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5b2f0 0x56496dd7ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 -- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 msgr2=0x56496ddbf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496ddbf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 -- 172.21.15.18:0/3301840876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56496daff8e0 con 0x56496dd110a0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbfea00640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efbf0004780 tx=0x7efbf0051b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ba7adeccc95e5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0072060 con 0x56496dd110a0 2024-04-25T10:07:43.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efbf0053b30 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efbe8004360 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7efbf0081070 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 10 client.6558 fetch_fsmap learned FSMap version 37 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x56496dbb78f0 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8004360 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 37) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efbf0024060 con 0x56496dd110a0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 10 client.6558 fetch_fsmap finished waiting for FSMap version 37 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 10 client.6558 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 20 client.6558 populate_metadata read hostname 'smithi018' 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd7bb40 0x56496dd7bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 4 client.6558 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56496db6b530 con 0x56496dd7bb40 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbf6000640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd7bb40 0x56496dd7bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:07:43.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbf6000640 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd7bb40 0x56496dd7bf50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90645b4317b80a05 server_cookie=48d69f07616c1ffb in_seq=0 out_seq=0 2024-04-25T10:07:43.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 10 client.6558 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 1 -- 172.21.15.18:0/3301840876 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x56496db6b530 con 0x56496dd7bb40 2024-04-25T10:07:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 10 client.6558 handle_command_reply: tid=0 2024-04-25T10:07:43.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 client.6558 shutdown 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 msgr2=0x56496ddbf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efbf0004780 tx=0x7efbf0051b50 comp rx=0 tx=0).stop 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 shutdown_connections 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x56496dd7bb40 0x56496dd7bf50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56496dd5b2f0 0x56496dd7ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56496dd5a9d0 0x56496ddbf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 --2- 172.21.15.18:0/3301840876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56496dd110a0 0x56496ddbf380 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 >> 172.21.15.18:0/3301840876 conn(0x56496dd0d020 msgr2=0x56496dd59070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efbe3e00640 0 client.6558 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 shutdown_connections 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 1 -- 172.21.15.18:0/3301840876 wait complete. 2024-04-25T10:07:43.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc09095000 20 client.6558 trim_cache size 0 max 16384 2024-04-25T10:07:43.335 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:07:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:07:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:07:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "29f1dce9-b190-4fc8-bc76-4a61a968d8a5": { 2024-04-25T10:07:43.335 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "29f1dce9-b190-4fc8-bc76-4a61a968d8a5", 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair,force" 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:07:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 msgr2=0x7efbdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 0x7efbdc069420 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efbe80ae000 tx=0x7efbe80a6040 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 msgr2=0x7efc00150920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.319+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7efbf000e980 tx=0x7efbf000ee40 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 shutdown_connections 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efbdc066f60 0x7efbdc069420 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efc0015b910 0x7efc0006ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc000cf3c0 0x7efc0015d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 --2- 172.21.15.18:0/3383736721 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efc000cd370 0x7efc00150920 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 >> 172.21.15.18:0/3383736721 conn(0x7efc000b3200 msgr2=0x7efc000c7ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:07:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 shutdown_connections 2024-04-25T10:07:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:07:43.323+0000 7efc05c00640 1 -- 172.21.15.18:0/3383736721 wait complete. 2024-04-25T10:07:43.348 INFO:tasks.cephfs.filesystem:scrub status for tag:29f1dce9-b190-4fc8-bc76-4a61a968d8a5 - {'path': '/', 'tag': '29f1dce9-b190-4fc8-bc76-4a61a968d8a5', 'options': 'recursive,repair,force'} 2024-04-25T10:07:50.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:07:50.794 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:08:13.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:13.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T10:08:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 Processor -- start 2024-04-25T10:08:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 -- start start 2024-04-25T10:08:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 0x7ff9ac15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac06db20 con 0x7ff9ac06d2d0 2024-04-25T10:08:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac06de00 con 0x7ff9ac071270 2024-04-25T10:08:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b3600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac15f090 con 0x7ff9ac15e770 2024-04-25T10:08:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9a3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff9ac06d2d0 0x7ff9ac15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-04-25T10:08:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9a3e00640 1 -- 172.21.15.18:0/2211674918 learned_addr learned my addr 172.21.15.18:0/2211674918 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/2211674918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 0x7ff9ac15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368502692 0 0) 0x7ff9ac06db20 con 0x7ff9ac06d2d0 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff990003530 con 0x7ff9ac06d2d0 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348678752 0 0) 0x7ff9ac06de00 con 0x7ff9ac071270 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ac06db20 con 0x7ff9ac071270 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b0c00640 1 -- 172.21.15.18:0/2211674918 >> v1:172.21.15.167:6789/0 conn(0x7ff9ac071270 legacy=0x7ff9ac0ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b0c00640 1 -- 172.21.15.18:0/2211674918 >> v1:172.21.15.18:6789/0 conn(0x7ff9ac06d2d0 legacy=0x7ff9ac15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312313226 0 0) 0x7ff990003530 con 0x7ff9ac06d2d0 2024-04-25T10:08:13.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.503+0000 7ff9b0c00640 1 -- 172.21.15.18:0/2211674918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac06e0e0 con 0x7ff9ac15e770 2024-04-25T10:08:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/2211674918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 0x7ff9ac15eb50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f37bc33436ae1691 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b2070 con 0x7ff9ac15e770 2024-04-25T10:08:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0a9070 con 0x7ff9ac15e770 2024-04-25T10:08:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9abe00640 1 -- 172.21.15.18:0/2211674918 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0ad880 con 0x7ff9ac15e770 2024-04-25T10:08:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 -- 172.21.15.18:0/2211674918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 msgr2=0x7ff9ac15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 --2- 172.21.15.18:0/2211674918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 0x7ff9ac15eb50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c01c450 comp rx=0 tx=0).stop 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 -- 172.21.15.18:0/2211674918 shutdown_connections 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 --2- 172.21.15.18:0/2211674918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac15e770 0x7ff9ac15eb50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 -- 172.21.15.18:0/2211674918 >> 172.21.15.18:0/2211674918 conn(0x7ff9ac067080 msgr2=0x7ff9ac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 -- 172.21.15.18:0/2211674918 shutdown_connections 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.507+0000 7ff9b3600640 1 -- 172.21.15.18:0/2211674918 wait complete. 2024-04-25T10:08:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 Processor -- start 2024-04-25T10:08:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- start start 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac06d2d0 0x7ff9ac0b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac071270 0x7ff9ac13fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac06d870 con 0x7ff9ac15e770 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac06d6f0 con 0x7ff9ac06d2d0 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac16c220 con 0x7ff9ac071270 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36822/0 (socket says 172.21.15.18:36822) 2024-04-25T10:08:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 -- 172.21.15.18:0/1491223703 learned_addr learned my addr 172.21.15.18:0/1491223703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac06d2d0 0x7ff9ac0b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac071270 0x7ff9ac13fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 -- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac071270 msgr2=0x7ff9ac13fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac071270 0x7ff9ac13fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 -- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac06d2d0 msgr2=0x7ff9ac0b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac06d2d0 0x7ff9ac0b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 -- 172.21.15.18:0/1491223703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0b3050 con 0x7ff9ac15e770 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b1600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c790 tx=0x7ff9a400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9a9600640 1 -- 172.21.15.18:0/1491223703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4003b80 con 0x7ff9ac15e770 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9a9600640 1 -- 172.21.15.18:0/1491223703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4003d20 con 0x7ff9ac15e770 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0b32f0 con 0x7ff9ac15e770 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9a9600640 1 -- 172.21.15.18:0/1491223703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400aa50 con 0x7ff9ac15e770 2024-04-25T10:08:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.511+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0b38b0 con 0x7ff9ac15e770 2024-04-25T10:08:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9a9600640 1 -- 172.21.15.18:0/1491223703 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff9a400abf0 con 0x7ff9ac15e770 2024-04-25T10:08:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9a9600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 0x7ff988069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9a9600640 1 -- 172.21.15.18:0/1491223703 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff9a4085220 con 0x7ff9ac15e770 2024-04-25T10:08:13.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 Processor -- start 2024-04-25T10:08:13.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 0x7ff988069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 -- start start 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 0x7ff988069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0af000 tx=0x7ff99c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff490f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff490f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff48f40ff0 con 0x55ff4913d9d0 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff48ec9150 con 0x55ff490f40a0 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.515+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff48f3d090 con 0x55ff4913e2f0 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36830/0 (socket says 172.21.15.18:36830) 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1063155952 learned_addr learned my addr 172.21.15.18:0/1063155952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff490f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b1600640 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff490f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 msgr2=0x55ff490f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff490f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 msgr2=0x55ff490f4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff490f4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1063155952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff490d70d0 con 0x55ff4913d9d0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d59321fc08abdd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9a1600640 1 -- 172.21.15.18:0/1063155952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0c7070 con 0x55ff4913d9d0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9a1600640 1 -- 172.21.15.18:0/1063155952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0cc460 con 0x55ff4913d9d0 2024-04-25T10:08:13.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9a1600640 1 -- 172.21.15.18:0/1063155952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b2040 con 0x55ff4913d9d0 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1063155952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 msgr2=0x55ff4913ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c004740 comp rx=0 tx=0).stop 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1063155952 shutdown_connections 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff490f4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff490f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1063155952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913d9d0 0x55ff4913ddb0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1063155952 >> 172.21.15.18:0/1063155952 conn(0x55ff490f0020 msgr2=0x55ff490f2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1063155952 shutdown_connections 2024-04-25T10:08:13.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1063155952 wait complete. 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- start start 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 Processor -- start 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff491227f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49122d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff48f05250 con 0x55ff4913e2f0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff48efb690 con 0x55ff490f40a0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.519+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff48ec9a40 con 0x55ff4913d9d0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 10 client.0 _ll_register_callbacks cb 0x55ff490dee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff491227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9a3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49122d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36840/0 (socket says 172.21.15.18:36840) 2024-04-25T10:08:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 -- 172.21.15.18:0/2204614146 learned_addr learned my addr 172.21.15.18:0/2204614146 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 -- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 msgr2=0x55ff49122d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49122d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 -- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 msgr2=0x55ff491227f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff491227f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 -- 172.21.15.18:0/2204614146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff48fee1c0 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b1600640 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400a430 tx=0x7ff9a40014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ccbb500908bb18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4081060 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff9a4051f90 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff99c0cc460 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9a4072050 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 10 client.6570 fetch_fsmap learned FSMap version 38 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55ff48fea170 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0cc460 con 0x55ff4913e2f0 2024-04-25T10:08:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff9a4054d70 con 0x55ff4913e2f0 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 10 client.6570 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 10 client.6570 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 20 client.6570 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff4914dc80 0x55ff49150070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 4 client.6570 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff48edcc60 con 0x55ff4914dc80 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff4914dc80 0x55ff49150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff4914dc80 0x55ff49150070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6027e7fb37402a6e server_cookie=279b2d875b27e9f2 in_seq=0 out_seq=0 2024-04-25T10:08:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 10 client.6570 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 1 -- 172.21.15.18:0/2204614146 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7ff99c0d6a90 con 0x55ff4914dc80 2024-04-25T10:08:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 10 client.6570 handle_command_reply: tid=0 2024-04-25T10:08:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 client.6570 shutdown 2024-04-25T10:08:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 msgr2=0x55ff49123270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400a430 tx=0x7ff9a40014e0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 shutdown_connections 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff4914dc80 0x55ff49150070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff4913e2f0 0x55ff49123270 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49122d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/2204614146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff490f40a0 0x55ff491227f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff99a000640 0 client.6570 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 >> 172.21.15.18:0/2204614146 conn(0x55ff490f0020 msgr2=0x55ff490f2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 shutdown_connections 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.523+0000 7ff9b6b36000 1 -- 172.21.15.18:0/2204614146 wait complete. 2024-04-25T10:08:13.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.527+0000 7ff9b6b36000 20 client.6570 trim_cache size 0 max 16384 2024-04-25T10:08:13.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 Processor -- start 2024-04-25T10:08:13.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 -- start start 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913d9d0 0x55ff4919a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff4919ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac203a10 con 0x55ff490f40a0 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac202be0 con 0x55ff4913d9d0 2024-04-25T10:08:13.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.539+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0afd30 con 0x55ff4913e2f0 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36844/0 (socket says 172.21.15.18:36844) 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/3945447276 learned_addr learned my addr 172.21.15.18:0/3945447276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 msgr2=0x55ff4919ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff4919ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913d9d0 msgr2=0x55ff4919a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913d9d0 0x55ff4919a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/3945447276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff48f87de0 con 0x55ff490f40a0 2024-04-25T10:08:13.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b9fe039cbfd533 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9a0c00640 1 -- 172.21.15.18:0/3945447276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0b2040 con 0x55ff490f40a0 2024-04-25T10:08:13.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9a0c00640 1 -- 172.21.15.18:0/3945447276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0d2070 con 0x55ff490f40a0 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9a0c00640 1 -- 172.21.15.18:0/3945447276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0bb040 con 0x55ff490f40a0 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- 172.21.15.18:0/3945447276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 msgr2=0x55ff4919a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0097f0 tx=0x7ff99c0b8000 comp rx=0 tx=0).stop 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- 172.21.15.18:0/3945447276 shutdown_connections 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913e2f0 0x55ff4919ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913d9d0 0x55ff4919a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/3945447276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff4919a300 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- 172.21.15.18:0/3945447276 >> 172.21.15.18:0/3945447276 conn(0x55ff490f0020 msgr2=0x55ff4913c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- 172.21.15.18:0/3945447276 shutdown_connections 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- 172.21.15.18:0/3945447276 wait complete. 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- start start 2024-04-25T10:08:13.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 Processor -- start 2024-04-25T10:08:13.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913e2f0 0x55ff491511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff48edbe00 con 0x55ff490f40a0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac2025e0 con 0x55ff4913e2f0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ff48f40300 con 0x55ff4913d9d0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b6b36000 10 client.0 _ll_register_callbacks cb 0x55ff490bf040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36850/0 (socket says 172.21.15.18:36850) 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1972850765 learned_addr learned my addr 172.21.15.18:0/1972850765 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b1600640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913e2f0 0x55ff491511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.543+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 msgr2=0x55ff49150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913e2f0 msgr2=0x55ff491511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913e2f0 0x55ff491511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b0c00640 1 -- 172.21.15.18:0/1972850765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ff48ee28e0 con 0x55ff490f40a0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b0c00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff99c019060 tx=0x7ff99c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=def5b05dac488a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0e4060 con 0x55ff490f40a0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff99c0d63b0 con 0x55ff490f40a0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff99c0d2070 con 0x55ff490f40a0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff99c0bb070 con 0x55ff490f40a0 2024-04-25T10:08:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 10 client.6576 fetch_fsmap learned FSMap version 38 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55ff48f9a8f0 con 0x55ff490f40a0 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0d2070 con 0x55ff490f40a0 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff99c0ed020 con 0x55ff490f40a0 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 10 client.6576 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 10 client.6576 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 20 client.6576 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff491a3f50 0x55ff491a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 4 client.6576 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ff48f4e530 con 0x55ff491a3f50 2024-04-25T10:08:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff491a3f50 0x55ff491a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9a3e00640 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff491a3f50 0x55ff491a6340 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6155f6d9205661d server_cookie=3f462fc334bb9d37 in_seq=0 out_seq=0 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 10 client.6576 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 1 -- 172.21.15.18:0/1972850765 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ff48f4e530 con 0x55ff491a3f50 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 10 client.6576 handle_command_reply: tid=0 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 client.6576 shutdown 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 msgr2=0x55ff49150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff99c019060 tx=0x7ff99c01ac90 comp rx=0 tx=0).stop 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 shutdown_connections 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x55ff491a3f50 0x55ff491a6340 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ff4913e2f0 0x55ff491511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ff4913d9d0 0x55ff49150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff99a000640 0 client.6576 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 --2- 172.21.15.18:0/1972850765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ff490f40a0 0x55ff49150770 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 >> 172.21.15.18:0/1972850765 conn(0x55ff490f0020 msgr2=0x55ff4913c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 shutdown_connections 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 1 -- 172.21.15.18:0/1972850765 wait complete. 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b6b36000 20 client.6576 trim_cache size 0 max 16384 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:08:13.563 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 msgr2=0x7ff988069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 0x7ff988069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0af000 tx=0x7ff99c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 msgr2=0x7ff9ac153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7ff9a400c790 tx=0x7ff9a400cc50 comp rx=0 tx=0).stop 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 shutdown_connections 2024-04-25T10:08:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9ac15e770 0x7ff9ac153760 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff988066f60 0x7ff988069420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff9ac071270 0x7ff9ac13fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 --2- 172.21.15.18:0/1491223703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9ac06d2d0 0x7ff9ac0b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 >> 172.21.15.18:0/1491223703 conn(0x7ff9ac067080 msgr2=0x7ff9ac15d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 shutdown_connections 2024-04-25T10:08:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.547+0000 7ff9b3600640 1 -- 172.21.15.18:0/1491223703 wait complete. 2024-04-25T10:08:13.576 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:08:13.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:13.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.707+0000 7f48b2200640 1 Processor -- start 2024-04-25T10:08:13.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.707+0000 7f48b2200640 1 -- start start 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48b2200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48ac144140 0x7f48ac0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48b2200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f48ac0ced60 0x7f48ac06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48b2200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac15ac60 con 0x7f48ac06e900 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48b2200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac06ed30 con 0x7f48ac144140 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48b2200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ac0cf3e0 con 0x7f48ac0ced60 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48ac144140 0x7f48ac0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f48ac144140 0x7f48ac0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36852/0 (socket says 172.21.15.18:36852) 2024-04-25T10:08:13.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 -- 172.21.15.18:0/25121887 learned_addr learned my addr 172.21.15.18:0/25121887 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48aaa00640 1 --2- 172.21.15.18:0/25121887 >> v2:172.21.15.167:3300/0 conn(0x7f48ac0ced60 0x7f48ac06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 -- 172.21.15.18:0/25121887 >> v2:172.21.15.167:3300/0 conn(0x7f48ac0ced60 msgr2=0x7f48ac06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 --2- 172.21.15.18:0/25121887 >> v2:172.21.15.167:3300/0 conn(0x7f48ac0ced60 0x7f48ac06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 -- 172.21.15.18:0/25121887 >> v1:172.21.15.167:6789/0 conn(0x7f48ac06e900 legacy=0x7f48ac15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:13.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.711+0000 7f48ab400640 1 -- 172.21.15.18:0/25121887 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac15af20 con 0x7f48ac144140 2024-04-25T10:08:13.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48ab400640 1 --2- 172.21.15.18:0/25121887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac0ce820 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06efb0 tx=0x7f489c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ade2105cf59b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48aa000640 1 -- 172.21.15.18:0/25121887 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0b0070 con 0x7f48ac144140 2024-04-25T10:08:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48aa000640 1 -- 172.21.15.18:0/25121887 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489c0ab600 con 0x7f48ac144140 2024-04-25T10:08:13.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48aa000640 1 -- 172.21.15.18:0/25121887 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c0ab9d0 con 0x7f48ac144140 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- 172.21.15.18:0/25121887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 msgr2=0x7f48ac0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 --2- 172.21.15.18:0/25121887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac0ce820 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f48ac06efb0 tx=0x7f489c01c4e0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- 172.21.15.18:0/25121887 shutdown_connections 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 --2- 172.21.15.18:0/25121887 >> v2:172.21.15.167:3300/0 conn(0x7f48ac0ced60 0x7f48ac06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 --2- 172.21.15.18:0/25121887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac0ce820 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- 172.21.15.18:0/25121887 >> 172.21.15.18:0/25121887 conn(0x7f48ac066fa0 msgr2=0x7f48ac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- 172.21.15.18:0/25121887 shutdown_connections 2024-04-25T10:08:13.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- 172.21.15.18:0/25121887 wait complete. 2024-04-25T10:08:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 Processor -- start 2024-04-25T10:08:13.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.715+0000 7f48b2200640 1 -- start start 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ac06e900 0x7f48ac0b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48ac0ced60 0x7f48ac153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac144520 con 0x7f48ac144140 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0cf170 con 0x7f48ac06e900 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac15ba00 con 0x7f48ac0ced60 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48ab400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ac06e900 0x7f48ac0b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36854/0 (socket says 172.21.15.18:36854) 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 -- 172.21.15.18:0/2164445148 learned_addr learned my addr 172.21.15.18:0/2164445148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:13.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48aaa00640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48ac0ced60 0x7f48ac153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 -- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48ac0ced60 msgr2=0x7f48ac153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48ac0ced60 0x7f48ac153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 -- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ac06e900 msgr2=0x7f48ac0b45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ac06e900 0x7f48ac0b45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 -- 172.21.15.18:0/2164445148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac151a20 con 0x7f48ac144140 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48abe00640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f48a400c780 tx=0x7f48a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4004b70 con 0x7f48ac144140 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4004d10 con 0x7f48ac144140 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac13d8e0 con 0x7f48ac144140 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400aa90 con 0x7f48ac144140 2024-04-25T10:08:13.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac151c90 con 0x7f48ac144140 2024-04-25T10:08:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac0745d0 con 0x7f48ac144140 2024-04-25T10:08:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.719+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f48a400ac30 con 0x7f48ac144140 2024-04-25T10:08:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.723+0000 7f48a3400640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 0x7f488c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:13.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.723+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f48a4085380 con 0x7f48ac144140 2024-04-25T10:08:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.723+0000 7f48ab400640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 0x7f488c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:13.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.723+0000 7f48ab400640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 0x7f488c069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f489c0ad000 tx=0x7f489c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:13.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.727+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f48a4020070 con 0x7f48ac144140 2024-04-25T10:08:13.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.923+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48ac164f50 con 0x7f48ac144140 2024-04-25T10:08:13.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.923+0000 7f48a3400640 1 -- 172.21.15.18:0/2164445148 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f48a4055b30 con 0x7f48ac144140 2024-04-25T10:08:13.932 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:13.932 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:50.725074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:08:13.932 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-25T10:08:13.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 msgr2=0x7f488c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 0x7f488c069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f489c0ad000 tx=0x7f489c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 msgr2=0x7f48ac1540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f48a400c780 tx=0x7f48a400cc40 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 shutdown_connections 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48ac144140 0x7f48ac1540c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f488c066f60 0x7f488c069420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f48ac0ced60 0x7f48ac153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 --2- 172.21.15.18:0/2164445148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48ac06e900 0x7f48ac0b45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 >> 172.21.15.18:0/2164445148 conn(0x7f48ac066fa0 msgr2=0x7f48ac06ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 shutdown_connections 2024-04-25T10:08:13.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:13.927+0000 7f48b2200640 1 -- 172.21.15.18:0/2164445148 wait complete. 2024-04-25T10:08:13.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b damage ls --format=json-pretty 2024-04-25T10:08:14.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 Processor -- start 2024-04-25T10:08:14.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 -- start start 2024-04-25T10:08:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe33c15dc60 0x7fe33c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 0x7fe33c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c15e040 con 0x7fe33c099a60 2024-04-25T10:08:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c0cff80 con 0x7fe33c15dc60 2024-04-25T10:08:14.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe342a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0d0260 con 0x7fe33c06bf30 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe333400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 0x7fe33c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe33be00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe33c15dc60 0x7fe33c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe340a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fe33c099a60 0x7fe33c0cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47592/0 (socket says 172.21.15.18:47592) 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe340a00640 1 -- 172.21.15.18:0/3455224780 learned_addr learned my addr 172.21.15.18:0/3455224780 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe333400640 1 -- 172.21.15.18:0/3455224780 >> v2:172.21.15.167:3300/0 conn(0x7fe33c15dc60 msgr2=0x7fe33c0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe333400640 1 --2- 172.21.15.18:0/3455224780 >> v2:172.21.15.167:3300/0 conn(0x7fe33c15dc60 0x7fe33c0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe333400640 1 -- 172.21.15.18:0/3455224780 >> v1:172.21.15.167:6789/0 conn(0x7fe33c099a60 legacy=0x7fe33c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.091+0000 7fe333400640 1 -- 172.21.15.18:0/3455224780 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0d0540 con 0x7fe33c06bf30 2024-04-25T10:08:14.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe333400640 1 --2- 172.21.15.18:0/3455224780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 0x7fe33c0cf8a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3240097c0 tx=0x7fe32401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28609c561beddf93 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe33b400640 1 -- 172.21.15.18:0/3455224780 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240b1070 con 0x7fe33c06bf30 2024-04-25T10:08:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe33b400640 1 -- 172.21.15.18:0/3455224780 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240a8050 con 0x7fe33c06bf30 2024-04-25T10:08:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe33b400640 1 -- 172.21.15.18:0/3455224780 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240ac860 con 0x7fe33c06bf30 2024-04-25T10:08:14.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 -- 172.21.15.18:0/3455224780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 msgr2=0x7fe33c0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 --2- 172.21.15.18:0/3455224780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 0x7fe33c0cf8a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe3240097c0 tx=0x7fe32401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 -- 172.21.15.18:0/3455224780 shutdown_connections 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 --2- 172.21.15.18:0/3455224780 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c06bf30 0x7fe33c0cf8a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 --2- 172.21.15.18:0/3455224780 >> v2:172.21.15.167:3300/0 conn(0x7fe33c15dc60 0x7fe33c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 -- 172.21.15.18:0/3455224780 >> 172.21.15.18:0/3455224780 conn(0x7fe33c0b3200 msgr2=0x7fe33c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 -- 172.21.15.18:0/3455224780 shutdown_connections 2024-04-25T10:08:14.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.095+0000 7fe342a00640 1 -- 172.21.15.18:0/3455224780 wait complete. 2024-04-25T10:08:14.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 Processor -- start 2024-04-25T10:08:14.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- start start 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe33c06bf30 0x7fe33c155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c099a60 0x7fe33c0c9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c09a280 con 0x7fe33c15dc60 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0cc880 con 0x7fe33c06bf30 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c155f60 con 0x7fe33c099a60 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36870/0 (socket says 172.21.15.18:36870) 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 -- 172.21.15.18:0/172589950 learned_addr learned my addr 172.21.15.18:0/172589950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe33be00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe33c06bf30 0x7fe33c155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe333400640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c099a60 0x7fe33c0c9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 -- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c099a60 msgr2=0x7fe33c0c9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c099a60 0x7fe33c0c9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 -- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe33c06bf30 msgr2=0x7fe33c155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe33c06bf30 0x7fe33c155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 -- 172.21.15.18:0/172589950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0ca180 con 0x7fe33c15dc60 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe340a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe33400caa0 tx=0x7fe33400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe338c00640 1 -- 172.21.15.18:0/172589950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334017070 con 0x7fe33c15dc60 2024-04-25T10:08:14.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe338c00640 1 -- 172.21.15.18:0/172589950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400aba0 con 0x7fe33c15dc60 2024-04-25T10:08:14.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe338c00640 1 -- 172.21.15.18:0/172589950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334012400 con 0x7fe33c15dc60 2024-04-25T10:08:14.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c0c8ba0 con 0x7fe33c15dc60 2024-04-25T10:08:14.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.099+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c0c9160 con 0x7fe33c15dc60 2024-04-25T10:08:14.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe338c00640 1 -- 172.21.15.18:0/172589950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe33401a070 con 0x7fe33c15dc60 2024-04-25T10:08:14.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe338c00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 0x7fe318069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe338c00640 1 -- 172.21.15.18:0/172589950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe334084e30 con 0x7fe33c15dc60 2024-04-25T10:08:14.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe345f8d000 1 Processor -- start 2024-04-25T10:08:14.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe33be00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 0x7fe318069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.103+0000 7fe345f8d000 1 -- start start 2024-04-25T10:08:14.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 0x7fe318069450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009ac0 tx=0x7fe32c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565370428c00 0x5653703de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x5653703decc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653702c5ba0 con 0x5653704282e0 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56537022b090 con 0x5653703de8e0 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653701b3160 con 0x565370428c00 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36874/0 (socket says 172.21.15.18:36874) 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 -- 172.21.15.18:0/456219633 learned_addr learned my addr 172.21.15.18:0/456219633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 -- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565370428c00 msgr2=0x5653703de3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565370428c00 0x5653703de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 -- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 msgr2=0x5653703decc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x5653703decc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 -- 172.21.15.18:0/456219633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653702d4c20 con 0x5653704282e0 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe33be00640 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe32c006aa0 tx=0x7fe32c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5772aafcf4de2bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe330c00640 1 -- 172.21.15.18:0/456219633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c01b070 con 0x5653704282e0 2024-04-25T10:08:14.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe330c00640 1 -- 172.21.15.18:0/456219633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c027070 con 0x5653704282e0 2024-04-25T10:08:14.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe330c00640 1 -- 172.21.15.18:0/456219633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32c003a30 con 0x5653704282e0 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- 172.21.15.18:0/456219633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 msgr2=0x5653704286c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fe32c006aa0 tx=0x7fe32c014000 comp rx=0 tx=0).stop 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- 172.21.15.18:0/456219633 shutdown_connections 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x5653703decc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565370428c00 0x5653703de3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 --2- 172.21.15.18:0/456219633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653704282e0 0x5653704286c0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- 172.21.15.18:0/456219633 >> 172.21.15.18:0/456219633 conn(0x5653703da890 msgr2=0x5653703dcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- 172.21.15.18:0/456219633 shutdown_connections 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- 172.21.15.18:0/456219633 wait complete. 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 -- start start 2024-04-25T10:08:14.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.107+0000 7fe345f8d000 1 Processor -- start 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x56537042f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 0x56537042fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565370227130 con 0x565370428c00 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653701ef130 con 0x5653703de8e0 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653702e9300 con 0x5653704282e0 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 10 client.0 _ll_register_callbacks cb 0x5653703c9bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36880/0 (socket says 172.21.15.18:36880) 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 -- 172.21.15.18:0/587238358 learned_addr learned my addr 172.21.15.18:0/587238358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe33be00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x56537042f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe333400640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 0x56537042fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 -- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 msgr2=0x56537042fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 0x56537042fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 -- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 msgr2=0x56537042f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x56537042f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 -- 172.21.15.18:0/587238358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565370208060 con 0x565370428c00 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe333400640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 0x56537042fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe340a00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe334051a40 tx=0x7fe334055720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac095c2684f8778 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3340539a0 con 0x565370428c00 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe334059170 con 0x565370428c00 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe32c027070 con 0x565370428c00 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe334059370 con 0x565370428c00 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 10 client.6591 fetch_fsmap learned FSMap version 38 2024-04-25T10:08:14.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5653701cc7c0 con 0x565370428c00 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32c027070 con 0x565370428c00 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe334054a30 con 0x565370428c00 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 10 client.6591 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 10 client.6591 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 20 client.6591 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370416e00 0x5653704171e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 4 client.6591 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5653701c6cd0 con 0x565370416e00 2024-04-25T10:08:14.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe33be00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370416e00 0x5653704171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe33be00640 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370416e00 0x5653704171e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a77a75ad13a043fd server_cookie=461c163c23806fdb in_seq=0 out_seq=0 2024-04-25T10:08:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.111+0000 7fe329600640 10 client.6591 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe329600640 1 -- 172.21.15.18:0/587238358 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5653701c6cd0 con 0x565370416e00 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe329600640 10 client.6591 handle_command_reply: tid=0 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 client.6591 shutdown 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 msgr2=0x565370416090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe334051a40 tx=0x7fe334055720 comp rx=0 tx=0).stop 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 shutdown_connections 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370416e00 0x5653704171e0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565370428c00 0x565370416090 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653704282e0 0x56537042fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 --2- 172.21.15.18:0/587238358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653703de8e0 0x56537042f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe329600640 0 client.6591 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 >> 172.21.15.18:0/587238358 conn(0x5653703da890 msgr2=0x5653703dd510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 shutdown_connections 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 1 -- 172.21.15.18:0/587238358 wait complete. 2024-04-25T10:08:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.115+0000 7fe345f8d000 20 client.6591 trim_cache size 0 max 16384 2024-04-25T10:08:14.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 Processor -- start 2024-04-25T10:08:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- start start 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x5653703ddff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x5653703dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c202cf0 con 0x5653703de8e0 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c158380 con 0x5653704282e0 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c09cde0 con 0x5653703da890 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36892/0 (socket says 172.21.15.18:36892) 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 -- 172.21.15.18:0/2556926374 learned_addr learned my addr 172.21.15.18:0/2556926374 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe33be00640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x5653703ddff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe340a00640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x5653703dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 -- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 msgr2=0x5653703ddff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x5653703ddff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 -- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 msgr2=0x5653703dd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x5653703dd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 -- 172.21.15.18:0/2556926374 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653701e6fc0 con 0x5653703de8e0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe340a00640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x5653703dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe333400640 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe32401a010 tx=0x7fe3240046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ff831ca3f5d4d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe32be00640 1 -- 172.21.15.18:0/2556926374 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240ba070 con 0x5653703de8e0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe32be00640 1 -- 172.21.15.18:0/2556926374 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240a8040 con 0x5653703de8e0 2024-04-25T10:08:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe32be00640 1 -- 172.21.15.18:0/2556926374 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240b1040 con 0x5653703de8e0 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- 172.21.15.18:0/2556926374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 msgr2=0x5653703dcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fe32401a010 tx=0x7fe3240046d0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 -- 172.21.15.18:0/2556926374 shutdown_connections 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x5653703dd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x5653703dcc80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.127+0000 7fe345f8d000 1 --2- 172.21.15.18:0/2556926374 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x5653703ddff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/2556926374 >> 172.21.15.18:0/2556926374 conn(0x5653703e3b90 msgr2=0x565370427260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/2556926374 shutdown_connections 2024-04-25T10:08:14.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/2556926374 wait complete. 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- start start 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 Processor -- start 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x565370488720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x56537042c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653701c5e70 con 0x5653703de8e0 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653701b3a50 con 0x5653704282e0 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56537022a3a0 con 0x5653703da890 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 10 client.0 _ll_register_callbacks cb 0x5653701d7240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36908/0 (socket says 172.21.15.18:36908) 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 -- 172.21.15.18:0/1310835739 learned_addr learned my addr 172.21.15.18:0/1310835739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe340a00640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x56537042c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe33be00640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x565370488720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 -- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 msgr2=0x565370488720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x565370488720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 -- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 msgr2=0x56537042c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x56537042c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 -- 172.21.15.18:0/1310835739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5653702849e0 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe333400640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe32401a010 tx=0x7fe3240a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106ed3bff664c802 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3240b1070 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe3240acde0 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe3240a8040 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3240ba040 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 10 client.6597 fetch_fsmap learned FSMap version 38 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5653701ca630 con 0x5653703de8e0 2024-04-25T10:08:14.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3240a8040 con 0x5653703de8e0 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe3240bf450 con 0x5653703de8e0 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 10 client.6597 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 10 client.6597 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 20 client.6597 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370428c00 0x56537042d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 4 client.6597 mds_command: new command op to 35462 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 --> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5653702385d0 con 0x565370428c00 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.131+0000 7fe33be00640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370428c00 0x56537042d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe33be00640 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370428c00 0x56537042d370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d29a9e297fa45d03 server_cookie=a80c2e0c4f182d08 in_seq=0 out_seq=0 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe329600640 10 client.6597 ms_handle_connect on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe329600640 1 -- 172.21.15.18:0/1310835739 <== mds.0 v2:172.21.15.167:6835/343490040 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5653702385d0 con 0x565370428c00 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe329600640 10 client.6597 handle_command_reply: tid=0 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 client.6597 shutdown 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 msgr2=0x565370488c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fe32401a010 tx=0x7fe3240a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 shutdown_connections 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:6835/343490040,v1:172.21.15.167:6837/343490040] conn(0x565370428c00 0x56537042d370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5653704282e0 0x56537042c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653703de8e0 0x565370488c60 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 --2- 172.21.15.18:0/1310835739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5653703da890 0x565370488720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe329600640 0 client.6597 ms_handle_reset on v2:172.21.15.167:6835/343490040 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 >> 172.21.15.18:0/1310835739 conn(0x5653703e3b90 msgr2=0x565370427af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 shutdown_connections 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 1 -- 172.21.15.18:0/1310835739 wait complete. 2024-04-25T10:08:14.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe345f8d000 20 client.6597 trim_cache size 0 max 16384 2024-04-25T10:08:14.147 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:14.147 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 msgr2=0x7fe318069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 0x7fe318069450 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009ac0 tx=0x7fe32c009190 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 msgr2=0x7fe33c0cae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fe33400caa0 tx=0x7fe33400cf60 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 shutdown_connections 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c15dc60 0x7fe33c0cae10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe318066f90 0x7fe318069450 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe33c099a60 0x7fe33c0c9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 --2- 172.21.15.18:0/172589950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe33c06bf30 0x7fe33c155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 >> 172.21.15.18:0/172589950 conn(0x7fe33c0b3200 msgr2=0x7fe33c0b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 shutdown_connections 2024-04-25T10:08:14.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.135+0000 7fe342a00640 1 -- 172.21.15.18:0/172589950 wait complete. 2024-04-25T10:08:14.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:08:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.291+0000 7fa09ce00640 1 Processor -- start 2024-04-25T10:08:14.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 -- start start 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa098070fe0 0x7fa098161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0980713c0 0x7fa098143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa098071800 0x7fa09815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa09806d090 con 0x7fa098071800 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa098162390 con 0x7fa098070fe0 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa09ce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa098161af0 con 0x7fa0980713c0 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa098071800 0x7fa09815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa098071800 0x7fa09815e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36922/0 (socket says 172.21.15.18:36922) 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 -- 172.21.15.18:0/2835873637 learned_addr learned my addr 172.21.15.18:0/2835873637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa095400640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0980713c0 0x7fa098143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa095e00640 1 --2- 172.21.15.18:0/2835873637 >> v2:172.21.15.167:3300/0 conn(0x7fa098070fe0 0x7fa098161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 -- 172.21.15.18:0/2835873637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0980713c0 msgr2=0x7fa098143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0980713c0 0x7fa098143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 -- 172.21.15.18:0/2835873637 >> v2:172.21.15.167:3300/0 conn(0x7fa098070fe0 msgr2=0x7fa098161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 --2- 172.21.15.18:0/2835873637 >> v2:172.21.15.167:3300/0 conn(0x7fa098070fe0 0x7fa098161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.295+0000 7fa096800640 1 -- 172.21.15.18:0/2835873637 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa098161dd0 con 0x7fa098071800 2024-04-25T10:08:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa096800640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa098071800 0x7fa09815e550 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa098072ce0 tx=0x7fa09001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b06cf004c1006b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa094a00640 1 -- 172.21.15.18:0/2835873637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900a5840 con 0x7fa098071800 2024-04-25T10:08:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa094a00640 1 -- 172.21.15.18:0/2835873637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0900a59e0 con 0x7fa098071800 2024-04-25T10:08:14.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa094a00640 1 -- 172.21.15.18:0/2835873637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900a5db0 con 0x7fa098071800 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- 172.21.15.18:0/2835873637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa098071800 msgr2=0x7fa09815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa098071800 0x7fa09815e550 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fa098072ce0 tx=0x7fa09001c9c0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- 172.21.15.18:0/2835873637 shutdown_connections 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa098071800 0x7fa09815e550 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 --2- 172.21.15.18:0/2835873637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa0980713c0 0x7fa098143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 --2- 172.21.15.18:0/2835873637 >> v2:172.21.15.167:3300/0 conn(0x7fa098070fe0 0x7fa098161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- 172.21.15.18:0/2835873637 >> 172.21.15.18:0/2835873637 conn(0x7fa0980b3390 msgr2=0x7fa0980b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- 172.21.15.18:0/2835873637 shutdown_connections 2024-04-25T10:08:14.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- 172.21.15.18:0/2835873637 wait complete. 2024-04-25T10:08:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 Processor -- start 2024-04-25T10:08:14.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.299+0000 7fa09ce00640 1 -- start start 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa098070fe0 0x7fa09813d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 0x7fa09813fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980b06c0 con 0x7fa0980713c0 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980b0540 con 0x7fa098071800 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980b0840 con 0x7fa098070fe0 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36938/0 (socket says 172.21.15.18:36938) 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 -- 172.21.15.18:0/1885763725 learned_addr learned my addr 172.21.15.18:0/1885763725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095e00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa098070fe0 0x7fa09813d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa096800640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 0x7fa09813fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 -- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa098070fe0 msgr2=0x7fa09813d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa098070fe0 0x7fa09813d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 -- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 msgr2=0x7fa09813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 0x7fa09813fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 -- 172.21.15.18:0/1885763725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0981f6e20 con 0x7fa0980713c0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa096800640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 0x7fa09813fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa095400640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d800 tx=0x7fa08400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400b6c0 con 0x7fa0980713c0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa084019070 con 0x7fa0980713c0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400ba60 con 0x7fa0980713c0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0980b5190 con 0x7fa0980713c0 2024-04-25T10:08:14.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0981f7690 con 0x7fa0980713c0 2024-04-25T10:08:14.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0981f71e0 con 0x7fa0980713c0 2024-04-25T10:08:14.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.303+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa08400bc00 con 0x7fa0980713c0 2024-04-25T10:08:14.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.307+0000 7fa08e000640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 0x7fa078069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.307+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fa084085600 con 0x7fa0980713c0 2024-04-25T10:08:14.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.307+0000 7fa095e00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 0x7fa078069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.307+0000 7fa095e00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 0x7fa078069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ba30 tx=0x7fa088008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.311+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0840564a0 con 0x7fa0980713c0 2024-04-25T10:08:14.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa0980745d0 con 0x7fa0980713c0 2024-04-25T10:08:14.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa08e000640 1 -- 172.21.15.18:0/1885763725 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa084055da0 con 0x7fa0980713c0 2024-04-25T10:08:14.515 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:14.515 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:08:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 msgr2=0x7fa078069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 0x7fa078069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa08800ba30 tx=0x7fa088008040 comp rx=0 tx=0).stop 2024-04-25T10:08:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 msgr2=0x7fa0980b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fa08400d800 tx=0x7fa08400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 shutdown_connections 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa098071800 0x7fa09813fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980713c0 0x7fa0980b4690 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa078066f60 0x7fa078069420 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 --2- 172.21.15.18:0/1885763725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa098070fe0 0x7fa09813d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 >> 172.21.15.18:0/1885763725 conn(0x7fa0980b3390 msgr2=0x7fa0980d1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 shutdown_connections 2024-04-25T10:08:14.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.507+0000 7fa09ce00640 1 -- 172.21.15.18:0/1885763725 wait complete. 2024-04-25T10:08:14.536 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:08:14.536 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:08:14.537 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:08:14.607 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:08:14.696 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:08:14.696 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:14.696 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:14.705 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:14.705 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:14.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:14.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 Processor -- start 2024-04-25T10:08:14.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 -- start start 2024-04-25T10:08:14.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f006c650 con 0x7f42f00cff30 2024-04-25T10:08:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f006c930 con 0x7f42f0099a60 2024-04-25T10:08:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.935+0000 7f42f5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f006cc10 con 0x7f42f015ee00 2024-04-25T10:08:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ef400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f42f00cff30 0x7f42f00d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46874/0 (socket says 172.21.15.18:46874) 2024-04-25T10:08:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ef400640 1 -- 172.21.15.18:0/3294711282 learned_addr learned my addr 172.21.15.18:0/3294711282 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42e6000640 1 --2- 172.21.15.18:0/3294711282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494528613 0 0) 0x7f42f006c650 con 0x7f42f00cff30 2024-04-25T10:08:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42d4003530 con 0x7f42f00cff30 2024-04-25T10:08:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101862168 0 0) 0x7f42f006c930 con 0x7f42f0099a60 2024-04-25T10:08:14.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f006c650 con 0x7f42f0099a60 2024-04-25T10:08:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3759957701 0 0) 0x7f42d4003530 con 0x7f42f00cff30 2024-04-25T10:08:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42e6000640 1 -- 172.21.15.18:0/3294711282 >> v1:172.21.15.167:6789/0 conn(0x7f42f0099a60 legacy=0x7f42f0099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42e6000640 1 -- 172.21.15.18:0/3294711282 >> v1:172.21.15.18:6789/0 conn(0x7f42f00cff30 legacy=0x7f42f00d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42e6000640 1 -- 172.21.15.18:0/3294711282 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f006cef0 con 0x7f42f015ee00 2024-04-25T10:08:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.939+0000 7f42e6000640 1 --2- 172.21.15.18:0/3294711282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f006bd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42d80097f0 tx=0x7f42d801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b6eb0bc928da90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d80b0070 con 0x7f42f015ee00 2024-04-25T10:08:14.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42d80ab400 con 0x7f42f015ee00 2024-04-25T10:08:14.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42ee000640 1 -- 172.21.15.18:0/3294711282 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8001a00 con 0x7f42f015ee00 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- 172.21.15.18:0/3294711282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 msgr2=0x7f42f006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3294711282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f006bd20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f42d80097f0 tx=0x7f42d801c400 comp rx=0 tx=0).stop 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- 172.21.15.18:0/3294711282 shutdown_connections 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3294711282 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f006bd20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- 172.21.15.18:0/3294711282 >> 172.21.15.18:0/3294711282 conn(0x7f42f00d17a0 msgr2=0x7f42f00d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- 172.21.15.18:0/3294711282 shutdown_connections 2024-04-25T10:08:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- 172.21.15.18:0/3294711282 wait complete. 2024-04-25T10:08:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 Processor -- start 2024-04-25T10:08:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- start start 2024-04-25T10:08:14.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00cff30 0x7f42f0146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f01496f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f016bb90 con 0x7f42f0099a60 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f016ba10 con 0x7f42f00cff30 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42f5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f016bd10 con 0x7f42f015ee00 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42eea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36940/0 (socket says 172.21.15.18:36940) 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42eea00640 1 -- 172.21.15.18:0/3122814989 learned_addr learned my addr 172.21.15.18:0/3122814989 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42ef400640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f01496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.943+0000 7f42e6000640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00cff30 0x7f42f0146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 -- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 msgr2=0x7f42f01496f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f01496f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 -- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00cff30 msgr2=0x7f42f0146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:14.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00cff30 0x7f42f0146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 -- 172.21.15.18:0/3122814989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f00b66d0 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42eea00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c430 tx=0x7f42e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0017070 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00052f0 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0003840 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f00b69b0 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f00b6f70 con 0x7f42f0099a60 2024-04-25T10:08:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f00745d0 con 0x7f42f0099a60 2024-04-25T10:08:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.947+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f42e001a070 con 0x7f42f0099a60 2024-04-25T10:08:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.951+0000 7f42e7400640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 0x7f42cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.951+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f42e00845c0 con 0x7f42f0099a60 2024-04-25T10:08:14.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.951+0000 7f42e6000640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 0x7f42cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:14.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.951+0000 7f42e6000640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 0x7f42cc069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42d80ad000 tx=0x7f42d80a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:14.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:14.955+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f42e0054d70 con 0x7f42f0099a60 2024-04-25T10:08:15.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.115+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42f00cdbf0 con 0x7f42f0099a60 2024-04-25T10:08:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.115+0000 7f42e7400640 1 -- 172.21.15.18:0/3122814989 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17053 (secure 0 0 0) 0x7f42e0058e10 con 0x7f42f0099a60 2024-04-25T10:08:15.125 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:15.125 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:07:37.800820+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 msgr2=0x7f42cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 0x7f42cc069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f42d80ad000 tx=0x7f42d80a6000 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 msgr2=0x7f42f0152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f42e000c430 tx=0x7f42e000c8f0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 shutdown_connections 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f42cc066f60 0x7f42cc069420 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42f015ee00 0x7f42f01496f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f42f00cff30 0x7f42f0146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 --2- 172.21.15.18:0/3122814989 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42f0099a60 0x7f42f0152d10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 >> 172.21.15.18:0/3122814989 conn(0x7f42f00d17a0 msgr2=0x7f42f0070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 shutdown_connections 2024-04-25T10:08:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.119+0000 7f42f5c00640 1 -- 172.21.15.18:0/3122814989 wait complete. 2024-04-25T10:08:15.146 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:06:56.481311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:06:57.061707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:15.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:15.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 Processor -- start 2024-04-25T10:08:15.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 -- start start 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7fc015dc60 0x7f7fc00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc015e040 con 0x7f7fc009a170 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc00cff80 con 0x7f7fc006bf30 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fc5800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc00d0260 con 0x7f7fc015dc60 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7fc015dc60 0x7f7fc00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbf400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7fc009a170 0x7f7fc00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46890/0 (socket says 172.21.15.18:46890) 2024-04-25T10:08:15.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbf400640 1 -- 172.21.15.18:0/835236306 learned_addr learned my addr 172.21.15.18:0/835236306 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbea00640 1 --2- 172.21.15.18:0/835236306 >> v2:172.21.15.18:3300/0 conn(0x7f7fc015dc60 0x7f7fc00d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36942/0 (socket says 172.21.15.18:36942) 2024-04-25T10:08:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbea00640 1 -- 172.21.15.18:0/835236306 >> v1:172.21.15.167:6789/0 conn(0x7f7fc006bf30 legacy=0x7f7fc0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbea00640 1 -- 172.21.15.18:0/835236306 >> v1:172.21.15.18:6789/0 conn(0x7f7fc009a170 legacy=0x7f7fc00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.283+0000 7f7fbea00640 1 -- 172.21.15.18:0/835236306 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc00d0540 con 0x7f7fc015dc60 2024-04-25T10:08:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fbea00640 1 --2- 172.21.15.18:0/835236306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc015dc60 0x7f7fc00d1020 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00097c0 tx=0x7f7fb001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713e747c31aadc3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fbe000640 1 -- 172.21.15.18:0/835236306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00b1070 con 0x7f7fc015dc60 2024-04-25T10:08:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fbe000640 1 -- 172.21.15.18:0/835236306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb00a8050 con 0x7f7fc015dc60 2024-04-25T10:08:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fbe000640 1 -- 172.21.15.18:0/835236306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00ac860 con 0x7f7fc015dc60 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 -- 172.21.15.18:0/835236306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc015dc60 msgr2=0x7f7fc00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 --2- 172.21.15.18:0/835236306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc015dc60 0x7f7fc00d1020 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00097c0 tx=0x7f7fb001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 -- 172.21.15.18:0/835236306 shutdown_connections 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 --2- 172.21.15.18:0/835236306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc015dc60 0x7f7fc00d1020 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 -- 172.21.15.18:0/835236306 >> 172.21.15.18:0/835236306 conn(0x7f7fc00b3200 msgr2=0x7f7fc00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 -- 172.21.15.18:0/835236306 shutdown_connections 2024-04-25T10:08:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 -- 172.21.15.18:0/835236306 wait complete. 2024-04-25T10:08:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.287+0000 7f7fc5800640 1 Processor -- start 2024-04-25T10:08:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- start start 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc009a170 0x7f7fc01575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc015dc60 0x7f7fc014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc006cfa0 con 0x7f7fc006bf30 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00cc880 con 0x7f7fc009a170 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc014e530 con 0x7f7fc015dc60 2024-04-25T10:08:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36948/0 (socket says 172.21.15.18:36948) 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 -- 172.21.15.18:0/1701796665 learned_addr learned my addr 172.21.15.18:0/1701796665 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 -- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc015dc60 msgr2=0x7f7fc014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc015dc60 0x7f7fc014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 -- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc009a170 msgr2=0x7f7fc01575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc009a170 0x7f7fc01575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 -- 172.21.15.18:0/1701796665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc01587a0 con 0x7f7fc006bf30 2024-04-25T10:08:15.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fbea00640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0018ff0 tx=0x7f7fb001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00b1040 con 0x7f7fc006bf30 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb00bc070 con 0x7f7fc006bf30 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00b7690 con 0x7f7fc006bf30 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc014d490 con 0x7f7fc006bf30 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc014da50 con 0x7f7fc006bf30 2024-04-25T10:08:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.291+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc00745d0 con 0x7f7fc006bf30 2024-04-25T10:08:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.295+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7fb00b7830 con 0x7f7fc006bf30 2024-04-25T10:08:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.295+0000 7f7fb7400640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 0x7f7f9c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.295+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f7fb011f760 con 0x7f7fc006bf30 2024-04-25T10:08:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.295+0000 7f7fb6000640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 0x7f7f9c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.295+0000 7f7fb6000640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 0x7f7f9c069450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8000f70 tx=0x7f7fa80079e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.299+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7fb0016090 con 0x7f7fc006bf30 2024-04-25T10:08:15.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fc00b7590 con 0x7f7fc006bf30 2024-04-25T10:08:15.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fb7400640 1 -- 172.21.15.18:0/1701796665 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fb00f0440 con 0x7f7fc006bf30 2024-04-25T10:08:15.470 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:15.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 msgr2=0x7f7f9c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 0x7f7f9c069450 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8000f70 tx=0x7f7fa80079e0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 msgr2=0x7f7fc006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0018ff0 tx=0x7f7fb001ac20 comp rx=0 tx=0).stop 2024-04-25T10:08:15.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 shutdown_connections 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7f9c066f90 0x7f7f9c069450 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7fc015dc60 0x7f7fc014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7fc009a170 0x7f7fc01575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 --2- 172.21.15.18:0/1701796665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fc006bf30 0x7f7fc006c570 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 >> 172.21.15.18:0/1701796665 conn(0x7f7fc00b3200 msgr2=0x7f7fc00ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 shutdown_connections 2024-04-25T10:08:15.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.463+0000 7f7fc5800640 1 -- 172.21.15.18:0/1701796665 wait complete. 2024-04-25T10:08:15.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:08:15.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.626+0000 7f8d9ca00640 1 Processor -- start 2024-04-25T10:08:15.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.626+0000 7f8d9ca00640 1 -- start start 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.626+0000 7f8d9ca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d9809a170 0x7f8d980d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d9ca00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8d9806bf30 0x7f8d980cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d9ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9815e040 con 0x7f8d9815dc60 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d9ca00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980cff80 con 0x7f8d9809a170 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d9ca00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980d0260 con 0x7f8d9806bf30 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d9809a170 0x7f8d980d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d9809a170 0x7f8d980d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36964/0 (socket says 172.21.15.18:36964) 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 -- 172.21.15.18:0/814323980 learned_addr learned my addr 172.21.15.18:0/814323980 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:15.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d96800640 1 --2- 172.21.15.18:0/814323980 >> v2:172.21.15.167:3300/0 conn(0x7f8d9806bf30 0x7f8d980cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 -- 172.21.15.18:0/814323980 >> v2:172.21.15.167:3300/0 conn(0x7f8d9806bf30 msgr2=0x7f8d980cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 --2- 172.21.15.18:0/814323980 >> v2:172.21.15.167:3300/0 conn(0x7f8d9806bf30 0x7f8d980cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 -- 172.21.15.18:0/814323980 >> v1:172.21.15.167:6789/0 conn(0x7f8d9815dc60 legacy=0x7f8d98099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:15.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 -- 172.21.15.18:0/814323980 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980d0540 con 0x7f8d9809a170 2024-04-25T10:08:15.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d8fe00640 1 --2- 172.21.15.18:0/814323980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9809a170 0x7f8d980d1020 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8d98071e60 tx=0x7f8d8001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a92b59721571c55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.630+0000 7f8d95400640 1 -- 172.21.15.18:0/814323980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800b2070 con 0x7f8d9809a170 2024-04-25T10:08:15.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d95400640 1 -- 172.21.15.18:0/814323980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d800ad640 con 0x7f8d9809a170 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d95400640 1 -- 172.21.15.18:0/814323980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d800ada10 con 0x7f8d9809a170 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- 172.21.15.18:0/814323980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9809a170 msgr2=0x7f8d980d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/814323980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9809a170 0x7f8d980d1020 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f8d98071e60 tx=0x7f8d8001c390 comp rx=0 tx=0).stop 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- 172.21.15.18:0/814323980 shutdown_connections 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/814323980 >> v2:172.21.15.167:3300/0 conn(0x7f8d9806bf30 0x7f8d980cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/814323980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9809a170 0x7f8d980d1020 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- 172.21.15.18:0/814323980 >> 172.21.15.18:0/814323980 conn(0x7f8d980b3200 msgr2=0x7f8d980b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- 172.21.15.18:0/814323980 shutdown_connections 2024-04-25T10:08:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- 172.21.15.18:0/814323980 wait complete. 2024-04-25T10:08:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 Processor -- start 2024-04-25T10:08:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- start start 2024-04-25T10:08:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 0x7f8d98154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 0x7f8d98153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980cc6f0 con 0x7f8d9815dc60 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980cc570 con 0x7f8d9806bf30 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d9ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980cc870 con 0x7f8d9809a170 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d96800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d96800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36968/0 (socket says 172.21.15.18:36968) 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d96800640 1 -- 172.21.15.18:0/3700089784 learned_addr learned my addr 172.21.15.18:0/3700089784 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d95e00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 0x7f8d98154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.634+0000 7f8d8fe00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 0x7f8d98153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 -- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 msgr2=0x7f8d98153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 0x7f8d98153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 -- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 msgr2=0x7f8d98154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 0x7f8d98154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 -- 172.21.15.18:0/3700089784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98153f80 con 0x7f8d9815dc60 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d95e00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 0x7f8d98154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8fe00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 0x7f8d98153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d96800640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8d90007e90 tx=0x7f8d9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90014420 con 0x7f8d9815dc60 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90019070 con 0x7f8d9815dc60 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90014800 con 0x7f8d9815dc60 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d98154260 con 0x7f8d9815dc60 2024-04-25T10:08:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d98154820 con 0x7f8d9815dc60 2024-04-25T10:08:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980745d0 con 0x7f8d9815dc60 2024-04-25T10:08:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d900149a0 con 0x7f8d9815dc60 2024-04-25T10:08:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 0x7f8d74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f8d90085b10 con 0x7f8d9815dc60 2024-04-25T10:08:15.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.638+0000 7f8d95e00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 0x7f8d74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.642+0000 7f8d95e00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 0x7f8d74069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d980cd2f0 tx=0x7f8d88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.642+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d90011260 con 0x7f8d9815dc60 2024-04-25T10:08:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d980b7590 con 0x7f8d9815dc60 2024-04-25T10:08:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d8e000640 1 -- 172.21.15.18:0/3700089784 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d90056880 con 0x7f8d9815dc60 2024-04-25T10:08:15.815 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 msgr2=0x7f8d74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 0x7f8d74069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8d980cd2f0 tx=0x7f8d88009040 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 msgr2=0x7f8d98153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8d90007e90 tx=0x7f8d9000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 shutdown_connections 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d9815dc60 0x7f8d98153190 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d74066f60 0x7f8d74069420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d9809a170 0x7f8d98153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 --2- 172.21.15.18:0/3700089784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d9806bf30 0x7f8d98154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.806+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 >> 172.21.15.18:0/3700089784 conn(0x7f8d980b3200 msgr2=0x7f8d980ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.810+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 shutdown_connections 2024-04-25T10:08:15.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.810+0000 7f8d9ca00640 1 -- 172.21.15.18:0/3700089784 wait complete. 2024-04-25T10:08:15.836 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:08:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.970+0000 7fccce400640 1 Processor -- start 2024-04-25T10:08:15.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.970+0000 7fccce400640 1 -- start start 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccce400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccc80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccce400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc815bc40 con 0x7fccc815acd0 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccce400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc815b3a0 con 0x7fccc8144120 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccce400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc815e490 con 0x7fccc80b3090 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccbea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fccc815acd0 0x7fccc815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46892/0 (socket says 172.21.15.18:46892) 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccbea00640 1 -- 172.21.15.18:0/240804844 learned_addr learned my addr 172.21.15.18:0/240804844 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:15.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7e00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccc80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730413889 0 0) 0x7fccc815bc40 con 0x7fccc815acd0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac003530 con 0x7fccc815acd0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932115614 0 0) 0x7fccc815b3a0 con 0x7fccc8144120 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc815bc40 con 0x7fccc8144120 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 167361939 0 0) 0x7fccac003530 con 0x7fccc815acd0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 msgr2=0x7fccc80b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccc80b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 >> v1:172.21.15.167:6789/0 conn(0x7fccc8144120 legacy=0x7fccc80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc815b680 con 0x7fccc815acd0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fccb0001680 con 0x7fccc815acd0 2024-04-25T10:08:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 >> v1:172.21.15.18:6789/0 conn(0x7fccc815acd0 legacy=0x7fccc815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac003b80 0x7fccac003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac004810 0x7fccac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc815e490 con 0x7fccac003b80 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bb30 con 0x7fccac004810 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00bd30 con 0x7fccc80b3090 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac003b80 0x7fccac003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccbea00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac004810 0x7fccac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7e00640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 -- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 msgr2=0x7fccac005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc80b3090 0x7fccac005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 -- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac004810 msgr2=0x7fccac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac004810 0x7fccac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.974+0000 7fccc7400640 1 -- 172.21.15.18:0/240804844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac003530 con 0x7fccac003b80 2024-04-25T10:08:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccc7400640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac003b80 0x7fccac003fa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fccb80018d0 tx=0x7fccb801c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83fcd57a08557632 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8001520 con 0x7fccac003b80 2024-04-25T10:08:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb80052f0 con 0x7fccac003b80 2024-04-25T10:08:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccc6a00640 1 -- 172.21.15.18:0/240804844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8003840 con 0x7fccac003b80 2024-04-25T10:08:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 -- 172.21.15.18:0/240804844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac003b80 msgr2=0x7fccac003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 --2- 172.21.15.18:0/240804844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccac003b80 0x7fccac003fa0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fccb80018d0 tx=0x7fccb801c580 comp rx=0 tx=0).stop 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccc7e00640 1 -- 172.21.15.18:0/240804844 reap_dead start 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 -- 172.21.15.18:0/240804844 shutdown_connections 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 -- 172.21.15.18:0/240804844 >> 172.21.15.18:0/240804844 conn(0x7fccc8067080 msgr2=0x7fccc806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 -- 172.21.15.18:0/240804844 shutdown_connections 2024-04-25T10:08:15.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.978+0000 7fccce400640 1 -- 172.21.15.18:0/240804844 wait complete. 2024-04-25T10:08:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 Processor -- start 2024-04-25T10:08:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- start start 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 0x7fccc80b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc81f6da0 0x7fccc80af960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc815f1b0 con 0x7fccc81f6940 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc815f030 con 0x7fccac003b80 2024-04-25T10:08:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc806dae0 con 0x7fccc81f6da0 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36984/0 (socket says 172.21.15.18:36984) 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 -- 172.21.15.18:0/2583665028 learned_addr learned my addr 172.21.15.18:0/2583665028 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccc7e00640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc81f6da0 0x7fccc80af960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccc7400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 0x7fccc80b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 -- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc81f6da0 msgr2=0x7fccc80af960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc81f6da0 0x7fccc80af960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 -- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 msgr2=0x7fccc80b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 0x7fccc80b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 -- 172.21.15.18:0/2583665028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc80aff90 con 0x7fccc81f6940 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccc7400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 0x7fccc80b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbea00640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fccb00091c0 tx=0x7fccb0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb000f930 con 0x7fccc81f6940 2024-04-25T10:08:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb000faf0 con 0x7fccc81f6940 2024-04-25T10:08:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0016430 con 0x7fccc81f6940 2024-04-25T10:08:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc815bf90 con 0x7fccc81f6940 2024-04-25T10:08:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc815c550 con 0x7fccc81f6940 2024-04-25T10:08:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.982+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc80745d0 con 0x7fccc81f6940 2024-04-25T10:08:15.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.986+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fccb00153d0 con 0x7fccc81f6940 2024-04-25T10:08:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.986+0000 7fccbfe00640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 0x7fcca4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.986+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fccb0085610 con 0x7fccc81f6940 2024-04-25T10:08:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.986+0000 7fccc7400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 0x7fcca4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.986+0000 7fccc7400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 0x7fcca4069450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fccb80ad000 tx=0x7fccb80a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:15.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:15.990+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fccb00562f0 con 0x7fccc81f6940 2024-04-25T10:08:16.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.150+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccc8141440 con 0x7fccc81f6940 2024-04-25T10:08:16.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.150+0000 7fccbfe00640 1 -- 172.21.15.18:0/2583665028 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fccb0055bf0 con 0x7fccc81f6940 2024-04-25T10:08:16.159 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:08:16.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 msgr2=0x7fcca4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 0x7fcca4069450 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fccb80ad000 tx=0x7fccb80a7070 comp rx=0 tx=0).stop 2024-04-25T10:08:16.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 msgr2=0x7fccc80af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fccb00091c0 tx=0x7fccb0009680 comp rx=0 tx=0).stop 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 shutdown_connections 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcca4066f90 0x7fcca4069450 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccc81f6da0 0x7fccc80af960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccc81f6940 0x7fccc80af420 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 --2- 172.21.15.18:0/2583665028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccac003b80 0x7fccc80b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 >> 172.21.15.18:0/2583665028 conn(0x7fccc8067080 msgr2=0x7fccc813e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 shutdown_connections 2024-04-25T10:08:16.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.154+0000 7fccce400640 1 -- 172.21.15.18:0/2583665028 wait complete. 2024-04-25T10:08:16.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:08:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 Processor -- start 2024-04-25T10:08:16.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 -- start start 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f771415c330 0x7f7714163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771415c710 0x7f7714163610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f771406d2d0 0x7f7714071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77140af0e0 con 0x7f771415c330 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771406e350 con 0x7f771406d2d0 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7719a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77140cd470 con 0x7f771415c710 2024-04-25T10:08:16.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f771415c330 0x7f7714163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f771415c330 0x7f7714163040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36986/0 (socket says 172.21.15.18:36986) 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 -- 172.21.15.18:0/1588934976 learned_addr learned my addr 172.21.15.18:0/1588934976 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712000640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771415c710 0x7f7714163610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7713400640 1 --2- 172.21.15.18:0/1588934976 >> v2:172.21.15.167:3300/0 conn(0x7f771406d2d0 0x7f7714071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 -- 172.21.15.18:0/1588934976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771415c710 msgr2=0x7f7714163610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771415c710 0x7f7714163610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 -- 172.21.15.18:0/1588934976 >> v2:172.21.15.167:3300/0 conn(0x7f771406d2d0 msgr2=0x7f7714071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 --2- 172.21.15.18:0/1588934976 >> v2:172.21.15.167:3300/0 conn(0x7f771406d2d0 0x7f7714071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.314+0000 7f7712a00640 1 -- 172.21.15.18:0/1588934976 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771406dab0 con 0x7f771415c330 2024-04-25T10:08:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7712a00640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c330 0x7f7714163040 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f771406bb20 tx=0x7f770401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baadd9b1eca9d021 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7711600640 1 -- 172.21.15.18:0/1588934976 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040b0070 con 0x7f771415c330 2024-04-25T10:08:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7711600640 1 -- 172.21.15.18:0/1588934976 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77040ab600 con 0x7f771415c330 2024-04-25T10:08:16.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7711600640 1 -- 172.21.15.18:0/1588934976 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77040ab9d0 con 0x7f771415c330 2024-04-25T10:08:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 -- 172.21.15.18:0/1588934976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c330 msgr2=0x7f7714163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c330 0x7f7714163040 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f771406bb20 tx=0x7f770401c400 comp rx=0 tx=0).stop 2024-04-25T10:08:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 -- 172.21.15.18:0/1588934976 shutdown_connections 2024-04-25T10:08:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 --2- 172.21.15.18:0/1588934976 >> v2:172.21.15.167:3300/0 conn(0x7f771406d2d0 0x7f7714071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771415c710 0x7f7714163610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 --2- 172.21.15.18:0/1588934976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c330 0x7f7714163040 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 -- 172.21.15.18:0/1588934976 >> 172.21.15.18:0/1588934976 conn(0x7f7714067080 msgr2=0x7f771406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 -- 172.21.15.18:0/1588934976 shutdown_connections 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 -- 172.21.15.18:0/1588934976 wait complete. 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.318+0000 7f7719a00640 1 Processor -- start 2024-04-25T10:08:16.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- start start 2024-04-25T10:08:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771406d2d0 0x7f7714157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771415c330 0x7f771415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771406d860 con 0x7f771415c710 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771406d6e0 con 0x7f771415c330 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7714165490 con 0x7f771406d2d0 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37002/0 (socket says 172.21.15.18:37002) 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7712a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771406d2d0 0x7f7714157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 -- 172.21.15.18:0/377482199 learned_addr learned my addr 172.21.15.18:0/377482199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7712000640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771415c330 0x7f771415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 -- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771406d2d0 msgr2=0x7f7714157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771406d2d0 0x7f7714157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 -- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771415c330 msgr2=0x7f771415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771415c330 0x7f771415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 -- 172.21.15.18:0/377482199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77141443b0 con 0x7f771415c710 2024-04-25T10:08:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7713400640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f770c007e60 tx=0x7f770c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c014620 con 0x7f771415c710 2024-04-25T10:08:16.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c019070 con 0x7f771415c710 2024-04-25T10:08:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c014a20 con 0x7f771415c710 2024-04-25T10:08:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7714144690 con 0x7f771415c710 2024-04-25T10:08:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7714144c50 con 0x7f771415c710 2024-04-25T10:08:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.322+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77140745d0 con 0x7f771415c710 2024-04-25T10:08:16.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.326+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f770c014bc0 con 0x7f771415c710 2024-04-25T10:08:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.326+0000 7f770aa00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 0x7f76f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.326+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f770c085970 con 0x7f771415c710 2024-04-25T10:08:16.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.326+0000 7f7712a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 0x7f76f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:16.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.326+0000 7f7712a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 0x7f76f4069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77040ad000 tx=0x7f7704008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:16.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.330+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f770c056120 con 0x7f771415c710 2024-04-25T10:08:16.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.502+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f771406c250 con 0x7f771415c710 2024-04-25T10:08:16.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.502+0000 7f770aa00640 1 -- 172.21.15.18:0/377482199 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f770c05a1c0 con 0x7f771415c710 2024-04-25T10:08:16.511 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:08:16.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 msgr2=0x7f76f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 0x7f76f4069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f77040ad000 tx=0x7f7704008040 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 msgr2=0x7f771415e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f770c007e60 tx=0x7f770c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 shutdown_connections 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f771415c710 0x7f771415e0a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f771415c330 0x7f771415db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f76f4066f60 0x7f76f4069420 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 --2- 172.21.15.18:0/377482199 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f771406d2d0 0x7f7714157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 >> 172.21.15.18:0/377482199 conn(0x7f7714067080 msgr2=0x7f7714160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 shutdown_connections 2024-04-25T10:08:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.506+0000 7f7719a00640 1 -- 172.21.15.18:0/377482199 wait complete. 2024-04-25T10:08:16.533 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:08:16.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:16.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:16.582 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:08:16.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:16.582 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:08:16.637 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:08:16.637 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:16.646 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:08:16.647 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:16.647 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:16.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:08:16.699 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:08:16.699 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:16.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:08:16.711 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:16.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 Processor -- start 2024-04-25T10:08:17.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 -- start start 2024-04-25T10:08:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015a6c0 0x7f115015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11500b3700 0x7f11500d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115015f0d0 con 0x7f11500b3b60 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115015aaa0 con 0x7f11500b3700 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1157e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11500b40e0 con 0x7f115015a6c0 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.878+0000 7f1154a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11500b3700 0x7f11500d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f11500b3700 0x7f11500d05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37012/0 (socket says 172.21.15.18:37012) 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 -- 172.21.15.18:0/2293937712 learned_addr learned my addr 172.21.15.18:0/2293937712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1155400640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015a6c0 0x7f115015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 -- 172.21.15.18:0/2293937712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015a6c0 msgr2=0x7f115015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015a6c0 0x7f115015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 -- 172.21.15.18:0/2293937712 >> v1:172.21.15.167:6789/0 conn(0x7f11500b3b60 legacy=0x7f11500ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 -- 172.21.15.18:0/2293937712 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500b43c0 con 0x7f11500b3700 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f1154a00640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3700 0x7f11500d05c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59404069ad8a3eca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f114fe00640 1 -- 172.21.15.18:0/2293937712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0b2070 con 0x7f11500b3700 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f114fe00640 1 -- 172.21.15.18:0/2293937712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c0a9070 con 0x7f11500b3700 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.882+0000 7f114fe00640 1 -- 172.21.15.18:0/2293937712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c0ad880 con 0x7f11500b3700 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- 172.21.15.18:0/2293937712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3700 msgr2=0x7f11500d05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3700 0x7f11500d05c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f113c009870 tx=0x7f113c01c560 comp rx=0 tx=0).stop 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- 172.21.15.18:0/2293937712 shutdown_connections 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11500b3700 0x7f11500d05c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- 172.21.15.18:0/2293937712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f115015a6c0 0x7f115015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- 172.21.15.18:0/2293937712 >> 172.21.15.18:0/2293937712 conn(0x7f11500b2400 msgr2=0x7f11500b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- 172.21.15.18:0/2293937712 shutdown_connections 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- 172.21.15.18:0/2293937712 wait complete. 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 Processor -- start 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- start start 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11500b3700 0x7f1150151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3b60 0x7f1150159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150072600 con 0x7f115015a6c0 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1150072480 con 0x7f11500b3b60 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1157e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1150165d90 con 0x7f11500b3700 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11500b3700 0x7f1150151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37014/0 (socket says 172.21.15.18:37014) 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 -- 172.21.15.18:0/3038784117 learned_addr learned my addr 172.21.15.18:0/3038784117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1154a00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3b60 0x7f1150159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 -- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11500b3700 msgr2=0x7f1150151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11500b3700 0x7f1150151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 -- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3b60 msgr2=0x7f1150159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3b60 0x7f1150159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.886+0000 7f1155e00640 1 -- 172.21.15.18:0/3038784117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11500d08d0 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f1155e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f114800c770 tx=0x7f114800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1148003b80 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1148003d20 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114800aa30 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11501526c0 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1150152980 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11500745d0 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f114800abd0 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 0x7f1130069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.890+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1148085050 con 0x7f115015a6c0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.894+0000 7f1155400640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 0x7f1130069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.894+0000 7f1155400640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 0x7f1130069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1150167bf0 tx=0x7f1144008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:16.894+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1148055790 con 0x7f115015a6c0 2024-04-25T10:08:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.090+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1150070080 con 0x7f115015a6c0 2024-04-25T10:08:17.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f114d600640 1 -- 172.21.15.18:0/3038784117 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f1148059830 con 0x7f115015a6c0 2024-04-25T10:08:17.122 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:17.122 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:50.725074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:08:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-25T10:08:17.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 msgr2=0x7f1130069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 0x7f1130069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f1150167bf0 tx=0x7f1144008040 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 msgr2=0x7f11500cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f114800c770 tx=0x7f114800cc30 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 shutdown_connections 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f115015a6c0 0x7f11500cf470 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11500b3b60 0x7f1150159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1130066f60 0x7f1130069420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 --2- 172.21.15.18:0/3038784117 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11500b3700 0x7f1150151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 >> 172.21.15.18:0/3038784117 conn(0x7f11500b2400 msgr2=0x7f1150157220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 shutdown_connections 2024-04-25T10:08:17.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.094+0000 7f1157e00640 1 -- 172.21.15.18:0/3038784117 wait complete. 2024-04-25T10:08:17.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.254+0000 7f06e1800640 1 Processor -- start 2024-04-25T10:08:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.254+0000 7f06e1800640 1 -- start start 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06e1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc145270 0x7f06dc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06e1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f06dc0b1e60 0x7f06dc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06e1800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06dc0cc4e0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06e1800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06dc145650 con 0x7f06dc0b1e60 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06e1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc0ce040 con 0x7f06dc145270 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06d3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f06dc0cd4d0 0x7f06dc0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46902/0 (socket says 172.21.15.18:46902) 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06d3e00640 1 -- 172.21.15.18:0/1261268632 learned_addr learned my addr 172.21.15.18:0/1261268632 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06db400640 1 --2- 172.21.15.18:0/1261268632 >> v2:172.21.15.18:3300/0 conn(0x7f06dc0b1e60 0x7f06dc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06daa00640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc145270 0x7f06dc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06da000640 1 -- 172.21.15.18:0/1261268632 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867417209 0 0) 0x7f06dc0cc4e0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06da000640 1 -- 172.21.15.18:0/1261268632 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c0003530 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06db400640 1 -- 172.21.15.18:0/1261268632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc145270 msgr2=0x7f06dc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06db400640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc145270 0x7f06dc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06db400640 1 -- 172.21.15.18:0/1261268632 >> v1:172.21.15.18:6789/0 conn(0x7f06dc0cd4d0 legacy=0x7f06dc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.258+0000 7f06db400640 1 -- 172.21.15.18:0/1261268632 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc0ce320 con 0x7f06dc0b1e60 2024-04-25T10:08:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06db400640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0b1e60 0x7f06dc0cd930 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90e086e2c62cd0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06da000640 1 -- 172.21.15.18:0/1261268632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40b2070 con 0x7f06dc0b1e60 2024-04-25T10:08:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06da000640 1 -- 172.21.15.18:0/1261268632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d40a5920 con 0x7f06dc0b1e60 2024-04-25T10:08:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06da000640 1 -- 172.21.15.18:0/1261268632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d40a5cf0 con 0x7f06dc0b1e60 2024-04-25T10:08:17.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- 172.21.15.18:0/1261268632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0b1e60 msgr2=0x7f06dc0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0b1e60 0x7f06dc0cd930 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f06d4009d90 tx=0x7f06d401c970 comp rx=0 tx=0).stop 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- 172.21.15.18:0/1261268632 shutdown_connections 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0b1e60 0x7f06dc0cd930 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 --2- 172.21.15.18:0/1261268632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc145270 0x7f06dc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- 172.21.15.18:0/1261268632 >> 172.21.15.18:0/1261268632 conn(0x7f06dc066fa0 msgr2=0x7f06dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- 172.21.15.18:0/1261268632 shutdown_connections 2024-04-25T10:08:17.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- 172.21.15.18:0/1261268632 wait complete. 2024-04-25T10:08:17.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 Processor -- start 2024-04-25T10:08:17.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.262+0000 7f06e1800640 1 -- start start 2024-04-25T10:08:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc0b1e60 0x7f06dc13d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 0x7f06dc0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc15c710 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc15c590 con 0x7f06dc145270 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06dc15c890 con 0x7f06dc0b1e60 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37034/0 (socket says 172.21.15.18:37034) 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 -- 172.21.15.18:0/1171749013 learned_addr learned my addr 172.21.15.18:0/1171749013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06db400640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 0x7f06dc0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06daa00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc0b1e60 0x7f06dc13d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 -- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc0b1e60 msgr2=0x7f06dc13d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc0b1e60 0x7f06dc13d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 -- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 msgr2=0x7f06dc0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 0x7f06dc0ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 -- 172.21.15.18:0/1171749013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06dc15b890 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06db400640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 0x7f06dc0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d3e00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c480 tx=0x7f06c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4017070 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c4005cf0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4007290 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06dc15b310 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06dc15afe0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06dc0745d0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.266+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f06c401a070 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.270+0000 7f06d2a00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 0x7f06b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.270+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f06c40845f0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.270+0000 7f06daa00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 0x7f06b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.270+0000 7f06daa00640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 0x7f06b8069420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009ac0 tx=0x7f06cc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.274+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f06dc15b890 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.434+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06dc1429a0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.434+0000 7f06d2a00640 1 -- 172.21.15.18:0/1171749013 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17053 (secure 0 0 0) 0x7f06c4054da0 con 0x7f06dc0cd4d0 2024-04-25T10:08:17.444 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:17.444 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:07:37.800820+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:17.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 msgr2=0x7f06b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 0x7f06b8069420 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009ac0 tx=0x7f06cc009190 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 msgr2=0x7f06dc15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f06c400c480 tx=0x7f06c400c940 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 shutdown_connections 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06dc145270 0x7f06dc0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f06dc0cd4d0 0x7f06dc15aaa0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f06b8066f60 0x7f06b8069420 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 --2- 172.21.15.18:0/1171749013 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f06dc0b1e60 0x7f06dc13d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 >> 172.21.15.18:0/1171749013 conn(0x7f06dc066fa0 msgr2=0x7f06dc1444f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 shutdown_connections 2024-04-25T10:08:17.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.438+0000 7f06e1800640 1 -- 172.21.15.18:0/1171749013 wait complete. 2024-04-25T10:08:17.466 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:06:56.481311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:06:57.061707+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:17.467 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:17.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 Processor -- start 2024-04-25T10:08:17.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 -- start start 2024-04-25T10:08:17.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 0x7f32fc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32fc15af40 0x7f32fc0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32fc15e9a0 con 0x7f32fc150f40 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc06f530 con 0x7f32fc15af40 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f3302400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32fc15dbe0 con 0x7f32fc072210 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f32fbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32fc15af40 0x7f32fc0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f32fbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32fc15af40 0x7f32fc0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37040/0 (socket says 172.21.15.18:37040) 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.602+0000 7f32fbe00640 1 -- 172.21.15.18:0/1851882845 learned_addr learned my addr 172.21.15.18:0/1851882845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32fbe00640 1 -- 172.21.15.18:0/1851882845 >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 msgr2=0x7f32fc06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32f2a00640 1 --2- 172.21.15.18:0/1851882845 >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 0x7f32fc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32fbe00640 1 --2- 172.21.15.18:0/1851882845 >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 0x7f32fc06ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32fbe00640 1 -- 172.21.15.18:0/1851882845 >> v1:172.21.15.167:6789/0 conn(0x7f32fc150f40 legacy=0x7f32fc071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32fbe00640 1 -- 172.21.15.18:0/1851882845 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc15dec0 con 0x7f32fc15af40 2024-04-25T10:08:17.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32f2a00640 1 --2- 172.21.15.18:0/1851882845 >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 0x7f32fc06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:17.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32fbe00640 1 --2- 172.21.15.18:0/1851882845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc15af40 0x7f32fc0cdcc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f32fc072710 tx=0x7f32f401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a013ced06890e983 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32faa00640 1 -- 172.21.15.18:0/1851882845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40ac070 con 0x7f32fc15af40 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32faa00640 1 -- 172.21.15.18:0/1851882845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40a6410 con 0x7f32fc15af40 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.606+0000 7f32faa00640 1 -- 172.21.15.18:0/1851882845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40a67e0 con 0x7f32fc15af40 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- 172.21.15.18:0/1851882845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc15af40 msgr2=0x7f32fc0cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- 172.21.15.18:0/1851882845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc15af40 0x7f32fc0cdcc0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f32fc072710 tx=0x7f32f401c8d0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- 172.21.15.18:0/1851882845 shutdown_connections 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- 172.21.15.18:0/1851882845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc15af40 0x7f32fc0cdcc0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- 172.21.15.18:0/1851882845 >> v2:172.21.15.167:3300/0 conn(0x7f32fc072210 0x7f32fc06ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- 172.21.15.18:0/1851882845 >> 172.21.15.18:0/1851882845 conn(0x7f32fc067080 msgr2=0x7f32fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- 172.21.15.18:0/1851882845 shutdown_connections 2024-04-25T10:08:17.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- 172.21.15.18:0/1851882845 wait complete. 2024-04-25T10:08:17.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 Processor -- start 2024-04-25T10:08:17.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- start start 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 0x7f32fc14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32fc15af40 0x7f32fc150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0ce380 con 0x7f32fc072210 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0ce200 con 0x7f32fc150f40 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f3302400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32fc0ce500 con 0x7f32fc15af40 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37048/0 (socket says 172.21.15.18:37048) 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 -- 172.21.15.18:0/4216008361 learned_addr learned my addr 172.21.15.18:0/4216008361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32f2a00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 0x7f32fc14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fbe00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32fc15af40 0x7f32fc150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 -- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32fc15af40 msgr2=0x7f32fc150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32fc15af40 0x7f32fc150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 -- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 msgr2=0x7f32fc14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 0x7f32fc14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 -- 172.21.15.18:0/4216008361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc156140 con 0x7f32fc072210 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32f2a00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 0x7f32fc14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.610+0000 7f32fb400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c450 tx=0x7f32ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec016020 con 0x7f32fc072210 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec0052d0 con 0x7f32fc072210 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec007260 con 0x7f32fc072210 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32fc156420 con 0x7f32fc072210 2024-04-25T10:08:17.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32fc1569e0 con 0x7f32fc072210 2024-04-25T10:08:17.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32fc0745d0 con 0x7f32fc072210 2024-04-25T10:08:17.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32ec007400 con 0x7f32fc072210 2024-04-25T10:08:17.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 0x7f32d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f32ec084b30 con 0x7f32fc072210 2024-04-25T10:08:17.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.614+0000 7f32f2a00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 0x7f32d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.618+0000 7f32f2a00640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 0x7f32d8069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f32e4006fd0 tx=0x7f32e4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.618+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32ec020020 con 0x7f32fc072210 2024-04-25T10:08:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.782+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32fc06c250 con 0x7f32fc072210 2024-04-25T10:08:17.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.782+0000 7f32f3e00640 1 -- 172.21.15.18:0/4216008361 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32ec005480 con 0x7f32fc072210 2024-04-25T10:08:17.792 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 msgr2=0x7f32d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 0x7f32d8069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f32e4006fd0 tx=0x7f32e4008040 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 msgr2=0x7f32fc1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00c450 tx=0x7f32ec00c910 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 shutdown_connections 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32d8066f60 0x7f32d8069420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32fc15af40 0x7f32fc150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32fc150f40 0x7f32fc14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 --2- 172.21.15.18:0/4216008361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32fc072210 0x7f32fc1571e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 >> 172.21.15.18:0/4216008361 conn(0x7f32fc067080 msgr2=0x7f32fc0b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 shutdown_connections 2024-04-25T10:08:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.786+0000 7f3302400640 1 -- 172.21.15.18:0/4216008361 wait complete. 2024-04-25T10:08:17.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:08:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 Processor -- start 2024-04-25T10:08:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 -- start start 2024-04-25T10:08:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa23406fb00 0x7fa23406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2340affe0 con 0x7fa23415baa0 2024-04-25T10:08:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23406ba30 con 0x7fa2340cc910 2024-04-25T10:08:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa23c000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa234070420 con 0x7fa23406fb00 2024-04-25T10:08:17.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa238c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa23415baa0 0x7fa23406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46914/0 (socket says 172.21.15.18:46914) 2024-04-25T10:08:17.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa238c00640 1 -- 172.21.15.18:0/3995287484 learned_addr learned my addr 172.21.15.18:0/3995287484 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:17.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa239600640 1 --2- 172.21.15.18:0/3995287484 >> v2:172.21.15.167:3300/0 conn(0x7fa23406fb00 0x7fa23406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043306822 0 0) 0x7fa2340affe0 con 0x7fa23415baa0 2024-04-25T10:08:17.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa21c003530 con 0x7fa23415baa0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2096935034 0 0) 0x7fa21c003530 con 0x7fa23415baa0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 >> v2:172.21.15.167:3300/0 conn(0x7fa23406fb00 msgr2=0x7fa23406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 --2- 172.21.15.18:0/3995287484 >> v2:172.21.15.167:3300/0 conn(0x7fa23406fb00 0x7fa23406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 >> v1:172.21.15.167:6789/0 conn(0x7fa2340cc910 legacy=0x7fa23406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340cd240 con 0x7fa23415baa0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fa220001680 con 0x7fa23415baa0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.950+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 >> v1:172.21.15.18:6789/0 conn(0x7fa23415baa0 legacy=0x7fa23406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa21c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa21c0043c0 0x7fa21c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa21c005090 0x7fa21c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa234070420 con 0x7fa21c0043c0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c00bff0 con 0x7fa21c0039c0 2024-04-25T10:08:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21c00c1f0 con 0x7fa21c005090 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa238c00640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa21c0043c0 0x7fa21c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa21c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa23a000640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa21c005090 0x7fa21c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 -- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa21c005090 msgr2=0x7fa21c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa21c005090 0x7fa21c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 -- 172.21.15.18:0/3995287484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa21c0043c0 msgr2=0x7fa21c004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa21c0043c0 0x7fa21c004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 -- 172.21.15.18:0/3995287484 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c003530 con 0x7fa21c0039c0 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa238c00640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa21c0043c0 0x7fa21c004890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:17.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa23a000640 1 -- 172.21.15.18:0/3995287484 reap_dead start 2024-04-25T10:08:17.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa239600640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa21c003da0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa228009fc0 tx=0x7fa22801cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260f7575e9940073 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2280b2070 con 0x7fa21c0039c0 2024-04-25T10:08:17.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280a5b20 con 0x7fa21c0039c0 2024-04-25T10:08:17.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.954+0000 7fa233e00640 1 -- 172.21.15.18:0/3995287484 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228009c10 con 0x7fa21c0039c0 2024-04-25T10:08:17.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 msgr2=0x7fa21c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa21c003da0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa228009fc0 tx=0x7fa22801cc50 comp rx=0 tx=0).stop 2024-04-25T10:08:17.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- 172.21.15.18:0/3995287484 shutdown_connections 2024-04-25T10:08:17.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 --2- 172.21.15.18:0/3995287484 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa21c003da0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- 172.21.15.18:0/3995287484 >> 172.21.15.18:0/3995287484 conn(0x7fa2340b2240 msgr2=0x7fa2340b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:17.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- 172.21.15.18:0/3995287484 shutdown_connections 2024-04-25T10:08:17.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- 172.21.15.18:0/3995287484 wait complete. 2024-04-25T10:08:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 Processor -- start 2024-04-25T10:08:17.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- start start 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa2340b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa234157a60 0x7fa2340b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cce60 con 0x7fa2340b1400 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340cddc0 con 0x7fa21c0039c0 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2340ccfe0 con 0x7fa234157a60 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37064/0 (socket says 172.21.15.18:37064) 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa23a000640 1 -- 172.21.15.18:0/3360298838 learned_addr learned my addr 172.21.15.18:0/3360298838 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa238c00640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa234157a60 0x7fa2340b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.958+0000 7fa239600640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa2340b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 -- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa234157a60 msgr2=0x7fa2340b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa234157a60 0x7fa2340b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 -- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 msgr2=0x7fa2340b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa2340b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 -- 172.21.15.18:0/3360298838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2340b3c80 con 0x7fa2340b1400 2024-04-25T10:08:17.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23a000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa2340733c0 tx=0x7fa22c00fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c019070 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22c0050d0 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22c0067e0 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2340b3f60 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2340b4520 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2340745d0 con 0x7fa2340b1400 2024-04-25T10:08:17.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa22c006980 con 0x7fa2340b1400 2024-04-25T10:08:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 0x7fa214069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fa22c084160 con 0x7fa2340b1400 2024-04-25T10:08:17.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.962+0000 7fa239600640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 0x7fa214069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:17.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.966+0000 7fa239600640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 0x7fa214069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2280af000 tx=0x7fa2280a7040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:17.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:17.966+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa22c0549b0 con 0x7fa2340b1400 2024-04-25T10:08:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.126+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2340c5830 con 0x7fa2340b1400 2024-04-25T10:08:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa231600640 1 -- 172.21.15.18:0/3360298838 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa22c058a50 con 0x7fa2340b1400 2024-04-25T10:08:18.137 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:08:18.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 msgr2=0x7fa214069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 0x7fa214069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa2280af000 tx=0x7fa2280a7040 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 msgr2=0x7fa2340b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fa2340733c0 tx=0x7fa22c00fb40 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 shutdown_connections 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2340b1400 0x7fa2340b2f70 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa214066f60 0x7fa214069420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa234157a60 0x7fa2340b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 --2- 172.21.15.18:0/3360298838 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa21c0039c0 0x7fa2340b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 >> 172.21.15.18:0/3360298838 conn(0x7fa2340b2240 msgr2=0x7fa2340c6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 shutdown_connections 2024-04-25T10:08:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.130+0000 7fa23c000640 1 -- 172.21.15.18:0/3360298838 wait complete. 2024-04-25T10:08:18.158 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:08:18.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 Processor -- start 2024-04-25T10:08:18.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 -- start start 2024-04-25T10:08:18.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f600015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f600015ee60 0x7f60000b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f600015bc40 con 0x7f6000144120 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f600015e490 con 0x7f600015ee60 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f6004e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600015b150 con 0x7f600015acd0 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffde00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6000144120 0x7f60000ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46930/0 (socket says 172.21.15.18:46930) 2024-04-25T10:08:18.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffde00640 1 -- 172.21.15.18:0/819567386 learned_addr learned my addr 172.21.15.18:0/819567386 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f600015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 --2- 172.21.15.18:0/819567386 >> v2:172.21.15.167:3300/0 conn(0x7f600015ee60 0x7f60000b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703316257 0 0) 0x7f600015bc40 con 0x7f6000144120 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe4003530 con 0x7f6000144120 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3796629326 0 0) 0x7f5fe4003530 con 0x7f6000144120 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 msgr2=0x7f600015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f600015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 >> v2:172.21.15.167:3300/0 conn(0x7f600015ee60 msgr2=0x7f60000b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 --2- 172.21.15.18:0/819567386 >> v2:172.21.15.167:3300/0 conn(0x7f600015ee60 0x7f60000b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600015b3a0 con 0x7f6000144120 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f5ff0001680 con 0x7f6000144120 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 >> v1:172.21.15.18:6789/0 conn(0x7f6000144120 legacy=0x7f60000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe40039c0 0x7f5fe4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f5fe4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f5fe40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600015e490 con 0x7f5fe4004d50 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600015b150 con 0x7f5fe40039c0 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe400b9d0 con 0x7f600015acd0 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f5fe40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffde00640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe40039c0 0x7f5fe4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f5fe4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 -- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 msgr2=0x7f5fe4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f5fe4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 -- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe40039c0 msgr2=0x7f5fe4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe40039c0 0x7f5fe4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ffe800640 1 -- 172.21.15.18:0/819567386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe4003530 con 0x7f5fe4004d50 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.294+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f600015acd0 0x7f5fe4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f5ffe800640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f5fe40051d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009fc0 tx=0x7f5ff801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65559060139e8bf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff80b2070 con 0x7f5fe4004d50 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff80a5cd0 con 0x7f5fe4004d50 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f5ffd400640 1 -- 172.21.15.18:0/819567386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff8009c10 con 0x7f5fe4004d50 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 -- 172.21.15.18:0/819567386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 msgr2=0x7f5fe40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 --2- 172.21.15.18:0/819567386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f5fe40051d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8009fc0 tx=0x7f5ff801ccc0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f5ffe800640 1 -- 172.21.15.18:0/819567386 reap_dead start 2024-04-25T10:08:18.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 -- 172.21.15.18:0/819567386 shutdown_connections 2024-04-25T10:08:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 -- 172.21.15.18:0/819567386 >> 172.21.15.18:0/819567386 conn(0x7f6000067080 msgr2=0x7f600006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 -- 172.21.15.18:0/819567386 shutdown_connections 2024-04-25T10:08:18.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.298+0000 7f6004e00640 1 -- 172.21.15.18:0/819567386 wait complete. 2024-04-25T10:08:18.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 Processor -- start 2024-04-25T10:08:18.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- start start 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60001304d0 0x7f60000accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 0x7f600006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600015e920 con 0x7f5fe4004d50 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600015b960 con 0x7f600006e610 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600015eaa0 con 0x7f60001304d0 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37078/0 (socket says 172.21.15.18:37078) 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 -- 172.21.15.18:0/2688420446 learned_addr learned my addr 172.21.15.18:0/2688420446 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffe800640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 0x7f600006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60001304d0 0x7f60000accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 -- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60001304d0 msgr2=0x7f60000accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60001304d0 0x7f60000accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 -- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 msgr2=0x7f600006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 0x7f600006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 -- 172.21.15.18:0/2688420446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000ad230 con 0x7f5fe4004d50 2024-04-25T10:08:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffe800640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 0x7f600006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ffde00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00017f0 tx=0x7f5ff0012770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff001c070 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0014750 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0014b20 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6000130930 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.302+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6000130ee0 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60000745d0 con 0x7f5fe4004d50 2024-04-25T10:08:18.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ff001f070 con 0x7f5fe4004d50 2024-04-25T10:08:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f5ff6000640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 0x7f5fdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f5ff0087c80 con 0x7f5fe4004d50 2024-04-25T10:08:18.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 0x7f5fdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.306+0000 7f5ff7e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 0x7f5fdc069420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f600015df30 tx=0x7f5fe8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.310+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ff0058960 con 0x7f5fe4004d50 2024-04-25T10:08:18.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6000141730 con 0x7f5fe4004d50 2024-04-25T10:08:18.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f5ff6000640 1 -- 172.21.15.18:0/2688420446 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ff0058260 con 0x7f5fe4004d50 2024-04-25T10:08:18.479 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 msgr2=0x7f5fdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 0x7f5fdc069420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f600015df30 tx=0x7f5fe8008040 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 msgr2=0x7f6000141170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.470+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00017f0 tx=0x7f5ff0012770 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 shutdown_connections 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f600006e610 0x7f600006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5fdc066f60 0x7f5fdc069420 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60001304d0 0x7f60000accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 --2- 172.21.15.18:0/2688420446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5fe4004d50 0x7f6000141170 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 >> 172.21.15.18:0/2688420446 conn(0x7f6000067080 msgr2=0x7f60000b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:18.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 shutdown_connections 2024-04-25T10:08:18.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.474+0000 7f6004e00640 1 -- 172.21.15.18:0/2688420446 wait complete. 2024-04-25T10:08:18.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.630+0000 7fc3c2800640 1 Processor -- start 2024-04-25T10:08:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.630+0000 7fc3c2800640 1 -- start start 2024-04-25T10:08:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3bc15efa0 0x7fc3bc099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 0x7fc3bc099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 0x7fc3bc0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b3fe0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cd6c0 con 0x7fc3bc0b04b0 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0cce20 con 0x7fc3bc0cdb70 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3bc15efa0 0x7fc3bc099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3bc15efa0 0x7fc3bc099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37086/0 (socket says 172.21.15.18:37086) 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 -- 172.21.15.18:0/3833900250 learned_addr learned my addr 172.21.15.18:0/3833900250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1e00640 1 --2- 172.21.15.18:0/3833900250 >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 0x7fc3bc0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 -- 172.21.15.18:0/3833900250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 msgr2=0x7fc3bc099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c0a00640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 0x7fc3bc099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 0x7fc3bc099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 -- 172.21.15.18:0/3833900250 >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 msgr2=0x7fc3bc0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:18.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 --2- 172.21.15.18:0/3833900250 >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 0x7fc3bc0cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1400640 1 -- 172.21.15.18:0/3833900250 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0cd100 con 0x7fc3bc15efa0 2024-04-25T10:08:18.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c1e00640 1 --2- 172.21.15.18:0/3833900250 >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 0x7fc3bc0cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:18.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.634+0000 7fc3c0a00640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 0x7fc3bc099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c1400640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc099a60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc09f510 tx=0x7fc3b001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277c33f2f87d090b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3bbe00640 1 -- 172.21.15.18:0/3833900250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00b0070 con 0x7fc3bc15efa0 2024-04-25T10:08:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3bbe00640 1 -- 172.21.15.18:0/3833900250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b00ab600 con 0x7fc3bc15efa0 2024-04-25T10:08:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3bbe00640 1 -- 172.21.15.18:0/3833900250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b00ab9d0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- 172.21.15.18:0/3833900250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 msgr2=0x7fc3bc099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc099a60 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc09f510 tx=0x7fc3b001c1d0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- 172.21.15.18:0/3833900250 shutdown_connections 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 --2- 172.21.15.18:0/3833900250 >> v2:172.21.15.167:3300/0 conn(0x7fc3bc0b04b0 0x7fc3bc0cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0cdb70 0x7fc3bc099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 --2- 172.21.15.18:0/3833900250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc099a60 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- 172.21.15.18:0/3833900250 >> 172.21.15.18:0/3833900250 conn(0x7fc3bc0b3050 msgr2=0x7fc3bc0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- 172.21.15.18:0/3833900250 shutdown_connections 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- 172.21.15.18:0/3833900250 wait complete. 2024-04-25T10:08:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 Processor -- start 2024-04-25T10:08:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.638+0000 7fc3c2800640 1 -- start start 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0b04b0 0x7fc3bc0b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc0cdb70 0x7fc3bc158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b11a0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b3dc0 con 0x7fc3bc0cdb70 2024-04-25T10:08:18.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3bc0b1320 con 0x7fc3bc0b04b0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37092/0 (socket says 172.21.15.18:37092) 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 -- 172.21.15.18:0/2905996130 learned_addr learned my addr 172.21.15.18:0/2905996130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c0a00640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc0cdb70 0x7fc3bc158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1400640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0b04b0 0x7fc3bc0b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 -- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0b04b0 msgr2=0x7fc3bc0b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0b04b0 0x7fc3bc0b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 -- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc0cdb70 msgr2=0x7fc3bc158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc0cdb70 0x7fc3bc158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 -- 172.21.15.18:0/2905996130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0cb770 con 0x7fc3bc15efa0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c1e00640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400cf20 tx=0x7fc3b400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b401a070 con 0x7fc3bc15efa0 2024-04-25T10:08:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b400d840 con 0x7fc3bc15efa0 2024-04-25T10:08:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b400dc30 con 0x7fc3bc15efa0 2024-04-25T10:08:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3bc0b6cf0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3bc0b72b0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3bc04efa0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc3b401d070 con 0x7fc3bc15efa0 2024-04-25T10:08:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.642+0000 7fc3b9600640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 0x7fc39c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.646+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc3b4085a40 con 0x7fc3bc15efa0 2024-04-25T10:08:18.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.646+0000 7fc3c1400640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 0x7fc39c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:18.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.646+0000 7fc3c1400640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 0x7fc39c069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00ad000 tx=0x7fc3b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:18.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.650+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc3b40561f0 con 0x7fc3bc15efa0 2024-04-25T10:08:18.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.846+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc3bc0b3710 con 0x7fc3bc15efa0 2024-04-25T10:08:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.846+0000 7fc3b9600640 1 -- 172.21.15.18:0/2905996130 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fc3b405c030 con 0x7fc3bc15efa0 2024-04-25T10:08:18.856 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:18.856 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:50.725074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:08:18.856 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-25T10:08:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 msgr2=0x7fc39c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 0x7fc39c069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3b00ad000 tx=0x7fc3b0008040 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 msgr2=0x7fc3bc159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fc3b400cf20 tx=0x7fc3b400a710 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 shutdown_connections 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3bc15efa0 0x7fc3bc159190 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3bc0cdb70 0x7fc3bc158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc39c066f60 0x7fc39c069420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 --2- 172.21.15.18:0/2905996130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc3bc0b04b0 0x7fc3bc0b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 >> 172.21.15.18:0/2905996130 conn(0x7fc3bc0b3050 msgr2=0x7fc3bc0af550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 shutdown_connections 2024-04-25T10:08:18.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:18.850+0000 7fc3c2800640 1 -- 172.21.15.18:0/2905996130 wait complete. 2024-04-25T10:08:18.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:19.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 Processor -- start 2024-04-25T10:08:19.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 -- start start 2024-04-25T10:08:19.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf3815fe50 0x7fbf380b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf380b1c90 0x7fbf3815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf380cc4e0 con 0x7fbf38145270 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf38145650 con 0x7fbf3815fe50 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf381602b0 con 0x7fbf380b1c90 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf37e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbf38145270 0x7fbf380cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46942/0 (socket says 172.21.15.18:46942) 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf2fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf3815fe50 0x7fbf380b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf37e00640 1 -- 172.21.15.18:0/1899367967 learned_addr learned my addr 172.21.15.18:0/1899367967 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:19.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf3d200640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf380b1c90 0x7fbf3815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf2fe00640 1 -- 172.21.15.18:0/1899367967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf380b1c90 msgr2=0x7fbf3815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:19.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf2fe00640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf380b1c90 0x7fbf3815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf2fe00640 1 -- 172.21.15.18:0/1899367967 >> v1:172.21.15.18:6789/0 conn(0x7fbf38145270 legacy=0x7fbf380cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.010+0000 7fbf2fe00640 1 -- 172.21.15.18:0/1899367967 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf380ce040 con 0x7fbf3815fe50 2024-04-25T10:08:19.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf2fe00640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf3815fe50 0x7fbf380b1750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d73a919f2f7f1d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf37400640 1 -- 172.21.15.18:0/1899367967 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200b2070 con 0x7fbf3815fe50 2024-04-25T10:08:19.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf37400640 1 -- 172.21.15.18:0/1899367967 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf200ad640 con 0x7fbf3815fe50 2024-04-25T10:08:19.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf37400640 1 -- 172.21.15.18:0/1899367967 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf200ada10 con 0x7fbf3815fe50 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 -- 172.21.15.18:0/1899367967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf3815fe50 msgr2=0x7fbf380b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf3815fe50 0x7fbf380b1750 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fbf200097c0 tx=0x7fbf2001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 -- 172.21.15.18:0/1899367967 shutdown_connections 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf380b1c90 0x7fbf3815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 --2- 172.21.15.18:0/1899367967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf3815fe50 0x7fbf380b1750 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 -- 172.21.15.18:0/1899367967 >> 172.21.15.18:0/1899367967 conn(0x7fbf38066fa0 msgr2=0x7fbf3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 -- 172.21.15.18:0/1899367967 shutdown_connections 2024-04-25T10:08:19.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.014+0000 7fbf3f200640 1 -- 172.21.15.18:0/1899367967 wait complete. 2024-04-25T10:08:19.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 Processor -- start 2024-04-25T10:08:19.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- start start 2024-04-25T10:08:19.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf38145270 0x7fbf3815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf3815fe50 0x7fbf3815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380cdbe0 con 0x7fbf380b1c90 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3815f930 con 0x7fbf38145270 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf380cdd60 con 0x7fbf3815fe50 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37098/0 (socket says 172.21.15.18:37098) 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 -- 172.21.15.18:0/200759080 learned_addr learned my addr 172.21.15.18:0/200759080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:19.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf2fe00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf38145270 0x7fbf3815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3d200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf3815fe50 0x7fbf3815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 -- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf3815fe50 msgr2=0x7fbf3815afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf3815fe50 0x7fbf3815afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 -- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf38145270 msgr2=0x7fbf3815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf38145270 0x7fbf3815aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 -- 172.21.15.18:0/200759080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3813c350 con 0x7fbf380b1c90 2024-04-25T10:08:19.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf37e00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c420 tx=0x7fbf2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf28017070 con 0x7fbf380b1c90 2024-04-25T10:08:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf28005cf0 con 0x7fbf380b1c90 2024-04-25T10:08:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf280072f0 con 0x7fbf380b1c90 2024-04-25T10:08:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3813c070 con 0x7fbf380b1c90 2024-04-25T10:08:19.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.018+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf381655d0 con 0x7fbf380b1c90 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf380745d0 con 0x7fbf380b1c90 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf2801a070 con 0x7fbf380b1c90 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf34c00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 0x7fbf14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fbf28084660 con 0x7fbf380b1c90 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf2fe00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 0x7fbf14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.022+0000 7fbf2fe00640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 0x7fbf14069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbf200af000 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.026+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf280553d0 con 0x7fbf380b1c90 2024-04-25T10:08:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.190+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf3806ed30 con 0x7fbf380b1c90 2024-04-25T10:08:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.190+0000 7fbf34c00640 1 -- 172.21.15.18:0/200759080 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17053 (secure 0 0 0) 0x7fbf2805b0d0 con 0x7fbf380b1c90 2024-04-25T10:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:19.200 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:07:37.800820+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 msgr2=0x7fbf14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 0x7fbf14069420 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fbf200af000 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 msgr2=0x7fbf3812eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800c420 tx=0x7fbf2800c8e0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 shutdown_connections 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf14066f60 0x7fbf14069420 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf3815fe50 0x7fbf3815afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf38145270 0x7fbf3815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 --2- 172.21.15.18:0/200759080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf380b1c90 0x7fbf3812eef0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 >> 172.21.15.18:0/200759080 conn(0x7fbf38066fa0 msgr2=0x7fbf3813f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 shutdown_connections 2024-04-25T10:08:19.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.194+0000 7fbf3f200640 1 -- 172.21.15.18:0/200759080 wait complete. 2024-04-25T10:08:19.221 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:08:19.221 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:19.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 Processor -- start 2024-04-25T10:08:19.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 -- start start 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2424161510 0x7f2424143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242406d090 con 0x7f2424070fe0 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2424071ad0 con 0x7f24241435c0 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f242b400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2424162390 con 0x7f2424161510 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2428a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2424070fe0 0x7f24240713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46944/0 (socket says 172.21.15.18:46944) 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2428a00640 1 -- 172.21.15.18:0/952205142 learned_addr learned my addr 172.21.15.18:0/952205142 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:19.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423e00640 1 --2- 172.21.15.18:0/952205142 >> v2:172.21.15.167:3300/0 conn(0x7f2424161510 0x7f2424143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423400640 1 -- 172.21.15.18:0/952205142 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524822409 0 0) 0x7f2418001120 con 0x7f2424070fe0 2024-04-25T10:08:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423400640 1 -- 172.21.15.18:0/952205142 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f240c003530 con 0x7f2424070fe0 2024-04-25T10:08:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423e00640 1 -- 172.21.15.18:0/952205142 >> v1:172.21.15.167:6789/0 conn(0x7f24241435c0 legacy=0x7f242415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423e00640 1 -- 172.21.15.18:0/952205142 >> v1:172.21.15.18:6789/0 conn(0x7f2424070fe0 legacy=0x7f24240713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.354+0000 7f2423e00640 1 -- 172.21.15.18:0/952205142 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2424161af0 con 0x7f2424161510 2024-04-25T10:08:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f2423e00640 1 --2- 172.21.15.18:0/952205142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424161510 0x7f2424143080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24100097c0 tx=0x7f241001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73194eacb8950351 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f2423400640 1 -- 172.21.15.18:0/952205142 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100a7070 con 0x7f2424161510 2024-04-25T10:08:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f2423400640 1 -- 172.21.15.18:0/952205142 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24100b0070 con 0x7f2424161510 2024-04-25T10:08:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f2423400640 1 -- 172.21.15.18:0/952205142 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100ab870 con 0x7f2424161510 2024-04-25T10:08:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 -- 172.21.15.18:0/952205142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424161510 msgr2=0x7f2424143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 --2- 172.21.15.18:0/952205142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424161510 0x7f2424143080 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f24100097c0 tx=0x7f241001c470 comp rx=0 tx=0).stop 2024-04-25T10:08:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 -- 172.21.15.18:0/952205142 shutdown_connections 2024-04-25T10:08:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 --2- 172.21.15.18:0/952205142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424161510 0x7f2424143080 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 -- 172.21.15.18:0/952205142 >> 172.21.15.18:0/952205142 conn(0x7f24240b3390 msgr2=0x7f24240b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 -- 172.21.15.18:0/952205142 shutdown_connections 2024-04-25T10:08:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.358+0000 7f242b400640 1 -- 172.21.15.18:0/952205142 wait complete. 2024-04-25T10:08:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 Processor -- start 2024-04-25T10:08:19.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- start start 2024-04-25T10:08:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 0x7f242413ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24241435c0 0x7f24240cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242415ede0 con 0x7f2424161510 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242415ec60 con 0x7f2424070fe0 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24240b0540 con 0x7f24241435c0 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2428a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 0x7f242413ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37112/0 (socket says 172.21.15.18:37112) 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 -- 172.21.15.18:0/679097616 learned_addr learned my addr 172.21.15.18:0/679097616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2423e00640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24241435c0 0x7f24240cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 -- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24241435c0 msgr2=0x7f24240cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24241435c0 0x7f24240cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 -- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 msgr2=0x7f242413ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 0x7f242413ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 -- 172.21.15.18:0/679097616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242413e750 con 0x7f2424161510 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2428a00640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 0x7f242413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2429400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c7a0 tx=0x7f241c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c003b80 con 0x7f2424161510 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c003d20 con 0x7f2424161510 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242413ea30 con 0x7f2424161510 2024-04-25T10:08:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c00aa90 con 0x7f2424161510 2024-04-25T10:08:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.362+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242413f2d0 con 0x7f2424161510 2024-04-25T10:08:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242413f4d0 con 0x7f2424161510 2024-04-25T10:08:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f241c00ac30 con 0x7f2424161510 2024-04-25T10:08:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f2420c00640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 0x7f2404069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f241c084fb0 con 0x7f2424161510 2024-04-25T10:08:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f2428a00640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 0x7f2404069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.366+0000 7f2428a00640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 0x7f2404069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24180012c0 tx=0x7f2418009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.370+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f242413f4d0 con 0x7f2424161510 2024-04-25T10:08:19.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.566+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24240745d0 con 0x7f2424161510 2024-04-25T10:08:19.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.566+0000 7f2420c00640 1 -- 172.21.15.18:0/679097616 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f241c055800 con 0x7f2424161510 2024-04-25T10:08:19.576 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:19.576 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:50.725074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:08:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 msgr2=0x7f2404069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 0x7f2404069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f24180012c0 tx=0x7f2418009040 comp rx=0 tx=0).stop 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 msgr2=0x7f24240cd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c7a0 tx=0x7f241c00cc60 comp rx=0 tx=0).stop 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 shutdown_connections 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2424161510 0x7f24240cd3d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2404066f60 0x7f2404069420 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24241435c0 0x7f24240cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 --2- 172.21.15.18:0/679097616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2424070fe0 0x7f242413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 >> 172.21.15.18:0/679097616 conn(0x7f24240b3390 msgr2=0x7f242415d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 shutdown_connections 2024-04-25T10:08:19.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.570+0000 7f242b400640 1 -- 172.21.15.18:0/679097616 wait complete. 2024-04-25T10:08:19.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:19.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.726+0000 7f73ce800640 1 Processor -- start 2024-04-25T10:08:19.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 -- start start 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 0x7f73c8099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73c815ee00 0x7f73c806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 0x7f73c8161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c809a380 con 0x7f73c815ee00 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c806c650 con 0x7f73c8099a60 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73ce800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c806c930 con 0x7f73c81616a0 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73c815ee00 0x7f73c806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73c815ee00 0x7f73c806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37118/0 (socket says 172.21.15.18:37118) 2024-04-25T10:08:19.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 -- 172.21.15.18:0/4234971600 learned_addr learned my addr 172.21.15.18:0/4234971600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:19.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73c7e00640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 0x7f73c8161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 -- 172.21.15.18:0/4234971600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 msgr2=0x7f73c8161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:19.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73c7400640 1 --2- 172.21.15.18:0/4234971600 >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 0x7f73c8099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 0x7f73c8161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 -- 172.21.15.18:0/4234971600 >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 msgr2=0x7f73c8099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:19.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 --2- 172.21.15.18:0/4234971600 >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 0x7f73c8099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73bfe00640 1 -- 172.21.15.18:0/4234971600 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c806cc10 con 0x7f73c815ee00 2024-04-25T10:08:19.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73c7e00640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 0x7f73c8161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:19.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.730+0000 7f73c7400640 1 --2- 172.21.15.18:0/4234971600 >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 0x7f73c8099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:19.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73bfe00640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c815ee00 0x7f73c806bd20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f73c8072740 tx=0x7f73b001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f67c60ace57941b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73c6a00640 1 -- 172.21.15.18:0/4234971600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00ab5f0 con 0x7f73c815ee00 2024-04-25T10:08:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73c6a00640 1 -- 172.21.15.18:0/4234971600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b00b0070 con 0x7f73c815ee00 2024-04-25T10:08:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73c6a00640 1 -- 172.21.15.18:0/4234971600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b00ab9b0 con 0x7f73c815ee00 2024-04-25T10:08:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- 172.21.15.18:0/4234971600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c815ee00 msgr2=0x7f73c806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c815ee00 0x7f73c806bd20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f73c8072740 tx=0x7f73b001c520 comp rx=0 tx=0).stop 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- 172.21.15.18:0/4234971600 shutdown_connections 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c81616a0 0x7f73c8161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 --2- 172.21.15.18:0/4234971600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c815ee00 0x7f73c806bd20 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 --2- 172.21.15.18:0/4234971600 >> v2:172.21.15.167:3300/0 conn(0x7f73c8099a60 0x7f73c8099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- 172.21.15.18:0/4234971600 >> 172.21.15.18:0/4234971600 conn(0x7f73c80d17a0 msgr2=0x7f73c80d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- 172.21.15.18:0/4234971600 shutdown_connections 2024-04-25T10:08:19.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- 172.21.15.18:0/4234971600 wait complete. 2024-04-25T10:08:19.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 Processor -- start 2024-04-25T10:08:19.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.734+0000 7f73ce800640 1 -- start start 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 0x7f73c814b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 0x7f73c8154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c815e000 con 0x7f73c81616a0 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c815de80 con 0x7f73c815ee00 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c806c260 con 0x7f73c8099a60 2024-04-25T10:08:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37134/0 (socket says 172.21.15.18:37134) 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 -- 172.21.15.18:0/701622313 learned_addr learned my addr 172.21.15.18:0/701622313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7400640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 0x7f73c814b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bfe00640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 0x7f73c8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 -- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 msgr2=0x7f73c814b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 0x7f73c814b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 -- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 msgr2=0x7f73c8154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 0x7f73c8154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 -- 172.21.15.18:0/701622313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c81fb1f0 con 0x7f73c81616a0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bfe00640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 0x7f73c8154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7400640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 0x7f73c814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73c7e00640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cd80 tx=0x7f73c000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000f680 con 0x7f73c81616a0 2024-04-25T10:08:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000f840 con 0x7f73c81616a0 2024-04-25T10:08:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000fc30 con 0x7f73c81616a0 2024-04-25T10:08:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c81538a0 con 0x7f73c81616a0 2024-04-25T10:08:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c8153e60 con 0x7f73c81616a0 2024-04-25T10:08:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c80745d0 con 0x7f73c81616a0 2024-04-25T10:08:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.738+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f73c000e3e0 con 0x7f73c81616a0 2024-04-25T10:08:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.742+0000 7f73bf400640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 0x7f73a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.742+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f73c0085fe0 con 0x7f73c81616a0 2024-04-25T10:08:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.742+0000 7f73c7400640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 0x7f73a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.742+0000 7f73c7400640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 0x7f73a4069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006b20 tx=0x7f73b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.746+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f73c0014030 con 0x7f73c81616a0 2024-04-25T10:08:19.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.942+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73c806c040 con 0x7f73c81616a0 2024-04-25T10:08:19.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.942+0000 7f73bf400640 1 -- 172.21.15.18:0/701622313 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f73c0056d90 con 0x7f73c81616a0 2024-04-25T10:08:19.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:19.952 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:06:58.075161+0000","modified":"2024-04-25T10:07:50.725074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35462},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35462":{"gid":35462,"name":"b","rank":0,"incarnation":32,"state":"up:active","state_seq":17,"addr":"172.21.15.167:6837/343490040","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":343490040},{"type":"v1","addr":"172.21.15.167:6837","nonce":343490040}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T10:08:19.952 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 38 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 msgr2=0x7f73a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 0x7f73a4069420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f73b8006b20 tx=0x7f73b8008040 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 msgr2=0x7f73c81fa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f73c000cd80 tx=0x7f73c000a650 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 shutdown_connections 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73c81616a0 0x7f73c81fa6f0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c815ee00 0x7f73c8154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f73a4066f60 0x7f73a4069420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 --2- 172.21.15.18:0/701622313 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f73c8099a60 0x7f73c814b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:19.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 >> 172.21.15.18:0/701622313 conn(0x7f73c80d17a0 msgr2=0x7f73c80cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:19.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 shutdown_connections 2024-04-25T10:08:19.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:19.946+0000 7f73ce800640 1 -- 172.21.15.18:0/701622313 wait complete. 2024-04-25T10:08:19.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 Processor -- start 2024-04-25T10:08:20.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 -- start start 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f22140b1e60 0x7f221415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140cc4e0 con 0x7f221415fe50 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22140ce040 con 0x7f2214145270 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2218a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2214145650 con 0x7f22140b1e60 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2209400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f221415fe50 0x7f22140b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46950/0 (socket says 172.21.15.18:46950) 2024-04-25T10:08:20.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2209400640 1 -- 172.21.15.18:0/1077656084 learned_addr learned my addr 172.21.15.18:0/1077656084 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2212800640 1 --2- 172.21.15.18:0/1077656084 >> v2:172.21.15.167:3300/0 conn(0x7f22140b1e60 0x7f221415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819747239 0 0) 0x7f22140cc4e0 con 0x7f221415fe50 2024-04-25T10:08:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f8003530 con 0x7f221415fe50 2024-04-25T10:08:20.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1690992844 0 0) 0x7f21f8003530 con 0x7f221415fe50 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 >> v2:172.21.15.167:3300/0 conn(0x7f22140b1e60 msgr2=0x7f221415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 --2- 172.21.15.18:0/1077656084 >> v2:172.21.15.167:3300/0 conn(0x7f22140b1e60 0x7f221415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 >> v1:172.21.15.167:6789/0 conn(0x7f2214145270 legacy=0x7f22140cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140ce320 con 0x7f221415fe50 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f21fc001680 con 0x7f221415fe50 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 >> v1:172.21.15.18:6789/0 conn(0x7f221415fe50 legacy=0x7f22140b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f21f8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21f80043c0 0x7f21f8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21f8005090 0x7f21f800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2214145650 con 0x7f21f80039c0 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f800bff0 con 0x7f21f8005090 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f800c1f0 con 0x7f21f80043c0 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2211e00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f21f8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2209400640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21f80043c0 0x7f21f8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.106+0000 7f2212800640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21f8005090 0x7f21f800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 -- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21f80043c0 msgr2=0x7f21f8004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21f80043c0 0x7f21f8004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 -- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21f8005090 msgr2=0x7f21f800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21f8005090 0x7f21f800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 -- 172.21.15.18:0/1077656084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8003530 con 0x7f21f80039c0 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2212800640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21f8005090 0x7f21f800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:20.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2212800640 1 -- 172.21.15.18:0/1077656084 reap_dead start 2024-04-25T10:08:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211e00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f21f8003da0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2204001f60 tx=0x7f220401c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935237fd286d08ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204001b60 con 0x7f21f80039c0 2024-04-25T10:08:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040a9630 con 0x7f21f80039c0 2024-04-25T10:08:20.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2211400640 1 -- 172.21.15.18:0/1077656084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040a9a60 con 0x7f21f80039c0 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 -- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 msgr2=0x7f21f8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f21f8003da0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f2204001f60 tx=0x7f220401c880 comp rx=0 tx=0).stop 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 -- 172.21.15.18:0/1077656084 shutdown_connections 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 --2- 172.21.15.18:0/1077656084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f21f8003da0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 -- 172.21.15.18:0/1077656084 >> 172.21.15.18:0/1077656084 conn(0x7f2214066fa0 msgr2=0x7f221406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 -- 172.21.15.18:0/1077656084 shutdown_connections 2024-04-25T10:08:20.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.110+0000 7f2218a00640 1 -- 172.21.15.18:0/1077656084 wait complete. 2024-04-25T10:08:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 Processor -- start 2024-04-25T10:08:20.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 -- start start 2024-04-25T10:08:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140ad8e0 0x7f221415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 0x7f221406d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b1ce0 con 0x7f21f80039c0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b1b60 con 0x7f22140ad8e0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221415bd80 con 0x7f221406d2b0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37146/0 (socket says 172.21.15.18:37146) 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 -- 172.21.15.18:0/2646082024 learned_addr learned my addr 172.21.15.18:0/2646082024 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2212800640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 0x7f221406d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2209400640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140ad8e0 0x7f221415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 -- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 msgr2=0x7f221406d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 0x7f221406d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 -- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140ad8e0 msgr2=0x7f221415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140ad8e0 0x7f221415b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 -- 172.21.15.18:0/2646082024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221415b880 con 0x7f21f80039c0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2212800640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 0x7f221406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2211e00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2204098040 tx=0x7f21f8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22040a99e0 con 0x7f21f80039c0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22040a9b80 con 0x7f21f80039c0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22140cb070 con 0x7f21f80039c0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.114+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2204007040 con 0x7f21f80039c0 2024-04-25T10:08:20.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22140cb630 con 0x7f21f80039c0 2024-04-25T10:08:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22140745d0 con 0x7f21f80039c0 2024-04-25T10:08:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f22040a94f0 con 0x7f21f80039c0 2024-04-25T10:08:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f220aa00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 0x7f21f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f220411f6e0 con 0x7f21f80039c0 2024-04-25T10:08:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.118+0000 7f2209400640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 0x7f21f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.122+0000 7f2209400640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 0x7f21f0069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2214142b00 tx=0x7f21fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.122+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f22040ad020 con 0x7f21f80039c0 2024-04-25T10:08:20.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.290+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f221406b8e0 con 0x7f21f80039c0 2024-04-25T10:08:20.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.290+0000 7f220aa00640 1 -- 172.21.15.18:0/2646082024 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+17053 (secure 0 0 0) 0x7f2204016590 con 0x7f21f80039c0 2024-04-25T10:08:20.299 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:20.299 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:07:37.800820+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:06:56.481311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T10:06:57.061707+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1e","mappings":[{"from":7,"to":2}]},{"pgid":"10.1d","mappings":[{"from":4,"to":3}]},{"pgid":"10.21","mappings":[{"from":4,"to":3}]},{"pgid":"10.22","mappings":[{"from":7,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 msgr2=0x7f21f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 0x7f21f0069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2214142b00 tx=0x7f21fc009040 comp rx=0 tx=0).stop 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 msgr2=0x7f22140b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2204098040 tx=0x7f21f8005840 comp rx=0 tx=0).stop 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 shutdown_connections 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21f0066f60 0x7f21f0069420 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f221406d2b0 0x7f221406d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f22140ad8e0 0x7f221415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 --2- 172.21.15.18:0/2646082024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21f80039c0 0x7f22140b1110 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 >> 172.21.15.18:0/2646082024 conn(0x7f2214066fa0 msgr2=0x7f22140ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 shutdown_connections 2024-04-25T10:08:20.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.294+0000 7f2218a00640 1 -- 172.21.15.18:0/2646082024 wait complete. 2024-04-25T10:08:20.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:08:20.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 Processor -- start 2024-04-25T10:08:20.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 -- start start 2024-04-25T10:08:20.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc78159320 0x7fdc7815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc7806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7815fc00 con 0x7fdc7806e010 2024-04-25T10:08:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7806d640 con 0x7fdc78159320 2024-04-25T10:08:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7815fee0 con 0x7fdc7815f440 2024-04-25T10:08:20.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc78159320 0x7fdc7815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc78159320 0x7fdc7815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37152/0 (socket says 172.21.15.18:37152) 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7da00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdc7806e010 0x7fdc7806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46952/0 (socket says 172.21.15.18:46952) 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 -- 172.21.15.18:0/921922952 learned_addr learned my addr 172.21.15.18:0/921922952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc6fe00640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc7806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 -- 172.21.15.18:0/921922952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 msgr2=0x7fdc7806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc7806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 -- 172.21.15.18:0/921922952 >> v1:172.21.15.18:6789/0 conn(0x7fdc7806e010 legacy=0x7fdc7806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc7d000640 1 -- 172.21.15.18:0/921922952 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc781601c0 con 0x7fdc78159320 2024-04-25T10:08:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc6fe00640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:20.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.454+0000 7fdc77e00640 1 -- 172.21.15.18:0/921922952 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454677199 0 0) 0x7fdc7815fc00 con 0x7fdc7806e010 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7d000640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc78159320 0x7fdc7815c9b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009870 tx=0x7fdc6801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ce1f22c5876868 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc77e00640 1 -- 172.21.15.18:0/921922952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680aa620 con 0x7fdc78159320 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc77e00640 1 -- 172.21.15.18:0/921922952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc680af070 con 0x7fdc78159320 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc77e00640 1 -- 172.21.15.18:0/921922952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680aa9e0 con 0x7fdc78159320 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 -- 172.21.15.18:0/921922952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc78159320 msgr2=0x7fdc7815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc78159320 0x7fdc7815c9b0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fdc68009870 tx=0x7fdc6801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 -- 172.21.15.18:0/921922952 shutdown_connections 2024-04-25T10:08:20.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/921922952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc78159320 0x7fdc7815c9b0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 -- 172.21.15.18:0/921922952 >> 172.21.15.18:0/921922952 conn(0x7fdc78067080 msgr2=0x7fdc7806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:20.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 -- 172.21.15.18:0/921922952 shutdown_connections 2024-04-25T10:08:20.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.458+0000 7fdc7fa00640 1 -- 172.21.15.18:0/921922952 wait complete. 2024-04-25T10:08:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 Processor -- start 2024-04-25T10:08:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- start start 2024-04-25T10:08:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc78159320 0x7fdc7815a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc78164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7815f9a0 con 0x7fdc7806e010 2024-04-25T10:08:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7815f820 con 0x7fdc78159320 2024-04-25T10:08:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7806ebb0 con 0x7fdc7815f440 2024-04-25T10:08:20.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37168/0 (socket says 172.21.15.18:37168) 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 -- 172.21.15.18:0/1398708124 learned_addr learned my addr 172.21.15.18:0/1398708124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 -- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 msgr2=0x7fdc78164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc78164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 -- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc78159320 msgr2=0x7fdc7815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc78159320 0x7fdc7815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 -- 172.21.15.18:0/1398708124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7815b200 con 0x7fdc7806e010 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7d000640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fdc680ac040 tx=0x7fdc6801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680aadb0 con 0x7fdc7806e010 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc680bd3f0 con 0x7fdc7806e010 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc680bd7e0 con 0x7fdc7806e010 2024-04-25T10:08:20.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7815b4e0 con 0x7fdc7806e010 2024-04-25T10:08:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7815baa0 con 0x7fdc7806e010 2024-04-25T10:08:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.462+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc780745d0 con 0x7fdc7806e010 2024-04-25T10:08:20.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.466+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc680b33f0 con 0x7fdc7806e010 2024-04-25T10:08:20.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.466+0000 7fdc75600640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 0x7fdc54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.466+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fdc6811f750 con 0x7fdc7806e010 2024-04-25T10:08:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.466+0000 7fdc6fe00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 0x7fdc54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.466+0000 7fdc6fe00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 0x7fdc54069450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdc60006f10 tx=0x7fdc60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.470+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc680c3060 con 0x7fdc7806e010 2024-04-25T10:08:20.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.670+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc78159ea0 con 0x7fdc7806e010 2024-04-25T10:08:20.678 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:08:20.670+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:08:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.670+0000 7fdc75600640 1 -- 172.21.15.18:0/1398708124 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdc68016150 con 0x7fdc7806e010 2024-04-25T10:08:20.680 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:08:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 msgr2=0x7fdc54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 0x7fdc54069450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdc60006f10 tx=0x7fdc60008040 comp rx=0 tx=0).stop 2024-04-25T10:08:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 msgr2=0x7fdc78138740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fdc680ac040 tx=0x7fdc6801ace0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 shutdown_connections 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc54066f90 0x7fdc54069450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7815f440 0x7fdc78164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc78159320 0x7fdc7815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 --2- 172.21.15.18:0/1398708124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7806e010 0x7fdc78138740 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 >> 172.21.15.18:0/1398708124 conn(0x7fdc78067080 msgr2=0x7fdc7815cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 shutdown_connections 2024-04-25T10:08:20.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.674+0000 7fdc7fa00640 1 -- 172.21.15.18:0/1398708124 wait complete. 2024-04-25T10:08:20.697 INFO:tasks.ceph.mds.b.smithi167.stderr: -7611> 2024-04-25T10:07:03.636+0000 7f0428800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:08:20.701 INFO:tasks.ceph.mds.b.smithi167.stderr: -4902> 2024-04-25T10:07:11.504+0000 7f0423800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={35570=0-4194304@1} caps={35570=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=35570 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55f84882b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:08:20.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:08:20.704 INFO:tasks.ceph.mds.b.smithi167.stderr: -3080> 2024-04-25T10:07:43.112+0000 7f0423800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={35570=0-4194304@1} caps={35570=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=35570 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55f84882b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:08:20.750 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:08:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 Processor -- start 2024-04-25T10:08:20.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 -- start start 2024-04-25T10:08:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd6d4144120 0x7fd6d415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6d40b3090 0x7fd6d40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d415bc40 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d415e490 con 0x7fd6d40b3090 2024-04-25T10:08:20.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d9800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d415b3a0 con 0x7fd6d4144120 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d3400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6d40b3090 0x7fd6d40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6ca000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd6d40ccbf0 0x7fd6d415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46954/0 (socket says 172.21.15.18:46954) 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6ca000640 1 -- 172.21.15.18:0/1234286749 learned_addr learned my addr 172.21.15.18:0/1234286749 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d2a00640 1 --2- 172.21.15.18:0/1234286749 >> v2:172.21.15.167:3300/0 conn(0x7fd6d4144120 0x7fd6d415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d3400640 1 -- 172.21.15.18:0/1234286749 >> v2:172.21.15.167:3300/0 conn(0x7fd6d4144120 msgr2=0x7fd6d415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d3400640 1 --2- 172.21.15.18:0/1234286749 >> v2:172.21.15.167:3300/0 conn(0x7fd6d4144120 0x7fd6d415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d3400640 1 -- 172.21.15.18:0/1234286749 >> v1:172.21.15.18:6789/0 conn(0x7fd6d40ccbf0 legacy=0x7fd6d415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d3400640 1 -- 172.21.15.18:0/1234286749 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d415b680 con 0x7fd6d40b3090 2024-04-25T10:08:20.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.838+0000 7fd6d2000640 1 -- 172.21.15.18:0/1234286749 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947385649 0 0) 0x7fd6d415bc40 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.851 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d3400640 1 --2- 172.21.15.18:0/1234286749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40b3090 0x7fd6d40b3520 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406b9b0 tx=0x7fd6cc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c392188b4acd9246 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d2000640 1 -- 172.21.15.18:0/1234286749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0b0070 con 0x7fd6d40b3090 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d2000640 1 -- 172.21.15.18:0/1234286749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0ab600 con 0x7fd6d40b3090 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d2000640 1 -- 172.21.15.18:0/1234286749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0ab9d0 con 0x7fd6d40b3090 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 -- 172.21.15.18:0/1234286749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40b3090 msgr2=0x7fd6d40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 --2- 172.21.15.18:0/1234286749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40b3090 0x7fd6d40b3520 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fd6d406b9b0 tx=0x7fd6cc01c3f0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 -- 172.21.15.18:0/1234286749 shutdown_connections 2024-04-25T10:08:20.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 --2- 172.21.15.18:0/1234286749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40b3090 0x7fd6d40b3520 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 --2- 172.21.15.18:0/1234286749 >> v2:172.21.15.167:3300/0 conn(0x7fd6d4144120 0x7fd6d415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 -- 172.21.15.18:0/1234286749 >> 172.21.15.18:0/1234286749 conn(0x7fd6d4067080 msgr2=0x7fd6d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 -- 172.21.15.18:0/1234286749 shutdown_connections 2024-04-25T10:08:20.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.842+0000 7fd6d9800640 1 -- 172.21.15.18:0/1234286749 wait complete. 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 Processor -- start 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- start start 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40b3090 0x7fd6d415db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d4144120 0x7fd6d41f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d41675c0 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4167440 con 0x7fd6d40b3090 2024-04-25T10:08:20.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4167740 con 0x7fd6d4144120 2024-04-25T10:08:20.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:08:20.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37182/0 (socket says 172.21.15.18:37182) 2024-04-25T10:08:20.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 -- 172.21.15.18:0/698201208 learned_addr learned my addr 172.21.15.18:0/698201208 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d2a00640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40b3090 0x7fd6d415db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d3400640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d4144120 0x7fd6d41f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 -- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d4144120 msgr2=0x7fd6d41f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d4144120 0x7fd6d41f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 -- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40b3090 msgr2=0x7fd6d415db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40b3090 0x7fd6d415db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 -- 172.21.15.18:0/698201208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40b0b60 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6ca000640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0011f0 tx=0x7fd6bc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc018070 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0074e0 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc004a10 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d40b0e00 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.846+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d413dc60 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40745d0 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6bc004bb0 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6cb400640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 0x7fd6b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fd6bc084660 con 0x7fd6d40ccbf0 2024-04-25T10:08:20.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6d2a00640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 0x7fd6b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:20.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.850+0000 7fd6d2a00640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 0x7fd6b0069420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4003ab0 tx=0x7fd6c4009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:20.854+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6bc054d30 con 0x7fd6d40ccbf0 2024-04-25T10:08:21.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.054+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd6d413ff60 con 0x7fd6d40ccbf0 2024-04-25T10:08:21.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.674+0000 7fd6cb400640 1 -- 172.21.15.18:0/698201208 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd6bc058dd0 con 0x7fd6d40ccbf0 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.674+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 msgr2=0x7fd6b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.674+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 0x7fd6b0069420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4003ab0 tx=0x7fd6c4009830 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.674+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 msgr2=0x7fd6d41593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.674+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0011f0 tx=0x7fd6bc00c9b0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 shutdown_connections 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6b0066f60 0x7fd6b0069420 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd6d4144120 0x7fd6d41f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6d40ccbf0 0x7fd6d41593c0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 --2- 172.21.15.18:0/698201208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd6d40b3090 0x7fd6d415db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 >> 172.21.15.18:0/698201208 conn(0x7fd6d4067080 msgr2=0x7fd6d4141150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 shutdown_connections 2024-04-25T10:08:21.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.678+0000 7fd6d9800640 1 -- 172.21.15.18:0/698201208 wait complete. 2024-04-25T10:08:21.708 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:08:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 Processor -- start 2024-04-25T10:08:21.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 -- start start 2024-04-25T10:08:21.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd710071250 0x7fd7100cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd71015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71015ccc0 con 0x7fd71015c2d0 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71015c740 con 0x7fd710071250 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd717400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd710160200 con 0x7fd710071630 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd710071250 0x7fd7100cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd710071250 0x7fd7100cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33214/0 (socket says 172.21.15.18:33214) 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 -- 172.21.15.18:0/546827927 learned_addr learned my addr 172.21.15.18:0/546827927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd707e00640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd71015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 -- 172.21.15.18:0/546827927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 msgr2=0x7fd71015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd71015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 -- 172.21.15.18:0/546827927 >> v1:172.21.15.167:6789/0 conn(0x7fd71015c2d0 legacy=0x7fd71015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.850+0000 7fd714a00640 1 -- 172.21.15.18:0/546827927 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71015c9e0 con 0x7fd710071250 2024-04-25T10:08:21.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd714a00640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd7100cdf90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3abeed82b01f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd70fe00640 1 -- 172.21.15.18:0/546827927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b0070 con 0x7fd710071250 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd70fe00640 1 -- 172.21.15.18:0/546827927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000ab600 con 0x7fd710071250 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd70fe00640 1 -- 172.21.15.18:0/546827927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000ab9d0 con 0x7fd710071250 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 -- 172.21.15.18:0/546827927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 msgr2=0x7fd7100cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd7100cdf90 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70001c440 comp rx=0 tx=0).stop 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 -- 172.21.15.18:0/546827927 shutdown_connections 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd71015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 --2- 172.21.15.18:0/546827927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd7100cdf90 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 -- 172.21.15.18:0/546827927 >> 172.21.15.18:0/546827927 conn(0x7fd71006ac10 msgr2=0x7fd71006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 -- 172.21.15.18:0/546827927 shutdown_connections 2024-04-25T10:08:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.854+0000 7fd717400640 1 -- 172.21.15.18:0/546827927 wait complete. 2024-04-25T10:08:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 Processor -- start 2024-04-25T10:08:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- start start 2024-04-25T10:08:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd7100b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71015c2d0 0x7fd71014c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710071b90 con 0x7fd710071250 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710071a10 con 0x7fd71015c2d0 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101684a0 con 0x7fd710071630 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33228/0 (socket says 172.21.15.18:33228) 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 -- 172.21.15.18:0/307536673 learned_addr learned my addr 172.21.15.18:0/307536673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 -- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 msgr2=0x7fd7100b38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd7100b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 -- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71015c2d0 msgr2=0x7fd71014c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71015c2d0 0x7fd71014c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 -- 172.21.15.18:0/307536673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71006f030 con 0x7fd710071250 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd714a00640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd70001a070 tx=0x7fd7000191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000ba020 con 0x7fd710071250 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000b6420 con 0x7fd710071250 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b0040 con 0x7fd710071250 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd710154960 con 0x7fd710071250 2024-04-25T10:08:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.858+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd710154be0 con 0x7fd710071250 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100745d0 con 0x7fd710071250 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd7000bd020 con 0x7fd710071250 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd70d600640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fd70011f3d0 con 0x7fd710071250 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd707e00640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:21.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.862+0000 7fd707e00640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 0x7fd6ec069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006aa0 tx=0x7fd6f8006a30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:21.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:21.866+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7000c4030 con 0x7fd710071250 2024-04-25T10:08:22.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.034+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd710071f20 con 0x7fd710071250 2024-04-25T10:08:22.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.942+0000 7fd70d600640 1 -- 172.21.15.18:0/307536673 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v71) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd710154960 con 0x7fd710071250 2024-04-25T10:08:22.949 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 msgr2=0x7fd6ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 0x7fd6ec069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8006aa0 tx=0x7fd6f8006a30 comp rx=0 tx=0).stop 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 msgr2=0x7fd710154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fd70001a070 tx=0x7fd7000191e0 comp rx=0 tx=0).stop 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 shutdown_connections 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd71015c2d0 0x7fd71014c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:22.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd710071630 0x7fd7100b38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 --2- 172.21.15.18:0/307536673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd710071250 0x7fd710154420 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 >> 172.21.15.18:0/307536673 conn(0x7fd71006ac10 msgr2=0x7fd71015a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 shutdown_connections 2024-04-25T10:08:22.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:22.946+0000 7fd717400640 1 -- 172.21.15.18:0/307536673 wait complete. 2024-04-25T10:08:22.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:08:23.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 Processor -- start 2024-04-25T10:08:23.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 -- start start 2024-04-25T10:08:23.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 0x7f52040af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52040c60a0 0x7f52041676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040c6dc0 con 0x7f52040ce1c0 2024-04-25T10:08:23.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040d0430 con 0x7f52040c60a0 2024-04-25T10:08:23.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5209200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040c70a0 con 0x7f520415dd00 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 0x7f52040af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5202800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f52040c60a0 0x7f52041676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f51f9400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f52040ce1c0 0x7f52040c5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:46510/0 (socket says 172.21.15.18:46510) 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f5201e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 0x7f52040af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:36526/0 (socket says 172.21.15.18:36526) 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.118+0000 7f51f9400640 1 -- 172.21.15.18:0/3301734442 learned_addr learned my addr 172.21.15.18:0/3301734442 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5202800640 1 -- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 msgr2=0x7f52040af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5202800640 1 --2- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 0x7f52040af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5202800640 1 -- 172.21.15.18:0/3301734442 >> v1:172.21.15.167:6789/0 conn(0x7f52040ce1c0 legacy=0x7f52040c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5201400640 1 -- 172.21.15.18:0/3301734442 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187308561 0 0) 0x7f52040c6dc0 con 0x7f52040ce1c0 2024-04-25T10:08:23.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5202800640 1 -- 172.21.15.18:0/3301734442 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040c7380 con 0x7f52040c60a0 2024-04-25T10:08:23.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5202800640 1 --2- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041676d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009d90 tx=0x7f51fc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab70cad64668e0e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:23.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5201400640 1 -- 172.21.15.18:0/3301734442 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0b2070 con 0x7f52040c60a0 2024-04-25T10:08:23.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5201400640 1 -- 172.21.15.18:0/3301734442 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0a5940 con 0x7f52040c60a0 2024-04-25T10:08:23.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5201400640 1 -- 172.21.15.18:0/3301734442 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0a5d10 con 0x7f52040c60a0 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 -- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 msgr2=0x7f52041676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 --2- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041676d0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009d90 tx=0x7f51fc01c970 comp rx=0 tx=0).stop 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 -- 172.21.15.18:0/3301734442 shutdown_connections 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 --2- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041676d0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 --2- 172.21.15.18:0/3301734442 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520415dd00 0x7f52040af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 -- 172.21.15.18:0/3301734442 >> 172.21.15.18:0/3301734442 conn(0x7f52040b2240 msgr2=0x7f52040b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 -- 172.21.15.18:0/3301734442 shutdown_connections 2024-04-25T10:08:23.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.122+0000 7f5209200640 1 -- 172.21.15.18:0/3301734442 wait complete. 2024-04-25T10:08:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 Processor -- start 2024-04-25T10:08:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- start start 2024-04-25T10:08:23.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52041f7bd0 0x7f52041509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520416a7c0 con 0x7f52040ce1c0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520416a640 con 0x7f52040c60a0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520416a940 con 0x7f52041f7bd0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33230/0 (socket says 172.21.15.18:33230) 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 -- 172.21.15.18:0/1680587163 learned_addr learned my addr 172.21.15.18:0/1680587163 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5201e00640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5202800640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52041f7bd0 0x7f52041509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 -- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52041f7bd0 msgr2=0x7f52041509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52041f7bd0 0x7f52041509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 -- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 msgr2=0x7f52041f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 -- 172.21.15.18:0/1680587163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52041f9360 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5201e00640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51f9400640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0011f0 tx=0x7f51ec00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec018070 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0074e0 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041f9640 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec004a10 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.126+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040b32f0 con 0x7f52040ce1c0 2024-04-25T10:08:23.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040745d0 con 0x7f52040ce1c0 2024-04-25T10:08:23.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f51ec01b070 con 0x7f52040ce1c0 2024-04-25T10:08:23.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f51faa00640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 0x7f51e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:23.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5836+0+0 (secure 0 0 0) 0x7f51ec084510 con 0x7f52040ce1c0 2024-04-25T10:08:23.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f5201e00640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 0x7f51e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:23.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.130+0000 7f5201e00640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 0x7f51e0069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009b10 tx=0x7f51f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:23.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.134+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f51ec055400 con 0x7f52040ce1c0 2024-04-25T10:08:23.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.298+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52040cde60 con 0x7f52040ce1c0 2024-04-25T10:08:23.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.946+0000 7f51faa00640 1 -- 172.21.15.18:0/1680587163 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v72) v1 ==== 169+0+0 (secure 0 0 0) 0x7f51ec054d00 con 0x7f52040ce1c0 2024-04-25T10:08:23.955 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:08:23.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 msgr2=0x7f51e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 0x7f51e0069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f51f4009b10 tx=0x7f51f4008040 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 msgr2=0x7f5204150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0011f0 tx=0x7f51ec00c9b0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 shutdown_connections 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f60 0x7f51e0069420 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52041f7bd0 0x7f52041509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040ce1c0 0x7f5204150480 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 --2- 172.21.15.18:0/1680587163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52040c60a0 0x7f52041f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 >> 172.21.15.18:0/1680587163 conn(0x7f52040b2240 msgr2=0x7f52040b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 shutdown_connections 2024-04-25T10:08:23.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:23.950+0000 7f5209200640 1 -- 172.21.15.18:0/1680587163 wait complete. 2024-04-25T10:08:23.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:08:24.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.118+0000 7fbe3ea00640 1 Processor -- start 2024-04-25T10:08:24.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.118+0000 7fbe3ea00640 1 -- start start 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe3ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe38159320 0x7fbe3815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe3ea00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe3815fc00 con 0x7fbe3806e010 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe3ea00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe3806d640 con 0x7fbe38159320 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe3ea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3815fee0 con 0x7fbe3815f440 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe38159320 0x7fbe3815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe38159320 0x7fbe3815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33236/0 (socket says 172.21.15.18:33236) 2024-04-25T10:08:24.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 -- 172.21.15.18:0/3122876233 learned_addr learned my addr 172.21.15.18:0/3122876233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe2f400640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 -- 172.21.15.18:0/3122876233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 msgr2=0x7fbe3806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 -- 172.21.15.18:0/3122876233 >> v1:172.21.15.167:6789/0 conn(0x7fbe3806e010 legacy=0x7fbe3806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 -- 172.21.15.18:0/3122876233 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe381601c0 con 0x7fbe38159320 2024-04-25T10:08:24.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe2f400640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37e00640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe38159320 0x7fbe3815c9b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009870 tx=0x7fbe2801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b492fd3f6a177945 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37400640 1 -- 172.21.15.18:0/3122876233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280ab640 con 0x7fbe38159320 2024-04-25T10:08:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37400640 1 -- 172.21.15.18:0/3122876233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280b0070 con 0x7fbe38159320 2024-04-25T10:08:24.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.122+0000 7fbe37400640 1 -- 172.21.15.18:0/3122876233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280aba00 con 0x7fbe38159320 2024-04-25T10:08:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- 172.21.15.18:0/3122876233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe38159320 msgr2=0x7fbe3815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe38159320 0x7fbe3815c9b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe28009870 tx=0x7fbe2801c460 comp rx=0 tx=0).stop 2024-04-25T10:08:24.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- 172.21.15.18:0/3122876233 shutdown_connections 2024-04-25T10:08:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/3122876233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe38159320 0x7fbe3815c9b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- 172.21.15.18:0/3122876233 >> 172.21.15.18:0/3122876233 conn(0x7fbe38067080 msgr2=0x7fbe3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- 172.21.15.18:0/3122876233 shutdown_connections 2024-04-25T10:08:24.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- 172.21.15.18:0/3122876233 wait complete. 2024-04-25T10:08:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 Processor -- start 2024-04-25T10:08:24.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- start start 2024-04-25T10:08:24.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 0x7fbe381583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3815aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3815f9a0 con 0x7fbe3806e010 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3815f820 con 0x7fbe38159320 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3806ebb0 con 0x7fbe3815f440 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33242/0 (socket says 172.21.15.18:33242) 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 -- 172.21.15.18:0/4127333449 learned_addr learned my addr 172.21.15.18:0/4127333449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe2f400640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 0x7fbe381583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe3ca00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3815aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 -- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 msgr2=0x7fbe3815aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3815aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.126+0000 7fbe37e00640 1 -- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 msgr2=0x7fbe381583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe37e00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 0x7fbe381583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe37e00640 1 -- 172.21.15.18:0/4127333449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380b1700 con 0x7fbe3806e010 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 0x7fbe381583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe37e00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ad040 tx=0x7fbe2801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280be5f0 con 0x7fbe3806e010 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280abe50 con 0x7fbe3806e010 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe380b2400 con 0x7fbe3806e010 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe280be9f0 con 0x7fbe3806e010 2024-04-25T10:08:24.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe380b29c0 con 0x7fbe3806e010 2024-04-25T10:08:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe380b2ee0 con 0x7fbe3806e010 2024-04-25T10:08:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe280c7440 con 0x7fbe3806e010 2024-04-25T10:08:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 0x7fbe14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbe2811f800 con 0x7fbe3806e010 2024-04-25T10:08:24.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 0x7fbe14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.134+0000 7fbe2f400640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 0x7fbe14069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe20006fd0 tx=0x7fbe20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.134+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe380b1700 con 0x7fbe3806e010 2024-04-25T10:08:24.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.306+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbe380745d0 con 0x7fbe3806e010 2024-04-25T10:08:24.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.310+0000 7fbe34c00640 1 -- 172.21.15.18:0/4127333449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbe28016110 con 0x7fbe3806e010 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 msgr2=0x7fbe14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 0x7fbe14069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fbe20006fd0 tx=0x7fbe20008040 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 msgr2=0x7fbe380b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbe280ad040 tx=0x7fbe2801aca0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 shutdown_connections 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe14066f60 0x7fbe14069420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3815f440 0x7fbe3815aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe38159320 0x7fbe381583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 --2- 172.21.15.18:0/4127333449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3806e010 0x7fbe380b0ed0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 >> 172.21.15.18:0/4127333449 conn(0x7fbe38067080 msgr2=0x7fbe3815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 shutdown_connections 2024-04-25T10:08:24.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.314+0000 7fbe3ea00640 1 -- 172.21.15.18:0/4127333449 wait complete. 2024-04-25T10:08:24.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T10:08:24.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 Processor -- start 2024-04-25T10:08:24.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 -- start start 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb9b415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40cc4e0 con 0x7fb9b415fe50 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40ce040 con 0x7fb9b4145270 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9bb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4145650 con 0x7fb9b40b1e60 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9abe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb9b415fe50 0x7fb9b40b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53080/0 (socket says 172.21.15.18:53080) 2024-04-25T10:08:24.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9abe00640 1 -- 172.21.15.18:0/2342696881 learned_addr learned my addr 172.21.15.18:0/2342696881 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb9b415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548560048 0 0) 0x7fb9b40cc4e0 con 0x7fb9b415fe50 2024-04-25T10:08:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb998003530 con 0x7fb9b415fe50 2024-04-25T10:08:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.474+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220077655 0 0) 0x7fb9b40ce040 con 0x7fb9b4145270 2024-04-25T10:08:24.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b40cc4e0 con 0x7fb9b4145270 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626490377 0 0) 0x7fb998003530 con 0x7fb9b415fe50 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 msgr2=0x7fb9b415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb9b415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 >> v1:172.21.15.167:6789/0 conn(0x7fb9b4145270 legacy=0x7fb9b40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40ce320 con 0x7fb9b415fe50 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fb99c001680 con 0x7fb9b415fe50 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb9b415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 >> v1:172.21.15.18:6789/0 conn(0x7fb9b415fe50 legacy=0x7fb9b40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998003b80 0x7fb998003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb998004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb998004d50 0x7fb9980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4145650 con 0x7fb998004d50 2024-04-25T10:08:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99800ba80 con 0x7fb998003b80 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99800bc30 con 0x7fb9b40b1e60 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb998004d50 0x7fb9980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b8e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998003b80 0x7fb998003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9abe00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb998004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 -- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 msgr2=0x7fb998004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b40b1e60 0x7fb998004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 -- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998003b80 msgr2=0x7fb998003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998003b80 0x7fb998003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 -- 172.21.15.18:0/2342696881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb998003530 con 0x7fb998004d50 2024-04-25T10:08:24.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b8e00640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998003b80 0x7fb998003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:24.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb998004d50 0x7fb9980051d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e320 tx=0x7fb9ac01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76847c518deb65df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.478+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac009de0 con 0x7fb998004d50 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0a5dd0 con 0x7fb998004d50 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b3e00640 1 -- 172.21.15.18:0/2342696881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac003ba0 con 0x7fb998004d50 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- 172.21.15.18:0/2342696881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb998004d50 msgr2=0x7fb9980051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2342696881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb998004d50 0x7fb9980051d0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e320 tx=0x7fb9ac01cd60 comp rx=0 tx=0).stop 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 -- 172.21.15.18:0/2342696881 reap_dead start 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- 172.21.15.18:0/2342696881 shutdown_connections 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- 172.21.15.18:0/2342696881 >> 172.21.15.18:0/2342696881 conn(0x7fb9b4066fa0 msgr2=0x7fb9b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- 172.21.15.18:0/2342696881 shutdown_connections 2024-04-25T10:08:24.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- 172.21.15.18:0/2342696881 wait complete. 2024-04-25T10:08:24.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 Processor -- start 2024-04-25T10:08:24.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- start start 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998004d50 0x7fb9b415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 0x7fb9b415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b415f650 con 0x7fb9b40b2620 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b41602b0 con 0x7fb998004d50 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9bb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b415f930 con 0x7fb9b415bc10 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33264/0 (socket says 172.21.15.18:33264) 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 -- 172.21.15.18:0/2661214540 learned_addr learned my addr 172.21.15.18:0/2661214540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b8e00640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998004d50 0x7fb9b415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9abe00640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 0x7fb9b415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 -- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 msgr2=0x7fb9b415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 0x7fb9b415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 -- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998004d50 msgr2=0x7fb9b415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998004d50 0x7fb9b415b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9b9800640 1 -- 172.21.15.18:0/2661214540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b415c6d0 con 0x7fb9b40b2620 2024-04-25T10:08:24.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.482+0000 7fb9abe00640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 0x7fb9b415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:24.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b9800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0af040 tx=0x7fb998005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac009de0 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac009a50 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b415c9b0 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac0adb30 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b40a8c20 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b40a8730 con 0x7fb9b40b2620 2024-04-25T10:08:24.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb9ac0c0030 con 0x7fb9b40b2620 2024-04-25T10:08:24.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 0x7fb9900693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:24.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fb9ac120750 con 0x7fb9b40b2620 2024-04-25T10:08:24.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.486+0000 7fb9b8e00640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 0x7fb9900693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:24.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.490+0000 7fb9b8e00640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 0x7fb9900693c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4000c10 tx=0x7fb9a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:24.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.490+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9ac016ad0 con 0x7fb9b40b2620 2024-04-25T10:08:24.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.714+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7fb9b40745d0 con 0x7fb9b40b2620 2024-04-25T10:08:24.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.946+0000 7fb9b1600640 1 -- 172.21.15.18:0/2661214540 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v239) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb9ac0f1a60 con 0x7fb9b40b2620 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 msgr2=0x7fb9900693c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 0x7fb9900693c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb9a4000c10 tx=0x7fb9a4009040 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 msgr2=0x7fb9b40b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0af040 tx=0x7fb998005840 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 shutdown_connections 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9b40b2620 0x7fb9b40b2aa0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb990066f00 0x7fb9900693c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb9b415bc10 0x7fb9b415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 --2- 172.21.15.18:0/2661214540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb998004d50 0x7fb9b415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 >> 172.21.15.18:0/2661214540 conn(0x7fb9b4066fa0 msgr2=0x7fb9b40af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 shutdown_connections 2024-04-25T10:08:24.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:24.950+0000 7fb9bb800640 1 -- 172.21.15.18:0/2661214540 wait complete. 2024-04-25T10:08:24.979 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T10:08:24.979 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T10:08:24.979 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:08:24.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:25.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.110+0000 7f3134a00640 1 Processor -- start 2024-04-25T10:08:25.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.110+0000 7f3134a00640 1 -- start start 2024-04-25T10:08:25.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3134a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31300b08a0 0x7f313006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3134a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31300cf540 con 0x7f31300b18e0 2024-04-25T10:08:25.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3134a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313015b240 con 0x7f313006e980 2024-04-25T10:08:25.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3134a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31300ce350 con 0x7f31300b08a0 2024-04-25T10:08:25.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3127e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f31300b18e0 0x7f31300b0190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53082/0 (socket says 172.21.15.18:53082) 2024-04-25T10:08:25.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3127e00640 1 -- 172.21.15.18:0/1810946379 learned_addr learned my addr 172.21.15.18:0/1810946379 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31300b08a0 0x7f313006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718301721 0 0) 0x7f31300cf540 con 0x7f31300b18e0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3114003530 con 0x7f31300b18e0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649945324 0 0) 0x7f313015b240 con 0x7f313006e980 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31300cf540 con 0x7f313006e980 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117856105 0 0) 0x7f3114003530 con 0x7f31300b18e0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31300b08a0 msgr2=0x7f313006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31300b08a0 0x7f313006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 >> v1:172.21.15.167:6789/0 conn(0x7f313006e980 legacy=0x7f31300cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300ce630 con 0x7f31300b18e0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f3118001680 con 0x7f31300b18e0 2024-04-25T10:08:25.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 >> v1:172.21.15.18:6789/0 conn(0x7f31300b18e0 legacy=0x7f31300b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3114003b80 0x7f3114003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114004810 0x7f3114004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31140051d0 0x7f311400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300ce350 con 0x7f31140051d0 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311400c0a0 con 0x7f3114004810 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311400c2a0 con 0x7f3114003b80 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31140051d0 0x7f311400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312de00640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3114003b80 0x7f3114003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f3127e00640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114004810 0x7f3114004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 -- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3114003b80 msgr2=0x7f3114003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3114003b80 0x7f3114003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 -- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114004810 msgr2=0x7f3114004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114004810 0x7f3114004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.114+0000 7f312e800640 1 -- 172.21.15.18:0/1810946379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114003530 con 0x7f31140051d0 2024-04-25T10:08:25.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f312e800640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31140051d0 0x7f311400b9d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f313015b550 tx=0x7f312801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5238de82de817c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280b2070 con 0x7f31140051d0 2024-04-25T10:08:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31280a5bf0 con 0x7f31140051d0 2024-04-25T10:08:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f312d400640 1 -- 172.21.15.18:0/1810946379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128009bd0 con 0x7f31140051d0 2024-04-25T10:08:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 -- 172.21.15.18:0/1810946379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31140051d0 msgr2=0x7f311400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 --2- 172.21.15.18:0/1810946379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31140051d0 0x7f311400b9d0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f313015b550 tx=0x7f312801cbc0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f312e800640 1 -- 172.21.15.18:0/1810946379 reap_dead start 2024-04-25T10:08:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 -- 172.21.15.18:0/1810946379 shutdown_connections 2024-04-25T10:08:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 -- 172.21.15.18:0/1810946379 >> 172.21.15.18:0/1810946379 conn(0x7f3130066fa0 msgr2=0x7f313006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 -- 172.21.15.18:0/1810946379 shutdown_connections 2024-04-25T10:08:25.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.118+0000 7f3134a00640 1 -- 172.21.15.18:0/1810946379 wait complete. 2024-04-25T10:08:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 Processor -- start 2024-04-25T10:08:25.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- start start 2024-04-25T10:08:25.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 0x7f31301e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31301f5360 0x7f3130159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300b0ef0 con 0x7f31301f4ee0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31300b1d70 con 0x7f31140051d0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313015ae60 con 0x7f31301f5360 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33274/0 (socket says 172.21.15.18:33274) 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 -- 172.21.15.18:0/3968858865 learned_addr learned my addr 172.21.15.18:0/3968858865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f312de00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 0x7f31301e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f312e800640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31301f5360 0x7f3130159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 -- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31301f5360 msgr2=0x7f3130159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31301f5360 0x7f3130159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 -- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 msgr2=0x7f31301e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 0x7f31301e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 -- 172.21.15.18:0/3968858865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31301e7ce0 con 0x7f31301f4ee0 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f312de00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 0x7f31301e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:25.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3127e00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3118004ea0 tx=0x7f3118004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311801a070 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311800f6b0 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311800fa60 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31301f4420 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31301f49e0 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.122+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31300745d0 con 0x7f31301f4ee0 2024-04-25T10:08:25.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.126+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f311800fc00 con 0x7f31301f4ee0 2024-04-25T10:08:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.126+0000 7f3126000640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 0x7f310c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.126+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f31180846f0 con 0x7f31301f4ee0 2024-04-25T10:08:25.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.126+0000 7f312de00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 0x7f310c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.126+0000 7f312de00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 0x7f310c069420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3120005630 tx=0x7f312000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.130+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3118055860 con 0x7f31301f4ee0 2024-04-25T10:08:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.290+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31300afa90 con 0x7f31301f4ee0 2024-04-25T10:08:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3126000640 1 -- 172.21.15.18:0/3968858865 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+13270 (secure 0 0 0) 0x7f3118055160 con 0x7f31301f4ee0 2024-04-25T10:08:25.301 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:25.301 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":72,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:23.944493+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/343490040":"2024-04-26T10:08:20.673143+0000","172.21.15.167:6835/343490040":"2024-04-26T10:08:20.673143+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 msgr2=0x7f310c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 0x7f310c069420 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3120005630 tx=0x7f312000b040 comp rx=0 tx=0).stop 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 msgr2=0x7f31301593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3118004ea0 tx=0x7f3118004f90 comp rx=0 tx=0).stop 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 shutdown_connections 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f310c066f60 0x7f310c069420 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31301f5360 0x7f3130159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31301f4ee0 0x7f31301593c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 --2- 172.21.15.18:0/3968858865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31140051d0 0x7f31301e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 >> 172.21.15.18:0/3968858865 conn(0x7f3130066fa0 msgr2=0x7f31301e3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 shutdown_connections 2024-04-25T10:08:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.294+0000 7f3134a00640 1 -- 172.21.15.18:0/3968858865 wait complete. 2024-04-25T10:08:25.323 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:25.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 Processor -- start 2024-04-25T10:08:25.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 -- start start 2024-04-25T10:08:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 0x7f74bc06e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc15fc00 con 0x7f74bc159320 2024-04-25T10:08:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74bc15fee0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c4800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc06ee50 con 0x7f74bc06e4a0 2024-04-25T10:08:25.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c1e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f74bc159320 0x7f74bc15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53098/0 (socket says 172.21.15.18:53098) 2024-04-25T10:08:25.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c1e00640 1 -- 172.21.15.18:0/3207789387 learned_addr learned my addr 172.21.15.18:0/3207789387 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:25.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.458+0000 7f74c2800640 1 --2- 172.21.15.18:0/3207789387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 0x7f74bc06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c0a00640 1 -- 172.21.15.18:0/3207789387 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1072414736 0 0) 0x7f74bc15fc00 con 0x7f74bc159320 2024-04-25T10:08:25.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c0a00640 1 -- 172.21.15.18:0/3207789387 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74a4003530 con 0x7f74bc159320 2024-04-25T10:08:25.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c2800640 1 -- 172.21.15.18:0/3207789387 >> v1:172.21.15.167:6789/0 conn(0x7f74bc15c9b0 legacy=0x7f74bc06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c2800640 1 -- 172.21.15.18:0/3207789387 >> v1:172.21.15.18:6789/0 conn(0x7f74bc159320 legacy=0x7f74bc15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c2800640 1 -- 172.21.15.18:0/3207789387 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc1601c0 con 0x7f74bc06e4a0 2024-04-25T10:08:25.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c2800640 1 --2- 172.21.15.18:0/3207789387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 0x7f74bc06e910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009dc0 tx=0x7f74b801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3878adb213ee93c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c0a00640 1 -- 172.21.15.18:0/3207789387 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80b2070 con 0x7f74bc06e4a0 2024-04-25T10:08:25.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c0a00640 1 -- 172.21.15.18:0/3207789387 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80a5850 con 0x7f74bc06e4a0 2024-04-25T10:08:25.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.462+0000 7f74c0a00640 1 -- 172.21.15.18:0/3207789387 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80a5c20 con 0x7f74bc06e4a0 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- 172.21.15.18:0/3207789387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 msgr2=0x7f74bc06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 --2- 172.21.15.18:0/3207789387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 0x7f74bc06e910 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009dc0 tx=0x7f74b801c990 comp rx=0 tx=0).stop 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- 172.21.15.18:0/3207789387 shutdown_connections 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 --2- 172.21.15.18:0/3207789387 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc06e4a0 0x7f74bc06e910 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- 172.21.15.18:0/3207789387 >> 172.21.15.18:0/3207789387 conn(0x7f74bc067080 msgr2=0x7f74bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:25.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- 172.21.15.18:0/3207789387 shutdown_connections 2024-04-25T10:08:25.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- 172.21.15.18:0/3207789387 wait complete. 2024-04-25T10:08:25.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 Processor -- start 2024-04-25T10:08:25.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- start start 2024-04-25T10:08:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 0x7f74bc13d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc159320 0x7f74bc15dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc169720 con 0x7f74bc15c9b0 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1695a0 con 0x7f74bc06e4a0 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c4800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74bc1698a0 con 0x7f74bc159320 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33284/0 (socket says 172.21.15.18:33284) 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 -- 172.21.15.18:0/832772629 learned_addr learned my addr 172.21.15.18:0/832772629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c1e00640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 0x7f74bc13d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c1400640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc159320 0x7f74bc15dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 -- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc159320 msgr2=0x7f74bc15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc159320 0x7f74bc15dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 -- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 msgr2=0x7f74bc13d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 0x7f74bc13d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 -- 172.21.15.18:0/832772629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc1435c0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c1e00640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 0x7f74bc13d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:25.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.466+0000 7f74c2800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f74b801a5c0 tx=0x7f74b8019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80b2050 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80be070 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80ad850 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74bc1438a0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74bc143e60 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74bc0745d0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f74b80ad9f0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 0x7f74a0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f74b811ff50 con 0x7f74bc15c9b0 2024-04-25T10:08:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.470+0000 7f74c1e00640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 0x7f74a0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.474+0000 7f74c1e00640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 0x7f74a0069470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011f0 tx=0x7f74b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.474+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f74b8016580 con 0x7f74bc15c9b0 2024-04-25T10:08:25.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74bc06c250 con 0x7f74bc15c9b0 2024-04-25T10:08:25.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74b6000640 1 -- 172.21.15.18:0/832772629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74b80f11d0 con 0x7f74bc15c9b0 2024-04-25T10:08:25.647 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 msgr2=0x7f74a0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 0x7f74a0069470 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f74b00011f0 tx=0x7f74b0009040 comp rx=0 tx=0).stop 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 msgr2=0x7f74bc15e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.638+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f74b801a5c0 tx=0x7f74b8019730 comp rx=0 tx=0).stop 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 shutdown_connections 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74bc15c9b0 0x7f74bc15e510 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f74a0066fb0 0x7f74a0069470 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f74bc159320 0x7f74bc15dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 --2- 172.21.15.18:0/832772629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74bc06e4a0 0x7f74bc13d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 >> 172.21.15.18:0/832772629 conn(0x7f74bc067080 msgr2=0x7f74bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:25.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 shutdown_connections 2024-04-25T10:08:25.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.642+0000 7f74c4800640 1 -- 172.21.15.18:0/832772629 wait complete. 2024-04-25T10:08:25.668 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T10:08:25.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 Processor -- start 2024-04-25T10:08:25.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 -- start start 2024-04-25T10:08:25.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbacc15da10 0x7fbacc0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0d11b0 0x7fbacc06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbacc15ddf0 con 0x7fbacc0b4210 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc06b480 con 0x7fbacc0d11b0 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbad2600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbacc0d06d0 con 0x7fbacc15da10 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0d11b0 0x7fbacc06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbacc0d11b0 0x7fbacc06ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33294/0 (socket says 172.21.15.18:33294) 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 -- 172.21.15.18:0/3797020514 learned_addr learned my addr 172.21.15.18:0/3797020514 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbacb400640 1 --2- 172.21.15.18:0/3797020514 >> v2:172.21.15.167:3300/0 conn(0x7fbacc15da10 0x7fbacc0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 -- 172.21.15.18:0/3797020514 >> v2:172.21.15.167:3300/0 conn(0x7fbacc15da10 msgr2=0x7fbacc0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 --2- 172.21.15.18:0/3797020514 >> v2:172.21.15.167:3300/0 conn(0x7fbacc15da10 0x7fbacc0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 -- 172.21.15.18:0/3797020514 >> v1:172.21.15.167:6789/0 conn(0x7fbacc0b4210 legacy=0x7fbacc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:25.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.802+0000 7fbac2a00640 1 -- 172.21.15.18:0/3797020514 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc0d09b0 con 0x7fbacc0d11b0 2024-04-25T10:08:25.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbac2a00640 1 --2- 172.21.15.18:0/3797020514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0d11b0 0x7fbacc06ac10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0684f0 tx=0x7fbab401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a354b9f191b399d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbacaa00640 1 -- 172.21.15.18:0/3797020514 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40b0070 con 0x7fbacc0d11b0 2024-04-25T10:08:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbacaa00640 1 -- 172.21.15.18:0/3797020514 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbab40ab600 con 0x7fbacc0d11b0 2024-04-25T10:08:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbacaa00640 1 -- 172.21.15.18:0/3797020514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbab40ab9d0 con 0x7fbacc0d11b0 2024-04-25T10:08:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 -- 172.21.15.18:0/3797020514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0d11b0 msgr2=0x7fbacc06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 --2- 172.21.15.18:0/3797020514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0d11b0 0x7fbacc06ac10 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0684f0 tx=0x7fbab401c450 comp rx=0 tx=0).stop 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 -- 172.21.15.18:0/3797020514 shutdown_connections 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 --2- 172.21.15.18:0/3797020514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc0d11b0 0x7fbacc06ac10 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 --2- 172.21.15.18:0/3797020514 >> v2:172.21.15.167:3300/0 conn(0x7fbacc15da10 0x7fbacc0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 -- 172.21.15.18:0/3797020514 >> 172.21.15.18:0/3797020514 conn(0x7fbacc0b2400 msgr2=0x7fbacc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 -- 172.21.15.18:0/3797020514 shutdown_connections 2024-04-25T10:08:25.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.806+0000 7fbad2600640 1 -- 172.21.15.18:0/3797020514 wait complete. 2024-04-25T10:08:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 Processor -- start 2024-04-25T10:08:25.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- start start 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbacc0b4210 0x7fbacc13ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc0d11b0 0x7fbacc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc162190 con 0x7fbacc15da10 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc162010 con 0x7fbacc0d11b0 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc162310 con 0x7fbacc0b4210 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33306/0 (socket says 172.21.15.18:33306) 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 -- 172.21.15.18:0/1230257772 learned_addr learned my addr 172.21.15.18:0/1230257772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:25.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacb400640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbacc0b4210 0x7fbacc13ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbac2a00640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc0d11b0 0x7fbacc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 -- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbacc0b4210 msgr2=0x7fbacc13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbacc0b4210 0x7fbacc13ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 -- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc0d11b0 msgr2=0x7fbacc0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:25.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc0d11b0 0x7fbacc0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 -- 172.21.15.18:0/1230257772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc140510 con 0x7fbacc15da10 2024-04-25T10:08:25.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbacbe00640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbac400b970 tx=0x7fbac400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4019070 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac400cae0 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac4014440 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbacc157120 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbacc1576e0 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.810+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbacc0745d0 con 0x7fbacc15da10 2024-04-25T10:08:25.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.814+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbac401c070 con 0x7fbacc15da10 2024-04-25T10:08:25.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.814+0000 7fbac3e00640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 0x7fbaa8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:25.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.814+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbac40849c0 con 0x7fbacc15da10 2024-04-25T10:08:25.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.814+0000 7fbacb400640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 0x7fbaa8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:25.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.814+0000 7fbacb400640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 0x7fbaa8069420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbabc007a60 tx=0x7fbabc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:25.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:25.818+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbac40554e0 con 0x7fbacc15da10 2024-04-25T10:08:26.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.038+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7fbacc0d04b0 con 0x7fbacc15da10 2024-04-25T10:08:26.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.954+0000 7fbac3e00640 1 -- 172.21.15.18:0/1230257772 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v241) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbac4059580 con 0x7fbacc15da10 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 msgr2=0x7fbaa8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 0x7fbaa8069420 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbabc007a60 tx=0x7fbabc008040 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 msgr2=0x7fbacc14e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbac400b970 tx=0x7fbac400be30 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 shutdown_connections 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbacc15da10 0x7fbacc14e280 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbacc0d11b0 0x7fbacc0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaa8066f60 0x7fbaa8069420 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 --2- 172.21.15.18:0/1230257772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbacc0b4210 0x7fbacc13ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 >> 172.21.15.18:0/1230257772 conn(0x7fbacc0b2400 msgr2=0x7fbacc06fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:26.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 shutdown_connections 2024-04-25T10:08:26.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:26.958+0000 7fbad2600640 1 -- 172.21.15.18:0/1230257772 wait complete. 2024-04-25T10:08:26.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:08:27.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.130+0000 7fa265200640 1 Processor -- start 2024-04-25T10:08:27.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.130+0000 7fa265200640 1 -- start start 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.130+0000 7fa265200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa26006e4a0 0x7fa26006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.130+0000 7fa265200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015fc00 con 0x7fa260159320 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa265200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015fee0 con 0x7fa26015c9b0 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa265200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006d640 con 0x7fa26006e4a0 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25de00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa260159320 0x7fa26015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53106/0 (socket says 172.21.15.18:53106) 2024-04-25T10:08:27.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25de00640 1 -- 172.21.15.18:0/3075135126 learned_addr learned my addr 172.21.15.18:0/3075135126 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 --2- 172.21.15.18:0/3075135126 >> v2:172.21.15.167:3300/0 conn(0x7fa26006e4a0 0x7fa26006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802058055 0 0) 0x7fa26015fc00 con 0x7fa260159320 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa244003530 con 0x7fa260159320 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 325590133 0 0) 0x7fa244003530 con 0x7fa260159320 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 >> v2:172.21.15.167:3300/0 conn(0x7fa26006e4a0 msgr2=0x7fa26006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 --2- 172.21.15.18:0/3075135126 >> v2:172.21.15.167:3300/0 conn(0x7fa26006e4a0 0x7fa26006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 >> v1:172.21.15.167:6789/0 conn(0x7fa26015c9b0 legacy=0x7fa26006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2601601c0 con 0x7fa260159320 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fa250001680 con 0x7fa260159320 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 >> v1:172.21.15.18:6789/0 conn(0x7fa260159320 legacy=0x7fa26015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440039c0 0x7fa244003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2440043e0 0x7fa2440048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 0x7fa24400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26006d640 con 0x7fa2440050b0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400bff0 con 0x7fa2440039c0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa24400c1f0 con 0x7fa2440043e0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 0x7fa24400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa257e00640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2440043e0 0x7fa2440048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25de00640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440039c0 0x7fa244003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 -- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2440043e0 msgr2=0x7fa2440048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2440043e0 0x7fa2440048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 -- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440039c0 msgr2=0x7fa244003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440039c0 0x7fa244003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.134+0000 7fa25e800640 1 -- 172.21.15.18:0/3075135126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244003530 con 0x7fa2440050b0 2024-04-25T10:08:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa25e800640 1 -- 172.21.15.18:0/3075135126 reap_dead start 2024-04-25T10:08:27.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa25e800640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 0x7fa24400b9d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fc0 tx=0x7fa25801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e04bd195a247f61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258009c10 con 0x7fa2440050b0 2024-04-25T10:08:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580a5d10 con 0x7fa2440050b0 2024-04-25T10:08:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa25d400640 1 -- 172.21.15.18:0/3075135126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258003be0 con 0x7fa2440050b0 2024-04-25T10:08:27.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 msgr2=0x7fa24400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 0x7fa24400b9d0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa258009fc0 tx=0x7fa25801ccc0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- 172.21.15.18:0/3075135126 shutdown_connections 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 --2- 172.21.15.18:0/3075135126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2440050b0 0x7fa24400b9d0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- 172.21.15.18:0/3075135126 >> 172.21.15.18:0/3075135126 conn(0x7fa260067080 msgr2=0x7fa26006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- 172.21.15.18:0/3075135126 shutdown_connections 2024-04-25T10:08:27.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- 172.21.15.18:0/3075135126 wait complete. 2024-04-25T10:08:27.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 Processor -- start 2024-04-25T10:08:27.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.138+0000 7fa265200640 1 -- start start 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440050b0 0x7fa260141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa260152d30 0x7fa2601e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26006e8d0 con 0x7fa2601e7f00 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260159700 con 0x7fa2440050b0 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26006ea50 con 0x7fa260152d30 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33322/0 (socket says 172.21.15.18:33322) 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 -- 172.21.15.18:0/350648552 learned_addr learned my addr 172.21.15.18:0/350648552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25de00640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440050b0 0x7fa260141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa257e00640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa260152d30 0x7fa2601e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 -- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa260152d30 msgr2=0x7fa2601e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa260152d30 0x7fa2601e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 -- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440050b0 msgr2=0x7fa260141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440050b0 0x7fa260141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 -- 172.21.15.18:0/350648552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26013eb80 con 0x7fa2601e7f00 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa25e800640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa25801d1a0 tx=0x7fa258009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258009c10 con 0x7fa2601e7f00 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2580bd070 con 0x7fa2601e7f00 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258003db0 con 0x7fa2601e7f00 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260153680 con 0x7fa2601e7f00 2024-04-25T10:08:27.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260153c40 con 0x7fa2601e7f00 2024-04-25T10:08:27.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600745d0 con 0x7fa2601e7f00 2024-04-25T10:08:27.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.142+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2580ae8d0 con 0x7fa2601e7f00 2024-04-25T10:08:27.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.146+0000 7fa256000640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 0x7fa23c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.146+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa2581205a0 con 0x7fa2601e7f00 2024-04-25T10:08:27.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.146+0000 7fa25de00640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 0x7fa23c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.146+0000 7fa25de00640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 0x7fa23c069420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa250001060 tx=0x7fa250007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.150+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2580169d0 con 0x7fa2601e7f00 2024-04-25T10:08:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.310+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa26015c2d0 con 0x7fa2601e7f00 2024-04-25T10:08:27.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.314+0000 7fa256000640 1 -- 172.21.15.18:0/350648552 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2580f15f0 con 0x7fa2601e7f00 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 msgr2=0x7fa23c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 0x7fa23c069420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa250001060 tx=0x7fa250007900 comp rx=0 tx=0).stop 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 msgr2=0x7fa26015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa25801d1a0 tx=0x7fa258009750 comp rx=0 tx=0).stop 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 shutdown_connections 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2601e7f00 0x7fa26015db60 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa23c066f60 0x7fa23c069420 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa260152d30 0x7fa2601e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 --2- 172.21.15.18:0/350648552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2440050b0 0x7fa260141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 >> 172.21.15.18:0/350648552 conn(0x7fa260067080 msgr2=0x7fa260158180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 shutdown_connections 2024-04-25T10:08:27.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.318+0000 7fa265200640 1 -- 172.21.15.18:0/350648552 wait complete. 2024-04-25T10:08:27.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:08:27.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:08:27.443 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:08:27.500 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:08:27.500 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:27.500 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:27.509 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:08:27.509 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:08:27.509 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:27.518 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:08:27.519 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:27.519 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:27.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:08:27.560 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:08:27.560 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:27.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:08:27.572 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:08:27.573 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:27.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.734+0000 7fe923000640 1 Processor -- start 2024-04-25T10:08:27.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.734+0000 7fe923000640 1 -- start start 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe923000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe91c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe923000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c06edc0 con 0x7fe91c06dad0 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe923000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe91c15def0 con 0x7fe91c0b2dc0 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe923000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c15e1b0 con 0x7fe91c15b2f0 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe921000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe91c06dad0 0x7fe91c06e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53122/0 (socket says 172.21.15.18:53122) 2024-04-25T10:08:27.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe921000640 1 -- 172.21.15.18:0/2905830270 learned_addr learned my addr 172.21.15.18:0/2905830270 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345019474 0 0) 0x7fe91c06edc0 con 0x7fe91c06dad0 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91be00640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe91c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe900003530 con 0x7fe91c06dad0 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 593947619 0 0) 0x7fe900003530 con 0x7fe91c06dad0 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 msgr2=0x7fe91c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe91c0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 >> v1:172.21.15.167:6789/0 conn(0x7fe91c0b2dc0 legacy=0x7fe91c06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c15e490 con 0x7fe91c06dad0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fe914001680 con 0x7fe91c06dad0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 >> v1:172.21.15.18:6789/0 conn(0x7fe91c06dad0 legacy=0x7fe91c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe9000039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe900004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe900004d50 0x7fe9000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c15e1b0 con 0x7fe900003f30 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90000ba30 con 0x7fe900004d50 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90000bc30 con 0x7fe91c15b2f0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe900004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe91be00640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe9000039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe921000640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe900004d50 0x7fe9000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 -- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 msgr2=0x7fe9000039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c15b2f0 0x7fe9000039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 -- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe900004d50 msgr2=0x7fe9000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:27.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe900004d50 0x7fe9000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.738+0000 7fe913400640 1 -- 172.21.15.18:0/2905830270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900003530 con 0x7fe900003f30 2024-04-25T10:08:27.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe913400640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe900004810 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe904001860 tx=0x7fe90401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c31f0e574ddd51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9040b0070 con 0x7fe900003f30 2024-04-25T10:08:27.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9040ab600 con 0x7fe900003f30 2024-04-25T10:08:27.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe91b400640 1 -- 172.21.15.18:0/2905830270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904001460 con 0x7fe900003f30 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 -- 172.21.15.18:0/2905830270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 msgr2=0x7fe900004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 --2- 172.21.15.18:0/2905830270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe900004810 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe904001860 tx=0x7fe90401c410 comp rx=0 tx=0).stop 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe921000640 1 -- 172.21.15.18:0/2905830270 reap_dead start 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 -- 172.21.15.18:0/2905830270 shutdown_connections 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 -- 172.21.15.18:0/2905830270 >> 172.21.15.18:0/2905830270 conn(0x7fe91c0b23b0 msgr2=0x7fe91c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 -- 172.21.15.18:0/2905830270 shutdown_connections 2024-04-25T10:08:27.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.742+0000 7fe923000640 1 -- 172.21.15.18:0/2905830270 wait complete. 2024-04-25T10:08:27.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 Processor -- start 2024-04-25T10:08:27.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- start start 2024-04-25T10:08:27.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c144650 0x7fe91c1419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe91c140e90 0x7fe91c141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c1614e0 con 0x7fe900003f30 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c15b8e0 con 0x7fe91c140e90 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91c161660 con 0x7fe91c144650 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33340/0 (socket says 172.21.15.18:33340) 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 -- 172.21.15.18:0/157519147 learned_addr learned my addr 172.21.15.18:0/157519147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe913400640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c144650 0x7fe91c1419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe921000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe91c140e90 0x7fe91c141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 -- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c144650 msgr2=0x7fe91c1419c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c144650 0x7fe91c1419c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 -- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe91c140e90 msgr2=0x7fe91c141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe91c140e90 0x7fe91c141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 -- 172.21.15.18:0/157519147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c1437f0 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe91be00640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe90c011e30 tx=0x7fe90c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c015630 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0157d0 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c015ba0 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91c142210 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe91c1427d0 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.746+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe91c142ef0 con 0x7fe900003f30 2024-04-25T10:08:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.750+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe90c01d400 con 0x7fe900003f30 2024-04-25T10:08:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.750+0000 7fe918c00640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 0x7fe8f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.750+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe90c085fd0 con 0x7fe900003f30 2024-04-25T10:08:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.750+0000 7fe913400640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 0x7fe8f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.750+0000 7fe913400640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 0x7fe8f8069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe9040a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.754+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe90c019030 con 0x7fe900003f30 2024-04-25T10:08:27.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe91c0d0ab0 con 0x7fe900003f30 2024-04-25T10:08:27.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe918c00640 1 -- 172.21.15.18:0/157519147 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3703 (secure 0 0 0) 0x7fe90c010040 con 0x7fe900003f30 2024-04-25T10:08:27.962 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:27.962 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5947,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2470042450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2470042450},{"type":"v1","addr":"172.21.15.167:6836","nonce":2470042450}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":6204,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/3921602799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3921602799},{"type":"v1","addr":"172.21.15.18:6833","nonce":3921602799}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":29},{"gid":6219,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/860616994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":860616994},{"type":"v1","addr":"172.21.15.18:6835","nonce":860616994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":35783,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/4125700245","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":4125700245},{"type":"v1","addr":"172.21.15.167:6837","nonce":4125700245}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":40}],"filesystems":[]} 2024-04-25T10:08:27.962 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 40 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 msgr2=0x7fe8f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 0x7fe8f8069420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe9040ad000 tx=0x7fe9040a6000 comp rx=0 tx=0).stop 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 msgr2=0x7fe91c1432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe90c011e30 tx=0x7fe90c00f580 comp rx=0 tx=0).stop 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 shutdown_connections 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe91c140e90 0x7fe91c141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe8f8066f60 0x7fe8f8069420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe91c144650 0x7fe91c1419c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 --2- 172.21.15.18:0/157519147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe900003f30 0x7fe91c1432b0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 >> 172.21.15.18:0/157519147 conn(0x7fe91c0b23b0 msgr2=0x7fe91c0d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 shutdown_connections 2024-04-25T10:08:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:27.954+0000 7fe923000640 1 -- 172.21.15.18:0/157519147 wait complete. 2024-04-25T10:08:27.985 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:08:27.985 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:08:27.985 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:08:27.985 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:08:27.985 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:08:27.986 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:08:27.986 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:08:27.986 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:08:27.986 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:08:27.986 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:08:27.986 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:08:27.986 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:08:27.987 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:08:27.987 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:08:27.987 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:08:27.987 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:08:27.997 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:08:27.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:08:27.998 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:08:27.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:08:28.003 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:08:28.003 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:08:28.004 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:08:28.004 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:08:28.047 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:08:28.048 DEBUG:teuthology.parallel:result is None 2024-04-25T10:08:28.048 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:08:28.048 DEBUG:teuthology.parallel:result is None 2024-04-25T10:08:28.049 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:08:28.049 DEBUG:teuthology.parallel:result is None 2024-04-25T10:08:28.050 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:08:28.050 DEBUG:teuthology.parallel:result is None 2024-04-25T10:08:28.050 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:08:28.136 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:08:28.136 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:08:28.138 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:08:28.139 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:08:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 Processor -- start 2024-04-25T10:08:28.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 -- start start 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 0x7fbf0c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c15fc00 con 0x7fbf0c06e010 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0c15fee0 con 0x7fbf0c159320 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf12e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c06d640 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf10e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbf0c06e010 0x7fbf0c06e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53126/0 (socket says 172.21.15.18:53126) 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf10e00640 1 -- 172.21.15.18:0/599708817 learned_addr learned my addr 172.21.15.18:0/599708817 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.186+0000 7fbf03400640 1 --2- 172.21.15.18:0/599708817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 0x7fbf0c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613838592 0 0) 0x7fbf0c15fc00 con 0x7fbf0c06e010 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbef0003530 con 0x7fbf0c06e010 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094680792 0 0) 0x7fbf0c15fee0 con 0x7fbf0c159320 2024-04-25T10:08:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf0c15fc00 con 0x7fbf0c159320 2024-04-25T10:08:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf03400640 1 -- 172.21.15.18:0/599708817 >> v1:172.21.15.167:6789/0 conn(0x7fbf0c159320 legacy=0x7fbf0c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf03400640 1 -- 172.21.15.18:0/599708817 >> v1:172.21.15.18:6789/0 conn(0x7fbf0c06e010 legacy=0x7fbf0c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:28.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf03400640 1 -- 172.21.15.18:0/599708817 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c1601c0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf03400640 1 --2- 172.21.15.18:0/599708817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 0x7fbf0c06dad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbef40097f0 tx=0x7fbef401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd2e9e17aa631c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40ab5f0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef40b0070 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.190+0000 7fbf0b400640 1 -- 172.21.15.18:0/599708817 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef40ab9b0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- 172.21.15.18:0/599708817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 msgr2=0x7fbf0c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 --2- 172.21.15.18:0/599708817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 0x7fbf0c06dad0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbef40097f0 tx=0x7fbef401c4e0 comp rx=0 tx=0).stop 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- 172.21.15.18:0/599708817 shutdown_connections 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 --2- 172.21.15.18:0/599708817 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c15c9b0 0x7fbf0c06dad0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- 172.21.15.18:0/599708817 >> 172.21.15.18:0/599708817 conn(0x7fbf0c067080 msgr2=0x7fbf0c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- 172.21.15.18:0/599708817 shutdown_connections 2024-04-25T10:08:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- 172.21.15.18:0/599708817 wait complete. 2024-04-25T10:08:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 Processor -- start 2024-04-25T10:08:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- start start 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf0c06e010 0x7fbf0c1409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c159320 0x7fbf0c140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c06ed30 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c06ebb0 con 0x7fbf0c06e010 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf12e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c1695a0 con 0x7fbf0c159320 2024-04-25T10:08:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33358/0 (socket says 172.21.15.18:33358) 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 -- 172.21.15.18:0/2918119510 learned_addr learned my addr 172.21.15.18:0/2918119510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf0be00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf0c06e010 0x7fbf0c1409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf03400640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c159320 0x7fbf0c140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 -- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c159320 msgr2=0x7fbf0c140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c159320 0x7fbf0c140130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 -- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf0c06e010 msgr2=0x7fbf0c1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf0c06e010 0x7fbf0c1409d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 -- 172.21.15.18:0/2918119510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c141250 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.194+0000 7fbf10e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400caa0 tx=0x7fbf0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04017070 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0400aba0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c0af3f0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04012400 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c0af6b0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c0745d0 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf0401a070 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 0x7fbee8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fbf04084b90 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.198+0000 7fbf0be00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 0x7fbee8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.202+0000 7fbf0be00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 0x7fbee8069450 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0011f0 tx=0x7fbefc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.202+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf0c141250 con 0x7fbf0c15c9b0 2024-04-25T10:08:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:28.382+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbf0c143910 con 0x7fbf0c15c9b0 2024-04-25T10:08:29.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf08c00640 1 -- 172.21.15.18:0/2918119510 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbf04055620 con 0x7fbf0c15c9b0 2024-04-25T10:08:29.345 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 msgr2=0x7fbee8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 0x7fbee8069450 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0011f0 tx=0x7fbefc009040 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 msgr2=0x7fbf0c0acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400caa0 tx=0x7fbf0400cf60 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 shutdown_connections 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0c15c9b0 0x7fbf0c0acb60 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbee8066f90 0x7fbee8069450 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbf0c159320 0x7fbf0c140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 --2- 172.21.15.18:0/2918119510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf0c06e010 0x7fbf0c1409d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.338+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 >> 172.21.15.18:0/2918119510 conn(0x7fbf0c067080 msgr2=0x7fbf0c15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:29.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.342+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 shutdown_connections 2024-04-25T10:08:29.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.342+0000 7fbf12e00640 1 -- 172.21.15.18:0/2918119510 wait complete. 2024-04-25T10:08:29.371 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:08:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.506+0000 7f3879400640 1 Processor -- start 2024-04-25T10:08:29.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.506+0000 7f3879400640 1 -- start start 2024-04-25T10:08:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3879400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3879400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 0x7f387406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3879400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387415ac60 con 0x7f387406e900 2024-04-25T10:08:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3879400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387406ed70 con 0x7f38740ced60 2024-04-25T10:08:29.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3879400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38740cf3e0 con 0x7f3874144140 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3869e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 0x7f387406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3873200640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f387406e900 0x7f387415e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:46612/0 (socket says 172.21.15.18:46612) 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:36734/0 (socket says 172.21.15.18:36734) 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 -- 172.21.15.18:0/2487924078 learned_addr learned my addr 172.21.15.18:0/2487924078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:29.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3869e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 0x7f387406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:44914/0 (socket says 172.21.15.18:44914) 2024-04-25T10:08:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 -- 172.21.15.18:0/2487924078 >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 msgr2=0x7f387406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 --2- 172.21.15.18:0/2487924078 >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 0x7f387406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 -- 172.21.15.18:0/2487924078 >> v1:172.21.15.167:6789/0 conn(0x7f387406e900 legacy=0x7f387415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.510+0000 7f3872800640 1 -- 172.21.15.18:0/2487924078 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387415af20 con 0x7f3874144140 2024-04-25T10:08:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3872800640 1 --2- 172.21.15.18:0/2487924078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5535c1052350b872 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3871e00640 1 -- 172.21.15.18:0/2487924078 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b0070 con 0x7f3874144140 2024-04-25T10:08:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3871e00640 1 -- 172.21.15.18:0/2487924078 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640ab600 con 0x7f3874144140 2024-04-25T10:08:29.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3871e00640 1 -- 172.21.15.18:0/2487924078 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640ab9d0 con 0x7f3874144140 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- 172.21.15.18:0/2487924078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 msgr2=0x7f38740ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 --2- 172.21.15.18:0/2487924078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3864009870 tx=0x7f386401c560 comp rx=0 tx=0).stop 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- 172.21.15.18:0/2487924078 shutdown_connections 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 --2- 172.21.15.18:0/2487924078 >> v2:172.21.15.167:3300/0 conn(0x7f38740ced60 0x7f387406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 --2- 172.21.15.18:0/2487924078 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3874144140 0x7f38740ce820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- 172.21.15.18:0/2487924078 >> 172.21.15.18:0/2487924078 conn(0x7f3874066fa0 msgr2=0x7f387406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- 172.21.15.18:0/2487924078 shutdown_connections 2024-04-25T10:08:29.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- 172.21.15.18:0/2487924078 wait complete. 2024-04-25T10:08:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 Processor -- start 2024-04-25T10:08:29.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.514+0000 7f3879400640 1 -- start start 2024-04-25T10:08:29.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387406e900 0x7f3874138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874144140 0x7f38741430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3874144520 con 0x7f38740ced60 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38740cf140 con 0x7f3874144140 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387415ba00 con 0x7f387406e900 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33370/0 (socket says 172.21.15.18:33370) 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 -- 172.21.15.18:0/616660692 learned_addr learned my addr 172.21.15.18:0/616660692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3873200640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874144140 0x7f38741430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3872800640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387406e900 0x7f3874138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 -- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387406e900 msgr2=0x7f3874138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387406e900 0x7f3874138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 -- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874144140 msgr2=0x7f38741430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874144140 0x7f38741430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 -- 172.21.15.18:0/616660692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387413b160 con 0x7f38740ced60 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3869e00640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e930 tx=0x7f385c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c017070 con 0x7f38740ced60 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00ca00 con 0x7f38740ced60 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387413a8c0 con 0x7f38740ced60 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00cdb0 con 0x7f38740ced60 2024-04-25T10:08:29.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387413ae80 con 0x7f38740ced60 2024-04-25T10:08:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38740745d0 con 0x7f38740ced60 2024-04-25T10:08:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.518+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f385c01a070 con 0x7f38740ced60 2024-04-25T10:08:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.522+0000 7f386b400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 0x7f3850069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.522+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f385c084e90 con 0x7f38740ced60 2024-04-25T10:08:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.522+0000 7f3872800640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 0x7f3850069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.522+0000 7f3872800640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 0x7f3850069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f38640ad000 tx=0x7f38640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.526+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f385c055a30 con 0x7f38740ced60 2024-04-25T10:08:29.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.746+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f387413e460 con 0x7f38740ced60 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f386b400640 1 -- 172.21.15.18:0/616660692 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f385c059ad0 con 0x7f38740ced60 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.757 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.763 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:08:29.764 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:08:29.768 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:08:29.770 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:29.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 msgr2=0x7f3850069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 0x7f3850069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f38640ad000 tx=0x7f38640a6000 comp rx=0 tx=0).stop 2024-04-25T10:08:29.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 msgr2=0x7f38741552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f385c00e930 tx=0x7f385c00edf0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 shutdown_connections 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3874144140 0x7f38741430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38740ced60 0x7f38741552e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3850066f60 0x7f3850069420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 --2- 172.21.15.18:0/616660692 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387406e900 0x7f3874138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 >> 172.21.15.18:0/616660692 conn(0x7f3874066fa0 msgr2=0x7f387406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 shutdown_connections 2024-04-25T10:08:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.750+0000 7f3879400640 1 -- 172.21.15.18:0/616660692 wait complete. 2024-04-25T10:08:29.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.910+0000 7fa2f8000640 1 Processor -- start 2024-04-25T10:08:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.910+0000 7fa2f8000640 1 -- start start 2024-04-25T10:08:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f8000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f015b2f0 0x7fa2f00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f8000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f006dad0 0x7fa2f00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f8000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f015def0 con 0x7fa2f00b2dc0 2024-04-25T10:08:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f8000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f015e1b0 con 0x7fa2f006dad0 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f8000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f015e490 con 0x7fa2f015b2f0 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f006dad0 0x7fa2f00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f006dad0 0x7fa2f00b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33384/0 (socket says 172.21.15.18:33384) 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 -- 172.21.15.18:0/1755953883 learned_addr learned my addr 172.21.15.18:0/1755953883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f5600640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f015b2f0 0x7fa2f00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 -- 172.21.15.18:0/1755953883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f015b2f0 msgr2=0x7fa2f00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:29.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f015b2f0 0x7fa2f00b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 -- 172.21.15.18:0/1755953883 >> v1:172.21.15.167:6789/0 conn(0x7fa2f00b2dc0 legacy=0x7fa2f006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2efe00640 1 -- 172.21.15.18:0/1755953883 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257193212 0 0) 0x7fa2f015def0 con 0x7fa2f00b2dc0 2024-04-25T10:08:29.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.914+0000 7fa2f6000640 1 -- 172.21.15.18:0/1755953883 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f015e770 con 0x7fa2f006dad0 2024-04-25T10:08:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f6000640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00b3780 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009e80 tx=0x7fa2e801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce0fcec7a7994eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2efe00640 1 -- 172.21.15.18:0/1755953883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f015b8e0 con 0x7fa2f006dad0 2024-04-25T10:08:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2efe00640 1 -- 172.21.15.18:0/1755953883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e80a58d0 con 0x7fa2f006dad0 2024-04-25T10:08:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2efe00640 1 -- 172.21.15.18:0/1755953883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80a5ca0 con 0x7fa2f006dad0 2024-04-25T10:08:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- 172.21.15.18:0/1755953883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 msgr2=0x7fa2f00b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00b3780 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009e80 tx=0x7fa2e801c9e0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- 172.21.15.18:0/1755953883 shutdown_connections 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00b3780 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- 172.21.15.18:0/1755953883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f015b2f0 0x7fa2f00b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- 172.21.15.18:0/1755953883 >> 172.21.15.18:0/1755953883 conn(0x7fa2f00b23b0 msgr2=0x7fa2f00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- 172.21.15.18:0/1755953883 shutdown_connections 2024-04-25T10:08:29.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- 172.21.15.18:0/1755953883 wait complete. 2024-04-25T10:08:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 Processor -- start 2024-04-25T10:08:29.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- start start 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 0x7fa2f0158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 0x7fa2f015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f016a880 con 0x7fa2f006dad0 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01616f0 con 0x7fa2f015b2f0 2024-04-25T10:08:29.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f8000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f016aa00 con 0x7fa2f00b2dc0 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33400/0 (socket says 172.21.15.18:33400) 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.918+0000 7fa2f5600640 1 -- 172.21.15.18:0/4273927865 learned_addr learned my addr 172.21.15.18:0/4273927865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f4c00640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 0x7fa2f0158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 -- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 msgr2=0x7fa2f0158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f6000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 0x7fa2f015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 0x7fa2f0158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 -- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 msgr2=0x7fa2f015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:29.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 0x7fa2f015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 -- 172.21.15.18:0/4273927865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0159950 con 0x7fa2f006dad0 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f4c00640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 0x7fa2f0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f6000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 0x7fa2f015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f5600640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400e870 tx=0x7fa2e400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4017070 con 0x7fa2f006dad0 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e400c940 con 0x7fa2f006dad0 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400ccf0 con 0x7fa2f006dad0 2024-04-25T10:08:29.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f0159ee0 con 0x7fa2f006dad0 2024-04-25T10:08:29.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f0151fb0 con 0x7fa2f006dad0 2024-04-25T10:08:29.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f00745d0 con 0x7fa2f006dad0 2024-04-25T10:08:29.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2e401a070 con 0x7fa2f006dad0 2024-04-25T10:08:29.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 0x7fa2d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:29.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.922+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa2e4084df0 con 0x7fa2f006dad0 2024-04-25T10:08:29.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.926+0000 7fa2f4c00640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 0x7fa2d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:29.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.926+0000 7fa2f4c00640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 0x7fa2d0069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0160e50 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:29.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:29.926+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2e4055f20 con 0x7fa2f006dad0 2024-04-25T10:08:30.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.090+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2f00d02e0 con 0x7fa2f006dad0 2024-04-25T10:08:30.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.090+0000 7fa2ed600640 1 -- 172.21.15.18:0/4273927865 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+13141 (secure 0 0 0) 0x7fa2e4055820 con 0x7fa2f006dad0 2024-04-25T10:08:30.100 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:30.100 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":77,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:29.337454+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 msgr2=0x7fa2d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 0x7fa2d0069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0160e50 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 msgr2=0x7fa2f00ad3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400e870 tx=0x7fa2e400ec70 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 shutdown_connections 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa2f015b2f0 0x7fa2f015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa2d0066f60 0x7fa2d0069420 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa2f00b2dc0 0x7fa2f0158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 --2- 172.21.15.18:0/4273927865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f006dad0 0x7fa2f00ad3e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 >> 172.21.15.18:0/4273927865 conn(0x7fa2f00b23b0 msgr2=0x7fa2f00b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 shutdown_connections 2024-04-25T10:08:30.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.094+0000 7fa2f8000640 1 -- 172.21.15.18:0/4273927865 wait complete. 2024-04-25T10:08:30.122 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:30.123 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 Processor -- start 2024-04-25T10:08:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 -- start start 2024-04-25T10:08:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa1006bf30 0x7ffa100d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1015e040 con 0x7ffa1009a170 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa100cff80 con 0x7ffa1015dc60 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa14c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa100d0260 con 0x7ffa1006bf30 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa07e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffa1009a170 0x7ffa100cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53128/0 (socket says 172.21.15.18:53128) 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa07e00640 1 -- 172.21.15.18:0/2426893737 learned_addr learned my addr 172.21.15.18:0/2426893737 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa0e800640 1 --2- 172.21.15.18:0/2426893737 >> v2:172.21.15.18:3300/0 conn(0x7ffa1006bf30 0x7ffa100d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa0e800640 1 -- 172.21.15.18:0/2426893737 >> v1:172.21.15.167:6789/0 conn(0x7ffa1015dc60 legacy=0x7ffa10099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa0e800640 1 -- 172.21.15.18:0/2426893737 >> v1:172.21.15.18:6789/0 conn(0x7ffa1009a170 legacy=0x7ffa100cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa0e800640 1 -- 172.21.15.18:0/2426893737 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100d0540 con 0x7ffa1006bf30 2024-04-25T10:08:30.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.258+0000 7ffa0d400640 1 -- 172.21.15.18:0/2426893737 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777183151 0 0) 0x7ffa1015e040 con 0x7ffa1009a170 2024-04-25T10:08:30.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa0e800640 1 --2- 172.21.15.18:0/2426893737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1006bf30 0x7ffa100d1020 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009d90 tx=0x7ffa0801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf3fca64ed5aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa0d400640 1 -- 172.21.15.18:0/2426893737 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080b2070 con 0x7ffa1006bf30 2024-04-25T10:08:30.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa0d400640 1 -- 172.21.15.18:0/2426893737 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa080a58e0 con 0x7ffa1006bf30 2024-04-25T10:08:30.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa0d400640 1 -- 172.21.15.18:0/2426893737 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080a5cb0 con 0x7ffa1006bf30 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 -- 172.21.15.18:0/2426893737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1006bf30 msgr2=0x7ffa100d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 --2- 172.21.15.18:0/2426893737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1006bf30 0x7ffa100d1020 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ffa08009d90 tx=0x7ffa0801c820 comp rx=0 tx=0).stop 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 -- 172.21.15.18:0/2426893737 shutdown_connections 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 --2- 172.21.15.18:0/2426893737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1006bf30 0x7ffa100d1020 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 -- 172.21.15.18:0/2426893737 >> 172.21.15.18:0/2426893737 conn(0x7ffa100b3200 msgr2=0x7ffa100b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 -- 172.21.15.18:0/2426893737 shutdown_connections 2024-04-25T10:08:30.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.262+0000 7ffa14c00640 1 -- 172.21.15.18:0/2426893737 wait complete. 2024-04-25T10:08:30.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 Processor -- start 2024-04-25T10:08:30.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- start start 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 0x7ffa101f7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 0x7ffa1015ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1006cfa0 con 0x7ffa1015dc60 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100cc880 con 0x7ffa1006bf30 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa100c8880 con 0x7ffa1009a170 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33426/0 (socket says 172.21.15.18:33426) 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 -- 172.21.15.18:0/1171154472 learned_addr learned my addr 172.21.15.18:0/1171154472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0de00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 0x7ffa101f7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa07e00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 0x7ffa1015ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 -- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 msgr2=0x7ffa1015ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 0x7ffa1015ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 -- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 msgr2=0x7ffa101f7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 0x7ffa101f7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 -- 172.21.15.18:0/1171154472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa10153130 con 0x7ffa1015dc60 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0de00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 0x7ffa101f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa07e00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 0x7ffa1015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa0e800640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ffa0801a450 tx=0x7ffa080195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080bd020 con 0x7ffa1015dc60 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa080ad6c0 con 0x7ffa1015dc60 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa080b2040 con 0x7ffa1015dc60 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa101f79c0 con 0x7ffa1015dc60 2024-04-25T10:08:30.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.266+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa101f7f80 con 0x7ffa1015dc60 2024-04-25T10:08:30.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa100745d0 con 0x7ffa1015dc60 2024-04-25T10:08:30.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa080c0020 con 0x7ffa1015dc60 2024-04-25T10:08:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa06000640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 0x7ff9ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ffa08120010 con 0x7ffa1015dc60 2024-04-25T10:08:30.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa0de00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 0x7ff9ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.270+0000 7ffa0de00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 0x7ff9ec069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa100cb9c0 tx=0x7ffa00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.274+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa080c7030 con 0x7ffa1015dc60 2024-04-25T10:08:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.438+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffa100b7590 con 0x7ffa1015dc60 2024-04-25T10:08:30.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.438+0000 7ffa06000640 1 -- 172.21.15.18:0/1171154472 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffa10153130 con 0x7ffa1015dc60 2024-04-25T10:08:30.447 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 msgr2=0x7ff9ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 0x7ff9ec069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa100cb9c0 tx=0x7ffa00009040 comp rx=0 tx=0).stop 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 msgr2=0x7ffa10152760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7ffa0801a450 tx=0x7ffa080195c0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 shutdown_connections 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa1015dc60 0x7ffa10152760 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff9ec066f60 0x7ff9ec069420 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa1009a170 0x7ffa1015ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 --2- 172.21.15.18:0/1171154472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa1006bf30 0x7ffa101f7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 >> 172.21.15.18:0/1171154472 conn(0x7ffa100b3200 msgr2=0x7ffa101594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 shutdown_connections 2024-04-25T10:08:30.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.442+0000 7ffa14c00640 1 -- 172.21.15.18:0/1171154472 wait complete. 2024-04-25T10:08:30.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:08:30.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 Processor -- start 2024-04-25T10:08:30.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 -- start start 2024-04-25T10:08:30.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f041c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0d0280 con 0x7f041c0cd460 2024-04-25T10:08:30.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c06d740 con 0x7f041c09a7a0 2024-04-25T10:08:30.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0cbfc0 con 0x7f041c15dcd0 2024-04-25T10:08:30.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f041c0cd460 0x7f041c0cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:53140/0 (socket says 172.21.15.18:53140) 2024-04-25T10:08:30.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 -- 172.21.15.18:0/1477091919 learned_addr learned my addr 172.21.15.18:0/1477091919 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041aa00640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f041c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355230036 0 0) 0x7f041c0d0280 con 0x7f041c0cd460 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0400003530 con 0x7f041c0cd460 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469988194 0 0) 0x7f0400003530 con 0x7f041c0cd460 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 msgr2=0x7f041c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f041c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 >> v1:172.21.15.167:6789/0 conn(0x7f041c09a7a0 legacy=0x7f041c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c06cea0 con 0x7f041c0cd460 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f0414001a00 con 0x7f041c0cd460 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 >> v1:172.21.15.18:6789/0 conn(0x7f041c0cd460 legacy=0x7f041c0cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04000039f0 0x7f0400003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f0400004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f04000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0cbfc0 con 0x7f0400004d50 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040000b9d0 con 0x7f04000039f0 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040000bbd0 con 0x7f041c15dcd0 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f04000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041aa00640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04000039f0 0x7f0400003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f0413e00640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f0400004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 -- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 msgr2=0x7f0400004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c15dcd0 0x7f0400004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 -- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04000039f0 msgr2=0x7f0400003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04000039f0 0x7f0400003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041b400640 1 -- 172.21.15.18:0/1477091919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400003530 con 0x7f0400004d50 2024-04-25T10:08:30.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.602+0000 7f041aa00640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f04000039f0 0x7f0400003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:30.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041b400640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f04000051d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f041400a8f0 tx=0x7f041401fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14cec0e5d079cb7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041400a4c0 con 0x7f0400004d50 2024-04-25T10:08:30.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04140aa720 con 0x7f0400004d50 2024-04-25T10:08:30.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041a000640 1 -- 172.21.15.18:0/1477091919 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04140aab10 con 0x7f0400004d50 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 -- 172.21.15.18:0/1477091919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 msgr2=0x7f04000051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 --2- 172.21.15.18:0/1477091919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f04000051d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f041400a8f0 tx=0x7f041401fb60 comp rx=0 tx=0).stop 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041b400640 1 -- 172.21.15.18:0/1477091919 reap_dead start 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 -- 172.21.15.18:0/1477091919 shutdown_connections 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 -- 172.21.15.18:0/1477091919 >> 172.21.15.18:0/1477091919 conn(0x7f041c0b3050 msgr2=0x7f041c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 -- 172.21.15.18:0/1477091919 shutdown_connections 2024-04-25T10:08:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.606+0000 7f041be00640 1 -- 172.21.15.18:0/1477091919 wait complete. 2024-04-25T10:08:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 Processor -- start 2024-04-25T10:08:30.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- start start 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f041c0c8630 0x7f041c0af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 0x7f041c0c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0cbc50 con 0x7f0400004d50 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c06d460 con 0x7f041c0c8630 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c15e0b0 con 0x7f041c0af770 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33444/0 (socket says 172.21.15.18:33444) 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 -- 172.21.15.18:0/3202258729 learned_addr learned my addr 172.21.15.18:0/3202258729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f0413e00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f041c0c8630 0x7f041c0af230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041b400640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 0x7f041c0c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 -- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 msgr2=0x7f041c0c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 0x7f041c0c4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 -- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f041c0c8630 msgr2=0x7f041c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f041c0c8630 0x7f041c0af230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 -- 172.21.15.18:0/3202258729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0c5bf0 con 0x7f0400004d50 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041b400640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 0x7f041c0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041aa00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f040c011ca0 tx=0x7f040c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00fd20 con 0x7f0400004d50 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c004020 con 0x7f0400004d50 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c004410 con 0x7f0400004d50 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0c5ed0 con 0x7f0400004d50 2024-04-25T10:08:30.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.610+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c0c6710 con 0x7f0400004d50 2024-04-25T10:08:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c0afb80 con 0x7f0400004d50 2024-04-25T10:08:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f040c012040 con 0x7f0400004d50 2024-04-25T10:08:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f0412a00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 0x7f03f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f040c085430 con 0x7f0400004d50 2024-04-25T10:08:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f0413e00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 0x7f03f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.614+0000 7f0413e00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 0x7f03f8069450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f041c0c8a50 tx=0x7f0404009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.618+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f041c0afb80 con 0x7f0400004d50 2024-04-25T10:08:30.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f041c04efa0 con 0x7f0400004d50 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f0412a00640 1 -- 172.21.15.18:0/3202258729 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7f040c019030 con 0x7f0400004d50 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:30.790 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 msgr2=0x7f03f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 0x7f03f8069450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f041c0c8a50 tx=0x7f0404009040 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 msgr2=0x7f041c157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f040c011ca0 tx=0x7f040c00f610 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 shutdown_connections 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f03f8066f90 0x7f03f8069450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f041c0af770 0x7f041c0c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f041c0c8630 0x7f041c0af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 --2- 172.21.15.18:0/3202258729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0400004d50 0x7f041c157090 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 >> 172.21.15.18:0/3202258729 conn(0x7f041c0b3050 msgr2=0x7f041c0cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 shutdown_connections 2024-04-25T10:08:30.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.782+0000 7f041be00640 1 -- 172.21.15.18:0/3202258729 wait complete. 2024-04-25T10:08:30.811 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:08:30.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:08:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.946+0000 7f8317600640 1 Processor -- start 2024-04-25T10:08:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.946+0000 7f8317600640 1 -- start start 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8317600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f831015dd00 0x7f83100af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8317600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f83101676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8317600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83100c6dc0 con 0x7f83100ce1c0 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8317600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83100d0430 con 0x7f831015dd00 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8317600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83100c70a0 con 0x7f83100c60a0 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f831015dd00 0x7f83100af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f831015dd00 0x7f83100af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33454/0 (socket says 172.21.15.18:33454) 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 -- 172.21.15.18:0/3909888977 learned_addr learned my addr 172.21.15.18:0/3909888977 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:30.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8315600640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f83101676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 -- 172.21.15.18:0/3909888977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 msgr2=0x7f83101676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f83101676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 -- 172.21.15.18:0/3909888977 >> v1:172.21.15.167:6789/0 conn(0x7f83100ce1c0 legacy=0x7f83100c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.950+0000 7f8314c00640 1 -- 172.21.15.18:0/3909888977 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83100c7380 con 0x7f831015dd00 2024-04-25T10:08:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8314c00640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f831015dd00 0x7f83100af860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689e28cb2c995f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f830f400640 1 -- 172.21.15.18:0/3909888977 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040a7070 con 0x7f831015dd00 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f830f400640 1 -- 172.21.15.18:0/3909888977 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83040b0070 con 0x7f831015dd00 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f830f400640 1 -- 172.21.15.18:0/3909888977 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83040ab890 con 0x7f831015dd00 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- 172.21.15.18:0/3909888977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f831015dd00 msgr2=0x7f83100af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f831015dd00 0x7f83100af860 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f8304009870 tx=0x7f830401c560 comp rx=0 tx=0).stop 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- 172.21.15.18:0/3909888977 shutdown_connections 2024-04-25T10:08:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f83101676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 --2- 172.21.15.18:0/3909888977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f831015dd00 0x7f83100af860 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- 172.21.15.18:0/3909888977 >> 172.21.15.18:0/3909888977 conn(0x7f83100b2240 msgr2=0x7f83100b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- 172.21.15.18:0/3909888977 shutdown_connections 2024-04-25T10:08:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- 172.21.15.18:0/3909888977 wait complete. 2024-04-25T10:08:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 Processor -- start 2024-04-25T10:08:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.954+0000 7f8317600640 1 -- start start 2024-04-25T10:08:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f831009e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83100ce1c0 0x7f831009a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831016a7c0 con 0x7f83100b54c0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831016a640 con 0x7f83100ce1c0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831016a940 con 0x7f83100c60a0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33458/0 (socket says 172.21.15.18:33458) 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 -- 172.21.15.18:0/312738042 learned_addr learned my addr 172.21.15.18:0/312738042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8314c00640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f831009e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f830fe00640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83100ce1c0 0x7f831009a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 -- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 msgr2=0x7f831009e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f831009e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 -- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83100ce1c0 msgr2=0x7f831009a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83100ce1c0 0x7f831009a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 -- 172.21.15.18:0/312738042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8310150810 con 0x7f83100b54c0 2024-04-25T10:08:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8315600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f830800efc0 tx=0x7f830800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308018020 con 0x7f83100b54c0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8308014480 con 0x7f83100b54c0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83100b0500 con 0x7f83100b54c0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8308014870 con 0x7f83100b54c0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83100b0ac0 con 0x7f83100b54c0 2024-04-25T10:08:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83100745d0 con 0x7f83100b54c0 2024-04-25T10:08:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.958+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f830801b020 con 0x7f83100b54c0 2024-04-25T10:08:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.962+0000 7f830cc00640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 0x7f82f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.962+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8308085870 con 0x7f83100b54c0 2024-04-25T10:08:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.962+0000 7f8314c00640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 0x7f82f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.962+0000 7f8314c00640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 0x7f82f0069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83040af000 tx=0x7f83040a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:30.966+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8308022070 con 0x7f83100b54c0 2024-04-25T10:08:31.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.126+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f83100cf600 con 0x7f83100b54c0 2024-04-25T10:08:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f830cc00640 1 -- 172.21.15.18:0/312738042 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8308010040 con 0x7f83100b54c0 2024-04-25T10:08:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:08:31.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 msgr2=0x7f82f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 0x7f82f0069420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83040af000 tx=0x7f83040a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 msgr2=0x7f83100b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f830800efc0 tx=0x7f830800c490 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 shutdown_connections 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83100b54c0 0x7f83100b12c0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83100ce1c0 0x7f831009a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f82f0066f60 0x7f82f0069420 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 --2- 172.21.15.18:0/312738042 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83100c60a0 0x7f831009e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.974+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 >> 172.21.15.18:0/312738042 conn(0x7f83100b2240 msgr2=0x7f83100ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:31.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.978+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 shutdown_connections 2024-04-25T10:08:31.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:31.978+0000 7f8317600640 1 -- 172.21.15.18:0/312738042 wait complete. 2024-04-25T10:08:32.013 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:08:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 Processor -- start 2024-04-25T10:08:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 -- start start 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f106415dc60 0x7f10640d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f10640cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106415e040 con 0x7f106406bf30 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10640cff80 con 0x7f106415dc60 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f106ac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640d0260 con 0x7f106409a170 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1063e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f106415dc60 0x7f10640d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f105be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f106406bf30 0x7f1064099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51652/0 (socket says 172.21.15.18:51652) 2024-04-25T10:08:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f105be00640 1 -- 172.21.15.18:0/2600999799 learned_addr learned my addr 172.21.15.18:0/2600999799 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1068c00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f10640cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1063e00640 1 -- 172.21.15.18:0/2600999799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 msgr2=0x7f10640cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1063e00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f10640cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1063e00640 1 -- 172.21.15.18:0/2600999799 >> v1:172.21.15.18:6789/0 conn(0x7f106406bf30 legacy=0x7f1064099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.158+0000 7f1063e00640 1 -- 172.21.15.18:0/2600999799 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640d0540 con 0x7f106415dc60 2024-04-25T10:08:32.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f1063e00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f10640d1020 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10540097c0 tx=0x7f105401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5be6b9dfa20c3e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f1063400640 1 -- 172.21.15.18:0/2600999799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540b1070 con 0x7f106415dc60 2024-04-25T10:08:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f1063400640 1 -- 172.21.15.18:0/2600999799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540a8050 con 0x7f106415dc60 2024-04-25T10:08:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f1063400640 1 -- 172.21.15.18:0/2600999799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10540ac860 con 0x7f106415dc60 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- 172.21.15.18:0/2600999799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 msgr2=0x7f10640d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f10640d1020 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f10540097c0 tx=0x7f105401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- 172.21.15.18:0/2600999799 shutdown_connections 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f10640cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 --2- 172.21.15.18:0/2600999799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f10640d1020 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- 172.21.15.18:0/2600999799 >> 172.21.15.18:0/2600999799 conn(0x7f10640b3200 msgr2=0x7f10640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- 172.21.15.18:0/2600999799 shutdown_connections 2024-04-25T10:08:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- 172.21.15.18:0/2600999799 wait complete. 2024-04-25T10:08:32.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 Processor -- start 2024-04-25T10:08:32.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.162+0000 7f106ac00640 1 -- start start 2024-04-25T10:08:32.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106406bf30 0x7f10640cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f1064154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640cc6f0 con 0x7f106415dc60 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10640cc570 con 0x7f106406bf30 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10640cc870 con 0x7f106409a170 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42590/0 (socket says 172.21.15.18:42590) 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 -- 172.21.15.18:0/1415805763 learned_addr learned my addr 172.21.15.18:0/1415805763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1063e00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106406bf30 0x7f10640cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f105be00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f1064154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 -- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 msgr2=0x7f1064154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f1064154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 -- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106406bf30 msgr2=0x7f10640cb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106406bf30 0x7f10640cb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 -- 172.21.15.18:0/1415805763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10640b4fb0 con 0x7f106415dc60 2024-04-25T10:08:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1068c00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f105c007e60 tx=0x7f105c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c014620 con 0x7f106415dc60 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c019070 con 0x7f106415dc60 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10640b5290 con 0x7f106415dc60 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c014a00 con 0x7f106415dc60 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106415c460 con 0x7f106415dc60 2024-04-25T10:08:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.166+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10640745d0 con 0x7f106415dc60 2024-04-25T10:08:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.170+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f105c014ba0 con 0x7f106415dc60 2024-04-25T10:08:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.170+0000 7f1060c00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 0x7f1040069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.170+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f105c085990 con 0x7f106415dc60 2024-04-25T10:08:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.170+0000 7f1063e00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 0x7f1040069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.170+0000 7f1063e00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 0x7f1040069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10540ae000 tx=0x7f10540a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:32.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.174+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f105c056950 con 0x7f106415dc60 2024-04-25T10:08:32.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.338+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f10640b7590 con 0x7f106415dc60 2024-04-25T10:08:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f1060c00640 1 -- 172.21.15.18:0/1415805763 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f105c056250 con 0x7f106415dc60 2024-04-25T10:08:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:08:32.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 msgr2=0x7f1040069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 0x7f1040069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f10540ae000 tx=0x7f10540a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 msgr2=0x7f1064155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f105c007e60 tx=0x7f105c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 shutdown_connections 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f106415dc60 0x7f1064155530 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1040066f60 0x7f1040069420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f106409a170 0x7f1064154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 --2- 172.21.15.18:0/1415805763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f106406bf30 0x7f10640cb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 >> 172.21.15.18:0/1415805763 conn(0x7f10640b3200 msgr2=0x7f10640ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 shutdown_connections 2024-04-25T10:08:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:32.978+0000 7f106ac00640 1 -- 172.21.15.18:0/1415805763 wait complete. 2024-04-25T10:08:33.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:08:33.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.162+0000 7fb309e00640 1 Processor -- start 2024-04-25T10:08:33.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.162+0000 7fb309e00640 1 -- start start 2024-04-25T10:08:33.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb309e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb30406c730 0x7fb30415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:33.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb309e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30415ef90 con 0x7fb30406cb10 2024-04-25T10:08:33.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb309e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3041623b0 con 0x7fb3040d0790 2024-04-25T10:08:33.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb309e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb30409a9e0 con 0x7fb30406c730 2024-04-25T10:08:33.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb303e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb30406cb10 0x7fb304161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51668/0 (socket says 172.21.15.18:51668) 2024-04-25T10:08:33.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb303e00640 1 -- 172.21.15.18:0/2599859168 learned_addr learned my addr 172.21.15.18:0/2599859168 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:33.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb308a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb30406c730 0x7fb30415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb303400640 1 -- 172.21.15.18:0/2599859168 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676546699 0 0) 0x7fb30415ef90 con 0x7fb30406cb10 2024-04-25T10:08:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb303400640 1 -- 172.21.15.18:0/2599859168 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003530 con 0x7fb30406cb10 2024-04-25T10:08:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb308a00640 1 -- 172.21.15.18:0/2599859168 >> v1:172.21.15.167:6789/0 conn(0x7fb3040d0790 legacy=0x7fb304161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb308a00640 1 -- 172.21.15.18:0/2599859168 >> v1:172.21.15.18:6789/0 conn(0x7fb30406cb10 legacy=0x7fb304161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:33.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.166+0000 7fb308a00640 1 -- 172.21.15.18:0/2599859168 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb304099dd0 con 0x7fb30406c730 2024-04-25T10:08:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb308a00640 1 --2- 172.21.15.18:0/2599859168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406c730 0x7fb30415ea50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097c0 tx=0x7fb2f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d045746fbecebb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303400640 1 -- 172.21.15.18:0/2599859168 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80b1070 con 0x7fb30406c730 2024-04-25T10:08:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303400640 1 -- 172.21.15.18:0/2599859168 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f80ac5f0 con 0x7fb30406c730 2024-04-25T10:08:33.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303400640 1 -- 172.21.15.18:0/2599859168 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80ac9a0 con 0x7fb30406c730 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- 172.21.15.18:0/2599859168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406c730 msgr2=0x7fb30415ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 --2- 172.21.15.18:0/2599859168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406c730 0x7fb30415ea50 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80097c0 tx=0x7fb2f801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- 172.21.15.18:0/2599859168 shutdown_connections 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 --2- 172.21.15.18:0/2599859168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406c730 0x7fb30415ea50 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- 172.21.15.18:0/2599859168 >> 172.21.15.18:0/2599859168 conn(0x7fb3040b3030 msgr2=0x7fb3040b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- 172.21.15.18:0/2599859168 shutdown_connections 2024-04-25T10:08:33.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- 172.21.15.18:0/2599859168 wait complete. 2024-04-25T10:08:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 Processor -- start 2024-04-25T10:08:33.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- start start 2024-04-25T10:08:33.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb30406c730 0x7fb30414eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 0x7fb3041501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb304099a60 con 0x7fb30406cb10 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30415de20 con 0x7fb3040d0790 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3040b0720 con 0x7fb30406c730 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42606/0 (socket says 172.21.15.18:42606) 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb303e00640 1 -- 172.21.15.18:0/2740038247 learned_addr learned my addr 172.21.15.18:0/2740038247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb308a00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb30406c730 0x7fb30414eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.170+0000 7fb309400640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 0x7fb3041501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 -- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb30406c730 msgr2=0x7fb30414eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:33.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb30406c730 0x7fb30414eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 -- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 msgr2=0x7fb3041501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 0x7fb3041501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 -- 172.21.15.18:0/2740038247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3041fad20 con 0x7fb30406cb10 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb309400640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 0x7fb3041501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb303e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c500 tx=0x7fb2f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0017070 con 0x7fb30406cb10 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f0005cf0 con 0x7fb30406cb10 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f00072f0 con 0x7fb30406cb10 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30414f070 con 0x7fb30406cb10 2024-04-25T10:08:33.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb304152f90 con 0x7fb30406cb10 2024-04-25T10:08:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3040745d0 con 0x7fb30406cb10 2024-04-25T10:08:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2f001a070 con 0x7fb30406cb10 2024-04-25T10:08:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 0x7fb2e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:33.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.174+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fb2f0084960 con 0x7fb30406cb10 2024-04-25T10:08:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.178+0000 7fb308a00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 0x7fb2e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:33.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.178+0000 7fb308a00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 0x7fb2e4069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ae000 tx=0x7fb2f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:33.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.178+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2f0055260 con 0x7fb30406cb10 2024-04-25T10:08:33.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:33.374+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb30406c510 con 0x7fb30406cb10 2024-04-25T10:08:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.010+0000 7fb300c00640 1 -- 172.21.15.18:0/2740038247 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb2f0059300 con 0x7fb30406cb10 2024-04-25T10:08:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T10:08:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 msgr2=0x7fb2e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 0x7fb2e4069420 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80ae000 tx=0x7fb2f80a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 msgr2=0x7fb304153d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c500 tx=0x7fb2f000c9c0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 shutdown_connections 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3040d0790 0x7fb3041501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb30406cb10 0x7fb304153d50 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2e4066f60 0x7fb2e4069420 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 --2- 172.21.15.18:0/2740038247 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb30406c730 0x7fb30414eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.018+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 >> 172.21.15.18:0/2740038247 conn(0x7fb3040b3030 msgr2=0x7fb304152150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.022+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 shutdown_connections 2024-04-25T10:08:34.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.022+0000 7fb309e00640 1 -- 172.21.15.18:0/2740038247 wait complete. 2024-04-25T10:08:34.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.194+0000 7fa4b3200640 1 Processor -- start 2024-04-25T10:08:34.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.194+0000 7fa4b3200640 1 -- start start 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa4ac099a60 0x7fa4ac099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 0x7fa4ac06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac1616a0 0x7fa4ac161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac09a380 con 0x7fa4ac099a60 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ac06c650 con 0x7fa4ac15ee00 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac06c930 con 0x7fa4ac1616a0 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa4ac099a60 0x7fa4ac099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa4ac099a60 0x7fa4ac099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42618/0 (socket says 172.21.15.18:42618) 2024-04-25T10:08:34.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 -- 172.21.15.18:0/1935386047 learned_addr learned my addr 172.21.15.18:0/1935386047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4b1200640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac1616a0 0x7fa4ac161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4a3400640 1 --2- 172.21.15.18:0/1935386047 >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 0x7fa4ac06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 -- 172.21.15.18:0/1935386047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac1616a0 msgr2=0x7fa4ac161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac1616a0 0x7fa4ac161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 -- 172.21.15.18:0/1935386047 >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 msgr2=0x7fa4ac06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 --2- 172.21.15.18:0/1935386047 >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 0x7fa4ac06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4abe00640 1 -- 172.21.15.18:0/1935386047 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac06cc10 con 0x7fa4ac099a60 2024-04-25T10:08:34.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.198+0000 7fa4a3400640 1 --2- 172.21.15.18:0/1935386047 >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 0x7fa4ac06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:34.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4abe00640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac099a60 0x7fa4ac099e40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0ce1f0 tx=0x7fa49c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b245ebbc4fda5e0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4ab400640 1 -- 172.21.15.18:0/1935386047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ab5f0 con 0x7fa4ac099a60 2024-04-25T10:08:34.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4ab400640 1 -- 172.21.15.18:0/1935386047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c0b0070 con 0x7fa4ac099a60 2024-04-25T10:08:34.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4ab400640 1 -- 172.21.15.18:0/1935386047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49c0ab9b0 con 0x7fa4ac099a60 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- 172.21.15.18:0/1935386047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac099a60 msgr2=0x7fa4ac099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac099a60 0x7fa4ac099e40 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac0ce1f0 tx=0x7fa49c01c520 comp rx=0 tx=0).stop 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- 172.21.15.18:0/1935386047 shutdown_connections 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac1616a0 0x7fa4ac161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- 172.21.15.18:0/1935386047 >> v2:172.21.15.167:3300/0 conn(0x7fa4ac15ee00 0x7fa4ac06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- 172.21.15.18:0/1935386047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac099a60 0x7fa4ac099e40 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- 172.21.15.18:0/1935386047 >> 172.21.15.18:0/1935386047 conn(0x7fa4ac0d17a0 msgr2=0x7fa4ac0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- 172.21.15.18:0/1935386047 shutdown_connections 2024-04-25T10:08:34.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- 172.21.15.18:0/1935386047 wait complete. 2024-04-25T10:08:34.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 Processor -- start 2024-04-25T10:08:34.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- start start 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4ac099a60 0x7fa4ac152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac15ee00 0x7fa4ac0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac15e000 con 0x7fa4ac1616a0 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac15de80 con 0x7fa4ac099a60 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.202+0000 7fa4b3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac06c260 con 0x7fa4ac15ee00 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42628/0 (socket says 172.21.15.18:42628) 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 -- 172.21.15.18:0/3706146797 learned_addr learned my addr 172.21.15.18:0/3706146797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:34.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4a3400640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac15ee00 0x7fa4ac0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4abe00640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4ac099a60 0x7fa4ac152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 -- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac15ee00 msgr2=0x7fa4ac0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac15ee00 0x7fa4ac0c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 -- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4ac099a60 msgr2=0x7fa4ac152740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4ac099a60 0x7fa4ac152740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 -- 172.21.15.18:0/3706146797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac152c80 con 0x7fa4ac1616a0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b1200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007e90 tx=0x7fa4a400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4014420 con 0x7fa4ac1616a0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4a4019070 con 0x7fa4ac1616a0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a4014800 con 0x7fa4ac1616a0 2024-04-25T10:08:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac0c91e0 con 0x7fa4ac1616a0 2024-04-25T10:08:34.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac0c97a0 con 0x7fa4ac1616a0 2024-04-25T10:08:34.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac0745d0 con 0x7fa4ac1616a0 2024-04-25T10:08:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.206+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4a40149a0 con 0x7fa4ac1616a0 2024-04-25T10:08:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.210+0000 7fa4a8c00640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 0x7fa488069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.210+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa4a4085a20 con 0x7fa4ac1616a0 2024-04-25T10:08:34.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.210+0000 7fa4abe00640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 0x7fa488069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.210+0000 7fa4abe00640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 0x7fa488069450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.214+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa4a4056890 con 0x7fa4ac1616a0 2024-04-25T10:08:34.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4ac0700e0 con 0x7fa4ac1616a0 2024-04-25T10:08:34.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4a8c00640 1 -- 172.21.15.18:0/3706146797 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16934 (secure 0 0 0) 0x7fa4a4056190 con 0x7fa4ac1616a0 2024-04-25T10:08:34.386 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:34.387 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":80,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:33.379358+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 msgr2=0x7fa488069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 0x7fa488069450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0af000 tx=0x7fa49c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 msgr2=0x7fa4ac15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4007e90 tx=0x7fa4a400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 shutdown_connections 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4ac1616a0 0x7fa4ac15c620 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa488066f90 0x7fa488069450 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa4ac15ee00 0x7fa4ac0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 --2- 172.21.15.18:0/3706146797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4ac099a60 0x7fa4ac152740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 >> 172.21.15.18:0/3706146797 conn(0x7fa4ac0d17a0 msgr2=0x7fa4ac1540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 shutdown_connections 2024-04-25T10:08:34.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.378+0000 7fa4b3200640 1 -- 172.21.15.18:0/3706146797 wait complete. 2024-04-25T10:08:34.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.538+0000 7f326c600640 1 Processor -- start 2024-04-25T10:08:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.538+0000 7f326c600640 1 -- start start 2024-04-25T10:08:34.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f326c600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f326415b5a0 0x7f32640cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f326c600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640ce7f0 con 0x7f326415b980 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f326c600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32640cead0 con 0x7f32640cc440 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f326c600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32640cfcd0 con 0x7f326415b5a0 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f326415b5a0 0x7f32640cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f326415b980 0x7f32640cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51670/0 (socket says 172.21.15.18:51670) 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269200640 1 -- 172.21.15.18:0/723939196 learned_addr learned my addr 172.21.15.18:0/723939196 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:34.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269c00640 1 -- 172.21.15.18:0/723939196 >> v1:172.21.15.167:6789/0 conn(0x7f32640cc440 legacy=0x7f32640d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269c00640 1 -- 172.21.15.18:0/723939196 >> v1:172.21.15.18:6789/0 conn(0x7f326415b980 legacy=0x7f32640cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3269c00640 1 -- 172.21.15.18:0/723939196 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32640cf960 con 0x7f326415b5a0 2024-04-25T10:08:34.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.542+0000 7f3263e00640 1 -- 172.21.15.18:0/723939196 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139418588 0 0) 0x7f32640ce7f0 con 0x7f326415b980 2024-04-25T10:08:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f3269c00640 1 --2- 172.21.15.18:0/723939196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640cdea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f32580097c0 tx=0x7f325801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52031bffcc3b72b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f3263e00640 1 -- 172.21.15.18:0/723939196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580aa620 con 0x7f326415b5a0 2024-04-25T10:08:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f3263e00640 1 -- 172.21.15.18:0/723939196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32580af070 con 0x7f326415b5a0 2024-04-25T10:08:34.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f3263e00640 1 -- 172.21.15.18:0/723939196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32580aa9e0 con 0x7f326415b5a0 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- 172.21.15.18:0/723939196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 msgr2=0x7f32640cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 --2- 172.21.15.18:0/723939196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640cdea0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f32580097c0 tx=0x7f325801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- 172.21.15.18:0/723939196 shutdown_connections 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 --2- 172.21.15.18:0/723939196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640cdea0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- 172.21.15.18:0/723939196 >> 172.21.15.18:0/723939196 conn(0x7f32640b3390 msgr2=0x7f32640b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- 172.21.15.18:0/723939196 shutdown_connections 2024-04-25T10:08:34.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- 172.21.15.18:0/723939196 wait complete. 2024-04-25T10:08:34.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 Processor -- start 2024-04-25T10:08:34.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- start start 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32640cc440 0x7f32640b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f326415b980 0x7f32640c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640d1450 con 0x7f326415b5a0 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32640d12d0 con 0x7f32640cc440 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.546+0000 7f326c600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3264169750 con 0x7f326415b980 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42646/0 (socket says 172.21.15.18:42646) 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 -- 172.21.15.18:0/4004453134 learned_addr learned my addr 172.21.15.18:0/4004453134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:34.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269c00640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32640cc440 0x7f32640b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f326a600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f326415b980 0x7f32640c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 -- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f326415b980 msgr2=0x7f32640c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f326415b980 0x7f32640c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 -- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32640cc440 msgr2=0x7f32640b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32640cc440 0x7f32640b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 -- 172.21.15.18:0/4004453134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326414ee20 con 0x7f326415b5a0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3269200640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f325000c4d0 tx=0x7f325000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250018070 con 0x7f326415b5a0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32500074e0 con 0x7f326415b5a0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250004a30 con 0x7f326415b5a0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326414f100 con 0x7f326415b5a0 2024-04-25T10:08:34.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f326414f6c0 con 0x7f326415b5a0 2024-04-25T10:08:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32640745d0 con 0x7f326415b5a0 2024-04-25T10:08:34.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.550+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f325001b070 con 0x7f326415b5a0 2024-04-25T10:08:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.554+0000 7f3261600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 0x7f3244069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.554+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3250084570 con 0x7f326415b5a0 2024-04-25T10:08:34.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.554+0000 7f3269c00640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 0x7f3244069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.554+0000 7f3269c00640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 0x7f3244069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f32580ae000 tx=0x7f32580a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.558+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3250055350 con 0x7f326415b5a0 2024-04-25T10:08:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.718+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32640cc960 con 0x7f326415b5a0 2024-04-25T10:08:34.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.718+0000 7f3261600640 1 -- 172.21.15.18:0/4004453134 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16934 (secure 0 0 0) 0x7f3250054c50 con 0x7f326415b5a0 2024-04-25T10:08:34.729 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:34.729 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":80,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:33.379358+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 msgr2=0x7f3244069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 0x7f3244069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f32580ae000 tx=0x7f32580a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 msgr2=0x7f32640b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f325000c4d0 tx=0x7f325000c990 comp rx=0 tx=0).stop 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 shutdown_connections 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3244066f60 0x7f3244069420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f326415b980 0x7f32640c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f326415b5a0 0x7f32640b5540 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 --2- 172.21.15.18:0/4004453134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32640cc440 0x7f32640b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 >> 172.21.15.18:0/4004453134 conn(0x7f32640b3390 msgr2=0x7f32640b60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 shutdown_connections 2024-04-25T10:08:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.722+0000 7f326c600640 1 -- 172.21.15.18:0/4004453134 wait complete. 2024-04-25T10:08:34.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:08:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 Processor -- start 2024-04-25T10:08:34.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 -- start start 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f609815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609815bc40 con 0x7f6098144120 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f609815b3a0 con 0x7f609815ee60 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f609d400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609815e490 con 0x7f609815acd0 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f6096800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6098144120 0x7f60980ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51676/0 (socket says 172.21.15.18:51676) 2024-04-25T10:08:34.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f6096800640 1 -- 172.21.15.18:0/2948193505 learned_addr learned my addr 172.21.15.18:0/2948193505 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.886+0000 7f608de00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f609815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1797723503 0 0) 0x7f609815bc40 con 0x7f6098144120 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f607c003530 con 0x7f6098144120 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224208199 0 0) 0x7f607c003530 con 0x7f6098144120 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 msgr2=0x7f609815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f609815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 >> v1:172.21.15.167:6789/0 conn(0x7f609815ee60 legacy=0x7f60980b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609815b680 con 0x7f6098144120 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6088001680 con 0x7f6098144120 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 >> v1:172.21.15.18:6789/0 conn(0x7f6098144120 legacy=0x7f60980ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607c0039f0 0x7f607c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0043a0 0x7f607c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f607c005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609815e490 con 0x7f607c0039f0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c00dc90 con 0x7f607c0043a0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c00de90 con 0x7f609815acd0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607c0039f0 0x7f607c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f608de00640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0043a0 0x7f607c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6097200640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f607c005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 -- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 msgr2=0x7f607c005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f609815acd0 0x7f607c005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 -- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0043a0 msgr2=0x7f607c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:34.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0043a0 0x7f607c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.890+0000 7f6096800640 1 -- 172.21.15.18:0/2948193505 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607c003530 con 0x7f607c0039f0 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f6096800640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607c0039f0 0x7f607c003dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f608800c240 tx=0x7f608801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26344c4bce5220f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088007d20 con 0x7f607c0039f0 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60880a9020 con 0x7f607c0039f0 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f6095e00640 1 -- 172.21.15.18:0/2948193505 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088005ae0 con 0x7f607c0039f0 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- 172.21.15.18:0/2948193505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607c0039f0 msgr2=0x7f607c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 --2- 172.21.15.18:0/2948193505 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f607c0039f0 0x7f607c003dd0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f608800c240 tx=0x7f608801cc80 comp rx=0 tx=0).stop 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f6097200640 1 -- 172.21.15.18:0/2948193505 reap_dead start 2024-04-25T10:08:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- 172.21.15.18:0/2948193505 shutdown_connections 2024-04-25T10:08:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- 172.21.15.18:0/2948193505 >> 172.21.15.18:0/2948193505 conn(0x7f6098067080 msgr2=0x7f609806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- 172.21.15.18:0/2948193505 shutdown_connections 2024-04-25T10:08:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- 172.21.15.18:0/2948193505 wait complete. 2024-04-25T10:08:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 Processor -- start 2024-04-25T10:08:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- start start 2024-04-25T10:08:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 0x7f609815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 0x7f60981f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609806dc60 con 0x7f609815bdb0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609806dae0 con 0x7f607c0039f0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.894+0000 7f609d400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f609806dde0 con 0x7f60980ae690 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42668/0 (socket says 172.21.15.18:42668) 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 -- 172.21.15.18:0/3202058128 learned_addr learned my addr 172.21.15.18:0/3202058128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f6096800640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 0x7f609815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f6097200640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 0x7f60981f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 -- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 msgr2=0x7f60981f9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 0x7f60981f9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 -- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 msgr2=0x7f609815d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 0x7f609815d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 -- 172.21.15.18:0/3202058128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609815c320 con 0x7f609815bdb0 2024-04-25T10:08:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f6097200640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 0x7f60981f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f6096800640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 0x7f609815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608de00640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f60800119d0 tx=0x7f6080011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608000faf0 con 0x7f609815bdb0 2024-04-25T10:08:34.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608000fc90 con 0x7f609815bdb0 2024-04-25T10:08:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6080014440 con 0x7f609815bdb0 2024-04-25T10:08:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609815c600 con 0x7f609815bdb0 2024-04-25T10:08:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f609815cbc0 con 0x7f609815bdb0 2024-04-25T10:08:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60980745d0 con 0x7f609815bdb0 2024-04-25T10:08:34.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.898+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6080012040 con 0x7f609815bdb0 2024-04-25T10:08:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.902+0000 7f608f400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 0x7f6074069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.902+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f60800856c0 con 0x7f609815bdb0 2024-04-25T10:08:34.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.902+0000 7f6096800640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 0x7f6074069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:34.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.902+0000 7f6096800640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 0x7f6074069450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f60880aa000 tx=0x7f60880b0040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:34.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:34.902+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6080019030 con 0x7f609815bdb0 2024-04-25T10:08:35.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:35.106+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f60980b31c0 con 0x7f609815bdb0 2024-04-25T10:08:36.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.026+0000 7f608f400640 1 -- 172.21.15.18:0/3202058128 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v45) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6080056690 con 0x7f609815bdb0 2024-04-25T10:08:36.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 msgr2=0x7f6074069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 0x7f6074069450 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f60880aa000 tx=0x7f60880b0040 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 msgr2=0x7f60980ae150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f60800119d0 tx=0x7f6080011e90 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 shutdown_connections 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6074066f90 0x7f6074069450 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f60980ae690 0x7f60981f9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f609815bdb0 0x7f60980ae150 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 --2- 172.21.15.18:0/3202058128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c0039f0 0x7f609815d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 >> 172.21.15.18:0/3202058128 conn(0x7f6098067080 msgr2=0x7f60980b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 shutdown_connections 2024-04-25T10:08:36.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.030+0000 7f609d400640 1 -- 172.21.15.18:0/3202058128 wait complete. 2024-04-25T10:08:36.061 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:08:36.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:08:36.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 Processor -- start 2024-04-25T10:08:36.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 -- start start 2024-04-25T10:08:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406ac10 con 0x7f0db4072210 2024-04-25T10:08:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db406aeb0 con 0x7f0db415dd90 2024-04-25T10:08:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dbb600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db40b2dc0 con 0x7f0db40cf3b0 2024-04-25T10:08:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dabe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0db4072210 0x7f0db40cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51678/0 (socket says 172.21.15.18:51678) 2024-04-25T10:08:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0dabe00640 1 -- 172.21.15.18:0/1423937546 learned_addr learned my addr 172.21.15.18:0/1423937546 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db9600640 1 --2- 172.21.15.18:0/1423937546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858801696 0 0) 0x7f0db406ac10 con 0x7f0db4072210 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d98003530 con 0x7f0db4072210 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652207020 0 0) 0x7f0db406aeb0 con 0x7f0db415dd90 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db406ac10 con 0x7f0db415dd90 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1162863481 0 0) 0x7f0d98003530 con 0x7f0db4072210 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db9600640 1 -- 172.21.15.18:0/1423937546 >> v1:172.21.15.167:6789/0 conn(0x7f0db415dd90 legacy=0x7f0db4071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db9600640 1 -- 172.21.15.18:0/1423937546 >> v1:172.21.15.18:6789/0 conn(0x7f0db4072210 legacy=0x7f0db40cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.202+0000 7f0db9600640 1 -- 172.21.15.18:0/1423937546 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db406b190 con 0x7f0db40cf3b0 2024-04-25T10:08:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0db9600640 1 --2- 172.21.15.18:0/1423937546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4168ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac01c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c42f10d5cb3b77f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:36.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac0b2070 con 0x7f0db40cf3b0 2024-04-25T10:08:36.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0a5550 con 0x7f0db40cf3b0 2024-04-25T10:08:36.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0db3e00640 1 -- 172.21.15.18:0/1423937546 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c001680 con 0x7f0db40cf3b0 2024-04-25T10:08:36.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 -- 172.21.15.18:0/1423937546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 msgr2=0x7f0db4168ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 --2- 172.21.15.18:0/1423937546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4168ab0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009dc0 tx=0x7f0dac01c820 comp rx=0 tx=0).stop 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 -- 172.21.15.18:0/1423937546 shutdown_connections 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 --2- 172.21.15.18:0/1423937546 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4168ab0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 -- 172.21.15.18:0/1423937546 >> 172.21.15.18:0/1423937546 conn(0x7f0db40cfd90 msgr2=0x7f0db40d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 -- 172.21.15.18:0/1423937546 shutdown_connections 2024-04-25T10:08:36.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.206+0000 7f0dbb600640 1 -- 172.21.15.18:0/1423937546 wait complete. 2024-04-25T10:08:36.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 Processor -- start 2024-04-25T10:08:36.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 -- start start 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0db415dd90 0x7f0db41492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db416b990 con 0x7f0db4072210 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db416b810 con 0x7f0db415dd90 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dbb600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db416bb10 con 0x7f0db40cf3b0 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42680/0 (socket says 172.21.15.18:42680) 2024-04-25T10:08:36.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 -- 172.21.15.18:0/3644930477 learned_addr learned my addr 172.21.15.18:0/3644930477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0dabe00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db9600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0db415dd90 0x7f0db41492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 -- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 msgr2=0x7f0db4148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 -- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0db415dd90 msgr2=0x7f0db41492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0db415dd90 0x7f0db41492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 -- 172.21.15.18:0/3644930477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db415bba0 con 0x7f0db4072210 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db8c00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c4c0 tx=0x7f0da400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da40052d0 con 0x7f0db4072210 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.210+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da4005470 con 0x7f0db4072210 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4012870 con 0x7f0db4072210 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db415be80 con 0x7f0db4072210 2024-04-25T10:08:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db415c440 con 0x7f0db4072210 2024-04-25T10:08:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db40671b0 con 0x7f0db4072210 2024-04-25T10:08:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0da4012a10 con 0x7f0db4072210 2024-04-25T10:08:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0db1600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 0x7f0d90069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0da4084d00 con 0x7f0db4072210 2024-04-25T10:08:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0dabe00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 0x7f0d90069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.214+0000 7f0dabe00640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 0x7f0d90069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0db41611f0 tx=0x7f0d9c001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.218+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0da4055530 con 0x7f0db4072210 2024-04-25T10:08:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:36.418+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0db415b150 con 0x7f0db4072210 2024-04-25T10:08:37.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.026+0000 7f0db1600640 1 -- 172.21.15.18:0/3644930477 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0da40595d0 con 0x7f0db4072210 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 msgr2=0x7f0d90069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 0x7f0d90069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0db41611f0 tx=0x7f0d9c001700 comp rx=0 tx=0).stop 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 msgr2=0x7f0db4160cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0da400c4c0 tx=0x7f0da400c980 comp rx=0 tx=0).stop 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 shutdown_connections 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0db415dd90 0x7f0db41492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0d90066f60 0x7f0d90069420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0db40cf3b0 0x7f0db4148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 --2- 172.21.15.18:0/3644930477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0db4072210 0x7f0db4160cb0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 >> 172.21.15.18:0/3644930477 conn(0x7f0db40cfd90 msgr2=0x7f0db4071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 shutdown_connections 2024-04-25T10:08:37.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.030+0000 7f0dbb600640 1 -- 172.21.15.18:0/3644930477 wait complete. 2024-04-25T10:08:37.060 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:08:37.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 Processor -- start 2024-04-25T10:08:37.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 -- start start 2024-04-25T10:08:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47b00d0e80 0x7f47b00d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00ce810 con 0x7f47b015deb0 2024-04-25T10:08:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00d1be0 con 0x7f47b00d0e80 2024-04-25T10:08:37.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0162720 con 0x7f47b015dad0 2024-04-25T10:08:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:47160/0 (socket says 172.21.15.18:47160) 2024-04-25T10:08:37.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 -- 172.21.15.18:0/2680870785 learned_addr learned my addr 172.21.15.18:0/2680870785 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b5800640 1 --2- 172.21.15.18:0/2680870785 >> v2:172.21.15.167:3300/0 conn(0x7f47b00d0e80 0x7f47b00d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 -- 172.21.15.18:0/2680870785 >> v2:172.21.15.167:3300/0 conn(0x7f47b00d0e80 msgr2=0x7f47b00d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 --2- 172.21.15.18:0/2680870785 >> v2:172.21.15.167:3300/0 conn(0x7f47b00d0e80 0x7f47b00d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 -- 172.21.15.18:0/2680870785 >> v1:172.21.15.167:6789/0 conn(0x7f47b015deb0 legacy=0x7f47b00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47b4e00640 1 -- 172.21.15.18:0/2680870785 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00ceaf0 con 0x7f47b015dad0 2024-04-25T10:08:37.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.194+0000 7f47afe00640 1 -- 172.21.15.18:0/2680870785 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727908168 0 0) 0x7f47b00ce810 con 0x7f47b015deb0 2024-04-25T10:08:37.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b4e00640 1 --2- 172.21.15.18:0/2680870785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9920c81489debc0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47afe00640 1 -- 172.21.15.18:0/2680870785 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00ab640 con 0x7f47b015dad0 2024-04-25T10:08:37.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47afe00640 1 -- 172.21.15.18:0/2680870785 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a00b0070 con 0x7f47b015dad0 2024-04-25T10:08:37.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47afe00640 1 -- 172.21.15.18:0/2680870785 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00aba00 con 0x7f47b015dad0 2024-04-25T10:08:37.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 -- 172.21.15.18:0/2680870785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 msgr2=0x7f47b01621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 --2- 172.21.15.18:0/2680870785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f47a0009870 tx=0x7f47a001c530 comp rx=0 tx=0).stop 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 -- 172.21.15.18:0/2680870785 shutdown_connections 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 --2- 172.21.15.18:0/2680870785 >> v2:172.21.15.167:3300/0 conn(0x7f47b00d0e80 0x7f47b00d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 --2- 172.21.15.18:0/2680870785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b015dad0 0x7f47b01621e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 -- 172.21.15.18:0/2680870785 >> 172.21.15.18:0/2680870785 conn(0x7f47b00b5900 msgr2=0x7f47b00b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 -- 172.21.15.18:0/2680870785 shutdown_connections 2024-04-25T10:08:37.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.198+0000 7f47b7800640 1 -- 172.21.15.18:0/2680870785 wait complete. 2024-04-25T10:08:37.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 Processor -- start 2024-04-25T10:08:37.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- start start 2024-04-25T10:08:37.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 0x7f47b0153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 0x7f47b0142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00d3190 con 0x7f47b015deb0 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00d3010 con 0x7f47b015dad0 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00d3310 con 0x7f47b00d0e80 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42688/0 (socket says 172.21.15.18:42688) 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 -- 172.21.15.18:0/4142703886 learned_addr learned my addr 172.21.15.18:0/4142703886 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b4e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 0x7f47b0153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 -- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 msgr2=0x7f47b0153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47a7e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 0x7f47b0142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 0x7f47b0153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 -- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 msgr2=0x7f47b0142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 0x7f47b0142800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 -- 172.21.15.18:0/4142703886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0142d40 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b4e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 0x7f47b0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47a7e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 0x7f47b0142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b5800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009e30 tx=0x7f47a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8018020 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8014480 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8014870 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b0154480 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.202+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b0154a40 con 0x7f47b015deb0 2024-04-25T10:08:37.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00745d0 con 0x7f47b015deb0 2024-04-25T10:08:37.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f47a801b020 con 0x7f47b015deb0 2024-04-25T10:08:37.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47ad600640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 0x7f478c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f47a8086140 con 0x7f47b015deb0 2024-04-25T10:08:37.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47b4e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 0x7f478c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.206+0000 7f47b4e00640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 0x7f478c069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f47a00af000 tx=0x7f47a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.210+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47a8022030 con 0x7f47b015deb0 2024-04-25T10:08:37.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47b00d16e0 con 0x7f47b015deb0 2024-04-25T10:08:37.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47ad600640 1 -- 172.21.15.18:0/4142703886 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f47a8010040 con 0x7f47b015deb0 2024-04-25T10:08:37.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:37.417 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:36.421005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35843":{"gid":35843,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/301895266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":301895266},{"type":"v1","addr":"172.21.15.18:6835","nonce":301895266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:37.418 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 46 2024-04-25T10:08:37.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 msgr2=0x7f478c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 0x7f478c069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f47a00af000 tx=0x7f47a0008040 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 msgr2=0x7f47b01536f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009e30 tx=0x7f47a800c490 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 shutdown_connections 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47b015deb0 0x7f47b01536f0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b015dad0 0x7f47b0142800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f478c066f60 0x7f478c069420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 --2- 172.21.15.18:0/4142703886 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47b00d0e80 0x7f47b0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 >> 172.21.15.18:0/4142703886 conn(0x7f47b00b5900 msgr2=0x7f47b00b90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 shutdown_connections 2024-04-25T10:08:37.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.410+0000 7f47b7800640 1 -- 172.21.15.18:0/4142703886 wait complete. 2024-04-25T10:08:37.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.574+0000 7f667aa00640 1 Processor -- start 2024-04-25T10:08:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.574+0000 7f667aa00640 1 -- start start 2024-04-25T10:08:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.574+0000 7f667aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f667406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.574+0000 7f667aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f66740af8f0 0x7f667406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f667aa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6674161870 con 0x7f66740b3700 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f667aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6674161b50 con 0x7f66740af8f0 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f667aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6674161e30 con 0x7f667415dbc0 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6678a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f66740b3700 0x7f667406fb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51688/0 (socket says 172.21.15.18:51688) 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6678a00640 1 -- 172.21.15.18:0/3243448028 learned_addr learned my addr 172.21.15.18:0/3243448028 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 --2- 172.21.15.18:0/3243448028 >> v2:172.21.15.18:3300/0 conn(0x7f66740af8f0 0x7f667406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673e00640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f667406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673400640 1 -- 172.21.15.18:0/3243448028 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269040580 0 0) 0x7f6674161870 con 0x7f66740b3700 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673400640 1 -- 172.21.15.18:0/3243448028 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6658003530 con 0x7f66740b3700 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 -- 172.21.15.18:0/3243448028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 msgr2=0x7f667406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f667406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 -- 172.21.15.18:0/3243448028 >> v1:172.21.15.18:6789/0 conn(0x7f66740b3700 legacy=0x7f667406fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 -- 172.21.15.18:0/3243448028 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674162110 con 0x7f66740af8f0 2024-04-25T10:08:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f666b400640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f667406b150 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f665c0097c0 tx=0x7f665c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62dce4ef9d2c77c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673400640 1 -- 172.21.15.18:0/3243448028 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0a7070 con 0x7f66740af8f0 2024-04-25T10:08:37.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673400640 1 -- 172.21.15.18:0/3243448028 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c0b0070 con 0x7f66740af8f0 2024-04-25T10:08:37.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.578+0000 7f6673400640 1 -- 172.21.15.18:0/3243448028 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0ab890 con 0x7f66740af8f0 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- 172.21.15.18:0/3243448028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 msgr2=0x7f667406b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f667406b150 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f665c0097c0 tx=0x7f665c01c470 comp rx=0 tx=0).stop 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- 172.21.15.18:0/3243448028 shutdown_connections 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f667406b150 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- 172.21.15.18:0/3243448028 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f667406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- 172.21.15.18:0/3243448028 >> 172.21.15.18:0/3243448028 conn(0x7f667406e3a0 msgr2=0x7f667406e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- 172.21.15.18:0/3243448028 shutdown_connections 2024-04-25T10:08:37.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- 172.21.15.18:0/3243448028 wait complete. 2024-04-25T10:08:37.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 Processor -- start 2024-04-25T10:08:37.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- start start 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66740b3700 0x7f66740b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f66741554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667416ad90 con 0x7f66740af8f0 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667416ac10 con 0x7f66740b3700 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f667aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667416af10 con 0x7f667415dbc0 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42716/0 (socket says 172.21.15.18:42716) 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 -- 172.21.15.18:0/1950187054 learned_addr learned my addr 172.21.15.18:0/1950187054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6678a00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f66741554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f666b400640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66740b3700 0x7f66740b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 -- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 msgr2=0x7f66741554a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f66741554a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 -- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66740b3700 msgr2=0x7f66740b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66740b3700 0x7f66740b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.582+0000 7f6673e00640 1 -- 172.21.15.18:0/1950187054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66740b1e70 con 0x7f66740af8f0 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6673e00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f666400e870 tx=0x7f666400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664017070 con 0x7f66740af8f0 2024-04-25T10:08:37.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666400c8e0 con 0x7f66740af8f0 2024-04-25T10:08:37.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666400cc90 con 0x7f66740af8f0 2024-04-25T10:08:37.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66740b2150 con 0x7f66740af8f0 2024-04-25T10:08:37.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66740b29f0 con 0x7f66740af8f0 2024-04-25T10:08:37.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66740b2320 con 0x7f66740af8f0 2024-04-25T10:08:37.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f666401a070 con 0x7f66740af8f0 2024-04-25T10:08:37.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 0x7f6650069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66640853c0 con 0x7f66740af8f0 2024-04-25T10:08:37.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.586+0000 7f666b400640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 0x7f6650069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.590+0000 7f666b400640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 0x7f6650069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f665c0af000 tx=0x7f665c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.590+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6664056230 con 0x7f66740af8f0 2024-04-25T10:08:37.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.758+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66740745d0 con 0x7f66740af8f0 2024-04-25T10:08:37.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.758+0000 7f6670c00640 1 -- 172.21.15.18:0/1950187054 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16921 (secure 0 0 0) 0x7f6664055b30 con 0x7f66740af8f0 2024-04-25T10:08:37.767 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:37.767 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:34.995107+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 msgr2=0x7f6650069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 0x7f6650069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f665c0af000 tx=0x7f665c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 msgr2=0x7f66740cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f666400e870 tx=0x7f666400ec70 comp rx=0 tx=0).stop 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 shutdown_connections 2024-04-25T10:08:37.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6650066f60 0x7f6650069420 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f667415dbc0 0x7f66741554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66740b3700 0x7f66740b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 --2- 172.21.15.18:0/1950187054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66740af8f0 0x7f66740cea60 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 >> 172.21.15.18:0/1950187054 conn(0x7f667406e3a0 msgr2=0x7f66740c9a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 shutdown_connections 2024-04-25T10:08:37.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.762+0000 7f667aa00640 1 -- 172.21.15.18:0/1950187054 wait complete. 2024-04-25T10:08:37.789 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:08:37.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:08:37.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 Processor -- start 2024-04-25T10:08:37.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 -- start start 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e6415ee00 0x7f2e6406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e640cff30 0x7f2e640d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e6406c650 con 0x7f2e64099a60 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e6406c930 con 0x7f2e640cff30 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6406cc10 con 0x7f2e6415ee00 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e69600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2e64099a60 0x7f2e64099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51696/0 (socket says 172.21.15.18:51696) 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e69600640 1 -- 172.21.15.18:0/73269376 learned_addr learned my addr 172.21.15.18:0/73269376 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6a000640 1 --2- 172.21.15.18:0/73269376 >> v2:172.21.15.18:3300/0 conn(0x7f2e640cff30 0x7f2e640d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e68c00640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e6415ee00 0x7f2e6406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e63e00640 1 -- 172.21.15.18:0/73269376 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670703196 0 0) 0x7f2e6406c650 con 0x7f2e64099a60 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e63e00640 1 -- 172.21.15.18:0/73269376 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e4c003530 con 0x7f2e64099a60 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6a000640 1 -- 172.21.15.18:0/73269376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e6415ee00 msgr2=0x7f2e6406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6a000640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e6415ee00 0x7f2e6406bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6a000640 1 -- 172.21.15.18:0/73269376 >> v1:172.21.15.18:6789/0 conn(0x7f2e64099a60 legacy=0x7f2e64099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.922+0000 7f2e6a000640 1 -- 172.21.15.18:0/73269376 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6406cef0 con 0x7f2e640cff30 2024-04-25T10:08:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6a000640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e640cff30 0x7f2e640d03e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009d90 tx=0x7f2e5c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7400db4df87a0dc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e63e00640 1 -- 172.21.15.18:0/73269376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0b2070 con 0x7f2e640cff30 2024-04-25T10:08:37.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e63e00640 1 -- 172.21.15.18:0/73269376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0a5830 con 0x7f2e640cff30 2024-04-25T10:08:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e63e00640 1 -- 172.21.15.18:0/73269376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0a5c00 con 0x7f2e640cff30 2024-04-25T10:08:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 -- 172.21.15.18:0/73269376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e640cff30 msgr2=0x7f2e640d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e640cff30 0x7f2e640d03e0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009d90 tx=0x7f2e5c01c970 comp rx=0 tx=0).stop 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 -- 172.21.15.18:0/73269376 shutdown_connections 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e640cff30 0x7f2e640d03e0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 --2- 172.21.15.18:0/73269376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e6415ee00 0x7f2e6406bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 -- 172.21.15.18:0/73269376 >> 172.21.15.18:0/73269376 conn(0x7f2e640d17a0 msgr2=0x7f2e640d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 -- 172.21.15.18:0/73269376 shutdown_connections 2024-04-25T10:08:37.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.926+0000 7f2e6c000640 1 -- 172.21.15.18:0/73269376 wait complete. 2024-04-25T10:08:37.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 Processor -- start 2024-04-25T10:08:37.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- start start 2024-04-25T10:08:37.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 0x7f2e6415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e640cff30 0x7f2e64144030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6416ab80 con 0x7f2e6415ee00 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6416aa00 con 0x7f2e64099a60 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e6416ad00 con 0x7f2e640cff30 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42738/0 (socket says 172.21.15.18:42738) 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 -- 172.21.15.18:0/1940156599 learned_addr learned my addr 172.21.15.18:0/1940156599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e68c00640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e640cff30 0x7f2e64144030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e69600640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 0x7f2e6415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 -- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e640cff30 msgr2=0x7f2e64144030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e640cff30 0x7f2e64144030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 -- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 msgr2=0x7f2e6415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 0x7f2e6415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 -- 172.21.15.18:0/1940156599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64147ea0 con 0x7f2e6415ee00 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e69600640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 0x7f2e6415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6a000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009d90 tx=0x7f2e5c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0b2050 con 0x7f2e6415ee00 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0be070 con 0x7f2e6415ee00 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e64148180 con 0x7f2e6415ee00 2024-04-25T10:08:37.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c0ad890 con 0x7f2e6415ee00 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.930+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e64148740 con 0x7f2e6415ee00 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e640745d0 con 0x7f2e6415ee00 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2e5c0ada30 con 0x7f2e6415ee00 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e61600640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 0x7f2e44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2e5c120190 con 0x7f2e6415ee00 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e69600640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 0x7f2e44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:37.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.934+0000 7f2e69600640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 0x7f2e44069420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2e58005890 tx=0x7f2e58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:37.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:37.938+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2e5c016560 con 0x7f2e6415ee00 2024-04-25T10:08:38.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.098+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e64147c50 con 0x7f2e44066f60 2024-04-25T10:08:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.106+0000 7f2e61600640 1 -- 172.21.15.18:0/1940156599 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248409 (secure 0 0 0) 0x7f2e64147c50 con 0x7f2e44066f60 2024-04-25T10:08:38.118 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:08:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 msgr2=0x7f2e44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 0x7f2e44069420 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2e58005890 tx=0x7f2e58009040 comp rx=0 tx=0).stop 2024-04-25T10:08:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 msgr2=0x7f2e64158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c009d90 tx=0x7f2e5c019710 comp rx=0 tx=0).stop 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 shutdown_connections 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e6415ee00 0x7f2e64158f20 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2e44066f60 0x7f2e44069420 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2e640cff30 0x7f2e64144030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 --2- 172.21.15.18:0/1940156599 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2e64099a60 0x7f2e6415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 >> 172.21.15.18:0/1940156599 conn(0x7f2e640d17a0 msgr2=0x7f2e6406fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 shutdown_connections 2024-04-25T10:08:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.110+0000 7f2e6c000640 1 -- 172.21.15.18:0/1940156599 wait complete. 2024-04-25T10:08:38.137 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-25T10:08:37.466504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249864,"kb_used_data":8704,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724856,"statfs":{"total":773094113280,"available":772838252544,"internally_reserved":0,"allocated":8912896,"data_stored":4697014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.487201"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999572+0000","last_change":"2024-04-25T10:08:32.999572+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999572+0000","last_undegraded":"2024-04-25T10:08:32.999572+0000","last_fullsized":"2024-04-25T10:08:32.999572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029526+0000","last_change":"2024-04-25T10:08:34.021493+0000","last_active":"2024-04-25T10:08:35.029526+0000","last_peered":"2024-04-25T10:08:35.029526+0000","last_clean":"2024-04-25T10:08:35.029526+0000","last_became_active":"2024-04-25T10:08:34.021186+0000","last_became_peered":"2024-04-25T10:08:34.021186+0000","last_unstale":"2024-04-25T10:08:35.029526+0000","last_undegraded":"2024-04-25T10:08:35.029526+0000","last_fullsized":"2024-04-25T10:08:35.029526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:42.229181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998998+0000","last_change":"2024-04-25T10:08:34.025282+0000","last_active":"2024-04-25T10:08:34.998998+0000","last_peered":"2024-04-25T10:08:34.998998+0000","last_clean":"2024-04-25T10:08:34.998998+0000","last_became_active":"2024-04-25T10:08:34.025024+0000","last_became_peered":"2024-04-25T10:08:34.025024+0000","last_unstale":"2024-04-25T10:08:34.998998+0000","last_undegraded":"2024-04-25T10:08:34.998998+0000","last_fullsized":"2024-04-25T10:08:34.998998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997864+0000","last_change":"2024-04-25T10:08:32.997864+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997864+0000","last_undegraded":"2024-04-25T10:08:32.997864+0000","last_fullsized":"2024-04-25T10:08:32.997864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031585+0000","last_change":"2024-04-25T10:08:34.017231+0000","last_active":"2024-04-25T10:08:35.031585+0000","last_peered":"2024-04-25T10:08:35.031585+0000","last_clean":"2024-04-25T10:08:35.031585+0000","last_became_active":"2024-04-25T10:08:34.016095+0000","last_became_peered":"2024-04-25T10:08:34.016095+0000","last_unstale":"2024-04-25T10:08:35.031585+0000","last_undegraded":"2024-04-25T10:08:35.031585+0000","last_fullsized":"2024-04-25T10:08:35.031585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.605425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990198+0000","last_change":"2024-04-25T10:08:32.990198+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990198+0000","last_undegraded":"2024-04-25T10:08:32.990198+0000","last_fullsized":"2024-04-25T10:08:32.990198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031661+0000","last_change":"2024-04-25T10:08:34.017931+0000","last_active":"2024-04-25T10:08:35.031661+0000","last_peered":"2024-04-25T10:08:35.031661+0000","last_clean":"2024-04-25T10:08:35.031661+0000","last_became_active":"2024-04-25T10:08:34.017586+0000","last_became_peered":"2024-04-25T10:08:34.017586+0000","last_unstale":"2024-04-25T10:08:35.031661+0000","last_undegraded":"2024-04-25T10:08:35.031661+0000","last_fullsized":"2024-04-25T10:08:35.031661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:49.996965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990781+0000","last_change":"2024-04-25T10:08:32.990781+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990781+0000","last_undegraded":"2024-04-25T10:08:32.990781+0000","last_fullsized":"2024-04-25T10:08:32.990781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998080+0000","last_change":"2024-04-25T10:08:32.998080+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998080+0000","last_undegraded":"2024-04-25T10:08:32.998080+0000","last_fullsized":"2024-04-25T10:08:32.998080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029377+0000","last_change":"2024-04-25T10:08:34.026807+0000","last_active":"2024-04-25T10:08:35.029377+0000","last_peered":"2024-04-25T10:08:35.029377+0000","last_clean":"2024-04-25T10:08:35.029377+0000","last_became_active":"2024-04-25T10:08:34.025681+0000","last_became_peered":"2024-04-25T10:08:34.025681+0000","last_unstale":"2024-04-25T10:08:35.029377+0000","last_undegraded":"2024-04-25T10:08:35.029377+0000","last_fullsized":"2024-04-25T10:08:35.029377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.077735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997374+0000","last_change":"2024-04-25T10:08:32.997374+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997374+0000","last_undegraded":"2024-04-25T10:08:32.997374+0000","last_fullsized":"2024-04-25T10:08:32.997374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031744+0000","last_change":"2024-04-25T10:08:34.015665+0000","last_active":"2024-04-25T10:08:35.031744+0000","last_peered":"2024-04-25T10:08:35.031744+0000","last_clean":"2024-04-25T10:08:35.031744+0000","last_became_active":"2024-04-25T10:08:34.015246+0000","last_became_peered":"2024-04-25T10:08:34.015246+0000","last_unstale":"2024-04-25T10:08:35.031744+0000","last_undegraded":"2024-04-25T10:08:35.031744+0000","last_fullsized":"2024-04-25T10:08:35.031744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028905+0000","last_change":"2024-04-25T10:08:34.014342+0000","last_active":"2024-04-25T10:08:35.028905+0000","last_peered":"2024-04-25T10:08:35.028905+0000","last_clean":"2024-04-25T10:08:35.028905+0000","last_became_active":"2024-04-25T10:08:34.014011+0000","last_became_peered":"2024-04-25T10:08:34.014011+0000","last_unstale":"2024-04-25T10:08:35.028905+0000","last_undegraded":"2024-04-25T10:08:35.028905+0000","last_fullsized":"2024-04-25T10:08:35.028905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:40.898281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996176+0000","last_change":"2024-04-25T10:08:32.996176+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996176+0000","last_undegraded":"2024-04-25T10:08:32.996176+0000","last_fullsized":"2024-04-25T10:08:32.996176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031908+0000","last_change":"2024-04-25T10:08:34.011449+0000","last_active":"2024-04-25T10:08:35.031908+0000","last_peered":"2024-04-25T10:08:35.031908+0000","last_clean":"2024-04-25T10:08:35.031908+0000","last_became_active":"2024-04-25T10:08:34.011147+0000","last_became_peered":"2024-04-25T10:08:34.011147+0000","last_unstale":"2024-04-25T10:08:35.031908+0000","last_undegraded":"2024-04-25T10:08:35.031908+0000","last_fullsized":"2024-04-25T10:08:35.031908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.893587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999000+0000","last_change":"2024-04-25T10:08:34.010473+0000","last_active":"2024-04-25T10:08:34.999000+0000","last_peered":"2024-04-25T10:08:34.999000+0000","last_clean":"2024-04-25T10:08:34.999000+0000","last_became_active":"2024-04-25T10:08:34.010053+0000","last_became_peered":"2024-04-25T10:08:34.010053+0000","last_unstale":"2024-04-25T10:08:34.999000+0000","last_undegraded":"2024-04-25T10:08:34.999000+0000","last_fullsized":"2024-04-25T10:08:34.999000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031767+0000","last_change":"2024-04-25T10:08:34.007070+0000","last_active":"2024-04-25T10:08:35.031767+0000","last_peered":"2024-04-25T10:08:35.031767+0000","last_clean":"2024-04-25T10:08:35.031767+0000","last_became_active":"2024-04-25T10:08:34.006804+0000","last_became_peered":"2024-04-25T10:08:34.006804+0000","last_unstale":"2024-04-25T10:08:35.031767+0000","last_undegraded":"2024-04-25T10:08:35.031767+0000","last_fullsized":"2024-04-25T10:08:35.031767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:41.897342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992122+0000","last_change":"2024-04-25T10:08:32.992122+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992122+0000","last_undegraded":"2024-04-25T10:08:32.992122+0000","last_fullsized":"2024-04-25T10:08:32.992122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031521+0000","last_change":"2024-04-25T10:08:34.020307+0000","last_active":"2024-04-25T10:08:35.031521+0000","last_peered":"2024-04-25T10:08:35.031521+0000","last_clean":"2024-04-25T10:08:35.031521+0000","last_became_active":"2024-04-25T10:08:34.018096+0000","last_became_peered":"2024-04-25T10:08:34.018096+0000","last_unstale":"2024-04-25T10:08:35.031521+0000","last_undegraded":"2024-04-25T10:08:35.031521+0000","last_fullsized":"2024-04-25T10:08:35.031521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:36.687476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.988735+0000","last_change":"2024-04-25T10:08:32.988735+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.988735+0000","last_undegraded":"2024-04-25T10:08:32.988735+0000","last_fullsized":"2024-04-25T10:08:32.988735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028846+0000","last_change":"2024-04-25T10:08:34.026585+0000","last_active":"2024-04-25T10:08:35.028846+0000","last_peered":"2024-04-25T10:08:35.028846+0000","last_clean":"2024-04-25T10:08:35.028846+0000","last_became_active":"2024-04-25T10:08:34.026274+0000","last_became_peered":"2024-04-25T10:08:34.026274+0000","last_unstale":"2024-04-25T10:08:35.028846+0000","last_undegraded":"2024-04-25T10:08:35.028846+0000","last_fullsized":"2024-04-25T10:08:35.028846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:41.217493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029490+0000","last_change":"2024-04-25T10:08:34.025864+0000","last_active":"2024-04-25T10:08:35.029490+0000","last_peered":"2024-04-25T10:08:35.029490+0000","last_clean":"2024-04-25T10:08:35.029490+0000","last_became_active":"2024-04-25T10:08:34.025510+0000","last_became_peered":"2024-04-25T10:08:34.025510+0000","last_unstale":"2024-04-25T10:08:35.029490+0000","last_undegraded":"2024-04-25T10:08:35.029490+0000","last_fullsized":"2024-04-25T10:08:35.029490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996041+0000","last_change":"2024-04-25T10:08:32.996041+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996041+0000","last_undegraded":"2024-04-25T10:08:32.996041+0000","last_fullsized":"2024-04-25T10:08:32.996041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999201+0000","last_change":"2024-04-25T10:08:32.999201+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999201+0000","last_undegraded":"2024-04-25T10:08:32.999201+0000","last_fullsized":"2024-04-25T10:08:32.999201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031801+0000","last_change":"2024-04-25T10:08:34.030709+0000","last_active":"2024-04-25T10:08:35.031801+0000","last_peered":"2024-04-25T10:08:35.031801+0000","last_clean":"2024-04-25T10:08:35.031801+0000","last_became_active":"2024-04-25T10:08:34.030384+0000","last_became_peered":"2024-04-25T10:08:34.030384+0000","last_unstale":"2024-04-25T10:08:35.031801+0000","last_undegraded":"2024-04-25T10:08:35.031801+0000","last_fullsized":"2024-04-25T10:08:35.031801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:10.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029152+0000","last_change":"2024-04-25T10:08:34.020753+0000","last_active":"2024-04-25T10:08:35.029152+0000","last_peered":"2024-04-25T10:08:35.029152+0000","last_clean":"2024-04-25T10:08:35.029152+0000","last_became_active":"2024-04-25T10:08:34.020394+0000","last_became_peered":"2024-04-25T10:08:34.020394+0000","last_unstale":"2024-04-25T10:08:35.029152+0000","last_undegraded":"2024-04-25T10:08:35.029152+0000","last_fullsized":"2024-04-25T10:08:35.029152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:51.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996331+0000","last_change":"2024-04-25T10:08:32.996331+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996331+0000","last_undegraded":"2024-04-25T10:08:32.996331+0000","last_fullsized":"2024-04-25T10:08:32.996331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999136+0000","last_change":"2024-04-25T10:08:34.009888+0000","last_active":"2024-04-25T10:08:34.999136+0000","last_peered":"2024-04-25T10:08:34.999136+0000","last_clean":"2024-04-25T10:08:34.999136+0000","last_became_active":"2024-04-25T10:08:34.008686+0000","last_became_peered":"2024-04-25T10:08:34.008686+0000","last_unstale":"2024-04-25T10:08:34.999136+0000","last_undegraded":"2024-04-25T10:08:34.999136+0000","last_fullsized":"2024-04-25T10:08:34.999136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995643+0000","last_change":"2024-04-25T10:08:32.995643+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995643+0000","last_undegraded":"2024-04-25T10:08:32.995643+0000","last_fullsized":"2024-04-25T10:08:32.995643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999140+0000","last_change":"2024-04-25T10:08:34.011122+0000","last_active":"2024-04-25T10:08:34.999140+0000","last_peered":"2024-04-25T10:08:34.999140+0000","last_clean":"2024-04-25T10:08:34.999140+0000","last_became_active":"2024-04-25T10:08:34.010868+0000","last_became_peered":"2024-04-25T10:08:34.010868+0000","last_unstale":"2024-04-25T10:08:34.999140+0000","last_undegraded":"2024-04-25T10:08:34.999140+0000","last_fullsized":"2024-04-25T10:08:34.999140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031894+0000","last_change":"2024-04-25T10:08:33.002480+0000","last_active":"2024-04-25T10:08:35.031894+0000","last_peered":"2024-04-25T10:08:35.031894+0000","last_clean":"2024-04-25T10:08:35.031894+0000","last_became_active":"2024-04-25T10:08:33.000086+0000","last_became_peered":"2024-04-25T10:08:33.000086+0000","last_unstale":"2024-04-25T10:08:35.031894+0000","last_undegraded":"2024-04-25T10:08:35.031894+0000","last_fullsized":"2024-04-25T10:08:35.031894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:57.411455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028904+0000","last_change":"2024-04-25T10:08:34.026292+0000","last_active":"2024-04-25T10:08:35.028904+0000","last_peered":"2024-04-25T10:08:35.028904+0000","last_clean":"2024-04-25T10:08:35.028904+0000","last_became_active":"2024-04-25T10:08:34.026020+0000","last_became_peered":"2024-04-25T10:08:34.026020+0000","last_unstale":"2024-04-25T10:08:35.028904+0000","last_undegraded":"2024-04-25T10:08:35.028904+0000","last_fullsized":"2024-04-25T10:08:35.028904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:52.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016511+0000","last_change":"2024-04-25T10:08:33.011515+0000","last_active":"2024-04-25T10:08:33.016511+0000","last_peered":"2024-04-25T10:08:33.016511+0000","last_clean":"2024-04-25T10:08:33.016511+0000","last_became_active":"2024-04-25T10:08:33.010837+0000","last_became_peered":"2024-04-25T10:08:33.010837+0000","last_unstale":"2024-04-25T10:08:33.016511+0000","last_undegraded":"2024-04-25T10:08:33.016511+0000","last_fullsized":"2024-04-25T10:08:33.016511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990913+0000","last_change":"2024-04-25T10:08:32.990913+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990913+0000","last_undegraded":"2024-04-25T10:08:32.990913+0000","last_fullsized":"2024-04-25T10:08:32.990913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016551+0000","last_change":"2024-04-25T10:08:33.011678+0000","last_active":"2024-04-25T10:08:33.016551+0000","last_peered":"2024-04-25T10:08:33.016551+0000","last_clean":"2024-04-25T10:08:33.016551+0000","last_became_active":"2024-04-25T10:08:33.011366+0000","last_became_peered":"2024-04-25T10:08:33.011366+0000","last_unstale":"2024-04-25T10:08:33.016551+0000","last_undegraded":"2024-04-25T10:08:33.016551+0000","last_fullsized":"2024-04-25T10:08:33.016551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:45.021233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991690+0000","last_change":"2024-04-25T10:08:32.991690+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991690+0000","last_undegraded":"2024-04-25T10:08:32.991690+0000","last_fullsized":"2024-04-25T10:08:32.991690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013359+0000","last_change":"2024-04-25T10:08:33.007013+0000","last_active":"2024-04-25T10:08:33.013359+0000","last_peered":"2024-04-25T10:08:33.013359+0000","last_clean":"2024-04-25T10:08:33.013359+0000","last_became_active":"2024-04-25T10:08:33.006754+0000","last_became_peered":"2024-04-25T10:08:33.006754+0000","last_unstale":"2024-04-25T10:08:33.013359+0000","last_undegraded":"2024-04-25T10:08:33.013359+0000","last_fullsized":"2024-04-25T10:08:33.013359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:53.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029185+0000","last_change":"2024-04-25T10:08:34.025084+0000","last_active":"2024-04-25T10:08:35.029185+0000","last_peered":"2024-04-25T10:08:35.029185+0000","last_clean":"2024-04-25T10:08:35.029185+0000","last_became_active":"2024-04-25T10:08:34.024770+0000","last_became_peered":"2024-04-25T10:08:34.024770+0000","last_unstale":"2024-04-25T10:08:35.029185+0000","last_undegraded":"2024-04-25T10:08:35.029185+0000","last_fullsized":"2024-04-25T10:08:35.029185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.334293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009630+0000","last_change":"2024-04-25T10:08:33.007061+0000","last_active":"2024-04-25T10:08:33.009630+0000","last_peered":"2024-04-25T10:08:33.009630+0000","last_clean":"2024-04-25T10:08:33.009630+0000","last_became_active":"2024-04-25T10:08:33.006778+0000","last_became_peered":"2024-04-25T10:08:33.006778+0000","last_unstale":"2024-04-25T10:08:33.009630+0000","last_undegraded":"2024-04-25T10:08:33.009630+0000","last_fullsized":"2024-04-25T10:08:33.009630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:01.724703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029446+0000","last_change":"2024-04-25T10:08:34.031090+0000","last_active":"2024-04-25T10:08:35.029446+0000","last_peered":"2024-04-25T10:08:35.029446+0000","last_clean":"2024-04-25T10:08:35.029446+0000","last_became_active":"2024-04-25T10:08:34.023940+0000","last_became_peered":"2024-04-25T10:08:34.023940+0000","last_unstale":"2024-04-25T10:08:35.029446+0000","last_undegraded":"2024-04-25T10:08:35.029446+0000","last_fullsized":"2024-04-25T10:08:35.029446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:28.981263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009561+0000","last_change":"2024-04-25T10:08:33.005514+0000","last_active":"2024-04-25T10:08:33.009561+0000","last_peered":"2024-04-25T10:08:33.009561+0000","last_clean":"2024-04-25T10:08:33.009561+0000","last_became_active":"2024-04-25T10:08:33.005250+0000","last_became_peered":"2024-04-25T10:08:33.005250+0000","last_unstale":"2024-04-25T10:08:33.009561+0000","last_undegraded":"2024-04-25T10:08:33.009561+0000","last_fullsized":"2024-04-25T10:08:33.009561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.993102+0000","last_change":"2024-04-25T10:08:32.993102+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.993102+0000","last_undegraded":"2024-04-25T10:08:32.993102+0000","last_fullsized":"2024-04-25T10:08:32.993102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028964+0000","last_change":"2024-04-25T10:08:33.006037+0000","last_active":"2024-04-25T10:08:35.028964+0000","last_peered":"2024-04-25T10:08:35.028964+0000","last_clean":"2024-04-25T10:08:35.028964+0000","last_became_active":"2024-04-25T10:08:33.005767+0000","last_became_peered":"2024-04-25T10:08:33.005767+0000","last_unstale":"2024-04-25T10:08:35.028964+0000","last_undegraded":"2024-04-25T10:08:35.028964+0000","last_fullsized":"2024-04-25T10:08:35.028964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:53.277350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992811+0000","last_change":"2024-04-25T10:08:32.992811+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992811+0000","last_undegraded":"2024-04-25T10:08:32.992811+0000","last_fullsized":"2024-04-25T10:08:32.992811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031330+0000","last_change":"2024-04-25T10:08:32.995936+0000","last_active":"2024-04-25T10:08:35.031330+0000","last_peered":"2024-04-25T10:08:35.031330+0000","last_clean":"2024-04-25T10:08:35.031330+0000","last_became_active":"2024-04-25T10:08:32.995620+0000","last_became_peered":"2024-04-25T10:08:32.995620+0000","last_unstale":"2024-04-25T10:08:35.031330+0000","last_undegraded":"2024-04-25T10:08:35.031330+0000","last_fullsized":"2024-04-25T10:08:35.031330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.564491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028864+0000","last_change":"2024-04-25T10:08:34.020243+0000","last_active":"2024-04-25T10:08:35.028864+0000","last_peered":"2024-04-25T10:08:35.028864+0000","last_clean":"2024-04-25T10:08:35.028864+0000","last_became_active":"2024-04-25T10:08:34.018667+0000","last_became_peered":"2024-04-25T10:08:34.018667+0000","last_unstale":"2024-04-25T10:08:35.028864+0000","last_undegraded":"2024-04-25T10:08:35.028864+0000","last_fullsized":"2024-04-25T10:08:35.028864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:08.399465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019207+0000","last_change":"2024-04-25T10:08:33.014183+0000","last_active":"2024-04-25T10:08:33.019207+0000","last_peered":"2024-04-25T10:08:33.019207+0000","last_clean":"2024-04-25T10:08:33.019207+0000","last_became_active":"2024-04-25T10:08:33.013867+0000","last_became_peered":"2024-04-25T10:08:33.013867+0000","last_unstale":"2024-04-25T10:08:33.019207+0000","last_undegraded":"2024-04-25T10:08:33.019207+0000","last_fullsized":"2024-04-25T10:08:33.019207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995420+0000","last_change":"2024-04-25T10:08:32.995420+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995420+0000","last_undegraded":"2024-04-25T10:08:32.995420+0000","last_fullsized":"2024-04-25T10:08:32.995420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009592+0000","last_change":"2024-04-25T10:08:33.007771+0000","last_active":"2024-04-25T10:08:33.009592+0000","last_peered":"2024-04-25T10:08:33.009592+0000","last_clean":"2024-04-25T10:08:33.009592+0000","last_became_active":"2024-04-25T10:08:33.006885+0000","last_became_peered":"2024-04-25T10:08:33.006885+0000","last_unstale":"2024-04-25T10:08:33.009592+0000","last_undegraded":"2024-04-25T10:08:33.009592+0000","last_fullsized":"2024-04-25T10:08:33.009592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031943+0000","last_change":"2024-04-25T10:08:33.000784+0000","last_active":"2024-04-25T10:08:35.031943+0000","last_peered":"2024-04-25T10:08:35.031943+0000","last_clean":"2024-04-25T10:08:35.031943+0000","last_became_active":"2024-04-25T10:08:33.000487+0000","last_became_peered":"2024-04-25T10:08:33.000487+0000","last_unstale":"2024-04-25T10:08:35.031943+0000","last_undegraded":"2024-04-25T10:08:35.031943+0000","last_fullsized":"2024-04-25T10:08:35.031943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:01.990140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999011+0000","last_change":"2024-04-25T10:08:34.024469+0000","last_active":"2024-04-25T10:08:34.999011+0000","last_peered":"2024-04-25T10:08:34.999011+0000","last_clean":"2024-04-25T10:08:34.999011+0000","last_became_active":"2024-04-25T10:08:34.024156+0000","last_became_peered":"2024-04-25T10:08:34.024156+0000","last_unstale":"2024-04-25T10:08:34.999011+0000","last_undegraded":"2024-04-25T10:08:34.999011+0000","last_fullsized":"2024-04-25T10:08:34.999011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.003564+0000","last_change":"2024-04-25T10:08:32.998633+0000","last_active":"2024-04-25T10:08:33.003564+0000","last_peered":"2024-04-25T10:08:33.003564+0000","last_clean":"2024-04-25T10:08:33.003564+0000","last_became_active":"2024-04-25T10:08:32.998332+0000","last_became_peered":"2024-04-25T10:08:32.998332+0000","last_unstale":"2024-04-25T10:08:33.003564+0000","last_undegraded":"2024-04-25T10:08:33.003564+0000","last_fullsized":"2024-04-25T10:08:33.003564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:15.122956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996477+0000","last_change":"2024-04-25T10:08:32.996477+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996477+0000","last_undegraded":"2024-04-25T10:08:32.996477+0000","last_fullsized":"2024-04-25T10:08:32.996477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009611+0000","last_change":"2024-04-25T10:08:33.006611+0000","last_active":"2024-04-25T10:08:33.009611+0000","last_peered":"2024-04-25T10:08:33.009611+0000","last_clean":"2024-04-25T10:08:33.009611+0000","last_became_active":"2024-04-25T10:08:33.006152+0000","last_became_peered":"2024-04-25T10:08:33.006152+0000","last_unstale":"2024-04-25T10:08:33.009611+0000","last_undegraded":"2024-04-25T10:08:33.009611+0000","last_fullsized":"2024-04-25T10:08:33.009611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992129+0000","last_change":"2024-04-25T10:08:32.992129+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992129+0000","last_undegraded":"2024-04-25T10:08:32.992129+0000","last_fullsized":"2024-04-25T10:08:32.992129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013736+0000","last_change":"2024-04-25T10:08:33.010430+0000","last_active":"2024-04-25T10:08:33.013736+0000","last_peered":"2024-04-25T10:08:33.013736+0000","last_clean":"2024-04-25T10:08:33.013736+0000","last_became_active":"2024-04-25T10:08:33.010028+0000","last_became_peered":"2024-04-25T10:08:33.010028+0000","last_unstale":"2024-04-25T10:08:33.013736+0000","last_undegraded":"2024-04-25T10:08:33.013736+0000","last_fullsized":"2024-04-25T10:08:33.013736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989438+0000","last_change":"2024-04-25T10:08:32.989438+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989438+0000","last_undegraded":"2024-04-25T10:08:32.989438+0000","last_fullsized":"2024-04-25T10:08:32.989438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031412+0000","last_change":"2024-04-25T10:08:33.000541+0000","last_active":"2024-04-25T10:08:35.031412+0000","last_peered":"2024-04-25T10:08:35.031412+0000","last_clean":"2024-04-25T10:08:35.031412+0000","last_became_active":"2024-04-25T10:08:33.000156+0000","last_became_peered":"2024-04-25T10:08:33.000156+0000","last_unstale":"2024-04-25T10:08:35.031412+0000","last_undegraded":"2024-04-25T10:08:35.031412+0000","last_fullsized":"2024-04-25T10:08:35.031412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:05.087355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992342+0000","last_change":"2024-04-25T10:08:32.992342+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992342+0000","last_undegraded":"2024-04-25T10:08:32.992342+0000","last_fullsized":"2024-04-25T10:08:32.992342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028931+0000","last_change":"2024-04-25T10:08:33.001887+0000","last_active":"2024-04-25T10:08:35.028931+0000","last_peered":"2024-04-25T10:08:35.028931+0000","last_clean":"2024-04-25T10:08:35.028931+0000","last_became_active":"2024-04-25T10:08:33.001619+0000","last_became_peered":"2024-04-25T10:08:33.001619+0000","last_unstale":"2024-04-25T10:08:35.028931+0000","last_undegraded":"2024-04-25T10:08:35.028931+0000","last_fullsized":"2024-04-25T10:08:35.028931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.189417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016533+0000","last_change":"2024-04-25T10:08:33.011663+0000","last_active":"2024-04-25T10:08:33.016533+0000","last_peered":"2024-04-25T10:08:33.016533+0000","last_clean":"2024-04-25T10:08:33.016533+0000","last_became_active":"2024-04-25T10:08:33.011338+0000","last_became_peered":"2024-04-25T10:08:33.011338+0000","last_unstale":"2024-04-25T10:08:33.016533+0000","last_undegraded":"2024-04-25T10:08:33.016533+0000","last_fullsized":"2024-04-25T10:08:33.016533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031552+0000","last_change":"2024-04-25T10:08:34.012127+0000","last_active":"2024-04-25T10:08:35.031552+0000","last_peered":"2024-04-25T10:08:35.031552+0000","last_clean":"2024-04-25T10:08:35.031552+0000","last_became_active":"2024-04-25T10:08:34.011736+0000","last_became_peered":"2024-04-25T10:08:34.011736+0000","last_unstale":"2024-04-25T10:08:35.031552+0000","last_undegraded":"2024-04-25T10:08:35.031552+0000","last_fullsized":"2024-04-25T10:08:35.031552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:16.153141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008148+0000","last_change":"2024-04-25T10:08:33.003042+0000","last_active":"2024-04-25T10:08:33.008148+0000","last_peered":"2024-04-25T10:08:33.008148+0000","last_clean":"2024-04-25T10:08:33.008148+0000","last_became_active":"2024-04-25T10:08:33.002788+0000","last_became_peered":"2024-04-25T10:08:33.002788+0000","last_unstale":"2024-04-25T10:08:33.008148+0000","last_undegraded":"2024-04-25T10:08:33.008148+0000","last_fullsized":"2024-04-25T10:08:33.008148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:09.025426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031642+0000","last_change":"2024-04-25T10:08:34.019681+0000","last_active":"2024-04-25T10:08:35.031642+0000","last_peered":"2024-04-25T10:08:35.031642+0000","last_clean":"2024-04-25T10:08:35.031642+0000","last_became_active":"2024-04-25T10:08:34.019409+0000","last_became_peered":"2024-04-25T10:08:34.019409+0000","last_unstale":"2024-04-25T10:08:35.031642+0000","last_undegraded":"2024-04-25T10:08:35.031642+0000","last_fullsized":"2024-04-25T10:08:35.031642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:04.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031975+0000","last_change":"2024-04-25T10:08:32.997942+0000","last_active":"2024-04-25T10:08:35.031975+0000","last_peered":"2024-04-25T10:08:35.031975+0000","last_clean":"2024-04-25T10:08:35.031975+0000","last_became_active":"2024-04-25T10:08:32.995849+0000","last_became_peered":"2024-04-25T10:08:32.995849+0000","last_unstale":"2024-04-25T10:08:35.031975+0000","last_undegraded":"2024-04-25T10:08:35.031975+0000","last_fullsized":"2024-04-25T10:08:35.031975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:13.109114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998886+0000","last_change":"2024-04-25T10:08:33.004697+0000","last_active":"2024-04-25T10:08:34.998886+0000","last_peered":"2024-04-25T10:08:34.998886+0000","last_clean":"2024-04-25T10:08:34.998886+0000","last_became_active":"2024-04-25T10:08:33.004438+0000","last_became_peered":"2024-04-25T10:08:33.004438+0000","last_unstale":"2024-04-25T10:08:34.998886+0000","last_undegraded":"2024-04-25T10:08:34.998886+0000","last_fullsized":"2024-04-25T10:08:34.998886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:27.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029208+0000","last_change":"2024-04-25T10:08:34.030460+0000","last_active":"2024-04-25T10:08:35.029208+0000","last_peered":"2024-04-25T10:08:35.029208+0000","last_clean":"2024-04-25T10:08:35.029208+0000","last_became_active":"2024-04-25T10:08:34.030192+0000","last_became_peered":"2024-04-25T10:08:34.030192+0000","last_unstale":"2024-04-25T10:08:35.029208+0000","last_undegraded":"2024-04-25T10:08:35.029208+0000","last_fullsized":"2024-04-25T10:08:35.029208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:43.931847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982991+0000","last_change":"2024-04-25T10:08:31.982991+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982991+0000","last_undegraded":"2024-04-25T10:08:31.982991+0000","last_fullsized":"2024-04-25T10:08:31.982991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029533+0000","last_change":"2024-04-25T10:08:34.016568+0000","last_active":"2024-04-25T10:08:35.029533+0000","last_peered":"2024-04-25T10:08:35.029533+0000","last_clean":"2024-04-25T10:08:35.029533+0000","last_became_active":"2024-04-25T10:08:34.016236+0000","last_became_peered":"2024-04-25T10:08:34.016236+0000","last_unstale":"2024-04-25T10:08:35.029533+0000","last_undegraded":"2024-04-25T10:08:35.029533+0000","last_fullsized":"2024-04-25T10:08:35.029533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:54.046151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.983178+0000","last_change":"2024-04-25T10:08:31.983178+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.983178+0000","last_undegraded":"2024-04-25T10:08:31.983178+0000","last_fullsized":"2024-04-25T10:08:31.983178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991601+0000","last_change":"2024-04-25T10:08:32.991601+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991601+0000","last_undegraded":"2024-04-25T10:08:32.991601+0000","last_fullsized":"2024-04-25T10:08:32.991601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982905+0000","last_change":"2024-04-25T10:08:31.982905+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982905+0000","last_undegraded":"2024-04-25T10:08:31.982905+0000","last_fullsized":"2024-04-25T10:08:31.982905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989959+0000","last_change":"2024-04-25T10:08:32.989959+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989959+0000","last_undegraded":"2024-04-25T10:08:32.989959+0000","last_fullsized":"2024-04-25T10:08:32.989959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013412+0000","last_change":"2024-04-25T10:08:33.008642+0000","last_active":"2024-04-25T10:08:33.013412+0000","last_peered":"2024-04-25T10:08:33.013412+0000","last_clean":"2024-04-25T10:08:33.013412+0000","last_became_active":"2024-04-25T10:08:33.008355+0000","last_became_peered":"2024-04-25T10:08:33.008355+0000","last_unstale":"2024-04-25T10:08:33.013412+0000","last_undegraded":"2024-04-25T10:08:33.013412+0000","last_fullsized":"2024-04-25T10:08:33.013412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989722+0000","last_change":"2024-04-25T10:08:32.989722+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989722+0000","last_undegraded":"2024-04-25T10:08:32.989722+0000","last_fullsized":"2024-04-25T10:08:32.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029589+0000","last_change":"2024-04-25T10:08:33.003130+0000","last_active":"2024-04-25T10:08:35.029589+0000","last_peered":"2024-04-25T10:08:35.029589+0000","last_clean":"2024-04-25T10:08:35.029589+0000","last_became_active":"2024-04-25T10:08:33.002868+0000","last_became_peered":"2024-04-25T10:08:33.002868+0000","last_unstale":"2024-04-25T10:08:35.029589+0000","last_undegraded":"2024-04-25T10:08:35.029589+0000","last_fullsized":"2024-04-25T10:08:35.029589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:07.070501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990386+0000","last_change":"2024-04-25T10:08:32.990386+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990386+0000","last_undegraded":"2024-04-25T10:08:32.990386+0000","last_fullsized":"2024-04-25T10:08:32.990386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013729+0000","last_change":"2024-04-25T10:08:33.010326+0000","last_active":"2024-04-25T10:08:33.013729+0000","last_peered":"2024-04-25T10:08:33.013729+0000","last_clean":"2024-04-25T10:08:33.013729+0000","last_became_active":"2024-04-25T10:08:33.010037+0000","last_became_peered":"2024-04-25T10:08:33.010037+0000","last_unstale":"2024-04-25T10:08:33.013729+0000","last_undegraded":"2024-04-25T10:08:33.013729+0000","last_fullsized":"2024-04-25T10:08:33.013729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029213+0000","last_change":"2024-04-25T10:08:34.017218+0000","last_active":"2024-04-25T10:08:35.029213+0000","last_peered":"2024-04-25T10:08:35.029213+0000","last_clean":"2024-04-25T10:08:35.029213+0000","last_became_active":"2024-04-25T10:08:34.016156+0000","last_became_peered":"2024-04-25T10:08:34.016156+0000","last_unstale":"2024-04-25T10:08:35.029213+0000","last_undegraded":"2024-04-25T10:08:35.029213+0000","last_fullsized":"2024-04-25T10:08:35.029213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:22.115314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019205+0000","last_change":"2024-04-25T10:08:33.014162+0000","last_active":"2024-04-25T10:08:33.019205+0000","last_peered":"2024-04-25T10:08:33.019205+0000","last_clean":"2024-04-25T10:08:33.019205+0000","last_became_active":"2024-04-25T10:08:33.013858+0000","last_became_peered":"2024-04-25T10:08:33.013858+0000","last_unstale":"2024-04-25T10:08:33.019205+0000","last_undegraded":"2024-04-25T10:08:33.019205+0000","last_fullsized":"2024-04-25T10:08:33.019205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:35.003598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990029+0000","last_change":"2024-04-25T10:08:32.990029+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990029+0000","last_undegraded":"2024-04-25T10:08:32.990029+0000","last_fullsized":"2024-04-25T10:08:32.990029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013382+0000","last_change":"2024-04-25T10:08:33.007116+0000","last_active":"2024-04-25T10:08:33.013382+0000","last_peered":"2024-04-25T10:08:33.013382+0000","last_clean":"2024-04-25T10:08:33.013382+0000","last_became_active":"2024-04-25T10:08:33.006840+0000","last_became_peered":"2024-04-25T10:08:33.006840+0000","last_unstale":"2024-04-25T10:08:33.013382+0000","last_undegraded":"2024-04-25T10:08:33.013382+0000","last_fullsized":"2024-04-25T10:08:33.013382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:11.394789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991537+0000","last_change":"2024-04-25T10:08:32.991537+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991537+0000","last_undegraded":"2024-04-25T10:08:32.991537+0000","last_fullsized":"2024-04-25T10:08:32.991537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031588+0000","last_change":"2024-04-25T10:08:33.003506+0000","last_active":"2024-04-25T10:08:35.031588+0000","last_peered":"2024-04-25T10:08:35.031588+0000","last_clean":"2024-04-25T10:08:35.031588+0000","last_became_active":"2024-04-25T10:08:33.003077+0000","last_became_peered":"2024-04-25T10:08:33.003077+0000","last_unstale":"2024-04-25T10:08:35.031588+0000","last_undegraded":"2024-04-25T10:08:35.031588+0000","last_fullsized":"2024-04-25T10:08:35.031588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.875235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999250+0000","last_change":"2024-04-25T10:08:34.018059+0000","last_active":"2024-04-25T10:08:34.999250+0000","last_peered":"2024-04-25T10:08:34.999250+0000","last_clean":"2024-04-25T10:08:34.999250+0000","last_became_active":"2024-04-25T10:08:34.017761+0000","last_became_peered":"2024-04-25T10:08:34.017761+0000","last_unstale":"2024-04-25T10:08:34.999250+0000","last_undegraded":"2024-04-25T10:08:34.999250+0000","last_fullsized":"2024-04-25T10:08:34.999250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008953+0000","last_change":"2024-04-25T10:08:33.004709+0000","last_active":"2024-04-25T10:08:33.008953+0000","last_peered":"2024-04-25T10:08:33.008953+0000","last_clean":"2024-04-25T10:08:33.008953+0000","last_became_active":"2024-04-25T10:08:33.004382+0000","last_became_peered":"2024-04-25T10:08:33.004382+0000","last_unstale":"2024-04-25T10:08:33.008953+0000","last_undegraded":"2024-04-25T10:08:33.008953+0000","last_fullsized":"2024-04-25T10:08:33.008953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:28.087771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999464+0000","last_change":"2024-04-25T10:08:34.013883+0000","last_active":"2024-04-25T10:08:34.999464+0000","last_peered":"2024-04-25T10:08:34.999464+0000","last_clean":"2024-04-25T10:08:34.999464+0000","last_became_active":"2024-04-25T10:08:34.013586+0000","last_became_peered":"2024-04-25T10:08:34.013586+0000","last_unstale":"2024-04-25T10:08:34.999464+0000","last_undegraded":"2024-04-25T10:08:34.999464+0000","last_fullsized":"2024-04-25T10:08:34.999464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998609+0000","last_change":"2024-04-25T10:08:33.000919+0000","last_active":"2024-04-25T10:08:34.998609+0000","last_peered":"2024-04-25T10:08:34.998609+0000","last_clean":"2024-04-25T10:08:34.998609+0000","last_became_active":"2024-04-25T10:08:33.000597+0000","last_became_peered":"2024-04-25T10:08:33.000597+0000","last_unstale":"2024-04-25T10:08:34.998609+0000","last_undegraded":"2024-04-25T10:08:34.998609+0000","last_fullsized":"2024-04-25T10:08:34.998609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998495+0000","last_change":"2024-04-25T10:08:32.998495+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998495+0000","last_undegraded":"2024-04-25T10:08:32.998495+0000","last_fullsized":"2024-04-25T10:08:32.998495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982907+0000","last_change":"2024-04-25T10:08:31.982907+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982907+0000","last_undegraded":"2024-04-25T10:08:31.982907+0000","last_fullsized":"2024-04-25T10:08:31.982907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.000546+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:08:33.000546+0000","last_peered":"2024-04-25T10:08:33.000546+0000","last_clean":"2024-04-25T10:08:33.000546+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:08:33.000546+0000","last_undegraded":"2024-04-25T10:08:33.000546+0000","last_fullsized":"2024-04-25T10:08:33.000546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":436731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":451332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":450702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1040958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:08:38.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:08:38.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 Processor -- start 2024-04-25T10:08:38.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 -- start start 2024-04-25T10:08:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc78c0ce8e0 0x7fc78c0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78c0cdbe0 con 0x7fc78c0cd190 2024-04-25T10:08:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc78c0cb5c0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc790a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cac90 con 0x7fc78c15a800 2024-04-25T10:08:38.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78be00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc78c0ce8e0 0x7fc78c0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:47222/0 (socket says 172.21.15.18:47222) 2024-04-25T10:08:38.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc783e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fc78c0cd190 0x7fc78c0ce1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58912/0 (socket says 172.21.15.18:58912) 2024-04-25T10:08:38.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 -- 172.21.15.18:0/1263680267 learned_addr learned my addr 172.21.15.18:0/1263680267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 -- 172.21.15.18:0/1263680267 >> v2:172.21.15.167:3300/0 conn(0x7fc78c0ce8e0 msgr2=0x7fc78c0cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78aa00640 1 -- 172.21.15.18:0/1263680267 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824984588 0 0) 0x7fc78c0cdbe0 con 0x7fc78c0cd190 2024-04-25T10:08:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 --2- 172.21.15.18:0/1263680267 >> v2:172.21.15.167:3300/0 conn(0x7fc78c0ce8e0 0x7fc78c0cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 -- 172.21.15.18:0/1263680267 >> v1:172.21.15.167:6789/0 conn(0x7fc78c0cd190 legacy=0x7fc78c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.314+0000 7fc78b400640 1 -- 172.21.15.18:0/1263680267 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c0caf70 con 0x7fc78c15a800 2024-04-25T10:08:38.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc78b400640 1 --2- 172.21.15.18:0/1263680267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00bb10 tx=0x7fc77c01ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf79f73242c31db2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc78aa00640 1 -- 172.21.15.18:0/1263680267 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0b4070 con 0x7fc78c15a800 2024-04-25T10:08:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc78aa00640 1 -- 172.21.15.18:0/1263680267 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc77c0a7c10 con 0x7fc78c15a800 2024-04-25T10:08:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc78aa00640 1 -- 172.21.15.18:0/1263680267 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77c0af440 con 0x7fc78c15a800 2024-04-25T10:08:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 -- 172.21.15.18:0/1263680267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 msgr2=0x7fc78c0afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 --2- 172.21.15.18:0/1263680267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00bb10 tx=0x7fc77c01ec30 comp rx=0 tx=0).stop 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 -- 172.21.15.18:0/1263680267 shutdown_connections 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 --2- 172.21.15.18:0/1263680267 >> v2:172.21.15.167:3300/0 conn(0x7fc78c0ce8e0 0x7fc78c0cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 --2- 172.21.15.18:0/1263680267 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c15a800 0x7fc78c0afee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 -- 172.21.15.18:0/1263680267 >> 172.21.15.18:0/1263680267 conn(0x7fc78c099a60 msgr2=0x7fc78c0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 -- 172.21.15.18:0/1263680267 shutdown_connections 2024-04-25T10:08:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.318+0000 7fc790a00640 1 -- 172.21.15.18:0/1263680267 wait complete. 2024-04-25T10:08:38.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 Processor -- start 2024-04-25T10:08:38.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- start start 2024-04-25T10:08:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 0x7fc78c1552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc78c15a800 0x7fc78c14f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cc3e0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cc260 con 0x7fc78c15a800 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78c0cc560 con 0x7fc78c0cd190 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42754/0 (socket says 172.21.15.18:42754) 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 -- 172.21.15.18:0/2166388732 learned_addr learned my addr 172.21.15.18:0/2166388732 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 -- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 msgr2=0x7fc78c1552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc78b400640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 0x7fc78c1552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc78be00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc78c15a800 0x7fc78c14f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 0x7fc78c1552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 -- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc78c15a800 msgr2=0x7fc78c14f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc78c15a800 0x7fc78c14f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 -- 172.21.15.18:0/2166388732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78c1f98a0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc78b400640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 0x7fc78c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783e00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc7740011f0 tx=0x7fc77400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774018070 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7740074e0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774004a10 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78c1f9b80 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc78c1fa140 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.322+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78c04efa0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.326+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc77401b070 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.326+0000 7fc783400640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 0x7fc768069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.326+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc7740845d0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.326+0000 7fc78b400640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 0x7fc768069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.326+0000 7fc78b400640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 0x7fc768069450 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0b1000 tx=0x7fc77c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.330+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7740553b0 con 0x7fc78c0ce8e0 2024-04-25T10:08:38.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.490+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc78c153310 con 0x7fc768066f90 2024-04-25T10:08:38.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.494+0000 7fc783400640 1 -- 172.21.15.18:0/2166388732 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248409 (secure 0 0 0) 0x7fc78c153310 con 0x7fc768066f90 2024-04-25T10:08:38.506 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:38.508 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 msgr2=0x7fc768069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 0x7fc768069450 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0b1000 tx=0x7fc77c008040 comp rx=0 tx=0).stop 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 msgr2=0x7fc78c14f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc7740011f0 tx=0x7fc77400c9b0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 shutdown_connections 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc78c15a800 0x7fc78c14f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc78c0ce8e0 0x7fc78c14f160 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc768066f90 0x7fc768069450 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 --2- 172.21.15.18:0/2166388732 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc78c0cd190 0x7fc78c1552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 >> 172.21.15.18:0/2166388732 conn(0x7fc78c099a60 msgr2=0x7fc78c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:38.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 shutdown_connections 2024-04-25T10:08:38.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.498+0000 7fc790a00640 1 -- 172.21.15.18:0/2166388732 wait complete. 2024-04-25T10:08:38.527 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-25T10:08:37.466504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249864,"kb_used_data":8704,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724856,"statfs":{"total":773094113280,"available":772838252544,"internally_reserved":0,"allocated":8912896,"data_stored":4697014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.487201"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999572+0000","last_change":"2024-04-25T10:08:32.999572+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999572+0000","last_undegraded":"2024-04-25T10:08:32.999572+0000","last_fullsized":"2024-04-25T10:08:32.999572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029526+0000","last_change":"2024-04-25T10:08:34.021493+0000","last_active":"2024-04-25T10:08:35.029526+0000","last_peered":"2024-04-25T10:08:35.029526+0000","last_clean":"2024-04-25T10:08:35.029526+0000","last_became_active":"2024-04-25T10:08:34.021186+0000","last_became_peered":"2024-04-25T10:08:34.021186+0000","last_unstale":"2024-04-25T10:08:35.029526+0000","last_undegraded":"2024-04-25T10:08:35.029526+0000","last_fullsized":"2024-04-25T10:08:35.029526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:42.229181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998998+0000","last_change":"2024-04-25T10:08:34.025282+0000","last_active":"2024-04-25T10:08:34.998998+0000","last_peered":"2024-04-25T10:08:34.998998+0000","last_clean":"2024-04-25T10:08:34.998998+0000","last_became_active":"2024-04-25T10:08:34.025024+0000","last_became_peered":"2024-04-25T10:08:34.025024+0000","last_unstale":"2024-04-25T10:08:34.998998+0000","last_undegraded":"2024-04-25T10:08:34.998998+0000","last_fullsized":"2024-04-25T10:08:34.998998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997864+0000","last_change":"2024-04-25T10:08:32.997864+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997864+0000","last_undegraded":"2024-04-25T10:08:32.997864+0000","last_fullsized":"2024-04-25T10:08:32.997864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031585+0000","last_change":"2024-04-25T10:08:34.017231+0000","last_active":"2024-04-25T10:08:35.031585+0000","last_peered":"2024-04-25T10:08:35.031585+0000","last_clean":"2024-04-25T10:08:35.031585+0000","last_became_active":"2024-04-25T10:08:34.016095+0000","last_became_peered":"2024-04-25T10:08:34.016095+0000","last_unstale":"2024-04-25T10:08:35.031585+0000","last_undegraded":"2024-04-25T10:08:35.031585+0000","last_fullsized":"2024-04-25T10:08:35.031585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.605425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990198+0000","last_change":"2024-04-25T10:08:32.990198+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990198+0000","last_undegraded":"2024-04-25T10:08:32.990198+0000","last_fullsized":"2024-04-25T10:08:32.990198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031661+0000","last_change":"2024-04-25T10:08:34.017931+0000","last_active":"2024-04-25T10:08:35.031661+0000","last_peered":"2024-04-25T10:08:35.031661+0000","last_clean":"2024-04-25T10:08:35.031661+0000","last_became_active":"2024-04-25T10:08:34.017586+0000","last_became_peered":"2024-04-25T10:08:34.017586+0000","last_unstale":"2024-04-25T10:08:35.031661+0000","last_undegraded":"2024-04-25T10:08:35.031661+0000","last_fullsized":"2024-04-25T10:08:35.031661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:49.996965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990781+0000","last_change":"2024-04-25T10:08:32.990781+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990781+0000","last_undegraded":"2024-04-25T10:08:32.990781+0000","last_fullsized":"2024-04-25T10:08:32.990781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998080+0000","last_change":"2024-04-25T10:08:32.998080+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998080+0000","last_undegraded":"2024-04-25T10:08:32.998080+0000","last_fullsized":"2024-04-25T10:08:32.998080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029377+0000","last_change":"2024-04-25T10:08:34.026807+0000","last_active":"2024-04-25T10:08:35.029377+0000","last_peered":"2024-04-25T10:08:35.029377+0000","last_clean":"2024-04-25T10:08:35.029377+0000","last_became_active":"2024-04-25T10:08:34.025681+0000","last_became_peered":"2024-04-25T10:08:34.025681+0000","last_unstale":"2024-04-25T10:08:35.029377+0000","last_undegraded":"2024-04-25T10:08:35.029377+0000","last_fullsized":"2024-04-25T10:08:35.029377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.077735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997374+0000","last_change":"2024-04-25T10:08:32.997374+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997374+0000","last_undegraded":"2024-04-25T10:08:32.997374+0000","last_fullsized":"2024-04-25T10:08:32.997374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031744+0000","last_change":"2024-04-25T10:08:34.015665+0000","last_active":"2024-04-25T10:08:35.031744+0000","last_peered":"2024-04-25T10:08:35.031744+0000","last_clean":"2024-04-25T10:08:35.031744+0000","last_became_active":"2024-04-25T10:08:34.015246+0000","last_became_peered":"2024-04-25T10:08:34.015246+0000","last_unstale":"2024-04-25T10:08:35.031744+0000","last_undegraded":"2024-04-25T10:08:35.031744+0000","last_fullsized":"2024-04-25T10:08:35.031744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028905+0000","last_change":"2024-04-25T10:08:34.014342+0000","last_active":"2024-04-25T10:08:35.028905+0000","last_peered":"2024-04-25T10:08:35.028905+0000","last_clean":"2024-04-25T10:08:35.028905+0000","last_became_active":"2024-04-25T10:08:34.014011+0000","last_became_peered":"2024-04-25T10:08:34.014011+0000","last_unstale":"2024-04-25T10:08:35.028905+0000","last_undegraded":"2024-04-25T10:08:35.028905+0000","last_fullsized":"2024-04-25T10:08:35.028905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:40.898281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996176+0000","last_change":"2024-04-25T10:08:32.996176+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996176+0000","last_undegraded":"2024-04-25T10:08:32.996176+0000","last_fullsized":"2024-04-25T10:08:32.996176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031908+0000","last_change":"2024-04-25T10:08:34.011449+0000","last_active":"2024-04-25T10:08:35.031908+0000","last_peered":"2024-04-25T10:08:35.031908+0000","last_clean":"2024-04-25T10:08:35.031908+0000","last_became_active":"2024-04-25T10:08:34.011147+0000","last_became_peered":"2024-04-25T10:08:34.011147+0000","last_unstale":"2024-04-25T10:08:35.031908+0000","last_undegraded":"2024-04-25T10:08:35.031908+0000","last_fullsized":"2024-04-25T10:08:35.031908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.893587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999000+0000","last_change":"2024-04-25T10:08:34.010473+0000","last_active":"2024-04-25T10:08:34.999000+0000","last_peered":"2024-04-25T10:08:34.999000+0000","last_clean":"2024-04-25T10:08:34.999000+0000","last_became_active":"2024-04-25T10:08:34.010053+0000","last_became_peered":"2024-04-25T10:08:34.010053+0000","last_unstale":"2024-04-25T10:08:34.999000+0000","last_undegraded":"2024-04-25T10:08:34.999000+0000","last_fullsized":"2024-04-25T10:08:34.999000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031767+0000","last_change":"2024-04-25T10:08:34.007070+0000","last_active":"2024-04-25T10:08:35.031767+0000","last_peered":"2024-04-25T10:08:35.031767+0000","last_clean":"2024-04-25T10:08:35.031767+0000","last_became_active":"2024-04-25T10:08:34.006804+0000","last_became_peered":"2024-04-25T10:08:34.006804+0000","last_unstale":"2024-04-25T10:08:35.031767+0000","last_undegraded":"2024-04-25T10:08:35.031767+0000","last_fullsized":"2024-04-25T10:08:35.031767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:41.897342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992122+0000","last_change":"2024-04-25T10:08:32.992122+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992122+0000","last_undegraded":"2024-04-25T10:08:32.992122+0000","last_fullsized":"2024-04-25T10:08:32.992122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031521+0000","last_change":"2024-04-25T10:08:34.020307+0000","last_active":"2024-04-25T10:08:35.031521+0000","last_peered":"2024-04-25T10:08:35.031521+0000","last_clean":"2024-04-25T10:08:35.031521+0000","last_became_active":"2024-04-25T10:08:34.018096+0000","last_became_peered":"2024-04-25T10:08:34.018096+0000","last_unstale":"2024-04-25T10:08:35.031521+0000","last_undegraded":"2024-04-25T10:08:35.031521+0000","last_fullsized":"2024-04-25T10:08:35.031521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:36.687476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.988735+0000","last_change":"2024-04-25T10:08:32.988735+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.988735+0000","last_undegraded":"2024-04-25T10:08:32.988735+0000","last_fullsized":"2024-04-25T10:08:32.988735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028846+0000","last_change":"2024-04-25T10:08:34.026585+0000","last_active":"2024-04-25T10:08:35.028846+0000","last_peered":"2024-04-25T10:08:35.028846+0000","last_clean":"2024-04-25T10:08:35.028846+0000","last_became_active":"2024-04-25T10:08:34.026274+0000","last_became_peered":"2024-04-25T10:08:34.026274+0000","last_unstale":"2024-04-25T10:08:35.028846+0000","last_undegraded":"2024-04-25T10:08:35.028846+0000","last_fullsized":"2024-04-25T10:08:35.028846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:41.217493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029490+0000","last_change":"2024-04-25T10:08:34.025864+0000","last_active":"2024-04-25T10:08:35.029490+0000","last_peered":"2024-04-25T10:08:35.029490+0000","last_clean":"2024-04-25T10:08:35.029490+0000","last_became_active":"2024-04-25T10:08:34.025510+0000","last_became_peered":"2024-04-25T10:08:34.025510+0000","last_unstale":"2024-04-25T10:08:35.029490+0000","last_undegraded":"2024-04-25T10:08:35.029490+0000","last_fullsized":"2024-04-25T10:08:35.029490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996041+0000","last_change":"2024-04-25T10:08:32.996041+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996041+0000","last_undegraded":"2024-04-25T10:08:32.996041+0000","last_fullsized":"2024-04-25T10:08:32.996041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999201+0000","last_change":"2024-04-25T10:08:32.999201+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999201+0000","last_undegraded":"2024-04-25T10:08:32.999201+0000","last_fullsized":"2024-04-25T10:08:32.999201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031801+0000","last_change":"2024-04-25T10:08:34.030709+0000","last_active":"2024-04-25T10:08:35.031801+0000","last_peered":"2024-04-25T10:08:35.031801+0000","last_clean":"2024-04-25T10:08:35.031801+0000","last_became_active":"2024-04-25T10:08:34.030384+0000","last_became_peered":"2024-04-25T10:08:34.030384+0000","last_unstale":"2024-04-25T10:08:35.031801+0000","last_undegraded":"2024-04-25T10:08:35.031801+0000","last_fullsized":"2024-04-25T10:08:35.031801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:10.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029152+0000","last_change":"2024-04-25T10:08:34.020753+0000","last_active":"2024-04-25T10:08:35.029152+0000","last_peered":"2024-04-25T10:08:35.029152+0000","last_clean":"2024-04-25T10:08:35.029152+0000","last_became_active":"2024-04-25T10:08:34.020394+0000","last_became_peered":"2024-04-25T10:08:34.020394+0000","last_unstale":"2024-04-25T10:08:35.029152+0000","last_undegraded":"2024-04-25T10:08:35.029152+0000","last_fullsized":"2024-04-25T10:08:35.029152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:51.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996331+0000","last_change":"2024-04-25T10:08:32.996331+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996331+0000","last_undegraded":"2024-04-25T10:08:32.996331+0000","last_fullsized":"2024-04-25T10:08:32.996331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999136+0000","last_change":"2024-04-25T10:08:34.009888+0000","last_active":"2024-04-25T10:08:34.999136+0000","last_peered":"2024-04-25T10:08:34.999136+0000","last_clean":"2024-04-25T10:08:34.999136+0000","last_became_active":"2024-04-25T10:08:34.008686+0000","last_became_peered":"2024-04-25T10:08:34.008686+0000","last_unstale":"2024-04-25T10:08:34.999136+0000","last_undegraded":"2024-04-25T10:08:34.999136+0000","last_fullsized":"2024-04-25T10:08:34.999136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995643+0000","last_change":"2024-04-25T10:08:32.995643+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995643+0000","last_undegraded":"2024-04-25T10:08:32.995643+0000","last_fullsized":"2024-04-25T10:08:32.995643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999140+0000","last_change":"2024-04-25T10:08:34.011122+0000","last_active":"2024-04-25T10:08:34.999140+0000","last_peered":"2024-04-25T10:08:34.999140+0000","last_clean":"2024-04-25T10:08:34.999140+0000","last_became_active":"2024-04-25T10:08:34.010868+0000","last_became_peered":"2024-04-25T10:08:34.010868+0000","last_unstale":"2024-04-25T10:08:34.999140+0000","last_undegraded":"2024-04-25T10:08:34.999140+0000","last_fullsized":"2024-04-25T10:08:34.999140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031894+0000","last_change":"2024-04-25T10:08:33.002480+0000","last_active":"2024-04-25T10:08:35.031894+0000","last_peered":"2024-04-25T10:08:35.031894+0000","last_clean":"2024-04-25T10:08:35.031894+0000","last_became_active":"2024-04-25T10:08:33.000086+0000","last_became_peered":"2024-04-25T10:08:33.000086+0000","last_unstale":"2024-04-25T10:08:35.031894+0000","last_undegraded":"2024-04-25T10:08:35.031894+0000","last_fullsized":"2024-04-25T10:08:35.031894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:57.411455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028904+0000","last_change":"2024-04-25T10:08:34.026292+0000","last_active":"2024-04-25T10:08:35.028904+0000","last_peered":"2024-04-25T10:08:35.028904+0000","last_clean":"2024-04-25T10:08:35.028904+0000","last_became_active":"2024-04-25T10:08:34.026020+0000","last_became_peered":"2024-04-25T10:08:34.026020+0000","last_unstale":"2024-04-25T10:08:35.028904+0000","last_undegraded":"2024-04-25T10:08:35.028904+0000","last_fullsized":"2024-04-25T10:08:35.028904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:52.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016511+0000","last_change":"2024-04-25T10:08:33.011515+0000","last_active":"2024-04-25T10:08:33.016511+0000","last_peered":"2024-04-25T10:08:33.016511+0000","last_clean":"2024-04-25T10:08:33.016511+0000","last_became_active":"2024-04-25T10:08:33.010837+0000","last_became_peered":"2024-04-25T10:08:33.010837+0000","last_unstale":"2024-04-25T10:08:33.016511+0000","last_undegraded":"2024-04-25T10:08:33.016511+0000","last_fullsized":"2024-04-25T10:08:33.016511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990913+0000","last_change":"2024-04-25T10:08:32.990913+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990913+0000","last_undegraded":"2024-04-25T10:08:32.990913+0000","last_fullsized":"2024-04-25T10:08:32.990913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016551+0000","last_change":"2024-04-25T10:08:33.011678+0000","last_active":"2024-04-25T10:08:33.016551+0000","last_peered":"2024-04-25T10:08:33.016551+0000","last_clean":"2024-04-25T10:08:33.016551+0000","last_became_active":"2024-04-25T10:08:33.011366+0000","last_became_peered":"2024-04-25T10:08:33.011366+0000","last_unstale":"2024-04-25T10:08:33.016551+0000","last_undegraded":"2024-04-25T10:08:33.016551+0000","last_fullsized":"2024-04-25T10:08:33.016551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:45.021233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991690+0000","last_change":"2024-04-25T10:08:32.991690+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991690+0000","last_undegraded":"2024-04-25T10:08:32.991690+0000","last_fullsized":"2024-04-25T10:08:32.991690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013359+0000","last_change":"2024-04-25T10:08:33.007013+0000","last_active":"2024-04-25T10:08:33.013359+0000","last_peered":"2024-04-25T10:08:33.013359+0000","last_clean":"2024-04-25T10:08:33.013359+0000","last_became_active":"2024-04-25T10:08:33.006754+0000","last_became_peered":"2024-04-25T10:08:33.006754+0000","last_unstale":"2024-04-25T10:08:33.013359+0000","last_undegraded":"2024-04-25T10:08:33.013359+0000","last_fullsized":"2024-04-25T10:08:33.013359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:53.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029185+0000","last_change":"2024-04-25T10:08:34.025084+0000","last_active":"2024-04-25T10:08:35.029185+0000","last_peered":"2024-04-25T10:08:35.029185+0000","last_clean":"2024-04-25T10:08:35.029185+0000","last_became_active":"2024-04-25T10:08:34.024770+0000","last_became_peered":"2024-04-25T10:08:34.024770+0000","last_unstale":"2024-04-25T10:08:35.029185+0000","last_undegraded":"2024-04-25T10:08:35.029185+0000","last_fullsized":"2024-04-25T10:08:35.029185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.334293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009630+0000","last_change":"2024-04-25T10:08:33.007061+0000","last_active":"2024-04-25T10:08:33.009630+0000","last_peered":"2024-04-25T10:08:33.009630+0000","last_clean":"2024-04-25T10:08:33.009630+0000","last_became_active":"2024-04-25T10:08:33.006778+0000","last_became_peered":"2024-04-25T10:08:33.006778+0000","last_unstale":"2024-04-25T10:08:33.009630+0000","last_undegraded":"2024-04-25T10:08:33.009630+0000","last_fullsized":"2024-04-25T10:08:33.009630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:01.724703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029446+0000","last_change":"2024-04-25T10:08:34.031090+0000","last_active":"2024-04-25T10:08:35.029446+0000","last_peered":"2024-04-25T10:08:35.029446+0000","last_clean":"2024-04-25T10:08:35.029446+0000","last_became_active":"2024-04-25T10:08:34.023940+0000","last_became_peered":"2024-04-25T10:08:34.023940+0000","last_unstale":"2024-04-25T10:08:35.029446+0000","last_undegraded":"2024-04-25T10:08:35.029446+0000","last_fullsized":"2024-04-25T10:08:35.029446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:28.981263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009561+0000","last_change":"2024-04-25T10:08:33.005514+0000","last_active":"2024-04-25T10:08:33.009561+0000","last_peered":"2024-04-25T10:08:33.009561+0000","last_clean":"2024-04-25T10:08:33.009561+0000","last_became_active":"2024-04-25T10:08:33.005250+0000","last_became_peered":"2024-04-25T10:08:33.005250+0000","last_unstale":"2024-04-25T10:08:33.009561+0000","last_undegraded":"2024-04-25T10:08:33.009561+0000","last_fullsized":"2024-04-25T10:08:33.009561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.993102+0000","last_change":"2024-04-25T10:08:32.993102+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.993102+0000","last_undegraded":"2024-04-25T10:08:32.993102+0000","last_fullsized":"2024-04-25T10:08:32.993102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028964+0000","last_change":"2024-04-25T10:08:33.006037+0000","last_active":"2024-04-25T10:08:35.028964+0000","last_peered":"2024-04-25T10:08:35.028964+0000","last_clean":"2024-04-25T10:08:35.028964+0000","last_became_active":"2024-04-25T10:08:33.005767+0000","last_became_peered":"2024-04-25T10:08:33.005767+0000","last_unstale":"2024-04-25T10:08:35.028964+0000","last_undegraded":"2024-04-25T10:08:35.028964+0000","last_fullsized":"2024-04-25T10:08:35.028964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:53.277350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992811+0000","last_change":"2024-04-25T10:08:32.992811+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992811+0000","last_undegraded":"2024-04-25T10:08:32.992811+0000","last_fullsized":"2024-04-25T10:08:32.992811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031330+0000","last_change":"2024-04-25T10:08:32.995936+0000","last_active":"2024-04-25T10:08:35.031330+0000","last_peered":"2024-04-25T10:08:35.031330+0000","last_clean":"2024-04-25T10:08:35.031330+0000","last_became_active":"2024-04-25T10:08:32.995620+0000","last_became_peered":"2024-04-25T10:08:32.995620+0000","last_unstale":"2024-04-25T10:08:35.031330+0000","last_undegraded":"2024-04-25T10:08:35.031330+0000","last_fullsized":"2024-04-25T10:08:35.031330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.564491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028864+0000","last_change":"2024-04-25T10:08:34.020243+0000","last_active":"2024-04-25T10:08:35.028864+0000","last_peered":"2024-04-25T10:08:35.028864+0000","last_clean":"2024-04-25T10:08:35.028864+0000","last_became_active":"2024-04-25T10:08:34.018667+0000","last_became_peered":"2024-04-25T10:08:34.018667+0000","last_unstale":"2024-04-25T10:08:35.028864+0000","last_undegraded":"2024-04-25T10:08:35.028864+0000","last_fullsized":"2024-04-25T10:08:35.028864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:08.399465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019207+0000","last_change":"2024-04-25T10:08:33.014183+0000","last_active":"2024-04-25T10:08:33.019207+0000","last_peered":"2024-04-25T10:08:33.019207+0000","last_clean":"2024-04-25T10:08:33.019207+0000","last_became_active":"2024-04-25T10:08:33.013867+0000","last_became_peered":"2024-04-25T10:08:33.013867+0000","last_unstale":"2024-04-25T10:08:33.019207+0000","last_undegraded":"2024-04-25T10:08:33.019207+0000","last_fullsized":"2024-04-25T10:08:33.019207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995420+0000","last_change":"2024-04-25T10:08:32.995420+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995420+0000","last_undegraded":"2024-04-25T10:08:32.995420+0000","last_fullsized":"2024-04-25T10:08:32.995420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009592+0000","last_change":"2024-04-25T10:08:33.007771+0000","last_active":"2024-04-25T10:08:33.009592+0000","last_peered":"2024-04-25T10:08:33.009592+0000","last_clean":"2024-04-25T10:08:33.009592+0000","last_became_active":"2024-04-25T10:08:33.006885+0000","last_became_peered":"2024-04-25T10:08:33.006885+0000","last_unstale":"2024-04-25T10:08:33.009592+0000","last_undegraded":"2024-04-25T10:08:33.009592+0000","last_fullsized":"2024-04-25T10:08:33.009592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031943+0000","last_change":"2024-04-25T10:08:33.000784+0000","last_active":"2024-04-25T10:08:35.031943+0000","last_peered":"2024-04-25T10:08:35.031943+0000","last_clean":"2024-04-25T10:08:35.031943+0000","last_became_active":"2024-04-25T10:08:33.000487+0000","last_became_peered":"2024-04-25T10:08:33.000487+0000","last_unstale":"2024-04-25T10:08:35.031943+0000","last_undegraded":"2024-04-25T10:08:35.031943+0000","last_fullsized":"2024-04-25T10:08:35.031943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:01.990140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999011+0000","last_change":"2024-04-25T10:08:34.024469+0000","last_active":"2024-04-25T10:08:34.999011+0000","last_peered":"2024-04-25T10:08:34.999011+0000","last_clean":"2024-04-25T10:08:34.999011+0000","last_became_active":"2024-04-25T10:08:34.024156+0000","last_became_peered":"2024-04-25T10:08:34.024156+0000","last_unstale":"2024-04-25T10:08:34.999011+0000","last_undegraded":"2024-04-25T10:08:34.999011+0000","last_fullsized":"2024-04-25T10:08:34.999011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.003564+0000","last_change":"2024-04-25T10:08:32.998633+0000","last_active":"2024-04-25T10:08:33.003564+0000","last_peered":"2024-04-25T10:08:33.003564+0000","last_clean":"2024-04-25T10:08:33.003564+0000","last_became_active":"2024-04-25T10:08:32.998332+0000","last_became_peered":"2024-04-25T10:08:32.998332+0000","last_unstale":"2024-04-25T10:08:33.003564+0000","last_undegraded":"2024-04-25T10:08:33.003564+0000","last_fullsized":"2024-04-25T10:08:33.003564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:15.122956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996477+0000","last_change":"2024-04-25T10:08:32.996477+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996477+0000","last_undegraded":"2024-04-25T10:08:32.996477+0000","last_fullsized":"2024-04-25T10:08:32.996477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009611+0000","last_change":"2024-04-25T10:08:33.006611+0000","last_active":"2024-04-25T10:08:33.009611+0000","last_peered":"2024-04-25T10:08:33.009611+0000","last_clean":"2024-04-25T10:08:33.009611+0000","last_became_active":"2024-04-25T10:08:33.006152+0000","last_became_peered":"2024-04-25T10:08:33.006152+0000","last_unstale":"2024-04-25T10:08:33.009611+0000","last_undegraded":"2024-04-25T10:08:33.009611+0000","last_fullsized":"2024-04-25T10:08:33.009611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992129+0000","last_change":"2024-04-25T10:08:32.992129+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992129+0000","last_undegraded":"2024-04-25T10:08:32.992129+0000","last_fullsized":"2024-04-25T10:08:32.992129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013736+0000","last_change":"2024-04-25T10:08:33.010430+0000","last_active":"2024-04-25T10:08:33.013736+0000","last_peered":"2024-04-25T10:08:33.013736+0000","last_clean":"2024-04-25T10:08:33.013736+0000","last_became_active":"2024-04-25T10:08:33.010028+0000","last_became_peered":"2024-04-25T10:08:33.010028+0000","last_unstale":"2024-04-25T10:08:33.013736+0000","last_undegraded":"2024-04-25T10:08:33.013736+0000","last_fullsized":"2024-04-25T10:08:33.013736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989438+0000","last_change":"2024-04-25T10:08:32.989438+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989438+0000","last_undegraded":"2024-04-25T10:08:32.989438+0000","last_fullsized":"2024-04-25T10:08:32.989438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031412+0000","last_change":"2024-04-25T10:08:33.000541+0000","last_active":"2024-04-25T10:08:35.031412+0000","last_peered":"2024-04-25T10:08:35.031412+0000","last_clean":"2024-04-25T10:08:35.031412+0000","last_became_active":"2024-04-25T10:08:33.000156+0000","last_became_peered":"2024-04-25T10:08:33.000156+0000","last_unstale":"2024-04-25T10:08:35.031412+0000","last_undegraded":"2024-04-25T10:08:35.031412+0000","last_fullsized":"2024-04-25T10:08:35.031412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:05.087355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992342+0000","last_change":"2024-04-25T10:08:32.992342+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992342+0000","last_undegraded":"2024-04-25T10:08:32.992342+0000","last_fullsized":"2024-04-25T10:08:32.992342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028931+0000","last_change":"2024-04-25T10:08:33.001887+0000","last_active":"2024-04-25T10:08:35.028931+0000","last_peered":"2024-04-25T10:08:35.028931+0000","last_clean":"2024-04-25T10:08:35.028931+0000","last_became_active":"2024-04-25T10:08:33.001619+0000","last_became_peered":"2024-04-25T10:08:33.001619+0000","last_unstale":"2024-04-25T10:08:35.028931+0000","last_undegraded":"2024-04-25T10:08:35.028931+0000","last_fullsized":"2024-04-25T10:08:35.028931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.189417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016533+0000","last_change":"2024-04-25T10:08:33.011663+0000","last_active":"2024-04-25T10:08:33.016533+0000","last_peered":"2024-04-25T10:08:33.016533+0000","last_clean":"2024-04-25T10:08:33.016533+0000","last_became_active":"2024-04-25T10:08:33.011338+0000","last_became_peered":"2024-04-25T10:08:33.011338+0000","last_unstale":"2024-04-25T10:08:33.016533+0000","last_undegraded":"2024-04-25T10:08:33.016533+0000","last_fullsized":"2024-04-25T10:08:33.016533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031552+0000","last_change":"2024-04-25T10:08:34.012127+0000","last_active":"2024-04-25T10:08:35.031552+0000","last_peered":"2024-04-25T10:08:35.031552+0000","last_clean":"2024-04-25T10:08:35.031552+0000","last_became_active":"2024-04-25T10:08:34.011736+0000","last_became_peered":"2024-04-25T10:08:34.011736+0000","last_unstale":"2024-04-25T10:08:35.031552+0000","last_undegraded":"2024-04-25T10:08:35.031552+0000","last_fullsized":"2024-04-25T10:08:35.031552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:16.153141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008148+0000","last_change":"2024-04-25T10:08:33.003042+0000","last_active":"2024-04-25T10:08:33.008148+0000","last_peered":"2024-04-25T10:08:33.008148+0000","last_clean":"2024-04-25T10:08:33.008148+0000","last_became_active":"2024-04-25T10:08:33.002788+0000","last_became_peered":"2024-04-25T10:08:33.002788+0000","last_unstale":"2024-04-25T10:08:33.008148+0000","last_undegraded":"2024-04-25T10:08:33.008148+0000","last_fullsized":"2024-04-25T10:08:33.008148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:09.025426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031642+0000","last_change":"2024-04-25T10:08:34.019681+0000","last_active":"2024-04-25T10:08:35.031642+0000","last_peered":"2024-04-25T10:08:35.031642+0000","last_clean":"2024-04-25T10:08:35.031642+0000","last_became_active":"2024-04-25T10:08:34.019409+0000","last_became_peered":"2024-04-25T10:08:34.019409+0000","last_unstale":"2024-04-25T10:08:35.031642+0000","last_undegraded":"2024-04-25T10:08:35.031642+0000","last_fullsized":"2024-04-25T10:08:35.031642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:04.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031975+0000","last_change":"2024-04-25T10:08:32.997942+0000","last_active":"2024-04-25T10:08:35.031975+0000","last_peered":"2024-04-25T10:08:35.031975+0000","last_clean":"2024-04-25T10:08:35.031975+0000","last_became_active":"2024-04-25T10:08:32.995849+0000","last_became_peered":"2024-04-25T10:08:32.995849+0000","last_unstale":"2024-04-25T10:08:35.031975+0000","last_undegraded":"2024-04-25T10:08:35.031975+0000","last_fullsized":"2024-04-25T10:08:35.031975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:13.109114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998886+0000","last_change":"2024-04-25T10:08:33.004697+0000","last_active":"2024-04-25T10:08:34.998886+0000","last_peered":"2024-04-25T10:08:34.998886+0000","last_clean":"2024-04-25T10:08:34.998886+0000","last_became_active":"2024-04-25T10:08:33.004438+0000","last_became_peered":"2024-04-25T10:08:33.004438+0000","last_unstale":"2024-04-25T10:08:34.998886+0000","last_undegraded":"2024-04-25T10:08:34.998886+0000","last_fullsized":"2024-04-25T10:08:34.998886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:27.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029208+0000","last_change":"2024-04-25T10:08:34.030460+0000","last_active":"2024-04-25T10:08:35.029208+0000","last_peered":"2024-04-25T10:08:35.029208+0000","last_clean":"2024-04-25T10:08:35.029208+0000","last_became_active":"2024-04-25T10:08:34.030192+0000","last_became_peered":"2024-04-25T10:08:34.030192+0000","last_unstale":"2024-04-25T10:08:35.029208+0000","last_undegraded":"2024-04-25T10:08:35.029208+0000","last_fullsized":"2024-04-25T10:08:35.029208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:43.931847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982991+0000","last_change":"2024-04-25T10:08:31.982991+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982991+0000","last_undegraded":"2024-04-25T10:08:31.982991+0000","last_fullsized":"2024-04-25T10:08:31.982991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029533+0000","last_change":"2024-04-25T10:08:34.016568+0000","last_active":"2024-04-25T10:08:35.029533+0000","last_peered":"2024-04-25T10:08:35.029533+0000","last_clean":"2024-04-25T10:08:35.029533+0000","last_became_active":"2024-04-25T10:08:34.016236+0000","last_became_peered":"2024-04-25T10:08:34.016236+0000","last_unstale":"2024-04-25T10:08:35.029533+0000","last_undegraded":"2024-04-25T10:08:35.029533+0000","last_fullsized":"2024-04-25T10:08:35.029533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:54.046151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.983178+0000","last_change":"2024-04-25T10:08:31.983178+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.983178+0000","last_undegraded":"2024-04-25T10:08:31.983178+0000","last_fullsized":"2024-04-25T10:08:31.983178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991601+0000","last_change":"2024-04-25T10:08:32.991601+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991601+0000","last_undegraded":"2024-04-25T10:08:32.991601+0000","last_fullsized":"2024-04-25T10:08:32.991601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982905+0000","last_change":"2024-04-25T10:08:31.982905+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982905+0000","last_undegraded":"2024-04-25T10:08:31.982905+0000","last_fullsized":"2024-04-25T10:08:31.982905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989959+0000","last_change":"2024-04-25T10:08:32.989959+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989959+0000","last_undegraded":"2024-04-25T10:08:32.989959+0000","last_fullsized":"2024-04-25T10:08:32.989959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013412+0000","last_change":"2024-04-25T10:08:33.008642+0000","last_active":"2024-04-25T10:08:33.013412+0000","last_peered":"2024-04-25T10:08:33.013412+0000","last_clean":"2024-04-25T10:08:33.013412+0000","last_became_active":"2024-04-25T10:08:33.008355+0000","last_became_peered":"2024-04-25T10:08:33.008355+0000","last_unstale":"2024-04-25T10:08:33.013412+0000","last_undegraded":"2024-04-25T10:08:33.013412+0000","last_fullsized":"2024-04-25T10:08:33.013412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989722+0000","last_change":"2024-04-25T10:08:32.989722+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989722+0000","last_undegraded":"2024-04-25T10:08:32.989722+0000","last_fullsized":"2024-04-25T10:08:32.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029589+0000","last_change":"2024-04-25T10:08:33.003130+0000","last_active":"2024-04-25T10:08:35.029589+0000","last_peered":"2024-04-25T10:08:35.029589+0000","last_clean":"2024-04-25T10:08:35.029589+0000","last_became_active":"2024-04-25T10:08:33.002868+0000","last_became_peered":"2024-04-25T10:08:33.002868+0000","last_unstale":"2024-04-25T10:08:35.029589+0000","last_undegraded":"2024-04-25T10:08:35.029589+0000","last_fullsized":"2024-04-25T10:08:35.029589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:07.070501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990386+0000","last_change":"2024-04-25T10:08:32.990386+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990386+0000","last_undegraded":"2024-04-25T10:08:32.990386+0000","last_fullsized":"2024-04-25T10:08:32.990386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013729+0000","last_change":"2024-04-25T10:08:33.010326+0000","last_active":"2024-04-25T10:08:33.013729+0000","last_peered":"2024-04-25T10:08:33.013729+0000","last_clean":"2024-04-25T10:08:33.013729+0000","last_became_active":"2024-04-25T10:08:33.010037+0000","last_became_peered":"2024-04-25T10:08:33.010037+0000","last_unstale":"2024-04-25T10:08:33.013729+0000","last_undegraded":"2024-04-25T10:08:33.013729+0000","last_fullsized":"2024-04-25T10:08:33.013729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029213+0000","last_change":"2024-04-25T10:08:34.017218+0000","last_active":"2024-04-25T10:08:35.029213+0000","last_peered":"2024-04-25T10:08:35.029213+0000","last_clean":"2024-04-25T10:08:35.029213+0000","last_became_active":"2024-04-25T10:08:34.016156+0000","last_became_peered":"2024-04-25T10:08:34.016156+0000","last_unstale":"2024-04-25T10:08:35.029213+0000","last_undegraded":"2024-04-25T10:08:35.029213+0000","last_fullsized":"2024-04-25T10:08:35.029213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:22.115314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019205+0000","last_change":"2024-04-25T10:08:33.014162+0000","last_active":"2024-04-25T10:08:33.019205+0000","last_peered":"2024-04-25T10:08:33.019205+0000","last_clean":"2024-04-25T10:08:33.019205+0000","last_became_active":"2024-04-25T10:08:33.013858+0000","last_became_peered":"2024-04-25T10:08:33.013858+0000","last_unstale":"2024-04-25T10:08:33.019205+0000","last_undegraded":"2024-04-25T10:08:33.019205+0000","last_fullsized":"2024-04-25T10:08:33.019205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:35.003598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990029+0000","last_change":"2024-04-25T10:08:32.990029+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990029+0000","last_undegraded":"2024-04-25T10:08:32.990029+0000","last_fullsized":"2024-04-25T10:08:32.990029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013382+0000","last_change":"2024-04-25T10:08:33.007116+0000","last_active":"2024-04-25T10:08:33.013382+0000","last_peered":"2024-04-25T10:08:33.013382+0000","last_clean":"2024-04-25T10:08:33.013382+0000","last_became_active":"2024-04-25T10:08:33.006840+0000","last_became_peered":"2024-04-25T10:08:33.006840+0000","last_unstale":"2024-04-25T10:08:33.013382+0000","last_undegraded":"2024-04-25T10:08:33.013382+0000","last_fullsized":"2024-04-25T10:08:33.013382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:11.394789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991537+0000","last_change":"2024-04-25T10:08:32.991537+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991537+0000","last_undegraded":"2024-04-25T10:08:32.991537+0000","last_fullsized":"2024-04-25T10:08:32.991537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031588+0000","last_change":"2024-04-25T10:08:33.003506+0000","last_active":"2024-04-25T10:08:35.031588+0000","last_peered":"2024-04-25T10:08:35.031588+0000","last_clean":"2024-04-25T10:08:35.031588+0000","last_became_active":"2024-04-25T10:08:33.003077+0000","last_became_peered":"2024-04-25T10:08:33.003077+0000","last_unstale":"2024-04-25T10:08:35.031588+0000","last_undegraded":"2024-04-25T10:08:35.031588+0000","last_fullsized":"2024-04-25T10:08:35.031588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.875235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999250+0000","last_change":"2024-04-25T10:08:34.018059+0000","last_active":"2024-04-25T10:08:34.999250+0000","last_peered":"2024-04-25T10:08:34.999250+0000","last_clean":"2024-04-25T10:08:34.999250+0000","last_became_active":"2024-04-25T10:08:34.017761+0000","last_became_peered":"2024-04-25T10:08:34.017761+0000","last_unstale":"2024-04-25T10:08:34.999250+0000","last_undegraded":"2024-04-25T10:08:34.999250+0000","last_fullsized":"2024-04-25T10:08:34.999250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008953+0000","last_change":"2024-04-25T10:08:33.004709+0000","last_active":"2024-04-25T10:08:33.008953+0000","last_peered":"2024-04-25T10:08:33.008953+0000","last_clean":"2024-04-25T10:08:33.008953+0000","last_became_active":"2024-04-25T10:08:33.004382+0000","last_became_peered":"2024-04-25T10:08:33.004382+0000","last_unstale":"2024-04-25T10:08:33.008953+0000","last_undegraded":"2024-04-25T10:08:33.008953+0000","last_fullsized":"2024-04-25T10:08:33.008953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:28.087771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999464+0000","last_change":"2024-04-25T10:08:34.013883+0000","last_active":"2024-04-25T10:08:34.999464+0000","last_peered":"2024-04-25T10:08:34.999464+0000","last_clean":"2024-04-25T10:08:34.999464+0000","last_became_active":"2024-04-25T10:08:34.013586+0000","last_became_peered":"2024-04-25T10:08:34.013586+0000","last_unstale":"2024-04-25T10:08:34.999464+0000","last_undegraded":"2024-04-25T10:08:34.999464+0000","last_fullsized":"2024-04-25T10:08:34.999464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998609+0000","last_change":"2024-04-25T10:08:33.000919+0000","last_active":"2024-04-25T10:08:34.998609+0000","last_peered":"2024-04-25T10:08:34.998609+0000","last_clean":"2024-04-25T10:08:34.998609+0000","last_became_active":"2024-04-25T10:08:33.000597+0000","last_became_peered":"2024-04-25T10:08:33.000597+0000","last_unstale":"2024-04-25T10:08:34.998609+0000","last_undegraded":"2024-04-25T10:08:34.998609+0000","last_fullsized":"2024-04-25T10:08:34.998609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998495+0000","last_change":"2024-04-25T10:08:32.998495+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998495+0000","last_undegraded":"2024-04-25T10:08:32.998495+0000","last_fullsized":"2024-04-25T10:08:32.998495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982907+0000","last_change":"2024-04-25T10:08:31.982907+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982907+0000","last_undegraded":"2024-04-25T10:08:31.982907+0000","last_fullsized":"2024-04-25T10:08:31.982907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.000546+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:08:33.000546+0000","last_peered":"2024-04-25T10:08:33.000546+0000","last_clean":"2024-04-25T10:08:33.000546+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:08:33.000546+0000","last_undegraded":"2024-04-25T10:08:33.000546+0000","last_fullsized":"2024-04-25T10:08:33.000546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":436731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":451332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":450702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1040958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:08:38.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:08:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 Processor -- start 2024-04-25T10:08:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 -- start start 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11dc06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f11dc0d0c40 0x7f11dc0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc06b530 con 0x7f11dc06ac10 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc15eef0 con 0x7f11dc0d0c40 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15e650 con 0x7f11dc15df00 2024-04-25T10:08:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11dbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f11dc06ac10 0x7f11dc0b39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51704/0 (socket says 172.21.15.18:51704) 2024-04-25T10:08:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11dbe00640 1 -- 172.21.15.18:0/3634228645 learned_addr learned my addr 172.21.15.18:0/3634228645 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11e1200640 1 --2- 172.21.15.18:0/3634228645 >> v2:172.21.15.167:3300/0 conn(0x7f11dc0d0c40 0x7f11dc0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11d3400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11dc06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3702831950 0 0) 0x7f11dc06b530 con 0x7f11dc06ac10 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c0003530 con 0x7f11dc06ac10 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3004973387 0 0) 0x7f11c0003530 con 0x7f11dc06ac10 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 msgr2=0x7f11dc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11dc06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 >> v2:172.21.15.167:3300/0 conn(0x7f11dc0d0c40 msgr2=0x7f11dc0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 --2- 172.21.15.18:0/3634228645 >> v2:172.21.15.167:3300/0 conn(0x7f11dc0d0c40 0x7f11dc0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc15e930 con 0x7f11dc06ac10 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f11cc001680 con 0x7f11dc06ac10 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 >> v1:172.21.15.18:6789/0 conn(0x7f11dc06ac10 legacy=0x7f11dc0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11c00039c0 0x7f11c0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c0004810 0x7f11c0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15e650 con 0x7f11c0004810 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c000b9d0 con 0x7f11c00039c0 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c000bb50 con 0x7f11dc15df00 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.702+0000 7f11d3400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c0004810 0x7f11c0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11dbe00640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11c00039c0 0x7f11c0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e1200640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 -- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 msgr2=0x7f11c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11dc15df00 0x7f11c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 -- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11c00039c0 msgr2=0x7f11c0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11c00039c0 0x7f11c0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 -- 172.21.15.18:0/3634228645 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0003530 con 0x7f11c0004810 2024-04-25T10:08:38.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11dbe00640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11c00039c0 0x7f11c0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11d3400640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c0004810 0x7f11c0004c90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009ae0 tx=0x7f11c401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bec76b53331790 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40096b0 con 0x7f11c0004810 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40a6480 con 0x7f11c0004810 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11db400640 1 -- 172.21.15.18:0/3634228645 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c40a6870 con 0x7f11c0004810 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e3200640 1 -- 172.21.15.18:0/3634228645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c0004810 msgr2=0x7f11c0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e3200640 1 --2- 172.21.15.18:0/3634228645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11c0004810 0x7f11c0004c90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f11c4009ae0 tx=0x7f11c401ca10 comp rx=0 tx=0).stop 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e1200640 1 -- 172.21.15.18:0/3634228645 reap_dead start 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e3200640 1 -- 172.21.15.18:0/3634228645 shutdown_connections 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.706+0000 7f11e3200640 1 -- 172.21.15.18:0/3634228645 >> 172.21.15.18:0/3634228645 conn(0x7f11dc0b2400 msgr2=0x7f11dc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- 172.21.15.18:0/3634228645 shutdown_connections 2024-04-25T10:08:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- 172.21.15.18:0/3634228645 wait complete. 2024-04-25T10:08:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 Processor -- start 2024-04-25T10:08:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- start start 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 0x7f11dc1587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11dc150800 0x7f11dc0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15e360 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0d0720 con 0x7f11dc150800 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0b0030 con 0x7f11c0004810 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42764/0 (socket says 172.21.15.18:42764) 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 -- 172.21.15.18:0/2557226658 learned_addr learned my addr 172.21.15.18:0/2557226658 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11e1200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11dc150800 0x7f11dc0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11dbe00640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 0x7f11dc1587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 -- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 msgr2=0x7f11dc1587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 0x7f11dc1587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 -- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11dc150800 msgr2=0x7f11dc0cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11dc150800 0x7f11dc0cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 -- 172.21.15.18:0/2557226658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc159460 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11dbe00640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 0x7f11dc1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.710+0000 7f11d3400640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f11c4098290 tx=0x7f11c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4004030 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c40041d0 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4003620 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc159740 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc0c9a80 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc0745d0 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f11c40037c0 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:38.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f11c411f300 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.714+0000 7f11dbe00640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:38.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.718+0000 7f11dbe00640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 0x7f11b8069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0018b0 tx=0x7f11cc000f60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:38.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.718+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11c40c2030 con 0x7f11dc0ce0e0 2024-04-25T10:08:38.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.874+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11dc0728d0 con 0x7f11b8066f60 2024-04-25T10:08:38.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.882+0000 7f11d8c00640 1 -- 172.21.15.18:0/2557226658 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248409 (secure 0 0 0) 0x7f11dc0728d0 con 0x7f11b8066f60 2024-04-25T10:08:38.893 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:38.894 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 msgr2=0x7f11b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 0x7f11b8069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0018b0 tx=0x7f11cc000f60 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 msgr2=0x7f11dc158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f11c4098290 tx=0x7f11c0005840 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 shutdown_connections 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11dc150800 0x7f11dc0cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11dc0ce0e0 0x7f11dc158ce0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 --2- 172.21.15.18:0/2557226658 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f11c0004810 0x7f11dc1587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 >> 172.21.15.18:0/2557226658 conn(0x7f11dc0b2400 msgr2=0x7f11dc0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 shutdown_connections 2024-04-25T10:08:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:38.886+0000 7f11e3200640 1 -- 172.21.15.18:0/2557226658 wait complete. 2024-04-25T10:08:38.914 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-25T10:08:37.466504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":181,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":134,"ondisk_log_size":134,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":51,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":249864,"kb_used_data":8704,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724856,"statfs":{"total":773094113280,"available":772838252544,"internally_reserved":0,"allocated":8912896,"data_stored":4697014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.487201"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999572+0000","last_change":"2024-04-25T10:08:32.999572+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999572+0000","last_undegraded":"2024-04-25T10:08:32.999572+0000","last_fullsized":"2024-04-25T10:08:32.999572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029526+0000","last_change":"2024-04-25T10:08:34.021493+0000","last_active":"2024-04-25T10:08:35.029526+0000","last_peered":"2024-04-25T10:08:35.029526+0000","last_clean":"2024-04-25T10:08:35.029526+0000","last_became_active":"2024-04-25T10:08:34.021186+0000","last_became_peered":"2024-04-25T10:08:34.021186+0000","last_unstale":"2024-04-25T10:08:35.029526+0000","last_undegraded":"2024-04-25T10:08:35.029526+0000","last_fullsized":"2024-04-25T10:08:35.029526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:42.229181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998998+0000","last_change":"2024-04-25T10:08:34.025282+0000","last_active":"2024-04-25T10:08:34.998998+0000","last_peered":"2024-04-25T10:08:34.998998+0000","last_clean":"2024-04-25T10:08:34.998998+0000","last_became_active":"2024-04-25T10:08:34.025024+0000","last_became_peered":"2024-04-25T10:08:34.025024+0000","last_unstale":"2024-04-25T10:08:34.998998+0000","last_undegraded":"2024-04-25T10:08:34.998998+0000","last_fullsized":"2024-04-25T10:08:34.998998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997864+0000","last_change":"2024-04-25T10:08:32.997864+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997864+0000","last_undegraded":"2024-04-25T10:08:32.997864+0000","last_fullsized":"2024-04-25T10:08:32.997864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031585+0000","last_change":"2024-04-25T10:08:34.017231+0000","last_active":"2024-04-25T10:08:35.031585+0000","last_peered":"2024-04-25T10:08:35.031585+0000","last_clean":"2024-04-25T10:08:35.031585+0000","last_became_active":"2024-04-25T10:08:34.016095+0000","last_became_peered":"2024-04-25T10:08:34.016095+0000","last_unstale":"2024-04-25T10:08:35.031585+0000","last_undegraded":"2024-04-25T10:08:35.031585+0000","last_fullsized":"2024-04-25T10:08:35.031585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.605425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990198+0000","last_change":"2024-04-25T10:08:32.990198+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990198+0000","last_undegraded":"2024-04-25T10:08:32.990198+0000","last_fullsized":"2024-04-25T10:08:32.990198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031661+0000","last_change":"2024-04-25T10:08:34.017931+0000","last_active":"2024-04-25T10:08:35.031661+0000","last_peered":"2024-04-25T10:08:35.031661+0000","last_clean":"2024-04-25T10:08:35.031661+0000","last_became_active":"2024-04-25T10:08:34.017586+0000","last_became_peered":"2024-04-25T10:08:34.017586+0000","last_unstale":"2024-04-25T10:08:35.031661+0000","last_undegraded":"2024-04-25T10:08:35.031661+0000","last_fullsized":"2024-04-25T10:08:35.031661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:49.996965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990781+0000","last_change":"2024-04-25T10:08:32.990781+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990781+0000","last_undegraded":"2024-04-25T10:08:32.990781+0000","last_fullsized":"2024-04-25T10:08:32.990781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998080+0000","last_change":"2024-04-25T10:08:32.998080+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998080+0000","last_undegraded":"2024-04-25T10:08:32.998080+0000","last_fullsized":"2024-04-25T10:08:32.998080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029377+0000","last_change":"2024-04-25T10:08:34.026807+0000","last_active":"2024-04-25T10:08:35.029377+0000","last_peered":"2024-04-25T10:08:35.029377+0000","last_clean":"2024-04-25T10:08:35.029377+0000","last_became_active":"2024-04-25T10:08:34.025681+0000","last_became_peered":"2024-04-25T10:08:34.025681+0000","last_unstale":"2024-04-25T10:08:35.029377+0000","last_undegraded":"2024-04-25T10:08:35.029377+0000","last_fullsized":"2024-04-25T10:08:35.029377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.077735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.997374+0000","last_change":"2024-04-25T10:08:32.997374+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.997374+0000","last_undegraded":"2024-04-25T10:08:32.997374+0000","last_fullsized":"2024-04-25T10:08:32.997374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031744+0000","last_change":"2024-04-25T10:08:34.015665+0000","last_active":"2024-04-25T10:08:35.031744+0000","last_peered":"2024-04-25T10:08:35.031744+0000","last_clean":"2024-04-25T10:08:35.031744+0000","last_became_active":"2024-04-25T10:08:34.015246+0000","last_became_peered":"2024-04-25T10:08:34.015246+0000","last_unstale":"2024-04-25T10:08:35.031744+0000","last_undegraded":"2024-04-25T10:08:35.031744+0000","last_fullsized":"2024-04-25T10:08:35.031744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028905+0000","last_change":"2024-04-25T10:08:34.014342+0000","last_active":"2024-04-25T10:08:35.028905+0000","last_peered":"2024-04-25T10:08:35.028905+0000","last_clean":"2024-04-25T10:08:35.028905+0000","last_became_active":"2024-04-25T10:08:34.014011+0000","last_became_peered":"2024-04-25T10:08:34.014011+0000","last_unstale":"2024-04-25T10:08:35.028905+0000","last_undegraded":"2024-04-25T10:08:35.028905+0000","last_fullsized":"2024-04-25T10:08:35.028905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:40.898281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996176+0000","last_change":"2024-04-25T10:08:32.996176+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996176+0000","last_undegraded":"2024-04-25T10:08:32.996176+0000","last_fullsized":"2024-04-25T10:08:32.996176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031908+0000","last_change":"2024-04-25T10:08:34.011449+0000","last_active":"2024-04-25T10:08:35.031908+0000","last_peered":"2024-04-25T10:08:35.031908+0000","last_clean":"2024-04-25T10:08:35.031908+0000","last_became_active":"2024-04-25T10:08:34.011147+0000","last_became_peered":"2024-04-25T10:08:34.011147+0000","last_unstale":"2024-04-25T10:08:35.031908+0000","last_undegraded":"2024-04-25T10:08:35.031908+0000","last_fullsized":"2024-04-25T10:08:35.031908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.893587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999000+0000","last_change":"2024-04-25T10:08:34.010473+0000","last_active":"2024-04-25T10:08:34.999000+0000","last_peered":"2024-04-25T10:08:34.999000+0000","last_clean":"2024-04-25T10:08:34.999000+0000","last_became_active":"2024-04-25T10:08:34.010053+0000","last_became_peered":"2024-04-25T10:08:34.010053+0000","last_unstale":"2024-04-25T10:08:34.999000+0000","last_undegraded":"2024-04-25T10:08:34.999000+0000","last_fullsized":"2024-04-25T10:08:34.999000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031767+0000","last_change":"2024-04-25T10:08:34.007070+0000","last_active":"2024-04-25T10:08:35.031767+0000","last_peered":"2024-04-25T10:08:35.031767+0000","last_clean":"2024-04-25T10:08:35.031767+0000","last_became_active":"2024-04-25T10:08:34.006804+0000","last_became_peered":"2024-04-25T10:08:34.006804+0000","last_unstale":"2024-04-25T10:08:35.031767+0000","last_undegraded":"2024-04-25T10:08:35.031767+0000","last_fullsized":"2024-04-25T10:08:35.031767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:41.897342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992122+0000","last_change":"2024-04-25T10:08:32.992122+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992122+0000","last_undegraded":"2024-04-25T10:08:32.992122+0000","last_fullsized":"2024-04-25T10:08:32.992122+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031521+0000","last_change":"2024-04-25T10:08:34.020307+0000","last_active":"2024-04-25T10:08:35.031521+0000","last_peered":"2024-04-25T10:08:35.031521+0000","last_clean":"2024-04-25T10:08:35.031521+0000","last_became_active":"2024-04-25T10:08:34.018096+0000","last_became_peered":"2024-04-25T10:08:34.018096+0000","last_unstale":"2024-04-25T10:08:35.031521+0000","last_undegraded":"2024-04-25T10:08:35.031521+0000","last_fullsized":"2024-04-25T10:08:35.031521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:36.687476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.988735+0000","last_change":"2024-04-25T10:08:32.988735+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.988735+0000","last_undegraded":"2024-04-25T10:08:32.988735+0000","last_fullsized":"2024-04-25T10:08:32.988735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028846+0000","last_change":"2024-04-25T10:08:34.026585+0000","last_active":"2024-04-25T10:08:35.028846+0000","last_peered":"2024-04-25T10:08:35.028846+0000","last_clean":"2024-04-25T10:08:35.028846+0000","last_became_active":"2024-04-25T10:08:34.026274+0000","last_became_peered":"2024-04-25T10:08:34.026274+0000","last_unstale":"2024-04-25T10:08:35.028846+0000","last_undegraded":"2024-04-25T10:08:35.028846+0000","last_fullsized":"2024-04-25T10:08:35.028846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:41.217493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029490+0000","last_change":"2024-04-25T10:08:34.025864+0000","last_active":"2024-04-25T10:08:35.029490+0000","last_peered":"2024-04-25T10:08:35.029490+0000","last_clean":"2024-04-25T10:08:35.029490+0000","last_became_active":"2024-04-25T10:08:34.025510+0000","last_became_peered":"2024-04-25T10:08:34.025510+0000","last_unstale":"2024-04-25T10:08:35.029490+0000","last_undegraded":"2024-04-25T10:08:35.029490+0000","last_fullsized":"2024-04-25T10:08:35.029490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996041+0000","last_change":"2024-04-25T10:08:32.996041+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996041+0000","last_undegraded":"2024-04-25T10:08:32.996041+0000","last_fullsized":"2024-04-25T10:08:32.996041+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.999201+0000","last_change":"2024-04-25T10:08:32.999201+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.999201+0000","last_undegraded":"2024-04-25T10:08:32.999201+0000","last_fullsized":"2024-04-25T10:08:32.999201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031801+0000","last_change":"2024-04-25T10:08:34.030709+0000","last_active":"2024-04-25T10:08:35.031801+0000","last_peered":"2024-04-25T10:08:35.031801+0000","last_clean":"2024-04-25T10:08:35.031801+0000","last_became_active":"2024-04-25T10:08:34.030384+0000","last_became_peered":"2024-04-25T10:08:34.030384+0000","last_unstale":"2024-04-25T10:08:35.031801+0000","last_undegraded":"2024-04-25T10:08:35.031801+0000","last_fullsized":"2024-04-25T10:08:35.031801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:10.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029152+0000","last_change":"2024-04-25T10:08:34.020753+0000","last_active":"2024-04-25T10:08:35.029152+0000","last_peered":"2024-04-25T10:08:35.029152+0000","last_clean":"2024-04-25T10:08:35.029152+0000","last_became_active":"2024-04-25T10:08:34.020394+0000","last_became_peered":"2024-04-25T10:08:34.020394+0000","last_unstale":"2024-04-25T10:08:35.029152+0000","last_undegraded":"2024-04-25T10:08:35.029152+0000","last_fullsized":"2024-04-25T10:08:35.029152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:51.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996331+0000","last_change":"2024-04-25T10:08:32.996331+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996331+0000","last_undegraded":"2024-04-25T10:08:32.996331+0000","last_fullsized":"2024-04-25T10:08:32.996331+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999136+0000","last_change":"2024-04-25T10:08:34.009888+0000","last_active":"2024-04-25T10:08:34.999136+0000","last_peered":"2024-04-25T10:08:34.999136+0000","last_clean":"2024-04-25T10:08:34.999136+0000","last_became_active":"2024-04-25T10:08:34.008686+0000","last_became_peered":"2024-04-25T10:08:34.008686+0000","last_unstale":"2024-04-25T10:08:34.999136+0000","last_undegraded":"2024-04-25T10:08:34.999136+0000","last_fullsized":"2024-04-25T10:08:34.999136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995643+0000","last_change":"2024-04-25T10:08:32.995643+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995643+0000","last_undegraded":"2024-04-25T10:08:32.995643+0000","last_fullsized":"2024-04-25T10:08:32.995643+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999140+0000","last_change":"2024-04-25T10:08:34.011122+0000","last_active":"2024-04-25T10:08:34.999140+0000","last_peered":"2024-04-25T10:08:34.999140+0000","last_clean":"2024-04-25T10:08:34.999140+0000","last_became_active":"2024-04-25T10:08:34.010868+0000","last_became_peered":"2024-04-25T10:08:34.010868+0000","last_unstale":"2024-04-25T10:08:34.999140+0000","last_undegraded":"2024-04-25T10:08:34.999140+0000","last_fullsized":"2024-04-25T10:08:34.999140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031894+0000","last_change":"2024-04-25T10:08:33.002480+0000","last_active":"2024-04-25T10:08:35.031894+0000","last_peered":"2024-04-25T10:08:35.031894+0000","last_clean":"2024-04-25T10:08:35.031894+0000","last_became_active":"2024-04-25T10:08:33.000086+0000","last_became_peered":"2024-04-25T10:08:33.000086+0000","last_unstale":"2024-04-25T10:08:35.031894+0000","last_undegraded":"2024-04-25T10:08:35.031894+0000","last_fullsized":"2024-04-25T10:08:35.031894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:57.411455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028904+0000","last_change":"2024-04-25T10:08:34.026292+0000","last_active":"2024-04-25T10:08:35.028904+0000","last_peered":"2024-04-25T10:08:35.028904+0000","last_clean":"2024-04-25T10:08:35.028904+0000","last_became_active":"2024-04-25T10:08:34.026020+0000","last_became_peered":"2024-04-25T10:08:34.026020+0000","last_unstale":"2024-04-25T10:08:35.028904+0000","last_undegraded":"2024-04-25T10:08:35.028904+0000","last_fullsized":"2024-04-25T10:08:35.028904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:52.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016511+0000","last_change":"2024-04-25T10:08:33.011515+0000","last_active":"2024-04-25T10:08:33.016511+0000","last_peered":"2024-04-25T10:08:33.016511+0000","last_clean":"2024-04-25T10:08:33.016511+0000","last_became_active":"2024-04-25T10:08:33.010837+0000","last_became_peered":"2024-04-25T10:08:33.010837+0000","last_unstale":"2024-04-25T10:08:33.016511+0000","last_undegraded":"2024-04-25T10:08:33.016511+0000","last_fullsized":"2024-04-25T10:08:33.016511+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990913+0000","last_change":"2024-04-25T10:08:32.990913+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990913+0000","last_undegraded":"2024-04-25T10:08:32.990913+0000","last_fullsized":"2024-04-25T10:08:32.990913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016551+0000","last_change":"2024-04-25T10:08:33.011678+0000","last_active":"2024-04-25T10:08:33.016551+0000","last_peered":"2024-04-25T10:08:33.016551+0000","last_clean":"2024-04-25T10:08:33.016551+0000","last_became_active":"2024-04-25T10:08:33.011366+0000","last_became_peered":"2024-04-25T10:08:33.011366+0000","last_unstale":"2024-04-25T10:08:33.016551+0000","last_undegraded":"2024-04-25T10:08:33.016551+0000","last_fullsized":"2024-04-25T10:08:33.016551+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:45.021233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991690+0000","last_change":"2024-04-25T10:08:32.991690+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991690+0000","last_undegraded":"2024-04-25T10:08:32.991690+0000","last_fullsized":"2024-04-25T10:08:32.991690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013359+0000","last_change":"2024-04-25T10:08:33.007013+0000","last_active":"2024-04-25T10:08:33.013359+0000","last_peered":"2024-04-25T10:08:33.013359+0000","last_clean":"2024-04-25T10:08:33.013359+0000","last_became_active":"2024-04-25T10:08:33.006754+0000","last_became_peered":"2024-04-25T10:08:33.006754+0000","last_unstale":"2024-04-25T10:08:33.013359+0000","last_undegraded":"2024-04-25T10:08:33.013359+0000","last_fullsized":"2024-04-25T10:08:33.013359+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:53.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029185+0000","last_change":"2024-04-25T10:08:34.025084+0000","last_active":"2024-04-25T10:08:35.029185+0000","last_peered":"2024-04-25T10:08:35.029185+0000","last_clean":"2024-04-25T10:08:35.029185+0000","last_became_active":"2024-04-25T10:08:34.024770+0000","last_became_peered":"2024-04-25T10:08:34.024770+0000","last_unstale":"2024-04-25T10:08:35.029185+0000","last_undegraded":"2024-04-25T10:08:35.029185+0000","last_fullsized":"2024-04-25T10:08:35.029185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.334293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009630+0000","last_change":"2024-04-25T10:08:33.007061+0000","last_active":"2024-04-25T10:08:33.009630+0000","last_peered":"2024-04-25T10:08:33.009630+0000","last_clean":"2024-04-25T10:08:33.009630+0000","last_became_active":"2024-04-25T10:08:33.006778+0000","last_became_peered":"2024-04-25T10:08:33.006778+0000","last_unstale":"2024-04-25T10:08:33.009630+0000","last_undegraded":"2024-04-25T10:08:33.009630+0000","last_fullsized":"2024-04-25T10:08:33.009630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:01.724703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029446+0000","last_change":"2024-04-25T10:08:34.031090+0000","last_active":"2024-04-25T10:08:35.029446+0000","last_peered":"2024-04-25T10:08:35.029446+0000","last_clean":"2024-04-25T10:08:35.029446+0000","last_became_active":"2024-04-25T10:08:34.023940+0000","last_became_peered":"2024-04-25T10:08:34.023940+0000","last_unstale":"2024-04-25T10:08:35.029446+0000","last_undegraded":"2024-04-25T10:08:35.029446+0000","last_fullsized":"2024-04-25T10:08:35.029446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:28.981263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009561+0000","last_change":"2024-04-25T10:08:33.005514+0000","last_active":"2024-04-25T10:08:33.009561+0000","last_peered":"2024-04-25T10:08:33.009561+0000","last_clean":"2024-04-25T10:08:33.009561+0000","last_became_active":"2024-04-25T10:08:33.005250+0000","last_became_peered":"2024-04-25T10:08:33.005250+0000","last_unstale":"2024-04-25T10:08:33.009561+0000","last_undegraded":"2024-04-25T10:08:33.009561+0000","last_fullsized":"2024-04-25T10:08:33.009561+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.993102+0000","last_change":"2024-04-25T10:08:32.993102+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.993102+0000","last_undegraded":"2024-04-25T10:08:32.993102+0000","last_fullsized":"2024-04-25T10:08:32.993102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028964+0000","last_change":"2024-04-25T10:08:33.006037+0000","last_active":"2024-04-25T10:08:35.028964+0000","last_peered":"2024-04-25T10:08:35.028964+0000","last_clean":"2024-04-25T10:08:35.028964+0000","last_became_active":"2024-04-25T10:08:33.005767+0000","last_became_peered":"2024-04-25T10:08:33.005767+0000","last_unstale":"2024-04-25T10:08:35.028964+0000","last_undegraded":"2024-04-25T10:08:35.028964+0000","last_fullsized":"2024-04-25T10:08:35.028964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:53.277350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992811+0000","last_change":"2024-04-25T10:08:32.992811+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992811+0000","last_undegraded":"2024-04-25T10:08:32.992811+0000","last_fullsized":"2024-04-25T10:08:32.992811+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031330+0000","last_change":"2024-04-25T10:08:32.995936+0000","last_active":"2024-04-25T10:08:35.031330+0000","last_peered":"2024-04-25T10:08:35.031330+0000","last_clean":"2024-04-25T10:08:35.031330+0000","last_became_active":"2024-04-25T10:08:32.995620+0000","last_became_peered":"2024-04-25T10:08:32.995620+0000","last_unstale":"2024-04-25T10:08:35.031330+0000","last_undegraded":"2024-04-25T10:08:35.031330+0000","last_fullsized":"2024-04-25T10:08:35.031330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.564491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028864+0000","last_change":"2024-04-25T10:08:34.020243+0000","last_active":"2024-04-25T10:08:35.028864+0000","last_peered":"2024-04-25T10:08:35.028864+0000","last_clean":"2024-04-25T10:08:35.028864+0000","last_became_active":"2024-04-25T10:08:34.018667+0000","last_became_peered":"2024-04-25T10:08:34.018667+0000","last_unstale":"2024-04-25T10:08:35.028864+0000","last_undegraded":"2024-04-25T10:08:35.028864+0000","last_fullsized":"2024-04-25T10:08:35.028864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:08.399465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019207+0000","last_change":"2024-04-25T10:08:33.014183+0000","last_active":"2024-04-25T10:08:33.019207+0000","last_peered":"2024-04-25T10:08:33.019207+0000","last_clean":"2024-04-25T10:08:33.019207+0000","last_became_active":"2024-04-25T10:08:33.013867+0000","last_became_peered":"2024-04-25T10:08:33.013867+0000","last_unstale":"2024-04-25T10:08:33.019207+0000","last_undegraded":"2024-04-25T10:08:33.019207+0000","last_fullsized":"2024-04-25T10:08:33.019207+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.995420+0000","last_change":"2024-04-25T10:08:32.995420+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.995420+0000","last_undegraded":"2024-04-25T10:08:32.995420+0000","last_fullsized":"2024-04-25T10:08:32.995420+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009592+0000","last_change":"2024-04-25T10:08:33.007771+0000","last_active":"2024-04-25T10:08:33.009592+0000","last_peered":"2024-04-25T10:08:33.009592+0000","last_clean":"2024-04-25T10:08:33.009592+0000","last_became_active":"2024-04-25T10:08:33.006885+0000","last_became_peered":"2024-04-25T10:08:33.006885+0000","last_unstale":"2024-04-25T10:08:33.009592+0000","last_undegraded":"2024-04-25T10:08:33.009592+0000","last_fullsized":"2024-04-25T10:08:33.009592+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:31.650799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031943+0000","last_change":"2024-04-25T10:08:33.000784+0000","last_active":"2024-04-25T10:08:35.031943+0000","last_peered":"2024-04-25T10:08:35.031943+0000","last_clean":"2024-04-25T10:08:35.031943+0000","last_became_active":"2024-04-25T10:08:33.000487+0000","last_became_peered":"2024-04-25T10:08:33.000487+0000","last_unstale":"2024-04-25T10:08:35.031943+0000","last_undegraded":"2024-04-25T10:08:35.031943+0000","last_fullsized":"2024-04-25T10:08:35.031943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:01.990140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999011+0000","last_change":"2024-04-25T10:08:34.024469+0000","last_active":"2024-04-25T10:08:34.999011+0000","last_peered":"2024-04-25T10:08:34.999011+0000","last_clean":"2024-04-25T10:08:34.999011+0000","last_became_active":"2024-04-25T10:08:34.024156+0000","last_became_peered":"2024-04-25T10:08:34.024156+0000","last_unstale":"2024-04-25T10:08:34.999011+0000","last_undegraded":"2024-04-25T10:08:34.999011+0000","last_fullsized":"2024-04-25T10:08:34.999011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.003564+0000","last_change":"2024-04-25T10:08:32.998633+0000","last_active":"2024-04-25T10:08:33.003564+0000","last_peered":"2024-04-25T10:08:33.003564+0000","last_clean":"2024-04-25T10:08:33.003564+0000","last_became_active":"2024-04-25T10:08:32.998332+0000","last_became_peered":"2024-04-25T10:08:32.998332+0000","last_unstale":"2024-04-25T10:08:33.003564+0000","last_undegraded":"2024-04-25T10:08:33.003564+0000","last_fullsized":"2024-04-25T10:08:33.003564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:15.122956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.996477+0000","last_change":"2024-04-25T10:08:32.996477+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.996477+0000","last_undegraded":"2024-04-25T10:08:32.996477+0000","last_fullsized":"2024-04-25T10:08:32.996477+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.009611+0000","last_change":"2024-04-25T10:08:33.006611+0000","last_active":"2024-04-25T10:08:33.009611+0000","last_peered":"2024-04-25T10:08:33.009611+0000","last_clean":"2024-04-25T10:08:33.009611+0000","last_became_active":"2024-04-25T10:08:33.006152+0000","last_became_peered":"2024-04-25T10:08:33.006152+0000","last_unstale":"2024-04-25T10:08:33.009611+0000","last_undegraded":"2024-04-25T10:08:33.009611+0000","last_fullsized":"2024-04-25T10:08:33.009611+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992129+0000","last_change":"2024-04-25T10:08:32.992129+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992129+0000","last_undegraded":"2024-04-25T10:08:32.992129+0000","last_fullsized":"2024-04-25T10:08:32.992129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013736+0000","last_change":"2024-04-25T10:08:33.010430+0000","last_active":"2024-04-25T10:08:33.013736+0000","last_peered":"2024-04-25T10:08:33.013736+0000","last_clean":"2024-04-25T10:08:33.013736+0000","last_became_active":"2024-04-25T10:08:33.010028+0000","last_became_peered":"2024-04-25T10:08:33.010028+0000","last_unstale":"2024-04-25T10:08:33.013736+0000","last_undegraded":"2024-04-25T10:08:33.013736+0000","last_fullsized":"2024-04-25T10:08:33.013736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:40.104277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989438+0000","last_change":"2024-04-25T10:08:32.989438+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989438+0000","last_undegraded":"2024-04-25T10:08:32.989438+0000","last_fullsized":"2024-04-25T10:08:32.989438+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031412+0000","last_change":"2024-04-25T10:08:33.000541+0000","last_active":"2024-04-25T10:08:35.031412+0000","last_peered":"2024-04-25T10:08:35.031412+0000","last_clean":"2024-04-25T10:08:35.031412+0000","last_became_active":"2024-04-25T10:08:33.000156+0000","last_became_peered":"2024-04-25T10:08:33.000156+0000","last_unstale":"2024-04-25T10:08:35.031412+0000","last_undegraded":"2024-04-25T10:08:35.031412+0000","last_fullsized":"2024-04-25T10:08:35.031412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:05.087355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.992342+0000","last_change":"2024-04-25T10:08:32.992342+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.992342+0000","last_undegraded":"2024-04-25T10:08:32.992342+0000","last_fullsized":"2024-04-25T10:08:32.992342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028931+0000","last_change":"2024-04-25T10:08:33.001887+0000","last_active":"2024-04-25T10:08:35.028931+0000","last_peered":"2024-04-25T10:08:35.028931+0000","last_clean":"2024-04-25T10:08:35.028931+0000","last_became_active":"2024-04-25T10:08:33.001619+0000","last_became_peered":"2024-04-25T10:08:33.001619+0000","last_unstale":"2024-04-25T10:08:35.028931+0000","last_undegraded":"2024-04-25T10:08:35.028931+0000","last_fullsized":"2024-04-25T10:08:35.028931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.189417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.016533+0000","last_change":"2024-04-25T10:08:33.011663+0000","last_active":"2024-04-25T10:08:33.016533+0000","last_peered":"2024-04-25T10:08:33.016533+0000","last_clean":"2024-04-25T10:08:33.016533+0000","last_became_active":"2024-04-25T10:08:33.011338+0000","last_became_peered":"2024-04-25T10:08:33.011338+0000","last_unstale":"2024-04-25T10:08:33.016533+0000","last_undegraded":"2024-04-25T10:08:33.016533+0000","last_fullsized":"2024-04-25T10:08:33.016533+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031552+0000","last_change":"2024-04-25T10:08:34.012127+0000","last_active":"2024-04-25T10:08:35.031552+0000","last_peered":"2024-04-25T10:08:35.031552+0000","last_clean":"2024-04-25T10:08:35.031552+0000","last_became_active":"2024-04-25T10:08:34.011736+0000","last_became_peered":"2024-04-25T10:08:34.011736+0000","last_unstale":"2024-04-25T10:08:35.031552+0000","last_undegraded":"2024-04-25T10:08:35.031552+0000","last_fullsized":"2024-04-25T10:08:35.031552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:16.153141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008148+0000","last_change":"2024-04-25T10:08:33.003042+0000","last_active":"2024-04-25T10:08:33.008148+0000","last_peered":"2024-04-25T10:08:33.008148+0000","last_clean":"2024-04-25T10:08:33.008148+0000","last_became_active":"2024-04-25T10:08:33.002788+0000","last_became_peered":"2024-04-25T10:08:33.002788+0000","last_unstale":"2024-04-25T10:08:33.008148+0000","last_undegraded":"2024-04-25T10:08:33.008148+0000","last_fullsized":"2024-04-25T10:08:33.008148+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:10:09.025426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031642+0000","last_change":"2024-04-25T10:08:34.019681+0000","last_active":"2024-04-25T10:08:35.031642+0000","last_peered":"2024-04-25T10:08:35.031642+0000","last_clean":"2024-04-25T10:08:35.031642+0000","last_became_active":"2024-04-25T10:08:34.019409+0000","last_became_peered":"2024-04-25T10:08:34.019409+0000","last_unstale":"2024-04-25T10:08:35.031642+0000","last_undegraded":"2024-04-25T10:08:35.031642+0000","last_fullsized":"2024-04-25T10:08:35.031642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:04.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031975+0000","last_change":"2024-04-25T10:08:32.997942+0000","last_active":"2024-04-25T10:08:35.031975+0000","last_peered":"2024-04-25T10:08:35.031975+0000","last_clean":"2024-04-25T10:08:35.031975+0000","last_became_active":"2024-04-25T10:08:32.995849+0000","last_became_peered":"2024-04-25T10:08:32.995849+0000","last_unstale":"2024-04-25T10:08:35.031975+0000","last_undegraded":"2024-04-25T10:08:35.031975+0000","last_fullsized":"2024-04-25T10:08:35.031975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:13.109114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:08:32.976611+0000","last_change":"2024-04-25T10:08:32.976611+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.976611+0000","last_undegraded":"2024-04-25T10:08:32.976611+0000","last_fullsized":"2024-04-25T10:08:32.976611+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998886+0000","last_change":"2024-04-25T10:08:33.004697+0000","last_active":"2024-04-25T10:08:34.998886+0000","last_peered":"2024-04-25T10:08:34.998886+0000","last_clean":"2024-04-25T10:08:34.998886+0000","last_became_active":"2024-04-25T10:08:33.004438+0000","last_became_peered":"2024-04-25T10:08:33.004438+0000","last_unstale":"2024-04-25T10:08:34.998886+0000","last_undegraded":"2024-04-25T10:08:34.998886+0000","last_fullsized":"2024-04-25T10:08:34.998886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:27.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029208+0000","last_change":"2024-04-25T10:08:34.030460+0000","last_active":"2024-04-25T10:08:35.029208+0000","last_peered":"2024-04-25T10:08:35.029208+0000","last_clean":"2024-04-25T10:08:35.029208+0000","last_became_active":"2024-04-25T10:08:34.030192+0000","last_became_peered":"2024-04-25T10:08:34.030192+0000","last_unstale":"2024-04-25T10:08:35.029208+0000","last_undegraded":"2024-04-25T10:08:35.029208+0000","last_fullsized":"2024-04-25T10:08:35.029208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:43.931847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982991+0000","last_change":"2024-04-25T10:08:31.982991+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982991+0000","last_undegraded":"2024-04-25T10:08:31.982991+0000","last_fullsized":"2024-04-25T10:08:31.982991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029533+0000","last_change":"2024-04-25T10:08:34.016568+0000","last_active":"2024-04-25T10:08:35.029533+0000","last_peered":"2024-04-25T10:08:35.029533+0000","last_clean":"2024-04-25T10:08:35.029533+0000","last_became_active":"2024-04-25T10:08:34.016236+0000","last_became_peered":"2024-04-25T10:08:34.016236+0000","last_unstale":"2024-04-25T10:08:35.029533+0000","last_undegraded":"2024-04-25T10:08:35.029533+0000","last_fullsized":"2024-04-25T10:08:35.029533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:54.046151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.983178+0000","last_change":"2024-04-25T10:08:31.983178+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.983178+0000","last_undegraded":"2024-04-25T10:08:31.983178+0000","last_fullsized":"2024-04-25T10:08:31.983178+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991601+0000","last_change":"2024-04-25T10:08:32.991601+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991601+0000","last_undegraded":"2024-04-25T10:08:32.991601+0000","last_fullsized":"2024-04-25T10:08:32.991601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982905+0000","last_change":"2024-04-25T10:08:31.982905+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982905+0000","last_undegraded":"2024-04-25T10:08:31.982905+0000","last_fullsized":"2024-04-25T10:08:31.982905+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989959+0000","last_change":"2024-04-25T10:08:32.989959+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989959+0000","last_undegraded":"2024-04-25T10:08:32.989959+0000","last_fullsized":"2024-04-25T10:08:32.989959+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013412+0000","last_change":"2024-04-25T10:08:33.008642+0000","last_active":"2024-04-25T10:08:33.013412+0000","last_peered":"2024-04-25T10:08:33.013412+0000","last_clean":"2024-04-25T10:08:33.013412+0000","last_became_active":"2024-04-25T10:08:33.008355+0000","last_became_peered":"2024-04-25T10:08:33.008355+0000","last_unstale":"2024-04-25T10:08:33.013412+0000","last_undegraded":"2024-04-25T10:08:33.013412+0000","last_fullsized":"2024-04-25T10:08:33.013412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:14.672083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.989722+0000","last_change":"2024-04-25T10:08:32.989722+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.989722+0000","last_undegraded":"2024-04-25T10:08:32.989722+0000","last_fullsized":"2024-04-25T10:08:32.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029589+0000","last_change":"2024-04-25T10:08:33.003130+0000","last_active":"2024-04-25T10:08:35.029589+0000","last_peered":"2024-04-25T10:08:35.029589+0000","last_clean":"2024-04-25T10:08:35.029589+0000","last_became_active":"2024-04-25T10:08:33.002868+0000","last_became_peered":"2024-04-25T10:08:33.002868+0000","last_unstale":"2024-04-25T10:08:35.029589+0000","last_undegraded":"2024-04-25T10:08:35.029589+0000","last_fullsized":"2024-04-25T10:08:35.029589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:07.070501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990386+0000","last_change":"2024-04-25T10:08:32.990386+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990386+0000","last_undegraded":"2024-04-25T10:08:32.990386+0000","last_fullsized":"2024-04-25T10:08:32.990386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013729+0000","last_change":"2024-04-25T10:08:33.010326+0000","last_active":"2024-04-25T10:08:33.013729+0000","last_peered":"2024-04-25T10:08:33.013729+0000","last_clean":"2024-04-25T10:08:33.013729+0000","last_became_active":"2024-04-25T10:08:33.010037+0000","last_became_peered":"2024-04-25T10:08:33.010037+0000","last_unstale":"2024-04-25T10:08:33.013729+0000","last_undegraded":"2024-04-25T10:08:33.013729+0000","last_fullsized":"2024-04-25T10:08:33.013729+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.839098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029213+0000","last_change":"2024-04-25T10:08:34.017218+0000","last_active":"2024-04-25T10:08:35.029213+0000","last_peered":"2024-04-25T10:08:35.029213+0000","last_clean":"2024-04-25T10:08:35.029213+0000","last_became_active":"2024-04-25T10:08:34.016156+0000","last_became_peered":"2024-04-25T10:08:34.016156+0000","last_unstale":"2024-04-25T10:08:35.029213+0000","last_undegraded":"2024-04-25T10:08:35.029213+0000","last_fullsized":"2024-04-25T10:08:35.029213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:22.115314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.019205+0000","last_change":"2024-04-25T10:08:33.014162+0000","last_active":"2024-04-25T10:08:33.019205+0000","last_peered":"2024-04-25T10:08:33.019205+0000","last_clean":"2024-04-25T10:08:33.019205+0000","last_became_active":"2024-04-25T10:08:33.013858+0000","last_became_peered":"2024-04-25T10:08:33.013858+0000","last_unstale":"2024-04-25T10:08:33.019205+0000","last_undegraded":"2024-04-25T10:08:33.019205+0000","last_fullsized":"2024-04-25T10:08:33.019205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:35.003598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.990029+0000","last_change":"2024-04-25T10:08:32.990029+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.990029+0000","last_undegraded":"2024-04-25T10:08:32.990029+0000","last_fullsized":"2024-04-25T10:08:32.990029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.013382+0000","last_change":"2024-04-25T10:08:33.007116+0000","last_active":"2024-04-25T10:08:33.013382+0000","last_peered":"2024-04-25T10:08:33.013382+0000","last_clean":"2024-04-25T10:08:33.013382+0000","last_became_active":"2024-04-25T10:08:33.006840+0000","last_became_peered":"2024-04-25T10:08:33.006840+0000","last_unstale":"2024-04-25T10:08:33.013382+0000","last_undegraded":"2024-04-25T10:08:33.013382+0000","last_fullsized":"2024-04-25T10:08:33.013382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:11.394789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.991537+0000","last_change":"2024-04-25T10:08:32.991537+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.991537+0000","last_undegraded":"2024-04-25T10:08:32.991537+0000","last_fullsized":"2024-04-25T10:08:32.991537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031588+0000","last_change":"2024-04-25T10:08:33.003506+0000","last_active":"2024-04-25T10:08:35.031588+0000","last_peered":"2024-04-25T10:08:35.031588+0000","last_clean":"2024-04-25T10:08:35.031588+0000","last_became_active":"2024-04-25T10:08:33.003077+0000","last_became_peered":"2024-04-25T10:08:33.003077+0000","last_unstale":"2024-04-25T10:08:35.031588+0000","last_undegraded":"2024-04-25T10:08:35.031588+0000","last_fullsized":"2024-04-25T10:08:35.031588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.875235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999250+0000","last_change":"2024-04-25T10:08:34.018059+0000","last_active":"2024-04-25T10:08:34.999250+0000","last_peered":"2024-04-25T10:08:34.999250+0000","last_clean":"2024-04-25T10:08:34.999250+0000","last_became_active":"2024-04-25T10:08:34.017761+0000","last_became_peered":"2024-04-25T10:08:34.017761+0000","last_unstale":"2024-04-25T10:08:34.999250+0000","last_undegraded":"2024-04-25T10:08:34.999250+0000","last_fullsized":"2024-04-25T10:08:34.999250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.008953+0000","last_change":"2024-04-25T10:08:33.004709+0000","last_active":"2024-04-25T10:08:33.008953+0000","last_peered":"2024-04-25T10:08:33.008953+0000","last_clean":"2024-04-25T10:08:33.008953+0000","last_became_active":"2024-04-25T10:08:33.004382+0000","last_became_peered":"2024-04-25T10:08:33.004382+0000","last_unstale":"2024-04-25T10:08:33.008953+0000","last_undegraded":"2024-04-25T10:08:33.008953+0000","last_fullsized":"2024-04-25T10:08:33.008953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:28.087771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999464+0000","last_change":"2024-04-25T10:08:34.013883+0000","last_active":"2024-04-25T10:08:34.999464+0000","last_peered":"2024-04-25T10:08:34.999464+0000","last_clean":"2024-04-25T10:08:34.999464+0000","last_became_active":"2024-04-25T10:08:34.013586+0000","last_became_peered":"2024-04-25T10:08:34.013586+0000","last_unstale":"2024-04-25T10:08:34.999464+0000","last_undegraded":"2024-04-25T10:08:34.999464+0000","last_fullsized":"2024-04-25T10:08:34.999464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998609+0000","last_change":"2024-04-25T10:08:33.000919+0000","last_active":"2024-04-25T10:08:34.998609+0000","last_peered":"2024-04-25T10:08:34.998609+0000","last_clean":"2024-04-25T10:08:34.998609+0000","last_became_active":"2024-04-25T10:08:33.000597+0000","last_became_peered":"2024-04-25T10:08:33.000597+0000","last_unstale":"2024-04-25T10:08:34.998609+0000","last_undegraded":"2024-04-25T10:08:34.998609+0000","last_fullsized":"2024-04-25T10:08:34.998609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2024-04-25T10:08:32.998495+0000","last_change":"2024-04-25T10:08:32.998495+0000","last_active":"2024-04-25T10:08:32.976611+0000","last_peered":"2024-04-25T10:08:32.976611+0000","last_clean":"2024-04-25T10:08:32.976611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:32.998495+0000","last_undegraded":"2024-04-25T10:08:32.998495+0000","last_fullsized":"2024-04-25T10:08:32.998495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":1,"reported_epoch":78,"state":"creating+peering","last_fresh":"2024-04-25T10:08:31.982907+0000","last_change":"2024-04-25T10:08:31.982907+0000","last_active":"2024-04-25T10:08:31.970012+0000","last_peered":"2024-04-25T10:08:31.970012+0000","last_clean":"2024-04-25T10:08:31.970012+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:08:31.982907+0000","last_undegraded":"2024-04-25T10:08:31.982907+0000","last_fullsized":"2024-04-25T10:08:31.982907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":276,"reported_epoch":79,"state":"active+clean","last_fresh":"2024-04-25T10:08:33.000546+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:08:33.000546+0000","last_peered":"2024-04-25T10:08:33.000546+0000","last_clean":"2024-04-25T10:08:33.000546+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:08:33.000546+0000","last_undegraded":"2024-04-25T10:08:33.000546+0000","last_fullsized":"2024-04-25T10:08:33.000546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509502,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1552384,"data_stored":1027099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343892,"statfs":{"total":96636764160,"available":96608145408,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509500,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":436731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542206,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":946176,"data_stored":430064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":451332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":450702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1040958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.999572+0000', 'last_change': '2024-04-25T10:08:32.999572+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.999572+0000', 'last_undegraded': '2024-04-25T10:08:32.999572+0000', 'last_fullsized': '2024-04-25T10:08:32.999572+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.997864+0000', 'last_change': '2024-04-25T10:08:32.997864+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.997864+0000', 'last_undegraded': '2024-04-25T10:08:32.997864+0000', 'last_fullsized': '2024-04-25T10:08:32.997864+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2024-04-25T10:08:38.918 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.990198+0000', 'last_change': '2024-04-25T10:08:32.990198+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.990198+0000', 'last_undegraded': '2024-04-25T10:08:32.990198+0000', 'last_fullsized': '2024-04-25T10:08:32.990198+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.990781+0000', 'last_change': '2024-04-25T10:08:32.990781+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.990781+0000', 'last_undegraded': '2024-04-25T10:08:32.990781+0000', 'last_fullsized': '2024-04-25T10:08:32.990781+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.998080+0000', 'last_change': '2024-04-25T10:08:32.998080+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.998080+0000', 'last_undegraded': '2024-04-25T10:08:32.998080+0000', 'last_fullsized': '2024-04-25T10:08:32.998080+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.997374+0000', 'last_change': '2024-04-25T10:08:32.997374+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.997374+0000', 'last_undegraded': '2024-04-25T10:08:32.997374+0000', 'last_fullsized': '2024-04-25T10:08:32.997374+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.996176+0000', 'last_change': '2024-04-25T10:08:32.996176+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.996176+0000', 'last_undegraded': '2024-04-25T10:08:32.996176+0000', 'last_fullsized': '2024-04-25T10:08:32.996176+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.919 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.992122+0000', 'last_change': '2024-04-25T10:08:32.992122+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.992122+0000', 'last_undegraded': '2024-04-25T10:08:32.992122+0000', 'last_fullsized': '2024-04-25T10:08:32.992122+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.988735+0000', 'last_change': '2024-04-25T10:08:32.988735+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.988735+0000', 'last_undegraded': '2024-04-25T10:08:32.988735+0000', 'last_fullsized': '2024-04-25T10:08:32.988735+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.996041+0000', 'last_change': '2024-04-25T10:08:32.996041+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.996041+0000', 'last_undegraded': '2024-04-25T10:08:32.996041+0000', 'last_fullsized': '2024-04-25T10:08:32.996041+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.999201+0000', 'last_change': '2024-04-25T10:08:32.999201+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.999201+0000', 'last_undegraded': '2024-04-25T10:08:32.999201+0000', 'last_fullsized': '2024-04-25T10:08:32.999201+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2024-04-25T10:08:38.920 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.996331+0000', 'last_change': '2024-04-25T10:08:32.996331+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.996331+0000', 'last_undegraded': '2024-04-25T10:08:32.996331+0000', 'last_fullsized': '2024-04-25T10:08:32.996331+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.995643+0000', 'last_change': '2024-04-25T10:08:32.995643+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.995643+0000', 'last_undegraded': '2024-04-25T10:08:32.995643+0000', 'last_fullsized': '2024-04-25T10:08:32.995643+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.990913+0000', 'last_change': '2024-04-25T10:08:32.990913+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.990913+0000', 'last_undegraded': '2024-04-25T10:08:32.990913+0000', 'last_fullsized': '2024-04-25T10:08:32.990913+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.991690+0000', 'last_change': '2024-04-25T10:08:32.991690+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.991690+0000', 'last_undegraded': '2024-04-25T10:08:32.991690+0000', 'last_fullsized': '2024-04-25T10:08:32.991690+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.993102+0000', 'last_change': '2024-04-25T10:08:32.993102+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.993102+0000', 'last_undegraded': '2024-04-25T10:08:32.993102+0000', 'last_fullsized': '2024-04-25T10:08:32.993102+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.992811+0000', 'last_change': '2024-04-25T10:08:32.992811+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.992811+0000', 'last_undegraded': '2024-04-25T10:08:32.992811+0000', 'last_fullsized': '2024-04-25T10:08:32.992811+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2024-04-25T10:08:38.921 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.995420+0000', 'last_change': '2024-04-25T10:08:32.995420+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.995420+0000', 'last_undegraded': '2024-04-25T10:08:32.995420+0000', 'last_fullsized': '2024-04-25T10:08:32.995420+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.996477+0000', 'last_change': '2024-04-25T10:08:32.996477+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.996477+0000', 'last_undegraded': '2024-04-25T10:08:32.996477+0000', 'last_fullsized': '2024-04-25T10:08:32.996477+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.992129+0000', 'last_change': '2024-04-25T10:08:32.992129+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.992129+0000', 'last_undegraded': '2024-04-25T10:08:32.992129+0000', 'last_fullsized': '2024-04-25T10:08:32.992129+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.989438+0000', 'last_change': '2024-04-25T10:08:32.989438+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.989438+0000', 'last_undegraded': '2024-04-25T10:08:32.989438+0000', 'last_fullsized': '2024-04-25T10:08:32.989438+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.992342+0000', 'last_change': '2024-04-25T10:08:32.992342+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.992342+0000', 'last_undegraded': '2024-04-25T10:08:32.992342+0000', 'last_fullsized': '2024-04-25T10:08:32.992342+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.922 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-25T10:08:32.976611+0000', 'last_change': '2024-04-25T10:08:32.976611+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.976611+0000', 'last_undegraded': '2024-04-25T10:08:32.976611+0000', 'last_fullsized': '2024-04-25T10:08:32.976611+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:31.982991+0000', 'last_change': '2024-04-25T10:08:31.982991+0000', 'last_active': '2024-04-25T10:08:31.970012+0000', 'last_peered': '2024-04-25T10:08:31.970012+0000', 'last_clean': '2024-04-25T10:08:31.970012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:31.982991+0000', 'last_undegraded': '2024-04-25T10:08:31.982991+0000', 'last_fullsized': '2024-04-25T10:08:31.982991+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:31.983178+0000', 'last_change': '2024-04-25T10:08:31.983178+0000', 'last_active': '2024-04-25T10:08:31.970012+0000', 'last_peered': '2024-04-25T10:08:31.970012+0000', 'last_clean': '2024-04-25T10:08:31.970012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:31.983178+0000', 'last_undegraded': '2024-04-25T10:08:31.983178+0000', 'last_fullsized': '2024-04-25T10:08:31.983178+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.991601+0000', 'last_change': '2024-04-25T10:08:32.991601+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.991601+0000', 'last_undegraded': '2024-04-25T10:08:32.991601+0000', 'last_fullsized': '2024-04-25T10:08:32.991601+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2024-04-25T10:08:38.923 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:31.982905+0000', 'last_change': '2024-04-25T10:08:31.982905+0000', 'last_active': '2024-04-25T10:08:31.970012+0000', 'last_peered': '2024-04-25T10:08:31.970012+0000', 'last_clean': '2024-04-25T10:08:31.970012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:31.982905+0000', 'last_undegraded': '2024-04-25T10:08:31.982905+0000', 'last_fullsized': '2024-04-25T10:08:31.982905+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.989959+0000', 'last_change': '2024-04-25T10:08:32.989959+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.989959+0000', 'last_undegraded': '2024-04-25T10:08:32.989959+0000', 'last_fullsized': '2024-04-25T10:08:32.989959+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.989722+0000', 'last_change': '2024-04-25T10:08:32.989722+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.989722+0000', 'last_undegraded': '2024-04-25T10:08:32.989722+0000', 'last_fullsized': '2024-04-25T10:08:32.989722+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.990386+0000', 'last_change': '2024-04-25T10:08:32.990386+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.990386+0000', 'last_undegraded': '2024-04-25T10:08:32.990386+0000', 'last_fullsized': '2024-04-25T10:08:32.990386+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.990029+0000', 'last_change': '2024-04-25T10:08:32.990029+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.990029+0000', 'last_undegraded': '2024-04-25T10:08:32.990029+0000', 'last_fullsized': '2024-04-25T10:08:32.990029+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2024-04-25T10:08:38.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.991537+0000', 'last_change': '2024-04-25T10:08:32.991537+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.991537+0000', 'last_undegraded': '2024-04-25T10:08:32.991537+0000', 'last_fullsized': '2024-04-25T10:08:32.991537+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T10:08:38.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2024-04-25T10:08:38.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:32.998495+0000', 'last_change': '2024-04-25T10:08:32.998495+0000', 'last_active': '2024-04-25T10:08:32.976611+0000', 'last_peered': '2024-04-25T10:08:32.976611+0000', 'last_clean': '2024-04-25T10:08:32.976611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:32.998495+0000', 'last_undegraded': '2024-04-25T10:08:32.998495+0000', 'last_fullsized': '2024-04-25T10:08:32.998495+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:32.976611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T10:08:38.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2024-04-25T10:08:38.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 78, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:08:31.982907+0000', 'last_change': '2024-04-25T10:08:31.982907+0000', 'last_active': '2024-04-25T10:08:31.970012+0000', 'last_peered': '2024-04-25T10:08:31.970012+0000', 'last_clean': '2024-04-25T10:08:31.970012+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:08:31.982907+0000', 'last_undegraded': '2024-04-25T10:08:31.982907+0000', 'last_fullsized': '2024-04-25T10:08:31.982907+0000', 'mapping_epoch': 78, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 78, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'last_clean_scrub_stamp': '2024-04-25T10:08:31.970012+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:08:38.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:08:38.979 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-04-25T10:08:38.970+0000 7f9bfde00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:08:39.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.086+0000 7f2433e00640 1 Processor -- start 2024-04-25T10:08:39.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.086+0000 7f2433e00640 1 -- start start 2024-04-25T10:08:39.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2433e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f242c161510 0x7f242c143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2433e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c06d090 con 0x7f242c070fe0 2024-04-25T10:08:39.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2433e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c071ad0 con 0x7f242c1435c0 2024-04-25T10:08:39.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2433e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c162390 con 0x7f242c161510 2024-04-25T10:08:39.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f242c070fe0 0x7f242c0713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51706/0 (socket says 172.21.15.18:51706) 2024-04-25T10:08:39.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 -- 172.21.15.18:0/1483936224 learned_addr learned my addr 172.21.15.18:0/1483936224 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2430a00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f242c161510 0x7f242c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983653839 0 0) 0x7f2420001120 con 0x7f242c070fe0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2414003530 con 0x7f242c070fe0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721541116 0 0) 0x7f242c071ad0 con 0x7f242c1435c0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2420001120 con 0x7f242c1435c0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 941815218 0 0) 0x7f2414003530 con 0x7f242c070fe0 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f242c161510 msgr2=0x7f242c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f242c161510 0x7f242c143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 >> v1:172.21.15.167:6789/0 conn(0x7f242c1435c0 legacy=0x7f242c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c161af0 con 0x7f242c070fe0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f2420001850 con 0x7f242c070fe0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 >> v1:172.21.15.18:6789/0 conn(0x7f242c070fe0 legacy=0x7f242c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2414003b80 0x7f2414003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2414004810 0x7f2414004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24140051d0 0x7f241400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c162390 con 0x7f2414003b80 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241400bfc0 con 0x7f2414004810 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241400c1c0 con 0x7f24140051d0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2430a00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f242c161510 0x7f242c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2414003b80 0x7f2414003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431e00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24140051d0 0x7f241400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2430a00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2414004810 0x7f2414004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 -- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24140051d0 msgr2=0x7f241400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:39.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24140051d0 0x7f241400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 -- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2414004810 msgr2=0x7f2414004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2414004810 0x7f2414004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.090+0000 7f2431400640 1 -- 172.21.15.18:0/1483936224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2414003530 con 0x7f2414003b80 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2431400640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2414003b80 0x7f2414003f80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f242000c4c0 tx=0x7f242001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e94ae8a4c4caabd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000c0e0 con 0x7f2414003b80 2024-04-25T10:08:39.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200a9020 con 0x7f2414003b80 2024-04-25T10:08:39.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f242be00640 1 -- 172.21.15.18:0/1483936224 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420005ae0 con 0x7f2414003b80 2024-04-25T10:08:39.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 -- 172.21.15.18:0/1483936224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2414003b80 msgr2=0x7f2414003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 --2- 172.21.15.18:0/1483936224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2414003b80 0x7f2414003f80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f242000c4c0 tx=0x7f242001cbd0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2431e00640 1 -- 172.21.15.18:0/1483936224 reap_dead start 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 -- 172.21.15.18:0/1483936224 shutdown_connections 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 -- 172.21.15.18:0/1483936224 >> 172.21.15.18:0/1483936224 conn(0x7f242c0b3390 msgr2=0x7f242c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 -- 172.21.15.18:0/1483936224 shutdown_connections 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.094+0000 7f2433e00640 1 -- 172.21.15.18:0/1483936224 wait complete. 2024-04-25T10:08:39.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 Processor -- start 2024-04-25T10:08:39.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- start start 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2414003b80 0x7f242c143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c0b1ee0 0x7f242c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15ede0 con 0x7f242c13f720 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c15ec60 con 0x7f242c0b1ee0 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0b0540 con 0x7f2414003b80 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42786/0 (socket says 172.21.15.18:42786) 2024-04-25T10:08:39.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 -- 172.21.15.18:0/2354388932 learned_addr learned my addr 172.21.15.18:0/2354388932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:39.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 -- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2414003b80 msgr2=0x7f242c143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2414003b80 0x7f242c143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 -- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c0b1ee0 msgr2=0x7f242c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c0b1ee0 0x7f242c0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 -- 172.21.15.18:0/2354388932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0b4600 con 0x7f242c13f720 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2430a00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2418011c00 tx=0x7f241800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241800fc40 con 0x7f242c13f720 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241800fde0 con 0x7f242c13f720 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2418014660 con 0x7f242c13f720 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c1444a0 con 0x7f242c13f720 2024-04-25T10:08:39.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c0b4ba0 con 0x7f242c13f720 2024-04-25T10:08:39.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.098+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c0b2300 con 0x7f242c13f720 2024-04-25T10:08:39.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.102+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2418012040 con 0x7f242c13f720 2024-04-25T10:08:39.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.102+0000 7f2429600640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 0x7f240c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.102+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2418085a00 con 0x7f242c13f720 2024-04-25T10:08:39.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.102+0000 7f2431400640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 0x7f240c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.102+0000 7f2431400640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 0x7f240c069450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f24200aa000 tx=0x7f242c161cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.106+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2418019030 con 0x7f242c13f720 2024-04-25T10:08:39.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f242c0745d0 con 0x7f242c13f720 2024-04-25T10:08:39.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2429600640 1 -- 172.21.15.18:0/2354388932 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7f2418056750 con 0x7f242c13f720 2024-04-25T10:08:39.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:39.331 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":308,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":81,"num_osds":8,"num_up_osds":8,"osd_up_since":1714039422,"num_in_osds":8,"osd_in_since":1714039413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":58},{"state_name":"creating+peering","count":33},{"state_name":"unknown","count":6}],"num_pgs":97,"num_pools":3,"num_objects":12,"data_bytes":591110,"bytes_used":255860736,"bytes_avail":772838252544,"bytes_total":773094113280,"unknown_pgs_ratio":0.061855670064687729,"inactive_pgs_ratio":0.34020617604255676,"write_bytes_sec":559,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":46,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":35843}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-04-25T10:08:21.462637+0000","services":{}},"progress_events":{}} 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 msgr2=0x7f240c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 0x7f240c069450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f24200aa000 tx=0x7f242c161cc0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 msgr2=0x7f242c0b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f2418011c00 tx=0x7f241800f610 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 shutdown_connections 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f242c0b1ee0 0x7f242c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f242c13f720 0x7f242c0b19a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f240c066f90 0x7f240c069450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 --2- 172.21.15.18:0/2354388932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2414003b80 0x7f242c143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 >> 172.21.15.18:0/2354388932 conn(0x7f242c0b3390 msgr2=0x7f242c142860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 shutdown_connections 2024-04-25T10:08:39.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.322+0000 7f2433e00640 1 -- 172.21.15.18:0/2354388932 wait complete. 2024-04-25T10:08:39.352 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:08:39.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:08:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.526+0000 7ffb41c00640 1 Processor -- start 2024-04-25T10:08:39.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.526+0000 7ffb41c00640 1 -- start start 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb41c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb3c145270 0x7ffb3c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb41c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 0x7ffb3c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb41c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb3c0cc4e0 con 0x7ffb3c0b1750 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb41c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c145650 con 0x7ffb3c145270 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb41c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb3c0ce040 con 0x7ffb3c0cd4d0 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffb3c0b1750 0x7ffb3c0b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51712/0 (socket says 172.21.15.18:51712) 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3b400640 1 -- 172.21.15.18:0/1233372140 learned_addr learned my addr 172.21.15.18:0/1233372140 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/1233372140 >> v2:172.21.15.18:3300/0 conn(0x7ffb3c145270 0x7ffb3c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb33e00640 1 --2- 172.21.15.18:0/1233372140 >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 0x7ffb3c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3a000640 1 -- 172.21.15.18:0/1233372140 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 118898458 0 0) 0x7ffb3c0cc4e0 con 0x7ffb3c0b1750 2024-04-25T10:08:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3a000640 1 -- 172.21.15.18:0/1233372140 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb20003530 con 0x7ffb3c0b1750 2024-04-25T10:08:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3aa00640 1 -- 172.21.15.18:0/1233372140 >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 msgr2=0x7ffb3c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/1233372140 >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 0x7ffb3c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3aa00640 1 -- 172.21.15.18:0/1233372140 >> v1:172.21.15.18:6789/0 conn(0x7ffb3c0b1750 legacy=0x7ffb3c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb3aa00640 1 -- 172.21.15.18:0/1233372140 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c0ce320 con 0x7ffb3c145270 2024-04-25T10:08:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.530+0000 7ffb33e00640 1 --2- 172.21.15.18:0/1233372140 >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 0x7ffb3c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/1233372140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c145270 0x7ffb3c15fe50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0b24b0 tx=0x7ffb2c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3bd91e5d6ad2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb3a000640 1 -- 172.21.15.18:0/1233372140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0b0070 con 0x7ffb3c145270 2024-04-25T10:08:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb3a000640 1 -- 172.21.15.18:0/1233372140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0ab600 con 0x7ffb3c145270 2024-04-25T10:08:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb3a000640 1 -- 172.21.15.18:0/1233372140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0ab9d0 con 0x7ffb3c145270 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- 172.21.15.18:0/1233372140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c145270 msgr2=0x7ffb3c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 --2- 172.21.15.18:0/1233372140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c145270 0x7ffb3c15fe50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0b24b0 tx=0x7ffb2c01c480 comp rx=0 tx=0).stop 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- 172.21.15.18:0/1233372140 shutdown_connections 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 --2- 172.21.15.18:0/1233372140 >> v2:172.21.15.167:3300/0 conn(0x7ffb3c0cd4d0 0x7ffb3c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 --2- 172.21.15.18:0/1233372140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c145270 0x7ffb3c15fe50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- 172.21.15.18:0/1233372140 >> 172.21.15.18:0/1233372140 conn(0x7ffb3c066fa0 msgr2=0x7ffb3c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- 172.21.15.18:0/1233372140 shutdown_connections 2024-04-25T10:08:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- 172.21.15.18:0/1233372140 wait complete. 2024-04-25T10:08:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 Processor -- start 2024-04-25T10:08:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.534+0000 7ffb41c00640 1 -- start start 2024-04-25T10:08:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c0cd4d0 0x7ffb3c135460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c145270 0x7ffb3c1359a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c15c710 con 0x7ffb3c0b1750 2024-04-25T10:08:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c15c590 con 0x7ffb3c145270 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb3c15c890 con 0x7ffb3c0cd4d0 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42802/0 (socket says 172.21.15.18:42802) 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 -- 172.21.15.18:0/2428016965 learned_addr learned my addr 172.21.15.18:0/2428016965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 -- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c0cd4d0 msgr2=0x7ffb3c135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c0cd4d0 0x7ffb3c135460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 -- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c145270 msgr2=0x7ffb3c1359a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c145270 0x7ffb3c1359a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 -- 172.21.15.18:0/2428016965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c135ee0 con 0x7ffb3c0b1750 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb3aa00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0ae040 tx=0x7ffb2c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0b0040 con 0x7ffb3c0b1750 2024-04-25T10:08:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2c0b9070 con 0x7ffb3c0b1750 2024-04-25T10:08:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3c135180 con 0x7ffb3c0b1750 2024-04-25T10:08:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c006e20 con 0x7ffb3c0b1750 2024-04-25T10:08:39.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb3c13cbe0 con 0x7ffb3c0b1750 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3c0745d0 con 0x7ffb3c0b1750 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.538+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffb2c0b4690 con 0x7ffb3c0b1750 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.542+0000 7ffb32a00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 0x7ffb18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.542+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffb2c11ef10 con 0x7ffb3c0b1750 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.542+0000 7ffb33e00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 0x7ffb18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:39.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.542+0000 7ffb33e00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 0x7ffb18069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb24006f10 tx=0x7ffb24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:39.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.546+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb2c016070 con 0x7ffb3c0b1750 2024-04-25T10:08:39.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.702+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffb3c06b8e0 con 0x7ffb18066f60 2024-04-25T10:08:39.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.710+0000 7ffb32a00640 1 -- 172.21.15.18:0/2428016965 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7ffb3c06b8e0 con 0x7ffb18066f60 2024-04-25T10:08:39.721 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:39.722 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:08:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 msgr2=0x7ffb18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 0x7ffb18069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ffb24006f10 tx=0x7ffb24008040 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 msgr2=0x7ffb3c13d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0ae040 tx=0x7ffb2c019220 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 shutdown_connections 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb3c145270 0x7ffb3c1359a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb18066f60 0x7ffb18069420 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb3c0cd4d0 0x7ffb3c135460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 --2- 172.21.15.18:0/2428016965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb3c0b1750 0x7ffb3c13d3e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 >> 172.21.15.18:0/2428016965 conn(0x7ffb3c066fa0 msgr2=0x7ffb3c0738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 shutdown_connections 2024-04-25T10:08:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:39.714+0000 7ffb41c00640 1 -- 172.21.15.18:0/2428016965 wait complete. 2024-04-25T10:08:39.741 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2024-04-25T10:08:39.467008+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250068,"kb_used_data":8904,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724652,"statfs":{"total":773094113280,"available":772838043648,"internally_reserved":0,"allocated":9117696,"data_stored":4790276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.484171"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418114+0000","last_change":"2024-04-25T10:08:34.017363+0000","last_active":"2024-04-25T10:08:35.418114+0000","last_peered":"2024-04-25T10:08:35.418114+0000","last_clean":"2024-04-25T10:08:35.418114+0000","last_became_active":"2024-04-25T10:08:34.017088+0000","last_became_peered":"2024-04-25T10:08:34.017088+0000","last_unstale":"2024-04-25T10:08:35.418114+0000","last_undegraded":"2024-04-25T10:08:35.418114+0000","last_fullsized":"2024-04-25T10:08:35.418114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:15.681645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029526+0000","last_change":"2024-04-25T10:08:34.021493+0000","last_active":"2024-04-25T10:08:35.029526+0000","last_peered":"2024-04-25T10:08:35.029526+0000","last_clean":"2024-04-25T10:08:35.029526+0000","last_became_active":"2024-04-25T10:08:34.021186+0000","last_became_peered":"2024-04-25T10:08:34.021186+0000","last_unstale":"2024-04-25T10:08:35.029526+0000","last_undegraded":"2024-04-25T10:08:35.029526+0000","last_fullsized":"2024-04-25T10:08:35.029526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:42.229181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998998+0000","last_change":"2024-04-25T10:08:34.025282+0000","last_active":"2024-04-25T10:08:34.998998+0000","last_peered":"2024-04-25T10:08:34.998998+0000","last_clean":"2024-04-25T10:08:34.998998+0000","last_became_active":"2024-04-25T10:08:34.025024+0000","last_became_peered":"2024-04-25T10:08:34.025024+0000","last_unstale":"2024-04-25T10:08:34.998998+0000","last_undegraded":"2024-04-25T10:08:34.998998+0000","last_fullsized":"2024-04-25T10:08:34.998998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418001+0000","last_change":"2024-04-25T10:08:34.028893+0000","last_active":"2024-04-25T10:08:35.418001+0000","last_peered":"2024-04-25T10:08:35.418001+0000","last_clean":"2024-04-25T10:08:35.418001+0000","last_became_active":"2024-04-25T10:08:34.028352+0000","last_became_peered":"2024-04-25T10:08:34.028352+0000","last_unstale":"2024-04-25T10:08:35.418001+0000","last_undegraded":"2024-04-25T10:08:35.418001+0000","last_fullsized":"2024-04-25T10:08:35.418001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:51.230025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031585+0000","last_change":"2024-04-25T10:08:34.017231+0000","last_active":"2024-04-25T10:08:35.031585+0000","last_peered":"2024-04-25T10:08:35.031585+0000","last_clean":"2024-04-25T10:08:35.031585+0000","last_became_active":"2024-04-25T10:08:34.016095+0000","last_became_peered":"2024-04-25T10:08:34.016095+0000","last_unstale":"2024-04-25T10:08:35.031585+0000","last_undegraded":"2024-04-25T10:08:35.031585+0000","last_fullsized":"2024-04-25T10:08:35.031585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.605425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180961+0000","last_change":"2024-04-25T10:08:34.014621+0000","last_active":"2024-04-25T10:08:35.180961+0000","last_peered":"2024-04-25T10:08:35.180961+0000","last_clean":"2024-04-25T10:08:35.180961+0000","last_became_active":"2024-04-25T10:08:34.014085+0000","last_became_peered":"2024-04-25T10:08:34.014085+0000","last_unstale":"2024-04-25T10:08:35.180961+0000","last_undegraded":"2024-04-25T10:08:35.180961+0000","last_fullsized":"2024-04-25T10:08:35.180961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:04.190820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002915+0000","last_change":"2024-04-25T10:08:34.016772+0000","last_active":"2024-04-25T10:08:35.002915+0000","last_peered":"2024-04-25T10:08:35.002915+0000","last_clean":"2024-04-25T10:08:35.002915+0000","last_became_active":"2024-04-25T10:08:34.015366+0000","last_became_peered":"2024-04-25T10:08:34.015366+0000","last_unstale":"2024-04-25T10:08:35.002915+0000","last_undegraded":"2024-04-25T10:08:35.002915+0000","last_fullsized":"2024-04-25T10:08:35.002915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031661+0000","last_change":"2024-04-25T10:08:34.017931+0000","last_active":"2024-04-25T10:08:35.031661+0000","last_peered":"2024-04-25T10:08:35.031661+0000","last_clean":"2024-04-25T10:08:35.031661+0000","last_became_active":"2024-04-25T10:08:34.017586+0000","last_became_peered":"2024-04-25T10:08:34.017586+0000","last_unstale":"2024-04-25T10:08:35.031661+0000","last_undegraded":"2024-04-25T10:08:35.031661+0000","last_fullsized":"2024-04-25T10:08:35.031661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:49.996965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003501+0000","last_change":"2024-04-25T10:08:34.017106+0000","last_active":"2024-04-25T10:08:35.003501+0000","last_peered":"2024-04-25T10:08:35.003501+0000","last_clean":"2024-04-25T10:08:35.003501+0000","last_became_active":"2024-04-25T10:08:34.016836+0000","last_became_peered":"2024-04-25T10:08:34.016836+0000","last_unstale":"2024-04-25T10:08:35.003501+0000","last_undegraded":"2024-04-25T10:08:35.003501+0000","last_fullsized":"2024-04-25T10:08:35.003501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:12.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417714+0000","last_change":"2024-04-25T10:08:34.025645+0000","last_active":"2024-04-25T10:08:35.417714+0000","last_peered":"2024-04-25T10:08:35.417714+0000","last_clean":"2024-04-25T10:08:35.417714+0000","last_became_active":"2024-04-25T10:08:34.025056+0000","last_became_peered":"2024-04-25T10:08:34.025056+0000","last_unstale":"2024-04-25T10:08:35.417714+0000","last_undegraded":"2024-04-25T10:08:35.417714+0000","last_fullsized":"2024-04-25T10:08:35.417714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:51.196016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029377+0000","last_change":"2024-04-25T10:08:34.026807+0000","last_active":"2024-04-25T10:08:35.029377+0000","last_peered":"2024-04-25T10:08:35.029377+0000","last_clean":"2024-04-25T10:08:35.029377+0000","last_became_active":"2024-04-25T10:08:34.025681+0000","last_became_peered":"2024-04-25T10:08:34.025681+0000","last_unstale":"2024-04-25T10:08:35.029377+0000","last_undegraded":"2024-04-25T10:08:35.029377+0000","last_fullsized":"2024-04-25T10:08:35.029377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.077735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418172+0000","last_change":"2024-04-25T10:08:34.035915+0000","last_active":"2024-04-25T10:08:35.418172+0000","last_peered":"2024-04-25T10:08:35.418172+0000","last_clean":"2024-04-25T10:08:35.418172+0000","last_became_active":"2024-04-25T10:08:34.035583+0000","last_became_peered":"2024-04-25T10:08:34.035583+0000","last_unstale":"2024-04-25T10:08:35.418172+0000","last_undegraded":"2024-04-25T10:08:35.418172+0000","last_fullsized":"2024-04-25T10:08:35.418172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:50.401689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031744+0000","last_change":"2024-04-25T10:08:34.015665+0000","last_active":"2024-04-25T10:08:35.031744+0000","last_peered":"2024-04-25T10:08:35.031744+0000","last_clean":"2024-04-25T10:08:35.031744+0000","last_became_active":"2024-04-25T10:08:34.015246+0000","last_became_peered":"2024-04-25T10:08:34.015246+0000","last_unstale":"2024-04-25T10:08:35.031744+0000","last_undegraded":"2024-04-25T10:08:35.031744+0000","last_fullsized":"2024-04-25T10:08:35.031744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181056+0000","last_change":"2024-04-25T10:08:34.014402+0000","last_active":"2024-04-25T10:08:35.181056+0000","last_peered":"2024-04-25T10:08:35.181056+0000","last_clean":"2024-04-25T10:08:35.181056+0000","last_became_active":"2024-04-25T10:08:34.012356+0000","last_became_peered":"2024-04-25T10:08:34.012356+0000","last_unstale":"2024-04-25T10:08:35.181056+0000","last_undegraded":"2024-04-25T10:08:35.181056+0000","last_fullsized":"2024-04-25T10:08:35.181056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:58.513846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028905+0000","last_change":"2024-04-25T10:08:34.014342+0000","last_active":"2024-04-25T10:08:35.028905+0000","last_peered":"2024-04-25T10:08:35.028905+0000","last_clean":"2024-04-25T10:08:35.028905+0000","last_became_active":"2024-04-25T10:08:34.014011+0000","last_became_peered":"2024-04-25T10:08:34.014011+0000","last_unstale":"2024-04-25T10:08:35.028905+0000","last_undegraded":"2024-04-25T10:08:35.028905+0000","last_fullsized":"2024-04-25T10:08:35.028905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:40.898281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417995+0000","last_change":"2024-04-25T10:08:34.024552+0000","last_active":"2024-04-25T10:08:35.417995+0000","last_peered":"2024-04-25T10:08:35.417995+0000","last_clean":"2024-04-25T10:08:35.417995+0000","last_became_active":"2024-04-25T10:08:34.024245+0000","last_became_peered":"2024-04-25T10:08:34.024245+0000","last_unstale":"2024-04-25T10:08:35.417995+0000","last_undegraded":"2024-04-25T10:08:35.417995+0000","last_fullsized":"2024-04-25T10:08:35.417995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:31.110028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031908+0000","last_change":"2024-04-25T10:08:34.011449+0000","last_active":"2024-04-25T10:08:35.031908+0000","last_peered":"2024-04-25T10:08:35.031908+0000","last_clean":"2024-04-25T10:08:35.031908+0000","last_became_active":"2024-04-25T10:08:34.011147+0000","last_became_peered":"2024-04-25T10:08:34.011147+0000","last_unstale":"2024-04-25T10:08:35.031908+0000","last_undegraded":"2024-04-25T10:08:35.031908+0000","last_fullsized":"2024-04-25T10:08:35.031908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.893587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999000+0000","last_change":"2024-04-25T10:08:34.010473+0000","last_active":"2024-04-25T10:08:34.999000+0000","last_peered":"2024-04-25T10:08:34.999000+0000","last_clean":"2024-04-25T10:08:34.999000+0000","last_became_active":"2024-04-25T10:08:34.010053+0000","last_became_peered":"2024-04-25T10:08:34.010053+0000","last_unstale":"2024-04-25T10:08:34.999000+0000","last_undegraded":"2024-04-25T10:08:34.999000+0000","last_fullsized":"2024-04-25T10:08:34.999000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181299+0000","last_change":"2024-04-25T10:08:34.017362+0000","last_active":"2024-04-25T10:08:35.181299+0000","last_peered":"2024-04-25T10:08:35.181299+0000","last_clean":"2024-04-25T10:08:35.181299+0000","last_became_active":"2024-04-25T10:08:34.017053+0000","last_became_peered":"2024-04-25T10:08:34.017053+0000","last_unstale":"2024-04-25T10:08:35.181299+0000","last_undegraded":"2024-04-25T10:08:35.181299+0000","last_fullsized":"2024-04-25T10:08:35.181299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:48.842056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031767+0000","last_change":"2024-04-25T10:08:34.007070+0000","last_active":"2024-04-25T10:08:35.031767+0000","last_peered":"2024-04-25T10:08:35.031767+0000","last_clean":"2024-04-25T10:08:35.031767+0000","last_became_active":"2024-04-25T10:08:34.006804+0000","last_became_peered":"2024-04-25T10:08:34.006804+0000","last_unstale":"2024-04-25T10:08:35.031767+0000","last_undegraded":"2024-04-25T10:08:35.031767+0000","last_fullsized":"2024-04-25T10:08:35.031767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:41.897342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003601+0000","last_change":"2024-04-25T10:08:34.012610+0000","last_active":"2024-04-25T10:08:35.003601+0000","last_peered":"2024-04-25T10:08:35.003601+0000","last_clean":"2024-04-25T10:08:35.003601+0000","last_became_active":"2024-04-25T10:08:34.011294+0000","last_became_peered":"2024-04-25T10:08:34.011294+0000","last_unstale":"2024-04-25T10:08:35.003601+0000","last_undegraded":"2024-04-25T10:08:35.003601+0000","last_fullsized":"2024-04-25T10:08:35.003601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:23.736647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031521+0000","last_change":"2024-04-25T10:08:34.020307+0000","last_active":"2024-04-25T10:08:35.031521+0000","last_peered":"2024-04-25T10:08:35.031521+0000","last_clean":"2024-04-25T10:08:35.031521+0000","last_became_active":"2024-04-25T10:08:34.018096+0000","last_became_peered":"2024-04-25T10:08:34.018096+0000","last_unstale":"2024-04-25T10:08:35.031521+0000","last_undegraded":"2024-04-25T10:08:35.031521+0000","last_fullsized":"2024-04-25T10:08:35.031521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:36.687476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003352+0000","last_change":"2024-04-25T10:08:34.024671+0000","last_active":"2024-04-25T10:08:35.003352+0000","last_peered":"2024-04-25T10:08:35.003352+0000","last_clean":"2024-04-25T10:08:35.003352+0000","last_became_active":"2024-04-25T10:08:34.024387+0000","last_became_peered":"2024-04-25T10:08:34.024387+0000","last_unstale":"2024-04-25T10:08:35.003352+0000","last_undegraded":"2024-04-25T10:08:35.003352+0000","last_fullsized":"2024-04-25T10:08:35.003352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:20.825364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028846+0000","last_change":"2024-04-25T10:08:34.026585+0000","last_active":"2024-04-25T10:08:35.028846+0000","last_peered":"2024-04-25T10:08:35.028846+0000","last_clean":"2024-04-25T10:08:35.028846+0000","last_became_active":"2024-04-25T10:08:34.026274+0000","last_became_peered":"2024-04-25T10:08:34.026274+0000","last_unstale":"2024-04-25T10:08:35.028846+0000","last_undegraded":"2024-04-25T10:08:35.028846+0000","last_fullsized":"2024-04-25T10:08:35.028846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:41.217493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029490+0000","last_change":"2024-04-25T10:08:34.025864+0000","last_active":"2024-04-25T10:08:35.029490+0000","last_peered":"2024-04-25T10:08:35.029490+0000","last_clean":"2024-04-25T10:08:35.029490+0000","last_became_active":"2024-04-25T10:08:34.025510+0000","last_became_peered":"2024-04-25T10:08:34.025510+0000","last_unstale":"2024-04-25T10:08:35.029490+0000","last_undegraded":"2024-04-25T10:08:35.029490+0000","last_fullsized":"2024-04-25T10:08:35.029490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417690+0000","last_change":"2024-04-25T10:08:34.035798+0000","last_active":"2024-04-25T10:08:35.417690+0000","last_peered":"2024-04-25T10:08:35.417690+0000","last_clean":"2024-04-25T10:08:35.417690+0000","last_became_active":"2024-04-25T10:08:34.035501+0000","last_became_peered":"2024-04-25T10:08:34.035501+0000","last_unstale":"2024-04-25T10:08:35.417690+0000","last_undegraded":"2024-04-25T10:08:35.417690+0000","last_fullsized":"2024-04-25T10:08:35.417690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.283949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417929+0000","last_change":"2024-04-25T10:08:34.027320+0000","last_active":"2024-04-25T10:08:35.417929+0000","last_peered":"2024-04-25T10:08:35.417929+0000","last_clean":"2024-04-25T10:08:35.417929+0000","last_became_active":"2024-04-25T10:08:34.027036+0000","last_became_peered":"2024-04-25T10:08:34.027036+0000","last_unstale":"2024-04-25T10:08:35.417929+0000","last_undegraded":"2024-04-25T10:08:35.417929+0000","last_fullsized":"2024-04-25T10:08:35.417929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:09.250533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031801+0000","last_change":"2024-04-25T10:08:34.030709+0000","last_active":"2024-04-25T10:08:35.031801+0000","last_peered":"2024-04-25T10:08:35.031801+0000","last_clean":"2024-04-25T10:08:35.031801+0000","last_became_active":"2024-04-25T10:08:34.030384+0000","last_became_peered":"2024-04-25T10:08:34.030384+0000","last_unstale":"2024-04-25T10:08:35.031801+0000","last_undegraded":"2024-04-25T10:08:35.031801+0000","last_fullsized":"2024-04-25T10:08:35.031801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:10.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029152+0000","last_change":"2024-04-25T10:08:34.020753+0000","last_active":"2024-04-25T10:08:35.029152+0000","last_peered":"2024-04-25T10:08:35.029152+0000","last_clean":"2024-04-25T10:08:35.029152+0000","last_became_active":"2024-04-25T10:08:34.020394+0000","last_became_peered":"2024-04-25T10:08:34.020394+0000","last_unstale":"2024-04-25T10:08:35.029152+0000","last_undegraded":"2024-04-25T10:08:35.029152+0000","last_fullsized":"2024-04-25T10:08:35.029152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:51.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417284+0000","last_change":"2024-04-25T10:08:34.020178+0000","last_active":"2024-04-25T10:08:35.417284+0000","last_peered":"2024-04-25T10:08:35.417284+0000","last_clean":"2024-04-25T10:08:35.417284+0000","last_became_active":"2024-04-25T10:08:34.019886+0000","last_became_peered":"2024-04-25T10:08:34.019886+0000","last_unstale":"2024-04-25T10:08:35.417284+0000","last_undegraded":"2024-04-25T10:08:35.417284+0000","last_fullsized":"2024-04-25T10:08:35.417284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:30.654822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999136+0000","last_change":"2024-04-25T10:08:34.009888+0000","last_active":"2024-04-25T10:08:34.999136+0000","last_peered":"2024-04-25T10:08:34.999136+0000","last_clean":"2024-04-25T10:08:34.999136+0000","last_became_active":"2024-04-25T10:08:34.008686+0000","last_became_peered":"2024-04-25T10:08:34.008686+0000","last_unstale":"2024-04-25T10:08:34.999136+0000","last_undegraded":"2024-04-25T10:08:34.999136+0000","last_fullsized":"2024-04-25T10:08:34.999136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417736+0000","last_change":"2024-04-25T10:08:34.016111+0000","last_active":"2024-04-25T10:08:35.417736+0000","last_peered":"2024-04-25T10:08:35.417736+0000","last_clean":"2024-04-25T10:08:35.417736+0000","last_became_active":"2024-04-25T10:08:34.015699+0000","last_became_peered":"2024-04-25T10:08:34.015699+0000","last_unstale":"2024-04-25T10:08:35.417736+0000","last_undegraded":"2024-04-25T10:08:35.417736+0000","last_fullsized":"2024-04-25T10:08:35.417736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:15.473404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999140+0000","last_change":"2024-04-25T10:08:34.011122+0000","last_active":"2024-04-25T10:08:34.999140+0000","last_peered":"2024-04-25T10:08:34.999140+0000","last_clean":"2024-04-25T10:08:34.999140+0000","last_became_active":"2024-04-25T10:08:34.010868+0000","last_became_peered":"2024-04-25T10:08:34.010868+0000","last_unstale":"2024-04-25T10:08:34.999140+0000","last_undegraded":"2024-04-25T10:08:34.999140+0000","last_fullsized":"2024-04-25T10:08:34.999140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031894+0000","last_change":"2024-04-25T10:08:33.002480+0000","last_active":"2024-04-25T10:08:35.031894+0000","last_peered":"2024-04-25T10:08:35.031894+0000","last_clean":"2024-04-25T10:08:35.031894+0000","last_became_active":"2024-04-25T10:08:33.000086+0000","last_became_peered":"2024-04-25T10:08:33.000086+0000","last_unstale":"2024-04-25T10:08:35.031894+0000","last_undegraded":"2024-04-25T10:08:35.031894+0000","last_fullsized":"2024-04-25T10:08:35.031894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:57.411455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028904+0000","last_change":"2024-04-25T10:08:34.026292+0000","last_active":"2024-04-25T10:08:35.028904+0000","last_peered":"2024-04-25T10:08:35.028904+0000","last_clean":"2024-04-25T10:08:35.028904+0000","last_became_active":"2024-04-25T10:08:34.026020+0000","last_became_peered":"2024-04-25T10:08:34.026020+0000","last_unstale":"2024-04-25T10:08:35.028904+0000","last_undegraded":"2024-04-25T10:08:35.028904+0000","last_fullsized":"2024-04-25T10:08:35.028904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:52.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418041+0000","last_change":"2024-04-25T10:08:33.011515+0000","last_active":"2024-04-25T10:08:35.418041+0000","last_peered":"2024-04-25T10:08:35.418041+0000","last_clean":"2024-04-25T10:08:35.418041+0000","last_became_active":"2024-04-25T10:08:33.010837+0000","last_became_peered":"2024-04-25T10:08:33.010837+0000","last_unstale":"2024-04-25T10:08:35.418041+0000","last_undegraded":"2024-04-25T10:08:35.418041+0000","last_fullsized":"2024-04-25T10:08:35.418041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:16.121478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003718+0000","last_change":"2024-04-25T10:08:34.030490+0000","last_active":"2024-04-25T10:08:35.003718+0000","last_peered":"2024-04-25T10:08:35.003718+0000","last_clean":"2024-04-25T10:08:35.003718+0000","last_became_active":"2024-04-25T10:08:34.030167+0000","last_became_peered":"2024-04-25T10:08:34.030167+0000","last_unstale":"2024-04-25T10:08:35.003718+0000","last_undegraded":"2024-04-25T10:08:35.003718+0000","last_fullsized":"2024-04-25T10:08:35.003718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:41.110876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417655+0000","last_change":"2024-04-25T10:08:33.011678+0000","last_active":"2024-04-25T10:08:35.417655+0000","last_peered":"2024-04-25T10:08:35.417655+0000","last_clean":"2024-04-25T10:08:35.417655+0000","last_became_active":"2024-04-25T10:08:33.011366+0000","last_became_peered":"2024-04-25T10:08:33.011366+0000","last_unstale":"2024-04-25T10:08:35.417655+0000","last_undegraded":"2024-04-25T10:08:35.417655+0000","last_fullsized":"2024-04-25T10:08:35.417655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:24.713433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003698+0000","last_change":"2024-04-25T10:08:34.013022+0000","last_active":"2024-04-25T10:08:35.003698+0000","last_peered":"2024-04-25T10:08:35.003698+0000","last_clean":"2024-04-25T10:08:35.003698+0000","last_became_active":"2024-04-25T10:08:34.012718+0000","last_became_peered":"2024-04-25T10:08:34.012718+0000","last_unstale":"2024-04-25T10:08:35.003698+0000","last_undegraded":"2024-04-25T10:08:35.003698+0000","last_fullsized":"2024-04-25T10:08:35.003698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:37.845698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002852+0000","last_change":"2024-04-25T10:08:33.007013+0000","last_active":"2024-04-25T10:08:35.002852+0000","last_peered":"2024-04-25T10:08:35.002852+0000","last_clean":"2024-04-25T10:08:35.002852+0000","last_became_active":"2024-04-25T10:08:33.006754+0000","last_became_peered":"2024-04-25T10:08:33.006754+0000","last_unstale":"2024-04-25T10:08:35.002852+0000","last_undegraded":"2024-04-25T10:08:35.002852+0000","last_fullsized":"2024-04-25T10:08:35.002852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:30.675420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029185+0000","last_change":"2024-04-25T10:08:34.025084+0000","last_active":"2024-04-25T10:08:35.029185+0000","last_peered":"2024-04-25T10:08:35.029185+0000","last_clean":"2024-04-25T10:08:35.029185+0000","last_became_active":"2024-04-25T10:08:34.024770+0000","last_became_peered":"2024-04-25T10:08:34.024770+0000","last_unstale":"2024-04-25T10:08:35.029185+0000","last_undegraded":"2024-04-25T10:08:35.029185+0000","last_fullsized":"2024-04-25T10:08:35.029185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.334293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003706+0000","last_change":"2024-04-25T10:08:33.007061+0000","last_active":"2024-04-25T10:08:35.003706+0000","last_peered":"2024-04-25T10:08:35.003706+0000","last_clean":"2024-04-25T10:08:35.003706+0000","last_became_active":"2024-04-25T10:08:33.006778+0000","last_became_peered":"2024-04-25T10:08:33.006778+0000","last_unstale":"2024-04-25T10:08:35.003706+0000","last_undegraded":"2024-04-25T10:08:35.003706+0000","last_fullsized":"2024-04-25T10:08:35.003706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:28.087771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029446+0000","last_change":"2024-04-25T10:08:34.031090+0000","last_active":"2024-04-25T10:08:35.029446+0000","last_peered":"2024-04-25T10:08:35.029446+0000","last_clean":"2024-04-25T10:08:35.029446+0000","last_became_active":"2024-04-25T10:08:34.023940+0000","last_became_peered":"2024-04-25T10:08:34.023940+0000","last_unstale":"2024-04-25T10:08:35.029446+0000","last_undegraded":"2024-04-25T10:08:35.029446+0000","last_fullsized":"2024-04-25T10:08:35.029446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:28.981263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417361+0000","last_change":"2024-04-25T10:08:33.005514+0000","last_active":"2024-04-25T10:08:35.417361+0000","last_peered":"2024-04-25T10:08:35.417361+0000","last_clean":"2024-04-25T10:08:35.417361+0000","last_became_active":"2024-04-25T10:08:33.005250+0000","last_became_peered":"2024-04-25T10:08:33.005250+0000","last_unstale":"2024-04-25T10:08:35.417361+0000","last_undegraded":"2024-04-25T10:08:35.417361+0000","last_fullsized":"2024-04-25T10:08:35.417361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003802+0000","last_change":"2024-04-25T10:08:34.033108+0000","last_active":"2024-04-25T10:08:35.003802+0000","last_peered":"2024-04-25T10:08:35.003802+0000","last_clean":"2024-04-25T10:08:35.003802+0000","last_became_active":"2024-04-25T10:08:34.032807+0000","last_became_peered":"2024-04-25T10:08:34.032807+0000","last_unstale":"2024-04-25T10:08:35.003802+0000","last_undegraded":"2024-04-25T10:08:35.003802+0000","last_fullsized":"2024-04-25T10:08:35.003802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:32.657399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028964+0000","last_change":"2024-04-25T10:08:33.006037+0000","last_active":"2024-04-25T10:08:35.028964+0000","last_peered":"2024-04-25T10:08:35.028964+0000","last_clean":"2024-04-25T10:08:35.028964+0000","last_became_active":"2024-04-25T10:08:33.005767+0000","last_became_peered":"2024-04-25T10:08:33.005767+0000","last_unstale":"2024-04-25T10:08:35.028964+0000","last_undegraded":"2024-04-25T10:08:35.028964+0000","last_fullsized":"2024-04-25T10:08:35.028964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:53.277350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003398+0000","last_change":"2024-04-25T10:08:34.016727+0000","last_active":"2024-04-25T10:08:35.003398+0000","last_peered":"2024-04-25T10:08:35.003398+0000","last_clean":"2024-04-25T10:08:35.003398+0000","last_became_active":"2024-04-25T10:08:34.015906+0000","last_became_peered":"2024-04-25T10:08:34.015906+0000","last_unstale":"2024-04-25T10:08:35.003398+0000","last_undegraded":"2024-04-25T10:08:35.003398+0000","last_fullsized":"2024-04-25T10:08:35.003398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:21.441345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031330+0000","last_change":"2024-04-25T10:08:32.995936+0000","last_active":"2024-04-25T10:08:35.031330+0000","last_peered":"2024-04-25T10:08:35.031330+0000","last_clean":"2024-04-25T10:08:35.031330+0000","last_became_active":"2024-04-25T10:08:32.995620+0000","last_became_peered":"2024-04-25T10:08:32.995620+0000","last_unstale":"2024-04-25T10:08:35.031330+0000","last_undegraded":"2024-04-25T10:08:35.031330+0000","last_fullsized":"2024-04-25T10:08:35.031330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.564491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028864+0000","last_change":"2024-04-25T10:08:34.020243+0000","last_active":"2024-04-25T10:08:35.028864+0000","last_peered":"2024-04-25T10:08:35.028864+0000","last_clean":"2024-04-25T10:08:35.028864+0000","last_became_active":"2024-04-25T10:08:34.018667+0000","last_became_peered":"2024-04-25T10:08:34.018667+0000","last_unstale":"2024-04-25T10:08:35.028864+0000","last_undegraded":"2024-04-25T10:08:35.028864+0000","last_fullsized":"2024-04-25T10:08:35.028864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:08.399465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418223+0000","last_change":"2024-04-25T10:08:33.014183+0000","last_active":"2024-04-25T10:08:35.418223+0000","last_peered":"2024-04-25T10:08:35.418223+0000","last_clean":"2024-04-25T10:08:35.418223+0000","last_became_active":"2024-04-25T10:08:33.013867+0000","last_became_peered":"2024-04-25T10:08:33.013867+0000","last_unstale":"2024-04-25T10:08:35.418223+0000","last_undegraded":"2024-04-25T10:08:35.418223+0000","last_fullsized":"2024-04-25T10:08:35.418223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:57.034900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417620+0000","last_change":"2024-04-25T10:08:34.028808+0000","last_active":"2024-04-25T10:08:35.417620+0000","last_peered":"2024-04-25T10:08:35.417620+0000","last_clean":"2024-04-25T10:08:35.417620+0000","last_became_active":"2024-04-25T10:08:34.028400+0000","last_became_peered":"2024-04-25T10:08:34.028400+0000","last_unstale":"2024-04-25T10:08:35.417620+0000","last_undegraded":"2024-04-25T10:08:35.417620+0000","last_fullsized":"2024-04-25T10:08:35.417620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:08.077100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418053+0000","last_change":"2024-04-25T10:08:33.007771+0000","last_active":"2024-04-25T10:08:35.418053+0000","last_peered":"2024-04-25T10:08:35.418053+0000","last_clean":"2024-04-25T10:08:35.418053+0000","last_became_active":"2024-04-25T10:08:33.006885+0000","last_became_peered":"2024-04-25T10:08:33.006885+0000","last_unstale":"2024-04-25T10:08:35.418053+0000","last_undegraded":"2024-04-25T10:08:35.418053+0000","last_fullsized":"2024-04-25T10:08:35.418053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:35.003598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181241+0000","last_change":"2024-04-25T10:08:34.018486+0000","last_active":"2024-04-25T10:08:35.181241+0000","last_peered":"2024-04-25T10:08:35.181241+0000","last_clean":"2024-04-25T10:08:35.181241+0000","last_became_active":"2024-04-25T10:08:34.017970+0000","last_became_peered":"2024-04-25T10:08:34.017970+0000","last_unstale":"2024-04-25T10:08:35.181241+0000","last_undegraded":"2024-04-25T10:08:35.181241+0000","last_fullsized":"2024-04-25T10:08:35.181241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:55.028353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031943+0000","last_change":"2024-04-25T10:08:33.000784+0000","last_active":"2024-04-25T10:08:35.031943+0000","last_peered":"2024-04-25T10:08:35.031943+0000","last_clean":"2024-04-25T10:08:35.031943+0000","last_became_active":"2024-04-25T10:08:33.000487+0000","last_became_peered":"2024-04-25T10:08:33.000487+0000","last_unstale":"2024-04-25T10:08:35.031943+0000","last_undegraded":"2024-04-25T10:08:35.031943+0000","last_fullsized":"2024-04-25T10:08:35.031943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:01.990140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999011+0000","last_change":"2024-04-25T10:08:34.024469+0000","last_active":"2024-04-25T10:08:34.999011+0000","last_peered":"2024-04-25T10:08:34.999011+0000","last_clean":"2024-04-25T10:08:34.999011+0000","last_became_active":"2024-04-25T10:08:34.024156+0000","last_became_peered":"2024-04-25T10:08:34.024156+0000","last_unstale":"2024-04-25T10:08:34.999011+0000","last_undegraded":"2024-04-25T10:08:34.999011+0000","last_fullsized":"2024-04-25T10:08:34.999011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002997+0000","last_change":"2024-04-25T10:08:32.998633+0000","last_active":"2024-04-25T10:08:35.002997+0000","last_peered":"2024-04-25T10:08:35.002997+0000","last_clean":"2024-04-25T10:08:35.002997+0000","last_became_active":"2024-04-25T10:08:32.998332+0000","last_became_peered":"2024-04-25T10:08:32.998332+0000","last_unstale":"2024-04-25T10:08:35.002997+0000","last_undegraded":"2024-04-25T10:08:35.002997+0000","last_fullsized":"2024-04-25T10:08:35.002997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:10.565742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418289+0000","last_change":"2024-04-25T10:08:34.034644+0000","last_active":"2024-04-25T10:08:35.418289+0000","last_peered":"2024-04-25T10:08:35.418289+0000","last_clean":"2024-04-25T10:08:35.418289+0000","last_became_active":"2024-04-25T10:08:34.034203+0000","last_became_peered":"2024-04-25T10:08:34.034203+0000","last_unstale":"2024-04-25T10:08:35.418289+0000","last_undegraded":"2024-04-25T10:08:35.418289+0000","last_fullsized":"2024-04-25T10:08:35.418289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:12.304014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417453+0000","last_change":"2024-04-25T10:08:33.006611+0000","last_active":"2024-04-25T10:08:35.417453+0000","last_peered":"2024-04-25T10:08:35.417453+0000","last_clean":"2024-04-25T10:08:35.417453+0000","last_became_active":"2024-04-25T10:08:33.006152+0000","last_became_peered":"2024-04-25T10:08:33.006152+0000","last_unstale":"2024-04-25T10:08:35.417453+0000","last_undegraded":"2024-04-25T10:08:35.417453+0000","last_fullsized":"2024-04-25T10:08:35.417453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:45.021233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002728+0000","last_change":"2024-04-25T10:08:34.009911+0000","last_active":"2024-04-25T10:08:35.002728+0000","last_peered":"2024-04-25T10:08:35.002728+0000","last_clean":"2024-04-25T10:08:35.002728+0000","last_became_active":"2024-04-25T10:08:34.009524+0000","last_became_peered":"2024-04-25T10:08:34.009524+0000","last_unstale":"2024-04-25T10:08:35.002728+0000","last_undegraded":"2024-04-25T10:08:35.002728+0000","last_fullsized":"2024-04-25T10:08:35.002728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417183+0000","last_change":"2024-04-25T10:08:33.010430+0000","last_active":"2024-04-25T10:08:35.417183+0000","last_peered":"2024-04-25T10:08:35.417183+0000","last_clean":"2024-04-25T10:08:35.417183+0000","last_became_active":"2024-04-25T10:08:33.010028+0000","last_became_peered":"2024-04-25T10:08:33.010028+0000","last_unstale":"2024-04-25T10:08:35.417183+0000","last_undegraded":"2024-04-25T10:08:35.417183+0000","last_fullsized":"2024-04-25T10:08:35.417183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:20.434746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003117+0000","last_change":"2024-04-25T10:08:34.011806+0000","last_active":"2024-04-25T10:08:35.003117+0000","last_peered":"2024-04-25T10:08:35.003117+0000","last_clean":"2024-04-25T10:08:35.003117+0000","last_became_active":"2024-04-25T10:08:34.011521+0000","last_became_peered":"2024-04-25T10:08:34.011521+0000","last_unstale":"2024-04-25T10:08:35.003117+0000","last_undegraded":"2024-04-25T10:08:35.003117+0000","last_fullsized":"2024-04-25T10:08:35.003117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:17.128077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031412+0000","last_change":"2024-04-25T10:08:33.000541+0000","last_active":"2024-04-25T10:08:35.031412+0000","last_peered":"2024-04-25T10:08:35.031412+0000","last_clean":"2024-04-25T10:08:35.031412+0000","last_became_active":"2024-04-25T10:08:33.000156+0000","last_became_peered":"2024-04-25T10:08:33.000156+0000","last_unstale":"2024-04-25T10:08:35.031412+0000","last_undegraded":"2024-04-25T10:08:35.031412+0000","last_fullsized":"2024-04-25T10:08:35.031412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:05.087355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003597+0000","last_change":"2024-04-25T10:08:34.016943+0000","last_active":"2024-04-25T10:08:35.003597+0000","last_peered":"2024-04-25T10:08:35.003597+0000","last_clean":"2024-04-25T10:08:35.003597+0000","last_became_active":"2024-04-25T10:08:34.016354+0000","last_became_peered":"2024-04-25T10:08:34.016354+0000","last_unstale":"2024-04-25T10:08:35.003597+0000","last_undegraded":"2024-04-25T10:08:35.003597+0000","last_fullsized":"2024-04-25T10:08:35.003597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:58.041499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028931+0000","last_change":"2024-04-25T10:08:33.001887+0000","last_active":"2024-04-25T10:08:35.028931+0000","last_peered":"2024-04-25T10:08:35.028931+0000","last_clean":"2024-04-25T10:08:35.028931+0000","last_became_active":"2024-04-25T10:08:33.001619+0000","last_became_peered":"2024-04-25T10:08:33.001619+0000","last_unstale":"2024-04-25T10:08:35.028931+0000","last_undegraded":"2024-04-25T10:08:35.028931+0000","last_fullsized":"2024-04-25T10:08:35.028931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.189417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181121+0000","last_change":"2024-04-25T10:08:34.013029+0000","last_active":"2024-04-25T10:08:35.181121+0000","last_peered":"2024-04-25T10:08:35.181121+0000","last_clean":"2024-04-25T10:08:35.181121+0000","last_became_active":"2024-04-25T10:08:34.012708+0000","last_became_peered":"2024-04-25T10:08:34.012708+0000","last_unstale":"2024-04-25T10:08:35.181121+0000","last_undegraded":"2024-04-25T10:08:35.181121+0000","last_fullsized":"2024-04-25T10:08:35.181121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:42.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418315+0000","last_change":"2024-04-25T10:08:33.011663+0000","last_active":"2024-04-25T10:08:35.418315+0000","last_peered":"2024-04-25T10:08:35.418315+0000","last_clean":"2024-04-25T10:08:35.418315+0000","last_became_active":"2024-04-25T10:08:33.011338+0000","last_became_peered":"2024-04-25T10:08:33.011338+0000","last_unstale":"2024-04-25T10:08:35.418315+0000","last_undegraded":"2024-04-25T10:08:35.418315+0000","last_fullsized":"2024-04-25T10:08:35.418315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:16.221935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031552+0000","last_change":"2024-04-25T10:08:34.012127+0000","last_active":"2024-04-25T10:08:35.031552+0000","last_peered":"2024-04-25T10:08:35.031552+0000","last_clean":"2024-04-25T10:08:35.031552+0000","last_became_active":"2024-04-25T10:08:34.011736+0000","last_became_peered":"2024-04-25T10:08:34.011736+0000","last_unstale":"2024-04-25T10:08:35.031552+0000","last_undegraded":"2024-04-25T10:08:35.031552+0000","last_fullsized":"2024-04-25T10:08:35.031552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:16.153141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003914+0000","last_change":"2024-04-25T10:08:33.003042+0000","last_active":"2024-04-25T10:08:35.003914+0000","last_peered":"2024-04-25T10:08:35.003914+0000","last_clean":"2024-04-25T10:08:35.003914+0000","last_became_active":"2024-04-25T10:08:33.002788+0000","last_became_peered":"2024-04-25T10:08:33.002788+0000","last_unstale":"2024-04-25T10:08:35.003914+0000","last_undegraded":"2024-04-25T10:08:35.003914+0000","last_fullsized":"2024-04-25T10:08:35.003914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:53.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031642+0000","last_change":"2024-04-25T10:08:34.019681+0000","last_active":"2024-04-25T10:08:35.031642+0000","last_peered":"2024-04-25T10:08:35.031642+0000","last_clean":"2024-04-25T10:08:35.031642+0000","last_became_active":"2024-04-25T10:08:34.019409+0000","last_became_peered":"2024-04-25T10:08:34.019409+0000","last_unstale":"2024-04-25T10:08:35.031642+0000","last_undegraded":"2024-04-25T10:08:35.031642+0000","last_fullsized":"2024-04-25T10:08:35.031642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:04.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031975+0000","last_change":"2024-04-25T10:08:32.997942+0000","last_active":"2024-04-25T10:08:35.031975+0000","last_peered":"2024-04-25T10:08:35.031975+0000","last_clean":"2024-04-25T10:08:35.031975+0000","last_became_active":"2024-04-25T10:08:32.995849+0000","last_became_peered":"2024-04-25T10:08:32.995849+0000","last_unstale":"2024-04-25T10:08:35.031975+0000","last_undegraded":"2024-04-25T10:08:35.031975+0000","last_fullsized":"2024-04-25T10:08:35.031975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:13.109114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181067+0000","last_change":"2024-04-25T10:08:34.013039+0000","last_active":"2024-04-25T10:08:35.181067+0000","last_peered":"2024-04-25T10:08:35.181067+0000","last_clean":"2024-04-25T10:08:35.181067+0000","last_became_active":"2024-04-25T10:08:34.012743+0000","last_became_peered":"2024-04-25T10:08:34.012743+0000","last_unstale":"2024-04-25T10:08:35.181067+0000","last_undegraded":"2024-04-25T10:08:35.181067+0000","last_fullsized":"2024-04-25T10:08:35.181067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:10.438643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998886+0000","last_change":"2024-04-25T10:08:33.004697+0000","last_active":"2024-04-25T10:08:34.998886+0000","last_peered":"2024-04-25T10:08:34.998886+0000","last_clean":"2024-04-25T10:08:34.998886+0000","last_became_active":"2024-04-25T10:08:33.004438+0000","last_became_peered":"2024-04-25T10:08:33.004438+0000","last_unstale":"2024-04-25T10:08:34.998886+0000","last_undegraded":"2024-04-25T10:08:34.998886+0000","last_fullsized":"2024-04-25T10:08:34.998886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:27.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029208+0000","last_change":"2024-04-25T10:08:34.030460+0000","last_active":"2024-04-25T10:08:35.029208+0000","last_peered":"2024-04-25T10:08:35.029208+0000","last_clean":"2024-04-25T10:08:35.029208+0000","last_became_active":"2024-04-25T10:08:34.030192+0000","last_became_peered":"2024-04-25T10:08:34.030192+0000","last_unstale":"2024-04-25T10:08:35.029208+0000","last_undegraded":"2024-04-25T10:08:35.029208+0000","last_fullsized":"2024-04-25T10:08:35.029208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:43.931847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181123+0000","last_change":"2024-04-25T10:08:33.004926+0000","last_active":"2024-04-25T10:08:35.181123+0000","last_peered":"2024-04-25T10:08:35.181123+0000","last_clean":"2024-04-25T10:08:35.181123+0000","last_became_active":"2024-04-25T10:08:33.004583+0000","last_became_peered":"2024-04-25T10:08:33.004583+0000","last_unstale":"2024-04-25T10:08:35.181123+0000","last_undegraded":"2024-04-25T10:08:35.181123+0000","last_fullsized":"2024-04-25T10:08:35.181123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:25.381134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029533+0000","last_change":"2024-04-25T10:08:34.016568+0000","last_active":"2024-04-25T10:08:35.029533+0000","last_peered":"2024-04-25T10:08:35.029533+0000","last_clean":"2024-04-25T10:08:35.029533+0000","last_became_active":"2024-04-25T10:08:34.016236+0000","last_became_peered":"2024-04-25T10:08:34.016236+0000","last_unstale":"2024-04-25T10:08:35.029533+0000","last_undegraded":"2024-04-25T10:08:35.029533+0000","last_fullsized":"2024-04-25T10:08:35.029533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:54.046151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180870+0000","last_change":"2024-04-25T10:08:33.005091+0000","last_active":"2024-04-25T10:08:35.180870+0000","last_peered":"2024-04-25T10:08:35.180870+0000","last_clean":"2024-04-25T10:08:35.180870+0000","last_became_active":"2024-04-25T10:08:33.004551+0000","last_became_peered":"2024-04-25T10:08:33.004551+0000","last_unstale":"2024-04-25T10:08:35.180870+0000","last_undegraded":"2024-04-25T10:08:35.180870+0000","last_fullsized":"2024-04-25T10:08:35.180870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:59.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003746+0000","last_change":"2024-04-25T10:08:34.027247+0000","last_active":"2024-04-25T10:08:35.003746+0000","last_peered":"2024-04-25T10:08:35.003746+0000","last_clean":"2024-04-25T10:08:35.003746+0000","last_became_active":"2024-04-25T10:08:34.026985+0000","last_became_peered":"2024-04-25T10:08:34.026985+0000","last_unstale":"2024-04-25T10:08:35.003746+0000","last_undegraded":"2024-04-25T10:08:35.003746+0000","last_fullsized":"2024-04-25T10:08:35.003746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:17.228534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180876+0000","last_change":"2024-04-25T10:08:33.003781+0000","last_active":"2024-04-25T10:08:35.180876+0000","last_peered":"2024-04-25T10:08:35.180876+0000","last_clean":"2024-04-25T10:08:35.180876+0000","last_became_active":"2024-04-25T10:08:33.003489+0000","last_became_peered":"2024-04-25T10:08:33.003489+0000","last_unstale":"2024-04-25T10:08:35.180876+0000","last_undegraded":"2024-04-25T10:08:35.180876+0000","last_fullsized":"2024-04-25T10:08:35.180876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:00.437969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003862+0000","last_change":"2024-04-25T10:08:34.013487+0000","last_active":"2024-04-25T10:08:35.003862+0000","last_peered":"2024-04-25T10:08:35.003862+0000","last_clean":"2024-04-25T10:08:35.003862+0000","last_became_active":"2024-04-25T10:08:34.013142+0000","last_became_peered":"2024-04-25T10:08:34.013142+0000","last_unstale":"2024-04-25T10:08:35.003862+0000","last_undegraded":"2024-04-25T10:08:35.003862+0000","last_fullsized":"2024-04-25T10:08:35.003862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417472+0000","last_change":"2024-04-25T10:08:33.008642+0000","last_active":"2024-04-25T10:08:35.417472+0000","last_peered":"2024-04-25T10:08:35.417472+0000","last_clean":"2024-04-25T10:08:35.417472+0000","last_became_active":"2024-04-25T10:08:33.008355+0000","last_became_peered":"2024-04-25T10:08:33.008355+0000","last_unstale":"2024-04-25T10:08:35.417472+0000","last_undegraded":"2024-04-25T10:08:35.417472+0000","last_fullsized":"2024-04-25T10:08:35.417472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:24.713433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002919+0000","last_change":"2024-04-25T10:08:34.019194+0000","last_active":"2024-04-25T10:08:35.002919+0000","last_peered":"2024-04-25T10:08:35.002919+0000","last_clean":"2024-04-25T10:08:35.002919+0000","last_became_active":"2024-04-25T10:08:34.016299+0000","last_became_peered":"2024-04-25T10:08:34.016299+0000","last_unstale":"2024-04-25T10:08:35.002919+0000","last_undegraded":"2024-04-25T10:08:35.002919+0000","last_fullsized":"2024-04-25T10:08:35.002919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029589+0000","last_change":"2024-04-25T10:08:33.003130+0000","last_active":"2024-04-25T10:08:35.029589+0000","last_peered":"2024-04-25T10:08:35.029589+0000","last_clean":"2024-04-25T10:08:35.029589+0000","last_became_active":"2024-04-25T10:08:33.002868+0000","last_became_peered":"2024-04-25T10:08:33.002868+0000","last_unstale":"2024-04-25T10:08:35.029589+0000","last_undegraded":"2024-04-25T10:08:35.029589+0000","last_fullsized":"2024-04-25T10:08:35.029589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:07.070501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003897+0000","last_change":"2024-04-25T10:08:34.029747+0000","last_active":"2024-04-25T10:08:35.003897+0000","last_peered":"2024-04-25T10:08:35.003897+0000","last_clean":"2024-04-25T10:08:35.003897+0000","last_became_active":"2024-04-25T10:08:34.029436+0000","last_became_peered":"2024-04-25T10:08:34.029436+0000","last_unstale":"2024-04-25T10:08:35.003897+0000","last_undegraded":"2024-04-25T10:08:35.003897+0000","last_fullsized":"2024-04-25T10:08:35.003897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418049+0000","last_change":"2024-04-25T10:08:33.010326+0000","last_active":"2024-04-25T10:08:35.418049+0000","last_peered":"2024-04-25T10:08:35.418049+0000","last_clean":"2024-04-25T10:08:35.418049+0000","last_became_active":"2024-04-25T10:08:33.010037+0000","last_became_peered":"2024-04-25T10:08:33.010037+0000","last_unstale":"2024-04-25T10:08:35.418049+0000","last_undegraded":"2024-04-25T10:08:35.418049+0000","last_fullsized":"2024-04-25T10:08:35.418049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:17.019427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029213+0000","last_change":"2024-04-25T10:08:34.017218+0000","last_active":"2024-04-25T10:08:35.029213+0000","last_peered":"2024-04-25T10:08:35.029213+0000","last_clean":"2024-04-25T10:08:35.029213+0000","last_became_active":"2024-04-25T10:08:34.016156+0000","last_became_peered":"2024-04-25T10:08:34.016156+0000","last_unstale":"2024-04-25T10:08:35.029213+0000","last_undegraded":"2024-04-25T10:08:35.029213+0000","last_fullsized":"2024-04-25T10:08:35.029213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:22.115314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417678+0000","last_change":"2024-04-25T10:08:33.014162+0000","last_active":"2024-04-25T10:08:35.417678+0000","last_peered":"2024-04-25T10:08:35.417678+0000","last_clean":"2024-04-25T10:08:35.417678+0000","last_became_active":"2024-04-25T10:08:33.013858+0000","last_became_peered":"2024-04-25T10:08:33.013858+0000","last_unstale":"2024-04-25T10:08:35.417678+0000","last_undegraded":"2024-04-25T10:08:35.417678+0000","last_fullsized":"2024-04-25T10:08:35.417678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:20.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003074+0000","last_change":"2024-04-25T10:08:34.016197+0000","last_active":"2024-04-25T10:08:35.003074+0000","last_peered":"2024-04-25T10:08:35.003074+0000","last_clean":"2024-04-25T10:08:35.003074+0000","last_became_active":"2024-04-25T10:08:34.015896+0000","last_became_peered":"2024-04-25T10:08:34.015896+0000","last_unstale":"2024-04-25T10:08:35.003074+0000","last_undegraded":"2024-04-25T10:08:35.003074+0000","last_fullsized":"2024-04-25T10:08:35.003074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002696+0000","last_change":"2024-04-25T10:08:33.007116+0000","last_active":"2024-04-25T10:08:35.002696+0000","last_peered":"2024-04-25T10:08:35.002696+0000","last_clean":"2024-04-25T10:08:35.002696+0000","last_became_active":"2024-04-25T10:08:33.006840+0000","last_became_peered":"2024-04-25T10:08:33.006840+0000","last_unstale":"2024-04-25T10:08:35.002696+0000","last_undegraded":"2024-04-25T10:08:35.002696+0000","last_fullsized":"2024-04-25T10:08:35.002696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002874+0000","last_change":"2024-04-25T10:08:34.017288+0000","last_active":"2024-04-25T10:08:35.002874+0000","last_peered":"2024-04-25T10:08:35.002874+0000","last_clean":"2024-04-25T10:08:35.002874+0000","last_became_active":"2024-04-25T10:08:34.015490+0000","last_became_peered":"2024-04-25T10:08:34.015490+0000","last_unstale":"2024-04-25T10:08:35.002874+0000","last_undegraded":"2024-04-25T10:08:35.002874+0000","last_fullsized":"2024-04-25T10:08:35.002874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031588+0000","last_change":"2024-04-25T10:08:33.003506+0000","last_active":"2024-04-25T10:08:35.031588+0000","last_peered":"2024-04-25T10:08:35.031588+0000","last_clean":"2024-04-25T10:08:35.031588+0000","last_became_active":"2024-04-25T10:08:33.003077+0000","last_became_peered":"2024-04-25T10:08:33.003077+0000","last_unstale":"2024-04-25T10:08:35.031588+0000","last_undegraded":"2024-04-25T10:08:35.031588+0000","last_fullsized":"2024-04-25T10:08:35.031588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.875235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999250+0000","last_change":"2024-04-25T10:08:34.018059+0000","last_active":"2024-04-25T10:08:34.999250+0000","last_peered":"2024-04-25T10:08:34.999250+0000","last_clean":"2024-04-25T10:08:34.999250+0000","last_became_active":"2024-04-25T10:08:34.017761+0000","last_became_peered":"2024-04-25T10:08:34.017761+0000","last_unstale":"2024-04-25T10:08:34.999250+0000","last_undegraded":"2024-04-25T10:08:34.999250+0000","last_fullsized":"2024-04-25T10:08:34.999250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003210+0000","last_change":"2024-04-25T10:08:33.004709+0000","last_active":"2024-04-25T10:08:35.003210+0000","last_peered":"2024-04-25T10:08:35.003210+0000","last_clean":"2024-04-25T10:08:35.003210+0000","last_became_active":"2024-04-25T10:08:33.004382+0000","last_became_peered":"2024-04-25T10:08:33.004382+0000","last_unstale":"2024-04-25T10:08:35.003210+0000","last_undegraded":"2024-04-25T10:08:35.003210+0000","last_fullsized":"2024-04-25T10:08:35.003210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:47.606636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999464+0000","last_change":"2024-04-25T10:08:34.013883+0000","last_active":"2024-04-25T10:08:34.999464+0000","last_peered":"2024-04-25T10:08:34.999464+0000","last_clean":"2024-04-25T10:08:34.999464+0000","last_became_active":"2024-04-25T10:08:34.013586+0000","last_became_peered":"2024-04-25T10:08:34.013586+0000","last_unstale":"2024-04-25T10:08:34.999464+0000","last_undegraded":"2024-04-25T10:08:34.999464+0000","last_fullsized":"2024-04-25T10:08:34.999464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998609+0000","last_change":"2024-04-25T10:08:33.000919+0000","last_active":"2024-04-25T10:08:34.998609+0000","last_peered":"2024-04-25T10:08:34.998609+0000","last_clean":"2024-04-25T10:08:34.998609+0000","last_became_active":"2024-04-25T10:08:33.000597+0000","last_became_peered":"2024-04-25T10:08:33.000597+0000","last_unstale":"2024-04-25T10:08:34.998609+0000","last_undegraded":"2024-04-25T10:08:34.998609+0000","last_fullsized":"2024-04-25T10:08:34.998609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417885+0000","last_change":"2024-04-25T10:08:34.022918+0000","last_active":"2024-04-25T10:08:35.417885+0000","last_peered":"2024-04-25T10:08:35.417885+0000","last_clean":"2024-04-25T10:08:35.417885+0000","last_became_active":"2024-04-25T10:08:34.022412+0000","last_became_peered":"2024-04-25T10:08:34.022412+0000","last_unstale":"2024-04-25T10:08:35.417885+0000","last_undegraded":"2024-04-25T10:08:35.417885+0000","last_fullsized":"2024-04-25T10:08:35.417885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:11.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181278+0000","last_change":"2024-04-25T10:08:33.004372+0000","last_active":"2024-04-25T10:08:35.181278+0000","last_peered":"2024-04-25T10:08:35.181278+0000","last_clean":"2024-04-25T10:08:35.181278+0000","last_became_active":"2024-04-25T10:08:33.003174+0000","last_became_peered":"2024-04-25T10:08:33.003174+0000","last_unstale":"2024-04-25T10:08:35.181278+0000","last_undegraded":"2024-04-25T10:08:35.181278+0000","last_fullsized":"2024-04-25T10:08:35.181278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:52.656400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417882+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:08:35.417882+0000","last_peered":"2024-04-25T10:08:35.417882+0000","last_clean":"2024-04-25T10:08:35.417882+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:08:35.417882+0000","last_undegraded":"2024-04-25T10:08:35.417882+0000","last_fullsized":"2024-04-25T10:08:35.417882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":452202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":450624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1003520,"data_stored":452306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542207,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":451172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":451332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":450702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1040958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:08:42.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:08:42.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 Processor -- start 2024-04-25T10:08:42.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 -- start start 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b18161510 0x7f9b18143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1806d090 con 0x7f9b18070fe0 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b18071ad0 con 0x7f9b181435c0 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b1e000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b18162390 con 0x7f9b18161510 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b17400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9b18070fe0 0x7f9b180713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46470/0 (socket says 172.21.15.18:46470) 2024-04-25T10:08:42.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b17400640 1 -- 172.21.15.18:0/3387690870 learned_addr learned my addr 172.21.15.18:0/3387690870 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/3387690870 >> v2:172.21.15.167:3300/0 conn(0x7f9b18161510 0x7f9b18143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482932484 0 0) 0x7f9b080014a0 con 0x7f9b18070fe0 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc003530 con 0x7f9b18070fe0 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3237156818 0 0) 0x7f9afc003530 con 0x7f9b18070fe0 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 >> v2:172.21.15.167:3300/0 conn(0x7f9b18161510 msgr2=0x7f9b18143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:42.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 --2- 172.21.15.18:0/3387690870 >> v2:172.21.15.167:3300/0 conn(0x7f9b18161510 0x7f9b18143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 >> v1:172.21.15.167:6789/0 conn(0x7f9b181435c0 legacy=0x7f9b1815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18161af0 con 0x7f9b18070fe0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f9b08001bd0 con 0x7f9b18070fe0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 >> v1:172.21.15.18:6789/0 conn(0x7f9b18070fe0 legacy=0x7f9b180713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc003a10 0x7f9afc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 0x7f9afc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9afc0051d0 0x7f9afc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18162390 con 0x7f9afc004810 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc00c0d0 con 0x7f9afc0051d0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.890+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc00c2d0 con 0x7f9afc003a10 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 0x7f9afc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b17400640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc003a10 0x7f9afc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b17e00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9afc0051d0 0x7f9afc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 -- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc003a10 msgr2=0x7f9afc003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc003a10 0x7f9afc003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 -- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9afc0051d0 msgr2=0x7f9afc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9afc0051d0 0x7f9afc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 -- 172.21.15.18:0/3387690870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc003530 con 0x7f9afc004810 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b17e00640 1 -- 172.21.15.18:0/3387690870 reap_dead start 2024-04-25T10:08:42.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 0x7f9afc004c90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009ae0 tx=0x7f9b0001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc47a2bfd500bdf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:42.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000b2070 con 0x7f9afc004810 2024-04-25T10:08:42.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b000a5660 con 0x7f9afc004810 2024-04-25T10:08:42.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b16a00640 1 -- 172.21.15.18:0/3387690870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000096b0 con 0x7f9afc004810 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b1e000640 1 -- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 msgr2=0x7f9afc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.894+0000 7f9b1e000640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 0x7f9afc004c90 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f9b00009ae0 tx=0x7f9b0001ca70 comp rx=0 tx=0).stop 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- 172.21.15.18:0/3387690870 shutdown_connections 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 --2- 172.21.15.18:0/3387690870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9afc004810 0x7f9afc004c90 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- 172.21.15.18:0/3387690870 >> 172.21.15.18:0/3387690870 conn(0x7f9b180b3390 msgr2=0x7f9b180b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- 172.21.15.18:0/3387690870 shutdown_connections 2024-04-25T10:08:42.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- 172.21.15.18:0/3387690870 wait complete. 2024-04-25T10:08:42.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 Processor -- start 2024-04-25T10:08:42.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- start start 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 0x7f9b1813f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 0x7f9b18146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1815e030 con 0x7f9b180b66a0 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181620b0 con 0x7f9b180b6b00 2024-04-25T10:08:42.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b1e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18143080 con 0x7f9afc004810 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52398/0 (socket says 172.21.15.18:52398) 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 -- 172.21.15.18:0/121776197 learned_addr learned my addr 172.21.15.18:0/121776197 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b17400640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 0x7f9b1813f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b17e00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 0x7f9b18146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 -- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 msgr2=0x7f9b1813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 0x7f9b1813f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 -- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 msgr2=0x7f9b18146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 0x7f9b18146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 -- 172.21.15.18:0/121776197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180b5600 con 0x7f9b180b66a0 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b17400640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 0x7f9b1813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b17e00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 0x7f9b18146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:42.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.898+0000 7f9b0ea00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9b0001c8a0 tx=0x7f9b00019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000b2040 con 0x7f9b180b66a0 2024-04-25T10:08:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b00004020 con 0x7f9b180b66a0 2024-04-25T10:08:42.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b000043f0 con 0x7f9b180b66a0 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180b58e0 con 0x7f9b180b66a0 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b180b5ea0 con 0x7f9b180b66a0 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b180745d0 con 0x7f9b180b66a0 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9b000bf030 con 0x7f9b180b66a0 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 0x7f9af4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:42.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9b0011f0e0 con 0x7f9b180b66a0 2024-04-25T10:08:42.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b17400640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 0x7f9af4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:42.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.902+0000 7f9b17400640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 0x7f9af4069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b08001640 tx=0x7f9b08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:42.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:42.906+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b000c6060 con 0x7f9b180b66a0 2024-04-25T10:08:43.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.066+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b180d1fc0 con 0x7f9af4066f60 2024-04-25T10:08:43.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.074+0000 7f9b0fe00640 1 -- 172.21.15.18:0/121776197 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7f9b180d1fc0 con 0x7f9af4066f60 2024-04-25T10:08:43.084 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:43.086 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 msgr2=0x7f9af4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 0x7f9af4069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9b08001640 tx=0x7f9b08009040 comp rx=0 tx=0).stop 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 msgr2=0x7f9b18146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f9b0001c8a0 tx=0x7f9b00019810 comp rx=0 tx=0).stop 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 shutdown_connections 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b180b6b00 0x7f9b18146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b180b66a0 0x7f9b18146570 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9af4066f60 0x7f9af4069420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 --2- 172.21.15.18:0/121776197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9afc004810 0x7f9b1813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 >> 172.21.15.18:0/121776197 conn(0x7f9b180b3390 msgr2=0x7f9b180cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:43.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 shutdown_connections 2024-04-25T10:08:43.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.078+0000 7f9b1e000640 1 -- 172.21.15.18:0/121776197 wait complete. 2024-04-25T10:08:43.105 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":224,"stamp":"2024-04-25T10:08:41.467605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":250068,"kb_used_data":8904,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754724652,"statfs":{"total":773094113280,"available":772838043648,"internally_reserved":0,"allocated":9117696,"data_stored":4790276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002214"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418114+0000","last_change":"2024-04-25T10:08:34.017363+0000","last_active":"2024-04-25T10:08:35.418114+0000","last_peered":"2024-04-25T10:08:35.418114+0000","last_clean":"2024-04-25T10:08:35.418114+0000","last_became_active":"2024-04-25T10:08:34.017088+0000","last_became_peered":"2024-04-25T10:08:34.017088+0000","last_unstale":"2024-04-25T10:08:35.418114+0000","last_undegraded":"2024-04-25T10:08:35.418114+0000","last_fullsized":"2024-04-25T10:08:35.418114+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:15.681645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029526+0000","last_change":"2024-04-25T10:08:34.021493+0000","last_active":"2024-04-25T10:08:35.029526+0000","last_peered":"2024-04-25T10:08:35.029526+0000","last_clean":"2024-04-25T10:08:35.029526+0000","last_became_active":"2024-04-25T10:08:34.021186+0000","last_became_peered":"2024-04-25T10:08:34.021186+0000","last_unstale":"2024-04-25T10:08:35.029526+0000","last_undegraded":"2024-04-25T10:08:35.029526+0000","last_fullsized":"2024-04-25T10:08:35.029526+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:42.229181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998998+0000","last_change":"2024-04-25T10:08:34.025282+0000","last_active":"2024-04-25T10:08:34.998998+0000","last_peered":"2024-04-25T10:08:34.998998+0000","last_clean":"2024-04-25T10:08:34.998998+0000","last_became_active":"2024-04-25T10:08:34.025024+0000","last_became_peered":"2024-04-25T10:08:34.025024+0000","last_unstale":"2024-04-25T10:08:34.998998+0000","last_undegraded":"2024-04-25T10:08:34.998998+0000","last_fullsized":"2024-04-25T10:08:34.998998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418001+0000","last_change":"2024-04-25T10:08:34.028893+0000","last_active":"2024-04-25T10:08:35.418001+0000","last_peered":"2024-04-25T10:08:35.418001+0000","last_clean":"2024-04-25T10:08:35.418001+0000","last_became_active":"2024-04-25T10:08:34.028352+0000","last_became_peered":"2024-04-25T10:08:34.028352+0000","last_unstale":"2024-04-25T10:08:35.418001+0000","last_undegraded":"2024-04-25T10:08:35.418001+0000","last_fullsized":"2024-04-25T10:08:35.418001+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:51.230025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031585+0000","last_change":"2024-04-25T10:08:34.017231+0000","last_active":"2024-04-25T10:08:35.031585+0000","last_peered":"2024-04-25T10:08:35.031585+0000","last_clean":"2024-04-25T10:08:35.031585+0000","last_became_active":"2024-04-25T10:08:34.016095+0000","last_became_peered":"2024-04-25T10:08:34.016095+0000","last_unstale":"2024-04-25T10:08:35.031585+0000","last_undegraded":"2024-04-25T10:08:35.031585+0000","last_fullsized":"2024-04-25T10:08:35.031585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:34:16.605425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180961+0000","last_change":"2024-04-25T10:08:34.014621+0000","last_active":"2024-04-25T10:08:35.180961+0000","last_peered":"2024-04-25T10:08:35.180961+0000","last_clean":"2024-04-25T10:08:35.180961+0000","last_became_active":"2024-04-25T10:08:34.014085+0000","last_became_peered":"2024-04-25T10:08:34.014085+0000","last_unstale":"2024-04-25T10:08:35.180961+0000","last_undegraded":"2024-04-25T10:08:35.180961+0000","last_fullsized":"2024-04-25T10:08:35.180961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:04.190820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002915+0000","last_change":"2024-04-25T10:08:34.016772+0000","last_active":"2024-04-25T10:08:35.002915+0000","last_peered":"2024-04-25T10:08:35.002915+0000","last_clean":"2024-04-25T10:08:35.002915+0000","last_became_active":"2024-04-25T10:08:34.015366+0000","last_became_peered":"2024-04-25T10:08:34.015366+0000","last_unstale":"2024-04-25T10:08:35.002915+0000","last_undegraded":"2024-04-25T10:08:35.002915+0000","last_fullsized":"2024-04-25T10:08:35.002915+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031661+0000","last_change":"2024-04-25T10:08:34.017931+0000","last_active":"2024-04-25T10:08:35.031661+0000","last_peered":"2024-04-25T10:08:35.031661+0000","last_clean":"2024-04-25T10:08:35.031661+0000","last_became_active":"2024-04-25T10:08:34.017586+0000","last_became_peered":"2024-04-25T10:08:34.017586+0000","last_unstale":"2024-04-25T10:08:35.031661+0000","last_undegraded":"2024-04-25T10:08:35.031661+0000","last_fullsized":"2024-04-25T10:08:35.031661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:49.996965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003501+0000","last_change":"2024-04-25T10:08:34.017106+0000","last_active":"2024-04-25T10:08:35.003501+0000","last_peered":"2024-04-25T10:08:35.003501+0000","last_clean":"2024-04-25T10:08:35.003501+0000","last_became_active":"2024-04-25T10:08:34.016836+0000","last_became_peered":"2024-04-25T10:08:34.016836+0000","last_unstale":"2024-04-25T10:08:35.003501+0000","last_undegraded":"2024-04-25T10:08:35.003501+0000","last_fullsized":"2024-04-25T10:08:35.003501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:12.240175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417714+0000","last_change":"2024-04-25T10:08:34.025645+0000","last_active":"2024-04-25T10:08:35.417714+0000","last_peered":"2024-04-25T10:08:35.417714+0000","last_clean":"2024-04-25T10:08:35.417714+0000","last_became_active":"2024-04-25T10:08:34.025056+0000","last_became_peered":"2024-04-25T10:08:34.025056+0000","last_unstale":"2024-04-25T10:08:35.417714+0000","last_undegraded":"2024-04-25T10:08:35.417714+0000","last_fullsized":"2024-04-25T10:08:35.417714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:51.196016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029377+0000","last_change":"2024-04-25T10:08:34.026807+0000","last_active":"2024-04-25T10:08:35.029377+0000","last_peered":"2024-04-25T10:08:35.029377+0000","last_clean":"2024-04-25T10:08:35.029377+0000","last_became_active":"2024-04-25T10:08:34.025681+0000","last_became_peered":"2024-04-25T10:08:34.025681+0000","last_unstale":"2024-04-25T10:08:35.029377+0000","last_undegraded":"2024-04-25T10:08:35.029377+0000","last_fullsized":"2024-04-25T10:08:35.029377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:58.077735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418172+0000","last_change":"2024-04-25T10:08:34.035915+0000","last_active":"2024-04-25T10:08:35.418172+0000","last_peered":"2024-04-25T10:08:35.418172+0000","last_clean":"2024-04-25T10:08:35.418172+0000","last_became_active":"2024-04-25T10:08:34.035583+0000","last_became_peered":"2024-04-25T10:08:34.035583+0000","last_unstale":"2024-04-25T10:08:35.418172+0000","last_undegraded":"2024-04-25T10:08:35.418172+0000","last_fullsized":"2024-04-25T10:08:35.418172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:50.401689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031744+0000","last_change":"2024-04-25T10:08:34.015665+0000","last_active":"2024-04-25T10:08:35.031744+0000","last_peered":"2024-04-25T10:08:35.031744+0000","last_clean":"2024-04-25T10:08:35.031744+0000","last_became_active":"2024-04-25T10:08:34.015246+0000","last_became_peered":"2024-04-25T10:08:34.015246+0000","last_unstale":"2024-04-25T10:08:35.031744+0000","last_undegraded":"2024-04-25T10:08:35.031744+0000","last_fullsized":"2024-04-25T10:08:35.031744+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.847292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181056+0000","last_change":"2024-04-25T10:08:34.014402+0000","last_active":"2024-04-25T10:08:35.181056+0000","last_peered":"2024-04-25T10:08:35.181056+0000","last_clean":"2024-04-25T10:08:35.181056+0000","last_became_active":"2024-04-25T10:08:34.012356+0000","last_became_peered":"2024-04-25T10:08:34.012356+0000","last_unstale":"2024-04-25T10:08:35.181056+0000","last_undegraded":"2024-04-25T10:08:35.181056+0000","last_fullsized":"2024-04-25T10:08:35.181056+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:58.513846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028905+0000","last_change":"2024-04-25T10:08:34.014342+0000","last_active":"2024-04-25T10:08:35.028905+0000","last_peered":"2024-04-25T10:08:35.028905+0000","last_clean":"2024-04-25T10:08:35.028905+0000","last_became_active":"2024-04-25T10:08:34.014011+0000","last_became_peered":"2024-04-25T10:08:34.014011+0000","last_unstale":"2024-04-25T10:08:35.028905+0000","last_undegraded":"2024-04-25T10:08:35.028905+0000","last_fullsized":"2024-04-25T10:08:35.028905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:40.898281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417995+0000","last_change":"2024-04-25T10:08:34.024552+0000","last_active":"2024-04-25T10:08:35.417995+0000","last_peered":"2024-04-25T10:08:35.417995+0000","last_clean":"2024-04-25T10:08:35.417995+0000","last_became_active":"2024-04-25T10:08:34.024245+0000","last_became_peered":"2024-04-25T10:08:34.024245+0000","last_unstale":"2024-04-25T10:08:35.417995+0000","last_undegraded":"2024-04-25T10:08:35.417995+0000","last_fullsized":"2024-04-25T10:08:35.417995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:53:31.110028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031908+0000","last_change":"2024-04-25T10:08:34.011449+0000","last_active":"2024-04-25T10:08:35.031908+0000","last_peered":"2024-04-25T10:08:35.031908+0000","last_clean":"2024-04-25T10:08:35.031908+0000","last_became_active":"2024-04-25T10:08:34.011147+0000","last_became_peered":"2024-04-25T10:08:34.011147+0000","last_unstale":"2024-04-25T10:08:35.031908+0000","last_undegraded":"2024-04-25T10:08:35.031908+0000","last_fullsized":"2024-04-25T10:08:35.031908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:37.893587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999000+0000","last_change":"2024-04-25T10:08:34.010473+0000","last_active":"2024-04-25T10:08:34.999000+0000","last_peered":"2024-04-25T10:08:34.999000+0000","last_clean":"2024-04-25T10:08:34.999000+0000","last_became_active":"2024-04-25T10:08:34.010053+0000","last_became_peered":"2024-04-25T10:08:34.010053+0000","last_unstale":"2024-04-25T10:08:34.999000+0000","last_undegraded":"2024-04-25T10:08:34.999000+0000","last_fullsized":"2024-04-25T10:08:34.999000+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181299+0000","last_change":"2024-04-25T10:08:34.017362+0000","last_active":"2024-04-25T10:08:35.181299+0000","last_peered":"2024-04-25T10:08:35.181299+0000","last_clean":"2024-04-25T10:08:35.181299+0000","last_became_active":"2024-04-25T10:08:34.017053+0000","last_became_peered":"2024-04-25T10:08:34.017053+0000","last_unstale":"2024-04-25T10:08:35.181299+0000","last_undegraded":"2024-04-25T10:08:35.181299+0000","last_fullsized":"2024-04-25T10:08:35.181299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:48.842056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031767+0000","last_change":"2024-04-25T10:08:34.007070+0000","last_active":"2024-04-25T10:08:35.031767+0000","last_peered":"2024-04-25T10:08:35.031767+0000","last_clean":"2024-04-25T10:08:35.031767+0000","last_became_active":"2024-04-25T10:08:34.006804+0000","last_became_peered":"2024-04-25T10:08:34.006804+0000","last_unstale":"2024-04-25T10:08:35.031767+0000","last_undegraded":"2024-04-25T10:08:35.031767+0000","last_fullsized":"2024-04-25T10:08:35.031767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:41.897342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003601+0000","last_change":"2024-04-25T10:08:34.012610+0000","last_active":"2024-04-25T10:08:35.003601+0000","last_peered":"2024-04-25T10:08:35.003601+0000","last_clean":"2024-04-25T10:08:35.003601+0000","last_became_active":"2024-04-25T10:08:34.011294+0000","last_became_peered":"2024-04-25T10:08:34.011294+0000","last_unstale":"2024-04-25T10:08:35.003601+0000","last_undegraded":"2024-04-25T10:08:35.003601+0000","last_fullsized":"2024-04-25T10:08:35.003601+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:23.736647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031521+0000","last_change":"2024-04-25T10:08:34.020307+0000","last_active":"2024-04-25T10:08:35.031521+0000","last_peered":"2024-04-25T10:08:35.031521+0000","last_clean":"2024-04-25T10:08:35.031521+0000","last_became_active":"2024-04-25T10:08:34.018096+0000","last_became_peered":"2024-04-25T10:08:34.018096+0000","last_unstale":"2024-04-25T10:08:35.031521+0000","last_undegraded":"2024-04-25T10:08:35.031521+0000","last_fullsized":"2024-04-25T10:08:35.031521+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:36.687476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003352+0000","last_change":"2024-04-25T10:08:34.024671+0000","last_active":"2024-04-25T10:08:35.003352+0000","last_peered":"2024-04-25T10:08:35.003352+0000","last_clean":"2024-04-25T10:08:35.003352+0000","last_became_active":"2024-04-25T10:08:34.024387+0000","last_became_peered":"2024-04-25T10:08:34.024387+0000","last_unstale":"2024-04-25T10:08:35.003352+0000","last_undegraded":"2024-04-25T10:08:35.003352+0000","last_fullsized":"2024-04-25T10:08:35.003352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:20.825364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028846+0000","last_change":"2024-04-25T10:08:34.026585+0000","last_active":"2024-04-25T10:08:35.028846+0000","last_peered":"2024-04-25T10:08:35.028846+0000","last_clean":"2024-04-25T10:08:35.028846+0000","last_became_active":"2024-04-25T10:08:34.026274+0000","last_became_peered":"2024-04-25T10:08:34.026274+0000","last_unstale":"2024-04-25T10:08:35.028846+0000","last_undegraded":"2024-04-25T10:08:35.028846+0000","last_fullsized":"2024-04-25T10:08:35.028846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:41.217493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029490+0000","last_change":"2024-04-25T10:08:34.025864+0000","last_active":"2024-04-25T10:08:35.029490+0000","last_peered":"2024-04-25T10:08:35.029490+0000","last_clean":"2024-04-25T10:08:35.029490+0000","last_became_active":"2024-04-25T10:08:34.025510+0000","last_became_peered":"2024-04-25T10:08:34.025510+0000","last_unstale":"2024-04-25T10:08:35.029490+0000","last_undegraded":"2024-04-25T10:08:35.029490+0000","last_fullsized":"2024-04-25T10:08:35.029490+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:10.450925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417690+0000","last_change":"2024-04-25T10:08:34.035798+0000","last_active":"2024-04-25T10:08:35.417690+0000","last_peered":"2024-04-25T10:08:35.417690+0000","last_clean":"2024-04-25T10:08:35.417690+0000","last_became_active":"2024-04-25T10:08:34.035501+0000","last_became_peered":"2024-04-25T10:08:34.035501+0000","last_unstale":"2024-04-25T10:08:35.417690+0000","last_undegraded":"2024-04-25T10:08:35.417690+0000","last_fullsized":"2024-04-25T10:08:35.417690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:54.283949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417929+0000","last_change":"2024-04-25T10:08:34.027320+0000","last_active":"2024-04-25T10:08:35.417929+0000","last_peered":"2024-04-25T10:08:35.417929+0000","last_clean":"2024-04-25T10:08:35.417929+0000","last_became_active":"2024-04-25T10:08:34.027036+0000","last_became_peered":"2024-04-25T10:08:34.027036+0000","last_unstale":"2024-04-25T10:08:35.417929+0000","last_undegraded":"2024-04-25T10:08:35.417929+0000","last_fullsized":"2024-04-25T10:08:35.417929+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:09.250533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031801+0000","last_change":"2024-04-25T10:08:34.030709+0000","last_active":"2024-04-25T10:08:35.031801+0000","last_peered":"2024-04-25T10:08:35.031801+0000","last_clean":"2024-04-25T10:08:35.031801+0000","last_became_active":"2024-04-25T10:08:34.030384+0000","last_became_peered":"2024-04-25T10:08:34.030384+0000","last_unstale":"2024-04-25T10:08:35.031801+0000","last_undegraded":"2024-04-25T10:08:35.031801+0000","last_fullsized":"2024-04-25T10:08:35.031801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:10.809616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029152+0000","last_change":"2024-04-25T10:08:34.020753+0000","last_active":"2024-04-25T10:08:35.029152+0000","last_peered":"2024-04-25T10:08:35.029152+0000","last_clean":"2024-04-25T10:08:35.029152+0000","last_became_active":"2024-04-25T10:08:34.020394+0000","last_became_peered":"2024-04-25T10:08:34.020394+0000","last_unstale":"2024-04-25T10:08:35.029152+0000","last_undegraded":"2024-04-25T10:08:35.029152+0000","last_fullsized":"2024-04-25T10:08:35.029152+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:51.101556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417284+0000","last_change":"2024-04-25T10:08:34.020178+0000","last_active":"2024-04-25T10:08:35.417284+0000","last_peered":"2024-04-25T10:08:35.417284+0000","last_clean":"2024-04-25T10:08:35.417284+0000","last_became_active":"2024-04-25T10:08:34.019886+0000","last_became_peered":"2024-04-25T10:08:34.019886+0000","last_unstale":"2024-04-25T10:08:35.417284+0000","last_undegraded":"2024-04-25T10:08:35.417284+0000","last_fullsized":"2024-04-25T10:08:35.417284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:06:30.654822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999136+0000","last_change":"2024-04-25T10:08:34.009888+0000","last_active":"2024-04-25T10:08:34.999136+0000","last_peered":"2024-04-25T10:08:34.999136+0000","last_clean":"2024-04-25T10:08:34.999136+0000","last_became_active":"2024-04-25T10:08:34.008686+0000","last_became_peered":"2024-04-25T10:08:34.008686+0000","last_unstale":"2024-04-25T10:08:34.999136+0000","last_undegraded":"2024-04-25T10:08:34.999136+0000","last_fullsized":"2024-04-25T10:08:34.999136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:25.720033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417736+0000","last_change":"2024-04-25T10:08:34.016111+0000","last_active":"2024-04-25T10:08:35.417736+0000","last_peered":"2024-04-25T10:08:35.417736+0000","last_clean":"2024-04-25T10:08:35.417736+0000","last_became_active":"2024-04-25T10:08:34.015699+0000","last_became_peered":"2024-04-25T10:08:34.015699+0000","last_unstale":"2024-04-25T10:08:35.417736+0000","last_undegraded":"2024-04-25T10:08:35.417736+0000","last_fullsized":"2024-04-25T10:08:35.417736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:07:15.473404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999140+0000","last_change":"2024-04-25T10:08:34.011122+0000","last_active":"2024-04-25T10:08:34.999140+0000","last_peered":"2024-04-25T10:08:34.999140+0000","last_clean":"2024-04-25T10:08:34.999140+0000","last_became_active":"2024-04-25T10:08:34.010868+0000","last_became_peered":"2024-04-25T10:08:34.010868+0000","last_unstale":"2024-04-25T10:08:34.999140+0000","last_undegraded":"2024-04-25T10:08:34.999140+0000","last_fullsized":"2024-04-25T10:08:34.999140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"80'4","reported_seq":18,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031894+0000","last_change":"2024-04-25T10:08:33.002480+0000","last_active":"2024-04-25T10:08:35.031894+0000","last_peered":"2024-04-25T10:08:35.031894+0000","last_clean":"2024-04-25T10:08:35.031894+0000","last_became_active":"2024-04-25T10:08:33.000086+0000","last_became_peered":"2024-04-25T10:08:33.000086+0000","last_unstale":"2024-04-25T10:08:35.031894+0000","last_undegraded":"2024-04-25T10:08:35.031894+0000","last_fullsized":"2024-04-25T10:08:35.031894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:57.411455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028904+0000","last_change":"2024-04-25T10:08:34.026292+0000","last_active":"2024-04-25T10:08:35.028904+0000","last_peered":"2024-04-25T10:08:35.028904+0000","last_clean":"2024-04-25T10:08:35.028904+0000","last_became_active":"2024-04-25T10:08:34.026020+0000","last_became_peered":"2024-04-25T10:08:34.026020+0000","last_unstale":"2024-04-25T10:08:35.028904+0000","last_undegraded":"2024-04-25T10:08:35.028904+0000","last_fullsized":"2024-04-25T10:08:35.028904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:52.283072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418041+0000","last_change":"2024-04-25T10:08:33.011515+0000","last_active":"2024-04-25T10:08:35.418041+0000","last_peered":"2024-04-25T10:08:35.418041+0000","last_clean":"2024-04-25T10:08:35.418041+0000","last_became_active":"2024-04-25T10:08:33.010837+0000","last_became_peered":"2024-04-25T10:08:33.010837+0000","last_unstale":"2024-04-25T10:08:35.418041+0000","last_undegraded":"2024-04-25T10:08:35.418041+0000","last_fullsized":"2024-04-25T10:08:35.418041+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:16.121478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003718+0000","last_change":"2024-04-25T10:08:34.030490+0000","last_active":"2024-04-25T10:08:35.003718+0000","last_peered":"2024-04-25T10:08:35.003718+0000","last_clean":"2024-04-25T10:08:35.003718+0000","last_became_active":"2024-04-25T10:08:34.030167+0000","last_became_peered":"2024-04-25T10:08:34.030167+0000","last_unstale":"2024-04-25T10:08:35.003718+0000","last_undegraded":"2024-04-25T10:08:35.003718+0000","last_fullsized":"2024-04-25T10:08:35.003718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:57:41.110876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417655+0000","last_change":"2024-04-25T10:08:33.011678+0000","last_active":"2024-04-25T10:08:35.417655+0000","last_peered":"2024-04-25T10:08:35.417655+0000","last_clean":"2024-04-25T10:08:35.417655+0000","last_became_active":"2024-04-25T10:08:33.011366+0000","last_became_peered":"2024-04-25T10:08:33.011366+0000","last_unstale":"2024-04-25T10:08:35.417655+0000","last_undegraded":"2024-04-25T10:08:35.417655+0000","last_fullsized":"2024-04-25T10:08:35.417655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:24.713433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003698+0000","last_change":"2024-04-25T10:08:34.013022+0000","last_active":"2024-04-25T10:08:35.003698+0000","last_peered":"2024-04-25T10:08:35.003698+0000","last_clean":"2024-04-25T10:08:35.003698+0000","last_became_active":"2024-04-25T10:08:34.012718+0000","last_became_peered":"2024-04-25T10:08:34.012718+0000","last_unstale":"2024-04-25T10:08:35.003698+0000","last_undegraded":"2024-04-25T10:08:35.003698+0000","last_fullsized":"2024-04-25T10:08:35.003698+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:37.845698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002852+0000","last_change":"2024-04-25T10:08:33.007013+0000","last_active":"2024-04-25T10:08:35.002852+0000","last_peered":"2024-04-25T10:08:35.002852+0000","last_clean":"2024-04-25T10:08:35.002852+0000","last_became_active":"2024-04-25T10:08:33.006754+0000","last_became_peered":"2024-04-25T10:08:33.006754+0000","last_unstale":"2024-04-25T10:08:35.002852+0000","last_undegraded":"2024-04-25T10:08:35.002852+0000","last_fullsized":"2024-04-25T10:08:35.002852+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:30.675420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029185+0000","last_change":"2024-04-25T10:08:34.025084+0000","last_active":"2024-04-25T10:08:35.029185+0000","last_peered":"2024-04-25T10:08:35.029185+0000","last_clean":"2024-04-25T10:08:35.029185+0000","last_became_active":"2024-04-25T10:08:34.024770+0000","last_became_peered":"2024-04-25T10:08:34.024770+0000","last_unstale":"2024-04-25T10:08:35.029185+0000","last_undegraded":"2024-04-25T10:08:35.029185+0000","last_fullsized":"2024-04-25T10:08:35.029185+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:05.334293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003706+0000","last_change":"2024-04-25T10:08:33.007061+0000","last_active":"2024-04-25T10:08:35.003706+0000","last_peered":"2024-04-25T10:08:35.003706+0000","last_clean":"2024-04-25T10:08:35.003706+0000","last_became_active":"2024-04-25T10:08:33.006778+0000","last_became_peered":"2024-04-25T10:08:33.006778+0000","last_unstale":"2024-04-25T10:08:35.003706+0000","last_undegraded":"2024-04-25T10:08:35.003706+0000","last_fullsized":"2024-04-25T10:08:35.003706+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:28.087771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029446+0000","last_change":"2024-04-25T10:08:34.031090+0000","last_active":"2024-04-25T10:08:35.029446+0000","last_peered":"2024-04-25T10:08:35.029446+0000","last_clean":"2024-04-25T10:08:35.029446+0000","last_became_active":"2024-04-25T10:08:34.023940+0000","last_became_peered":"2024-04-25T10:08:34.023940+0000","last_unstale":"2024-04-25T10:08:35.029446+0000","last_undegraded":"2024-04-25T10:08:35.029446+0000","last_fullsized":"2024-04-25T10:08:35.029446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:28.981263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417361+0000","last_change":"2024-04-25T10:08:33.005514+0000","last_active":"2024-04-25T10:08:35.417361+0000","last_peered":"2024-04-25T10:08:35.417361+0000","last_clean":"2024-04-25T10:08:35.417361+0000","last_became_active":"2024-04-25T10:08:33.005250+0000","last_became_peered":"2024-04-25T10:08:33.005250+0000","last_unstale":"2024-04-25T10:08:35.417361+0000","last_undegraded":"2024-04-25T10:08:35.417361+0000","last_fullsized":"2024-04-25T10:08:35.417361+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:02.983789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003802+0000","last_change":"2024-04-25T10:08:34.033108+0000","last_active":"2024-04-25T10:08:35.003802+0000","last_peered":"2024-04-25T10:08:35.003802+0000","last_clean":"2024-04-25T10:08:35.003802+0000","last_became_active":"2024-04-25T10:08:34.032807+0000","last_became_peered":"2024-04-25T10:08:34.032807+0000","last_unstale":"2024-04-25T10:08:35.003802+0000","last_undegraded":"2024-04-25T10:08:35.003802+0000","last_fullsized":"2024-04-25T10:08:35.003802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:55:32.657399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028964+0000","last_change":"2024-04-25T10:08:33.006037+0000","last_active":"2024-04-25T10:08:35.028964+0000","last_peered":"2024-04-25T10:08:35.028964+0000","last_clean":"2024-04-25T10:08:35.028964+0000","last_became_active":"2024-04-25T10:08:33.005767+0000","last_became_peered":"2024-04-25T10:08:33.005767+0000","last_unstale":"2024-04-25T10:08:35.028964+0000","last_undegraded":"2024-04-25T10:08:35.028964+0000","last_fullsized":"2024-04-25T10:08:35.028964+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:53.277350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003398+0000","last_change":"2024-04-25T10:08:34.016727+0000","last_active":"2024-04-25T10:08:35.003398+0000","last_peered":"2024-04-25T10:08:35.003398+0000","last_clean":"2024-04-25T10:08:35.003398+0000","last_became_active":"2024-04-25T10:08:34.015906+0000","last_became_peered":"2024-04-25T10:08:34.015906+0000","last_unstale":"2024-04-25T10:08:35.003398+0000","last_undegraded":"2024-04-25T10:08:35.003398+0000","last_fullsized":"2024-04-25T10:08:35.003398+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:21.441345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031330+0000","last_change":"2024-04-25T10:08:32.995936+0000","last_active":"2024-04-25T10:08:35.031330+0000","last_peered":"2024-04-25T10:08:35.031330+0000","last_clean":"2024-04-25T10:08:35.031330+0000","last_became_active":"2024-04-25T10:08:32.995620+0000","last_became_peered":"2024-04-25T10:08:32.995620+0000","last_unstale":"2024-04-25T10:08:35.031330+0000","last_undegraded":"2024-04-25T10:08:35.031330+0000","last_fullsized":"2024-04-25T10:08:35.031330+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:10.564491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028864+0000","last_change":"2024-04-25T10:08:34.020243+0000","last_active":"2024-04-25T10:08:35.028864+0000","last_peered":"2024-04-25T10:08:35.028864+0000","last_clean":"2024-04-25T10:08:35.028864+0000","last_became_active":"2024-04-25T10:08:34.018667+0000","last_became_peered":"2024-04-25T10:08:34.018667+0000","last_unstale":"2024-04-25T10:08:35.028864+0000","last_undegraded":"2024-04-25T10:08:35.028864+0000","last_fullsized":"2024-04-25T10:08:35.028864+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:08.399465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418223+0000","last_change":"2024-04-25T10:08:33.014183+0000","last_active":"2024-04-25T10:08:35.418223+0000","last_peered":"2024-04-25T10:08:35.418223+0000","last_clean":"2024-04-25T10:08:35.418223+0000","last_became_active":"2024-04-25T10:08:33.013867+0000","last_became_peered":"2024-04-25T10:08:33.013867+0000","last_unstale":"2024-04-25T10:08:35.418223+0000","last_undegraded":"2024-04-25T10:08:35.418223+0000","last_fullsized":"2024-04-25T10:08:35.418223+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:57.034900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417620+0000","last_change":"2024-04-25T10:08:34.028808+0000","last_active":"2024-04-25T10:08:35.417620+0000","last_peered":"2024-04-25T10:08:35.417620+0000","last_clean":"2024-04-25T10:08:35.417620+0000","last_became_active":"2024-04-25T10:08:34.028400+0000","last_became_peered":"2024-04-25T10:08:34.028400+0000","last_unstale":"2024-04-25T10:08:35.417620+0000","last_undegraded":"2024-04-25T10:08:35.417620+0000","last_fullsized":"2024-04-25T10:08:35.417620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:08.077100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418053+0000","last_change":"2024-04-25T10:08:33.007771+0000","last_active":"2024-04-25T10:08:35.418053+0000","last_peered":"2024-04-25T10:08:35.418053+0000","last_clean":"2024-04-25T10:08:35.418053+0000","last_became_active":"2024-04-25T10:08:33.006885+0000","last_became_peered":"2024-04-25T10:08:33.006885+0000","last_unstale":"2024-04-25T10:08:35.418053+0000","last_undegraded":"2024-04-25T10:08:35.418053+0000","last_fullsized":"2024-04-25T10:08:35.418053+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:35.003598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181241+0000","last_change":"2024-04-25T10:08:34.018486+0000","last_active":"2024-04-25T10:08:35.181241+0000","last_peered":"2024-04-25T10:08:35.181241+0000","last_clean":"2024-04-25T10:08:35.181241+0000","last_became_active":"2024-04-25T10:08:34.017970+0000","last_became_peered":"2024-04-25T10:08:34.017970+0000","last_unstale":"2024-04-25T10:08:35.181241+0000","last_undegraded":"2024-04-25T10:08:35.181241+0000","last_fullsized":"2024-04-25T10:08:35.181241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:55.028353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"80'3","reported_seq":17,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031943+0000","last_change":"2024-04-25T10:08:33.000784+0000","last_active":"2024-04-25T10:08:35.031943+0000","last_peered":"2024-04-25T10:08:35.031943+0000","last_clean":"2024-04-25T10:08:35.031943+0000","last_became_active":"2024-04-25T10:08:33.000487+0000","last_became_peered":"2024-04-25T10:08:33.000487+0000","last_unstale":"2024-04-25T10:08:35.031943+0000","last_undegraded":"2024-04-25T10:08:35.031943+0000","last_fullsized":"2024-04-25T10:08:35.031943+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:16:01.990140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999011+0000","last_change":"2024-04-25T10:08:34.024469+0000","last_active":"2024-04-25T10:08:34.999011+0000","last_peered":"2024-04-25T10:08:34.999011+0000","last_clean":"2024-04-25T10:08:34.999011+0000","last_became_active":"2024-04-25T10:08:34.024156+0000","last_became_peered":"2024-04-25T10:08:34.024156+0000","last_unstale":"2024-04-25T10:08:34.999011+0000","last_undegraded":"2024-04-25T10:08:34.999011+0000","last_fullsized":"2024-04-25T10:08:34.999011+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"80'6","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002997+0000","last_change":"2024-04-25T10:08:32.998633+0000","last_active":"2024-04-25T10:08:35.002997+0000","last_peered":"2024-04-25T10:08:35.002997+0000","last_clean":"2024-04-25T10:08:35.002997+0000","last_became_active":"2024-04-25T10:08:32.998332+0000","last_became_peered":"2024-04-25T10:08:32.998332+0000","last_unstale":"2024-04-25T10:08:35.002997+0000","last_undegraded":"2024-04-25T10:08:35.002997+0000","last_fullsized":"2024-04-25T10:08:35.002997+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:10.565742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418289+0000","last_change":"2024-04-25T10:08:34.034644+0000","last_active":"2024-04-25T10:08:35.418289+0000","last_peered":"2024-04-25T10:08:35.418289+0000","last_clean":"2024-04-25T10:08:35.418289+0000","last_became_active":"2024-04-25T10:08:34.034203+0000","last_became_peered":"2024-04-25T10:08:34.034203+0000","last_unstale":"2024-04-25T10:08:35.418289+0000","last_undegraded":"2024-04-25T10:08:35.418289+0000","last_fullsized":"2024-04-25T10:08:35.418289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:12.304014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417453+0000","last_change":"2024-04-25T10:08:33.006611+0000","last_active":"2024-04-25T10:08:35.417453+0000","last_peered":"2024-04-25T10:08:35.417453+0000","last_clean":"2024-04-25T10:08:35.417453+0000","last_became_active":"2024-04-25T10:08:33.006152+0000","last_became_peered":"2024-04-25T10:08:33.006152+0000","last_unstale":"2024-04-25T10:08:35.417453+0000","last_undegraded":"2024-04-25T10:08:35.417453+0000","last_fullsized":"2024-04-25T10:08:35.417453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:45.021233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002728+0000","last_change":"2024-04-25T10:08:34.009911+0000","last_active":"2024-04-25T10:08:35.002728+0000","last_peered":"2024-04-25T10:08:35.002728+0000","last_clean":"2024-04-25T10:08:35.002728+0000","last_became_active":"2024-04-25T10:08:34.009524+0000","last_became_peered":"2024-04-25T10:08:34.009524+0000","last_unstale":"2024-04-25T10:08:35.002728+0000","last_undegraded":"2024-04-25T10:08:35.002728+0000","last_fullsized":"2024-04-25T10:08:35.002728+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:36.010197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417183+0000","last_change":"2024-04-25T10:08:33.010430+0000","last_active":"2024-04-25T10:08:35.417183+0000","last_peered":"2024-04-25T10:08:35.417183+0000","last_clean":"2024-04-25T10:08:35.417183+0000","last_became_active":"2024-04-25T10:08:33.010028+0000","last_became_peered":"2024-04-25T10:08:33.010028+0000","last_unstale":"2024-04-25T10:08:35.417183+0000","last_undegraded":"2024-04-25T10:08:35.417183+0000","last_fullsized":"2024-04-25T10:08:35.417183+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:35:20.434746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003117+0000","last_change":"2024-04-25T10:08:34.011806+0000","last_active":"2024-04-25T10:08:35.003117+0000","last_peered":"2024-04-25T10:08:35.003117+0000","last_clean":"2024-04-25T10:08:35.003117+0000","last_became_active":"2024-04-25T10:08:34.011521+0000","last_became_peered":"2024-04-25T10:08:34.011521+0000","last_unstale":"2024-04-25T10:08:35.003117+0000","last_undegraded":"2024-04-25T10:08:35.003117+0000","last_fullsized":"2024-04-25T10:08:35.003117+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:17.128077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031412+0000","last_change":"2024-04-25T10:08:33.000541+0000","last_active":"2024-04-25T10:08:35.031412+0000","last_peered":"2024-04-25T10:08:35.031412+0000","last_clean":"2024-04-25T10:08:35.031412+0000","last_became_active":"2024-04-25T10:08:33.000156+0000","last_became_peered":"2024-04-25T10:08:33.000156+0000","last_unstale":"2024-04-25T10:08:35.031412+0000","last_undegraded":"2024-04-25T10:08:35.031412+0000","last_fullsized":"2024-04-25T10:08:35.031412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:05.087355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003597+0000","last_change":"2024-04-25T10:08:34.016943+0000","last_active":"2024-04-25T10:08:35.003597+0000","last_peered":"2024-04-25T10:08:35.003597+0000","last_clean":"2024-04-25T10:08:35.003597+0000","last_became_active":"2024-04-25T10:08:34.016354+0000","last_became_peered":"2024-04-25T10:08:34.016354+0000","last_unstale":"2024-04-25T10:08:35.003597+0000","last_undegraded":"2024-04-25T10:08:35.003597+0000","last_fullsized":"2024-04-25T10:08:35.003597+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:58.041499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"80'8","reported_seq":22,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.028931+0000","last_change":"2024-04-25T10:08:33.001887+0000","last_active":"2024-04-25T10:08:35.028931+0000","last_peered":"2024-04-25T10:08:35.028931+0000","last_clean":"2024-04-25T10:08:35.028931+0000","last_became_active":"2024-04-25T10:08:33.001619+0000","last_became_peered":"2024-04-25T10:08:33.001619+0000","last_unstale":"2024-04-25T10:08:35.028931+0000","last_undegraded":"2024-04-25T10:08:35.028931+0000","last_fullsized":"2024-04-25T10:08:35.028931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:50.189417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181121+0000","last_change":"2024-04-25T10:08:34.013029+0000","last_active":"2024-04-25T10:08:35.181121+0000","last_peered":"2024-04-25T10:08:35.181121+0000","last_clean":"2024-04-25T10:08:35.181121+0000","last_became_active":"2024-04-25T10:08:34.012708+0000","last_became_peered":"2024-04-25T10:08:34.012708+0000","last_unstale":"2024-04-25T10:08:35.181121+0000","last_undegraded":"2024-04-25T10:08:35.181121+0000","last_fullsized":"2024-04-25T10:08:35.181121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:42.705920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418315+0000","last_change":"2024-04-25T10:08:33.011663+0000","last_active":"2024-04-25T10:08:35.418315+0000","last_peered":"2024-04-25T10:08:35.418315+0000","last_clean":"2024-04-25T10:08:35.418315+0000","last_became_active":"2024-04-25T10:08:33.011338+0000","last_became_peered":"2024-04-25T10:08:33.011338+0000","last_unstale":"2024-04-25T10:08:35.418315+0000","last_undegraded":"2024-04-25T10:08:35.418315+0000","last_fullsized":"2024-04-25T10:08:35.418315+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:16.221935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031552+0000","last_change":"2024-04-25T10:08:34.012127+0000","last_active":"2024-04-25T10:08:35.031552+0000","last_peered":"2024-04-25T10:08:35.031552+0000","last_clean":"2024-04-25T10:08:35.031552+0000","last_became_active":"2024-04-25T10:08:34.011736+0000","last_became_peered":"2024-04-25T10:08:34.011736+0000","last_unstale":"2024-04-25T10:08:35.031552+0000","last_undegraded":"2024-04-25T10:08:35.031552+0000","last_fullsized":"2024-04-25T10:08:35.031552+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:16.153141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003914+0000","last_change":"2024-04-25T10:08:33.003042+0000","last_active":"2024-04-25T10:08:35.003914+0000","last_peered":"2024-04-25T10:08:35.003914+0000","last_clean":"2024-04-25T10:08:35.003914+0000","last_became_active":"2024-04-25T10:08:33.002788+0000","last_became_peered":"2024-04-25T10:08:33.002788+0000","last_unstale":"2024-04-25T10:08:35.003914+0000","last_undegraded":"2024-04-25T10:08:35.003914+0000","last_fullsized":"2024-04-25T10:08:35.003914+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:53.078009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031642+0000","last_change":"2024-04-25T10:08:34.019681+0000","last_active":"2024-04-25T10:08:35.031642+0000","last_peered":"2024-04-25T10:08:35.031642+0000","last_clean":"2024-04-25T10:08:35.031642+0000","last_became_active":"2024-04-25T10:08:34.019409+0000","last_became_peered":"2024-04-25T10:08:34.019409+0000","last_unstale":"2024-04-25T10:08:35.031642+0000","last_undegraded":"2024-04-25T10:08:35.031642+0000","last_fullsized":"2024-04-25T10:08:35.031642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:04.389178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"80'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031975+0000","last_change":"2024-04-25T10:08:32.997942+0000","last_active":"2024-04-25T10:08:35.031975+0000","last_peered":"2024-04-25T10:08:35.031975+0000","last_clean":"2024-04-25T10:08:35.031975+0000","last_became_active":"2024-04-25T10:08:32.995849+0000","last_became_peered":"2024-04-25T10:08:32.995849+0000","last_unstale":"2024-04-25T10:08:35.031975+0000","last_undegraded":"2024-04-25T10:08:35.031975+0000","last_fullsized":"2024-04-25T10:08:35.031975+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:58:13.109114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181067+0000","last_change":"2024-04-25T10:08:34.013039+0000","last_active":"2024-04-25T10:08:35.181067+0000","last_peered":"2024-04-25T10:08:35.181067+0000","last_clean":"2024-04-25T10:08:35.181067+0000","last_became_active":"2024-04-25T10:08:34.012743+0000","last_became_peered":"2024-04-25T10:08:34.012743+0000","last_unstale":"2024-04-25T10:08:35.181067+0000","last_undegraded":"2024-04-25T10:08:35.181067+0000","last_fullsized":"2024-04-25T10:08:35.181067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:10.438643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998886+0000","last_change":"2024-04-25T10:08:33.004697+0000","last_active":"2024-04-25T10:08:34.998886+0000","last_peered":"2024-04-25T10:08:34.998886+0000","last_clean":"2024-04-25T10:08:34.998886+0000","last_became_active":"2024-04-25T10:08:33.004438+0000","last_became_peered":"2024-04-25T10:08:33.004438+0000","last_unstale":"2024-04-25T10:08:34.998886+0000","last_undegraded":"2024-04-25T10:08:34.998886+0000","last_fullsized":"2024-04-25T10:08:34.998886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:27.604762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029208+0000","last_change":"2024-04-25T10:08:34.030460+0000","last_active":"2024-04-25T10:08:35.029208+0000","last_peered":"2024-04-25T10:08:35.029208+0000","last_clean":"2024-04-25T10:08:35.029208+0000","last_became_active":"2024-04-25T10:08:34.030192+0000","last_became_peered":"2024-04-25T10:08:34.030192+0000","last_unstale":"2024-04-25T10:08:35.029208+0000","last_undegraded":"2024-04-25T10:08:35.029208+0000","last_fullsized":"2024-04-25T10:08:35.029208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:43.931847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181123+0000","last_change":"2024-04-25T10:08:33.004926+0000","last_active":"2024-04-25T10:08:35.181123+0000","last_peered":"2024-04-25T10:08:35.181123+0000","last_clean":"2024-04-25T10:08:35.181123+0000","last_became_active":"2024-04-25T10:08:33.004583+0000","last_became_peered":"2024-04-25T10:08:33.004583+0000","last_unstale":"2024-04-25T10:08:35.181123+0000","last_undegraded":"2024-04-25T10:08:35.181123+0000","last_fullsized":"2024-04-25T10:08:35.181123+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:25.381134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029533+0000","last_change":"2024-04-25T10:08:34.016568+0000","last_active":"2024-04-25T10:08:35.029533+0000","last_peered":"2024-04-25T10:08:35.029533+0000","last_clean":"2024-04-25T10:08:35.029533+0000","last_became_active":"2024-04-25T10:08:34.016236+0000","last_became_peered":"2024-04-25T10:08:34.016236+0000","last_unstale":"2024-04-25T10:08:35.029533+0000","last_undegraded":"2024-04-25T10:08:35.029533+0000","last_fullsized":"2024-04-25T10:08:35.029533+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:23:54.046151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180870+0000","last_change":"2024-04-25T10:08:33.005091+0000","last_active":"2024-04-25T10:08:35.180870+0000","last_peered":"2024-04-25T10:08:35.180870+0000","last_clean":"2024-04-25T10:08:35.180870+0000","last_became_active":"2024-04-25T10:08:33.004551+0000","last_became_peered":"2024-04-25T10:08:33.004551+0000","last_unstale":"2024-04-25T10:08:35.180870+0000","last_undegraded":"2024-04-25T10:08:35.180870+0000","last_fullsized":"2024-04-25T10:08:35.180870+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:14:59.645120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003746+0000","last_change":"2024-04-25T10:08:34.027247+0000","last_active":"2024-04-25T10:08:35.003746+0000","last_peered":"2024-04-25T10:08:35.003746+0000","last_clean":"2024-04-25T10:08:35.003746+0000","last_became_active":"2024-04-25T10:08:34.026985+0000","last_became_peered":"2024-04-25T10:08:34.026985+0000","last_unstale":"2024-04-25T10:08:35.003746+0000","last_undegraded":"2024-04-25T10:08:35.003746+0000","last_fullsized":"2024-04-25T10:08:35.003746+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:17.228534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.180876+0000","last_change":"2024-04-25T10:08:33.003781+0000","last_active":"2024-04-25T10:08:35.180876+0000","last_peered":"2024-04-25T10:08:35.180876+0000","last_clean":"2024-04-25T10:08:35.180876+0000","last_became_active":"2024-04-25T10:08:33.003489+0000","last_became_peered":"2024-04-25T10:08:33.003489+0000","last_unstale":"2024-04-25T10:08:35.180876+0000","last_undegraded":"2024-04-25T10:08:35.180876+0000","last_fullsized":"2024-04-25T10:08:35.180876+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:00.437969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003862+0000","last_change":"2024-04-25T10:08:34.013487+0000","last_active":"2024-04-25T10:08:35.003862+0000","last_peered":"2024-04-25T10:08:35.003862+0000","last_clean":"2024-04-25T10:08:35.003862+0000","last_became_active":"2024-04-25T10:08:34.013142+0000","last_became_peered":"2024-04-25T10:08:34.013142+0000","last_unstale":"2024-04-25T10:08:35.003862+0000","last_undegraded":"2024-04-25T10:08:35.003862+0000","last_fullsized":"2024-04-25T10:08:35.003862+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:15.678682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"80'2","reported_seq":16,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417472+0000","last_change":"2024-04-25T10:08:33.008642+0000","last_active":"2024-04-25T10:08:35.417472+0000","last_peered":"2024-04-25T10:08:35.417472+0000","last_clean":"2024-04-25T10:08:35.417472+0000","last_became_active":"2024-04-25T10:08:33.008355+0000","last_became_peered":"2024-04-25T10:08:33.008355+0000","last_unstale":"2024-04-25T10:08:35.417472+0000","last_undegraded":"2024-04-25T10:08:35.417472+0000","last_fullsized":"2024-04-25T10:08:35.417472+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:12:24.713433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002919+0000","last_change":"2024-04-25T10:08:34.019194+0000","last_active":"2024-04-25T10:08:35.002919+0000","last_peered":"2024-04-25T10:08:35.002919+0000","last_clean":"2024-04-25T10:08:35.002919+0000","last_became_active":"2024-04-25T10:08:34.016299+0000","last_became_peered":"2024-04-25T10:08:34.016299+0000","last_unstale":"2024-04-25T10:08:35.002919+0000","last_undegraded":"2024-04-25T10:08:35.002919+0000","last_fullsized":"2024-04-25T10:08:35.002919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"81'1","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029589+0000","last_change":"2024-04-25T10:08:33.003130+0000","last_active":"2024-04-25T10:08:35.029589+0000","last_peered":"2024-04-25T10:08:35.029589+0000","last_clean":"2024-04-25T10:08:35.029589+0000","last_became_active":"2024-04-25T10:08:33.002868+0000","last_became_peered":"2024-04-25T10:08:33.002868+0000","last_unstale":"2024-04-25T10:08:35.029589+0000","last_undegraded":"2024-04-25T10:08:35.029589+0000","last_fullsized":"2024-04-25T10:08:35.029589+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:07.070501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003897+0000","last_change":"2024-04-25T10:08:34.029747+0000","last_active":"2024-04-25T10:08:35.003897+0000","last_peered":"2024-04-25T10:08:35.003897+0000","last_clean":"2024-04-25T10:08:35.003897+0000","last_became_active":"2024-04-25T10:08:34.029436+0000","last_became_peered":"2024-04-25T10:08:34.029436+0000","last_unstale":"2024-04-25T10:08:35.003897+0000","last_undegraded":"2024-04-25T10:08:35.003897+0000","last_fullsized":"2024-04-25T10:08:35.003897+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:19:46.027832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.418049+0000","last_change":"2024-04-25T10:08:33.010326+0000","last_active":"2024-04-25T10:08:35.418049+0000","last_peered":"2024-04-25T10:08:35.418049+0000","last_clean":"2024-04-25T10:08:35.418049+0000","last_became_active":"2024-04-25T10:08:33.010037+0000","last_became_peered":"2024-04-25T10:08:33.010037+0000","last_unstale":"2024-04-25T10:08:35.418049+0000","last_undegraded":"2024-04-25T10:08:35.418049+0000","last_fullsized":"2024-04-25T10:08:35.418049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:17.019427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.029213+0000","last_change":"2024-04-25T10:08:34.017218+0000","last_active":"2024-04-25T10:08:35.029213+0000","last_peered":"2024-04-25T10:08:35.029213+0000","last_clean":"2024-04-25T10:08:35.029213+0000","last_became_active":"2024-04-25T10:08:34.016156+0000","last_became_peered":"2024-04-25T10:08:34.016156+0000","last_unstale":"2024-04-25T10:08:35.029213+0000","last_undegraded":"2024-04-25T10:08:35.029213+0000","last_fullsized":"2024-04-25T10:08:35.029213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:22.115314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417678+0000","last_change":"2024-04-25T10:08:33.014162+0000","last_active":"2024-04-25T10:08:35.417678+0000","last_peered":"2024-04-25T10:08:35.417678+0000","last_clean":"2024-04-25T10:08:35.417678+0000","last_became_active":"2024-04-25T10:08:33.013858+0000","last_became_peered":"2024-04-25T10:08:33.013858+0000","last_unstale":"2024-04-25T10:08:35.417678+0000","last_undegraded":"2024-04-25T10:08:35.417678+0000","last_fullsized":"2024-04-25T10:08:35.417678+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:20.305622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003074+0000","last_change":"2024-04-25T10:08:34.016197+0000","last_active":"2024-04-25T10:08:35.003074+0000","last_peered":"2024-04-25T10:08:35.003074+0000","last_clean":"2024-04-25T10:08:35.003074+0000","last_became_active":"2024-04-25T10:08:34.015896+0000","last_became_peered":"2024-04-25T10:08:34.015896+0000","last_unstale":"2024-04-25T10:08:35.003074+0000","last_undegraded":"2024-04-25T10:08:35.003074+0000","last_fullsized":"2024-04-25T10:08:35.003074+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002696+0000","last_change":"2024-04-25T10:08:33.007116+0000","last_active":"2024-04-25T10:08:35.002696+0000","last_peered":"2024-04-25T10:08:35.002696+0000","last_clean":"2024-04-25T10:08:35.002696+0000","last_became_active":"2024-04-25T10:08:33.006840+0000","last_became_peered":"2024-04-25T10:08:33.006840+0000","last_unstale":"2024-04-25T10:08:35.002696+0000","last_undegraded":"2024-04-25T10:08:35.002696+0000","last_fullsized":"2024-04-25T10:08:35.002696+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.002874+0000","last_change":"2024-04-25T10:08:34.017288+0000","last_active":"2024-04-25T10:08:35.002874+0000","last_peered":"2024-04-25T10:08:35.002874+0000","last_clean":"2024-04-25T10:08:35.002874+0000","last_became_active":"2024-04-25T10:08:34.015490+0000","last_became_peered":"2024-04-25T10:08:34.015490+0000","last_unstale":"2024-04-25T10:08:35.002874+0000","last_undegraded":"2024-04-25T10:08:35.002874+0000","last_fullsized":"2024-04-25T10:08:35.002874+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:03.990389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.031588+0000","last_change":"2024-04-25T10:08:33.003506+0000","last_active":"2024-04-25T10:08:35.031588+0000","last_peered":"2024-04-25T10:08:35.031588+0000","last_clean":"2024-04-25T10:08:35.031588+0000","last_became_active":"2024-04-25T10:08:33.003077+0000","last_became_peered":"2024-04-25T10:08:33.003077+0000","last_unstale":"2024-04-25T10:08:35.031588+0000","last_undegraded":"2024-04-25T10:08:35.031588+0000","last_fullsized":"2024-04-25T10:08:35.031588+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:03:44.875235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999250+0000","last_change":"2024-04-25T10:08:34.018059+0000","last_active":"2024-04-25T10:08:34.999250+0000","last_peered":"2024-04-25T10:08:34.999250+0000","last_clean":"2024-04-25T10:08:34.999250+0000","last_became_active":"2024-04-25T10:08:34.017761+0000","last_became_peered":"2024-04-25T10:08:34.017761+0000","last_unstale":"2024-04-25T10:08:34.999250+0000","last_undegraded":"2024-04-25T10:08:34.999250+0000","last_fullsized":"2024-04-25T10:08:34.999250+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:18.026027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.003210+0000","last_change":"2024-04-25T10:08:33.004709+0000","last_active":"2024-04-25T10:08:35.003210+0000","last_peered":"2024-04-25T10:08:35.003210+0000","last_clean":"2024-04-25T10:08:35.003210+0000","last_became_active":"2024-04-25T10:08:33.004382+0000","last_became_peered":"2024-04-25T10:08:33.004382+0000","last_unstale":"2024-04-25T10:08:35.003210+0000","last_undegraded":"2024-04-25T10:08:35.003210+0000","last_fullsized":"2024-04-25T10:08:35.003210+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:47.606636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.999464+0000","last_change":"2024-04-25T10:08:34.013883+0000","last_active":"2024-04-25T10:08:34.999464+0000","last_peered":"2024-04-25T10:08:34.999464+0000","last_clean":"2024-04-25T10:08:34.999464+0000","last_became_active":"2024-04-25T10:08:34.013586+0000","last_became_peered":"2024-04-25T10:08:34.013586+0000","last_unstale":"2024-04-25T10:08:34.999464+0000","last_undegraded":"2024-04-25T10:08:34.999464+0000","last_fullsized":"2024-04-25T10:08:34.999464+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:21.312222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:34.998609+0000","last_change":"2024-04-25T10:08:33.000919+0000","last_active":"2024-04-25T10:08:34.998609+0000","last_peered":"2024-04-25T10:08:34.998609+0000","last_clean":"2024-04-25T10:08:34.998609+0000","last_became_active":"2024-04-25T10:08:33.000597+0000","last_became_peered":"2024-04-25T10:08:33.000597+0000","last_unstale":"2024-04-25T10:08:34.998609+0000","last_undegraded":"2024-04-25T10:08:34.998609+0000","last_fullsized":"2024-04-25T10:08:34.998609+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:36.642255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417885+0000","last_change":"2024-04-25T10:08:34.022918+0000","last_active":"2024-04-25T10:08:35.417885+0000","last_peered":"2024-04-25T10:08:35.417885+0000","last_clean":"2024-04-25T10:08:35.417885+0000","last_became_active":"2024-04-25T10:08:34.022412+0000","last_became_peered":"2024-04-25T10:08:34.022412+0000","last_unstale":"2024-04-25T10:08:35.417885+0000","last_undegraded":"2024-04-25T10:08:35.417885+0000","last_fullsized":"2024-04-25T10:08:35.417885+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:32.976611+0000","last_clean_scrub_stamp":"2024-04-25T10:08:32.976611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:11.009423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.181278+0000","last_change":"2024-04-25T10:08:33.004372+0000","last_active":"2024-04-25T10:08:35.181278+0000","last_peered":"2024-04-25T10:08:35.181278+0000","last_clean":"2024-04-25T10:08:35.181278+0000","last_became_active":"2024-04-25T10:08:33.003174+0000","last_became_peered":"2024-04-25T10:08:33.003174+0000","last_unstale":"2024-04-25T10:08:35.181278+0000","last_undegraded":"2024-04-25T10:08:35.181278+0000","last_fullsized":"2024-04-25T10:08:35.181278+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:08:31.970012+0000","last_clean_scrub_stamp":"2024-04-25T10:08:31.970012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:52.656400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-25T10:08:35.417882+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:08:35.417882+0000","last_peered":"2024-04-25T10:08:35.417882+0000","last_clean":"2024-04-25T10:08:35.417882+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:08:35.417882+0000","last_undegraded":"2024-04-25T10:08:35.417882+0000","last_fullsized":"2024-04-25T10:08:35.417882+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1040980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509504,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":452202,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":450624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1003520,"data_stored":452306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542207,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":451172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542205,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":995328,"data_stored":451332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542207,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":991232,"data_stored":450702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542205,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1040958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:08:43.109 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:08:43.109 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:08:43.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.286+0000 7fed96400640 1 Processor -- start 2024-04-25T10:08:43.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.286+0000 7fed96400640 1 -- start start 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed96400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed9015c9b0 0x7fed9006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed96400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9015fc00 con 0x7fed9006e010 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed96400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9015fee0 con 0x7fed90159320 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed96400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9006d640 con 0x7fed9015c9b0 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fed9006e010 0x7fed9006e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46476/0 (socket says 172.21.15.18:46476) 2024-04-25T10:08:43.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8fe00640 1 -- 172.21.15.18:0/3450333197 learned_addr learned my addr 172.21.15.18:0/3450333197 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 --2- 172.21.15.18:0/3450333197 >> v2:172.21.15.167:3300/0 conn(0x7fed9015c9b0 0x7fed9006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2813493926 0 0) 0x7fed9015fc00 con 0x7fed9006e010 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed74003530 con 0x7fed9006e010 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509593128 0 0) 0x7fed74003530 con 0x7fed9006e010 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 >> v2:172.21.15.167:3300/0 conn(0x7fed9015c9b0 msgr2=0x7fed9006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 --2- 172.21.15.18:0/3450333197 >> v2:172.21.15.167:3300/0 conn(0x7fed9015c9b0 0x7fed9006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 >> v1:172.21.15.167:6789/0 conn(0x7fed90159320 legacy=0x7fed9015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed901601c0 con 0x7fed9006e010 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fed88001a00 con 0x7fed9006e010 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 >> v1:172.21.15.18:6789/0 conn(0x7fed9006e010 legacy=0x7fed9006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74003a10 0x7fed74003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 0x7fed74004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740051d0 0x7fed7400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006d640 con 0x7fed74004810 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400c0d0 con 0x7fed74003a10 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7400c2d0 con 0x7fed740051d0 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 0x7fed74004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8f400640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74003a10 0x7fed74003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8fe00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740051d0 0x7fed7400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 -- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740051d0 msgr2=0x7fed7400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740051d0 0x7fed7400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 -- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74003a10 msgr2=0x7fed74003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed74003a10 0x7fed74003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed87e00640 1 -- 172.21.15.18:0/3450333197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74003530 con 0x7fed74004810 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8fe00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740051d0 0x7fed7400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.290+0000 7fed8fe00640 1 -- 172.21.15.18:0/3450333197 reap_dead start 2024-04-25T10:08:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed87e00640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 0x7fed74004c90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fed78009ae0 tx=0x7fed7801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4178dd3546235a13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780b2070 con 0x7fed74004810 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed780a5550 con 0x7fed74004810 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed8ea00640 1 -- 172.21.15.18:0/3450333197 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed780096b0 con 0x7fed74004810 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 msgr2=0x7fed74004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 0x7fed74004c90 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fed78009ae0 tx=0x7fed7801ca70 comp rx=0 tx=0).stop 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- 172.21.15.18:0/3450333197 shutdown_connections 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 --2- 172.21.15.18:0/3450333197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74004810 0x7fed74004c90 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- 172.21.15.18:0/3450333197 >> 172.21.15.18:0/3450333197 conn(0x7fed90067080 msgr2=0x7fed9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- 172.21.15.18:0/3450333197 shutdown_connections 2024-04-25T10:08:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- 172.21.15.18:0/3450333197 wait complete. 2024-04-25T10:08:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 Processor -- start 2024-04-25T10:08:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.294+0000 7fed96400640 1 -- start start 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 0x7fed90133990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed900b2660 0x7fed900b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006dad0 con 0x7fed900b06f0 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90159700 con 0x7fed900b2660 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9006dc50 con 0x7fed74004810 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52418/0 (socket says 172.21.15.18:52418) 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 -- 172.21.15.18:0/1525071598 learned_addr learned my addr 172.21.15.18:0/1525071598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed87e00640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed900b2660 0x7fed900b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8f400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 0x7fed90133990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 -- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 msgr2=0x7fed90133990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 0x7fed90133990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 -- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed900b2660 msgr2=0x7fed900b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed900b2660 0x7fed900b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 -- 172.21.15.18:0/1525071598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900b3340 con 0x7fed900b06f0 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8f400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 0x7fed90133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed8fe00640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fed900aeed0 tx=0x7fed880119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88010040 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8801a070 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed88013a20 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed900b3620 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed900b3be0 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900745d0 con 0x7fed900b06f0 2024-04-25T10:08:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.298+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed88013bc0 con 0x7fed900b06f0 2024-04-25T10:08:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.302+0000 7fed87400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 0x7fed6c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.302+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fed88087f60 con 0x7fed900b06f0 2024-04-25T10:08:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.302+0000 7fed8f400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 0x7fed6c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.302+0000 7fed8f400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 0x7fed6c069450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed900cc150 tx=0x7fed80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.306+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed88058dd0 con 0x7fed900b06f0 2024-04-25T10:08:43.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.522+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fed9006acb0 con 0x7fed900b06f0 2024-04-25T10:08:43.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.526+0000 7fed87400640 1 -- 172.21.15.18:0/1525071598 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fed880586d0 con 0x7fed900b06f0 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:08:43.535 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:08:43.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 msgr2=0x7fed6c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 0x7fed6c069450 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed900cc150 tx=0x7fed80009040 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 msgr2=0x7fed900b0b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fed900aeed0 tx=0x7fed880119f0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 shutdown_connections 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed900b06f0 0x7fed900b0b50 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed900b2660 0x7fed900b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed6c066f90 0x7fed6c069450 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 --2- 172.21.15.18:0/1525071598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed74004810 0x7fed90133990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 >> 172.21.15.18:0/1525071598 conn(0x7fed90067080 msgr2=0x7fed90071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 shutdown_connections 2024-04-25T10:08:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.530+0000 7fed96400640 1 -- 172.21.15.18:0/1525071598 wait complete. 2024-04-25T10:08:43.557 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:43.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 Processor -- start 2024-04-25T10:08:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 -- start start 2024-04-25T10:08:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38d4145270 0x7f38d415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d40cd4d0 0x7f38d40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d40b1750 0x7f38d40b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d40b20e0 con 0x7f38d40b1750 2024-04-25T10:08:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d4145650 con 0x7f38d4145270 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38dc600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d40cc4e0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d40b1750 0x7f38d40b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38d40b1750 0x7f38d40b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52424/0 (socket says 172.21.15.18:52424) 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 -- 172.21.15.18:0/3919150541 learned_addr learned my addr 172.21.15.18:0/3919150541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38d9c00640 1 --2- 172.21.15.18:0/3919150541 >> v2:172.21.15.167:3300/0 conn(0x7f38d4145270 0x7f38d415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38d9200640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d40cd4d0 0x7f38d40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 -- 172.21.15.18:0/3919150541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d40cd4d0 msgr2=0x7f38d40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d40cd4d0 0x7f38d40cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 -- 172.21.15.18:0/3919150541 >> v2:172.21.15.167:3300/0 conn(0x7f38d4145270 msgr2=0x7f38d415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 --2- 172.21.15.18:0/3919150541 >> v2:172.21.15.167:3300/0 conn(0x7f38d4145270 0x7f38d415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.690+0000 7f38da600640 1 -- 172.21.15.18:0/3919150541 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40ce040 con 0x7f38d40b1750 2024-04-25T10:08:43.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38da600640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40b1750 0x7f38d40b1ba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f38d406f3a0 tx=0x7f38cc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46ccd4994835e21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38d3e00640 1 -- 172.21.15.18:0/3919150541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0a5760 con 0x7f38d40b1750 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38d3e00640 1 -- 172.21.15.18:0/3919150541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0a5900 con 0x7f38d40b1750 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38d3e00640 1 -- 172.21.15.18:0/3919150541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0a5cd0 con 0x7f38d40b1750 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 -- 172.21.15.18:0/3919150541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40b1750 msgr2=0x7f38d40b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40b1750 0x7f38d40b1ba0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f38d406f3a0 tx=0x7f38cc01c9f0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 -- 172.21.15.18:0/3919150541 shutdown_connections 2024-04-25T10:08:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40b1750 0x7f38d40b1ba0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 --2- 172.21.15.18:0/3919150541 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d40cd4d0 0x7f38d40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 --2- 172.21.15.18:0/3919150541 >> v2:172.21.15.167:3300/0 conn(0x7f38d4145270 0x7f38d415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 -- 172.21.15.18:0/3919150541 >> 172.21.15.18:0/3919150541 conn(0x7f38d4066fa0 msgr2=0x7f38d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 -- 172.21.15.18:0/3919150541 shutdown_connections 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.694+0000 7f38dc600640 1 -- 172.21.15.18:0/3919150541 wait complete. 2024-04-25T10:08:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 Processor -- start 2024-04-25T10:08:43.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- start start 2024-04-25T10:08:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d40b1750 0x7f38d41f6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d4145270 0x7f38d413cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415c590 con 0x7f38d40cd4d0 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415f930 con 0x7f38d40b1750 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d415c710 con 0x7f38d4145270 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52426/0 (socket says 172.21.15.18:52426) 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 -- 172.21.15.18:0/3714098420 learned_addr learned my addr 172.21.15.18:0/3714098420 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9c00640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d40b1750 0x7f38d41f6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38da600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d4145270 0x7f38d413cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 -- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d4145270 msgr2=0x7f38d413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d4145270 0x7f38d413cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 -- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d40b1750 msgr2=0x7f38d41f6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d40b1750 0x7f38d41f6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 -- 172.21.15.18:0/3714098420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d413d950 con 0x7f38d40cd4d0 2024-04-25T10:08:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d9200640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f38c000d800 tx=0x7f38c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0018020 con 0x7f38d40cd4d0 2024-04-25T10:08:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c00096a0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c0009a50 con 0x7f38d40cd4d0 2024-04-25T10:08:43.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41401e0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d41407a0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.698+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d40745d0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.702+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f38c001b020 con 0x7f38d40cd4d0 2024-04-25T10:08:43.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.702+0000 7f38d1600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:43.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.702+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f38c00856d0 con 0x7f38d40cd4d0 2024-04-25T10:08:43.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.702+0000 7f38d9c00640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:43.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.702+0000 7f38d9c00640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 0x7f38b4069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f38c80079c0 tx=0x7f38c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:43.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.706+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38c0022020 con 0x7f38d40cd4d0 2024-04-25T10:08:43.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.902+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38d4142410 con 0x7f38d40cd4d0 2024-04-25T10:08:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38d1600640 1 -- 172.21.15.18:0/3714098420 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f38c005ae20 con 0x7f38d40cd4d0 2024-04-25T10:08:43.913 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:43.913 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:36.421005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35843":{"gid":35843,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/301895266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":301895266},{"type":"v1","addr":"172.21.15.18:6835","nonce":301895266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:43.913 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 46 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 msgr2=0x7f38b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 0x7f38b4069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f38c80079c0 tx=0x7f38c8008040 comp rx=0 tx=0).stop 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 msgr2=0x7f38d415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f38c000d800 tx=0x7f38c000dcc0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 shutdown_connections 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38b4066f60 0x7f38b4069420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38d4145270 0x7f38d413cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38d40cd4d0 0x7f38d415adf0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 --2- 172.21.15.18:0/3714098420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38d40b1750 0x7f38d41f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 >> 172.21.15.18:0/3714098420 conn(0x7f38d4066fa0 msgr2=0x7f38d40ae280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 shutdown_connections 2024-04-25T10:08:43.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:43.906+0000 7f38dc600640 1 -- 172.21.15.18:0/3714098420 wait complete. 2024-04-25T10:08:44.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:08:33.379806+0000', 'modified': '2024-04-25T10:08:36.421005+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 35843}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_35843': {'gid': 35843, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/301895266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 301895266}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 301895266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:08:44.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:08:44.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:08:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 Processor -- start 2024-04-25T10:08:44.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 -- start start 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 0x7f81e406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f81e406e010 0x7f81e406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e415fc00 con 0x7f81e4159320 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e406d640 con 0x7f81e406e010 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81eac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e415fee0 con 0x7f81e415c9b0 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f81e4159320 0x7f81e415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46478/0 (socket says 172.21.15.18:46478) 2024-04-25T10:08:44.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 -- 172.21.15.18:0/19775519 learned_addr learned my addr 172.21.15.18:0/19775519 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:44.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e8c00640 1 --2- 172.21.15.18:0/19775519 >> v2:172.21.15.167:3300/0 conn(0x7f81e406e010 0x7f81e406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3400640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 0x7f81e406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285694685 0 0) 0x7f81e415fc00 con 0x7f81e4159320 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003530 con 0x7f81e4159320 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205779845 0 0) 0x7f81c8003530 con 0x7f81e4159320 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 msgr2=0x7f81e406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 0x7f81e406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 >> v2:172.21.15.167:3300/0 conn(0x7f81e406e010 msgr2=0x7f81e406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 --2- 172.21.15.18:0/19775519 >> v2:172.21.15.167:3300/0 conn(0x7f81e406e010 0x7f81e406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e41601c0 con 0x7f81e4159320 2024-04-25T10:08:44.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f81d4001680 con 0x7f81e4159320 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 >> v1:172.21.15.18:6789/0 conn(0x7f81e4159320 legacy=0x7f81e415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81c80039c0 0x7f81c8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c8004810 0x7f81c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 0x7f81c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e406d640 con 0x7f81c80039c0 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e415fee0 con 0x7f81c8004810 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800b9d0 con 0x7f81e415c9b0 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e8c00640 1 --2- 172.21.15.18:0/19775519 >> v2:172.21.15.167:3300/0 conn(0x7f81e406e010 0x7f81e406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81c80039c0 0x7f81c8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 -- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 msgr2=0x7f81c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81e415c9b0 0x7f81c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 -- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c8004810 msgr2=0x7f81c8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81c8004810 0x7f81c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.474+0000 7f81e3e00640 1 -- 172.21.15.18:0/19775519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003530 con 0x7f81c80039c0 2024-04-25T10:08:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81e3e00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81c80039c0 0x7f81c8003de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c240 tx=0x7f81d401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5774fd4c25a7e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4007d40 con 0x7f81c80039c0 2024-04-25T10:08:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40a9020 con 0x7f81c80039c0 2024-04-25T10:08:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81e2a00640 1 -- 172.21.15.18:0/19775519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d4005ae0 con 0x7f81c80039c0 2024-04-25T10:08:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 -- 172.21.15.18:0/19775519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81c80039c0 msgr2=0x7f81c8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 --2- 172.21.15.18:0/19775519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81c80039c0 0x7f81c8003de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f81d400c240 tx=0x7f81d401cca0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81e8c00640 1 -- 172.21.15.18:0/19775519 reap_dead start 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 -- 172.21.15.18:0/19775519 shutdown_connections 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 -- 172.21.15.18:0/19775519 >> 172.21.15.18:0/19775519 conn(0x7f81e4067080 msgr2=0x7f81e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 -- 172.21.15.18:0/19775519 shutdown_connections 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.478+0000 7f81eac00640 1 -- 172.21.15.18:0/19775519 wait complete. 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 Processor -- start 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- start start 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 0x7f81e41fad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81e415e7e0 0x7f81e413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4166580 con 0x7f81e415e360 2024-04-25T10:08:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e406edf0 con 0x7f81e415e7e0 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4166700 con 0x7f81c80039c0 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52444/0 (socket says 172.21.15.18:52444) 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 -- 172.21.15.18:0/1824321250 learned_addr learned my addr 172.21.15.18:0/1824321250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 0x7f81e41fad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e8c00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81e415e7e0 0x7f81e413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 -- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 msgr2=0x7f81e41fad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 0x7f81e41fad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 -- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81e415e7e0 msgr2=0x7f81e413fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81e415e7e0 0x7f81e413fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 -- 172.21.15.18:0/1824321250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e4140670 con 0x7f81e415e360 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 0x7f81e41fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81e3400640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f81d000e7f0 tx=0x7f81d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81dbe00640 1 -- 172.21.15.18:0/1824321250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0017070 con 0x7f81e415e360 2024-04-25T10:08:44.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81dbe00640 1 -- 172.21.15.18:0/1824321250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d000c940 con 0x7f81e415e360 2024-04-25T10:08:44.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4140390 con 0x7f81e415e360 2024-04-25T10:08:44.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81dbe00640 1 -- 172.21.15.18:0/1824321250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000cd30 con 0x7f81e415e360 2024-04-25T10:08:44.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.482+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e41fa500 con 0x7f81e415e360 2024-04-25T10:08:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81dbe00640 1 -- 172.21.15.18:0/1824321250 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f81d001a070 con 0x7f81e415e360 2024-04-25T10:08:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81dbe00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 0x7f81c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81dbe00640 1 -- 172.21.15.18:0/1824321250 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81d00850a0 con 0x7f81e415e360 2024-04-25T10:08:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 0x7f81c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 Processor -- start 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 -- start start 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 0x7f81c4069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f81d40aa000 tx=0x7f81e415be50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc38599d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3859a240 0x55bc3854f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc384375f0 con 0x55bc3854ff30 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3839eda0 con 0x55bc38599920 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.486+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc38327150 con 0x55bc3859a240 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52448/0 (socket says 172.21.15.18:52448) 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 -- 172.21.15.18:0/1491559697 learned_addr learned my addr 172.21.15.18:0/1491559697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc38599d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3400640 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3859a240 0x55bc3854f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 -- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3859a240 msgr2=0x55bc3854f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3859a240 0x55bc3854f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 -- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 msgr2=0x55bc38599d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc38599d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 -- 172.21.15.18:0/1491559697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc38340ca0 con 0x55bc3854ff30 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e8c00640 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f81e40b4c90 tx=0x7f81dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46be328fc6db5b24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81d8c00640 1 -- 172.21.15.18:0/1491559697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc015600 con 0x55bc3854ff30 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81d8c00640 1 -- 172.21.15.18:0/1491559697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc01a070 con 0x55bc3854ff30 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81d8c00640 1 -- 172.21.15.18:0/1491559697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81dc0159e0 con 0x55bc3854ff30 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- 172.21.15.18:0/1491559697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 msgr2=0x55bc38550310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f81e40b4c90 tx=0x7f81dc00b040 comp rx=0 tx=0).stop 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- 172.21.15.18:0/1491559697 shutdown_connections 2024-04-25T10:08:44.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc38550310 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3859a240 0x55bc3854f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1491559697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc38599d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- 172.21.15.18:0/1491559697 >> 172.21.15.18:0/1491559697 conn(0x55bc385562a0 msgr2=0x55bc3854e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- 172.21.15.18:0/1491559697 shutdown_connections 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- 172.21.15.18:0/1491559697 wait complete. 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- start start 2024-04-25T10:08:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 Processor -- start 2024-04-25T10:08:44.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc3859a240 0x55bc38553aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc38359990 con 0x55bc3854ff30 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3839ae40 con 0x55bc3859a240 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3832a900 con 0x55bc38599920 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81ee08b000 10 client.0 _ll_register_callbacks cb 0x55bc384521c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52458/0 (socket says 172.21.15.18:52458) 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3e00640 1 -- 172.21.15.18:0/1886241866 learned_addr learned my addr 172.21.15.18:0/1886241866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.490+0000 7f81e3400640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e8c00640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc3859a240 0x55bc38553aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 -- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 msgr2=0x55bc385a11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385a11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 -- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc3859a240 msgr2=0x55bc38553aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc3859a240 0x55bc38553aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 -- 172.21.15.18:0/1886241866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc38357630 con 0x55bc3854ff30 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3e00640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f81d401cad0 tx=0x7f81d401b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eda34fb5431cd90 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:44.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40ca060 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81d4007620 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81dc01a070 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d40d0050 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 10 client.6954 fetch_fsmap learned FSMap version 46 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55bc383273a0 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81dc01a070 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81d40d3020 con 0x55bc3854ff30 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 10 client.6954 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 10 client.6954 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 20 client.6954 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc38555160 0x55bc385aac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 4 client.6954 mds_command: new command op to 35843 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 --> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc3833aa50 con 0x55bc38555160 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3400640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc38555160 0x55bc385aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 10 client.6954 ms_handle_connect on v2:172.21.15.18:6832/301895266 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81e3400640 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc38555160 0x55bc385aac70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae2e34f3fe76ea7 server_cookie=1b3cd6b00176554 in_seq=0 out_seq=0 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 1 -- 172.21.15.18:0/1886241866 <== mds.0 v2:172.21.15.18:6832/301895266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bc3833aa50 con 0x55bc38555160 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 10 client.6954 handle_command_reply: tid=0 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 client.6954 shutdown 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 msgr2=0x55bc385a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f81d401cad0 tx=0x7f81d401b4e0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 shutdown_connections 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc38555160 0x55bc385aac70 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc3859a240 0x55bc38553aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385a11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 --2- 172.21.15.18:0/1886241866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385a0c80 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81cd600640 0 client.6954 ms_handle_reset on v2:172.21.15.18:6832/301895266 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 >> 172.21.15.18:0/1886241866 conn(0x55bc385562a0 msgr2=0x55bc3854e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 shutdown_connections 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 1 -- 172.21.15.18:0/1886241866 wait complete. 2024-04-25T10:08:44.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.494+0000 7f81ee08b000 20 client.6954 trim_cache size 0 max 16384 2024-04-25T10:08:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.510+0000 7f81ee08b000 1 Processor -- start 2024-04-25T10:08:44.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.510+0000 7f81ee08b000 1 -- start start 2024-04-25T10:08:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3854ff30 0x55bc385f5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc385f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4203110 con 0x55bc385562a0 2024-04-25T10:08:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e41622a0 con 0x55bc38599920 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4202b40 con 0x55bc3854ff30 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52464/0 (socket says 172.21.15.18:52464) 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 -- 172.21.15.18:0/667060872 learned_addr learned my addr 172.21.15.18:0/667060872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 -- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3854ff30 msgr2=0x55bc385f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3854ff30 0x55bc385f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 -- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 msgr2=0x55bc385f5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc385f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 -- 172.21.15.18:0/667060872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3859a070 con 0x55bc385562a0 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81e3e00640 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f81d4001870 tx=0x7f81d40b3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d543913738dc976 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81cfe00640 1 -- 172.21.15.18:0/667060872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40074a0 con 0x55bc385562a0 2024-04-25T10:08:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81cfe00640 1 -- 172.21.15.18:0/667060872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40a9040 con 0x55bc385562a0 2024-04-25T10:08:44.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81cfe00640 1 -- 172.21.15.18:0/667060872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a5b10 con 0x55bc385562a0 2024-04-25T10:08:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- 172.21.15.18:0/667060872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 msgr2=0x55bc385f5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f81d4001870 tx=0x7f81d40b3000 comp rx=0 tx=0).stop 2024-04-25T10:08:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- 172.21.15.18:0/667060872 shutdown_connections 2024-04-25T10:08:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc38599920 0x55bc385f5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc3854ff30 0x55bc385f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- 172.21.15.18:0/667060872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc385562a0 0x55bc385f5120 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- 172.21.15.18:0/667060872 >> 172.21.15.18:0/667060872 conn(0x55bc38553510 msgr2=0x55bc385980a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- 172.21.15.18:0/667060872 shutdown_connections 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- 172.21.15.18:0/667060872 wait complete. 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 -- start start 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 Processor -- start 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.514+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc385562a0 0x55bc385fb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385deae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc383a33d0 con 0x55bc3854ff30 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3845ad50 con 0x55bc385562a0 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc38339980 con 0x55bc38599920 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 10 client.0 _ll_register_callbacks cb 0x7f81dc009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:44.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52466/0 (socket says 172.21.15.18:52466) 2024-04-25T10:08:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 -- 172.21.15.18:0/3339780749 learned_addr learned my addr 172.21.15.18:0/3339780749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3400640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc385562a0 0x55bc385fb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e8c00640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385deae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 -- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 msgr2=0x55bc385deae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385deae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 -- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc385562a0 msgr2=0x55bc385fb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc385562a0 0x55bc385fb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 -- 172.21.15.18:0/3339780749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc38420600 con 0x55bc3854ff30 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3e00640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f81d40983c0 tx=0x7f81d4019a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f82c5e84713f327 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:44.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40a5a90 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f81d40b4070 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81d40a9040 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81d40a5c30 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 10 client.6960 fetch_fsmap learned FSMap version 46 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=2+}) v3 -- 0x55bc383339b0 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d40a9040 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 46) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81d40d3070 con 0x55bc3854ff30 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 10 client.6960 fetch_fsmap finished waiting for FSMap version 46 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 10 client.6960 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 20 client.6960 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc3859a240 0x55bc385df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 4 client.6960 mds_command: new command op to 35843 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 --> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc383ac2e0 con 0x55bc3859a240 2024-04-25T10:08:44.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3400640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc3859a240 0x55bc385df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81e3400640 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc3859a240 0x55bc385df020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf12800db2e2ff3b server_cookie=288f258af997a815 in_seq=0 out_seq=0 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 10 client.6960 ms_handle_connect on v2:172.21.15.18:6832/301895266 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 1 -- 172.21.15.18:0/3339780749 <== mds.0 v2:172.21.15.18:6832/301895266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x55bc383ac2e0 con 0x55bc3859a240 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 10 client.6960 handle_command_reply: tid=0 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 client.6960 shutdown 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 msgr2=0x55bc385faf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f81d40983c0 tx=0x7f81d4019a40 comp rx=0 tx=0).stop 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 shutdown_connections 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:6832/301895266,v1:172.21.15.18:6835/301895266] conn(0x55bc3859a240 0x55bc385df020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bc38599920 0x55bc385deae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bc385562a0 0x55bc385fb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81cd600640 0 client.6960 ms_handle_reset on v2:172.21.15.18:6832/301895266 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 --2- 172.21.15.18:0/3339780749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc3854ff30 0x55bc385faf90 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 >> 172.21.15.18:0/3339780749 conn(0x55bc38553510 msgr2=0x55bc385987b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 shutdown_connections 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 1 -- 172.21.15.18:0/3339780749 wait complete. 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81ee08b000 20 client.6960 trim_cache size 0 max 16384 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 35843, 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:08:44.536 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 10.503852752, 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 46, 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 81, 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 81, 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 16.387977096 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:44.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 msgr2=0x7f81c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 0x7f81c4069420 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f81d40aa000 tx=0x7f81e415be50 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 msgr2=0x7f81e413f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.518+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f81d000e7f0 tx=0x7f81d000ecb0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 shutdown_connections 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81e415e7e0 0x7f81e413fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81e415e360 0x7f81e413f7d0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f81c4066f60 0x7f81c4069420 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 --2- 172.21.15.18:0/1824321250 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81c80039c0 0x7f81e41fad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 >> 172.21.15.18:0/1824321250 conn(0x7f81e4067080 msgr2=0x7f81e4160870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 shutdown_connections 2024-04-25T10:08:44.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.522+0000 7f81eac00640 1 -- 172.21.15.18:0/1824321250 wait complete. 2024-04-25T10:08:44.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:08:44.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 Processor -- start 2024-04-25T10:08:44.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 -- start start 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 0x7f1884099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 0x7f1884099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188406d740 con 0x7f188409a7a0 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18840cbfc0 con 0x7f188415dcd0 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188406cea0 con 0x7f18840cd460 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1889000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f188409a7a0 0x7f18840cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46484/0 (socket says 172.21.15.18:46484) 2024-04-25T10:08:44.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1889000640 1 -- 172.21.15.18:0/849972260 learned_addr learned my addr 172.21.15.18:0/849972260 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1889a00640 1 --2- 172.21.15.18:0/849972260 >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 0x7f1884099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188a400640 1 --2- 172.21.15.18:0/849972260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 0x7f1884099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681502419 0 0) 0x7f188406d740 con 0x7f188409a7a0 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f186c003530 con 0x7f188409a7a0 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093346932 0 0) 0x7f186c003530 con 0x7f188409a7a0 2024-04-25T10:08:44.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188a400640 1 -- 172.21.15.18:0/849972260 >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 msgr2=0x7f1884099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188a400640 1 --2- 172.21.15.18:0/849972260 >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 0x7f1884099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188a400640 1 -- 172.21.15.18:0/849972260 >> v1:172.21.15.18:6789/0 conn(0x7f188409a7a0 legacy=0x7f18840cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f188a400640 1 -- 172.21.15.18:0/849972260 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188406d180 con 0x7f18840cd460 2024-04-25T10:08:44.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.682+0000 7f1889a00640 1 --2- 172.21.15.18:0/849972260 >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 0x7f1884099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188a400640 1 --2- 172.21.15.18:0/849972260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 0x7f1884099fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9553e25d1717290 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c0b2070 con 0x7f18840cd460 2024-04-25T10:08:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0a5660 con 0x7f18840cd460 2024-04-25T10:08:44.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f1883e00640 1 -- 172.21.15.18:0/849972260 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870001680 con 0x7f18840cd460 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 -- 172.21.15.18:0/849972260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 msgr2=0x7f1884099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 --2- 172.21.15.18:0/849972260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 0x7f1884099fa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f187c009d90 tx=0x7f187c01c860 comp rx=0 tx=0).stop 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 -- 172.21.15.18:0/849972260 shutdown_connections 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 --2- 172.21.15.18:0/849972260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18840cd460 0x7f1884099fa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 --2- 172.21.15.18:0/849972260 >> v2:172.21.15.167:3300/0 conn(0x7f188415dcd0 0x7f1884099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 -- 172.21.15.18:0/849972260 >> 172.21.15.18:0/849972260 conn(0x7f18840b3050 msgr2=0x7f18840b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 -- 172.21.15.18:0/849972260 shutdown_connections 2024-04-25T10:08:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.686+0000 7f188ae00640 1 -- 172.21.15.18:0/849972260 wait complete. 2024-04-25T10:08:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 Processor -- start 2024-04-25T10:08:44.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- start start 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f188409a7a0 0x7f18840b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f188415dcd0 0x7f18841558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188416aa20 con 0x7f18840cd460 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188416a8a0 con 0x7f188415dcd0 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188416aba0 con 0x7f188409a7a0 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52482/0 (socket says 172.21.15.18:52482) 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 -- 172.21.15.18:0/182328457 learned_addr learned my addr 172.21.15.18:0/182328457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889a00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f188409a7a0 0x7f18840b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188a400640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f188415dcd0 0x7f18841558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 -- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f188409a7a0 msgr2=0x7f18840b43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f188409a7a0 0x7f18840b43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 -- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f188415dcd0 msgr2=0x7f18841558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f188415dcd0 0x7f18841558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 -- 172.21.15.18:0/182328457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18840b4a90 con 0x7f18840cd460 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1889000640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f18700017f0 tx=0x7f187000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870005ae0 con 0x7f18840cd460 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1870005ca0 con 0x7f18840cd460 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18840b4d70 con 0x7f18840cd460 2024-04-25T10:08:44.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700072b0 con 0x7f18840cd460 2024-04-25T10:08:44.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.690+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18840b5330 con 0x7f18840cd460 2024-04-25T10:08:44.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188404efa0 con 0x7f18840cd460 2024-04-25T10:08:44.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1870007450 con 0x7f18840cd460 2024-04-25T10:08:44.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f1881600640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 0x7f1864069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:44.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1870084e80 con 0x7f18840cd460 2024-04-25T10:08:44.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f1889a00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 0x7f1864069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:44.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.694+0000 7f1889a00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 0x7f1864069420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1878009580 tx=0x7f1878009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.698+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18700556a0 con 0x7f18840cd460 2024-04-25T10:08:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f188406d740 con 0x7f18840cd460 2024-04-25T10:08:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f1881600640 1 -- 172.21.15.18:0/182328457 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v46) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1870059740 con 0x7f18840cd460 2024-04-25T10:08:44.910 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:08:44.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 msgr2=0x7f1864069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 0x7f1864069420 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1878009580 tx=0x7f1878009190 comp rx=0 tx=0).stop 2024-04-25T10:08:44.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 msgr2=0x7f1884153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f18700017f0 tx=0x7f187000cbe0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 shutdown_connections 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f188415dcd0 0x7f18841558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18840cd460 0x7f1884153b80 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1864066f60 0x7f1864069420 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 --2- 172.21.15.18:0/182328457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f188409a7a0 0x7f18840b43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 >> 172.21.15.18:0/182328457 conn(0x7f18840b3050 msgr2=0x7f18840cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 shutdown_connections 2024-04-25T10:08:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:44.902+0000 7f188ae00640 1 -- 172.21.15.18:0/182328457 wait complete. 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:08:44.932 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:44.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:44.933 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:08:44.942 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42180sec preferred_lft 42180sec 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:08:44.943 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:08:44.944 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:08:44.945 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:44.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:44.946 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:08:45.006 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:08:45.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.008 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:08:45.061 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:08:45.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.062 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:08:45.062 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:08:45.062 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:08:45.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:08:45.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:08:45.063 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:08:45.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.158 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:08:45.167 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:08:45.167 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:08:45.168 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:45.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:08:45.232 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:08:45.232 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:45.284 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:45.284 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:08:45.284 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:45.336 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:08:45.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:45.429 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:45.430 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:08:45.443 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:45.443 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:08:45.443 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:08:45.443 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:08:45.443 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:08:45.447 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:08:45.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:45.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.467 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:08:45.525 INFO:teuthology.orchestra.run.smithi018.stdout:client35963 2024-04-25T10:08:45.526 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:45.526 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:45.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.577 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T10:08:45.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.639 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T10:08:45.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:45.695 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T10:08:45.746 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:08:45.858 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:08:45.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:08:45.867 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:45.867 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:45.917 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:45.917 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:45.968 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:46.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 Processor -- start 2024-04-25T10:08:46.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 -- start start 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f980015e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980006d090 con 0x7f9800161510 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9800071ad0 con 0x7f9800070fe0 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f9805800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800162390 con 0x7f980015e550 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97f6000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9800161510 0x7f9800143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46490/0 (socket says 172.21.15.18:46490) 2024-04-25T10:08:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97f6000640 1 -- 172.21.15.18:0/3426204319 learned_addr learned my addr 172.21.15.18:0/3426204319 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97ff400640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f980015e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1262856891 0 0) 0x7f97e8001120 con 0x7f9800161510 2024-04-25T10:08:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e4003530 con 0x7f9800161510 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 927658213 0 0) 0x7f9800071ad0 con 0x7f9800070fe0 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97e8001120 con 0x7f9800070fe0 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2308888864 0 0) 0x7f97e4003530 con 0x7f9800161510 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 msgr2=0x7f980015e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f980015e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 >> v1:172.21.15.167:6789/0 conn(0x7f9800070fe0 legacy=0x7f98000713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800161af0 con 0x7f9800161510 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f97e8001850 con 0x7f9800161510 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 >> v1:172.21.15.18:6789/0 conn(0x7f9800161510 legacy=0x7f9800143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4003b80 0x7f97e4003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f97e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e4004d50 0x7f97e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800162390 con 0x7f97e4004d50 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e400ba80 con 0x7f97e4003b80 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.146+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e400bc30 con 0x7f980015e550 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e4004d50 0x7f97e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97fea00640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4003b80 0x7f97e4003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97f6000640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f97e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 -- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 msgr2=0x7f97e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980015e550 0x7f97e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 -- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4003b80 msgr2=0x7f97e4003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4003b80 0x7f97e4003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 -- 172.21.15.18:0/3426204319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4003530 con 0x7f97e4004d50 2024-04-25T10:08:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e4004d50 0x7f97e40051d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fc0 tx=0x7f97f801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23820fc051a87538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80b2070 con 0x7f97e4004d50 2024-04-25T10:08:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f80a5b80 con 0x7f97e4004d50 2024-04-25T10:08:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97fe000640 1 -- 172.21.15.18:0/3426204319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8009c10 con 0x7f97e4004d50 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f9805800640 1 -- 172.21.15.18:0/3426204319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e4004d50 msgr2=0x7f97e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f9805800640 1 --2- 172.21.15.18:0/3426204319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97e4004d50 0x7f97e40051d0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009fc0 tx=0x7f97f801cc80 comp rx=0 tx=0).stop 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.150+0000 7f97ff400640 1 -- 172.21.15.18:0/3426204319 reap_dead start 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- 172.21.15.18:0/3426204319 shutdown_connections 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- 172.21.15.18:0/3426204319 >> 172.21.15.18:0/3426204319 conn(0x7f98000b3390 msgr2=0x7f98000b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- 172.21.15.18:0/3426204319 shutdown_connections 2024-04-25T10:08:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- 172.21.15.18:0/3426204319 wait complete. 2024-04-25T10:08:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 Processor -- start 2024-04-25T10:08:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- start start 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4004d50 0x7f9800145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980013fd50 0x7f98001401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980015e030 con 0x7f9800145020 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98001620b0 con 0x7f97e4004d50 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f9805800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800143790 con 0x7f980013fd50 2024-04-25T10:08:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52486/0 (socket says 172.21.15.18:52486) 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 -- 172.21.15.18:0/112422619 learned_addr learned my addr 172.21.15.18:0/112422619 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 -- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980013fd50 msgr2=0x7f98001401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980013fd50 0x7f98001401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 -- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4004d50 msgr2=0x7f9800145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97fea00640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4004d50 0x7f9800145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4004d50 0x7f9800145f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 -- 172.21.15.18:0/112422619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000b4740 con 0x7f9800145020 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f6000640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f97e80124c0 tx=0x7f97e8012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.154+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e801c070 con 0x7f9800145020 2024-04-25T10:08:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e8014810 con 0x7f9800145020 2024-04-25T10:08:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e8014c00 con 0x7f9800145020 2024-04-25T10:08:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98000b5a80 con 0x7f9800145020 2024-04-25T10:08:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98000b4cc0 con 0x7f9800145020 2024-04-25T10:08:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98000745d0 con 0x7f9800145020 2024-04-25T10:08:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97e801f070 con 0x7f9800145020 2024-04-25T10:08:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97f7400640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 0x7f97dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f97e8087ba0 con 0x7f9800145020 2024-04-25T10:08:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.158+0000 7f97fea00640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 0x7f97dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.162+0000 7f97fea00640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 0x7f97dc069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97f0007fd0 tx=0x7f97f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.162+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f980006d090 con 0x7f9800145020 2024-04-25T10:08:46.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98000cef80 con 0x7f9800145020 2024-04-25T10:08:46.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f97f7400640 1 -- 172.21.15.18:0/112422619 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16921 (secure 0 0 0) 0x7f97e8058980 con 0x7f9800145020 2024-04-25T10:08:46.334 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:46.334 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:34.995107+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 msgr2=0x7f97dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 0x7f97dc069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f97f0007fd0 tx=0x7f97f0009040 comp rx=0 tx=0).stop 2024-04-25T10:08:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 msgr2=0x7f98000cdb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f97e80124c0 tx=0x7f97e8012980 comp rx=0 tx=0).stop 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 shutdown_connections 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f97dc066f60 0x7f97dc069420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f980013fd50 0x7f98001401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9800145020 0x7f98000cdb10 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 --2- 172.21.15.18:0/112422619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97e4004d50 0x7f9800145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 >> 172.21.15.18:0/112422619 conn(0x7f98000b3390 msgr2=0x7f98000736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 shutdown_connections 2024-04-25T10:08:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.326+0000 7f9805800640 1 -- 172.21.15.18:0/112422619 wait complete. 2024-04-25T10:08:46.355 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:08:31.175528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:08:32.386489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:46.356 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.490+0000 7fe740e00640 1 Processor -- start 2024-04-25T10:08:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.490+0000 7fe740e00640 1 -- start start 2024-04-25T10:08:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe73c144120 0x7fe73c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 0x7fe73c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 0x7fe73c0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c15e490 con 0x7fe73c144120 2024-04-25T10:08:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c15bc40 con 0x7fe73c0ccbf0 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe740e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c15b3a0 con 0x7fe73c15ee60 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe73c144120 0x7fe73c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe73c144120 0x7fe73c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52494/0 (socket says 172.21.15.18:52494) 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 -- 172.21.15.18:0/2502866300 learned_addr learned my addr 172.21.15.18:0/2502866300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe731400640 1 --2- 172.21.15.18:0/2502866300 >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 0x7fe73c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe73a800640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 0x7fe73c0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 -- 172.21.15.18:0/2502866300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 msgr2=0x7fe73c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 0x7fe73c0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 -- 172.21.15.18:0/2502866300 >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 msgr2=0x7fe73c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 --2- 172.21.15.18:0/2502866300 >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 0x7fe73c15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe739e00640 1 -- 172.21.15.18:0/2502866300 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c15b680 con 0x7fe73c144120 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe731400640 1 --2- 172.21.15.18:0/2502866300 >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 0x7fe73c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.494+0000 7fe73a800640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 0x7fe73c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:46.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe739e00640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c144120 0x7fe73c15acd0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe73c06b870 tx=0x7fe72c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de410d0188be7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe739400640 1 -- 172.21.15.18:0/2502866300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b2070 con 0x7fe73c144120 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe739400640 1 -- 172.21.15.18:0/2502866300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0a9070 con 0x7fe73c144120 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe739400640 1 -- 172.21.15.18:0/2502866300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0ad880 con 0x7fe73c144120 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- 172.21.15.18:0/2502866300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c144120 msgr2=0x7fe73c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c144120 0x7fe73c15acd0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe73c06b870 tx=0x7fe72c01c490 comp rx=0 tx=0).stop 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- 172.21.15.18:0/2502866300 shutdown_connections 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c15ee60 0x7fe73c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- 172.21.15.18:0/2502866300 >> v2:172.21.15.167:3300/0 conn(0x7fe73c0ccbf0 0x7fe73c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- 172.21.15.18:0/2502866300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c144120 0x7fe73c15acd0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- 172.21.15.18:0/2502866300 >> 172.21.15.18:0/2502866300 conn(0x7fe73c067080 msgr2=0x7fe73c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- 172.21.15.18:0/2502866300 shutdown_connections 2024-04-25T10:08:46.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- 172.21.15.18:0/2502866300 wait complete. 2024-04-25T10:08:46.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 Processor -- start 2024-04-25T10:08:46.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 -- start start 2024-04-25T10:08:46.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 0x7fe73c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.498+0000 7fe740e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe73c144120 0x7fe73c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c071640 con 0x7fe73c15ee60 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0714c0 con 0x7fe73c144120 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c0717c0 con 0x7fe73c0ccbf0 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe739e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 0x7fe73c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52496/0 (socket says 172.21.15.18:52496) 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe739e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 0x7fe73c159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50024/0 (socket says 172.21.15.18:50024) 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 -- 172.21.15.18:0/3874653703 learned_addr learned my addr 172.21.15.18:0/3874653703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:46.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe731400640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe73c144120 0x7fe73c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 -- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 msgr2=0x7fe73c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 0x7fe73c159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 -- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe73c144120 msgr2=0x7fe73c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe73c144120 0x7fe73c0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 -- 172.21.15.18:0/3874653703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c06e0f0 con 0x7fe73c15ee60 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe73a800640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cd80 tx=0x7fe73400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400f680 con 0x7fe73c15ee60 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73400f840 con 0x7fe73c15ee60 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73400fc30 con 0x7fe73c15ee60 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c15f870 con 0x7fe73c15ee60 2024-04-25T10:08:46.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c15fe30 con 0x7fe73c15ee60 2024-04-25T10:08:46.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c0745d0 con 0x7fe73c15ee60 2024-04-25T10:08:46.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.502+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7340213f0 con 0x7fe73c15ee60 2024-04-25T10:08:46.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.506+0000 7fe732a00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 0x7fe718069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.506+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe734085eb0 con 0x7fe73c15ee60 2024-04-25T10:08:46.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.506+0000 7fe739e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 0x7fe718069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.506+0000 7fe739e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 0x7fe718069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.510+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe734014030 con 0x7fe73c15ee60 2024-04-25T10:08:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe73c06c250 con 0x7fe73c15ee60 2024-04-25T10:08:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe732a00640 1 -- 172.21.15.18:0/3874653703 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe734056640 con 0x7fe73c15ee60 2024-04-25T10:08:46.682 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 msgr2=0x7fe718069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 0x7fe718069420 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe72c0af000 tx=0x7fe72c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 msgr2=0x7fe73c160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe73400cd80 tx=0x7fe73400a650 comp rx=0 tx=0).stop 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 shutdown_connections 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe73c15ee60 0x7fe73c160910 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe73c144120 0x7fe73c0b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe718066f60 0x7fe718069420 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 --2- 172.21.15.18:0/3874653703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe73c0ccbf0 0x7fe73c159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 >> 172.21.15.18:0/3874653703 conn(0x7fe73c067080 msgr2=0x7fe73c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 shutdown_connections 2024-04-25T10:08:46.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.674+0000 7fe740e00640 1 -- 172.21.15.18:0/3874653703 wait complete. 2024-04-25T10:08:46.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:08:46.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 Processor -- start 2024-04-25T10:08:46.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 -- start start 2024-04-25T10:08:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72fc1592f0 0x7f72fc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f72fc160000 0x7f72fc15d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc06adb0 con 0x7f72fc15f480 2024-04-25T10:08:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc06b090 con 0x7f72fc1592f0 2024-04-25T10:08:46.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc06b370 con 0x7f72fc160000 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f72fc1592f0 0x7f72fc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72f3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f72fc15f480 0x7f72fc15f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46498/0 (socket says 172.21.15.18:46498) 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72f3e00640 1 -- 172.21.15.18:0/459420421 learned_addr learned my addr 172.21.15.18:0/459420421 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f7301000640 1 --2- 172.21.15.18:0/459420421 >> v2:172.21.15.167:3300/0 conn(0x7f72fc160000 0x7f72fc15d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fbe00640 1 -- 172.21.15.18:0/459420421 >> v2:172.21.15.167:3300/0 conn(0x7f72fc160000 msgr2=0x7f72fc15d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fbe00640 1 --2- 172.21.15.18:0/459420421 >> v2:172.21.15.167:3300/0 conn(0x7f72fc160000 0x7f72fc15d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fbe00640 1 -- 172.21.15.18:0/459420421 >> v1:172.21.15.18:6789/0 conn(0x7f72fc15f480 legacy=0x7f72fc15f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fbe00640 1 -- 172.21.15.18:0/459420421 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc06b650 con 0x7f72fc1592f0 2024-04-25T10:08:46.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.838+0000 7f72fb400640 1 -- 172.21.15.18:0/459420421 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596081089 0 0) 0x7f72fc06adb0 con 0x7f72fc15f480 2024-04-25T10:08:46.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f72fbe00640 1 --2- 172.21.15.18:0/459420421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc0d0ec0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f72fc070ca0 tx=0x7f72ec01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7058c3f165eef3cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f72fb400640 1 -- 172.21.15.18:0/459420421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0b0070 con 0x7f72fc1592f0 2024-04-25T10:08:46.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f72fb400640 1 -- 172.21.15.18:0/459420421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0ab600 con 0x7f72fc1592f0 2024-04-25T10:08:46.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f72fb400640 1 -- 172.21.15.18:0/459420421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0ab9d0 con 0x7f72fc1592f0 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 -- 172.21.15.18:0/459420421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 msgr2=0x7f72fc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 --2- 172.21.15.18:0/459420421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc0d0ec0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f72fc070ca0 tx=0x7f72ec01c3f0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 -- 172.21.15.18:0/459420421 shutdown_connections 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 --2- 172.21.15.18:0/459420421 >> v2:172.21.15.167:3300/0 conn(0x7f72fc160000 0x7f72fc15d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 --2- 172.21.15.18:0/459420421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc0d0ec0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 -- 172.21.15.18:0/459420421 >> 172.21.15.18:0/459420421 conn(0x7f72fc0b5ca0 msgr2=0x7f72fc099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:46.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 -- 172.21.15.18:0/459420421 shutdown_connections 2024-04-25T10:08:46.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.842+0000 7f7301a00640 1 -- 172.21.15.18:0/459420421 wait complete. 2024-04-25T10:08:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 Processor -- start 2024-04-25T10:08:46.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- start start 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72fc15f480 0x7f72fc06f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72fc160000 0x7f72fc06f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15e180 con 0x7f72fc1592f0 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15e000 con 0x7f72fc15f480 2024-04-25T10:08:46.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc15e300 con 0x7f72fc160000 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52524/0 (socket says 172.21.15.18:52524) 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 -- 172.21.15.18:0/1404901637 learned_addr learned my addr 172.21.15.18:0/1404901637 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 -- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72fc160000 msgr2=0x7f72fc06f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72fc160000 0x7f72fc06f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 -- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72fc15f480 msgr2=0x7f72fc06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72fc15f480 0x7f72fc06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 -- 172.21.15.18:0/1404901637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0cf770 con 0x7f72fc1592f0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72fbe00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f72ec01a020 tx=0x7f72ec01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0b0050 con 0x7f72fc1592f0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0b1040 con 0x7f72fc1592f0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc0cf490 con 0x7f72fc1592f0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec004240 con 0x7f72fc1592f0 2024-04-25T10:08:46.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.846+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc159c60 con 0x7f72fc1592f0 2024-04-25T10:08:46.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc0745d0 con 0x7f72fc1592f0 2024-04-25T10:08:46.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72ec0be060 con 0x7f72fc1592f0 2024-04-25T10:08:46.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f72f8c00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 0x7f72d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:46.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f72ec11eda0 con 0x7f72fc1592f0 2024-04-25T10:08:46.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f72f3e00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 0x7f72d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:46.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.850+0000 7f72f3e00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 0x7f72d8069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72e40011f0 tx=0x7f72e4007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:46.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:46.854+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f72ec016070 con 0x7f72fc1592f0 2024-04-25T10:08:47.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.014+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72fc0b52b0 con 0x7f72fc1592f0 2024-04-25T10:08:47.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.014+0000 7f72f8c00640 1 -- 172.21.15.18:0/1404901637 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f72ec0efb90 con 0x7f72fc1592f0 2024-04-25T10:08:47.024 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 msgr2=0x7f72d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 0x7f72d8069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f72e40011f0 tx=0x7f72e4007930 comp rx=0 tx=0).stop 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 msgr2=0x7f72fc1f57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f72ec01a020 tx=0x7f72ec01ac30 comp rx=0 tx=0).stop 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 shutdown_connections 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f72d8066f60 0x7f72d8069420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f72fc160000 0x7f72fc06f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72fc15f480 0x7f72fc06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 --2- 172.21.15.18:0/1404901637 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72fc1592f0 0x7f72fc1f57f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 >> 172.21.15.18:0/1404901637 conn(0x7f72fc0b5ca0 msgr2=0x7f72fc099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:47.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 shutdown_connections 2024-04-25T10:08:47.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.018+0000 7f7301a00640 1 -- 172.21.15.18:0/1404901637 wait complete. 2024-04-25T10:08:47.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:08:47.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 Processor -- start 2024-04-25T10:08:47.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 -- start start 2024-04-25T10:08:47.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 0x7f18d80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 0x7f18d80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d815e040 con 0x7f18d815dc60 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d80cff80 con 0x7f18d809a170 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80d0260 con 0x7f18d806bf30 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dcc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 0x7f18d80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18cf400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 0x7f18d80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18d7e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f18d815dc60 0x7f18d8099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:47414/0 (socket says 172.21.15.18:47414) 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18d7e00640 1 -- 172.21.15.18:0/1492385557 learned_addr learned my addr 172.21.15.18:0/1492385557 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dcc00640 1 -- 172.21.15.18:0/1492385557 >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 msgr2=0x7f18d80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:47.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dcc00640 1 --2- 172.21.15.18:0/1492385557 >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 0x7f18d80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18d7400640 1 -- 172.21.15.18:0/1492385557 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434629539 0 0) 0x7f18d815e040 con 0x7f18d815dc60 2024-04-25T10:08:47.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dcc00640 1 -- 172.21.15.18:0/1492385557 >> v1:172.21.15.167:6789/0 conn(0x7f18d815dc60 legacy=0x7f18d8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18dcc00640 1 -- 172.21.15.18:0/1492385557 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80d0540 con 0x7f18d806bf30 2024-04-25T10:08:47.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.182+0000 7f18cf400640 1 --2- 172.21.15.18:0/1492385557 >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 0x7f18d80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:47.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dcc00640 1 --2- 172.21.15.18:0/1492385557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 0x7f18d80cf8a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009d90 tx=0x7f18d001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12b2b4d4da319967 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18d7400640 1 -- 172.21.15.18:0/1492385557 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00b2070 con 0x7f18d806bf30 2024-04-25T10:08:47.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18d7400640 1 -- 172.21.15.18:0/1492385557 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d00a5970 con 0x7f18d806bf30 2024-04-25T10:08:47.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18d7400640 1 -- 172.21.15.18:0/1492385557 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00a5d40 con 0x7f18d806bf30 2024-04-25T10:08:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 -- 172.21.15.18:0/1492385557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 msgr2=0x7f18d80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 --2- 172.21.15.18:0/1492385557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 0x7f18d80cf8a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009d90 tx=0x7f18d001c8b0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 -- 172.21.15.18:0/1492385557 shutdown_connections 2024-04-25T10:08:47.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 --2- 172.21.15.18:0/1492385557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d806bf30 0x7f18d80cf8a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 --2- 172.21.15.18:0/1492385557 >> v2:172.21.15.167:3300/0 conn(0x7f18d809a170 0x7f18d80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 -- 172.21.15.18:0/1492385557 >> 172.21.15.18:0/1492385557 conn(0x7f18d80b3200 msgr2=0x7f18d80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:47.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 -- 172.21.15.18:0/1492385557 shutdown_connections 2024-04-25T10:08:47.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.186+0000 7f18dec00640 1 -- 172.21.15.18:0/1492385557 wait complete. 2024-04-25T10:08:47.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 Processor -- start 2024-04-25T10:08:47.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- start start 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d809a170 0x7f18d80b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d815dc60 0x7f18d81f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cc6f0 con 0x7f18d806bf30 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cc570 con 0x7f18d815dc60 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d80cc870 con 0x7f18d809a170 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52534/0 (socket says 172.21.15.18:52534) 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 -- 172.21.15.18:0/3990395099 learned_addr learned my addr 172.21.15.18:0/3990395099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:47.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dcc00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d815dc60 0x7f18d81f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18cf400640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d809a170 0x7f18d80b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 -- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d809a170 msgr2=0x7f18d80b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d809a170 0x7f18d80b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 -- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d815dc60 msgr2=0x7f18d81f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d815dc60 0x7f18d81f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 -- 172.21.15.18:0/3990395099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80b4cf0 con 0x7f18d806bf30 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d7e00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c410 tx=0x7f18c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80074e0 con 0x7f18d806bf30 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c80047f0 con 0x7f18d806bf30 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c8007680 con 0x7f18d806bf30 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d80b4fd0 con 0x7f18d806bf30 2024-04-25T10:08:47.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.190+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d80b5590 con 0x7f18d806bf30 2024-04-25T10:08:47.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d80745d0 con 0x7f18d806bf30 2024-04-25T10:08:47.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18c8011070 con 0x7f18d806bf30 2024-04-25T10:08:47.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18d4c00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 0x7f18b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f18c8084e90 con 0x7f18d806bf30 2024-04-25T10:08:47.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18cf400640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 0x7f18b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.194+0000 7f18cf400640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 0x7f18b4069450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009580 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.198+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18c8055c70 con 0x7f18d806bf30 2024-04-25T10:08:47.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18d80b7590 con 0x7f18d806bf30 2024-04-25T10:08:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18d4c00640 1 -- 172.21.15.18:0/3990395099 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18c8055570 con 0x7f18d806bf30 2024-04-25T10:08:47.370 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 msgr2=0x7f18b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 0x7f18b4069450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f18c0009580 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 msgr2=0x7f18d80b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f18c800c410 tx=0x7f18c800c8d0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 shutdown_connections 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18d815dc60 0x7f18d81f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18b4066f90 0x7f18b4069450 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f18d809a170 0x7f18d80b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 --2- 172.21.15.18:0/3990395099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f18d806bf30 0x7f18d80b6990 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 >> 172.21.15.18:0/3990395099 conn(0x7f18d80b3200 msgr2=0x7f18d8073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:47.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 shutdown_connections 2024-04-25T10:08:47.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.362+0000 7f18dec00640 1 -- 172.21.15.18:0/3990395099 wait complete. 2024-04-25T10:08:47.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:08:47.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 Processor -- start 2024-04-25T10:08:47.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 -- start start 2024-04-25T10:08:47.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde2815dc60 0x7fde280d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde280cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2815e040 con 0x7fde2806bf30 2024-04-25T10:08:47.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280cff80 con 0x7fde2815dc60 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde30200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280d0260 con 0x7fde2809a170 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2d800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde2815dc60 0x7fde280d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2ce00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fde2806bf30 0x7fde28099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46512/0 (socket says 172.21.15.18:46512) 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2ce00640 1 -- 172.21.15.18:0/3958743513 learned_addr learned my addr 172.21.15.18:0/3958743513 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2e200640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde280cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2d800640 1 -- 172.21.15.18:0/3958743513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 msgr2=0x7fde280cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2d800640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde280cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2d800640 1 -- 172.21.15.18:0/3958743513 >> v1:172.21.15.18:6789/0 conn(0x7fde2806bf30 legacy=0x7fde28099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde2d800640 1 -- 172.21.15.18:0/3958743513 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280d0540 con 0x7fde2815dc60 2024-04-25T10:08:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.526+0000 7fde27e00640 1 -- 172.21.15.18:0/3958743513 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270911247 0 0) 0x7fde2815e040 con 0x7fde2806bf30 2024-04-25T10:08:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde2d800640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2815dc60 0x7fde280d1020 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097c0 tx=0x7fde1c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42c067f5c10897b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde27e00640 1 -- 172.21.15.18:0/3958743513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b1070 con 0x7fde2815dc60 2024-04-25T10:08:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde27e00640 1 -- 172.21.15.18:0/3958743513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c0a8050 con 0x7fde2815dc60 2024-04-25T10:08:47.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde27e00640 1 -- 172.21.15.18:0/3958743513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ac860 con 0x7fde2815dc60 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- 172.21.15.18:0/3958743513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2815dc60 msgr2=0x7fde280d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2815dc60 0x7fde280d1020 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0097c0 tx=0x7fde1c01c3e0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- 172.21.15.18:0/3958743513 shutdown_connections 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde280cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 --2- 172.21.15.18:0/3958743513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2815dc60 0x7fde280d1020 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- 172.21.15.18:0/3958743513 >> 172.21.15.18:0/3958743513 conn(0x7fde280b3200 msgr2=0x7fde280b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- 172.21.15.18:0/3958743513 shutdown_connections 2024-04-25T10:08:47.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- 172.21.15.18:0/3958743513 wait complete. 2024-04-25T10:08:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 Processor -- start 2024-04-25T10:08:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.530+0000 7fde30200640 1 -- start start 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde2814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 0x7fde280b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280cc6f0 con 0x7fde2806bf30 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280cc570 con 0x7fde2815dc60 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280cc870 con 0x7fde2809a170 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52552/0 (socket says 172.21.15.18:52552) 2024-04-25T10:08:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 -- 172.21.15.18:0/2000078775 learned_addr learned my addr 172.21.15.18:0/2000078775 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2e200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 0x7fde280b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2ce00640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde2814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 -- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 msgr2=0x7fde2814e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde2814e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 -- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 msgr2=0x7fde280b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 0x7fde280b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 -- 172.21.15.18:0/2000078775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280b7310 con 0x7fde2806bf30 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2e200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 0x7fde280b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde2d800640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01aa90 tx=0x7fde1c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b1040 con 0x7fde2806bf30 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c0bd070 con 0x7fde2806bf30 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0b7660 con 0x7fde2806bf30 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2814f7d0 con 0x7fde2806bf30 2024-04-25T10:08:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2814fd90 con 0x7fde2806bf30 2024-04-25T10:08:47.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280745d0 con 0x7fde2806bf30 2024-04-25T10:08:47.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.534+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde1c0b7800 con 0x7fde2806bf30 2024-04-25T10:08:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.538+0000 7fde25600640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.538+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fde1c11f770 con 0x7fde2806bf30 2024-04-25T10:08:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.538+0000 7fde2ce00640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:47.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.538+0000 7fde2ce00640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 0x7fde08069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde28153ba0 tx=0x7fde14007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:47.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.542+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde280b7310 con 0x7fde2806bf30 2024-04-25T10:08:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde280b7590 con 0x7fde2806bf30 2024-04-25T10:08:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde25600640 1 -- 172.21.15.18:0/2000078775 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v81) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde1c016090 con 0x7fde2806bf30 2024-04-25T10:08:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 msgr2=0x7fde08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 0x7fde08069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fde28153ba0 tx=0x7fde14007b60 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 msgr2=0x7fde280b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01aa90 tx=0x7fde1c01ac20 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 shutdown_connections 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2815dc60 0x7fde280b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde08066f60 0x7fde08069420 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde2809a170 0x7fde2814e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 --2- 172.21.15.18:0/2000078775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde2806bf30 0x7fde280b4b30 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 >> 172.21.15.18:0/2000078775 conn(0x7fde280b3200 msgr2=0x7fde2815cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 shutdown_connections 2024-04-25T10:08:47.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.718+0000 7fde30200640 1 -- 172.21.15.18:0/2000078775 wait complete. 2024-04-25T10:08:47.746 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:08:47.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:47.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:47.806 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:08:47.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:47.807 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:08:47.823 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.994+0000 7fef16c00640 1 Processor -- start 2024-04-25T10:08:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.994+0000 7fef16c00640 1 -- start start 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef16c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef10145270 0x7fef1015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef16c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef100cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef16c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef100cc4e0 con 0x7fef100cd4d0 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef16c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef10145650 con 0x7fef10145270 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef16c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef100ce040 con 0x7fef100b1e60 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef10145270 0x7fef1015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef10145270 0x7fef1015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52562/0 (socket says 172.21.15.18:52562) 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 -- 172.21.15.18:0/3386412233 learned_addr learned my addr 172.21.15.18:0/3386412233 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef14c00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef100cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 -- 172.21.15.18:0/3386412233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 msgr2=0x7fef100cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:48.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef100cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 -- 172.21.15.18:0/3386412233 >> v1:172.21.15.167:6789/0 conn(0x7fef100cd4d0 legacy=0x7fef100b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:47.998+0000 7fef0fe00640 1 -- 172.21.15.18:0/3386412233 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100ce320 con 0x7fef10145270 2024-04-25T10:08:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef0fe00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef10145270 0x7fef1015fe50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fef00009870 tx=0x7fef0001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fddcca235d6be00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef0f400640 1 -- 172.21.15.18:0/3386412233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000ab650 con 0x7fef10145270 2024-04-25T10:08:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef0f400640 1 -- 172.21.15.18:0/3386412233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef000b0070 con 0x7fef10145270 2024-04-25T10:08:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef0f400640 1 -- 172.21.15.18:0/3386412233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef000aba10 con 0x7fef10145270 2024-04-25T10:08:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- 172.21.15.18:0/3386412233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef10145270 msgr2=0x7fef1015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef10145270 0x7fef1015fe50 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fef00009870 tx=0x7fef0001c560 comp rx=0 tx=0).stop 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- 172.21.15.18:0/3386412233 shutdown_connections 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef100cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 --2- 172.21.15.18:0/3386412233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef10145270 0x7fef1015fe50 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- 172.21.15.18:0/3386412233 >> 172.21.15.18:0/3386412233 conn(0x7fef10066fa0 msgr2=0x7fef1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- 172.21.15.18:0/3386412233 shutdown_connections 2024-04-25T10:08:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- 172.21.15.18:0/3386412233 wait complete. 2024-04-25T10:08:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 Processor -- start 2024-04-25T10:08:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.002+0000 7fef16c00640 1 -- start start 2024-04-25T10:08:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef10142990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef10145270 0x7fef10140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1015c710 con 0x7fef100cd4d0 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1015c590 con 0x7fef10145270 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef1015c890 con 0x7fef100b1e60 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef0fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef10142990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef14c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef10145270 0x7fef10140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52574/0 (socket says 172.21.15.18:52574) 2024-04-25T10:08:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 -- 172.21.15.18:0/144068450 learned_addr learned my addr 172.21.15.18:0/144068450 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 -- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 msgr2=0x7fef10142990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef10142990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 -- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef10145270 msgr2=0x7fef10140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef10145270 0x7fef10140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 -- 172.21.15.18:0/144068450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef101418f0 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef07e00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feef800c450 tx=0x7feef800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8016020 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef80052d0 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef10141bd0 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef8007260 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef10142470 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef10141da0 con 0x7fef100cd4d0 2024-04-25T10:08:48.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.006+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feef8007400 con 0x7fef100cd4d0 2024-04-25T10:08:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.010+0000 7fef0cc00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 0x7feeec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.010+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feef8084a10 con 0x7fef100cd4d0 2024-04-25T10:08:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.010+0000 7fef0fe00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 0x7feeec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.010+0000 7fef0fe00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 0x7feeec069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fef000af000 tx=0x7fef000a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.014+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feef8020020 con 0x7fef100cd4d0 2024-04-25T10:08:48.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef100745d0 con 0x7fef100cd4d0 2024-04-25T10:08:48.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef0cc00640 1 -- 172.21.15.18:0/144068450 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4940 (secure 0 0 0) 0x7feef8005480 con 0x7fef100cd4d0 2024-04-25T10:08:48.217 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:48.218 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":46,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:36.421005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":35843},"failed":[],"damaged":[],"stopped":[],"info":{"gid_35843":{"gid":35843,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/301895266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":301895266},{"type":"v1","addr":"172.21.15.18:6835","nonce":301895266}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:48.218 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 46 2024-04-25T10:08:48.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 msgr2=0x7feeec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 0x7feeec069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fef000af000 tx=0x7fef000a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 msgr2=0x7fef100b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7feef800c450 tx=0x7feef800c910 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 shutdown_connections 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef10145270 0x7fef10140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100cd4d0 0x7fef100b3900 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feeec066f60 0x7feeec069420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 --2- 172.21.15.18:0/144068450 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef100b1e60 0x7fef10142990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 >> 172.21.15.18:0/144068450 conn(0x7fef10066fa0 msgr2=0x7fef10144500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 shutdown_connections 2024-04-25T10:08:48.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.210+0000 7fef16c00640 1 -- 172.21.15.18:0/144068450 wait complete. 2024-04-25T10:08:48.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T10:08:48.408 INFO:teuthology.orchestra.run.smithi018.stdout:{"message":"","return_code":0} 2024-04-25T10:08:48.409 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:08:48.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:08:48.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 Processor -- start 2024-04-25T10:08:48.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 -- start start 2024-04-25T10:08:48.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0cdc144120 0x7f0cdc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0ccbf0 0x7f0cdc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cdc15bc40 con 0x7f0cdc15ee60 2024-04-25T10:08:48.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cdc15e490 con 0x7f0cdc144120 2024-04-25T10:08:48.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc15b3a0 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce2600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0cdc15ee60 0x7f0cdc0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46518/0 (socket says 172.21.15.18:46518) 2024-04-25T10:08:48.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce2600640 1 -- 172.21.15.18:0/601868785 learned_addr learned my addr 172.21.15.18:0/601868785 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:48.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.542+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/601868785 >> v2:172.21.15.18:3300/0 conn(0x7f0cdc144120 0x7f0cdc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1200640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0ccbf0 0x7f0cdc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0cdbe00640 1 -- 172.21.15.18:0/601868785 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202393282 0 0) 0x7f0cdc15bc40 con 0x7f0cdc15ee60 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0cdbe00640 1 -- 172.21.15.18:0/601868785 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc4003530 con 0x7f0cdc15ee60 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1c00640 1 -- 172.21.15.18:0/601868785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0ccbf0 msgr2=0x7f0cdc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0ccbf0 0x7f0cdc15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1c00640 1 -- 172.21.15.18:0/601868785 >> v1:172.21.15.18:6789/0 conn(0x7f0cdc15ee60 legacy=0x7f0cdc0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1c00640 1 -- 172.21.15.18:0/601868785 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc15b680 con 0x7f0cdc144120 2024-04-25T10:08:48.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc144120 0x7f0cdc15acd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097c0 tx=0x7f0cd001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacd388f03465323 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0cdbe00640 1 -- 172.21.15.18:0/601868785 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b0070 con 0x7f0cdc144120 2024-04-25T10:08:48.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0cdbe00640 1 -- 172.21.15.18:0/601868785 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00ab600 con 0x7f0cdc144120 2024-04-25T10:08:48.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0cdbe00640 1 -- 172.21.15.18:0/601868785 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00ab9d0 con 0x7f0cdc144120 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 -- 172.21.15.18:0/601868785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc144120 msgr2=0x7f0cdc15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc144120 0x7f0cdc15acd0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0cd00097c0 tx=0x7f0cd001c410 comp rx=0 tx=0).stop 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 -- 172.21.15.18:0/601868785 shutdown_connections 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc0ccbf0 0x7f0cdc15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 --2- 172.21.15.18:0/601868785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc144120 0x7f0cdc15acd0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 -- 172.21.15.18:0/601868785 >> 172.21.15.18:0/601868785 conn(0x7f0cdc067080 msgr2=0x7f0cdc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.546+0000 7f0ce4600640 1 -- 172.21.15.18:0/601868785 shutdown_connections 2024-04-25T10:08:48.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 -- 172.21.15.18:0/601868785 wait complete. 2024-04-25T10:08:48.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 Processor -- start 2024-04-25T10:08:48.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 -- start start 2024-04-25T10:08:48.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 0x7f0cdc13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc15ee60 0x7f0cdc13e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc1675c0 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc167440 con 0x7f0cdc144120 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cdc167740 con 0x7f0cdc15ee60 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52586/0 (socket says 172.21.15.18:52586) 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 -- 172.21.15.18:0/877483904 learned_addr learned my addr 172.21.15.18:0/877483904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce2600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc15ee60 0x7f0cdc13e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1200640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 0x7f0cdc13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 -- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc15ee60 msgr2=0x7f0cdc13e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc15ee60 0x7f0cdc13e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 -- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 msgr2=0x7f0cdc13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 0x7f0cdc13dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 -- 172.21.15.18:0/877483904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc13b940 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1200640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 0x7f0cdc13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0ce1c00640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001a040 tx=0x7f0cd001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b0050 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.550+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd00bc070 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00b5830 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc15d290 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cdc15d850 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cdc0745d0 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0cd00b59d0 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0cd9600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 0x7f0cbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0cd011f900 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.554+0000 7f0ce1200640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 0x7f0cbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.558+0000 7f0ce1200640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 0x7f0cbc069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0b4610 tx=0x7f0cc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.558+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0cd0016090 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.758+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0cdc06f570 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.768 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:08:48.758+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:08:48.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.762+0000 7f0cd9600640 1 -- 172.21.15.18:0/877483904 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v47) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0cd00f0770 con 0x7f0cdc0ccbf0 2024-04-25T10:08:48.770 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:08:48.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 msgr2=0x7f0cbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 0x7f0cbc069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0b4610 tx=0x7f0cc8008040 comp rx=0 tx=0).stop 2024-04-25T10:08:48.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 msgr2=0x7f0cdc13ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0cd001a040 tx=0x7f0cd001ac50 comp rx=0 tx=0).stop 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 shutdown_connections 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0cbc066f60 0x7f0cbc069420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0cdc15ee60 0x7f0cdc13e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cdc144120 0x7f0cdc13dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 --2- 172.21.15.18:0/877483904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0cdc0ccbf0 0x7f0cdc13ad50 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 >> 172.21.15.18:0/877483904 conn(0x7f0cdc067080 msgr2=0x7f0cdc0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 shutdown_connections 2024-04-25T10:08:48.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.766+0000 7f0ce4600640 1 -- 172.21.15.18:0/877483904 wait complete. 2024-04-25T10:08:48.782 INFO:tasks.ceph.mds.a.smithi018.stderr: -4496> 2024-04-25T10:08:38.970+0000 7f9bfde00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:08:48.794 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T10:08:48.835 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:08:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 Processor -- start 2024-04-25T10:08:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 -- start start 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1a40690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a40bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db19bd9f0 con 0x564db1a1a290 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db19c1950 con 0x564db1aec270 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe1a0378080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564db1aedfe0 con 0x564db1a1a670 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52628/0 (socket says 172.21.15.18:52628) 2024-04-25T10:08:48.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 -- 172.21.15.18:0/1454021338 learned_addr learned my addr 172.21.15.18:0/1454021338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19cc00640 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1a40690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19e000640 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a40bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 -- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 msgr2=0x564db1a40690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1a40690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 -- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 msgr2=0x564db1a40bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a40bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.838+0000 7fe19d600640 1 -- 172.21.15.18:0/1454021338 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db1aef630 con 0x564db1a1a290 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe19000b330 tx=0x7fe19000b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ca8a5ba75927ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe197400640 1 -- 172.21.15.18:0/1454021338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190012020 con 0x564db1a1a290 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe197400640 1 -- 172.21.15.18:0/1454021338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000d6b0 con 0x564db1a1a290 2024-04-25T10:08:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe197400640 1 -- 172.21.15.18:0/1454021338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000da80 con 0x564db1a1a290 2024-04-25T10:08:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- 172.21.15.18:0/1454021338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 msgr2=0x564db1aeed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe19000b330 tx=0x7fe19000b7f0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- 172.21.15.18:0/1454021338 shutdown_connections 2024-04-25T10:08:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a40bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1a40690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- 172.21.15.18:0/1454021338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1aeed20 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- 172.21.15.18:0/1454021338 >> 172.21.15.18:0/1454021338 conn(0x564db1a17c30 msgr2=0x564db1a5fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- 172.21.15.18:0/1454021338 shutdown_connections 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- 172.21.15.18:0/1454021338 wait complete. 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 Processor -- start 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- start start 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1a469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1ae59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a45060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db1aef8d0 con 0x564db1a1a290 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564db1aefb70 con 0x564db1aec270 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe1a0378080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564db1ae6210 con 0x564db1a1a670 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1a469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1a469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52632/0 (socket says 172.21.15.18:52632) 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 -- 172.21.15.18:0/4293826552 learned_addr learned my addr 172.21.15.18:0/4293826552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19cc00640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1ae59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19e000640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a45060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 -- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 msgr2=0x564db1ae59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564db1a1a670 0x564db1ae59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 -- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 msgr2=0x564db1a45060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a45060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 -- 172.21.15.18:0/4293826552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564db1a45ac0 con 0x564db1a1a290 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19e000640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564db1aec270 0x564db1a45060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe19d600640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1a469e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe190000f70 tx=0x7fe190000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.842+0000 7fe196000640 1 -- 172.21.15.18:0/4293826552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe190027070 con 0x564db1a1a290 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe196000640 1 -- 172.21.15.18:0/4293826552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19000e690 con 0x564db1a1a290 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564db1a45d60 con 0x564db1a1a290 2024-04-25T10:08:48.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe196000640 1 -- 172.21.15.18:0/4293826552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19000ea80 con 0x564db1a1a290 2024-04-25T10:08:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564db1a462a0 con 0x564db1a1a290 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe196000640 1 -- 172.21.15.18:0/4293826552 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe190015020 con 0x564db1a1a290 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe196000640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe180065940 0x7fe180067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe196000640 1 -- 172.21.15.18:0/4293826552 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe1900853e0 con 0x564db1a1a290 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe1a0378080 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x564db1a455a0 0x564db1ae36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) v9 -- 0x564db1ae3bf0 con 0x564db1a455a0 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe19cc00640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe180065940 0x7fe180067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.846+0000 7fe19e000640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x564db1a455a0 0x564db1ae36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.850+0000 7fe19e000640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x564db1a455a0 0x564db1ae36b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.850+0000 7fe19cc00640 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe180065940 0x7fe180067e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ac000 tx=0x7fe18c0a5000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.850+0000 7fe19e000640 1 -- 172.21.15.18:0/4293826552 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v82'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe198001610 con 0x564db1a455a0 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.850+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x564db1a455a0 msgr2=0x564db1ae36b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.850+0000 7fe1a0378080 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x564db1a455a0 0x564db1ae36b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe180065940 msgr2=0x7fe180067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe180065940 0x7fe180067e00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0ac000 tx=0x7fe18c0a5000 comp rx=0 tx=0).stop 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 msgr2=0x564db1a469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 --2- 172.21.15.18:0/4293826552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564db1a1a290 0x564db1a469e0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fe190000f70 tx=0x7fe190000ee0 comp rx=0 tx=0).stop 2024-04-25T10:08:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe19e000640 1 -- 172.21.15.18:0/4293826552 reap_dead start 2024-04-25T10:08:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 shutdown_connections 2024-04-25T10:08:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 >> 172.21.15.18:0/4293826552 conn(0x564db1a17c30 msgr2=0x564db1aeab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 shutdown_connections 2024-04-25T10:08:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:48.854+0000 7fe1a0378080 1 -- 172.21.15.18:0/4293826552 wait complete. 2024-04-25T10:08:48.866 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:08:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 Processor -- start 2024-04-25T10:08:49.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 -- start start 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0a94159320 0x7f0a9415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 0x7f0a9406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9415fc00 con 0x7f0a9406e010 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9406d640 con 0x7f0a94159320 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a99200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9415fee0 con 0x7f0a9415f440 2024-04-25T10:08:49.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a92800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0a9406e010 0x7f0a9406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46532/0 (socket says 172.21.15.18:46532) 2024-04-25T10:08:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a92800640 1 -- 172.21.15.18:0/2074124505 learned_addr learned my addr 172.21.15.18:0/2074124505 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:49.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a8be00640 1 --2- 172.21.15.18:0/2074124505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 0x7f0a9406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a91e00640 1 --2- 172.21.15.18:0/2074124505 >> v2:172.21.15.167:3300/0 conn(0x7f0a94159320 0x7f0a9415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a91400640 1 -- 172.21.15.18:0/2074124505 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670273667 0 0) 0x7f0a9415fc00 con 0x7f0a9406e010 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a91400640 1 -- 172.21.15.18:0/2074124505 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a78003530 con 0x7f0a9406e010 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a8be00640 1 -- 172.21.15.18:0/2074124505 >> v2:172.21.15.167:3300/0 conn(0x7f0a94159320 msgr2=0x7f0a9415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a8be00640 1 --2- 172.21.15.18:0/2074124505 >> v2:172.21.15.167:3300/0 conn(0x7f0a94159320 0x7f0a9415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a8be00640 1 -- 172.21.15.18:0/2074124505 >> v1:172.21.15.18:6789/0 conn(0x7f0a9406e010 legacy=0x7f0a9406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.046+0000 7f0a8be00640 1 -- 172.21.15.18:0/2074124505 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a941601c0 con 0x7f0a9415f440 2024-04-25T10:08:49.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a8be00640 1 --2- 172.21.15.18:0/2074124505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 0x7f0a9406dad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44ca0978454071d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a91400640 1 -- 172.21.15.18:0/2074124505 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ab600 con 0x7f0a9415f440 2024-04-25T10:08:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a91400640 1 -- 172.21.15.18:0/2074124505 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c0b0070 con 0x7f0a9415f440 2024-04-25T10:08:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a91400640 1 -- 172.21.15.18:0/2074124505 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0ab9c0 con 0x7f0a9415f440 2024-04-25T10:08:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 -- 172.21.15.18:0/2074124505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 msgr2=0x7f0a9406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 --2- 172.21.15.18:0/2074124505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 0x7f0a9406dad0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0097c0 tx=0x7f0a7c01c3e0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 -- 172.21.15.18:0/2074124505 shutdown_connections 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 --2- 172.21.15.18:0/2074124505 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9415f440 0x7f0a9406dad0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 --2- 172.21.15.18:0/2074124505 >> v2:172.21.15.167:3300/0 conn(0x7f0a94159320 0x7f0a9415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 -- 172.21.15.18:0/2074124505 >> 172.21.15.18:0/2074124505 conn(0x7f0a94067080 msgr2=0x7f0a9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 -- 172.21.15.18:0/2074124505 shutdown_connections 2024-04-25T10:08:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.050+0000 7f0a99200640 1 -- 172.21.15.18:0/2074124505 wait complete. 2024-04-25T10:08:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 Processor -- start 2024-04-25T10:08:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- start start 2024-04-25T10:08:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 0x7f0a9413c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94159320 0x7f0a94157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94071c00 con 0x7f0a9415f440 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a94071a80 con 0x7f0a94159320 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9406ebb0 con 0x7f0a9406e010 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52646/0 (socket says 172.21.15.18:52646) 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 -- 172.21.15.18:0/632786769 learned_addr learned my addr 172.21.15.18:0/632786769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a8be00640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94159320 0x7f0a94157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a91e00640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 0x7f0a9413c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 -- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 msgr2=0x7f0a9413c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 0x7f0a9413c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 -- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94159320 msgr2=0x7f0a94157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94159320 0x7f0a94157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 -- 172.21.15.18:0/632786769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9413c750 con 0x7f0a9415f440 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a91e00640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 0x7f0a9413c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a92800640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cae0 tx=0x7f0a8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c017070 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c00ac40 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9413a950 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c012640 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9413af10 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.054+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9413b9d0 con 0x7f0a9415f440 2024-04-25T10:08:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.058+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a8c01a070 con 0x7f0a9415f440 2024-04-25T10:08:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.058+0000 7f0a8a000640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 0x7f0a70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.058+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0a8c084fe0 con 0x7f0a9415f440 2024-04-25T10:08:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.058+0000 7f0a91e00640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 0x7f0a70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.058+0000 7f0a91e00640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 0x7f0a70069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009bb0 tx=0x7f0a84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.062+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0a9413b9d0 con 0x7f0a9415f440 2024-04-25T10:08:49.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.262+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f0a9406f140 con 0x7f0a9415f440 2024-04-25T10:08:49.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.762+0000 7f0a8a000640 1 -- 172.21.15.18:0/632786769 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v48) v1 ==== 162+0+0 (secure 0 0 0) 0x7f0a8c055740 con 0x7f0a9415f440 2024-04-25T10:08:49.773 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:08:49.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 msgr2=0x7f0a70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 0x7f0a70069420 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0a84009bb0 tx=0x7f0a84008040 comp rx=0 tx=0).stop 2024-04-25T10:08:49.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 msgr2=0x7f0a9413ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00cae0 tx=0x7f0a8c00a060 comp rx=0 tx=0).stop 2024-04-25T10:08:49.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 shutdown_connections 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a9415f440 0x7f0a9413ebd0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a94159320 0x7f0a94157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a70066f60 0x7f0a70069420 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 --2- 172.21.15.18:0/632786769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a9406e010 0x7f0a9413c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 >> 172.21.15.18:0/632786769 conn(0x7f0a94067080 msgr2=0x7f0a9415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 shutdown_connections 2024-04-25T10:08:49.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.766+0000 7f0a99200640 1 -- 172.21.15.18:0/632786769 wait complete. 2024-04-25T10:08:49.801 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.934+0000 7ffb2fe00640 1 Processor -- start 2024-04-25T10:08:49.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.934+0000 7ffb2fe00640 1 -- start start 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffb28145270 0x7ffb2815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2fe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280cc4e0 con 0x7ffb280cd4d0 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2fe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb280ce040 con 0x7ffb280b1e60 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2fe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb28145650 con 0x7ffb28145270 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2ca00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffb280cd4d0 0x7ffb280b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46542/0 (socket says 172.21.15.18:46542) 2024-04-25T10:08:49.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2ca00640 1 -- 172.21.15.18:0/1411910874 learned_addr learned my addr 172.21.15.18:0/1411910874 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1411910874 >> v2:172.21.15.167:3300/0 conn(0x7ffb28145270 0x7ffb2815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635402528 0 0) 0x7ffb280cc4e0 con 0x7ffb280cd4d0 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb10003530 con 0x7ffb280cd4d0 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288476043 0 0) 0x7ffb280ce040 con 0x7ffb280b1e60 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb280cc4e0 con 0x7ffb280b1e60 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 211011195 0 0) 0x7ffb10003530 con 0x7ffb280cd4d0 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 >> v2:172.21.15.167:3300/0 conn(0x7ffb28145270 msgr2=0x7ffb2815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 --2- 172.21.15.18:0/1411910874 >> v2:172.21.15.167:3300/0 conn(0x7ffb28145270 0x7ffb2815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 >> v1:172.21.15.167:6789/0 conn(0x7ffb280b1e60 legacy=0x7ffb2815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280ce320 con 0x7ffb280cd4d0 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ffb14001680 con 0x7ffb280cd4d0 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1411910874 >> v2:172.21.15.167:3300/0 conn(0x7ffb28145270 0x7ffb2815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 >> v1:172.21.15.18:6789/0 conn(0x7ffb280cd4d0 legacy=0x7ffb280b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb10003ba0 0x7ffb10003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb10004810 0x7ffb10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 0x7ffb1000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb28145650 con 0x7ffb100051d0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1000c0a0 con 0x7ffb10004810 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1000c2a0 con 0x7ffb10003ba0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 0x7ffb1000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2ca00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb10004810 0x7ffb10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2d400640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb10003ba0 0x7ffb10003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 -- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb10003ba0 msgr2=0x7ffb10003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb10003ba0 0x7ffb10003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 -- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb10004810 msgr2=0x7ffb10004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb10004810 0x7ffb10004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2de00640 1 -- 172.21.15.18:0/1411910874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb10003530 con 0x7ffb100051d0 2024-04-25T10:08:49.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.938+0000 7ffb2ca00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb10004810 0x7ffb10004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:49.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2de00640 1 -- 172.21.15.18:0/1411910874 reap_dead start 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2de00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 0x7ffb1000b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001fd0 tx=0x7ffb2001c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce1bb233c055d2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb20001c20 con 0x7ffb100051d0 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb20003b80 con 0x7ffb100051d0 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb27e00640 1 -- 172.21.15.18:0/1411910874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb200050d0 con 0x7ffb100051d0 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 msgr2=0x7ffb1000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 0x7ffb1000b9d0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ffb20001fd0 tx=0x7ffb2001c8d0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- 172.21.15.18:0/1411910874 shutdown_connections 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/1411910874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb100051d0 0x7ffb1000b9d0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- 172.21.15.18:0/1411910874 >> 172.21.15.18:0/1411910874 conn(0x7ffb28066fa0 msgr2=0x7ffb2806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- 172.21.15.18:0/1411910874 shutdown_connections 2024-04-25T10:08:49.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- 172.21.15.18:0/1411910874 wait complete. 2024-04-25T10:08:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 Processor -- start 2024-04-25T10:08:49.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.942+0000 7ffb2fe00640 1 -- start start 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 0x7ffb280ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 0x7ffb280adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2815f930 con 0x7ffb280a9040 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2815f650 con 0x7ffb100051d0 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2815fe50 con 0x7ffb280cb380 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52660/0 (socket says 172.21.15.18:52660) 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 -- 172.21.15.18:0/2847153216 learned_addr learned my addr 172.21.15.18:0/2847153216 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2de00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 0x7ffb280adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 0x7ffb280ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 -- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 msgr2=0x7ffb280adf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 0x7ffb280adf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 -- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 msgr2=0x7ffb280ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 0x7ffb280ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 -- 172.21.15.18:0/2847153216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb280ab580 con 0x7ffb280a9040 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 0x7ffb280ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2de00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 0x7ffb280adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2ca00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ffb140058b0 tx=0x7ffb14011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14010040 con 0x7ffb280a9040 2024-04-25T10:08:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1401a070 con 0x7ffb280a9040 2024-04-25T10:08:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400fd60 con 0x7ffb280a9040 2024-04-25T10:08:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb280a95a0 con 0x7ffb280a9040 2024-04-25T10:08:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb280a9b60 con 0x7ffb280a9040 2024-04-25T10:08:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb280745d0 con 0x7ffb280a9040 2024-04-25T10:08:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.946+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffb1401f460 con 0x7ffb280a9040 2024-04-25T10:08:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.950+0000 7ffb25600640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 0x7ffb08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.950+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffb140884c0 con 0x7ffb280a9040 2024-04-25T10:08:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.950+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 0x7ffb08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.950+0000 7ffb2d400640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 0x7ffb08069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009cf0 tx=0x7ffb1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:49.954+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb14059250 con 0x7ffb280a9040 2024-04-25T10:08:50.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.154+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb2806b8e0 con 0x7ffb280a9040 2024-04-25T10:08:50.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb25600640 1 -- 172.21.15.18:0/2847153216 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4941 (secure 0 0 0) 0x7ffb14058b50 con 0x7ffb280a9040 2024-04-25T10:08:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:50.165 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:49.769651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:replay","state_seq":1,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:50.165 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 49 2024-04-25T10:08:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 msgr2=0x7ffb08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 0x7ffb08069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009cf0 tx=0x7ffb1c008040 comp rx=0 tx=0).stop 2024-04-25T10:08:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 msgr2=0x7ffb280ada30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:50.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7ffb140058b0 tx=0x7ffb14011c60 comp rx=0 tx=0).stop 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 shutdown_connections 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb08066f60 0x7ffb08069420 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb280cb380 0x7ffb280adf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb280a9040 0x7ffb280ada30 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 --2- 172.21.15.18:0/2847153216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb100051d0 0x7ffb280ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 >> 172.21.15.18:0/2847153216 conn(0x7ffb28066fa0 msgr2=0x7ffb280cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 shutdown_connections 2024-04-25T10:08:50.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:50.158+0000 7ffb2fe00640 1 -- 172.21.15.18:0/2847153216 wait complete. 2024-04-25T10:08:50.590 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:08:33.379806+0000', 'modified': '2024-04-25T10:08:49.769651+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7020}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7020': {'gid': 7020, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/1522131384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 1522131384}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1522131384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:08:50.590 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7020:up:replay 2024-04-25T10:08:50.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:08:50.915 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:08:51.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:51.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 Processor -- start 2024-04-25T10:08:51.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 -- start start 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb1c15fe50 0x7fbb1c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 0x7fbb1c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1c0b20a0 con 0x7fbb1c145270 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c145650 con 0x7fbb1c15fe50 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb22200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1c1602b0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb1c15fe50 0x7fbb1c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb1c15fe50 0x7fbb1c0b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47104/0 (socket says 172.21.15.18:47104) 2024-04-25T10:08:51.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 -- 172.21.15.18:0/3554055576 learned_addr learned my addr 172.21.15.18:0/3554055576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb1be00640 1 --2- 172.21.15.18:0/3554055576 >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 0x7fbb1c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 -- 172.21.15.18:0/3554055576 >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 msgr2=0x7fbb1c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 --2- 172.21.15.18:0/3554055576 >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 0x7fbb1c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 -- 172.21.15.18:0/3554055576 >> v1:172.21.15.167:6789/0 conn(0x7fbb1c145270 legacy=0x7fbb1c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb13e00640 1 -- 172.21.15.18:0/3554055576 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0cc4e0 con 0x7fbb1c15fe50 2024-04-25T10:08:51.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.734+0000 7fbb1be00640 1 --2- 172.21.15.18:0/3554055576 >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 0x7fbb1c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:51.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb13e00640 1 --2- 172.21.15.18:0/3554055576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c15fe50 0x7fbb1c0b1750 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b4b90 tx=0x7fbb0401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac9cf0143456121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:51.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb1aa00640 1 -- 172.21.15.18:0/3554055576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040b0070 con 0x7fbb1c15fe50 2024-04-25T10:08:51.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb1aa00640 1 -- 172.21.15.18:0/3554055576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb040ab600 con 0x7fbb1c15fe50 2024-04-25T10:08:51.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb1aa00640 1 -- 172.21.15.18:0/3554055576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb040ab9d0 con 0x7fbb1c15fe50 2024-04-25T10:08:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 -- 172.21.15.18:0/3554055576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c15fe50 msgr2=0x7fbb1c0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 --2- 172.21.15.18:0/3554055576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c15fe50 0x7fbb1c0b1750 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c0b4b90 tx=0x7fbb0401c2d0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 -- 172.21.15.18:0/3554055576 shutdown_connections 2024-04-25T10:08:51.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 --2- 172.21.15.18:0/3554055576 >> v2:172.21.15.167:3300/0 conn(0x7fbb1c0b1c90 0x7fbb1c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 --2- 172.21.15.18:0/3554055576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c15fe50 0x7fbb1c0b1750 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 -- 172.21.15.18:0/3554055576 >> 172.21.15.18:0/3554055576 conn(0x7fbb1c066fa0 msgr2=0x7fbb1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 -- 172.21.15.18:0/3554055576 shutdown_connections 2024-04-25T10:08:51.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.738+0000 7fbb22200640 1 -- 172.21.15.18:0/3554055576 wait complete. 2024-04-25T10:08:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 Processor -- start 2024-04-25T10:08:51.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- start start 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb1c145270 0x7fbb1c144130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb1c15fe50 0x7fbb1c14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c15f930 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c15f650 con 0x7fbb1c145270 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1c0cdbe0 con 0x7fbb1c15fe50 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47114/0 (socket says 172.21.15.18:47114) 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 -- 172.21.15.18:0/3248819021 learned_addr learned my addr 172.21.15.18:0/3248819021 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb13e00640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb1c145270 0x7fbb1c144130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1be00640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb1c15fe50 0x7fbb1c14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 -- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb1c15fe50 msgr2=0x7fbb1c14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb1c15fe50 0x7fbb1c14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 -- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb1c145270 msgr2=0x7fbb1c144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:51.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb1c145270 0x7fbb1c144130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 -- 172.21.15.18:0/3248819021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1c0b3910 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb1b400640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c480 tx=0x7fbb0c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:51.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c012830 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c017070 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c012c30 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1c0b3bf0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.742+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1c0b41b0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.746+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb1c0b44e0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.746+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb0c01c460 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.746+0000 7fbb13400640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 0x7fbaf8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:51.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.746+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbb0c085160 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.746+0000 7fbb13e00640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 0x7fbaf8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:51.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.750+0000 7fbb13e00640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 0x7fbaf8069420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbb040ad000 tx=0x7fbb04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:51.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.750+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb0c055ef0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb1c0745d0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb13400640 1 -- 172.21.15.18:0/3248819021 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fbb0c0557f0 con 0x7fbb1c0b1c90 2024-04-25T10:08:51.954 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:51.955 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:50.776450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:51.955 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 51 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 msgr2=0x7fbaf8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 0x7fbaf8069420 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbb040ad000 tx=0x7fbb04008040 comp rx=0 tx=0).stop 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 msgr2=0x7fbb1c0b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00c480 tx=0x7fbb0c00c940 comp rx=0 tx=0).stop 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 shutdown_connections 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbaf8066f60 0x7fbaf8069420 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb1c15fe50 0x7fbb1c14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb1c145270 0x7fbb1c144130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 --2- 172.21.15.18:0/3248819021 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb1c0b1c90 0x7fbb1c0b3310 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:51.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 >> 172.21.15.18:0/3248819021 conn(0x7fbb1c066fa0 msgr2=0x7fbb1c142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:51.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 shutdown_connections 2024-04-25T10:08:51.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:51.946+0000 7fbb22200640 1 -- 172.21.15.18:0/3248819021 wait complete. 2024-04-25T10:08:52.380 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:08:33.379806+0000', 'modified': '2024-04-25T10:08:50.776450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7020}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7020': {'gid': 7020, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.18:6835/1522131384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 1522131384}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1522131384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:08:52.380 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7020:up:rejoin 2024-04-25T10:08:53.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:08:53.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 Processor -- start 2024-04-25T10:08:53.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 -- start start 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f381806e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381806edc0 0x7f38180acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381806d6f0 con 0x7f3818071690 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381806d9d0 con 0x7f381806edc0 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f381e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381806dcb0 con 0x7f38180b22d0 2024-04-25T10:08:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381806edc0 0x7f38180acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381806edc0 0x7f38180acc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47124/0 (socket says 172.21.15.18:47124) 2024-04-25T10:08:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 -- 172.21.15.18:0/2918057499 learned_addr learned my addr 172.21.15.18:0/2918057499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f380ea00640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f381806e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 -- 172.21.15.18:0/2918057499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 msgr2=0x7f381806e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f381806e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 -- 172.21.15.18:0/2918057499 >> v1:172.21.15.167:6789/0 conn(0x7f3818071690 legacy=0x7f3818071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.526+0000 7f3817e00640 1 -- 172.21.15.18:0/2918057499 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381806df90 con 0x7f381806edc0 2024-04-25T10:08:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f3817e00640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381806edc0 0x7f38180acc60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3810009870 tx=0x7f381001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe7b35349bdf304 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f3816a00640 1 -- 172.21.15.18:0/2918057499 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100a9610 con 0x7f381806edc0 2024-04-25T10:08:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f3816a00640 1 -- 172.21.15.18:0/2918057499 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100a97b0 con 0x7f381806edc0 2024-04-25T10:08:53.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f3816a00640 1 -- 172.21.15.18:0/2918057499 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100a9b80 con 0x7f381806edc0 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 -- 172.21.15.18:0/2918057499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381806edc0 msgr2=0x7f38180acc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381806edc0 0x7f38180acc60 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3810009870 tx=0x7f381001c530 comp rx=0 tx=0).stop 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 -- 172.21.15.18:0/2918057499 shutdown_connections 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381806edc0 0x7f38180acc60 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 --2- 172.21.15.18:0/2918057499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f381806e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 -- 172.21.15.18:0/2918057499 >> 172.21.15.18:0/2918057499 conn(0x7f38180b17b0 msgr2=0x7f38180b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 -- 172.21.15.18:0/2918057499 shutdown_connections 2024-04-25T10:08:53.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.530+0000 7f381e800640 1 -- 172.21.15.18:0/2918057499 wait complete. 2024-04-25T10:08:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 Processor -- start 2024-04-25T10:08:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- start start 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381806edc0 0x7f38180b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f3818156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381816a970 con 0x7f3818071690 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381816a7f0 con 0x7f381806edc0 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381816aaf0 con 0x7f38180b22d0 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47126/0 (socket says 172.21.15.18:47126) 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 -- 172.21.15.18:0/438767869 learned_addr learned my addr 172.21.15.18:0/438767869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f3817400640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381806edc0 0x7f38180b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f3817e00640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f3818156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 -- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 msgr2=0x7f3818156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f3818156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 -- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381806edc0 msgr2=0x7f38180b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381806edc0 0x7f38180b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 -- 172.21.15.18:0/438767869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381814f0a0 con 0x7f3818071690 2024-04-25T10:08:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380ea00640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f380000d800 tx=0x7f380000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000b6c0 con 0x7f3818071690 2024-04-25T10:08:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3800019070 con 0x7f3818071690 2024-04-25T10:08:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000ba60 con 0x7f3818071690 2024-04-25T10:08:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381814f380 con 0x7f3818071690 2024-04-25T10:08:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381814f940 con 0x7f3818071690 2024-04-25T10:08:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.534+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381815ea50 con 0x7f3818071690 2024-04-25T10:08:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.538+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f380000bc00 con 0x7f3818071690 2024-04-25T10:08:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.538+0000 7f380fe00640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.538+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f38000855f0 con 0x7f3818071690 2024-04-25T10:08:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.538+0000 7f3817400640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.538+0000 7f3817400640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 0x7f37f4069450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3808001e00 tx=0x7f3808009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:53.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.542+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3800055d30 con 0x7f3818071690 2024-04-25T10:08:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38180745d0 con 0x7f3818071690 2024-04-25T10:08:53.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f380fe00640 1 -- 172.21.15.18:0/438767869 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f3800059dd0 con 0x7f3818071690 2024-04-25T10:08:53.747 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:53.747 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:51.777590+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:08:53.747 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 52 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 msgr2=0x7f37f4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 0x7f37f4069450 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3808001e00 tx=0x7f3808009040 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 msgr2=0x7f3818156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f380000d800 tx=0x7f380000dcc0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 shutdown_connections 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f4066f90 0x7f37f4069450 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38180b22d0 0x7f3818156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3818071690 0x7f3818156980 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 --2- 172.21.15.18:0/438767869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381806edc0 0x7f38180b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 >> 172.21.15.18:0/438767869 conn(0x7f38180b17b0 msgr2=0x7f3818161ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 shutdown_connections 2024-04-25T10:08:53.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:53.738+0000 7f381e800640 1 -- 172.21.15.18:0/438767869 wait complete. 2024-04-25T10:08:54.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 52, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:08:33.379806+0000', 'modified': '2024-04-25T10:08:51.777590+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 82, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7020}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7020': {'gid': 7020, 'name': 'a', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/1522131384', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 1522131384}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1522131384}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:08:54.171 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:08:54.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T10:08:54.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 Processor -- start 2024-04-25T10:08:54.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 -- start start 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84c815acd0 0x7f84c815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c815bc40 con 0x7f84c815ee60 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c815b3a0 con 0x7f84c8144120 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84d0400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c815e490 con 0x7f84c815acd0 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84cd000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84c815acd0 0x7f84c815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84ce400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f84c815ee60 0x7f84c80b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59844/0 (socket says 172.21.15.18:59844) 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84ce400640 1 -- 172.21.15.18:0/2975695359 learned_addr learned my addr 172.21.15.18:0/2975695359 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:54.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84cd000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84c815acd0 0x7f84c815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47136/0 (socket says 172.21.15.18:47136) 2024-04-25T10:08:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84cd000640 1 -- 172.21.15.18:0/2975695359 >> v1:172.21.15.167:6789/0 conn(0x7f84c8144120 legacy=0x7f84c80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84cd000640 1 -- 172.21.15.18:0/2975695359 >> v1:172.21.15.18:6789/0 conn(0x7f84c815ee60 legacy=0x7f84c80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.310+0000 7f84cd000640 1 -- 172.21.15.18:0/2975695359 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c815b680 con 0x7f84c815acd0 2024-04-25T10:08:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84cd000640 1 --2- 172.21.15.18:0/2975695359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815acd0 0x7f84c815e920 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f84b40097c0 tx=0x7f84b401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21bb055273f3b74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84c7e00640 1 -- 172.21.15.18:0/2975695359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40b0070 con 0x7f84c815acd0 2024-04-25T10:08:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84c7e00640 1 -- 172.21.15.18:0/2975695359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b40ab600 con 0x7f84c815acd0 2024-04-25T10:08:54.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84c7e00640 1 -- 172.21.15.18:0/2975695359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40ab9d0 con 0x7f84c815acd0 2024-04-25T10:08:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 -- 172.21.15.18:0/2975695359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815acd0 msgr2=0x7f84c815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 --2- 172.21.15.18:0/2975695359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815acd0 0x7f84c815e920 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f84b40097c0 tx=0x7f84b401c410 comp rx=0 tx=0).stop 2024-04-25T10:08:54.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 -- 172.21.15.18:0/2975695359 shutdown_connections 2024-04-25T10:08:54.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 --2- 172.21.15.18:0/2975695359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815acd0 0x7f84c815e920 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 -- 172.21.15.18:0/2975695359 >> 172.21.15.18:0/2975695359 conn(0x7f84c8067080 msgr2=0x7f84c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 -- 172.21.15.18:0/2975695359 shutdown_connections 2024-04-25T10:08:54.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.314+0000 7f84d0400640 1 -- 172.21.15.18:0/2975695359 wait complete. 2024-04-25T10:08:54.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 Processor -- start 2024-04-25T10:08:54.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- start start 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 0x7f84c815d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84c815acd0 0x7f84c80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8168660 con 0x7f84c815ee60 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c815b150 con 0x7f84c815acd0 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81687e0 con 0x7f84c8144120 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47148/0 (socket says 172.21.15.18:47148) 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 -- 172.21.15.18:0/386120836 learned_addr learned my addr 172.21.15.18:0/386120836 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84cda00640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 0x7f84c815d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84cd000640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84c815acd0 0x7f84c80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 -- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 msgr2=0x7f84c815d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 0x7f84c815d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 -- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84c815acd0 msgr2=0x7f84c80cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84c815acd0 0x7f84c80cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 -- 172.21.15.18:0/386120836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80aa330 con 0x7f84c815ee60 2024-04-25T10:08:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84cda00640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 0x7f84c815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:54.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84ce400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f84c000ca80 tx=0x7f84c000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84c5600640 1 -- 172.21.15.18:0/386120836 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0017070 con 0x7f84c815ee60 2024-04-25T10:08:54.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84c5600640 1 -- 172.21.15.18:0/386120836 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c000ac30 con 0x7f84c815ee60 2024-04-25T10:08:54.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84c5600640 1 -- 172.21.15.18:0/386120836 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0012600 con 0x7f84c815ee60 2024-04-25T10:08:54.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c81f7340 con 0x7f84c815ee60 2024-04-25T10:08:54.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.318+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c81f7ba0 con 0x7f84c815ee60 2024-04-25T10:08:54.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84c5600640 1 -- 172.21.15.18:0/386120836 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84c001a070 con 0x7f84c815ee60 2024-04-25T10:08:54.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84c5600640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 0x7f84a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84c5600640 1 -- 172.21.15.18:0/386120836 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f84c0084e80 con 0x7f84c815ee60 2024-04-25T10:08:54.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84d395d000 1 Processor -- start 2024-04-25T10:08:54.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84d395d000 1 -- start start 2024-04-25T10:08:54.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84cda00640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 0x7f84a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84cda00640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 0x7f84a8069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f70 tx=0x7f84bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84d395d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0389f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.322+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d039310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10cf205f0 con 0x55e10d082920 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce87da0 con 0x55e10d083240 2024-04-25T10:08:54.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce10150 con 0x55e10d038f30 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47162/0 (socket says 172.21.15.18:47162) 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 -- 172.21.15.18:0/325228518 learned_addr learned my addr 172.21.15.18:0/325228518 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84ce400640 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d039310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cd000640 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 -- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 msgr2=0x55e10d039310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d039310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 -- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 msgr2=0x55e10d0389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 -- 172.21.15.18:0/325228518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e10ce29ca0 con 0x55e10d082920 2024-04-25T10:08:54.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84cda00640 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005150 tx=0x7f84bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22157c80d928250 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84ba000640 1 -- 172.21.15.18:0/325228518 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc003600 con 0x55e10d082920 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84ba000640 1 -- 172.21.15.18:0/325228518 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0037a0 con 0x55e10d082920 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84ba000640 1 -- 172.21.15.18:0/325228518 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc003b50 con 0x55e10d082920 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- 172.21.15.18:0/325228518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 msgr2=0x55e10d082d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005150 tx=0x7f84bc011000 comp rx=0 tx=0).stop 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- 172.21.15.18:0/325228518 shutdown_connections 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d039310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- 172.21.15.18:0/325228518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d082920 0x55e10d082d00 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- 172.21.15.18:0/325228518 >> 172.21.15.18:0/325228518 conn(0x55e10d03f2a0 msgr2=0x55e10d0372d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- 172.21.15.18:0/325228518 shutdown_connections 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- 172.21.15.18:0/325228518 wait complete. 2024-04-25T10:08:54.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- start start 2024-04-25T10:08:54.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 Processor -- start 2024-04-25T10:08:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d089c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d08a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.326+0000 7f84d395d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce42990 con 0x55e10d083240 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce83e40 con 0x55e10d082920 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce13900 con 0x55e10d038f30 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 10 client.0 _ll_register_callbacks cb 0x55e10cf3b1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47164/0 (socket says 172.21.15.18:47164) 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 -- 172.21.15.18:0/1329705812 learned_addr learned my addr 172.21.15.18:0/1329705812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84cd000640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d08a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84cda00640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d089c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 -- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 msgr2=0x55e10d089c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d089c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 -- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 msgr2=0x55e10d08a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d08a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 -- 172.21.15.18:0/1329705812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e10ce40630 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84cda00640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d089c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84ce400640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f84c00519e0 tx=0x7f84c0055710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bcb196856f11aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0053990 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84bc0037a0 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f84c0004b70 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c006d120 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 10 client.7068 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55e10ce103a0 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0037a0 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f84c0059150 con 0x55e10d083240 2024-04-25T10:08:54.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 10 client.7068 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 10 client.7068 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 20 client.7068 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03e160 0x55e10d093ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 4 client.7068 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e10ce23a50 con 0x55e10d03e160 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84cda00640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03e160 0x55e10d093ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84cda00640 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03e160 0x55e10d093ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b01c73aa776c709f server_cookie=7693c39063cb3b25 in_seq=0 out_seq=0 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 10 client.7068 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 1 -- 172.21.15.18:0/1329705812 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e10ce23a50 con 0x55e10d03e160 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 10 client.7068 handle_command_reply: tid=0 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 client.7068 shutdown 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 msgr2=0x55e10d03caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f84c00519e0 tx=0x7f84c0055710 comp rx=0 tx=0).stop 2024-04-25T10:08:54.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 shutdown_connections 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03e160 0x55e10d093ce0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d083240 0x55e10d03caa0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d08a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 --2- 172.21.15.18:0/1329705812 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d038f30 0x55e10d089c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84aea00640 0 client.7068 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 >> 172.21.15.18:0/1329705812 conn(0x55e10d03f2a0 msgr2=0x55e10d0379e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.330+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 shutdown_connections 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.334+0000 7f84d395d000 1 -- 172.21.15.18:0/1329705812 wait complete. 2024-04-25T10:08:54.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.334+0000 7f84d395d000 20 client.7068 trim_cache size 0 max 16384 2024-04-25T10:08:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.346+0000 7f84d395d000 1 Processor -- start 2024-04-25T10:08:54.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.346+0000 7f84d395d000 1 -- start start 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d082920 0x55e10d0de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0dee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8202960 con 0x55e10d038f30 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80af910 con 0x55e10d083240 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80aff10 con 0x55e10d082920 2024-04-25T10:08:54.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47168/0 (socket says 172.21.15.18:47168) 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 -- 172.21.15.18:0/502623525 learned_addr learned my addr 172.21.15.18:0/502623525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cd000640 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d082920 0x55e10d0de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84ce400640 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0dee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 -- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d082920 msgr2=0x55e10d0de8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d082920 0x55e10d0de8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 -- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 msgr2=0x55e10d0dee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0dee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 -- 172.21.15.18:0/502623525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e10d083070 con 0x55e10d038f30 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84cda00640 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005630 tx=0x7f84bc005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8363a0f6f62d3eb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84b9600640 1 -- 172.21.15.18:0/502623525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0039d0 con 0x55e10d038f30 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84b9600640 1 -- 172.21.15.18:0/502623525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc003b70 con 0x55e10d038f30 2024-04-25T10:08:54.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84b9600640 1 -- 172.21.15.18:0/502623525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc02e380 con 0x55e10d038f30 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- 172.21.15.18:0/502623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 msgr2=0x55e10d0de3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f84bc005630 tx=0x7f84bc005000 comp rx=0 tx=0).stop 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- 172.21.15.18:0/502623525 shutdown_connections 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d083240 0x55e10d0dee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d082920 0x55e10d0de8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 --2- 172.21.15.18:0/502623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0de3a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- 172.21.15.18:0/502623525 >> 172.21.15.18:0/502623525 conn(0x55e10d03f2a0 msgr2=0x55e10d03c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- 172.21.15.18:0/502623525 shutdown_connections 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- 172.21.15.18:0/502623525 wait complete. 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 -- start start 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.350+0000 7f84d395d000 1 Processor -- start 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d083240 0x55e10d0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce8c3d0 con 0x55e10d038f30 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e10cf43d50 con 0x55e10d082920 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e10ce22980 con 0x55e10d083240 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 10 client.0 _ll_register_callbacks cb 0x7f84bc001e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47182/0 (socket says 172.21.15.18:47182) 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 -- 172.21.15.18:0/2135404316 learned_addr learned my addr 172.21.15.18:0/2135404316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cd000640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84ce400640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d083240 0x55e10d0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 -- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d083240 msgr2=0x55e10d0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d083240 0x55e10d0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 -- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 msgr2=0x55e10d0c7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d0c7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 -- 172.21.15.18:0/2135404316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e10cf09600 con 0x55e10d038f30 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cd000640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:54.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cda00640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f84bc015040 tx=0x7f84bc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458ee9273c9fa838 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc03e020 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f84bc02e380 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84bc003b70 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84bc048050 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 10 client.7074 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55e10ce1c9b0 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc003b70 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f84bc04b020 con 0x55e10d038f30 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 10 client.7074 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 10 client.7074 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 20 client.7074 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:54.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03ee50 0x55e10d0c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 4 client.7074 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:08:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e10ce952e0 con 0x55e10d03ee50 2024-04-25T10:08:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cd000640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03ee50 0x55e10d0c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 10 client.7074 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:54.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84cd000640 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03ee50 0x55e10d0c83c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76177b18a6c8dff5 server_cookie=525585a8901f3742 in_seq=0 out_seq=0 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 1 -- 172.21.15.18:0/2135404316 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55e10ce952e0 con 0x55e10d03ee50 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 10 client.7074 handle_command_reply: tid=0 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 client.7074 shutdown 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 msgr2=0x55e10d0c6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f84bc015040 tx=0x7f84bc000ee0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 shutdown_connections 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55e10d03ee50 0x55e10d0c83c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e10d083240 0x55e10d0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e10d082920 0x55e10d0c7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84aea00640 0 client.7074 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 --2- 172.21.15.18:0/2135404316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e10d038f30 0x55e10d0c6f30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 >> 172.21.15.18:0/2135404316 conn(0x55e10d03f2a0 msgr2=0x55e10d08a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 shutdown_connections 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 1 -- 172.21.15.18:0/2135404316 wait complete. 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.354+0000 7f84d395d000 20 client.7074 trim_cache size 0 max 16384 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:08:54.369 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7020, 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.5832393480000002, 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 52, 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 82, 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 82, 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 5.524477858 2024-04-25T10:08:54.370 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 msgr2=0x7f84a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 0x7f84a8069420 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f84bc000f70 tx=0x7f84bc009040 comp rx=0 tx=0).stop 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 msgr2=0x7f84c8159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f84c000ca80 tx=0x7f84c000cf40 comp rx=0 tx=0).stop 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 shutdown_connections 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84c815ee60 0x7f84c8159c90 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84c815acd0 0x7f84c80cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f84a8066f60 0x7f84a8069420 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 --2- 172.21.15.18:0/386120836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f84c8144120 0x7f84c815d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 >> 172.21.15.18:0/386120836 conn(0x7f84c8067080 msgr2=0x7f84c813d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 shutdown_connections 2024-04-25T10:08:54.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.358+0000 7f84d0400640 1 -- 172.21.15.18:0/386120836 wait complete. 2024-04-25T10:08:54.383 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:08:54.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 Processor -- start 2024-04-25T10:08:54.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 -- start start 2024-04-25T10:08:54.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33980ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339815ac60 con 0x7f33980ced60 2024-04-25T10:08:54.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980cf3e0 con 0x7f339806ead0 2024-04-25T10:08:54.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.522+0000 7f339cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339815af20 con 0x7f3398144140 2024-04-25T10:08:54.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f338fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f33980ced60 0x7f339806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59846/0 (socket says 172.21.15.18:59846) 2024-04-25T10:08:54.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f338fe00640 1 -- 172.21.15.18:0/1844441415 learned_addr learned my addr 172.21.15.18:0/1844441415 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395e00640 1 --2- 172.21.15.18:0/1844441415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33980ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 514195602 0 0) 0x7f339815ac60 con 0x7f33980ced60 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f337c003530 con 0x7f33980ced60 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913113018 0 0) 0x7f337c003530 con 0x7f33980ced60 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395e00640 1 -- 172.21.15.18:0/1844441415 >> v1:172.21.15.167:6789/0 conn(0x7f339806ead0 legacy=0x7f33980b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395e00640 1 -- 172.21.15.18:0/1844441415 >> v1:172.21.15.18:6789/0 conn(0x7f33980ced60 legacy=0x7f339806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395e00640 1 -- 172.21.15.18:0/1844441415 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339815b200 con 0x7f3398144140 2024-04-25T10:08:54.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.526+0000 7f3395e00640 1 --2- 172.21.15.18:0/1844441415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33980ce820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f33880097f0 tx=0x7f338801c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8926f70c95b12757 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880b0070 con 0x7f3398144140 2024-04-25T10:08:54.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33880ab400 con 0x7f3398144140 2024-04-25T10:08:54.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395400640 1 -- 172.21.15.18:0/1844441415 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380001680 con 0x7f3398144140 2024-04-25T10:08:54.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- 172.21.15.18:0/1844441415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 msgr2=0x7f33980ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 --2- 172.21.15.18:0/1844441415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33980ce820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f33880097f0 tx=0x7f338801c2b0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- 172.21.15.18:0/1844441415 shutdown_connections 2024-04-25T10:08:54.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 --2- 172.21.15.18:0/1844441415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33980ce820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- 172.21.15.18:0/1844441415 >> 172.21.15.18:0/1844441415 conn(0x7f3398066fa0 msgr2=0x7f339806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- 172.21.15.18:0/1844441415 shutdown_connections 2024-04-25T10:08:54.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- 172.21.15.18:0/1844441415 wait complete. 2024-04-25T10:08:54.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 Processor -- start 2024-04-25T10:08:54.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- start start 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33980ced60 0x7f33981f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33981f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398144520 con 0x7f339806ead0 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33980b1f30 con 0x7f33980ced60 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f339cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339815ba00 con 0x7f3398144140 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47190/0 (socket says 172.21.15.18:47190) 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3395e00640 1 -- 172.21.15.18:0/251912851 learned_addr learned my addr 172.21.15.18:0/251912851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f338fe00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33980ced60 0x7f33981f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.530+0000 7f3396800640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33981f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 -- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 msgr2=0x7f33981f4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33981f4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 -- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33980ced60 msgr2=0x7f33981f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33980ced60 0x7f33981f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 -- 172.21.15.18:0/251912851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398151aa0 con 0x7f339806ead0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3396800640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33981f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f3395e00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f33880ae040 tx=0x7f3388019050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33880b0040 con 0x7f339806ead0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33880bd070 con 0x7f339806ead0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388006e20 con 0x7f339806ead0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3398151d40 con 0x7f339806ead0 2024-04-25T10:08:54.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3398152300 con 0x7f339806ead0 2024-04-25T10:08:54.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33980745d0 con 0x7f339806ead0 2024-04-25T10:08:54.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33880ab7b0 con 0x7f339806ead0 2024-04-25T10:08:54.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 0x7f3374069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:54.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f338811fcb0 con 0x7f339806ead0 2024-04-25T10:08:54.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.534+0000 7f338fe00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 0x7f3374069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:54.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.538+0000 7f338fe00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 0x7f3374069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3380001ec0 tx=0x7f3380001c50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:54.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.538+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3388015ff0 con 0x7f339806ead0 2024-04-25T10:08:54.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f33980b4090 con 0x7f339806ead0 2024-04-25T10:08:54.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f338e000640 1 -- 172.21.15.18:0/251912851 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f33880f0a40 con 0x7f339806ead0 2024-04-25T10:08:54.746 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:08:54.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 msgr2=0x7f3374069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 0x7f3374069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3380001ec0 tx=0x7f3380001c50 comp rx=0 tx=0).stop 2024-04-25T10:08:54.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 msgr2=0x7f33980ca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:54.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f33880ae040 tx=0x7f3388019050 comp rx=0 tx=0).stop 2024-04-25T10:08:54.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 shutdown_connections 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3374066f60 0x7f3374069420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3398144140 0x7f33981f4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f33980ced60 0x7f33981f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 --2- 172.21.15.18:0/251912851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339806ead0 0x7f33980ca220 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 >> 172.21.15.18:0/251912851 conn(0x7f3398066fa0 msgr2=0x7f33980cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 shutdown_connections 2024-04-25T10:08:54.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:54.738+0000 7f339cc00640 1 -- 172.21.15.18:0/251912851 wait complete. 2024-04-25T10:08:54.767 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:08:54.767 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:08:54.768 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:54.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.768 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:08:54.777 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42170sec preferred_lft 42170sec 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:08:54.778 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:08:54.779 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:08:54.780 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.780 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:08:54.780 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:08:54.780 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:08:54.780 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:08:54.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.781 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:08:54.782 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-04-25T10:08:54.774+0000 7feb2c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:08:54.800 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:08:54.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.803 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:08:54.854 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:08:54.854 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:08:54.855 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:08:54.855 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:08:54.855 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:08:54.855 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:08:54.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.855 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:08:54.855 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:08:54.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:08:54.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:08:54.856 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:08:54.856 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:08:54.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.947 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:08:54.957 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:08:54.957 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:08:54.957 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:54.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:54.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:08:55.024 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:08:55.025 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:55.080 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:08:55.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:08:55.081 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:55.132 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:08:55.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:55.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:55.221 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:55.221 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:08:55.235 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:08:55.235 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:08:55.235 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:08:55.235 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:08:55.235 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:08:55.239 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:08:55.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:55.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:55.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:55.259 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:08:55.311 INFO:teuthology.orchestra.run.smithi018.stdout:client7083 2024-04-25T10:08:55.311 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:55.311 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:55.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:55.361 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T10:08:55.419 INFO:teuthology.orchestra.run.smithi018.stdout:file_undamaged 2024-04-25T10:08:55.420 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:08:55.420 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:08:55.420 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:08:55.420 DEBUG:teuthology.orchestra.run.smithi018:> import json 2024-04-25T10:08:55.420 DEBUG:teuthology.orchestra.run.smithi018:> import sys 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> except OSError as e: 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> sys.exit(e.errno) 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> print(json.dumps( 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> indent=2)) 2024-04-25T10:08:55.421 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:08:55.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T10:08:55.541 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T10:08:55.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:55.542 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T10:08:55.594 INFO:teuthology.orchestra.run.smithi018.stdout:2 2024-04-25T10:08:55.594 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:55.594 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:55.644 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:08:55.645 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:08:55.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:08:55.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 Processor -- start 2024-04-25T10:08:55.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 -- start start 2024-04-25T10:08:55.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 0x7fe1f406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1f406e900 0x7fe1f40b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f415ac60 con 0x7fe1f4144140 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f406ed50 con 0x7fe1f406e900 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1fa600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f40cf3e0 con 0x7fe1f40cef30 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe1f4144140 0x7fe1f40ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59848/0 (socket says 172.21.15.18:59848) 2024-04-25T10:08:55.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3400640 1 -- 172.21.15.18:0/3900206640 learned_addr learned my addr 172.21.15.18:0/3900206640 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3e00640 1 --2- 172.21.15.18:0/3900206640 >> v2:172.21.15.18:3300/0 conn(0x7fe1f406e900 0x7fe1f40b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f2a00640 1 --2- 172.21.15.18:0/3900206640 >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 0x7fe1f406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f2000640 1 -- 172.21.15.18:0/3900206640 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555705962 0 0) 0x7fe1f415ac60 con 0x7fe1f4144140 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3e00640 1 -- 172.21.15.18:0/3900206640 >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 msgr2=0x7fe1f406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3e00640 1 --2- 172.21.15.18:0/3900206640 >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 0x7fe1f406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:55.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3e00640 1 -- 172.21.15.18:0/3900206640 >> v1:172.21.15.18:6789/0 conn(0x7fe1f4144140 legacy=0x7fe1f40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:55.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f3e00640 1 -- 172.21.15.18:0/3900206640 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f415af20 con 0x7fe1f406e900 2024-04-25T10:08:55.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.874+0000 7fe1f2a00640 1 --2- 172.21.15.18:0/3900206640 >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 0x7fe1f406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1f3e00640 1 --2- 172.21.15.18:0/3900206640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f406e900 0x7fe1f40b0760 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe1f406efb0 tx=0x7fe1ec01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df2658e920a9d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1f2000640 1 -- 172.21.15.18:0/3900206640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0ad070 con 0x7fe1f406e900 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1f2000640 1 -- 172.21.15.18:0/3900206640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ec0a9620 con 0x7fe1f406e900 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1f2000640 1 -- 172.21.15.18:0/3900206640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ec0a99f0 con 0x7fe1f406e900 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 -- 172.21.15.18:0/3900206640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f406e900 msgr2=0x7fe1f40b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 --2- 172.21.15.18:0/3900206640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f406e900 0x7fe1f40b0760 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fe1f406efb0 tx=0x7fe1ec01c930 comp rx=0 tx=0).stop 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 -- 172.21.15.18:0/3900206640 shutdown_connections 2024-04-25T10:08:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 --2- 172.21.15.18:0/3900206640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f406e900 0x7fe1f40b0760 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 --2- 172.21.15.18:0/3900206640 >> v2:172.21.15.167:3300/0 conn(0x7fe1f40cef30 0x7fe1f406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 -- 172.21.15.18:0/3900206640 >> 172.21.15.18:0/3900206640 conn(0x7fe1f4066fa0 msgr2=0x7fe1f406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 -- 172.21.15.18:0/3900206640 shutdown_connections 2024-04-25T10:08:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.878+0000 7fe1fa600640 1 -- 172.21.15.18:0/3900206640 wait complete. 2024-04-25T10:08:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 Processor -- start 2024-04-25T10:08:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- start start 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 0x7fe1f4143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f4144140 0x7fe1f4167f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f415ba00 con 0x7fe1f40cef30 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f4144520 con 0x7fe1f4144140 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f415bb80 con 0x7fe1f406e900 2024-04-25T10:08:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47214/0 (socket says 172.21.15.18:47214) 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 -- 172.21.15.18:0/1714400324 learned_addr learned my addr 172.21.15.18:0/1714400324 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f3e00640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f4144140 0x7fe1f4167f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f3400640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 0x7fe1f4143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 -- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 msgr2=0x7fe1f4143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 0x7fe1f4143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 -- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f4144140 msgr2=0x7fe1f4167f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f4144140 0x7fe1f4167f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 -- 172.21.15.18:0/1714400324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f41420f0 con 0x7fe1f40cef30 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f3400640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 0x7fe1f4143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1f2a00640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e810 tx=0x7fe1e000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0017070 con 0x7fe1f40cef30 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000c8d0 con 0x7fe1f40cef30 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f41423d0 con 0x7fe1f40cef30 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000f040 con 0x7fe1f40cef30 2024-04-25T10:08:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f4142990 con 0x7fe1f40cef30 2024-04-25T10:08:55.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.882+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f40745d0 con 0x7fe1f40cef30 2024-04-25T10:08:55.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.886+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe1e001a070 con 0x7fe1f40cef30 2024-04-25T10:08:55.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.886+0000 7fe1eb400640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 0x7fe1d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:55.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.886+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe1e0084ed0 con 0x7fe1f40cef30 2024-04-25T10:08:55.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.886+0000 7fe1f3400640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 0x7fe1d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:55.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.886+0000 7fe1f3400640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 0x7fe1d4069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4000f70 tx=0x7fe1e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:55.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:55.890+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe1e0055c60 con 0x7fe1f40cef30 2024-04-25T10:08:56.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1f415a110 con 0x7fe1f40cef30 2024-04-25T10:08:56.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1eb400640 1 -- 172.21.15.18:0/1714400324 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17048 (secure 0 0 0) 0x7fe1e0055560 con 0x7fe1f40cef30 2024-04-25T10:08:56.063 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:08:56.063 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:48.763190+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 msgr2=0x7fe1d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 0x7fe1d4069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4000f70 tx=0x7fe1e4009040 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 msgr2=0x7fe1f4167a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000e810 tx=0x7fe1e000ecd0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 shutdown_connections 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1f4144140 0x7fe1f4167f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1f40cef30 0x7fe1f4167a40 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe1d4066f60 0x7fe1d4069420 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 --2- 172.21.15.18:0/1714400324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe1f406e900 0x7fe1f4143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 >> 172.21.15.18:0/1714400324 conn(0x7fe1f4066fa0 msgr2=0x7fe1f4165c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 shutdown_connections 2024-04-25T10:08:56.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.054+0000 7fe1fa600640 1 -- 172.21.15.18:0/1714400324 wait complete. 2024-04-25T10:08:56.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:08:31.175528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:08:32.386489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:08:56.084 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:08:56.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 Processor -- start 2024-04-25T10:08:56.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 -- start start 2024-04-25T10:08:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 0x7f0e64071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e64072040 0x7f0e64161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e64072460 con 0x7f0e64161cc0 2024-04-25T10:08:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e640b2dc0 con 0x7f0e64072040 2024-04-25T10:08:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e6bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6406ac10 con 0x7f0e6415dd90 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e64072040 0x7f0e64161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0e64072040 0x7f0e64161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47216/0 (socket says 172.21.15.18:47216) 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 -- 172.21.15.18:0/1675073918 learned_addr learned my addr 172.21.15.18:0/1675073918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e69200640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 0x7f0e64071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 -- 172.21.15.18:0/1675073918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 msgr2=0x7f0e64071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 0x7f0e64071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 -- 172.21.15.18:0/1675073918 >> v1:172.21.15.167:6789/0 conn(0x7f0e64161cc0 legacy=0x7f0e640cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e63e00640 1 -- 172.21.15.18:0/1675073918 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6406aeb0 con 0x7f0e64072040 2024-04-25T10:08:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.222+0000 7f0e69200640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 0x7f0e64071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:56.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e63e00640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e64072040 0x7f0e64161780 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009870 tx=0x7f0e5001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b706a8034ff4aea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e63400640 1 -- 172.21.15.18:0/1675073918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500b0070 con 0x7f0e64072040 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e63400640 1 -- 172.21.15.18:0/1675073918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500ab600 con 0x7f0e64072040 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e63400640 1 -- 172.21.15.18:0/1675073918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500ab9d0 con 0x7f0e64072040 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 -- 172.21.15.18:0/1675073918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e64072040 msgr2=0x7f0e64161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e64072040 0x7f0e64161780 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0e50009870 tx=0x7f0e5001c490 comp rx=0 tx=0).stop 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 -- 172.21.15.18:0/1675073918 shutdown_connections 2024-04-25T10:08:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e64072040 0x7f0e64161780 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/1675073918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e6415dd90 0x7f0e64071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 -- 172.21.15.18:0/1675073918 >> 172.21.15.18:0/1675073918 conn(0x7f0e640cfd90 msgr2=0x7f0e640d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 -- 172.21.15.18:0/1675073918 shutdown_connections 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 -- 172.21.15.18:0/1675073918 wait complete. 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.226+0000 7f0e6bc00640 1 Processor -- start 2024-04-25T10:08:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- start start 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e64072040 0x7f0e641589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e64161cc0 0x7f0e641554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6416aac0 con 0x7f0e6415dd90 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e64162540 con 0x7f0e64072040 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6416ac40 con 0x7f0e64161cc0 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47224/0 (socket says 172.21.15.18:47224) 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 -- 172.21.15.18:0/334442165 learned_addr learned my addr 172.21.15.18:0/334442165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e69200640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e64072040 0x7f0e641589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e69c00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e64161cc0 0x7f0e641554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 -- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e64161cc0 msgr2=0x7f0e641554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e64161cc0 0x7f0e641554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 -- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e64072040 msgr2=0x7f0e641589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e64072040 0x7f0e641589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 -- 172.21.15.18:0/334442165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640af580 con 0x7f0e6415dd90 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e63e00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ae040 tx=0x7f0e50019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500b0040 con 0x7f0e6415dd90 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e500b4440 con 0x7f0e6415dd90 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500b4850 con 0x7f0e6415dd90 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e64155ef0 con 0x7f0e6415dd90 2024-04-25T10:08:56.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e64156450 con 0x7f0e6415dd90 2024-04-25T10:08:56.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.230+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e640745d0 con 0x7f0e6415dd90 2024-04-25T10:08:56.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.234+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e500bb020 con 0x7f0e6415dd90 2024-04-25T10:08:56.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.234+0000 7f0e60c00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.234+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0e5011e790 con 0x7f0e6415dd90 2024-04-25T10:08:56.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.234+0000 7f0e69200640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.234+0000 7f0e69200640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0e580075b0 tx=0x7f0e58007540 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.238+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e500c2020 con 0x7f0e6415dd90 2024-04-25T10:08:56.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.398+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e640b36f0 con 0x7f0e6415dd90 2024-04-25T10:08:56.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.398+0000 7f0e60c00640 1 -- 172.21.15.18:0/334442165 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e64155ef0 con 0x7f0e6415dd90 2024-04-25T10:08:56.408 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 msgr2=0x7f0e44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f0e580075b0 tx=0x7f0e58007540 comp rx=0 tx=0).stop 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 msgr2=0x7f0e64150220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0e500ae040 tx=0x7f0e50019230 comp rx=0 tx=0).stop 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 shutdown_connections 2024-04-25T10:08:56.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e64161cc0 0x7f0e641554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e6415dd90 0x7f0e64150220 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 --2- 172.21.15.18:0/334442165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e64072040 0x7f0e641589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 >> 172.21.15.18:0/334442165 conn(0x7f0e640cfd90 msgr2=0x7f0e640d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 shutdown_connections 2024-04-25T10:08:56.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.402+0000 7f0e6bc00640 1 -- 172.21.15.18:0/334442165 wait complete. 2024-04-25T10:08:56.429 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:08:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 Processor -- start 2024-04-25T10:08:56.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 -- start start 2024-04-25T10:08:56.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fda1415dc60 0x7fda140d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda1409a170 0x7fda140cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1415e040 con 0x7fda1406bf30 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140cff80 con 0x7fda1409a170 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda1a000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda140d0260 con 0x7fda1415dc60 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda12a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda1406bf30 0x7fda14099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59852/0 (socket says 172.21.15.18:59852) 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda12a00640 1 -- 172.21.15.18:0/844156525 learned_addr learned my addr 172.21.15.18:0/844156525 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13e00640 1 --2- 172.21.15.18:0/844156525 >> v2:172.21.15.18:3300/0 conn(0x7fda1409a170 0x7fda140cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13400640 1 --2- 172.21.15.18:0/844156525 >> v2:172.21.15.167:3300/0 conn(0x7fda1415dc60 0x7fda140d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13e00640 1 -- 172.21.15.18:0/844156525 >> v2:172.21.15.167:3300/0 conn(0x7fda1415dc60 msgr2=0x7fda140d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:56.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13e00640 1 --2- 172.21.15.18:0/844156525 >> v2:172.21.15.167:3300/0 conn(0x7fda1415dc60 0x7fda140d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13e00640 1 -- 172.21.15.18:0/844156525 >> v1:172.21.15.18:6789/0 conn(0x7fda1406bf30 legacy=0x7fda14099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda13e00640 1 -- 172.21.15.18:0/844156525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda140d0540 con 0x7fda1409a170 2024-04-25T10:08:56.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.566+0000 7fda12000640 1 -- 172.21.15.18:0/844156525 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837891037 0 0) 0x7fda1415e040 con 0x7fda1406bf30 2024-04-25T10:08:56.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda13e00640 1 --2- 172.21.15.18:0/844156525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda140cf8a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fda1409a6b0 tx=0x7fda0c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df82a21cf4bb2923 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda12000640 1 -- 172.21.15.18:0/844156525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b2070 con 0x7fda1409a170 2024-04-25T10:08:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda12000640 1 -- 172.21.15.18:0/844156525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c0a5930 con 0x7fda1409a170 2024-04-25T10:08:56.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda12000640 1 -- 172.21.15.18:0/844156525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0a5d00 con 0x7fda1409a170 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- 172.21.15.18:0/844156525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 msgr2=0x7fda140cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 --2- 172.21.15.18:0/844156525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda140cf8a0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fda1409a6b0 tx=0x7fda0c01c870 comp rx=0 tx=0).stop 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- 172.21.15.18:0/844156525 shutdown_connections 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 --2- 172.21.15.18:0/844156525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda140cf8a0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 --2- 172.21.15.18:0/844156525 >> v2:172.21.15.167:3300/0 conn(0x7fda1415dc60 0x7fda140d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- 172.21.15.18:0/844156525 >> 172.21.15.18:0/844156525 conn(0x7fda140b3200 msgr2=0x7fda140b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- 172.21.15.18:0/844156525 shutdown_connections 2024-04-25T10:08:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- 172.21.15.18:0/844156525 wait complete. 2024-04-25T10:08:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 Processor -- start 2024-04-25T10:08:56.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.570+0000 7fda1a000640 1 -- start start 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 0x7fda14157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1415dc60 0x7fda140cae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cc6f0 con 0x7fda1409a170 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cc570 con 0x7fda1415dc60 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda140cc870 con 0x7fda1406bf30 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47238/0 (socket says 172.21.15.18:47238) 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 -- 172.21.15.18:0/1169206023 learned_addr learned my addr 172.21.15.18:0/1169206023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:56.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda13400640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 0x7fda14157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda13e00640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1415dc60 0x7fda140cae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 -- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 msgr2=0x7fda14157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 0x7fda14157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 -- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1415dc60 msgr2=0x7fda140cae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1415dc60 0x7fda140cae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 -- 172.21.15.18:0/1169206023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1409cd70 con 0x7fda1409a170 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda13400640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 0x7fda14157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda12a00640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c520 tx=0x7fda0000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00018070 con 0x7fda1409a170 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000074e0 con 0x7fda1409a170 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1409d050 con 0x7fda1409a170 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda000049f0 con 0x7fda1409a170 2024-04-25T10:08:56.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1409d610 con 0x7fda1409a170 2024-04-25T10:08:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.574+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda140745d0 con 0x7fda1409a170 2024-04-25T10:08:56.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.578+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fda0001b070 con 0x7fda1409a170 2024-04-25T10:08:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.578+0000 7fda0b400640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 0x7fd9f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.578+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fda00084770 con 0x7fda1409a170 2024-04-25T10:08:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.578+0000 7fda13400640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 0x7fd9f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.578+0000 7fda13400640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 0x7fd9f4069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda04009b10 tx=0x7fda04008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.582+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fda00055500 con 0x7fda1409a170 2024-04-25T10:08:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.742+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda140c8550 con 0x7fda1409a170 2024-04-25T10:08:56.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.742+0000 7fda0b400640 1 -- 172.21.15.18:0/1169206023 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda00054e00 con 0x7fda1409a170 2024-04-25T10:08:56.751 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:08:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 msgr2=0x7fd9f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 0x7fd9f4069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fda04009b10 tx=0x7fda04008040 comp rx=0 tx=0).stop 2024-04-25T10:08:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 msgr2=0x7fda14158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fda0000c520 tx=0x7fda0000c9e0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 shutdown_connections 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda1415dc60 0x7fda140cae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda1409a170 0x7fda14158aa0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9f4066f60 0x7fd9f4069420 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 --2- 172.21.15.18:0/1169206023 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fda1406bf30 0x7fda14157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 >> 172.21.15.18:0/1169206023 conn(0x7fda140b3200 msgr2=0x7fda14099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 shutdown_connections 2024-04-25T10:08:56.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.746+0000 7fda1a000640 1 -- 172.21.15.18:0/1169206023 wait complete. 2024-04-25T10:08:56.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:08:56.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.906+0000 7f1f35200640 1 Processor -- start 2024-04-25T10:08:56.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.906+0000 7f1f35200640 1 -- start start 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f35200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 0x7f1f3006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f35200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f300b4840 con 0x7f1f3006c160 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f35200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f300b4b20 con 0x7f1f3015a370 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f35200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3006c5d0 con 0x7f1f3015eab0 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1f3006c160 0x7f1f300cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59856/0 (socket says 172.21.15.18:59856) 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2fe00640 1 -- 172.21.15.18:0/526668432 learned_addr learned my addr 172.21.15.18:0/526668432 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f26a00640 1 --2- 172.21.15.18:0/526668432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 0x7f1f3006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1018786231 0 0) 0x7f1f300b4840 con 0x7f1f3006c160 2024-04-25T10:08:56.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f14003530 con 0x7f1f3006c160 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012359103 0 0) 0x7f1f300b4b20 con 0x7f1f3015a370 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f300b4840 con 0x7f1f3015a370 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f26a00640 1 -- 172.21.15.18:0/526668432 >> v1:172.21.15.167:6789/0 conn(0x7f1f3015a370 legacy=0x7f1f300b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2872770092 0 0) 0x7f1f14003530 con 0x7f1f3006c160 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f26a00640 1 -- 172.21.15.18:0/526668432 >> v1:172.21.15.18:6789/0 conn(0x7f1f3006c160 legacy=0x7f1f300cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.910+0000 7f1f26a00640 1 -- 172.21.15.18:0/526668432 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3015e2b0 con 0x7f1f3015eab0 2024-04-25T10:08:56.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f26a00640 1 --2- 172.21.15.18:0/526668432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 0x7f1f3006bc20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f180097f0 tx=0x7f1f1801cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a23d3b883ee04e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180b0070 con 0x7f1f3015eab0 2024-04-25T10:08:56.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f180ab400 con 0x7f1f3015eab0 2024-04-25T10:08:56.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f2ea00640 1 -- 172.21.15.18:0/526668432 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f28001a00 con 0x7f1f3015eab0 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- 172.21.15.18:0/526668432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 msgr2=0x7f1f3006bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 --2- 172.21.15.18:0/526668432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 0x7f1f3006bc20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1f180097f0 tx=0x7f1f1801cdd0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- 172.21.15.18:0/526668432 shutdown_connections 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 --2- 172.21.15.18:0/526668432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3015eab0 0x7f1f3006bc20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- 172.21.15.18:0/526668432 >> 172.21.15.18:0/526668432 conn(0x7f1f30071930 msgr2=0x7f1f30071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- 172.21.15.18:0/526668432 shutdown_connections 2024-04-25T10:08:56.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- 172.21.15.18:0/526668432 wait complete. 2024-04-25T10:08:56.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 Processor -- start 2024-04-25T10:08:56.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- start start 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006c160 0x7f1f30154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 0x7f1f301503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300ce420 con 0x7f1f3015a370 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300b44d0 con 0x7f1f3015eab0 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.914+0000 7f1f35200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f300ce5a0 con 0x7f1f3006c160 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47250/0 (socket says 172.21.15.18:47250) 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 -- 172.21.15.18:0/1064524033 learned_addr learned my addr 172.21.15.18:0/1064524033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f2f400640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006c160 0x7f1f30154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f2fe00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 0x7f1f301503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 -- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006c160 msgr2=0x7f1f30154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006c160 0x7f1f30154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 -- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 msgr2=0x7f1f301503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 0x7f1f301503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 -- 172.21.15.18:0/1064524033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f30153b20 con 0x7f1f3015a370 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f2fe00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 0x7f1f301503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f26a00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1f180097f0 tx=0x7f1f18019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180b8070 con 0x7f1f3015a370 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f18004020 con 0x7f1f3015a370 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f180b0040 con 0x7f1f3015a370 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f30152d60 con 0x7f1f3015a370 2024-04-25T10:08:56.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f30153320 con 0x7f1f3015a370 2024-04-25T10:08:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3015de10 con 0x7f1f3015a370 2024-04-25T10:08:56.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f18003620 con 0x7f1f3015a370 2024-04-25T10:08:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.918+0000 7f1f27e00640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 0x7f1f0c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.922+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1f1811ec10 con 0x7f1f3015a370 2024-04-25T10:08:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.922+0000 7f1f2f400640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 0x7f1f0c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:56.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.922+0000 7f1f2f400640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 0x7f1f0c069450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f200017c0 tx=0x7f1f20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:56.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:56.922+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f18015ff0 con 0x7f1f3015a370 2024-04-25T10:08:57.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f300cf970 con 0x7f1f3015a370 2024-04-25T10:08:57.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f27e00640 1 -- 172.21.15.18:0/1064524033 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f180ef350 con 0x7f1f3015a370 2024-04-25T10:08:57.099 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 msgr2=0x7f1f0c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 0x7f1f0c069450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f200017c0 tx=0x7f1f20009040 comp rx=0 tx=0).stop 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 msgr2=0x7f1f30149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f1f180097f0 tx=0x7f1f18019110 comp rx=0 tx=0).stop 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 shutdown_connections 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3015eab0 0x7f1f301503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3015a370 0x7f1f30149f20 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f0c066f90 0x7f1f0c069450 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 --2- 172.21.15.18:0/1064524033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f3006c160 0x7f1f30154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.090+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 >> 172.21.15.18:0/1064524033 conn(0x7f1f30071930 msgr2=0x7f1f3015d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.094+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 shutdown_connections 2024-04-25T10:08:57.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.094+0000 7f1f35200640 1 -- 172.21.15.18:0/1064524033 wait complete. 2024-04-25T10:08:57.120 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:08:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 Processor -- start 2024-04-25T10:08:57.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 -- start start 2024-04-25T10:08:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff1200cf3b0 0x7ff120168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12006ac10 con 0x7ff120072210 2024-04-25T10:08:57.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12006aeb0 con 0x7ff12015dd90 2024-04-25T10:08:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff125c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1200b2dc0 con 0x7ff1200cf3b0 2024-04-25T10:08:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff120072210 0x7ff1200cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59862/0 (socket says 172.21.15.18:59862) 2024-04-25T10:08:57.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11e000640 1 -- 172.21.15.18:0/3296029922 learned_addr learned my addr 172.21.15.18:0/3296029922 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:57.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 --2- 172.21.15.18:0/3296029922 >> v2:172.21.15.167:3300/0 conn(0x7ff1200cf3b0 0x7ff120168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797493784 0 0) 0x7ff12006ac10 con 0x7ff120072210 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff104003530 con 0x7ff120072210 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1354281755 0 0) 0x7ff104003530 con 0x7ff120072210 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 >> v2:172.21.15.167:3300/0 conn(0x7ff1200cf3b0 msgr2=0x7ff120168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 --2- 172.21.15.18:0/3296029922 >> v2:172.21.15.167:3300/0 conn(0x7ff1200cf3b0 0x7ff120168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 >> v1:172.21.15.167:6789/0 conn(0x7ff12015dd90 legacy=0x7ff120071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12006b190 con 0x7ff120072210 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff10c001680 con 0x7ff120072210 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 >> v1:172.21.15.18:6789/0 conn(0x7ff120072210 legacy=0x7ff1200cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1040039c0 0x7ff104003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff104004810 0x7ff104004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff10400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10400c0a0 con 0x7ff1040051d0 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10400c250 con 0x7ff104004810 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10400c450 con 0x7ff1040039c0 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff10400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11e000640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff104004810 0x7ff104004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11ea00640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1040039c0 0x7ff104003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 -- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1040039c0 msgr2=0x7ff104003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1040039c0 0x7ff104003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 -- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff104004810 msgr2=0x7ff104004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff104004810 0x7ff104004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.254+0000 7ff11f400640 1 -- 172.21.15.18:0/3296029922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104003530 con 0x7ff1040051d0 2024-04-25T10:08:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff11f400640 1 -- 172.21.15.18:0/3296029922 reap_dead start 2024-04-25T10:08:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff11f400640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff10400b9d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff118009fc0 tx=0x7ff11801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e3a63a5ddf6978 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118009c10 con 0x7ff1040051d0 2024-04-25T10:08:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1180a5d10 con 0x7ff1040051d0 2024-04-25T10:08:57.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff11d600640 1 -- 172.21.15.18:0/3296029922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118003be0 con 0x7ff1040051d0 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 -- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 msgr2=0x7ff10400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff10400b9d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff118009fc0 tx=0x7ff11801ccc0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 -- 172.21.15.18:0/3296029922 shutdown_connections 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 --2- 172.21.15.18:0/3296029922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff10400b9d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 -- 172.21.15.18:0/3296029922 >> 172.21.15.18:0/3296029922 conn(0x7ff1200cfd90 msgr2=0x7ff1200d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 -- 172.21.15.18:0/3296029922 shutdown_connections 2024-04-25T10:08:57.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.258+0000 7ff125c00640 1 -- 172.21.15.18:0/3296029922 wait complete. 2024-04-25T10:08:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 Processor -- start 2024-04-25T10:08:57.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- start start 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1200b3c60 0x7ff1200b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 0x7ff1200aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200cf7c0 con 0x7ff1040051d0 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12006b750 con 0x7ff1200ae5c0 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1200cf940 con 0x7ff1200b3c60 2024-04-25T10:08:57.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47280/0 (socket says 172.21.15.18:47280) 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 -- 172.21.15.18:0/1430373567 learned_addr learned my addr 172.21.15.18:0/1430373567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 -- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1200b3c60 msgr2=0x7ff1200b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1200b3c60 0x7ff1200b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11f400640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 0x7ff1200aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 -- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 msgr2=0x7ff1200aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 0x7ff1200aea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 -- 172.21.15.18:0/1430373567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12015e310 con 0x7ff1040051d0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11f400640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 0x7ff1200aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff11ea00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff110011c40 tx=0x7ff11000f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11000fcb0 con 0x7ff1040051d0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11001a070 con 0x7ff1040051d0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff110005310 con 0x7ff1040051d0 2024-04-25T10:08:57.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12015e5f0 con 0x7ff1040051d0 2024-04-25T10:08:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.262+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12015ebb0 con 0x7ff1040051d0 2024-04-25T10:08:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12015edb0 con 0x7ff1040051d0 2024-04-25T10:08:57.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff110013040 con 0x7ff1040051d0 2024-04-25T10:08:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff116a00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 0x7ff100069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff110088390 con 0x7ff1040051d0 2024-04-25T10:08:57.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff11e000640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 0x7ff100069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.266+0000 7ff11e000640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 0x7ff100069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff10c001c30 tx=0x7ff10c001ac0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.270+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff12015edb0 con 0x7ff1040051d0 2024-04-25T10:08:57.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1200745d0 con 0x7ff1040051d0 2024-04-25T10:08:57.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff116a00640 1 -- 172.21.15.18:0/1430373567 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v82) v1 ==== 80+0+120 (secure 0 0 0) 0x7ff1100591c0 con 0x7ff1040051d0 2024-04-25T10:08:57.454 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6835/301895266 2024-04-26T10:08:48.763167+0000 2024-04-25T10:08:57.454 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6832/301895266 2024-04-26T10:08:48.763167+0000 2024-04-25T10:08:57.454 INFO:teuthology.orchestra.run.smithi018.stderr:listed 2 entries 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 msgr2=0x7ff100069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 0x7ff100069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff10c001c30 tx=0x7ff10c001ac0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 msgr2=0x7ff12014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff110011c40 tx=0x7ff11000f5a0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 shutdown_connections 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff1200ae5c0 0x7ff1200aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff100066f60 0x7ff100069420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff1200b3c60 0x7ff1200b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 --2- 172.21.15.18:0/1430373567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1040051d0 0x7ff12014d7e0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 >> 172.21.15.18:0/1430373567 conn(0x7ff1200cfd90 msgr2=0x7ff12015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 shutdown_connections 2024-04-25T10:08:57.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.446+0000 7ff125c00640 1 -- 172.21.15.18:0/1430373567 wait complete. 2024-04-25T10:08:57.475 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:08:57.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:57.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:08:57.501 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:08:57.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:57.501 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:08:57.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:57.553 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T10:08:57.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 Processor -- start 2024-04-25T10:08:57.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 -- start start 2024-04-25T10:08:57.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 0x7f8d040ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040cf490 con 0x7f8d0406ead0 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d040cf1b0 con 0x7f8d04071e40 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d0aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d040719b0 con 0x7f8d04144080 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d08a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8d0406ead0 0x7f8d0415e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59868/0 (socket says 172.21.15.18:59868) 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d08a00640 1 -- 172.21.15.18:0/2178890842 learned_addr learned my addr 172.21.15.18:0/2178890842 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:08:57.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d03e00640 1 --2- 172.21.15.18:0/2178890842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 0x7f8d040ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695156774 0 0) 0x7f8d040cf490 con 0x7f8d0406ead0 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce8003530 con 0x7f8d0406ead0 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d03e00640 1 -- 172.21.15.18:0/2178890842 >> v1:172.21.15.167:6789/0 conn(0x7f8d04071e40 legacy=0x7f8d0406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415691228 0 0) 0x7f8d040cf1b0 con 0x7f8d04071e40 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d03e00640 1 -- 172.21.15.18:0/2178890842 >> v1:172.21.15.18:6789/0 conn(0x7f8d0406ead0 legacy=0x7f8d0415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.738+0000 7f8d03e00640 1 -- 172.21.15.18:0/2178890842 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04071360 con 0x7f8d04144080 2024-04-25T10:08:57.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d03e00640 1 --2- 172.21.15.18:0/2178890842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 0x7f8d040ce660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097f0 tx=0x7f8cf401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83228bb01579c2ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40b1070 con 0x7f8d04144080 2024-04-25T10:08:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40ac620 con 0x7f8d04144080 2024-04-25T10:08:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d02a00640 1 -- 172.21.15.18:0/2178890842 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40ac9f0 con 0x7f8d04144080 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 -- 172.21.15.18:0/2178890842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 msgr2=0x7f8d040ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/2178890842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 0x7f8d040ce660 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40097f0 tx=0x7f8cf401c4b0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 -- 172.21.15.18:0/2178890842 shutdown_connections 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/2178890842 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d04144080 0x7f8d040ce660 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 -- 172.21.15.18:0/2178890842 >> 172.21.15.18:0/2178890842 conn(0x7f8d0406ac10 msgr2=0x7f8d0406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 -- 172.21.15.18:0/2178890842 shutdown_connections 2024-04-25T10:08:57.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.742+0000 7f8d0aa00640 1 -- 172.21.15.18:0/2178890842 wait complete. 2024-04-25T10:08:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 Processor -- start 2024-04-25T10:08:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- start start 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d0406ead0 0x7f8d0413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d04071e40 0x7f8d041402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04168730 con 0x7f8d04144080 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d041685b0 con 0x7f8d04071e40 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d041688b0 con 0x7f8d0406ead0 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47292/0 (socket says 172.21.15.18:47292) 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 -- 172.21.15.18:0/303147414 learned_addr learned my addr 172.21.15.18:0/303147414 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d03e00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d0406ead0 0x7f8d0413fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d03400640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d04071e40 0x7f8d041402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 -- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d0406ead0 msgr2=0x7f8d0413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d0406ead0 0x7f8d0413fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 -- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d04071e40 msgr2=0x7f8d041402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d04071e40 0x7f8d041402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 -- 172.21.15.18:0/303147414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0415faa0 con 0x7f8d04144080 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d08a00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00cbe0 tx=0x7f8cfc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8cfbe00640 1 -- 172.21.15.18:0/303147414 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc017070 con 0x7f8d04144080 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8cfbe00640 1 -- 172.21.15.18:0/303147414 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc00ad40 con 0x7f8d04144080 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8cfbe00640 1 -- 172.21.15.18:0/303147414 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc012600 con 0x7f8d04144080 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0415f7c0 con 0x7f8d04144080 2024-04-25T10:08:57.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.746+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0415b000 con 0x7f8d04144080 2024-04-25T10:08:57.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8cfbe00640 1 -- 172.21.15.18:0/303147414 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8cfc01a070 con 0x7f8d04144080 2024-04-25T10:08:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8cfbe00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 0x7f8ce4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8cfbe00640 1 -- 172.21.15.18:0/303147414 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8cfc084f90 con 0x7f8d04144080 2024-04-25T10:08:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 Processor -- start 2024-04-25T10:08:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 -- start start 2024-04-25T10:08:57.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d03e00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 0x7f8ce4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d03e00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 0x7f8ce4069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ae000 tx=0x7f8cf40a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe67110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe67a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbcb5dd0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbc3e010 con 0x55f1fbe67650 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbcb1e70 con 0x55f1fbeb21e0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe67110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.750+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47306/0 (socket says 172.21.15.18:47306) 2024-04-25T10:08:57.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 -- 172.21.15.18:0/1892519345 learned_addr learned my addr 172.21.15.18:0/1892519345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 -- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 msgr2=0x55f1fbe67110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe67110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 -- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 msgr2=0x55f1fbe67a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe67a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 -- 172.21.15.18:0/1892519345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1fbc6e9c0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4097e90 tx=0x7f8cf4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeace64e77d77e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8cf8c00640 1 -- 172.21.15.18:0/1892519345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40c8070 con 0x55f1fbeb18c0 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8cf8c00640 1 -- 172.21.15.18:0/1892519345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40c46e0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8cf8c00640 1 -- 172.21.15.18:0/1892519345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40b1040 con 0x55f1fbeb18c0 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- 172.21.15.18:0/1892519345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 msgr2=0x55f1fbeb1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4097e90 tx=0x7f8cf4004740 comp rx=0 tx=0).stop 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- 172.21.15.18:0/1892519345 shutdown_connections 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe67a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe67110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1892519345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbeb1ca0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- 172.21.15.18:0/1892519345 >> 172.21.15.18:0/1892519345 conn(0x55f1fbd4f870 msgr2=0x55f1fbe659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- 172.21.15.18:0/1892519345 shutdown_connections 2024-04-25T10:08:57.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- 172.21.15.18:0/1892519345 wait complete. 2024-04-25T10:08:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- start start 2024-04-25T10:08:57.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 Processor -- start 2024-04-25T10:08:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe6cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe95de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbc70420 con 0x55f1fbeb18c0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbd38470 con 0x55f1fbe67650 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbe70c20 con 0x55f1fbeb21e0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d0de58000 10 client.0 _ll_register_callbacks cb 0x55f1fbe52f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47322/0 (socket says 172.21.15.18:47322) 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03400640 1 -- 172.21.15.18:0/3615187634 learned_addr learned my addr 172.21.15.18:0/3615187634 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d08a00640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe95de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.754+0000 7f8d03e00640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe6cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 -- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 msgr2=0x55f1fbe95de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe95de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 -- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 msgr2=0x55f1fbe6cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe6cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 -- 172.21.15.18:0/3615187634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1fbc3e260 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03400640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0012540 tx=0x7f8cf0012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f759505a3403c31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0005320 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8cf0018960 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cf40c46e0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cf0018b60 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 10 client.7131 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55f1fbc70b30 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40c46e0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8cf0018d00 con 0x55f1fbeb18c0 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 10 client.7131 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 10 client.7131 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 20 client.7131 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb8af0 0x55f1fbeb8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 4 client.7131 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f1fbc51c80 con 0x55f1fbeb8af0 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03e00640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb8af0 0x55f1fbeb8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d03e00640 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb8af0 0x55f1fbeb8ed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5645e79eb5f183b server_cookie=2f6e6e83387bbc1 in_seq=0 out_seq=0 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 10 client.7131 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 1 -- 172.21.15.18:0/3615187634 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f1fbc51c80 con 0x55f1fbeb8af0 2024-04-25T10:08:57.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 10 client.7131 handle_command_reply: tid=0 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 client.7131 shutdown 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 msgr2=0x55f1fbe958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0012540 tx=0x7f8cf0012a00 comp rx=0 tx=0).stop 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 shutdown_connections 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb8af0 0x55f1fbeb8ed0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb21e0 0x55f1fbe95de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe958a0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8ced600640 0 client.7131 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 --2- 172.21.15.18:0/3615187634 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbe67650 0x55f1fbe6cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 >> 172.21.15.18:0/3615187634 conn(0x55f1fbd4f870 msgr2=0x55f1fbe659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 shutdown_connections 2024-04-25T10:08:57.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 1 -- 172.21.15.18:0/3615187634 wait complete. 2024-04-25T10:08:57.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.758+0000 7f8d0de58000 20 client.7131 trim_cache size 0 max 16384 2024-04-25T10:08:57.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 Processor -- start 2024-04-25T10:08:57.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 -- start start 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 0x55f1fbe6d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe6d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d042033e0 con 0x55f1fbeb21e0 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d042025a0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04201a20 con 0x55f1fbe67650 2024-04-25T10:08:57.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 0x55f1fbe6d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d08a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47330/0 (socket says 172.21.15.18:47330) 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d08a00640 1 -- 172.21.15.18:0/1358018671 learned_addr learned my addr 172.21.15.18:0/1358018671 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.774+0000 7f8d03400640 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe6d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 -- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 msgr2=0x55f1fbe6d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 0x55f1fbe6d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 -- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb18c0 msgr2=0x55f1fbe6d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe6d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 -- 172.21.15.18:0/1358018671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f1fbd3b6d0 con 0x55f1fbeb21e0 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d03e00640 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 0x55f1fbe6d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d08a00640 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc083240 tx=0x7f8cfc083110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c823a14615fb382 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8cefe00640 1 -- 172.21.15.18:0/1358018671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc083350 con 0x55f1fbeb21e0 2024-04-25T10:08:57.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8cefe00640 1 -- 172.21.15.18:0/1358018671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc06d030 con 0x55f1fbeb21e0 2024-04-25T10:08:57.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8cefe00640 1 -- 172.21.15.18:0/1358018671 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc05d8a0 con 0x55f1fbeb21e0 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- 172.21.15.18:0/1358018671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 msgr2=0x55f1fbe67a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc083240 tx=0x7f8cfc083110 comp rx=0 tx=0).stop 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- 172.21.15.18:0/1358018671 shutdown_connections 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbeb21e0 0x55f1fbe67a30 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb18c0 0x55f1fbe6d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- 172.21.15.18:0/1358018671 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbe67650 0x55f1fbe6d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- 172.21.15.18:0/1358018671 >> 172.21.15.18:0/1358018671 conn(0x55f1fbd4f870 msgr2=0x55f1fbe6cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- 172.21.15.18:0/1358018671 shutdown_connections 2024-04-25T10:08:57.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- 172.21.15.18:0/1358018671 wait complete. 2024-04-25T10:08:57.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- start start 2024-04-25T10:08:57.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 Processor -- start 2024-04-25T10:08:57.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb18c0 0x55f1fbeb5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb21e0 0x55f1fbeb64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbcba400 con 0x55f1fbe67650 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04201fd0 con 0x55f1fbeb21e0 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f1fbcb50e0 con 0x55f1fbeb18c0 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.778+0000 7f8d0de58000 10 client.0 _ll_register_callbacks cb 0x55f1fbc52200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47346/0 (socket says 172.21.15.18:47346) 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 -- 172.21.15.18:0/244267669 learned_addr learned my addr 172.21.15.18:0/244267669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03400640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb18c0 0x55f1fbeb5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d08a00640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb21e0 0x55f1fbeb64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 -- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb18c0 msgr2=0x55f1fbeb5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb18c0 0x55f1fbeb5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 -- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb21e0 msgr2=0x55f1fbeb64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb21e0 0x55f1fbeb64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 -- 172.21.15.18:0/244267669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f1fbd38900 con 0x55f1fbe67650 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03e00640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8cf401c4f0 tx=0x7f8cf401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a1891a9ddcea4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40b1040 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8cfc06d030 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8cf40c4840 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8cf40e4050 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 10 client.7137 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x55f1fbc5cf20 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc06d030 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8cf40e7020 con 0x55f1fbe67650 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 10 client.7137 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 10 client.7137 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 20 client.7137 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb6a10 0x55f1fbeb6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 4 client.7137 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T10:08:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x55f1fbcc3310 con 0x55f1fbeb6a10 2024-04-25T10:08:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03400640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb6a10 0x55f1fbeb6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d03400640 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb6a10 0x55f1fbeb6e20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133ad8272b9ec5a6 server_cookie=28dedf405cab375e in_seq=0 out_seq=0 2024-04-25T10:08:57.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 10 client.7137 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 1 -- 172.21.15.18:0/244267669 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f1fbcc3310 con 0x55f1fbeb6a10 2024-04-25T10:08:57.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 10 client.7137 handle_command_reply: tid=0 2024-04-25T10:08:57.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 client.7137 shutdown 2024-04-25T10:08:57.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 msgr2=0x55f1fbf0e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f8cf401c4f0 tx=0x7f8cf401acf0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 shutdown_connections 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55f1fbeb6a10 0x55f1fbeb6e20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f1fbeb21e0 0x55f1fbeb64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55f1fbeb18c0 0x55f1fbeb5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 --2- 172.21.15.18:0/244267669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f1fbe67650 0x55f1fbf0e350 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 >> 172.21.15.18:0/244267669 conn(0x55f1fbd4f870 msgr2=0x55f1fbe6d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8ced600640 0 client.7137 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 shutdown_connections 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 1 -- 172.21.15.18:0/244267669 wait complete. 2024-04-25T10:08:57.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.782+0000 7f8d0de58000 20 client.7137 trim_cache size 0 max 16384 2024-04-25T10:08:57.798 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:57.798 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:08:57.798 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "7625dc69-eb1d-4d7b-a2e3-6a786b099feb", 2024-04-25T10:08:57.798 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:08:57.798 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 msgr2=0x7f8ce4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 0x7f8ce4069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40ae000 tx=0x7f8cf40a7000 comp rx=0 tx=0).stop 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 msgr2=0x7f8d04140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00cbe0 tx=0x7f8cfc00a430 comp rx=0 tx=0).stop 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 shutdown_connections 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d04144080 0x7f8d04140800 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d04071e40 0x7f8d041402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8ce4066f60 0x7f8ce4069420 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 --2- 172.21.15.18:0/303147414 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d0406ead0 0x7f8d0413fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 >> 172.21.15.18:0/303147414 conn(0x7f8d0406ac10 msgr2=0x7f8d0406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 shutdown_connections 2024-04-25T10:08:57.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.786+0000 7f8d0aa00640 1 -- 172.21.15.18:0/303147414 wait complete. 2024-04-25T10:08:57.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:08:57.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T10:08:57.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.946+0000 7f4046000640 1 Processor -- start 2024-04-25T10:08:57.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.946+0000 7f4046000640 1 -- start start 2024-04-25T10:08:57.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4046000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f404015c9b0 0x7f404006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4046000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4046000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404015fc00 con 0x7f4040159320 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4046000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f404006d640 con 0x7f404015c9b0 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4046000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404015fee0 con 0x7f404006e010 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f404015c9b0 0x7f404006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f404015c9b0 0x7f404006dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47348/0 (socket says 172.21.15.18:47348) 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 -- 172.21.15.18:0/1810548032 learned_addr learned my addr 172.21.15.18:0/1810548032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f403fe00640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 -- 172.21.15.18:0/1810548032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 msgr2=0x7f404006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 -- 172.21.15.18:0/1810548032 >> v1:172.21.15.167:6789/0 conn(0x7f4040159320 legacy=0x7f404015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.950+0000 7f4037e00640 1 -- 172.21.15.18:0/1810548032 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40401601c0 con 0x7f404015c9b0 2024-04-25T10:08:57.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4037e00640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f404015c9b0 0x7f404006dad0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f402801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef018336dd2834 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f403ea00640 1 -- 172.21.15.18:0/1810548032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b2070 con 0x7f404015c9b0 2024-04-25T10:08:57.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f403ea00640 1 -- 172.21.15.18:0/1810548032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a9070 con 0x7f404015c9b0 2024-04-25T10:08:57.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f403ea00640 1 -- 172.21.15.18:0/1810548032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ad880 con 0x7f404015c9b0 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- 172.21.15.18:0/1810548032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f404015c9b0 msgr2=0x7f404006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f404015c9b0 0x7f404006dad0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f402801c560 comp rx=0 tx=0).stop 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- 172.21.15.18:0/1810548032 shutdown_connections 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 --2- 172.21.15.18:0/1810548032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f404015c9b0 0x7f404006dad0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- 172.21.15.18:0/1810548032 >> 172.21.15.18:0/1810548032 conn(0x7f4040067080 msgr2=0x7f404006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- 172.21.15.18:0/1810548032 shutdown_connections 2024-04-25T10:08:57.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- 172.21.15.18:0/1810548032 wait complete. 2024-04-25T10:08:57.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 Processor -- start 2024-04-25T10:08:57.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.954+0000 7f4046000640 1 -- start start 2024-04-25T10:08:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404013b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 0x7f40400af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4040168920 con 0x7f4040159320 2024-04-25T10:08:57.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40401687a0 con 0x7f404015c9b0 2024-04-25T10:08:57.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4040168aa0 con 0x7f404006e010 2024-04-25T10:08:57.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47364/0 (socket says 172.21.15.18:47364) 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 -- 172.21.15.18:0/576589559 learned_addr learned my addr 172.21.15.18:0/576589559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f403f400640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404013b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f403fe00640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 0x7f40400af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 -- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 msgr2=0x7f404013b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404013b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 -- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 msgr2=0x7f40400af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 0x7f40400af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 -- 172.21.15.18:0/576589559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40400b2140 con 0x7f4040159320 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f403fe00640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 0x7f40400af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037e00640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0040 tx=0x7f4028019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037400640 1 -- 172.21.15.18:0/576589559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b2040 con 0x7f4040159320 2024-04-25T10:08:57.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037400640 1 -- 172.21.15.18:0/576589559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280aec60 con 0x7f4040159320 2024-04-25T10:08:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404013abb0 con 0x7f4040159320 2024-04-25T10:08:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4037400640 1 -- 172.21.15.18:0/576589559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280b8680 con 0x7f4040159320 2024-04-25T10:08:57.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.958+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404013b170 con 0x7f4040159320 2024-04-25T10:08:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4037400640 1 -- 172.21.15.18:0/576589559 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f40280c0020 con 0x7f4040159320 2024-04-25T10:08:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4037400640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 0x7f401c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4037400640 1 -- 172.21.15.18:0/576589559 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f402811ee60 con 0x7f4040159320 2024-04-25T10:08:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 Processor -- start 2024-04-25T10:08:57.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 0x7f401c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 -- start start 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 0x7f401c069450 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4030001810 tx=0x7f4030009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882c2f0 0x557ce87e1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce87e2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce862eff0 con 0x557ce882b9d0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce85b7150 con 0x557ce87e20a0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce862b090 con 0x557ce882c2f0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47376/0 (socket says 172.21.15.18:47376) 2024-04-25T10:08:57.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 -- 172.21.15.18:0/3902099512 learned_addr learned my addr 172.21.15.18:0/3902099512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f4037e00640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882c2f0 0x557ce87e1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 -- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882c2f0 msgr2=0x557ce87e1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403fe00640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce87e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882c2f0 0x557ce87e1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 -- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 msgr2=0x557ce87e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce87e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 -- 172.21.15.18:0/3902099512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ce87c50d0 con 0x557ce882b9d0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403fe00640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce87e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.962+0000 7f403f400640 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f403000fa90 tx=0x7f4030000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ce52719bd4111d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402fe00640 1 -- 172.21.15.18:0/3902099512 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030025070 con 0x557ce882b9d0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402fe00640 1 -- 172.21.15.18:0/3902099512 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030015bf0 con 0x557ce882b9d0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402fe00640 1 -- 172.21.15.18:0/3902099512 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4030020400 con 0x557ce882b9d0 2024-04-25T10:08:57.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- 172.21.15.18:0/3902099512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 msgr2=0x557ce882bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f403000fa90 tx=0x7f4030000ee0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- 172.21.15.18:0/3902099512 shutdown_connections 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce87e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882c2f0 0x557ce87e1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- 172.21.15.18:0/3902099512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce882bdb0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- 172.21.15.18:0/3902099512 >> 172.21.15.18:0/3902099512 conn(0x557ce87de020 msgr2=0x557ce87e0440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- 172.21.15.18:0/3902099512 shutdown_connections 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- 172.21.15.18:0/3902099512 wait complete. 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- start start 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 Processor -- start 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce88107f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882b9d0 0x557ce8810d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce85f3250 con 0x557ce882c2f0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce85e9690 con 0x557ce87e20a0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce85b7a40 con 0x557ce882b9d0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4049546000 10 client.0 _ll_register_callbacks cb 0x557ce87cce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47380/0 (socket says 172.21.15.18:47380) 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 -- 172.21.15.18:0/1434008178 learned_addr learned my addr 172.21.15.18:0/1434008178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f4037e00640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882b9d0 0x557ce8810d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403f400640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce88107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 -- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882b9d0 msgr2=0x557ce8810d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882b9d0 0x557ce8810d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 -- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 msgr2=0x557ce88107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce88107f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 -- 172.21.15.18:0/1434008178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ce86dc1c0 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f403fe00640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f4038007a70 tx=0x7f4038007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86687f27d3484d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4038010ad0 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.966+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4038010c70 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4030015bf0 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4038010e70 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 10 client.7149 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x557ce86d8170 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4030015bf0 con 0x557ce882c2f0 2024-04-25T10:08:57.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4038028080 con 0x557ce882c2f0 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 10 client.7149 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 10 client.7149 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 20 client.7149 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883bc80 0x557ce883e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 4 client.7149 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ce85cac60 con 0x557ce883bc80 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f403f400640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883bc80 0x557ce883e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f403f400640 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883bc80 0x557ce883e070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbd116b56912d285 server_cookie=ca14f841251c6590 in_seq=0 out_seq=0 2024-04-25T10:08:57.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 10 client.7149 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 1 -- 172.21.15.18:0/1434008178 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557ce85cac60 con 0x557ce883bc80 2024-04-25T10:08:57.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 10 client.7149 handle_command_reply: tid=0 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 client.7149 shutdown 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 msgr2=0x557ce8811270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f4038007a70 tx=0x7f4038007f30 comp rx=0 tx=0).stop 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 shutdown_connections 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883bc80 0x557ce883e070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882c2f0 0x557ce8811270 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce882b9d0 0x557ce8810d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 --2- 172.21.15.18:0/1434008178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce87e20a0 0x557ce88107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f402cc00640 0 client.7149 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 >> 172.21.15.18:0/1434008178 conn(0x557ce87de020 msgr2=0x557ce87e0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 shutdown_connections 2024-04-25T10:08:57.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 1 -- 172.21.15.18:0/1434008178 wait complete. 2024-04-25T10:08:57.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.970+0000 7f4049546000 20 client.7149 trim_cache size 0 max 16384 2024-04-25T10:08:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 Processor -- start 2024-04-25T10:08:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 -- start start 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce88880f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce8888b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4040201850 con 0x557ce882b9d0 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4040200a30 con 0x557ce882c2f0 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404015e0a0 con 0x557ce87e20a0 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47384/0 (socket says 172.21.15.18:47384) 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 -- 172.21.15.18:0/1791797281 learned_addr learned my addr 172.21.15.18:0/1791797281 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f403f400640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce88880f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f403fe00640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce8888b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 -- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 msgr2=0x557ce88880f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce88880f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 -- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 msgr2=0x557ce8888b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce8888b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 -- 172.21.15.18:0/1791797281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ce8675de0 con 0x557ce882b9d0 2024-04-25T10:08:57.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f403fe00640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce8888b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:08:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f4037e00640 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f402801a190 tx=0x7f40280a4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434ac825b80a56f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:57.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f402f400640 1 -- 172.21.15.18:0/1791797281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280ef4f0 con 0x557ce882b9d0 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f402f400640 1 -- 172.21.15.18:0/1791797281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a9040 con 0x557ce882b9d0 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.986+0000 7f402f400640 1 -- 172.21.15.18:0/1791797281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280f3640 con 0x557ce882b9d0 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1791797281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 msgr2=0x557ce8888630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f402801a190 tx=0x7f40280a4f90 comp rx=0 tx=0).stop 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1791797281 shutdown_connections 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce8888b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce8888630 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- 172.21.15.18:0/1791797281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce88880f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1791797281 >> 172.21.15.18:0/1791797281 conn(0x557ce87de020 msgr2=0x557ce8838fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1791797281 shutdown_connections 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1791797281 wait complete. 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- start start 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 Processor -- start 2024-04-25T10:08:58.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce883e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce883ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ce85c9e00 con 0x557ce882b9d0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4040200430 con 0x557ce882c2f0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557ce862e300 con 0x557ce87e20a0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 10 client.0 _ll_register_callbacks cb 0x557ce87ad040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47386/0 (socket says 172.21.15.18:47386) 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 -- 172.21.15.18:0/1135916279 learned_addr learned my addr 172.21.15.18:0/1135916279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f403fe00640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce883ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f403f400640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce883e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 -- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 msgr2=0x557ce883e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce883e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 -- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 msgr2=0x557ce883ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:08:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce883ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 -- 172.21.15.18:0/1135916279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557ce85d08e0 con 0x557ce882b9d0 2024-04-25T10:08:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4037e00640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f40280c4070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5286f827ec018ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:08:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f402cc00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:08:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402811a030 con 0x557ce882b9d0 2024-04-25T10:08:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f40280f3170 con 0x557ce882b9d0 2024-04-25T10:08:58.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40280a9040 con 0x557ce882b9d0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40280aee10 con 0x557ce882b9d0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 10 client.7155 fetch_fsmap learned FSMap version 52 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.990+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x557ce86888f0 con 0x557ce882b9d0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280a9040 con 0x557ce882b9d0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 52) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f40280b5030 con 0x557ce882b9d0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 10 client.7155 fetch_fsmap finished waiting for FSMap version 52 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 10 client.7155 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 20 client.7155 populate_metadata read hostname 'smithi018' 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883f760 0x557ce8893f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 4 client.7155 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557ce863c530 con 0x557ce883f760 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f403f400640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883f760 0x557ce8893f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f403f400640 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883f760 0x557ce8893f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6065c4a5f304d9 server_cookie=35513067f53df00d in_seq=0 out_seq=0 2024-04-25T10:08:58.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 10 client.7155 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 1 -- 172.21.15.18:0/1135916279 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x557ce863c530 con 0x557ce883f760 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 10 client.7155 handle_command_reply: tid=0 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 client.7155 shutdown 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 msgr2=0x557ce883e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4028009870 tx=0x7f40280c4070 comp rx=0 tx=0).stop 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 shutdown_connections 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x557ce883f760 0x557ce8893f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557ce882c2f0 0x557ce883ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557ce882b9d0 0x557ce883e8c0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 --2- 172.21.15.18:0/1135916279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557ce87e20a0 0x557ce883e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 >> 172.21.15.18:0/1135916279 conn(0x557ce87de020 msgr2=0x557ce882a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f402cc00640 0 client.7155 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 shutdown_connections 2024-04-25T10:08:58.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 1 -- 172.21.15.18:0/1135916279 wait complete. 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4049546000 20 client.7155 trim_cache size 0 max 16384 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "7625dc69-eb1d-4d7b-a2e3-6a786b099feb": { 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/subdir", 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "7625dc69-eb1d-4d7b-a2e3-6a786b099feb", 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive" 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:58.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:08:58.008 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:08:58.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 msgr2=0x7f401c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:58.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 0x7f401c069450 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4030001810 tx=0x7f4030009040 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 msgr2=0x7f404013a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f40280b0040 tx=0x7f4028019300 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 shutdown_connections 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f404015c9b0 0x7f40400af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4040159320 0x7f404013a1f0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f401c066f90 0x7f401c069450 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 --2- 172.21.15.18:0/576589559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f404006e010 0x7f404013b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 >> 172.21.15.18:0/576589559 conn(0x7f4040067080 msgr2=0x7f404015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 shutdown_connections 2024-04-25T10:08:58.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:08:57.994+0000 7f4046000640 1 -- 172.21.15.18:0/576589559 wait complete. 2024-04-25T10:08:58.023 INFO:tasks.cephfs.filesystem:scrub status for tag:7625dc69-eb1d-4d7b-a2e3-6a786b099feb - {'path': '/subdir', 'tag': '7625dc69-eb1d-4d7b-a2e3-6a786b099feb', 'options': 'recursive'} 2024-04-25T10:08:59.801 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:08:59.794+0000 7fb22fa00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T10:09:20.969 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:09:20.974 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:09:28.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:09:28.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T10:09:28.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 Processor -- start 2024-04-25T10:09:28.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 -- start start 2024-04-25T10:09:28.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fce000b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0015bc40 con 0x7fce0015acd0 2024-04-25T10:09:28.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0015b3a0 con 0x7fce00144120 2024-04-25T10:09:28.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce08200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015e490 con 0x7fce000b3090 2024-04-25T10:09:28.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce04e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fce0015acd0 0x7fce0015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57138/0 (socket says 172.21.15.18:57138) 2024-04-25T10:09:28.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.170+0000 7fce04e00640 1 -- 172.21.15.18:0/3777620873 learned_addr learned my addr 172.21.15.18:0/3777620873 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fce000b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014140546 0 0) 0x7fce0015bc40 con 0x7fce0015acd0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8005740 con 0x7fce0015acd0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2125683839 0 0) 0x7fcde8005740 con 0x7fce0015acd0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 msgr2=0x7fce000b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fce000b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 >> v1:172.21.15.167:6789/0 conn(0x7fce00144120 legacy=0x7fce000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0015b680 con 0x7fce0015acd0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fcdec001680 con 0x7fce0015acd0 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 >> v1:172.21.15.18:6789/0 conn(0x7fce0015acd0 legacy=0x7fce0015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fcde8005c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80061a0 0x7fcde8006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde8006f60 0x7fcde80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015e490 con 0x7fcde8006f60 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde800dda0 con 0x7fcde80061a0 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde800dfa0 con 0x7fce000b3090 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde8006f60 0x7fcde80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce05800640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fcde8005c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce04e00640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80061a0 0x7fcde8006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 -- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 msgr2=0x7fcde8005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce000b3090 0x7fcde8005c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 -- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80061a0 msgr2=0x7fcde8006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde80061a0 0x7fcde8006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.174+0000 7fce06200640 1 -- 172.21.15.18:0/3777620873 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8005740 con 0x7fcde8006f60 2024-04-25T10:09:28.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce06200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde8006f60 0x7fcde80073e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009fc0 tx=0x7fcdf801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe7d32bfa1656f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80b2070 con 0x7fcde8006f60 2024-04-25T10:09:28.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80a5bb0 con 0x7fcde8006f60 2024-04-25T10:09:28.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fcdffe00640 1 -- 172.21.15.18:0/3777620873 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8009c10 con 0x7fcde8006f60 2024-04-25T10:09:28.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- 172.21.15.18:0/3777620873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde8006f60 msgr2=0x7fcde80073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 --2- 172.21.15.18:0/3777620873 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcde8006f60 0x7fcde80073e0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8009fc0 tx=0x7fcdf801cc80 comp rx=0 tx=0).stop 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce06200640 1 -- 172.21.15.18:0/3777620873 reap_dead start 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- 172.21.15.18:0/3777620873 shutdown_connections 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- 172.21.15.18:0/3777620873 >> 172.21.15.18:0/3777620873 conn(0x7fce00067080 msgr2=0x7fce0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- 172.21.15.18:0/3777620873 shutdown_connections 2024-04-25T10:09:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- 172.21.15.18:0/3777620873 wait complete. 2024-04-25T10:09:28.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 Processor -- start 2024-04-25T10:09:28.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.178+0000 7fce08200640 1 -- start start 2024-04-25T10:09:28.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 0x7fce001598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00140c80 0x7fce0013cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015f030 con 0x7fce000a8ec0 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015b150 con 0x7fcde8006f60 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0015f1b0 con 0x7fce00140c80 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53686/0 (socket says 172.21.15.18:53686) 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 -- 172.21.15.18:0/1303590722 learned_addr learned my addr 172.21.15.18:0/1303590722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce05800640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 0x7fce001598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce04e00640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00140c80 0x7fce0013cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 -- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00140c80 msgr2=0x7fce0013cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00140c80 0x7fce0013cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 -- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 msgr2=0x7fce001598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 0x7fce001598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 -- 172.21.15.18:0/1303590722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce00141240 con 0x7fce000a8ec0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce05800640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 0x7fce001598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce06200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8002240 tx=0x7fcdf8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fcdfd600640 1 -- 172.21.15.18:0/1303590722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80bd070 con 0x7fce000a8ec0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fcdfd600640 1 -- 172.21.15.18:0/1303590722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80a59b0 con 0x7fce000a8ec0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fcdfd600640 1 -- 172.21.15.18:0/1303590722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf80b2040 con 0x7fce000a8ec0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce000a8710 con 0x7fce000a8ec0 2024-04-25T10:09:28.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0015a0c0 con 0x7fce000a8ec0 2024-04-25T10:09:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.182+0000 7fcdfd600640 1 -- 172.21.15.18:0/1303590722 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcdf80c0070 con 0x7fce000a8ec0 2024-04-25T10:09:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fcdfd600640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 0x7fcde0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fcdfd600640 1 -- 172.21.15.18:0/1303590722 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcdf811ee70 con 0x7fce000a8ec0 2024-04-25T10:09:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce05800640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 0x7fcde0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 Processor -- start 2024-04-25T10:09:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 -- start start 2024-04-25T10:09:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce05800640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 0x7fcde0069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000c10 tx=0x7fcdf4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae149d0 0x55ac2ae14db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2adcb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac2ac17ff0 con 0x55ac2ae152f0 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac2aba0150 con 0x55ac2adcb0a0 2024-04-25T10:09:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac2ac14090 con 0x55ac2ae149d0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce05800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae149d0 0x55ac2ae14db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53688/0 (socket says 172.21.15.18:53688) 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 -- 172.21.15.18:0/2691183354 learned_addr learned my addr 172.21.15.18:0/2691183354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce06200640 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2adcb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 -- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae149d0 msgr2=0x55ac2ae14db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae149d0 0x55ac2ae14db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 -- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 msgr2=0x55ac2adcb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2adcb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 -- 172.21.15.18:0/2691183354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac2adae0d0 con 0x55ac2ae152f0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce04e00640 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fcdec005140 tx=0x7fcdec007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c7f32bb73bc543c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fcdf2000640 1 -- 172.21.15.18:0/2691183354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec014ac0 con 0x55ac2ae152f0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fcdf2000640 1 -- 172.21.15.18:0/2691183354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec014c60 con 0x55ac2ae152f0 2024-04-25T10:09:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fcdf2000640 1 -- 172.21.15.18:0/2691183354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec017660 con 0x55ac2ae152f0 2024-04-25T10:09:28.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 -- 172.21.15.18:0/2691183354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 msgr2=0x55ac2adcab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.186+0000 7fce0b603000 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fcdec005140 tx=0x7fcdec007900 comp rx=0 tx=0).stop 2024-04-25T10:09:28.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2691183354 shutdown_connections 2024-04-25T10:09:28.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2adcb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2adcab60 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- 172.21.15.18:0/2691183354 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae149d0 0x55ac2ae14db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2691183354 >> 172.21.15.18:0/2691183354 conn(0x55ac2adc7020 msgr2=0x55ac2adc9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2691183354 shutdown_connections 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2691183354 wait complete. 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- start start 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 Processor -- start 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2adf9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2adfa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac2abdc250 con 0x55ac2adcb0a0 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac2abd2690 con 0x55ac2ae149d0 2024-04-25T10:09:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac2aba0a40 con 0x55ac2ae152f0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 10 client.0 _ll_register_callbacks cb 0x55ac2adb5e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53702/0 (socket says 172.21.15.18:53702) 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 -- 172.21.15.18:0/2090407010 learned_addr learned my addr 172.21.15.18:0/2090407010 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce04e00640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2adf9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce06200640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2adfa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 -- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 msgr2=0x55ac2adfa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2adfa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 -- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 msgr2=0x55ac2adf9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2adf9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 -- 172.21.15.18:0/2090407010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac2acc51c0 con 0x55ac2adcb0a0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce04e00640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2adf9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce05800640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4015720 tx=0x7fcdf4001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113376594e7055ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4014760 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcdf4014900 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcdec014c60 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdf4030050 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 10 client.7167 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55ac2acc1170 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec014c60 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcdf4033020 con 0x55ac2adcb0a0 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 10 client.7167 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 10 client.7167 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 20 client.7167 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae24c80 0x55ac2ae27070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 4 client.7167 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.190+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac2abb3c60 con 0x55ac2ae24c80 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce04e00640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae24c80 0x55ac2ae27070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce04e00640 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae24c80 0x55ac2ae27070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45b6c1782bd5a2cb server_cookie=a1b0fb5dcdcc3492 in_seq=0 out_seq=0 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fcde6a00640 10 client.7167 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fcde6a00640 1 -- 172.21.15.18:0/2090407010 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ac2abb3c60 con 0x55ac2ae24c80 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fcde6a00640 10 client.7167 handle_command_reply: tid=0 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 client.7167 shutdown 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 msgr2=0x55ac2adf97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4015720 tx=0x7fcdf4001130 comp rx=0 tx=0).stop 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 shutdown_connections 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae24c80 0x55ac2ae27070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2adfa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2adf9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 --2- 172.21.15.18:0/2090407010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2adcb0a0 0x55ac2adf97f0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fcde6a00640 0 client.7167 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 >> 172.21.15.18:0/2090407010 conn(0x55ac2adc7020 msgr2=0x55ac2adc9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 shutdown_connections 2024-04-25T10:09:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 1 -- 172.21.15.18:0/2090407010 wait complete. 2024-04-25T10:09:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.194+0000 7fce0b603000 20 client.7167 trim_cache size 0 max 16384 2024-04-25T10:09:28.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 Processor -- start 2024-04-25T10:09:28.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- start start 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2ae710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2ae71b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001fc570 con 0x55ac2ae149d0 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001fb750 con 0x55ac2adcb0a0 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce001fab80 con 0x55ac2ae152f0 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53712/0 (socket says 172.21.15.18:53712) 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 -- 172.21.15.18:0/2239804145 learned_addr learned my addr 172.21.15.18:0/2239804145 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce05800640 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2ae710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce06200640 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2ae71b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 -- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 msgr2=0x55ac2ae71b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2ae71b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 -- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 msgr2=0x55ac2ae710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2ae710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 -- 172.21.15.18:0/2239804145 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac2ac5ede0 con 0x55ac2ae149d0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce04e00640 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001980 tx=0x7fcdec00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8c15791ba007d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fcdf1600640 1 -- 172.21.15.18:0/2239804145 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec032070 con 0x55ac2ae149d0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fcdf1600640 1 -- 172.21.15.18:0/2239804145 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec02cb00 con 0x55ac2ae149d0 2024-04-25T10:09:28.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fcdf1600640 1 -- 172.21.15.18:0/2239804145 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec028030 con 0x55ac2ae149d0 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- 172.21.15.18:0/2239804145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 msgr2=0x55ac2ae71630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fcdec001980 tx=0x7fcdec00c000 comp rx=0 tx=0).stop 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- 172.21.15.18:0/2239804145 shutdown_connections 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2ae152f0 0x55ac2ae71b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae149d0 0x55ac2ae71630 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 --2- 172.21.15.18:0/2239804145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2adcb0a0 0x55ac2ae710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- 172.21.15.18:0/2239804145 >> 172.21.15.18:0/2239804145 conn(0x55ac2adc7020 msgr2=0x55ac2ae21fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- 172.21.15.18:0/2239804145 shutdown_connections 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.210+0000 7fce0b603000 1 -- 172.21.15.18:0/2239804145 wait complete. 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- start start 2024-04-25T10:09:28.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 Processor -- start 2024-04-25T10:09:28.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2adcb0a0 0x55ac2ae27380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2ae278c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac2abb2e00 con 0x55ac2ae152f0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001fb150 con 0x55ac2ae149d0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac2ac17300 con 0x55ac2adcb0a0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 10 client.0 _ll_register_callbacks cb 0x55ac2ad96040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53716/0 (socket says 172.21.15.18:53716) 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 -- 172.21.15.18:0/4180302476 learned_addr learned my addr 172.21.15.18:0/4180302476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce05800640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2adcb0a0 0x55ac2ae27380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce04e00640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2ae278c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 -- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2adcb0a0 msgr2=0x55ac2ae27380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2adcb0a0 0x55ac2ae27380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 -- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 msgr2=0x55ac2ae278c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2ae278c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 -- 172.21.15.18:0/4180302476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac2abb98e0 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce06200640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fcdf801d160 tx=0x7fcdf80ef670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e638d8e9a37271a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf811d230 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcdf80f7780 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcdec02cb00 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdf80f79a0 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 10 client.7173 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55ac2ac718f0 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec02cb00 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcdf80b5050 con 0x55ac2ae152f0 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 10 client.7173 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 10 client.7173 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:28.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 20 client.7173 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae28790 0x55ac2ae7cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 4 client.7173 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ac2ac25530 con 0x55ac2ae28790 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.214+0000 7fce05800640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae28790 0x55ac2ae7cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce05800640 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae28790 0x55ac2ae7cf60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=124fc11e9ae0c2c0 server_cookie=b4c9d9898cad04e1 in_seq=0 out_seq=0 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fcde6a00640 10 client.7173 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fcde6a00640 1 -- 172.21.15.18:0/4180302476 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ac2ac25530 con 0x55ac2ae28790 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fcde6a00640 10 client.7173 handle_command_reply: tid=0 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 client.7173 shutdown 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 msgr2=0x55ac2ae27e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fcdf801d160 tx=0x7fcdf80ef670 comp rx=0 tx=0).stop 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 shutdown_connections 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x55ac2ae28790 0x55ac2ae7cf60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2ae152f0 0x55ac2ae27e00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac2ae149d0 0x55ac2ae278c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 --2- 172.21.15.18:0/4180302476 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ac2adcb0a0 0x55ac2ae27380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fcde6a00640 0 client.7173 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 >> 172.21.15.18:0/4180302476 conn(0x55ac2adc7020 msgr2=0x55ac2ae130a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 shutdown_connections 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 1 -- 172.21.15.18:0/4180302476 wait complete. 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce0b603000 20 client.7173 trim_cache size 0 max 16384 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:09:28.230 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:09:28.231 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:09:28.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 msgr2=0x7fcde0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 0x7fcde0069450 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000c10 tx=0x7fcdf4009040 comp rx=0 tx=0).stop 2024-04-25T10:09:28.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 msgr2=0x7fce000a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8002240 tx=0x7fcdf8009750 comp rx=0 tx=0).stop 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 shutdown_connections 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce000a8ec0 0x7fce000a9340 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcde0066f90 0x7fcde0069450 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fce00140c80 0x7fce0013cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 --2- 172.21.15.18:0/1303590722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcde8006f60 0x7fce001598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 >> 172.21.15.18:0/1303590722 conn(0x7fce00067080 msgr2=0x7fce0015dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 shutdown_connections 2024-04-25T10:09:28.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.218+0000 7fce08200640 1 -- 172.21.15.18:0/1303590722 wait complete. 2024-04-25T10:09:28.245 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:09:28.245 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:09:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 Processor -- start 2024-04-25T10:09:28.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 -- start start 2024-04-25T10:09:28.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f27d40b4920 0x7f27d40afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d415ddf0 con 0x7f27d415da10 2024-04-25T10:09:28.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d406b480 con 0x7f27d40d11b0 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27da800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40d06d0 con 0x7f27d40b4920 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27d415da10 0x7f27d406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57144/0 (socket says 172.21.15.18:57144) 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3400640 1 -- 172.21.15.18:0/2304767372 learned_addr learned my addr 172.21.15.18:0/2304767372 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3e00640 1 --2- 172.21.15.18:0/2304767372 >> v2:172.21.15.167:3300/0 conn(0x7f27d40b4920 0x7f27d40afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d2a00640 1 -- 172.21.15.18:0/2304767372 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845404346 0 0) 0x7f27d415ddf0 con 0x7f27d415da10 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d2a00640 1 -- 172.21.15.18:0/2304767372 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b8003530 con 0x7f27d415da10 2024-04-25T10:09:28.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3e00640 1 -- 172.21.15.18:0/2304767372 >> v1:172.21.15.167:6789/0 conn(0x7f27d40d11b0 legacy=0x7f27d40b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3e00640 1 -- 172.21.15.18:0/2304767372 >> v1:172.21.15.18:6789/0 conn(0x7f27d415da10 legacy=0x7f27d406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.378+0000 7f27d3e00640 1 -- 172.21.15.18:0/2304767372 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40d09b0 con 0x7f27d40b4920 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27d3e00640 1 --2- 172.21.15.18:0/2304767372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40b4920 0x7f27d40afe20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009d90 tx=0x7f27cc01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f443f1e3606f22f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27d2a00640 1 -- 172.21.15.18:0/2304767372 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0b2070 con 0x7f27d40b4920 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27d2a00640 1 -- 172.21.15.18:0/2304767372 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc0a58b0 con 0x7f27d40b4920 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27d2a00640 1 -- 172.21.15.18:0/2304767372 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0a5c60 con 0x7f27d40b4920 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 -- 172.21.15.18:0/2304767372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40b4920 msgr2=0x7f27d40afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 --2- 172.21.15.18:0/2304767372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40b4920 0x7f27d40afe20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f27cc009d90 tx=0x7f27cc01c8e0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 -- 172.21.15.18:0/2304767372 shutdown_connections 2024-04-25T10:09:28.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 --2- 172.21.15.18:0/2304767372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d40b4920 0x7f27d40afe20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 -- 172.21.15.18:0/2304767372 >> 172.21.15.18:0/2304767372 conn(0x7f27d40b2400 msgr2=0x7f27d40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 -- 172.21.15.18:0/2304767372 shutdown_connections 2024-04-25T10:09:28.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.382+0000 7f27da800640 1 -- 172.21.15.18:0/2304767372 wait complete. 2024-04-25T10:09:28.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 Processor -- start 2024-04-25T10:09:28.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- start start 2024-04-25T10:09:28.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d40d11b0 0x7f27d40cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d415da10 0x7f27d4143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d416b900 con 0x7f27d40b4920 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d416b780 con 0x7f27d415da10 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d416ba80 con 0x7f27d40d11b0 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53724/0 (socket says 172.21.15.18:53724) 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 -- 172.21.15.18:0/1129231932 learned_addr learned my addr 172.21.15.18:0/1129231932 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27caa00640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d40d11b0 0x7f27d40cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3e00640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d415da10 0x7f27d4143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 -- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d40d11b0 msgr2=0x7f27d40cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d40d11b0 0x7f27d40cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 -- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d415da10 msgr2=0x7f27d4143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d415da10 0x7f27d4143000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 -- 172.21.15.18:0/1129231932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40ccdf0 con 0x7f27d40b4920 2024-04-25T10:09:28.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27d3400640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c420 tx=0x7f27c400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4017070 con 0x7f27d40b4920 2024-04-25T10:09:28.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4005cf0 con 0x7f27d40b4920 2024-04-25T10:09:28.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d40ceb10 con 0x7f27d40b4920 2024-04-25T10:09:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40072d0 con 0x7f27d40b4920 2024-04-25T10:09:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.386+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d40cf0d0 con 0x7f27d40b4920 2024-04-25T10:09:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d40cb400 con 0x7f27d40b4920 2024-04-25T10:09:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27c401a070 con 0x7f27d40b4920 2024-04-25T10:09:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27cbe00640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 0x7f27b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f27c40844f0 con 0x7f27d40b4920 2024-04-25T10:09:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27caa00640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 0x7f27b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.390+0000 7f27caa00640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 0x7f27b0069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f27d4160e20 tx=0x7f27bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.394+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27c4054cc0 con 0x7f27d40b4920 2024-04-25T10:09:28.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.590+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27d4157850 con 0x7f27d40b4920 2024-04-25T10:09:28.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.590+0000 7f27cbe00640 1 -- 172.21.15.18:0/1129231932 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f27c4058d60 con 0x7f27d40b4920 2024-04-25T10:09:28.600 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:09:28.601 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:08:59.777429+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":6,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:09:28.601 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 53 2024-04-25T10:09:28.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 msgr2=0x7f27b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 0x7f27b0069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f27d4160e20 tx=0x7f27bc009040 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 msgr2=0x7f27d40caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c420 tx=0x7f27c400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 shutdown_connections 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f27d415da10 0x7f27d4143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f27b0066f60 0x7f27b0069420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f27d40d11b0 0x7f27d40cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 --2- 172.21.15.18:0/1129231932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d40b4920 0x7f27d40caec0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 >> 172.21.15.18:0/1129231932 conn(0x7f27d40b2400 msgr2=0x7f27d4159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 shutdown_connections 2024-04-25T10:09:28.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.594+0000 7f27da800640 1 -- 172.21.15.18:0/1129231932 wait complete. 2024-04-25T10:09:28.622 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T10:09:28.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 Processor -- start 2024-04-25T10:09:28.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 -- start start 2024-04-25T10:09:28.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f058c15dc00 0x7f058c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f058c0d0150 0x7f058c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c0b30d0 con 0x7f058c0c70d0 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0cd860 con 0x7f058c15dc00 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0593a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0c7500 con 0x7f058c0d0150 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f058c15dc00 0x7f058c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f058c0c70d0 0x7f058c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57158/0 (socket says 172.21.15.18:57158) 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591a00640 1 -- 172.21.15.18:0/4145286269 learned_addr learned my addr 172.21.15.18:0/4145286269 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f058c15dc00 0x7f058c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53726/0 (socket says 172.21.15.18:53726) 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0583e00640 1 --2- 172.21.15.18:0/4145286269 >> v2:172.21.15.167:3300/0 conn(0x7f058c0d0150 0x7f058c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 -- 172.21.15.18:0/4145286269 >> v2:172.21.15.167:3300/0 conn(0x7f058c0d0150 msgr2=0x7f058c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 --2- 172.21.15.18:0/4145286269 >> v2:172.21.15.167:3300/0 conn(0x7f058c0d0150 0x7f058c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 -- 172.21.15.18:0/4145286269 >> v1:172.21.15.18:6789/0 conn(0x7f058c0c70d0 legacy=0x7f058c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f0591000640 1 -- 172.21.15.18:0/4145286269 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0ccf30 con 0x7f058c15dc00 2024-04-25T10:09:28.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.758+0000 7f058be00640 1 -- 172.21.15.18:0/4145286269 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54688110 0 0) 0x7f058c0b30d0 con 0x7f058c0c70d0 2024-04-25T10:09:28.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0591000640 1 --2- 172.21.15.18:0/4145286269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c15dc00 0x7f058c0af770 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f058c072850 tx=0x7f057c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7357acd5384030 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f058be00640 1 -- 172.21.15.18:0/4145286269 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b0070 con 0x7f058c15dc00 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f058be00640 1 -- 172.21.15.18:0/4145286269 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0ab600 con 0x7f058c15dc00 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f058be00640 1 -- 172.21.15.18:0/4145286269 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0ab9d0 con 0x7f058c15dc00 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 -- 172.21.15.18:0/4145286269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c15dc00 msgr2=0x7f058c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 --2- 172.21.15.18:0/4145286269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c15dc00 0x7f058c0af770 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f058c072850 tx=0x7f057c01c480 comp rx=0 tx=0).stop 2024-04-25T10:09:28.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 -- 172.21.15.18:0/4145286269 shutdown_connections 2024-04-25T10:09:28.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 --2- 172.21.15.18:0/4145286269 >> v2:172.21.15.167:3300/0 conn(0x7f058c0d0150 0x7f058c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 --2- 172.21.15.18:0/4145286269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c15dc00 0x7f058c0af770 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 -- 172.21.15.18:0/4145286269 >> 172.21.15.18:0/4145286269 conn(0x7f058c0b2240 msgr2=0x7f058c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 -- 172.21.15.18:0/4145286269 shutdown_connections 2024-04-25T10:09:28.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.762+0000 7f0593a00640 1 -- 172.21.15.18:0/4145286269 wait complete. 2024-04-25T10:09:28.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 Processor -- start 2024-04-25T10:09:28.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- start start 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f058c0c70d0 0x7f058c153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 0x7f058c153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0cde70 con 0x7f058c0d0150 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0cdcf0 con 0x7f058c0c70d0 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c16a640 con 0x7f058c15dc00 2024-04-25T10:09:28.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53730/0 (socket says 172.21.15.18:53730) 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 -- 172.21.15.18:0/1217051214 learned_addr learned my addr 172.21.15.18:0/1217051214 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0591000640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f058c0c70d0 0x7f058c153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0591a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 0x7f058c153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 -- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 msgr2=0x7f058c153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 0x7f058c153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 -- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f058c0c70d0 msgr2=0x7f058c153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f058c0c70d0 0x7f058c153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 -- 172.21.15.18:0/1217051214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c14a490 con 0x7f058c0d0150 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0591a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 0x7f058c153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:28.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0583e00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f057400e960 tx=0x7f057400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0589600640 1 -- 172.21.15.18:0/1217051214 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0574017070 con 0x7f058c0d0150 2024-04-25T10:09:28.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0589600640 1 -- 172.21.15.18:0/1217051214 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400ca00 con 0x7f058c0d0150 2024-04-25T10:09:28.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0589600640 1 -- 172.21.15.18:0/1217051214 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400cdb0 con 0x7f058c0d0150 2024-04-25T10:09:28.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c14a770 con 0x7f058c0d0150 2024-04-25T10:09:28.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.766+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c153a70 con 0x7f058c0d0150 2024-04-25T10:09:28.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0589600640 1 -- 172.21.15.18:0/1217051214 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f057401a070 con 0x7f058c0d0150 2024-04-25T10:09:28.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0589600640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 0x7f0568069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0589600640 1 -- 172.21.15.18:0/1217051214 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0574085630 con 0x7f058c0d0150 2024-04-25T10:09:28.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0596f37000 1 Processor -- start 2024-04-25T10:09:28.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0591000640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 0x7f0568069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.770+0000 7f0596f37000 1 -- start start 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 0x7f0568069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f057c0ad000 tx=0x7f057c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cdc00 0x56193b6833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b683cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b56aba0 con 0x56193b6cd2e0 2024-04-25T10:09:28.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b4d0090 con 0x56193b6cdc00 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56193b458160 con 0x56193b6838e0 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53734/0 (socket says 172.21.15.18:53734) 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 -- 172.21.15.18:0/1682831858 learned_addr learned my addr 172.21.15.18:0/1682831858 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 -- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 msgr2=0x56193b683cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b683cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 -- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cdc00 msgr2=0x56193b6833a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cdc00 0x56193b6833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 -- 172.21.15.18:0/1682831858 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56193b579c20 con 0x56193b6cd2e0 2024-04-25T10:09:28.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0591000640 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f057c01c4c0 tx=0x7f057c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d823764a9fd121e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0581600640 1 -- 172.21.15.18:0/1682831858 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0c7070 con 0x56193b6cd2e0 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0581600640 1 -- 172.21.15.18:0/1682831858 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0c2440 con 0x56193b6cd2e0 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0581600640 1 -- 172.21.15.18:0/1682831858 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c0b0040 con 0x56193b6cd2e0 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- 172.21.15.18:0/1682831858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 msgr2=0x56193b6cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f057c01c4c0 tx=0x7f057c004740 comp rx=0 tx=0).stop 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- 172.21.15.18:0/1682831858 shutdown_connections 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b683cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cdc00 0x56193b6833a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- 172.21.15.18:0/1682831858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b6cd6c0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- 172.21.15.18:0/1682831858 >> 172.21.15.18:0/1682831858 conn(0x56193b67f890 msgr2=0x56193b681c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- 172.21.15.18:0/1682831858 shutdown_connections 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- 172.21.15.18:0/1682831858 wait complete. 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- start start 2024-04-25T10:09:28.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 Processor -- start 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b6d4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cd2e0 0x56193b6d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b4cc130 con 0x56193b6cdc00 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b494130 con 0x56193b6838e0 2024-04-25T10:09:28.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56193b58e300 con 0x56193b6cd2e0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.774+0000 7f0596f37000 10 client.0 _ll_register_callbacks cb 0x56193b66ebc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53738/0 (socket says 172.21.15.18:53738) 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 -- 172.21.15.18:0/3619974304 learned_addr learned my addr 172.21.15.18:0/3619974304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591000640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b6d4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0583e00640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cd2e0 0x56193b6d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 -- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cd2e0 msgr2=0x56193b6d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cd2e0 0x56193b6d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 -- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 msgr2=0x56193b6d4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b6d4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 -- 172.21.15.18:0/3619974304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56193b4ad060 con 0x56193b6cdc00 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591a00640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f058400d480 tx=0x7f058400d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22048649a60713f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:28.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584019060 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0584014d00 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f057c0c2440 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05840070d0 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 10 client.7194 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x56193b4717c0 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c0c2440 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0584007270 con 0x56193b6cdc00 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 10 client.7194 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 10 client.7194 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 20 client.7194 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b6bbe30 0x56193b6bc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 4 client.7194 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56193b46bcd0 con 0x56193b6bbe30 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591000640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b6bbe30 0x56193b6bc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0591000640 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b6bbe30 0x56193b6bc210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddbec6edb8f4bebe server_cookie=736b9460ea0845ad in_seq=0 out_seq=0 2024-04-25T10:09:28.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 10 client.7194 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 1 -- 172.21.15.18:0/3619974304 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56193b46bcd0 con 0x56193b6bbe30 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 10 client.7194 handle_command_reply: tid=0 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 client.7194 shutdown 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 msgr2=0x56193b6bb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f058400d480 tx=0x7f058400d940 comp rx=0 tx=0).stop 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 shutdown_connections 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b6bbe30 0x56193b6bc210 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b6bb090 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cd2e0 0x56193b6d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 --2- 172.21.15.18:0/3619974304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b6d4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 >> 172.21.15.18:0/3619974304 conn(0x56193b67f890 msgr2=0x56193b682510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f057a000640 0 client.7194 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 shutdown_connections 2024-04-25T10:09:28.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 1 -- 172.21.15.18:0/3619974304 wait complete. 2024-04-25T10:09:28.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.778+0000 7f0596f37000 20 client.7194 trim_cache size 0 max 16384 2024-04-25T10:09:28.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 Processor -- start 2024-04-25T10:09:28.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- start start 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b729500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 0x56193b729a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c2026a0 con 0x56193b6cdc00 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b43d0 con 0x56193b6cd2e0 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b49d0 con 0x56193b6838e0 2024-04-25T10:09:28.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53754/0 (socket says 172.21.15.18:53754) 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 -- 172.21.15.18:0/621137896 learned_addr learned my addr 172.21.15.18:0/621137896 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 -- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 msgr2=0x56193b729500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591000640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b729500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0583e00640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 0x56193b729a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b729500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 -- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 msgr2=0x56193b729a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 0x56193b729a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 -- 172.21.15.18:0/621137896 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56193b48bfc0 con 0x56193b6cdc00 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0583e00640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 0x56193b729a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0591a00640 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0584001750 tx=0x7f0584006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f24562058ae732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0580c00640 1 -- 172.21.15.18:0/621137896 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058402c070 con 0x56193b6cdc00 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0580c00640 1 -- 172.21.15.18:0/621137896 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584002060 con 0x56193b6cdc00 2024-04-25T10:09:28.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0580c00640 1 -- 172.21.15.18:0/621137896 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584007270 con 0x56193b6cdc00 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- 172.21.15.18:0/621137896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 msgr2=0x56193b729f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0584001750 tx=0x7f0584006000 comp rx=0 tx=0).stop 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- 172.21.15.18:0/621137896 shutdown_connections 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cdc00 0x56193b729f80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6cd2e0 0x56193b729a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 --2- 172.21.15.18:0/621137896 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6838e0 0x56193b729500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- 172.21.15.18:0/621137896 >> 172.21.15.18:0/621137896 conn(0x56193b67f890 msgr2=0x56193b6cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- 172.21.15.18:0/621137896 shutdown_connections 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.794+0000 7f0596f37000 1 -- 172.21.15.18:0/621137896 wait complete. 2024-04-25T10:09:28.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- start start 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 Processor -- start 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b72d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cdc00 0x56193b6d19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b46ae70 con 0x56193b6cd2e0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193b458a50 con 0x56193b6838e0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56193b4cf3a0 con 0x56193b6cdc00 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 10 client.0 _ll_register_callbacks cb 0x56193b47c240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53760/0 (socket says 172.21.15.18:53760) 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 -- 172.21.15.18:0/2698524588 learned_addr learned my addr 172.21.15.18:0/2698524588 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0591000640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b72d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0591a00640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cdc00 0x56193b6d19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 -- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cdc00 msgr2=0x56193b6d19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cdc00 0x56193b6d19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 -- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 msgr2=0x56193b72d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b72d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 -- 172.21.15.18:0/2698524588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56193b5299e0 con 0x56193b6cd2e0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0591000640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b72d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0583e00640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f057400e930 tx=0x7f0574055e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775a37dd2aac4133 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057406d020 con 0x56193b6cd2e0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f05740551a0 con 0x56193b6cd2e0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0584002060 con 0x56193b6cd2e0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0574021070 con 0x56193b6cd2e0 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 10 client.7200 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:28.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x56193b46f630 con 0x56193b6cd2e0 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584002060 con 0x56193b6cd2e0 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f05740850b0 con 0x56193b6cd2e0 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 10 client.7200 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 10 client.7200 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 20 client.7200 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b734790 0x56193b736b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 4 client.7200 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x56193b4dd5d0 con 0x56193b734790 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0591000640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b734790 0x56193b736b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 10 client.7200 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0591000640 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b734790 0x56193b736b80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a42f6051b58033 server_cookie=983a714868df4026 in_seq=0 out_seq=0 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 1 -- 172.21.15.18:0/2698524588 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x56193b4dd5d0 con 0x56193b734790 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f057a000640 10 client.7200 handle_command_reply: tid=0 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.798+0000 7f0596f37000 1 client.7200 shutdown 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 msgr2=0x56193b72de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f057400e930 tx=0x7f0574055e10 comp rx=0 tx=0).stop 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 shutdown_connections 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56193b734790 0x56193b736b80 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56193b6cdc00 0x56193b6d19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56193b6cd2e0 0x56193b72de70 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f057a000640 0 client.7200 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 --2- 172.21.15.18:0/2698524588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56193b6838e0 0x56193b72d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 >> 172.21.15.18:0/2698524588 conn(0x56193b67f890 msgr2=0x56193b6ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 shutdown_connections 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 1 -- 172.21.15.18:0/2698524588 wait complete. 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0596f37000 20 client.7200 trim_cache size 0 max 16384 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "dentry", 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 1799116356, 2024-04-25T10:09:28.813 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627776, 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "frag": "*", 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "dname": "file_to_be_damaged", 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_id": "head", 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:09:28.814 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 msgr2=0x7f0568069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 0x7f0568069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f057c0ad000 tx=0x7f057c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 msgr2=0x7f058c1490b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f057400e960 tx=0x7f057400ee20 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 shutdown_connections 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0568066f60 0x7f0568069420 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f058c15dc00 0x7f058c153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f058c0d0150 0x7f058c1490b0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 --2- 172.21.15.18:0/1217051214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f058c0c70d0 0x7f058c153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 >> 172.21.15.18:0/1217051214 conn(0x7f058c0b2240 msgr2=0x7f058c0ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 shutdown_connections 2024-04-25T10:09:28.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.802+0000 7f0593a00640 1 -- 172.21.15.18:0/1217051214 wait complete. 2024-04-25T10:09:28.829 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:09:28.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 Processor -- start 2024-04-25T10:09:28.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 -- start start 2024-04-25T10:09:28.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f53f415b140 0x7f53f415e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53f40cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f415eda0 con 0x7f53f40ce2b0 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f40ce700 con 0x7f53f415b140 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b10e0 con 0x7f53f415b520 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f53f40ce2b0 0x7f53f40b17b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57166/0 (socket says 172.21.15.18:57166) 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f3e00640 1 -- 172.21.15.18:0/1634179084 learned_addr learned my addr 172.21.15.18:0/1634179084 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53eaa00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53f40cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f3400640 1 --2- 172.21.15.18:0/1634179084 >> v2:172.21.15.167:3300/0 conn(0x7f53f415b140 0x7f53f415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565525776 0 0) 0x7f53ec0014a0 con 0x7f53f40ce2b0 2024-04-25T10:09:28.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d8003530 con 0x7f53f40ce2b0 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1282499228 0 0) 0x7f53d8003530 con 0x7f53f40ce2b0 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 msgr2=0x7f53f40cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53f40cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 >> v2:172.21.15.167:3300/0 conn(0x7f53f415b140 msgr2=0x7f53f415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 --2- 172.21.15.18:0/1634179084 >> v2:172.21.15.167:3300/0 conn(0x7f53f415b140 0x7f53f415e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4099e00 con 0x7f53f40ce2b0 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f53ec001bd0 con 0x7f53f40ce2b0 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 >> v1:172.21.15.18:6789/0 conn(0x7f53f40ce2b0 legacy=0x7f53f40b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53d80039c0 0x7f53d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8004d50 0x7f53d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40ce700 con 0x7f53d80039c0 2024-04-25T10:09:28.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40b10e0 con 0x7f53d8004d50 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53d800b9d0 con 0x7f53f415b520 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f3400640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53d80039c0 0x7f53d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53eaa00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.962+0000 7f53f3e00640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8004d50 0x7f53d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 -- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 msgr2=0x7f53d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53f415b520 0x7f53d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 -- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8004d50 msgr2=0x7f53d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53d8004d50 0x7f53d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 -- 172.21.15.18:0/1634179084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8003530 con 0x7f53d80039c0 2024-04-25T10:09:28.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3400640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53d80039c0 0x7f53d8003de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009ae0 tx=0x7f53e401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2178c9287bda84d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40b2070 con 0x7f53d80039c0 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e40a5530 con 0x7f53d80039c0 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f2a00640 1 -- 172.21.15.18:0/1634179084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e40096b0 con 0x7f53d80039c0 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 -- 172.21.15.18:0/1634179084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53d80039c0 msgr2=0x7f53d8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 --2- 172.21.15.18:0/1634179084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53d80039c0 0x7f53d8003de0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009ae0 tx=0x7f53e401ca80 comp rx=0 tx=0).stop 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f3e00640 1 -- 172.21.15.18:0/1634179084 reap_dead start 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 -- 172.21.15.18:0/1634179084 shutdown_connections 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 -- 172.21.15.18:0/1634179084 >> 172.21.15.18:0/1634179084 conn(0x7f53f40d14f0 msgr2=0x7f53f40d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 -- 172.21.15.18:0/1634179084 shutdown_connections 2024-04-25T10:09:28.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.966+0000 7f53f9200640 1 -- 172.21.15.18:0/1634179084 wait complete. 2024-04-25T10:09:28.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 Processor -- start 2024-04-25T10:09:28.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 -- start start 2024-04-25T10:09:28.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d80039c0 0x7f53f40c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f4162e60 0x7f53f4159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4099a60 con 0x7f53f4157aa0 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f409a980 con 0x7f53f4162e60 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f4099be0 con 0x7f53d80039c0 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d80039c0 0x7f53f40c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53770/0 (socket says 172.21.15.18:53770) 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 -- 172.21.15.18:0/3772210381 learned_addr learned my addr 172.21.15.18:0/3772210381 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53eaa00640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f4162e60 0x7f53f4159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 -- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d80039c0 msgr2=0x7f53f40c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d80039c0 0x7f53f40c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 -- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f4162e60 msgr2=0x7f53f4159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f4162e60 0x7f53f4159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 -- 172.21.15.18:0/3772210381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40c6ea0 con 0x7f53f4157aa0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f3e00640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f53f40d25f0 tx=0x7f53ec00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00ec10 con 0x7f53f4157aa0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ec018070 con 0x7f53f4157aa0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec013420 con 0x7f53f4157aa0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.970+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f40c7180 con 0x7f53f4157aa0 2024-04-25T10:09:28.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f40c7740 con 0x7f53f4157aa0 2024-04-25T10:09:28.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f404efa0 con 0x7f53f4157aa0 2024-04-25T10:09:28.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53ec0135c0 con 0x7f53f4157aa0 2024-04-25T10:09:28.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53ebe00640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 0x7f53d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:28.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f53ec085520 con 0x7f53f4157aa0 2024-04-25T10:09:28.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53f3400640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 0x7f53d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:28.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.974+0000 7f53f3400640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 0x7f53d0069420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f53e40af000 tx=0x7f53e40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:28.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:28.978+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53f415eda0 con 0x7f53f4157aa0 2024-04-25T10:09:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f53f4158490 con 0x7f53f4157aa0 2024-04-25T10:09:29.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53ebe00640 1 -- 172.21.15.18:0/3772210381 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f53ec055c60 con 0x7f53f4157aa0 2024-04-25T10:09:29.186 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:09:29.186 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T10:09:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 msgr2=0x7f53d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 0x7f53d0069420 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f53e40af000 tx=0x7f53e40046d0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 msgr2=0x7f53f4157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f53f40d25f0 tx=0x7f53ec00e530 comp rx=0 tx=0).stop 2024-04-25T10:09:29.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 shutdown_connections 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53f4157aa0 0x7f53f4157f50 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f53f4162e60 0x7f53f4159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f53d0066f60 0x7f53d0069420 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 --2- 172.21.15.18:0/3772210381 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f53d80039c0 0x7f53f40c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 >> 172.21.15.18:0/3772210381 conn(0x7f53f40d14f0 msgr2=0x7f53f406bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 shutdown_connections 2024-04-25T10:09:29.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.178+0000 7f53f9200640 1 -- 172.21.15.18:0/3772210381 wait complete. 2024-04-25T10:09:29.207 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:09:29.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:09:29.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T10:09:29.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.342+0000 7f71cba00640 1 Processor -- start 2024-04-25T10:09:29.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.342+0000 7f71cba00640 1 -- start start 2024-04-25T10:09:29.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71cba00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71c4144080 0x7f71c40ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71cba00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40cf490 con 0x7f71c4071e40 2024-04-25T10:09:29.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71cba00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40cf1b0 con 0x7f71c406ead0 2024-04-25T10:09:29.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71cba00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40719b0 con 0x7f71c4144080 2024-04-25T10:09:29.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71c9000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f71c4144080 0x7f71c40ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71bbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f71c4071e40 0x7f71c406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57174/0 (socket says 172.21.15.18:57174) 2024-04-25T10:09:29.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71bbe00640 1 -- 172.21.15.18:0/2191046314 learned_addr learned my addr 172.21.15.18:0/2191046314 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:29.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71c9000640 1 -- 172.21.15.18:0/2191046314 >> v1:172.21.15.167:6789/0 conn(0x7f71c406ead0 legacy=0x7f71c415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71c9000640 1 -- 172.21.15.18:0/2191046314 >> v1:172.21.15.18:6789/0 conn(0x7f71c4071e40 legacy=0x7f71c406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.346+0000 7f71c9000640 1 -- 172.21.15.18:0/2191046314 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4071360 con 0x7f71c4144080 2024-04-25T10:09:29.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71c9000640 1 --2- 172.21.15.18:0/2191046314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4144080 0x7f71c40ce660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f71b40097f0 tx=0x7f71b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25484d4ac6742093 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71c3e00640 1 -- 172.21.15.18:0/2191046314 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40b0070 con 0x7f71c4144080 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71c3e00640 1 -- 172.21.15.18:0/2191046314 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b40ab600 con 0x7f71c4144080 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71c3e00640 1 -- 172.21.15.18:0/2191046314 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40ab9d0 con 0x7f71c4144080 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- 172.21.15.18:0/2191046314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4144080 msgr2=0x7f71c40ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 --2- 172.21.15.18:0/2191046314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4144080 0x7f71c40ce660 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f71b40097f0 tx=0x7f71b401c430 comp rx=0 tx=0).stop 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- 172.21.15.18:0/2191046314 shutdown_connections 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 --2- 172.21.15.18:0/2191046314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c4144080 0x7f71c40ce660 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- 172.21.15.18:0/2191046314 >> 172.21.15.18:0/2191046314 conn(0x7f71c406ac10 msgr2=0x7f71c406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- 172.21.15.18:0/2191046314 shutdown_connections 2024-04-25T10:09:29.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- 172.21.15.18:0/2191046314 wait complete. 2024-04-25T10:09:29.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 Processor -- start 2024-04-25T10:09:29.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.350+0000 7f71cba00640 1 -- start start 2024-04-25T10:09:29.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 0x7f71c40b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 0x7f71c415c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4168730 con 0x7f71c406ead0 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41685b0 con 0x7f71c4071e40 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41688b0 con 0x7f71c4144080 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53796/0 (socket says 172.21.15.18:53796) 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 -- 172.21.15.18:0/3747300323 learned_addr learned my addr 172.21.15.18:0/3747300323 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 0x7f71c40b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9a00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 0x7f71c415c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 -- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 msgr2=0x7f71c415c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 0x7f71c415c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 -- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 msgr2=0x7f71c40b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 0x7f71c40b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 -- 172.21.15.18:0/3747300323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c415cc50 con 0x7f71c406ead0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 0x7f71c40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9a00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 0x7f71c415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c9000640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f71b4019040 tx=0x7f71b40191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c1600640 1 -- 172.21.15.18:0/3747300323 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40b0040 con 0x7f71c406ead0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c1600640 1 -- 172.21.15.18:0/3747300323 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b40bb070 con 0x7f71c406ead0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c413ba70 con 0x7f71c406ead0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71c1600640 1 -- 172.21.15.18:0/3747300323 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40b58a0 con 0x7f71c406ead0 2024-04-25T10:09:29.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.354+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c413c030 con 0x7f71c406ead0 2024-04-25T10:09:29.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71c1600640 1 -- 172.21.15.18:0/3747300323 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f71b40b3070 con 0x7f71c406ead0 2024-04-25T10:09:29.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71c1600640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 0x7f71a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71c1600640 1 -- 172.21.15.18:0/3747300323 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f71b411efc0 con 0x7f71c406ead0 2024-04-25T10:09:29.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 Processor -- start 2024-04-25T10:09:29.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 -- start start 2024-04-25T10:09:29.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 0x7f71a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743c34120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743bea5f0 0x562743bea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562743a38c40 con 0x562743c34660 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627439c11d0 con 0x562743bea5f0 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562743a34ce0 con 0x562743c33d40 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 0x7f71a0069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71c413eb30 tx=0x7f71ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53798/0 (socket says 172.21.15.18:53798) 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 -- 172.21.15.18:0/3125494940 learned_addr learned my addr 172.21.15.18:0/3125494940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71c9000640 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743c34120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71c9a00640 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743bea5f0 0x562743bea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 -- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 msgr2=0x562743c34120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743c34120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 -- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743bea5f0 msgr2=0x562743bea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743bea5f0 0x562743bea9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 -- 172.21.15.18:0/3125494940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562743a7e2a0 con 0x562743c34660 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f71ac000f70 tx=0x7f71ac011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb9dd2ebdecd402 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71b9600640 1 -- 172.21.15.18:0/3125494940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac007710 con 0x562743c34660 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.358+0000 7f71b9600640 1 -- 172.21.15.18:0/3125494940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00e7b0 con 0x562743c34660 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b9600640 1 -- 172.21.15.18:0/3125494940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00eb60 con 0x562743c34660 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/3125494940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 msgr2=0x562743bea0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f71ac000f70 tx=0x7f71ac011000 comp rx=0 tx=0).stop 2024-04-25T10:09:29.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/3125494940 shutdown_connections 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743bea5f0 0x562743bea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c34660 0x562743bea0b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- 172.21.15.18:0/3125494940 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743c34120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/3125494940 >> 172.21.15.18:0/3125494940 conn(0x562743be65a0 msgr2=0x562743be8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/3125494940 shutdown_connections 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/3125494940 wait complete. 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- start start 2024-04-25T10:09:29.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 Processor -- start 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743beff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c34660 0x562743c18d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627439f3a90 con 0x562743bea5f0 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562743a37c10 con 0x562743c34660 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627439fc910 con 0x562743c33d40 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 10 client.0 _ll_register_callbacks cb 0x562743bd5410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53800/0 (socket says 172.21.15.18:53800) 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 -- 172.21.15.18:0/2293428556 learned_addr learned my addr 172.21.15.18:0/2293428556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9a00640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c34660 0x562743c18d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71bbe00640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743beff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 -- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 msgr2=0x562743beff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743beff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 -- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c34660 msgr2=0x562743c18d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c34660 0x562743c18d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 -- 172.21.15.18:0/2293428556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627439f1730 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71c9000640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f71b40eba60 tx=0x7f71b40efe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf17ca97898f7b35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b2000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b411b060 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f71b41070d0 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71ac00e7b0 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b40f7d60 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 10 client.7221 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x5627439c1420 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.362+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00e7b0 con 0x562743bea5f0 2024-04-25T10:09:29.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f71b4116bd0 con 0x562743bea5f0 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 10 client.7221 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 10 client.7221 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 20 client.7221 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743c19780 0x562743c46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 4 client.7221 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627439d4b50 con 0x562743c19780 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71bbe00640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743c19780 0x562743c46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71b2000640 10 client.7221 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71bbe00640 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743c19780 0x562743c46000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8450a04b8157cef server_cookie=7e035f80a6da67cb in_seq=0 out_seq=0 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71b2000640 1 -- 172.21.15.18:0/2293428556 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5627439d4b50 con 0x562743c19780 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71b2000640 10 client.7221 handle_command_reply: tid=0 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 client.7221 shutdown 2024-04-25T10:09:29.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 msgr2=0x562743bef9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f71b40eba60 tx=0x7f71b40efe10 comp rx=0 tx=0).stop 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 shutdown_connections 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743c19780 0x562743c46000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c34660 0x562743c18d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c33d40 0x562743beff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 --2- 172.21.15.18:0/2293428556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743bea5f0 0x562743bef9f0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71b2000640 0 client.7221 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 >> 172.21.15.18:0/2293428556 conn(0x562743be65a0 msgr2=0x562743be9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 shutdown_connections 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 1 -- 172.21.15.18:0/2293428556 wait complete. 2024-04-25T10:09:29.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.366+0000 7f71cee77000 20 client.7221 trim_cache size 0 max 16384 2024-04-25T10:09:29.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 Processor -- start 2024-04-25T10:09:29.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 -- start start 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c16d60 0x562743be99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743be65a0 0x562743c46000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4203930 con 0x562743c18090 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40af940 con 0x562743c16d60 2024-04-25T10:09:29.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41f86c0 con 0x562743be65a0 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53816/0 (socket says 172.21.15.18:53816) 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 -- 172.21.15.18:0/1405803064 learned_addr learned my addr 172.21.15.18:0/1405803064 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71c9a00640 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743be65a0 0x562743c46000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71c9000640 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c16d60 0x562743be99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 -- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743be65a0 msgr2=0x562743c46000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743be65a0 0x562743c46000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 -- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c16d60 msgr2=0x562743be99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c16d60 0x562743be99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 -- 172.21.15.18:0/1405803064 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562743abd550 con 0x562743c18090 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71bbe00640 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f71ac014000 tx=0x7f71ac007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a65a17583011f60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71b8c00640 1 -- 172.21.15.18:0/1405803064 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00ec60 con 0x562743c18090 2024-04-25T10:09:29.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71b8c00640 1 -- 172.21.15.18:0/1405803064 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00ee00 con 0x562743c18090 2024-04-25T10:09:29.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.382+0000 7f71b8c00640 1 -- 172.21.15.18:0/1405803064 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac02e660 con 0x562743c18090 2024-04-25T10:09:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/1405803064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 msgr2=0x562743be9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f71ac014000 tx=0x7f71ac007000 comp rx=0 tx=0).stop 2024-04-25T10:09:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/1405803064 shutdown_connections 2024-04-25T10:09:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743be65a0 0x562743c46000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c18090 0x562743be9ee0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- 172.21.15.18:0/1405803064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743c16d60 0x562743be99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/1405803064 >> 172.21.15.18:0/1405803064 conn(0x562743bf00f0 msgr2=0x562743c41330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/1405803064 shutdown_connections 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/1405803064 wait complete. 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- start start 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 Processor -- start 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 0x562743c48210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 0x562743c95b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562743a04230 con 0x562743c16d60 2024-04-25T10:09:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40af340 con 0x562743be65a0 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5627439f3a90 con 0x562743c18090 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 10 client.0 _ll_register_callbacks cb 0x7f71ac001dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53826/0 (socket says 172.21.15.18:53826) 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 -- 172.21.15.18:0/3302852207 learned_addr learned my addr 172.21.15.18:0/3302852207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71c9000640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 0x562743c48210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71c9a00640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 0x562743c95b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 -- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 msgr2=0x562743c95b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 0x562743c95b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 -- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 msgr2=0x562743c48210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 0x562743c48210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 -- 172.21.15.18:0/3302852207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627439eb490 con 0x562743c16d60 2024-04-25T10:09:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71c9000640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 0x562743c48210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71c9a00640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 0x562743c95b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71bbe00640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00efd0 tx=0x7f71ac000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaea502a4ec366a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00e7b0 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f71ac033040 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71ac00ee00 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71ac041050 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 10 client.7227 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x5627439e01b0 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00ee00 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f71ac044020 con 0x562743c16d60 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 10 client.7227 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 10 client.7227 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 20 client.7227 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743bea5f0 0x562743c96070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 4 client.7227 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.386+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x562743a46180 con 0x562743bea5f0 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71c9000640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743bea5f0 0x562743c96070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71c9000640 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743bea5f0 0x562743c96070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a66844b177ec82 server_cookie=b402b17169986d7 in_seq=0 out_seq=0 2024-04-25T10:09:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71b2000640 10 client.7227 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71b2000640 1 -- 172.21.15.18:0/3302852207 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562743a46180 con 0x562743bea5f0 2024-04-25T10:09:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71b2000640 10 client.7227 handle_command_reply: tid=0 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 client.7227 shutdown 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 msgr2=0x562743c955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f71ac00efd0 tx=0x7f71ac000bd0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 shutdown_connections 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x562743bea5f0 0x562743c96070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562743c18090 0x562743c95b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562743c16d60 0x562743c955f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71b2000640 0 client.7227 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 --2- 172.21.15.18:0/3302852207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562743be65a0 0x562743c48210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 >> 172.21.15.18:0/3302852207 conn(0x562743bf00f0 msgr2=0x562743be8990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 shutdown_connections 2024-04-25T10:09:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 1 -- 172.21.15.18:0/3302852207 wait complete. 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cee77000 20 client.7227 trim_cache size 0 max 16384 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "5ea94ad3-ffc5-4d0c-acba-611dbb1192f3", 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:09:29.404 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 msgr2=0x7f71a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 0x7f71a0069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f71c413eb30 tx=0x7f71ac009040 comp rx=0 tx=0).stop 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 msgr2=0x7f71c413cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f71b4019040 tx=0x7f71b40191d0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 shutdown_connections 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f71a0066f60 0x7f71a0069420 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f71c4144080 0x7f71c415c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71c4071e40 0x7f71c40b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 --2- 172.21.15.18:0/3747300323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71c406ead0 0x7f71c413cb10 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 >> 172.21.15.18:0/3747300323 conn(0x7f71c406ac10 msgr2=0x7f71c4142f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 shutdown_connections 2024-04-25T10:09:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.390+0000 7f71cba00640 1 -- 172.21.15.18:0/3747300323 wait complete. 2024-04-25T10:09:29.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:09:29.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T10:09:29.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 Processor -- start 2024-04-25T10:09:29.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 -- start start 2024-04-25T10:09:29.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb840b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415bc40 con 0x7feb8415acd0 2024-04-25T10:09:29.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8415b3a0 con 0x7feb84144120 2024-04-25T10:09:29.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb88a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415e490 con 0x7feb840b3090 2024-04-25T10:09:29.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb81400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feb8415acd0 0x7feb8415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57188/0 (socket says 172.21.15.18:57188) 2024-04-25T10:09:29.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb81400640 1 -- 172.21.15.18:0/4158776586 learned_addr learned my addr 172.21.15.18:0/4158776586 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb840b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589093167 0 0) 0x7feb8415bc40 con 0x7feb8415acd0 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb68003530 con 0x7feb8415acd0 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830629995 0 0) 0x7feb8415b3a0 con 0x7feb84144120 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8415bc40 con 0x7feb84144120 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 817718124 0 0) 0x7feb68003530 con 0x7feb8415acd0 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 msgr2=0x7feb840b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb840b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 >> v1:172.21.15.167:6789/0 conn(0x7feb84144120 legacy=0x7feb840ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8415b680 con 0x7feb8415acd0 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7feb70001680 con 0x7feb8415acd0 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 >> v1:172.21.15.18:6789/0 conn(0x7feb8415acd0 legacy=0x7feb8415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb68003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68004100 0x7feb68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb68004d50 0x7feb680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415e490 con 0x7feb68004d50 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6800bb60 con 0x7feb68004100 2024-04-25T10:09:29.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6800bd60 con 0x7feb840b3090 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb68004d50 0x7feb680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb81e00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb68003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb81400640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68004100 0x7feb68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 -- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 msgr2=0x7feb68003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb840b3090 0x7feb68003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 -- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68004100 msgr2=0x7feb68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68004100 0x7feb68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.554+0000 7feb82800640 1 -- 172.21.15.18:0/4158776586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb68003530 con 0x7feb68004d50 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb82800640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb68004d50 0x7feb680051d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fc0 tx=0x7feb7c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceba60c721693310 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0b2070 con 0x7feb68004d50 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c0a5c90 con 0x7feb68004d50 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb80a00640 1 -- 172.21.15.18:0/4158776586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c009c10 con 0x7feb68004d50 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 -- 172.21.15.18:0/4158776586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb68004d50 msgr2=0x7feb680051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 --2- 172.21.15.18:0/4158776586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb68004d50 0x7feb680051d0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009fc0 tx=0x7feb7c01cc80 comp rx=0 tx=0).stop 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb82800640 1 -- 172.21.15.18:0/4158776586 reap_dead start 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 -- 172.21.15.18:0/4158776586 shutdown_connections 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 -- 172.21.15.18:0/4158776586 >> 172.21.15.18:0/4158776586 conn(0x7feb84067080 msgr2=0x7feb8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 -- 172.21.15.18:0/4158776586 shutdown_connections 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.558+0000 7feb88a00640 1 -- 172.21.15.18:0/4158776586 wait complete. 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 Processor -- start 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- start start 2024-04-25T10:09:29.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb68004d50 0x7feb840cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb841f6d60 0x7feb840ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415f030 con 0x7feb840afbf0 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415b150 con 0x7feb841f6d60 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8415f1b0 con 0x7feb68004d50 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53854/0 (socket says 172.21.15.18:53854) 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 -- 172.21.15.18:0/1863179328 learned_addr learned my addr 172.21.15.18:0/1863179328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81e00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb68004d50 0x7feb840cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb82800640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb841f6d60 0x7feb840ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 -- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb68004d50 msgr2=0x7feb840cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb68004d50 0x7feb840cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 -- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb841f6d60 msgr2=0x7feb840ad0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb841f6d60 0x7feb840ad0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 -- 172.21.15.18:0/1863179328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb840cc300 con 0x7feb840afbf0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb81400640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7feb7000e780 tx=0x7feb7000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb7a000640 1 -- 172.21.15.18:0/1863179328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000ee30 con 0x7feb840afbf0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb7a000640 1 -- 172.21.15.18:0/1863179328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70018070 con 0x7feb840afbf0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb841f7200 con 0x7feb840afbf0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb7a000640 1 -- 172.21.15.18:0/1863179328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000cad0 con 0x7feb840afbf0 2024-04-25T10:09:29.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.562+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb840af3f0 con 0x7feb840afbf0 2024-04-25T10:09:29.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb7a000640 1 -- 172.21.15.18:0/1863179328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb7000cc70 con 0x7feb840afbf0 2024-04-25T10:09:29.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb7a000640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 0x7feb64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb7a000640 1 -- 172.21.15.18:0/1863179328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb70084f60 con 0x7feb840afbf0 2024-04-25T10:09:29.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb81e00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 0x7feb64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb8bdca000 1 Processor -- start 2024-04-25T10:09:29.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.566+0000 7feb8bdca000 1 -- start start 2024-04-25T10:09:29.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 0x7feb64069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feb840b05f0 tx=0x7feb740014b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a57b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742a580a0 0x559742a58480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597428a4ff0 con 0x559742aa19d0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974282d150 con 0x559742aa22f0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597428a1090 con 0x559742a580a0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53862/0 (socket says 172.21.15.18:53862) 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 -- 172.21.15.18:0/3299361223 learned_addr learned my addr 172.21.15.18:0/3299361223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb82800640 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742a580a0 0x559742a58480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81400640 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a57b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 -- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742a580a0 msgr2=0x559742a58480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742a580a0 0x559742a58480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 -- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 msgr2=0x559742a57b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a57b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 -- 172.21.15.18:0/3299361223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559742a3b0d0 con 0x559742aa19d0 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb81e00640 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feb74017460 tx=0x7feb74018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b26e2a8bf3a5d5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb6ea00640 1 -- 172.21.15.18:0/3299361223 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74023480 con 0x559742aa19d0 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb6ea00640 1 -- 172.21.15.18:0/3299361223 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74029070 con 0x559742aa19d0 2024-04-25T10:09:29.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb6ea00640 1 -- 172.21.15.18:0/3299361223 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74023660 con 0x559742aa19d0 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- 172.21.15.18:0/3299361223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 msgr2=0x559742aa1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7feb74017460 tx=0x7feb74018000 comp rx=0 tx=0).stop 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- 172.21.15.18:0/3299361223 shutdown_connections 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742a580a0 0x559742a58480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a57b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3299361223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742aa19d0 0x559742aa1db0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- 172.21.15.18:0/3299361223 >> 172.21.15.18:0/3299361223 conn(0x559742a54020 msgr2=0x559742a56440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- 172.21.15.18:0/3299361223 shutdown_connections 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- 172.21.15.18:0/3299361223 wait complete. 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 -- start start 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.570+0000 7feb8bdca000 1 Processor -- start 2024-04-25T10:09:29.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742a86d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a87270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559742869250 con 0x559742a580a0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974285f690 con 0x559742aa22f0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55974282da40 con 0x559742aa19d0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 10 client.0 _ll_register_callbacks cb 0x559742a42e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53866/0 (socket says 172.21.15.18:53866) 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 -- 172.21.15.18:0/3598963351 learned_addr learned my addr 172.21.15.18:0/3598963351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81400640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742a86d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb82800640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a87270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 -- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 msgr2=0x559742a86d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742a86d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 -- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 msgr2=0x559742a87270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a87270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 -- 172.21.15.18:0/3598963351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597429521c0 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81e00640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7feb74008010 tx=0x7feb740012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3d6397b3b914c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74023cc0 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb74024460 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb74029070 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb7403f050 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 10 client.7239 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x55974294e170 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74029070 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb74042020 con 0x559742a580a0 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 10 client.7239 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 10 client.7239 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 20 client.7239 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab1c80 0x559742ab4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 4 client.7239 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559742840c60 con 0x559742ab1c80 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81400640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab1c80 0x559742ab4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb81400640 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab1c80 0x559742ab4070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e43eb5bd91243d89 server_cookie=8ca51627a210f9ba in_seq=0 out_seq=0 2024-04-25T10:09:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 10 client.7239 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 1 -- 172.21.15.18:0/3598963351 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559742840c60 con 0x559742ab1c80 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb63400640 10 client.7239 handle_command_reply: tid=0 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 client.7239 shutdown 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 msgr2=0x559742a867f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.574+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7feb74008010 tx=0x7feb740012e0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 shutdown_connections 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab1c80 0x559742ab4070 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742a87270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742a86d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 --2- 172.21.15.18:0/3598963351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742a867f0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb63400640 0 client.7239 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 >> 172.21.15.18:0/3598963351 conn(0x559742a54020 msgr2=0x559742a56ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 shutdown_connections 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 1 -- 172.21.15.18:0/3598963351 wait complete. 2024-04-25T10:09:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.578+0000 7feb8bdca000 20 client.7239 trim_cache size 0 max 16384 2024-04-25T10:09:29.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.590+0000 7feb8bdca000 1 Processor -- start 2024-04-25T10:09:29.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.590+0000 7feb8bdca000 1 -- start start 2024-04-25T10:09:29.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa19d0 0x559742afe630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa22f0 0x559742afeb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb842009c0 con 0x559742a580a0 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841ffb60 con 0x559742aa19d0 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb841fef60 con 0x559742aa22f0 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53874/0 (socket says 172.21.15.18:53874) 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 -- 172.21.15.18:0/287022990 learned_addr learned my addr 172.21.15.18:0/287022990 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 -- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa22f0 msgr2=0x559742afeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa22f0 0x559742afeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 -- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa19d0 msgr2=0x559742afe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa19d0 0x559742afe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 -- 172.21.15.18:0/287022990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597428ebde0 con 0x559742a580a0 2024-04-25T10:09:29.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb81e00640 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7feb74005630 tx=0x7feb74031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c31991867b025ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb6e000640 1 -- 172.21.15.18:0/287022990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74024660 con 0x559742a580a0 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb6e000640 1 -- 172.21.15.18:0/287022990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74029070 con 0x559742a580a0 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb6e000640 1 -- 172.21.15.18:0/287022990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74023cc0 con 0x559742a580a0 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- 172.21.15.18:0/287022990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 msgr2=0x559742afe0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7feb74005630 tx=0x7feb74031000 comp rx=0 tx=0).stop 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- 172.21.15.18:0/287022990 shutdown_connections 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa22f0 0x559742afeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa19d0 0x559742afe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- 172.21.15.18:0/287022990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742afe0f0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- 172.21.15.18:0/287022990 >> 172.21.15.18:0/287022990 conn(0x559742a54020 msgr2=0x559742aaefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- 172.21.15.18:0/287022990 shutdown_connections 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- 172.21.15.18:0/287022990 wait complete. 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- start start 2024-04-25T10:09:29.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 Processor -- start 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742ab48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742ab4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974283fe00 con 0x559742a580a0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb841ff560 con 0x559742aa22f0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5597428a4300 con 0x559742aa19d0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.594+0000 7feb8bdca000 10 client.0 _ll_register_callbacks cb 0x559742a23040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742ab48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53888/0 (socket says 172.21.15.18:53888) 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 -- 172.21.15.18:0/650043016 learned_addr learned my addr 172.21.15.18:0/650043016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb82800640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742ab4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 -- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 msgr2=0x559742ab48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742ab48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 -- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 msgr2=0x559742ab4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742ab4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 -- 172.21.15.18:0/650043016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597428468e0 con 0x559742a580a0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81e00640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feb74015c20 tx=0x7feb7400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87bd14acfe6fd2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb74024870 con 0x559742a580a0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb74024a10 con 0x559742a580a0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb74029070 con 0x559742a580a0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb74024c10 con 0x559742a580a0 2024-04-25T10:09:29.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 10 client.7245 fetch_fsmap learned FSMap version 53 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=2+}) v3 -- 0x5597428fe8f0 con 0x559742a580a0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb74029070 con 0x559742a580a0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 53) v1 ==== 3294+0+0 (secure 0 0 0) 0x7feb7404a060 con 0x559742a580a0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 10 client.7245 fetch_fsmap finished waiting for FSMap version 53 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 10 client.7245 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 20 client.7245 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab57c0 0x559742b09f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 4 client.7245 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5597428b2530 con 0x559742ab57c0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81400640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab57c0 0x559742b09f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb81400640 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab57c0 0x559742b09f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ff2a8d46c3c4 server_cookie=45d75103deb383bf in_seq=0 out_seq=0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 10 client.7245 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 1 -- 172.21.15.18:0/650043016 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5597428b2530 con 0x559742ab57c0 2024-04-25T10:09:29.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 10 client.7245 handle_command_reply: tid=0 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 client.7245 shutdown 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 msgr2=0x559742ab4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7feb74015c20 tx=0x7feb7400f000 comp rx=0 tx=0).stop 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 shutdown_connections 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x559742ab57c0 0x559742b09f60 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559742aa22f0 0x559742ab4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559742aa19d0 0x559742ab48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 --2- 172.21.15.18:0/650043016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559742a580a0 0x559742ab4380 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb63400640 0 client.7245 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 >> 172.21.15.18:0/650043016 conn(0x559742a54020 msgr2=0x559742aa00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 shutdown_connections 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 1 -- 172.21.15.18:0/650043016 wait complete. 2024-04-25T10:09:29.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb8bdca000 20 client.7245 trim_cache size 0 max 16384 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "5ea94ad3-ffc5-4d0c-acba-611dbb1192f3": { 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/subdir", 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "5ea94ad3-ffc5-4d0c-acba-611dbb1192f3", 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:09:29.612 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:09:29.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 msgr2=0x7feb64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 0x7feb64069420 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7feb840b05f0 tx=0x7feb740014b0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 msgr2=0x7feb841f6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:29.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7feb7000e780 tx=0x7feb7000ec40 comp rx=0 tx=0).stop 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 shutdown_connections 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb841f6d60 0x7feb840ad0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb840afbf0 0x7feb841f6820 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7feb64066f60 0x7feb64069420 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 --2- 172.21.15.18:0/1863179328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feb68004d50 0x7feb840cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.598+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 >> 172.21.15.18:0/1863179328 conn(0x7feb84067080 msgr2=0x7feb8406d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.602+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 shutdown_connections 2024-04-25T10:09:29.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:29.602+0000 7feb88a00640 1 -- 172.21.15.18:0/1863179328 wait complete. 2024-04-25T10:09:29.627 INFO:tasks.cephfs.filesystem:scrub status for tag:5ea94ad3-ffc5-4d0c-acba-611dbb1192f3 - {'path': '/subdir', 'tag': '5ea94ad3-ffc5-4d0c-acba-611dbb1192f3', 'options': 'recursive,repair'} 2024-04-25T10:09:51.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:09:51.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:09:59.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:09:59.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T10:09:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.774+0000 7f906de00640 1 Processor -- start 2024-04-25T10:09:59.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.774+0000 7f906de00640 1 -- start start 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f906de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f906806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f906de00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906815e9a0 con 0x7f9068072210 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f906de00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906815dbe0 con 0x7f906815af40 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f906de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906806f530 con 0x7f9068150f40 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9067400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9068072210 0x7f90680cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44582/0 (socket says 172.21.15.18:44582) 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9067400640 1 -- 172.21.15.18:0/1156633191 learned_addr learned my addr 172.21.15.18:0/1156633191 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:59.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f906806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3335431172 0 0) 0x7f906815e9a0 con 0x7f9068072210 2024-04-25T10:09:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f904c005740 con 0x7f9068072210 2024-04-25T10:09:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906097486 0 0) 0x7f906815dbe0 con 0x7f906815af40 2024-04-25T10:09:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f906815e9a0 con 0x7f906815af40 2024-04-25T10:09:59.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 762836735 0 0) 0x7f904c005740 con 0x7f9068072210 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 msgr2=0x7f906806ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f906806ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 >> v1:172.21.15.167:6789/0 conn(0x7f906815af40 legacy=0x7f9068071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906815dec0 con 0x7f9068072210 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f9060001a00 con 0x7f9068072210 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 >> v1:172.21.15.18:6789/0 conn(0x7f9068072210 legacy=0x7f90680cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c005d90 0x7f904c006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c006a20 0x7f904c006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f904c0074e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906806f530 con 0x7f904c005d90 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c00dde0 con 0x7f904c006a20 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c00dfe0 con 0x7f9068150f40 2024-04-25T10:09:59.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c005d90 0x7f904c006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f905fe00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c006a20 0x7f904c006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9067400640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f904c0074e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 -- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 msgr2=0x7f904c0074e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f904c0074e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 -- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c006a20 msgr2=0x7f904c006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c006a20 0x7f904c006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9066a00640 1 -- 172.21.15.18:0/1156633191 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c005740 con 0x7f904c005d90 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f905fe00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c006a20 0x7f904c006ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:59.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.778+0000 7f9067400640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068150f40 0x7f904c0074e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f9066a00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c005d90 0x7f904c006190 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9058009ae0 tx=0x7f905801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ce30aa2e84bfaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580096b0 con 0x7f904c005d90 2024-04-25T10:09:59.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580a8430 con 0x7f904c005d90 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f9066000640 1 -- 172.21.15.18:0/1156633191 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580a8820 con 0x7f904c005d90 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 -- 172.21.15.18:0/1156633191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c005d90 msgr2=0x7f904c006190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 --2- 172.21.15.18:0/1156633191 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f904c005d90 0x7f904c006190 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f9058009ae0 tx=0x7f905801ca70 comp rx=0 tx=0).stop 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f9067400640 1 -- 172.21.15.18:0/1156633191 reap_dead start 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 -- 172.21.15.18:0/1156633191 shutdown_connections 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 -- 172.21.15.18:0/1156633191 >> 172.21.15.18:0/1156633191 conn(0x7f9068067080 msgr2=0x7f906806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 -- 172.21.15.18:0/1156633191 shutdown_connections 2024-04-25T10:09:59.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.782+0000 7f906de00640 1 -- 172.21.15.18:0/1156633191 wait complete. 2024-04-25T10:09:59.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 Processor -- start 2024-04-25T10:09:59.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- start start 2024-04-25T10:09:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c005d90 0x7f9068156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068155590 0x7f90680b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680ce550 con 0x7f9068152290 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90680ce3d0 con 0x7f904c005d90 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90680ce6d0 con 0x7f9068155590 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52784/0 (socket says 172.21.15.18:52784) 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 -- 172.21.15.18:0/3511921456 learned_addr learned my addr 172.21.15.18:0/3511921456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f9066a00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c005d90 0x7f9068156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f9067400640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068155590 0x7f90680b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 -- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068155590 msgr2=0x7f90680b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068155590 0x7f90680b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 -- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c005d90 msgr2=0x7f9068156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c005d90 0x7f9068156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 -- 172.21.15.18:0/3511921456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90680b3f80 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905fe00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f905000d7d0 tx=0x7f905000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905f400640 1 -- 172.21.15.18:0/3511921456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500069e0 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905f400640 1 -- 172.21.15.18:0/3511921456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050006b80 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f905f400640 1 -- 172.21.15.18:0/3511921456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050007030 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9068155a10 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.786+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9068156c40 con 0x7f9068152290 2024-04-25T10:09:59.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905f400640 1 -- 172.21.15.18:0/3511921456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f90500071d0 con 0x7f9068152290 2024-04-25T10:09:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905f400640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 0x7f9044069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905f400640 1 -- 172.21.15.18:0/3511921456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9050085140 con 0x7f9068152290 2024-04-25T10:09:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9066a00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 0x7f9044069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 Processor -- start 2024-04-25T10:09:59.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 -- start start 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9066a00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 0x7f9044069450 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f90580af000 tx=0x7f90580b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026848fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x560268446480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560268292ff0 con 0x5602684902f0 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026821b150 con 0x5602684460a0 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56026828f090 con 0x56026848f9d0 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52788/0 (socket says 172.21.15.18:52788) 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.790+0000 7f905fe00640 1 -- 172.21.15.18:0/3121457144 learned_addr learned my addr 172.21.15.18:0/3121457144 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9066a00640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026848fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9067400640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x560268446480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 -- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 msgr2=0x56026848fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026848fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 -- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 msgr2=0x560268446480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x560268446480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 -- 172.21.15.18:0/3121457144 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602684290d0 con 0x5602684902f0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9067400640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x560268446480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f905000b4a0 tx=0x7f90500012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5ca7c2baa31241 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9057e00640 1 -- 172.21.15.18:0/3121457144 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905001f040 con 0x5602684902f0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9057e00640 1 -- 172.21.15.18:0/3121457144 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050053c40 con 0x5602684902f0 2024-04-25T10:09:59.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9057e00640 1 -- 172.21.15.18:0/3121457144 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500074c0 con 0x5602684902f0 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- 172.21.15.18:0/3121457144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 msgr2=0x560268445b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f905000b4a0 tx=0x7f90500012e0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- 172.21.15.18:0/3121457144 shutdown_connections 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x560268446480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268445b60 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- 172.21.15.18:0/3121457144 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026848fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- 172.21.15.18:0/3121457144 >> 172.21.15.18:0/3121457144 conn(0x560268442020 msgr2=0x560268444440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- 172.21.15.18:0/3121457144 shutdown_connections 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- 172.21.15.18:0/3121457144 wait complete. 2024-04-25T10:09:59.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- start start 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 Processor -- start 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x5602684747f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x560268474d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560268257250 con 0x5602684902f0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026824d690 con 0x5602684460a0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56026821ba40 con 0x56026848f9d0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9071274000 10 client.0 _ll_register_callbacks cb 0x560268430e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9067400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9067400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52794/0 (socket says 172.21.15.18:52794) 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9067400640 1 -- 172.21.15.18:0/3647392930 learned_addr learned my addr 172.21.15.18:0/3647392930 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f9066a00640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x5602684747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.794+0000 7f905fe00640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x560268474d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 -- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 msgr2=0x560268474d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x560268474d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 -- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 msgr2=0x5602684747f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x5602684747f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 -- 172.21.15.18:0/3647392930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602683401c0 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9067400640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f906806f700 tx=0x7f9060007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ba8d46fc3b89e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906001a060 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9060015c90 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9050053c40 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9060004e40 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 10 client.7257 fetch_fsmap learned FSMap version 54 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x56026833c170 con 0x5602684902f0 2024-04-25T10:09:59.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050053c40 con 0x5602684902f0 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9060014400 con 0x5602684902f0 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 10 client.7257 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 10 client.7257 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 20 client.7257 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56026849fc80 0x5602684a2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 4 client.7257 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56026822ec60 con 0x56026849fc80 2024-04-25T10:09:59.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9066a00640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56026849fc80 0x5602684a2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9066a00640 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56026849fc80 0x5602684a2070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7c3e69c9da62c8c server_cookie=8da7948f33787b2e in_seq=0 out_seq=0 2024-04-25T10:09:59.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 10 client.7257 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 1 -- 172.21.15.18:0/3647392930 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56026822ec60 con 0x56026849fc80 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 10 client.7257 handle_command_reply: tid=0 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 client.7257 shutdown 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 msgr2=0x560268475270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f906806f700 tx=0x7f9060007500 comp rx=0 tx=0).stop 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 shutdown_connections 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x56026849fc80 0x5602684a2070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268475270 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x560268474d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 --2- 172.21.15.18:0/3647392930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x5602684747f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 >> 172.21.15.18:0/3647392930 conn(0x560268442020 msgr2=0x560268444ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9054c00640 0 client.7257 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:59.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 shutdown_connections 2024-04-25T10:09:59.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 1 -- 172.21.15.18:0/3647392930 wait complete. 2024-04-25T10:09:59.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.798+0000 7f9071274000 20 client.7257 trim_cache size 0 max 16384 2024-04-25T10:09:59.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 Processor -- start 2024-04-25T10:09:59.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 -- start start 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x56026849ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026849d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068203ee0 con 0x5602684902f0 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90682030e0 con 0x5602684460a0 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906814e2e0 con 0x56026848f9d0 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52800/0 (socket says 172.21.15.18:52800) 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 -- 172.21.15.18:0/2146825872 learned_addr learned my addr 172.21.15.18:0/2146825872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9066a00640 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x56026849ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f905fe00640 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026849d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 -- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 msgr2=0x56026849d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026849d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 -- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 msgr2=0x56026849ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x56026849ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 -- 172.21.15.18:0/2146825872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602682d9de0 con 0x5602684902f0 2024-04-25T10:09:59.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.814+0000 7f9067400640 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9060007540 tx=0x7f9060010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5061bd3b43bd31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9057400640 1 -- 172.21.15.18:0/2146825872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906002d070 con 0x5602684902f0 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9057400640 1 -- 172.21.15.18:0/2146825872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060001720 con 0x5602684902f0 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9057400640 1 -- 172.21.15.18:0/2146825872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060024040 con 0x5602684902f0 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/2146825872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 msgr2=0x560268444410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9060007540 tx=0x7f9060010000 comp rx=0 tx=0).stop 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/2146825872 shutdown_connections 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684902f0 0x560268444410 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x56026849d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- 172.21.15.18:0/2146825872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684460a0 0x56026849ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/2146825872 >> 172.21.15.18:0/2146825872 conn(0x560268442020 msgr2=0x56026849c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/2146825872 shutdown_connections 2024-04-25T10:09:59.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/2146825872 wait complete. 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- start start 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 Processor -- start 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x5602684a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684902f0 0x5602684a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026822de00 con 0x5602684460a0 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9068202ae0 con 0x5602684902f0 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560268292300 con 0x56026848f9d0 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 10 client.0 _ll_register_callbacks cb 0x560268411040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52808/0 (socket says 172.21.15.18:52808) 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 -- 172.21.15.18:0/901848456 learned_addr learned my addr 172.21.15.18:0/901848456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:09:59.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f905fe00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x5602684a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9067400640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684902f0 0x5602684a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 -- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 msgr2=0x5602684a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x5602684a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 -- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684902f0 msgr2=0x5602684a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684902f0 0x5602684a20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 -- 172.21.15.18:0/901848456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602682348e0 con 0x5602684460a0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9066a00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f905801cf50 tx=0x7f9058019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7b0f496866c151 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9054c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580cc070 con 0x5602684460a0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f90580cc210 con 0x5602684460a0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9060001720 con 0x5602684460a0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90580dc050 con 0x5602684460a0 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 10 client.7263 fetch_fsmap learned FSMap version 54 2024-04-25T10:09:59.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.818+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5602682ec8f0 con 0x5602684460a0 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9060001720 con 0x5602684460a0 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f90580df020 con 0x5602684460a0 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 10 client.7263 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 10 client.7263 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 20 client.7263 populate_metadata read hostname 'smithi018' 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5602684a3100 0x5602684a3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 4 client.7263 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5602682a0530 con 0x5602684a3100 2024-04-25T10:09:59.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f905fe00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5602684a3100 0x5602684a3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f905fe00640 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5602684a3100 0x5602684a3510 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=550b470d5a9fd03c server_cookie=5fd0b80d008543a3 in_seq=0 out_seq=0 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 10 client.7263 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 1 -- 172.21.15.18:0/901848456 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5602682a0530 con 0x5602684a3100 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 10 client.7263 handle_command_reply: tid=0 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 client.7263 shutdown 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 msgr2=0x5602684a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f905801cf50 tx=0x7f9058019810 comp rx=0 tx=0).stop 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 shutdown_connections 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5602684a3100 0x5602684a3510 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5602684902f0 0x5602684a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56026848f9d0 0x5602684a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 --2- 172.21.15.18:0/901848456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602684460a0 0x5602684a1640 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9054c00640 0 client.7263 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 >> 172.21.15.18:0/901848456 conn(0x560268442020 msgr2=0x56026849cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 shutdown_connections 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 1 -- 172.21.15.18:0/901848456 wait complete. 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f9071274000 20 client.7263 trim_cache size 0 max 16384 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:09:59.835 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 msgr2=0x7f9044069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 0x7f9044069450 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f90580af000 tx=0x7f90580b3040 comp rx=0 tx=0).stop 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 msgr2=0x7f906814ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f905000d7d0 tx=0x7f905000dc90 comp rx=0 tx=0).stop 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 shutdown_connections 2024-04-25T10:09:59.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9044066f90 0x7f9044069450 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9068155590 0x7f90680b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9068152290 0x7f906814ccd0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 --2- 172.21.15.18:0/3511921456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f904c005d90 0x7f9068156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 >> 172.21.15.18:0/3511921456 conn(0x7f9068067080 msgr2=0x7f906814ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 shutdown_connections 2024-04-25T10:09:59.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.822+0000 7f906de00640 1 -- 172.21.15.18:0/3511921456 wait complete. 2024-04-25T10:09:59.850 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:09:59.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:09:59.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 Processor -- start 2024-04-25T10:09:59.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 -- start start 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 0x7fb84806b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84815def0 con 0x7fb8480b2dc0 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb84815e1b0 con 0x7fb84815b2f0 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.982+0000 7fb84ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84815e490 con 0x7fb8480b3950 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb83fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb8480b2dc0 0x7fb84806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44594/0 (socket says 172.21.15.18:44594) 2024-04-25T10:09:59.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb83fe00640 1 -- 172.21.15.18:0/1384045646 learned_addr learned my addr 172.21.15.18:0/1384045646 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:09:59.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb846800640 1 --2- 172.21.15.18:0/1384045646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 0x7fb84806b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:09:59.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656174134 0 0) 0x7fb84815def0 con 0x7fb8480b2dc0 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb82c003530 con 0x7fb8480b2dc0 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190100209 0 0) 0x7fb84815e1b0 con 0x7fb84815b2f0 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84815def0 con 0x7fb84815b2f0 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb846800640 1 -- 172.21.15.18:0/1384045646 >> v1:172.21.15.167:6789/0 conn(0x7fb84815b2f0 legacy=0x7fb8480b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb846800640 1 -- 172.21.15.18:0/1384045646 >> v1:172.21.15.18:6789/0 conn(0x7fb8480b2dc0 legacy=0x7fb84806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349639406 0 0) 0x7fb82c003530 con 0x7fb8480b2dc0 2024-04-25T10:09:59.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb846800640 1 -- 172.21.15.18:0/1384045646 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84815e770 con 0x7fb8480b3950 2024-04-25T10:09:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.986+0000 7fb846800640 1 --2- 172.21.15.18:0/1384045646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 0x7fb84806b320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb840009dc0 tx=0x7fb84806c070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a3bb96a6525d751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:09:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400b2070 con 0x7fb8480b3950 2024-04-25T10:09:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400a56e0 con 0x7fb8480b3950 2024-04-25T10:09:59.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb845400640 1 -- 172.21.15.18:0/1384045646 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84815b8e0 con 0x7fb8480b3950 2024-04-25T10:09:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- 172.21.15.18:0/1384045646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 msgr2=0x7fb84806b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:09:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1384045646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 0x7fb84806b320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb840009dc0 tx=0x7fb84806c070 comp rx=0 tx=0).stop 2024-04-25T10:09:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- 172.21.15.18:0/1384045646 shutdown_connections 2024-04-25T10:09:59.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1384045646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b3950 0x7fb84806b320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:09:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- 172.21.15.18:0/1384045646 >> 172.21.15.18:0/1384045646 conn(0x7fb8480b23b0 msgr2=0x7fb8480cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:09:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- 172.21.15.18:0/1384045646 shutdown_connections 2024-04-25T10:09:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- 172.21.15.18:0/1384045646 wait complete. 2024-04-25T10:09:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 Processor -- start 2024-04-25T10:09:59.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- start start 2024-04-25T10:10:00.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 0x7fb8480b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b3950 0x7fb848155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84816ba10 con 0x7fb84815b2f0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84816b890 con 0x7fb8480b3950 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb84ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84816bb90 con 0x7fb8480b2dc0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb846800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb846800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52812/0 (socket says 172.21.15.18:52812) 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb846800640 1 -- 172.21.15.18:0/1551362978 learned_addr learned my addr 172.21.15.18:0/1551362978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb83fe00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b3950 0x7fb848155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.990+0000 7fb845e00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 0x7fb8480b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 -- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 msgr2=0x7fb8480b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 0x7fb8480b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 -- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b3950 msgr2=0x7fb848155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b3950 0x7fb848155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 -- 172.21.15.18:0/1551362978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8481581f0 con 0x7fb84815b2f0 2024-04-25T10:10:00.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb845e00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 0x7fb8480b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb846800640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb84001cd60 tx=0x7fb840019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400b2040 con 0x7fb84815b2f0 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400ad440 con 0x7fb84815b2f0 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830001680 con 0x7fb84815b2f0 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8481584d0 con 0x7fb84815b2f0 2024-04-25T10:10:00.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848158a90 con 0x7fb84815b2f0 2024-04-25T10:10:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8480745d0 con 0x7fb84815b2f0 2024-04-25T10:10:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8400c0020 con 0x7fb84815b2f0 2024-04-25T10:10:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 0x7fb824069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb84011f1e0 con 0x7fb84815b2f0 2024-04-25T10:10:00.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.994+0000 7fb845e00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 0x7fb824069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:09:59.998+0000 7fb845e00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 0x7fb824069420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8380016a0 tx=0x7fb838009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.002+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8400c7060 con 0x7fb84815b2f0 2024-04-25T10:10:00.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.194+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8480d0ab0 con 0x7fb84815b2f0 2024-04-25T10:10:00.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb83e000640 1 -- 172.21.15.18:0/1551362978 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4942 (secure 0 0 0) 0x7fb8400164a0 con 0x7fb84815b2f0 2024-04-25T10:10:00.205 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:00.205 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:09:35.776644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":15,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:10:00.205 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 54 2024-04-25T10:10:00.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 msgr2=0x7fb824069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 0x7fb824069420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb8380016a0 tx=0x7fb838009040 comp rx=0 tx=0).stop 2024-04-25T10:10:00.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 msgr2=0x7fb8480cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fb84001cd60 tx=0x7fb840019620 comp rx=0 tx=0).stop 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 shutdown_connections 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb84815b2f0 0x7fb8480cbf50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8480b3950 0x7fb848155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb824066f60 0x7fb824069420 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 --2- 172.21.15.18:0/1551362978 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8480b2dc0 0x7fb8480b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 >> 172.21.15.18:0/1551362978 conn(0x7fb8480b23b0 msgr2=0x7fb8480acf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 shutdown_connections 2024-04-25T10:10:00.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.198+0000 7fb84ca00640 1 -- 172.21.15.18:0/1551362978 wait complete. 2024-04-25T10:10:00.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T10:10:00.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 Processor -- start 2024-04-25T10:10:00.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 -- start start 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd550144120 0x7fd55015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500ccbf0 0x7fd55015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55015bc40 con 0x7fd55015ee60 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55015e490 con 0x7fd550144120 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd555600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55015b3a0 con 0x7fd5500ccbf0 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd55015ee60 0x7fd5500b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44608/0 (socket says 172.21.15.18:44608) 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54f400640 1 -- 172.21.15.18:0/3066638404 learned_addr learned my addr 172.21.15.18:0/3066638404 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:00.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54e000640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500ccbf0 0x7fd55015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54ea00640 1 --2- 172.21.15.18:0/3066638404 >> v2:172.21.15.167:3300/0 conn(0x7fd550144120 0x7fd55015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799464298 0 0) 0x7fd55015bc40 con 0x7fd55015ee60 2024-04-25T10:10:00.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd534003530 con 0x7fd55015ee60 2024-04-25T10:10:00.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 258933515 0 0) 0x7fd534003530 con 0x7fd55015ee60 2024-04-25T10:10:00.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54ea00640 1 -- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500ccbf0 msgr2=0x7fd55015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54ea00640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500ccbf0 0x7fd55015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54ea00640 1 -- 172.21.15.18:0/3066638404 >> v1:172.21.15.18:6789/0 conn(0x7fd55015ee60 legacy=0x7fd5500b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.362+0000 7fd54ea00640 1 -- 172.21.15.18:0/3066638404 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55015b680 con 0x7fd550144120 2024-04-25T10:10:00.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd54ea00640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd550144120 0x7fd55015acd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097c0 tx=0x7fd54001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1113c2a60c518927 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400b0070 con 0x7fd550144120 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400ab400 con 0x7fd550144120 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd54d600640 1 -- 172.21.15.18:0/3066638404 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548001a00 con 0x7fd550144120 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 -- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd550144120 msgr2=0x7fd55015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd550144120 0x7fd55015acd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd5400097c0 tx=0x7fd54001c330 comp rx=0 tx=0).stop 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 -- 172.21.15.18:0/3066638404 shutdown_connections 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5500ccbf0 0x7fd55015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 --2- 172.21.15.18:0/3066638404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd550144120 0x7fd55015acd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 -- 172.21.15.18:0/3066638404 >> 172.21.15.18:0/3066638404 conn(0x7fd550067080 msgr2=0x7fd55006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 -- 172.21.15.18:0/3066638404 shutdown_connections 2024-04-25T10:10:00.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.366+0000 7fd555600640 1 -- 172.21.15.18:0/3066638404 wait complete. 2024-04-25T10:10:00.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 Processor -- start 2024-04-25T10:10:00.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- start start 2024-04-25T10:10:00.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500ccbf0 0x7fd550158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd55015ee60 0x7fd55013ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5501675c0 con 0x7fd550144120 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550167440 con 0x7fd5500ccbf0 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550167740 con 0x7fd55015ee60 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52822/0 (socket says 172.21.15.18:52822) 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 -- 172.21.15.18:0/1571116135 learned_addr learned my addr 172.21.15.18:0/1571116135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54ea00640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500ccbf0 0x7fd550158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54f400640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd55015ee60 0x7fd55013ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 -- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd55015ee60 msgr2=0x7fd55013ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd55015ee60 0x7fd55013ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 -- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500ccbf0 msgr2=0x7fd550158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500ccbf0 0x7fd550158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 -- 172.21.15.18:0/1571116135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55013bcd0 con 0x7fd550144120 2024-04-25T10:10:00.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd54e000640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e930 tx=0x7fd53c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd546a00640 1 -- 172.21.15.18:0/1571116135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c017070 con 0x7fd550144120 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd546a00640 1 -- 172.21.15.18:0/1571116135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c00ca00 con 0x7fd550144120 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5501593b0 con 0x7fd550144120 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd546a00640 1 -- 172.21.15.18:0/1571116135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00cdb0 con 0x7fd550144120 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.370+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55013cad0 con 0x7fd550144120 2024-04-25T10:10:00.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd546a00640 1 -- 172.21.15.18:0/1571116135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd53c01a070 con 0x7fd550144120 2024-04-25T10:10:00.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd546a00640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 0x7fd530069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd546a00640 1 -- 172.21.15.18:0/1571116135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd53c085230 con 0x7fd550144120 2024-04-25T10:10:00.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54ea00640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 0x7fd530069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 Processor -- start 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 -- start start 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54ea00640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 0x7fd530069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd5400ad000 tx=0x7fd5400a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1ba2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d1a3bba0 con 0x5571d1b58cf0 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d19a1090 con 0x5571d1ba3060 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571d1929160 con 0x5571d1ba2740 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52838/0 (socket says 172.21.15.18:52838) 2024-04-25T10:10:00.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54f400640 1 -- 172.21.15.18:0/512007648 learned_addr learned my addr 172.21.15.18:0/512007648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54e000640 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.374+0000 7fd54ea00640 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1ba2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 -- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 msgr2=0x5571d1ba2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1ba2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 -- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 msgr2=0x5571d1b587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 -- 172.21.15.18:0/512007648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571d1a4ac20 con 0x5571d1b58cf0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd548001710 tx=0x7fd54800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e85ffee5cb32df55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd53b400640 1 -- 172.21.15.18:0/512007648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548019070 con 0x5571d1b58cf0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd53b400640 1 -- 172.21.15.18:0/512007648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548014480 con 0x5571d1b58cf0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd53b400640 1 -- 172.21.15.18:0/512007648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548014830 con 0x5571d1b58cf0 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- 172.21.15.18:0/512007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 msgr2=0x5571d1b590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd548001710 tx=0x7fd54800e530 comp rx=0 tx=0).stop 2024-04-25T10:10:00.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- 172.21.15.18:0/512007648 shutdown_connections 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b58cf0 0x5571d1b590d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- 172.21.15.18:0/512007648 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1ba2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- 172.21.15.18:0/512007648 >> 172.21.15.18:0/512007648 conn(0x5571d1b50890 msgr2=0x5571d1b52c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- 172.21.15.18:0/512007648 shutdown_connections 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- 172.21.15.18:0/512007648 wait complete. 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- start start 2024-04-25T10:10:00.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 Processor -- start 2024-04-25T10:10:00.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b58cf0 0x5571d1ba21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d199d130 con 0x5571d1ba2740 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d1965130 con 0x5571d1ba3060 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571d1a5f300 con 0x5571d1b58cf0 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd558a6d000 10 client.0 _ll_register_callbacks cb 0x5571d1b3fbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b58cf0 0x5571d1ba21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52852/0 (socket says 172.21.15.18:52852) 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54e000640 1 -- 172.21.15.18:0/1216646547 learned_addr learned my addr 172.21.15.18:0/1216646547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.378+0000 7fd54f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 -- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b58cf0 msgr2=0x5571d1ba21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b58cf0 0x5571d1ba21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 -- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 msgr2=0x5571d1b641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b641a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 -- 172.21.15.18:0/1216646547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571d197e060 con 0x5571d1ba2740 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54e000640 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0834e0 tx=0x7fd53c055b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75414c684f25e1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c080070 con 0x5571d1ba2740 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd53c051780 con 0x5571d1ba2740 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd548014480 con 0x5571d1ba2740 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53c021040 con 0x5571d1ba2740 2024-04-25T10:10:00.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 10 client.7281 fetch_fsmap learned FSMap version 54 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5571d19427c0 con 0x5571d1ba2740 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd548014480 con 0x5571d1ba2740 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd53c024060 con 0x5571d1ba2740 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 10 client.7281 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 10 client.7281 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 20 client.7281 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1b64f10 0x5571d1bb47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 4 client.7281 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:10:00.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571d193ccd0 con 0x5571d1b64f10 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54ea00640 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1b64f10 0x5571d1bb47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd54ea00640 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1b64f10 0x5571d1bb47f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3cb6a8d1056bff7 server_cookie=6eb52089b0037e0c in_seq=0 out_seq=0 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 10 client.7281 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 1 -- 172.21.15.18:0/1216646547 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5571d193ccd0 con 0x5571d1b64f10 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 10 client.7281 handle_command_reply: tid=0 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 client.7281 shutdown 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 msgr2=0x5571d1b63c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0834e0 tx=0x7fd53c055b70 comp rx=0 tx=0).stop 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 shutdown_connections 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1b64f10 0x5571d1bb47f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1ba3060 0x5571d1b641a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1b63c60 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 --2- 172.21.15.18:0/1216646547 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b58cf0 0x5571d1ba21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd52fe00640 0 client.7281 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:10:00.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 >> 172.21.15.18:0/1216646547 conn(0x5571d1b50890 msgr2=0x5571d1b59b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 shutdown_connections 2024-04-25T10:10:00.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 1 -- 172.21.15.18:0/1216646547 wait complete. 2024-04-25T10:10:00.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.382+0000 7fd558a6d000 20 client.7281 trim_cache size 0 max 16384 2024-04-25T10:10:00.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.394+0000 7fd558a6d000 1 Processor -- start 2024-04-25T10:10:00.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.394+0000 7fd558a6d000 1 -- start start 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.394+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.394+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1b59610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1b62820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550161020 con 0x5571d1b50890 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55013e890 con 0x5571d1b58cf0 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd550160a20 con 0x5571d1ba2740 2024-04-25T10:10:00.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52864/0 (socket says 172.21.15.18:52864) 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 -- 172.21.15.18:0/2883988379 learned_addr learned my addr 172.21.15.18:0/2883988379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54e000640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1b59610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54f400640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1b62820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 -- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 msgr2=0x5571d1b62820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1b62820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 -- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 msgr2=0x5571d1b59610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1b59610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 -- 172.21.15.18:0/2883988379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571d1b60960 con 0x5571d1b50890 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54e000640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1b59610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd540009580 tx=0x7fd540004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c204c67e87115a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd53aa00640 1 -- 172.21.15.18:0/2883988379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400b0040 con 0x5571d1b50890 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd53aa00640 1 -- 172.21.15.18:0/2883988379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400d0070 con 0x5571d1b50890 2024-04-25T10:10:00.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd53aa00640 1 -- 172.21.15.18:0/2883988379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400ca290 con 0x5571d1b50890 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- 172.21.15.18:0/2883988379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 msgr2=0x5571d1b590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fd540009580 tx=0x7fd540004740 comp rx=0 tx=0).stop 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- 172.21.15.18:0/2883988379 shutdown_connections 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1ba2740 0x5571d1b62820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1b59610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2883988379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1b50890 0x5571d1b590d0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- 172.21.15.18:0/2883988379 >> 172.21.15.18:0/2883988379 conn(0x5571d1b5fcb0 msgr2=0x5571d1b52c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- 172.21.15.18:0/2883988379 shutdown_connections 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- 172.21.15.18:0/2883988379 wait complete. 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- start start 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 Processor -- start 2024-04-25T10:10:00.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b50890 0x5571d1c034e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1c03a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1bb5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d193be70 con 0x5571d1ba2740 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d1929a50 con 0x5571d1b58cf0 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5571d19a03a0 con 0x5571d1b50890 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd558a6d000 10 client.0 _ll_register_callbacks cb 0x5571d194d240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1bb5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1c03a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1bb5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52868/0 (socket says 172.21.15.18:52868) 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b50890 0x5571d1c034e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.398+0000 7fd54f400640 1 -- 172.21.15.18:0/2167601401 learned_addr learned my addr 172.21.15.18:0/2167601401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 -- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b50890 msgr2=0x5571d1c034e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b50890 0x5571d1c034e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 -- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 msgr2=0x5571d1bb5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1bb5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 -- 172.21.15.18:0/2167601401 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571d195cfc0 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54e000640 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1c03a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0523b0 tx=0x7fd53c0833b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e47e5060afcf548 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c080040 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd53c055090 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5400d0070 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53c055390 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 10 client.6835 fetch_fsmap learned FSMap version 54 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5571d19fa9e0 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5400d0070 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd53c005bb0 con 0x5571d1b58cf0 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 10 client.6835 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T10:10:00.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 10 client.6835 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 20 client.6835 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1ba3060 0x5571d1c0c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 4 client.6835 mds_command: new command op to 7020 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 --> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5571d19ae5d0 con 0x5571d1ba3060 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54ea00640 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1ba3060 0x5571d1c0c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd54ea00640 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1ba3060 0x5571d1c0c350 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fb1a97b9317e14 server_cookie=21215b88257bb298 in_seq=0 out_seq=0 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 10 client.6835 ms_handle_connect on v2:172.21.15.18:6832/1522131384 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 1 -- 172.21.15.18:0/2167601401 <== mds.0 v2:172.21.15.18:6832/1522131384 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571d19ae5d0 con 0x5571d1ba3060 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 10 client.6835 handle_command_reply: tid=0 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 client.6835 shutdown 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 msgr2=0x5571d1c03a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1c03a20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0523b0 tx=0x7fd53c0833b0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 shutdown_connections 2024-04-25T10:10:00.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:6832/1522131384,v1:172.21.15.18:6835/1522131384] conn(0x5571d1ba3060 0x5571d1c0c350 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5571d1ba2740 0x5571d1bb5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd52fe00640 0 client.6835 ms_handle_reset on v2:172.21.15.18:6832/1522131384 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571d1b58cf0 0x5571d1c03a20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 --2- 172.21.15.18:0/2167601401 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5571d1b50890 0x5571d1c034e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 >> 172.21.15.18:0/2167601401 conn(0x5571d1b5fcb0 msgr2=0x5571d1b53510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 shutdown_connections 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 1 -- 172.21.15.18:0/2167601401 wait complete. 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd558a6d000 20 client.6835 trim_cache size 0 max 16384 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:00.416 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-25T10:10:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 msgr2=0x7fd530069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 0x7fd530069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd5400ad000 tx=0x7fd5400a6000 comp rx=0 tx=0).stop 2024-04-25T10:10:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 msgr2=0x7fd5501595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e930 tx=0x7fd53c00edf0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 shutdown_connections 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd530066f60 0x7fd530069420 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd55015ee60 0x7fd55013ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd550144120 0x7fd5501595b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 --2- 172.21.15.18:0/1571116135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5500ccbf0 0x7fd550158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 >> 172.21.15.18:0/1571116135 conn(0x7fd550067080 msgr2=0x7fd5500b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 shutdown_connections 2024-04-25T10:10:00.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.402+0000 7fd555600640 1 -- 172.21.15.18:0/1571116135 wait complete. 2024-04-25T10:10:00.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:10:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.562+0000 7f2927e00640 1 Processor -- start 2024-04-25T10:10:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.562+0000 7f2927e00640 1 -- start start 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f292815efa0 0x7f2928099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29280cdb70 0x7f2928099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29280cd6c0 con 0x7f29280b04b0 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280b3fe0 con 0x7f29280cdb70 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29280cce20 con 0x7f292815efa0 2024-04-25T10:10:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29280cdb70 0x7f2928099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f29280cdb70 0x7f2928099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52882/0 (socket says 172.21.15.18:52882) 2024-04-25T10:10:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 -- 172.21.15.18:0/3678734941 learned_addr learned my addr 172.21.15.18:0/3678734941 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2927400640 1 --1- 172.21.15.18:0/3678734941 >> v1:172.21.15.18:6789/0 conn(0x7f29280b04b0 0x7f29280cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44620/0 (socket says 172.21.15.18:44620) 2024-04-25T10:10:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f2926a00640 1 --2- 172.21.15.18:0/3678734941 >> v2:172.21.15.167:3300/0 conn(0x7f292815efa0 0x7f2928099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 -- 172.21.15.18:0/3678734941 >> v2:172.21.15.167:3300/0 conn(0x7f292815efa0 msgr2=0x7f2928099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 --2- 172.21.15.18:0/3678734941 >> v2:172.21.15.167:3300/0 conn(0x7f292815efa0 0x7f2928099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 -- 172.21.15.18:0/3678734941 >> v1:172.21.15.18:6789/0 conn(0x7f29280b04b0 legacy=0x7f29280cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.566+0000 7f291e000640 1 -- 172.21.15.18:0/3678734941 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280cd100 con 0x7f29280cdb70 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f291e000640 1 --2- 172.21.15.18:0/3678734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f2928099fa0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f292806f090 tx=0x7f291001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2161b92a2800a9ae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2926000640 1 -- 172.21.15.18:0/3678734941 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100b0070 con 0x7f29280cdb70 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2926000640 1 -- 172.21.15.18:0/3678734941 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29100ab600 con 0x7f29280cdb70 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2926000640 1 -- 172.21.15.18:0/3678734941 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100ab9d0 con 0x7f29280cdb70 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- 172.21.15.18:0/3678734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 msgr2=0x7f2928099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- 172.21.15.18:0/3678734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f2928099fa0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f292806f090 tx=0x7f291001c520 comp rx=0 tx=0).stop 2024-04-25T10:10:00.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- 172.21.15.18:0/3678734941 shutdown_connections 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- 172.21.15.18:0/3678734941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f2928099fa0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- 172.21.15.18:0/3678734941 >> v2:172.21.15.167:3300/0 conn(0x7f292815efa0 0x7f2928099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- 172.21.15.18:0/3678734941 >> 172.21.15.18:0/3678734941 conn(0x7f29280b3050 msgr2=0x7f29280b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- 172.21.15.18:0/3678734941 shutdown_connections 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- 172.21.15.18:0/3678734941 wait complete. 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 Processor -- start 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- start start 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29280b04b0 0x7f29281643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f292815efa0 0x7f2928165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2928168820 con 0x7f29280cdb70 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29281686a0 con 0x7f29280b04b0 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.570+0000 7f2927e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29281689a0 con 0x7f292815efa0 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52886/0 (socket says 172.21.15.18:52886) 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 -- 172.21.15.18:0/209627869 learned_addr learned my addr 172.21.15.18:0/209627869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f2926a00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29280b04b0 0x7f29281643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f2927400640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f292815efa0 0x7f2928165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 -- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f292815efa0 msgr2=0x7f2928165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f292815efa0 0x7f2928165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 -- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29280b04b0 msgr2=0x7f29281643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29280b04b0 0x7f29281643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 -- 172.21.15.18:0/209627869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292806c700 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291e000640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f29100ae040 tx=0x7f29100192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100b0040 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29100b4610 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29100b4a00 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292806c980 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292806cf40 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292804efa0 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29100ab4c0 con 0x7f29280cdb70 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.574+0000 7f291f400640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 0x7f2904069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.578+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f291011ed00 con 0x7f29280cdb70 2024-04-25T10:10:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.578+0000 7f2926a00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 0x7f2904069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.578+0000 7f2926a00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 0x7f2904069450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29281fa0a0 tx=0x7f2918008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.582+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f292806c700 con 0x7f29280cdb70 2024-04-25T10:10:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f29280b2910 con 0x7f29280cdb70 2024-04-25T10:10:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f291f400640 1 -- 172.21.15.18:0/209627869 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2910016110 con 0x7f29280cdb70 2024-04-25T10:10:00.789 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:00.789 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:10:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 msgr2=0x7f2904069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 0x7f2904069450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f29281fa0a0 tx=0x7f2918008040 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 msgr2=0x7f292806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f29100ae040 tx=0x7f29100192c0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 shutdown_connections 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2904066f90 0x7f2904069450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f292815efa0 0x7f2928165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29280cdb70 0x7f292806d740 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 --2- 172.21.15.18:0/209627869 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29280b04b0 0x7f29281643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 >> 172.21.15.18:0/209627869 conn(0x7f29280b3050 msgr2=0x7f2928159290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 shutdown_connections 2024-04-25T10:10:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.782+0000 7f2927e00640 1 -- 172.21.15.18:0/209627869 wait complete. 2024-04-25T10:10:00.811 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:10:00.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:10:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 Processor -- start 2024-04-25T10:10:00.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 -- start start 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c70144140 0x7f7c700ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c7006ead0 0x7f7c700b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7015ac60 con 0x7f7c700ced60 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.942+0000 7f7c75800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700cf3e0 con 0x7f7c7006ead0 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c75800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7015af20 con 0x7f7c70144140 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c7006ead0 0x7f7c700b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c7006ead0 0x7f7c700b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52890/0 (socket says 172.21.15.18:52890) 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 -- 172.21.15.18:0/3770354950 learned_addr learned my addr 172.21.15.18:0/3770354950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6ea00640 1 --2- 172.21.15.18:0/3770354950 >> v2:172.21.15.167:3300/0 conn(0x7f7c70144140 0x7f7c700ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 -- 172.21.15.18:0/3770354950 >> v2:172.21.15.167:3300/0 conn(0x7f7c70144140 msgr2=0x7f7c700ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 --2- 172.21.15.18:0/3770354950 >> v2:172.21.15.167:3300/0 conn(0x7f7c70144140 0x7f7c700ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 -- 172.21.15.18:0/3770354950 >> v1:172.21.15.167:6789/0 conn(0x7f7c700ced60 legacy=0x7f7c7006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 -- 172.21.15.18:0/3770354950 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7015b200 con 0x7f7c7006ead0 2024-04-25T10:10:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6f400640 1 --2- 172.21.15.18:0/3770354950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c7006ead0 0x7f7c700b0760 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006eef0 tx=0x7f7c6801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef414895910ada6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6e000640 1 -- 172.21.15.18:0/3770354950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680b1070 con 0x7f7c7006ead0 2024-04-25T10:10:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6e000640 1 -- 172.21.15.18:0/3770354950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c680ac440 con 0x7f7c7006ead0 2024-04-25T10:10:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.946+0000 7f7c6e000640 1 -- 172.21.15.18:0/3770354950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c680ac810 con 0x7f7c7006ead0 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- 172.21.15.18:0/3770354950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c7006ead0 msgr2=0x7f7c700b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- 172.21.15.18:0/3770354950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c7006ead0 0x7f7c700b0760 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f7c7006eef0 tx=0x7f7c6801c520 comp rx=0 tx=0).stop 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- 172.21.15.18:0/3770354950 shutdown_connections 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- 172.21.15.18:0/3770354950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c7006ead0 0x7f7c700b0760 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- 172.21.15.18:0/3770354950 >> v2:172.21.15.167:3300/0 conn(0x7f7c70144140 0x7f7c700ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- 172.21.15.18:0/3770354950 >> 172.21.15.18:0/3770354950 conn(0x7f7c70066fa0 msgr2=0x7f7c7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- 172.21.15.18:0/3770354950 shutdown_connections 2024-04-25T10:10:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- 172.21.15.18:0/3770354950 wait complete. 2024-04-25T10:10:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 Processor -- start 2024-04-25T10:10:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- start start 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7006ead0 0x7f7c7013e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c70144140 0x7f7c7015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015bb80 con 0x7f7c700ced60 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7015ba00 con 0x7f7c7006ead0 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c75800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c701673e0 con 0x7f7c70144140 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c6ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7006ead0 0x7f7c7013e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52892/0 (socket says 172.21.15.18:52892) 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 -- 172.21.15.18:0/967030283 learned_addr learned my addr 172.21.15.18:0/967030283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c6f400640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c70144140 0x7f7c7015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 -- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c70144140 msgr2=0x7f7c7015f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c70144140 0x7f7c7015f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 -- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7006ead0 msgr2=0x7f7c7013e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7006ead0 0x7f7c7013e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.950+0000 7f7c66000640 1 -- 172.21.15.18:0/967030283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c70159e00 con 0x7f7c700ced60 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c66000640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c790 tx=0x7f7c5800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58016020 con 0x7f7c700ced60 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c58006d60 con 0x7f7c700ced60 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c70155da0 con 0x7f7c700ced60 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003bc0 con 0x7f7c700ced60 2024-04-25T10:10:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c70156360 con 0x7f7c700ced60 2024-04-25T10:10:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700745d0 con 0x7f7c700ced60 2024-04-25T10:10:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c5800a850 con 0x7f7c700ced60 2024-04-25T10:10:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 0x7f7c4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7c58084e70 con 0x7f7c700ced60 2024-04-25T10:10:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.954+0000 7f7c6ea00640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 0x7f7c4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.958+0000 7f7c6ea00640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 0x7f7c4c069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c600079c0 tx=0x7f7c60008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:00.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:00.958+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c58020020 con 0x7f7c700ced60 2024-04-25T10:10:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c7015ecb0 con 0x7f7c700ced60 2024-04-25T10:10:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c67400640 1 -- 172.21.15.18:0/967030283 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c58055640 con 0x7f7c700ced60 2024-04-25T10:10:01.166 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 msgr2=0x7f7c4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 0x7f7c4c069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c600079c0 tx=0x7f7c60008040 comp rx=0 tx=0).stop 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 msgr2=0x7f7c70156880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c790 tx=0x7f7c5800cc50 comp rx=0 tx=0).stop 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 shutdown_connections 2024-04-25T10:10:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c4c066f60 0x7f7c4c069420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c70144140 0x7f7c7015f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c700ced60 0x7f7c70156880 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 --2- 172.21.15.18:0/967030283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c7006ead0 0x7f7c7013e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 >> 172.21.15.18:0/967030283 conn(0x7f7c70066fa0 msgr2=0x7f7c7015e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 shutdown_connections 2024-04-25T10:10:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.158+0000 7f7c75800640 1 -- 172.21.15.18:0/967030283 wait complete. 2024-04-25T10:10:01.187 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:10:01.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:10:01.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:10:01.187 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:10:01.187 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:01.188 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:10:01.188 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:10:01.188 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:10:01.188 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:01.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.188 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:10:01.197 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:10:01.198 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42103sec preferred_lft 42103sec 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:10:01.199 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:10:01.200 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:10:01.201 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:01.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.201 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:10:01.258 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:10:01.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.260 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:10:01.313 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:10:01.313 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:10:01.313 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:10:01.313 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:10:01.314 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:10:01.314 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:10:01.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:10:01.314 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:10:01.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.406 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:10:01.416 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:10:01.416 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:10:01.417 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:01.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:10:01.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:01.484 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:01.542 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:01.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:01.542 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:01.592 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:10:01.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:01.686 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:01.686 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:10:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:10:01.699 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:10:01.703 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:10:01.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:01.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.724 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:10:01.783 INFO:teuthology.orchestra.run.smithi018.stdout:client7305 2024-04-25T10:10:01.784 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:01.784 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:01.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:01.837 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T10:10:01.893 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:10:01.894 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T10:10:01.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 Processor -- start 2024-04-25T10:10:01.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 -- start start 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0594002300 0x55c8a8f4b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a8f738c0 0x55c8a8f73cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a8eee9f0 con 0x55c8a9021c10 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a8ef2950 con 0x7f0594002300 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05b1923080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8a8f76b00 con 0x55c8a8f738c0 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60418/0 (socket says 172.21.15.18:60418) 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 -- 172.21.15.18:0/3535560113 learned_addr learned my addr 172.21.15.18:0/3535560113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05aec00640 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0594002300 0x55c8a8f4b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05af600640 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a8f738c0 0x55c8a8f73cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 -- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a8f738c0 msgr2=0x55c8a8f73cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:01.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a8f738c0 0x55c8a8f73cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 -- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0594002300 msgr2=0x55c8a8f4b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0594002300 0x55c8a8f4b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 -- 172.21.15.18:0/3535560113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8a8f74210 con 0x55c8a9021c10 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ae200640 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f059c0017b0 tx=0x7f059c009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979378e4478046a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ace00640 1 -- 172.21.15.18:0/3535560113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00e8c0 con 0x55c8a9021c10 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ace00640 1 -- 172.21.15.18:0/3535560113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059c00ea80 con 0x55c8a9021c10 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.978+0000 7f05ace00640 1 -- 172.21.15.18:0/3535560113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c018400 con 0x55c8a9021c10 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/3535560113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 msgr2=0x55c8a901e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f059c0017b0 tx=0x7f059c009950 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/3535560113 shutdown_connections 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a8f738c0 0x55c8a8f73cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8a9021c10 0x55c8a901e900 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- 172.21.15.18:0/3535560113 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0594002300 0x55c8a8f4b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/3535560113 >> 172.21.15.18:0/3535560113 conn(0x55c8a8f72c50 msgr2=0x55c8a8f8cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:01.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/3535560113 shutdown_connections 2024-04-25T10:10:01.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/3535560113 wait complete. 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 Processor -- start 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- start start 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8a8f738c0 0x55c8a8f71fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a9021c10 0x55c8a90ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 0x55c8a8f4aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a90b1320 con 0x7f0594002300 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8a90b1100 con 0x55c8a8f738c0 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8a9022190 con 0x55c8a9021c10 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 0x55c8a8f4aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 0x55c8a8f4aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60426/0 (socket says 172.21.15.18:60426) 2024-04-25T10:10:01.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 -- 172.21.15.18:0/2793557962 learned_addr learned my addr 172.21.15.18:0/2793557962 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05aec00640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8a8f738c0 0x55c8a8f71fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05ae200640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a9021c10 0x55c8a90ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 -- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a9021c10 msgr2=0x55c8a90ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a9021c10 0x55c8a90ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 -- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8a8f738c0 msgr2=0x55c8a8f71fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8a8f738c0 0x55c8a8f71fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 -- 172.21.15.18:0/2793557962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8a90ae140 con 0x7f0594002300 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05ae200640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8a9021c10 0x55c8a90ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05aec00640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8a8f738c0 0x55c8a8f71fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05af600640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 0x55c8a8f4aed0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f05a8010480 tx=0x7f05a8010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05a7400640 1 -- 172.21.15.18:0/2793557962 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8006020 con 0x7f0594002300 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05a7400640 1 -- 172.21.15.18:0/2793557962 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a80061c0 con 0x7f0594002300 2024-04-25T10:10:01.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8a90ae3e0 con 0x7f0594002300 2024-04-25T10:10:01.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05a7400640 1 -- 172.21.15.18:0/2793557962 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a8014940 con 0x7f0594002300 2024-04-25T10:10:01.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.982+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8a90ae920 con 0x7f0594002300 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05a7400640 1 -- 172.21.15.18:0/2793557962 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f05a8012040 con 0x7f0594002300 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05a7400640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0590065940 0x7f0590067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05a7400640 1 -- 172.21.15.18:0/2793557962 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f05a8084280 con 0x7f0594002300 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05b1923080 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c8a90214f0 0x55c8a90b96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82) v9 -- 0x55c8a90b9c00 con 0x55c8a90214f0 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05aec00640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0590065940 0x7f0590067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05ae200640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c8a90214f0 0x55c8a90b96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05ae200640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c8a90214f0 0x55c8a90b96c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:01.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.986+0000 7f05aec00640 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0590065940 0x7f0590067e00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f05a00ae000 tx=0x7f05a0003030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:01.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05ae200640 1 -- 172.21.15.18:0/2793557962 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v82'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f059c015020 con 0x55c8a90214f0 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c8a90214f0 msgr2=0x55c8a90b96c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c8a90214f0 0x55c8a90b96c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0590065940 msgr2=0x7f0590067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0590065940 0x7f0590067e00 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f05a00ae000 tx=0x7f05a0003030 comp rx=0 tx=0).stop 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 msgr2=0x55c8a8f4aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 --2- 172.21.15.18:0/2793557962 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0594002300 0x55c8a8f4aed0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f05a8010480 tx=0x7f05a8010940 comp rx=0 tx=0).stop 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05af600640 1 -- 172.21.15.18:0/2793557962 reap_dead start 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 shutdown_connections 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 >> 172.21.15.18:0/2793557962 conn(0x55c8a8f72c50 msgr2=0x55c8a901e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 shutdown_connections 2024-04-25T10:10:01.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:01.990+0000 7f05b1923080 1 -- 172.21.15.18:0/2793557962 wait complete. 2024-04-25T10:10:02.002 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:10:02.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:10:02.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:10:02.210 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:10:02.211 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:02.211 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:02.220 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:02.220 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:02.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 Processor -- start 2024-04-25T10:10:02.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 -- start start 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f481c099a60 0x7f481c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f481c15ee00 0x7f481c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c1616a0 0x7f481c161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c09a380 con 0x7f481c099a60 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c06c650 con 0x7f481c15ee00 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f4821600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c06c930 con 0x7f481c1616a0 2024-04-25T10:10:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f481c099a60 0x7f481c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f481c099a60 0x7f481c099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60438/0 (socket says 172.21.15.18:60438) 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 -- 172.21.15.18:0/111215979 learned_addr learned my addr 172.21.15.18:0/111215979 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 -- 172.21.15.18:0/111215979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c1616a0 msgr2=0x7f481c161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 --2- 172.21.15.18:0/111215979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c1616a0 0x7f481c161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 -- 172.21.15.18:0/111215979 >> v2:172.21.15.167:3300/0 conn(0x7f481c15ee00 msgr2=0x7f481c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 --2- 172.21.15.18:0/111215979 >> v2:172.21.15.167:3300/0 conn(0x7f481c15ee00 0x7f481c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.450+0000 7f481aa00640 1 -- 172.21.15.18:0/111215979 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c06cc10 con 0x7f481c099a60 2024-04-25T10:10:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f481aa00640 1 --2- 172.21.15.18:0/111215979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c099a60 0x7f481c099e40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ce1f0 tx=0x7f480c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4e21ffd3fd29e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f481a000640 1 -- 172.21.15.18:0/111215979 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ab5f0 con 0x7f481c099a60 2024-04-25T10:10:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f481a000640 1 -- 172.21.15.18:0/111215979 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c0b0070 con 0x7f481c099a60 2024-04-25T10:10:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f481a000640 1 -- 172.21.15.18:0/111215979 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c0ab9b0 con 0x7f481c099a60 2024-04-25T10:10:02.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 -- 172.21.15.18:0/111215979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c099a60 msgr2=0x7f481c099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 --2- 172.21.15.18:0/111215979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c099a60 0x7f481c099e40 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f481c0ce1f0 tx=0x7f480c01c520 comp rx=0 tx=0).stop 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 -- 172.21.15.18:0/111215979 shutdown_connections 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 --2- 172.21.15.18:0/111215979 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c1616a0 0x7f481c161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 --2- 172.21.15.18:0/111215979 >> v2:172.21.15.167:3300/0 conn(0x7f481c15ee00 0x7f481c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 --2- 172.21.15.18:0/111215979 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c099a60 0x7f481c099e40 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 -- 172.21.15.18:0/111215979 >> 172.21.15.18:0/111215979 conn(0x7f481c0d17a0 msgr2=0x7f481c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 -- 172.21.15.18:0/111215979 shutdown_connections 2024-04-25T10:10:02.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.454+0000 7f4821600640 1 -- 172.21.15.18:0/111215979 wait complete. 2024-04-25T10:10:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 Processor -- start 2024-04-25T10:10:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- start start 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c099a60 0x7f481c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c1616a0 0x7f481c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15e000 con 0x7f481c15ee00 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c15de80 con 0x7f481c1616a0 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c06c260 con 0x7f481c099a60 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60448/0 (socket says 172.21.15.18:60448) 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 -- 172.21.15.18:0/3914136551 learned_addr learned my addr 172.21.15.18:0/3914136551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:02.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f481aa00640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c099a60 0x7f481c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f481b400640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c1616a0 0x7f481c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 -- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c099a60 msgr2=0x7f481c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c099a60 0x7f481c0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 -- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c1616a0 msgr2=0x7f481c0b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c1616a0 0x7f481c0b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 -- 172.21.15.18:0/3914136551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c15d700 con 0x7f481c15ee00 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4812000640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f480400b480 tx=0x7f480400b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804014070 con 0x7f481c15ee00 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804010890 con 0x7f481c15ee00 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c160760 con 0x7f481c15ee00 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804010c80 con 0x7f481c15ee00 2024-04-25T10:10:02.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.458+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c160d20 con 0x7f481c15ee00 2024-04-25T10:10:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c0745d0 con 0x7f481c15ee00 2024-04-25T10:10:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4804017070 con 0x7f481c15ee00 2024-04-25T10:10:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f4813400640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 0x7f47f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4804084fe0 con 0x7f481c15ee00 2024-04-25T10:10:02.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f481aa00640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 0x7f47f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.462+0000 7f481aa00640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 0x7f47f8069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f480c0af000 tx=0x7f480c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.466+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4804055e40 con 0x7f481c15ee00 2024-04-25T10:10:02.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.630+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f481c0d2620 con 0x7f481c15ee00 2024-04-25T10:10:02.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.630+0000 7f4813400640 1 -- 172.21.15.18:0/3914136551 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17048 (secure 0 0 0) 0x7f4804010e20 con 0x7f481c15ee00 2024-04-25T10:10:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:02.639 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:48.763190+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 msgr2=0x7f47f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 0x7f47f8069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f480c0af000 tx=0x7f480c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 msgr2=0x7f481c15fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f480400b480 tx=0x7f480400b940 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 shutdown_connections 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f481c1616a0 0x7f481c0b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f481c15ee00 0x7f481c15fca0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f47f8066f60 0x7f47f8069420 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 --2- 172.21.15.18:0/3914136551 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f481c099a60 0x7f481c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 >> 172.21.15.18:0/3914136551 conn(0x7f481c0d17a0 msgr2=0x7f481c1565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 shutdown_connections 2024-04-25T10:10:02.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.634+0000 7f4821600640 1 -- 172.21.15.18:0/3914136551 wait complete. 2024-04-25T10:10:02.660 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:08:31.175528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:08:32.386489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:10:02.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:10:02.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.794+0000 7fdc7a800640 1 Processor -- start 2024-04-25T10:10:02.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.794+0000 7fdc7a800640 1 -- start start 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc7a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc7415acd0 0x7fdc7415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc7a800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 0x7fdc740b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc7a800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7415bc40 con 0x7fdc74144120 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc7a800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7415e490 con 0x7fdc7415acd0 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc7a800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc7415b150 con 0x7fdc7415ee60 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc7415acd0 0x7fdc7415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc7415acd0 0x7fdc7415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60464/0 (socket says 172.21.15.18:60464) 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 -- 172.21.15.18:0/1426877949 learned_addr learned my addr 172.21.15.18:0/1426877949 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:02.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc73e00640 1 --2- 172.21.15.18:0/1426877949 >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 0x7fdc740b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 -- 172.21.15.18:0/1426877949 >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 msgr2=0x7fdc740b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:02.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/1426877949 >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 0x7fdc740b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 -- 172.21.15.18:0/1426877949 >> v1:172.21.15.167:6789/0 conn(0x7fdc74144120 legacy=0x7fdc740ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:02.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc6aa00640 1 -- 172.21.15.18:0/1426877949 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7415b3a0 con 0x7fdc7415acd0 2024-04-25T10:10:02.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.798+0000 7fdc73e00640 1 --2- 172.21.15.18:0/1426877949 >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 0x7fdc740b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/1426877949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7415acd0 0x7fdc7415e920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fdc7406bb20 tx=0x7fdc5c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d16af89048d8eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc72a00640 1 -- 172.21.15.18:0/1426877949 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0b2070 con 0x7fdc7415acd0 2024-04-25T10:10:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc72a00640 1 -- 172.21.15.18:0/1426877949 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c0a9070 con 0x7fdc7415acd0 2024-04-25T10:10:02.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc72a00640 1 -- 172.21.15.18:0/1426877949 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c0ad880 con 0x7fdc7415acd0 2024-04-25T10:10:02.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- 172.21.15.18:0/1426877949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7415acd0 msgr2=0x7fdc7415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 --2- 172.21.15.18:0/1426877949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7415acd0 0x7fdc7415e920 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fdc7406bb20 tx=0x7fdc5c01c450 comp rx=0 tx=0).stop 2024-04-25T10:10:02.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- 172.21.15.18:0/1426877949 shutdown_connections 2024-04-25T10:10:02.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 --2- 172.21.15.18:0/1426877949 >> v2:172.21.15.167:3300/0 conn(0x7fdc7415ee60 0x7fdc740b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 --2- 172.21.15.18:0/1426877949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc7415acd0 0x7fdc7415e920 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- 172.21.15.18:0/1426877949 >> 172.21.15.18:0/1426877949 conn(0x7fdc74067080 msgr2=0x7fdc7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- 172.21.15.18:0/1426877949 shutdown_connections 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- 172.21.15.18:0/1426877949 wait complete. 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 Processor -- start 2024-04-25T10:10:02.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.802+0000 7fdc7a800640 1 -- start start 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 0x7fdc740aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7415ee60 0x7fdc740b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74165fd0 con 0x7fdc74144120 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74165e50 con 0x7fdc7415ee60 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc74166150 con 0x7fdc7415acd0 2024-04-25T10:10:02.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60478/0 (socket says 172.21.15.18:60478) 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 -- 172.21.15.18:0/3884064946 learned_addr learned my addr 172.21.15.18:0/3884064946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 0x7fdc740aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73e00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7415ee60 0x7fdc740b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 -- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 msgr2=0x7fdc740aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 0x7fdc740aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 -- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7415ee60 msgr2=0x7fdc740b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7415ee60 0x7fdc740b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 -- 172.21.15.18:0/3884064946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc7413a770 con 0x7fdc74144120 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 0x7fdc740aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc73400640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c7f0 tx=0x7fdc6400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64016020 con 0x7fdc74144120 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6400aa50 con 0x7fdc74144120 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400ae40 con 0x7fdc74144120 2024-04-25T10:10:02.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7413aeb0 con 0x7fdc74144120 2024-04-25T10:10:02.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7415a4c0 con 0x7fdc74144120 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc740745d0 con 0x7fdc74144120 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.806+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc64019020 con 0x7fdc74144120 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.810+0000 7fdc6be00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 0x7fdc50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.810+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fdc64085620 con 0x7fdc74144120 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.810+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 0x7fdc50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.810+0000 7fdc6aa00640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 0x7fdc50069420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0af000 tx=0x7fdc5c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:02.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.814+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc64020020 con 0x7fdc74144120 2024-04-25T10:10:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.974+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc74156a00 con 0x7fdc74144120 2024-04-25T10:10:02.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.974+0000 7fdc6be00640 1 -- 172.21.15.18:0/3884064946 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc64056440 con 0x7fdc74144120 2024-04-25T10:10:02.983 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:10:02.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 msgr2=0x7fdc50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 0x7fdc50069420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c0af000 tx=0x7fdc5c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:02.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 msgr2=0x7fdc741564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:02.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c7f0 tx=0x7fdc6400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 shutdown_connections 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc7415ee60 0x7fdc740b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdc50066f60 0x7fdc50069420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdc7415acd0 0x7fdc740aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 --2- 172.21.15.18:0/3884064946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc74144120 0x7fdc741564c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 >> 172.21.15.18:0/3884064946 conn(0x7fdc74067080 msgr2=0x7fdc7406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 shutdown_connections 2024-04-25T10:10:02.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:02.978+0000 7fdc7a800640 1 -- 172.21.15.18:0/3884064946 wait complete. 2024-04-25T10:10:03.006 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:10:03.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 Processor -- start 2024-04-25T10:10:03.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 -- start start 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 0x7f6c6015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6015fc00 con 0x7f6c6006e010 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6006d640 con 0x7f6c60159320 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c65600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6015fee0 con 0x7f6c6015f440 2024-04-25T10:10:03.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48780/0 (socket says 172.21.15.18:48780) 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 -- 172.21.15.18:0/879238039 learned_addr learned my addr 172.21.15.18:0/879238039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c5ea00640 1 --2- 172.21.15.18:0/879238039 >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 0x7f6c6015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 -- 172.21.15.18:0/879238039 >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 msgr2=0x7f6c6015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 --2- 172.21.15.18:0/879238039 >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 0x7f6c6015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 -- 172.21.15.18:0/879238039 >> v1:172.21.15.167:6789/0 conn(0x7f6c6006e010 legacy=0x7f6c6006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c56000640 1 -- 172.21.15.18:0/879238039 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c601601c0 con 0x7f6c6015f440 2024-04-25T10:10:03.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.142+0000 7f6c5ea00640 1 --2- 172.21.15.18:0/879238039 >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 0x7f6c6015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:03.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c56000640 1 --2- 172.21.15.18:0/879238039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009870 tx=0x7f6c4801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64ca5647aca536cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c5e000640 1 -- 172.21.15.18:0/879238039 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480aa620 con 0x7f6c6015f440 2024-04-25T10:10:03.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c5e000640 1 -- 172.21.15.18:0/879238039 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480af070 con 0x7f6c6015f440 2024-04-25T10:10:03.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c5e000640 1 -- 172.21.15.18:0/879238039 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480aa9e0 con 0x7f6c6015f440 2024-04-25T10:10:03.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 -- 172.21.15.18:0/879238039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 msgr2=0x7f6c6006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 --2- 172.21.15.18:0/879238039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c48009870 tx=0x7f6c4801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 -- 172.21.15.18:0/879238039 shutdown_connections 2024-04-25T10:10:03.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 --2- 172.21.15.18:0/879238039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6006dad0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 --2- 172.21.15.18:0/879238039 >> v2:172.21.15.167:3300/0 conn(0x7f6c60159320 0x7f6c6015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.146+0000 7f6c65600640 1 -- 172.21.15.18:0/879238039 >> 172.21.15.18:0/879238039 conn(0x7f6c60067080 msgr2=0x7f6c6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:03.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- 172.21.15.18:0/879238039 shutdown_connections 2024-04-25T10:10:03.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- 172.21.15.18:0/879238039 wait complete. 2024-04-25T10:10:03.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 Processor -- start 2024-04-25T10:10:03.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- start start 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6006e010 0x7f6c6015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6013f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60071c00 con 0x7f6c60159320 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60071a80 con 0x7f6c6006e010 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c65600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6006ebb0 con 0x7f6c6015f440 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60480/0 (socket says 172.21.15.18:60480) 2024-04-25T10:10:03.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 -- 172.21.15.18:0/881852053 learned_addr learned my addr 172.21.15.18:0/881852053 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c5ea00640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6006e010 0x7f6c6015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c5f400640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6013f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 -- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 msgr2=0x7f6c6013f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6013f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 -- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6006e010 msgr2=0x7f6c6015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6006e010 0x7f6c6015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 -- 172.21.15.18:0/881852053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600b0400 con 0x7f6c60159320 2024-04-25T10:10:03.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.150+0000 7f6c56000640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6c480ac040 tx=0x7f6c4801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480aac30 con 0x7f6c60159320 2024-04-25T10:10:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480aadd0 con 0x7f6c60159320 2024-04-25T10:10:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c480bd630 con 0x7f6c60159320 2024-04-25T10:10:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600b06e0 con 0x7f6c60159320 2024-04-25T10:10:03.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c600b0ca0 con 0x7f6c60159320 2024-04-25T10:10:03.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c600745d0 con 0x7f6c60159320 2024-04-25T10:10:03.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c480c6440 con 0x7f6c60159320 2024-04-25T10:10:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 0x7f6c3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6c4811f540 con 0x7f6c60159320 2024-04-25T10:10:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.154+0000 7f6c5ea00640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 0x7f6c3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.158+0000 7f6c5ea00640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 0x7f6c3c069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6c60140600 tx=0x7f6c50009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.158+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c48016150 con 0x7f6c60159320 2024-04-25T10:10:03.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.318+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c6015b3d0 con 0x7f6c60159320 2024-04-25T10:10:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.318+0000 7f6c57400640 1 -- 172.21.15.18:0/881852053 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c480efd10 con 0x7f6c60159320 2024-04-25T10:10:03.328 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 msgr2=0x7f6c3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 0x7f6c3c069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6c60140600 tx=0x7f6c50009190 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 msgr2=0x7f6c6015e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f6c480ac040 tx=0x7f6c4801ace0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 shutdown_connections 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c3c066f60 0x7f6c3c069420 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c6015f440 0x7f6c6013f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c60159320 0x7f6c6015e6d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 --2- 172.21.15.18:0/881852053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c6006e010 0x7f6c6015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 >> 172.21.15.18:0/881852053 conn(0x7f6c60067080 msgr2=0x7f6c6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 shutdown_connections 2024-04-25T10:10:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.322+0000 7f6c65600640 1 -- 172.21.15.18:0/881852053 wait complete. 2024-04-25T10:10:03.349 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:10:03.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 Processor -- start 2024-04-25T10:10:03.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 -- start start 2024-04-25T10:10:03.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8370072210 0x7f83700cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837006ac10 con 0x7f837015dd90 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837006aeb0 con 0x7f83700ce1d0 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8377200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83700b2dc0 con 0x7f8370072210 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f837015dd90 0x7f8370071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55704/0 (socket says 172.21.15.18:55704) 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836fe00640 1 -- 172.21.15.18:0/1185760507 learned_addr learned my addr 172.21.15.18:0/1185760507 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:03.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f8367400640 1 --2- 172.21.15.18:0/1185760507 >> v2:172.21.15.167:3300/0 conn(0x7f8370072210 0x7f83700cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565785436 0 0) 0x7f837006ac10 con 0x7f837015dd90 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8354003530 con 0x7f837015dd90 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2845769043 0 0) 0x7f8354003530 con 0x7f837015dd90 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 >> v2:172.21.15.167:3300/0 conn(0x7f8370072210 msgr2=0x7f83700cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 --2- 172.21.15.18:0/1185760507 >> v2:172.21.15.167:3300/0 conn(0x7f8370072210 0x7f83700cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 >> v1:172.21.15.167:6789/0 conn(0x7f83700ce1d0 legacy=0x7f83700ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837006b190 con 0x7f837015dd90 2024-04-25T10:10:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f8360001680 con 0x7f837015dd90 2024-04-25T10:10:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 >> v1:172.21.15.18:6789/0 conn(0x7f837015dd90 legacy=0x7f8370071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540039c0 0x7f8354003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 0x7f8354004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540051d0 0x7f835400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835400c140 con 0x7f8354004810 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835400c2f0 con 0x7f83540039c0 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.486+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835400c4f0 con 0x7f83540051d0 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 0x7f8354004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f836fe00640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540039c0 0x7f8354003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8375200640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540051d0 0x7f835400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 -- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540051d0 msgr2=0x7f835400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540051d0 0x7f835400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 -- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540039c0 msgr2=0x7f8354003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f83540039c0 0x7f8354003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 -- 172.21.15.18:0/1185760507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354003530 con 0x7f8354004810 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8375200640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f83540051d0 0x7f835400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:03.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8375200640 1 -- 172.21.15.18:0/1185760507 reap_dead start 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8367400640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 0x7f8354004c90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8358009ae0 tx=0x7f835801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99cbe6edcc1ef419 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580096b0 con 0x7f8354004810 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83580a64e0 con 0x7f8354004810 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f836f400640 1 -- 172.21.15.18:0/1185760507 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83580a68d0 con 0x7f8354004810 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8377200640 1 -- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 msgr2=0x7f8354004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.490+0000 7f8377200640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 0x7f8354004c90 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8358009ae0 tx=0x7f835801ca70 comp rx=0 tx=0).stop 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- 172.21.15.18:0/1185760507 shutdown_connections 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 --2- 172.21.15.18:0/1185760507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8354004810 0x7f8354004c90 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- 172.21.15.18:0/1185760507 >> 172.21.15.18:0/1185760507 conn(0x7f83700cfd90 msgr2=0x7f83700d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- 172.21.15.18:0/1185760507 shutdown_connections 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- 172.21.15.18:0/1185760507 wait complete. 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 Processor -- start 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- start start 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8354004810 0x7f83701f7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8370159790 0x7f83701e97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370162110 con 0x7f83700cb3b0 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8370161f90 con 0x7f8354004810 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8377200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8370162290 con 0x7f8370159790 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60494/0 (socket says 172.21.15.18:60494) 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 -- 172.21.15.18:0/916267516 learned_addr learned my addr 172.21.15.18:0/916267516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:03.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f836fe00640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8354004810 0x7f83701f7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8367400640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8370159790 0x7f83701e97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 -- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8370159790 msgr2=0x7f83701e97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8370159790 0x7f83701e97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 -- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8354004810 msgr2=0x7f83701f7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8354004810 0x7f83701f7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 -- 172.21.15.18:0/916267516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83701e9ce0 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f8375200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f837006e710 tx=0x7f836800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.494+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003980 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368018070 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003d60 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83701e9f80 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83701ea540 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83700745d0 con 0x7f83700cb3b0 2024-04-25T10:10:03.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8368005070 con 0x7f83700cb3b0 2024-04-25T10:10:03.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836cc00640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 0x7f834c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8368084600 con 0x7f83700cb3b0 2024-04-25T10:10:03.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.498+0000 7f836fe00640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 0x7f834c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.502+0000 7f836fe00640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 0x7f834c069450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8360001060 tx=0x7f8360000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.502+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8368021020 con 0x7f83700cb3b0 2024-04-25T10:10:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.666+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83700671b0 con 0x7f83700cb3b0 2024-04-25T10:10:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.666+0000 7f836cc00640 1 -- 172.21.15.18:0/916267516 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8368054de0 con 0x7f83700cb3b0 2024-04-25T10:10:03.677 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 msgr2=0x7f834c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 0x7f834c069450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8360001060 tx=0x7f8360000f90 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 msgr2=0x7f8370160340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f837006e710 tx=0x7f836800eb90 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 shutdown_connections 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83700cb3b0 0x7f8370160340 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f834c066f90 0x7f834c069450 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8370159790 0x7f83701e97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 --2- 172.21.15.18:0/916267516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8354004810 0x7f83701f7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 >> 172.21.15.18:0/916267516 conn(0x7f83700cfd90 msgr2=0x7f837015aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 shutdown_connections 2024-04-25T10:10:03.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.670+0000 7f8377200640 1 -- 172.21.15.18:0/916267516 wait complete. 2024-04-25T10:10:03.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:10:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.830+0000 7f6c52400640 1 Processor -- start 2024-04-25T10:10:03.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.830+0000 7f6c52400640 1 -- start start 2024-04-25T10:10:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c52400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c4c0b3090 0x7f6c4c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c52400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c15bc40 con 0x7f6c4c15acd0 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c52400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c15b3a0 con 0x7f6c4c144120 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c52400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c15e490 con 0x7f6c4c0b3090 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c4c0b3090 0x7f6c4c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4aa00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6c4c15acd0 0x7f6c4c15e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55716/0 (socket says 172.21.15.18:55716) 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4aa00640 1 -- 172.21.15.18:0/3766864583 learned_addr learned my addr 172.21.15.18:0/3766864583 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:03.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4be00640 1 -- 172.21.15.18:0/3766864583 >> v1:172.21.15.167:6789/0 conn(0x7f6c4c144120 legacy=0x7f6c4c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4be00640 1 -- 172.21.15.18:0/3766864583 >> v1:172.21.15.18:6789/0 conn(0x7f6c4c15acd0 legacy=0x7f6c4c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.834+0000 7f6c4be00640 1 -- 172.21.15.18:0/3766864583 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c15b680 con 0x7f6c4c0b3090 2024-04-25T10:10:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c4be00640 1 --2- 172.21.15.18:0/3766864583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c0b3520 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009d90 tx=0x7f6c4401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb0f2034d008d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c4a000640 1 -- 172.21.15.18:0/3766864583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440b2070 con 0x7f6c4c0b3090 2024-04-25T10:10:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c4a000640 1 -- 172.21.15.18:0/3766864583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440a5890 con 0x7f6c4c0b3090 2024-04-25T10:10:03.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c4a000640 1 -- 172.21.15.18:0/3766864583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440a5c60 con 0x7f6c4c0b3090 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- 172.21.15.18:0/3766864583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c0b3090 msgr2=0x7f6c4c0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 --2- 172.21.15.18:0/3766864583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c0b3520 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009d90 tx=0x7f6c4401c8e0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- 172.21.15.18:0/3766864583 shutdown_connections 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 --2- 172.21.15.18:0/3766864583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c0b3520 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- 172.21.15.18:0/3766864583 >> 172.21.15.18:0/3766864583 conn(0x7f6c4c067080 msgr2=0x7f6c4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- 172.21.15.18:0/3766864583 shutdown_connections 2024-04-25T10:10:03.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- 172.21.15.18:0/3766864583 wait complete. 2024-04-25T10:10:03.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 Processor -- start 2024-04-25T10:10:03.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.838+0000 7f6c52400640 1 -- start start 2024-04-25T10:10:03.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c13ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 0x7f6c4c15d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c1685d0 con 0x7f6c4c15acd0 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c168450 con 0x7f6c4c0b3090 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c168750 con 0x7f6c4c144120 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60510/0 (socket says 172.21.15.18:60510) 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 -- 172.21.15.18:0/792727600 learned_addr learned my addr 172.21.15.18:0/792727600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4aa00640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 0x7f6c4c15d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4b400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c13ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 -- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 msgr2=0x7f6c4c15d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 0x7f6c4c15d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 -- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c4c0b3090 msgr2=0x7f6c4c13ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c13ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:03.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 -- 172.21.15.18:0/792727600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c13f3e0 con 0x7f6c4c15acd0 2024-04-25T10:10:03.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4aa00640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 0x7f6c4c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:03.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c4be00640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6c440b0040 tx=0x7f6c44019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440bd020 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c440ad6c0 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440b2040 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c13f6c0 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c13fc80 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c140160 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.842+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c440c0020 con 0x7f6c4c15acd0 2024-04-25T10:10:03.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.846+0000 7f6c43400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:03.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.846+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6c44120440 con 0x7f6c4c15acd0 2024-04-25T10:10:03.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.846+0000 7f6c4b400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:03.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.846+0000 7f6c4b400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 0x7f6c2c069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c001810 tx=0x7f6c3c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:03.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:03.850+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c4c140160 con 0x7f6c4c15acd0 2024-04-25T10:10:04.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.022+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c4c13d990 con 0x7f6c4c15acd0 2024-04-25T10:10:04.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.022+0000 7f6c43400640 1 -- 172.21.15.18:0/792727600 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v82) v1 ==== 80+0+120 (secure 0 0 0) 0x7f6c440c7030 con 0x7f6c4c15acd0 2024-04-25T10:10:04.033 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6835/301895266 2024-04-26T10:08:48.763167+0000 2024-04-25T10:10:04.033 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6832/301895266 2024-04-26T10:08:48.763167+0000 2024-04-25T10:10:04.033 INFO:teuthology.orchestra.run.smithi018.stderr:listed 2 entries 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 msgr2=0x7f6c2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 0x7f6c2c069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c001810 tx=0x7f6c3c009040 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 msgr2=0x7f6c4c158fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6c440b0040 tx=0x7f6c44019680 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 shutdown_connections 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c4c15acd0 0x7f6c4c158fc0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c2c066f60 0x7f6c2c069420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c4c144120 0x7f6c4c15d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 --2- 172.21.15.18:0/792727600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c4c0b3090 0x7f6c4c13ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 >> 172.21.15.18:0/792727600 conn(0x7f6c4c067080 msgr2=0x7f6c4c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 shutdown_connections 2024-04-25T10:10:04.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.026+0000 7f6c52400640 1 -- 172.21.15.18:0/792727600 wait complete. 2024-04-25T10:10:04.060 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:10:04.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:04.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:04.085 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:10:04.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:04.086 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:10:04.137 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:10:04.137 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:04.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:10:04.147 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:04.147 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:04.193 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:10:04.193 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:10:04.193 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:04.203 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:10:04.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:04.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.370+0000 7f5e5c600640 1 Processor -- start 2024-04-25T10:10:04.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.370+0000 7f5e5c600640 1 -- start start 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5c600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5c600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5e540b1e60 0x7f5e540cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5c600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540cc4e0 con 0x7f5e540cd4d0 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5c600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e54145650 con 0x7f5e540b1e60 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5c600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540ce040 con 0x7f5e54145270 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5e540b1e60 0x7f5e540cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5e540b1e60 0x7f5e540cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60512/0 (socket says 172.21.15.18:60512) 2024-04-25T10:10:04.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 -- 172.21.15.18:0/1540607471 learned_addr learned my addr 172.21.15.18:0/1540607471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:04.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e59c00640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 -- 172.21.15.18:0/1540607471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 msgr2=0x7f5e5415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:04.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 -- 172.21.15.18:0/1540607471 >> v1:172.21.15.167:6789/0 conn(0x7f5e540cd4d0 legacy=0x7f5e540b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:04.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.374+0000 7f5e5a600640 1 -- 172.21.15.18:0/1540607471 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540ce320 con 0x7f5e540b1e60 2024-04-25T10:10:04.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5a600640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540b1e60 0x7f5e540cd930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e50 tx=0x7f5e4c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe259f58b784c10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e53e00640 1 -- 172.21.15.18:0/1540607471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a5760 con 0x7f5e540b1e60 2024-04-25T10:10:04.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e53e00640 1 -- 172.21.15.18:0/1540607471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c0a5900 con 0x7f5e540b1e60 2024-04-25T10:10:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e53e00640 1 -- 172.21.15.18:0/1540607471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0a5cd0 con 0x7f5e540b1e60 2024-04-25T10:10:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- 172.21.15.18:0/1540607471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540b1e60 msgr2=0x7f5e540cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540b1e60 0x7f5e540cd930 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c009e50 tx=0x7f5e4c01c9f0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- 172.21.15.18:0/1540607471 shutdown_connections 2024-04-25T10:10:04.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540b1e60 0x7f5e540cd930 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- 172.21.15.18:0/1540607471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- 172.21.15.18:0/1540607471 >> 172.21.15.18:0/1540607471 conn(0x7f5e54066fa0 msgr2=0x7f5e5406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:04.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- 172.21.15.18:0/1540607471 shutdown_connections 2024-04-25T10:10:04.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- 172.21.15.18:0/1540607471 wait complete. 2024-04-25T10:10:04.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 Processor -- start 2024-04-25T10:10:04.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- start start 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540b1e60 0x7f5e540b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415c710 con 0x7f5e540cd4d0 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415c590 con 0x7f5e540b1e60 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e5c600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415c890 con 0x7f5e54145270 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e59200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e59200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60514/0 (socket says 172.21.15.18:60514) 2024-04-25T10:10:04.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e59200640 1 -- 172.21.15.18:0/4273105202 learned_addr learned my addr 172.21.15.18:0/4273105202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.378+0000 7f5e59c00640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540b1e60 0x7f5e540b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e5a600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 -- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 msgr2=0x7f5e5415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 -- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540b1e60 msgr2=0x7f5e540b1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540b1e60 0x7f5e540b1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 -- 172.21.15.18:0/4273105202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54160ca0 con 0x7f5e540cd4d0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e59200640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c450 tx=0x7f5e4000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012830 con 0x7f5e540cd4d0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e40017070 con 0x7f5e540cd4d0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e54160f40 con 0x7f5e540cd4d0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e40012c30 con 0x7f5e540cd4d0 2024-04-25T10:10:04.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54161500 con 0x7f5e540cd4d0 2024-04-25T10:10:04.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e540745d0 con 0x7f5e540cd4d0 2024-04-25T10:10:04.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.382+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5e4001c460 con 0x7f5e540cd4d0 2024-04-25T10:10:04.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.386+0000 7f5e51600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 0x7f5e34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.386+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5e40084ec0 con 0x7f5e540cd4d0 2024-04-25T10:10:04.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.386+0000 7f5e59c00640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 0x7f5e34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.386+0000 7f5e59c00640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 0x7f5e34069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5e541631a0 tx=0x7f5e48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.390+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5e40055690 con 0x7f5e540cd4d0 2024-04-25T10:10:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e5406b8e0 con 0x7f5e540cd4d0 2024-04-25T10:10:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e51600640 1 -- 172.21.15.18:0/4273105202 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f5e40059730 con 0x7f5e540cd4d0 2024-04-25T10:10:04.598 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:04.598 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:09:35.776644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":15,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:10:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 54 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 msgr2=0x7f5e34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 0x7f5e34069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5e541631a0 tx=0x7f5e48008040 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 msgr2=0x7f5e54160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5e4000c450 tx=0x7f5e4000c910 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 shutdown_connections 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5e34066f60 0x7f5e34069420 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5e54145270 0x7f5e5415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e540cd4d0 0x7f5e54160760 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 --2- 172.21.15.18:0/4273105202 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5e540b1e60 0x7f5e540b1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 >> 172.21.15.18:0/4273105202 conn(0x7f5e54066fa0 msgr2=0x7f5e540acab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 shutdown_connections 2024-04-25T10:10:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.590+0000 7f5e5c600640 1 -- 172.21.15.18:0/4273105202 wait complete. 2024-04-25T10:10:04.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:04.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 Processor -- start 2024-04-25T10:10:04.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 -- start start 2024-04-25T10:10:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3040af670 0x7ff3040afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff30406b0a0 0x7ff3040d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3040cd4e0 con 0x7ff30406ac10 2024-04-25T10:10:04.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3040cd7a0 con 0x7ff3040af670 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff30b400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3040cda80 con 0x7ff30406b0a0 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3040af670 0x7ff3040afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3040af670 0x7ff3040afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60528/0 (socket says 172.21.15.18:60528) 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 -- 172.21.15.18:0/2368875796 learned_addr learned my addr 172.21.15.18:0/2368875796 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff303e00640 1 --1- 172.21.15.18:0/2368875796 >> v1:172.21.15.18:6789/0 conn(0x7ff30406ac10 0x7ff3040d05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55726/0 (socket says 172.21.15.18:55726) 2024-04-25T10:10:04.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 -- 172.21.15.18:0/2368875796 >> v2:172.21.15.167:3300/0 conn(0x7ff30406b0a0 msgr2=0x7ff3040d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 --2- 172.21.15.18:0/2368875796 >> v2:172.21.15.167:3300/0 conn(0x7ff30406b0a0 0x7ff3040d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 -- 172.21.15.18:0/2368875796 >> v1:172.21.15.18:6789/0 conn(0x7ff30406ac10 legacy=0x7ff3040d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.754+0000 7ff308a00640 1 -- 172.21.15.18:0/2368875796 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3040cdd60 con 0x7ff3040af670 2024-04-25T10:10:04.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff308a00640 1 --2- 172.21.15.18:0/2368875796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3040af670 0x7ff3040afa50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff3040729b0 tx=0x7ff2f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d3eadf2c735e0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff303400640 1 -- 172.21.15.18:0/2368875796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b1070 con 0x7ff3040af670 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff303400640 1 -- 172.21.15.18:0/2368875796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f80ac600 con 0x7ff3040af670 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff303400640 1 -- 172.21.15.18:0/2368875796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80ac9d0 con 0x7ff3040af670 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 -- 172.21.15.18:0/2368875796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3040af670 msgr2=0x7ff3040afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 --2- 172.21.15.18:0/2368875796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3040af670 0x7ff3040afa50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff3040729b0 tx=0x7ff2f801c490 comp rx=0 tx=0).stop 2024-04-25T10:10:04.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 -- 172.21.15.18:0/2368875796 shutdown_connections 2024-04-25T10:10:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 --2- 172.21.15.18:0/2368875796 >> v2:172.21.15.167:3300/0 conn(0x7ff30406b0a0 0x7ff3040d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 --2- 172.21.15.18:0/2368875796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3040af670 0x7ff3040afa50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 -- 172.21.15.18:0/2368875796 >> 172.21.15.18:0/2368875796 conn(0x7ff3040b2400 msgr2=0x7ff3040b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 -- 172.21.15.18:0/2368875796 shutdown_connections 2024-04-25T10:10:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.758+0000 7ff30b400640 1 -- 172.21.15.18:0/2368875796 wait complete. 2024-04-25T10:10:04.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 Processor -- start 2024-04-25T10:10:04.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- start start 2024-04-25T10:10:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff30406b0a0 0x7ff304141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3040af670 0x7ff3040b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304070cb0 con 0x7ff30406ac10 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff304070b30 con 0x7ff3040af670 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3040d11f0 con 0x7ff30406b0a0 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60536/0 (socket says 172.21.15.18:60536) 2024-04-25T10:10:04.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 -- 172.21.15.18:0/3886472607 learned_addr learned my addr 172.21.15.18:0/3886472607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 -- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff30406b0a0 msgr2=0x7ff304141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff30406b0a0 0x7ff304141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 -- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3040af670 msgr2=0x7ff3040b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3040af670 0x7ff3040b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 -- 172.21.15.18:0/3886472607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff304141cb0 con 0x7ff30406ac10 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff308a00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff2f801a0c0 tx=0x7ff2f801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80bb020 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f80b7620 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff304141f90 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b1040 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff304142550 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.762+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3040745d0 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.766+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2f80be020 con 0x7ff30406ac10 2024-04-25T10:10:04.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.766+0000 7ff300c00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 0x7ff2e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:04.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.766+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff2f811f530 con 0x7ff30406ac10 2024-04-25T10:10:04.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.766+0000 7ff303e00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 0x7ff2e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:04.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.766+0000 7ff303e00640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 0x7ff2e4069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0000f70 tx=0x7ff2f0007a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:04.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.770+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2f80c5030 con 0x7ff30406ac10 2024-04-25T10:10:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.934+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3040b29f0 con 0x7ff30406ac10 2024-04-25T10:10:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.934+0000 7ff300c00640 1 -- 172.21.15.18:0/3886472607 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17048 (secure 0 0 0) 0x7ff2f8016110 con 0x7ff30406ac10 2024-04-25T10:10:04.944 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:04.944 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:48.763190+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 msgr2=0x7ff2e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 0x7ff2e4069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0000f70 tx=0x7ff2f0007a10 comp rx=0 tx=0).stop 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 msgr2=0x7ff30412bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff2f801a0c0 tx=0x7ff2f801acd0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 shutdown_connections 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3040af670 0x7ff3040b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2e4066f60 0x7ff2e4069420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff30406b0a0 0x7ff304141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 --2- 172.21.15.18:0/3886472607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff30406ac10 0x7ff30412bf80 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 >> 172.21.15.18:0/3886472607 conn(0x7ff3040b2400 msgr2=0x7ff3040b3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 shutdown_connections 2024-04-25T10:10:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:04.938+0000 7ff30b400640 1 -- 172.21.15.18:0/3886472607 wait complete. 2024-04-25T10:10:04.966 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:08:31.175528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:08:32.386489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:10:04.967 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:10:05.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 Processor -- start 2024-04-25T10:10:05.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 -- start start 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa16c09a170 0x7fa16c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa16c06bf30 0x7fa16c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16c15e040 con 0x7fa16c15dc60 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0cff80 con 0x7fa16c09a170 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa171800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16c0d0260 con 0x7fa16c06bf30 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa163e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa16c09a170 0x7fa16c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa163e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa16c09a170 0x7fa16c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60552/0 (socket says 172.21.15.18:60552) 2024-04-25T10:10:05.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.102+0000 7fa163e00640 1 -- 172.21.15.18:0/2319262632 learned_addr learned my addr 172.21.15.18:0/2319262632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa16b400640 1 --2- 172.21.15.18:0/2319262632 >> v2:172.21.15.167:3300/0 conn(0x7fa16c06bf30 0x7fa16c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa163e00640 1 -- 172.21.15.18:0/2319262632 >> v2:172.21.15.167:3300/0 conn(0x7fa16c06bf30 msgr2=0x7fa16c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa163e00640 1 --2- 172.21.15.18:0/2319262632 >> v2:172.21.15.167:3300/0 conn(0x7fa16c06bf30 0x7fa16c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa163e00640 1 -- 172.21.15.18:0/2319262632 >> v1:172.21.15.167:6789/0 conn(0x7fa16c15dc60 legacy=0x7fa16c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa163e00640 1 -- 172.21.15.18:0/2319262632 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c0d0540 con 0x7fa16c09a170 2024-04-25T10:10:05.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa16a000640 1 -- 172.21.15.18:0/2319262632 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1548633846 0 0) 0x7fa16c15e040 con 0x7fa16c15dc60 2024-04-25T10:10:05.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa163e00640 1 --2- 172.21.15.18:0/2319262632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c0d1020 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa16c071e60 tx=0x7fa15401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd837b6050405f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa16a000640 1 -- 172.21.15.18:0/2319262632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540b1070 con 0x7fa16c09a170 2024-04-25T10:10:05.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa16a000640 1 -- 172.21.15.18:0/2319262632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1540ac630 con 0x7fa16c09a170 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.106+0000 7fa16a000640 1 -- 172.21.15.18:0/2319262632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540a8050 con 0x7fa16c09a170 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- 172.21.15.18:0/2319262632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 msgr2=0x7fa16c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- 172.21.15.18:0/2319262632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c0d1020 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fa16c071e60 tx=0x7fa15401c3d0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- 172.21.15.18:0/2319262632 shutdown_connections 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- 172.21.15.18:0/2319262632 >> v2:172.21.15.167:3300/0 conn(0x7fa16c06bf30 0x7fa16c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- 172.21.15.18:0/2319262632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c0d1020 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- 172.21.15.18:0/2319262632 >> 172.21.15.18:0/2319262632 conn(0x7fa16c0b3200 msgr2=0x7fa16c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- 172.21.15.18:0/2319262632 shutdown_connections 2024-04-25T10:10:05.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- 172.21.15.18:0/2319262632 wait complete. 2024-04-25T10:10:05.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 Processor -- start 2024-04-25T10:10:05.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- start start 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa16c06bf30 0x7fa16c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 0x7fa16c15bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0cc6f0 con 0x7fa16c09a170 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0cc570 con 0x7fa16c15dc60 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa171800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c0cc870 con 0x7fa16c06bf30 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60554/0 (socket says 172.21.15.18:60554) 2024-04-25T10:10:05.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 -- 172.21.15.18:0/2089890175 learned_addr learned my addr 172.21.15.18:0/2089890175 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa16aa00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa16c06bf30 0x7fa16c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa16b400640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 0x7fa16c15bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 -- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa16c06bf30 msgr2=0x7fa16c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa16c06bf30 0x7fa16c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 -- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 msgr2=0x7fa16c15bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 0x7fa16c15bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 -- 172.21.15.18:0/2089890175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c15ad90 con 0x7fa16c09a170 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa16b400640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 0x7fa16c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:05.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.110+0000 7fa163e00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa154018fe0 tx=0x7fa15401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540bb070 con 0x7fa16c09a170 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa154004020 con 0x7fa16c09a170 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1540b1040 con 0x7fa16c09a170 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c0b7310 con 0x7fa16c09a170 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c15b030 con 0x7fa16c09a170 2024-04-25T10:10:05.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c0c87c0 con 0x7fa16c09a170 2024-04-25T10:10:05.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa154003620 con 0x7fa16c09a170 2024-04-25T10:10:05.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 0x7fa148069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa15411efa0 con 0x7fa16c09a170 2024-04-25T10:10:05.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.114+0000 7fa16aa00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 0x7fa148069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.118+0000 7fa16aa00640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 0x7fa148069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000f70 tx=0x7fa15c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.118+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa154016110 con 0x7fa16c09a170 2024-04-25T10:10:05.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa16c0745d0 con 0x7fa16c09a170 2024-04-25T10:10:05.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa162a00640 1 -- 172.21.15.18:0/2089890175 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1540efd30 con 0x7fa16c09a170 2024-04-25T10:10:05.289 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:10:05.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 msgr2=0x7fa148069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 0x7fa148069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa15c000f70 tx=0x7fa15c009040 comp rx=0 tx=0).stop 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 msgr2=0x7fa16c15ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fa154018fe0 tx=0x7fa15401ac10 comp rx=0 tx=0).stop 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 shutdown_connections 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa16c15dc60 0x7fa16c15bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa16c09a170 0x7fa16c15ba90 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa148066f60 0x7fa148069420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 --2- 172.21.15.18:0/2089890175 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa16c06bf30 0x7fa16c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 >> 172.21.15.18:0/2089890175 conn(0x7fa16c0b3200 msgr2=0x7fa16c15a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 shutdown_connections 2024-04-25T10:10:05.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.282+0000 7fa171800640 1 -- 172.21.15.18:0/2089890175 wait complete. 2024-04-25T10:10:05.310 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:10:05.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 Processor -- start 2024-04-25T10:10:05.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 -- start start 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6f880b4190 0x7f6f880b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880b30f0 con 0x7f6f880b0c90 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880b33d0 con 0x7f6f88144e20 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f8ca00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880b1100 con 0x7f6f880b4190 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f87200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6f880b0c90 0x7f6f8815bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55736/0 (socket says 172.21.15.18:55736) 2024-04-25T10:10:05.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f87200640 1 -- 172.21.15.18:0/1037014651 learned_addr learned my addr 172.21.15.18:0/1037014651 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f7de00640 1 --2- 172.21.15.18:0/1037014651 >> v2:172.21.15.167:3300/0 conn(0x7f6f880b4190 0x7f6f880b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192767739 0 0) 0x7f6f880b30f0 con 0x7f6f880b0c90 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.446+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f6c003530 con 0x7f6f880b0c90 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1446357166 0 0) 0x7f6f880b33d0 con 0x7f6f88144e20 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f7de00640 1 -- 172.21.15.18:0/1037014651 >> v1:172.21.15.167:6789/0 conn(0x7f6f88144e20 legacy=0x7f6f8806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f7de00640 1 -- 172.21.15.18:0/1037014651 >> v1:172.21.15.18:6789/0 conn(0x7f6f880b0c90 legacy=0x7f6f8815bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f7de00640 1 -- 172.21.15.18:0/1037014651 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880b36b0 con 0x7f6f880b4190 2024-04-25T10:10:05.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f7de00640 1 --2- 172.21.15.18:0/1037014651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f880b4190 0x7f6f880b0750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12a1e628bb93d79e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700b0070 con 0x7f6f880b4190 2024-04-25T10:10:05.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700ab400 con 0x7f6f880b4190 2024-04-25T10:10:05.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f85e00640 1 -- 172.21.15.18:0/1037014651 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80001600 con 0x7f6f880b4190 2024-04-25T10:10:05.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 -- 172.21.15.18:0/1037014651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f880b4190 msgr2=0x7f6f880b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/1037014651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f880b4190 0x7f6f880b0750 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001c2b0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 -- 172.21.15.18:0/1037014651 shutdown_connections 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/1037014651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f880b4190 0x7f6f880b0750 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 -- 172.21.15.18:0/1037014651 >> 172.21.15.18:0/1037014651 conn(0x7f6f88066fa0 msgr2=0x7f6f8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.450+0000 7f6f8ca00640 1 -- 172.21.15.18:0/1037014651 shutdown_connections 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 -- 172.21.15.18:0/1037014651 wait complete. 2024-04-25T10:10:05.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 Processor -- start 2024-04-25T10:10:05.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 -- start start 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f880b0c90 0x7f6f88156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 0x7f6f8813ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b2eb0 con 0x7f6f880b4190 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b2d30 con 0x7f6f88144e20 2024-04-25T10:10:05.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f8ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88145200 con 0x7f6f880b0c90 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60564/0 (socket says 172.21.15.18:60564) 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 -- 172.21.15.18:0/4249041843 learned_addr learned my addr 172.21.15.18:0/4249041843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f86800640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f880b0c90 0x7f6f88156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f87200640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 0x7f6f8813ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 -- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f880b0c90 msgr2=0x7f6f88156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f880b0c90 0x7f6f88156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 -- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 msgr2=0x7f6f8813ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 0x7f6f8813ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 -- 172.21.15.18:0/4249041843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88157470 con 0x7f6f880b4190 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f87200640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 0x7f6f8813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7de00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001aaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700bb020 con 0x7f6f880b4190 2024-04-25T10:10:05.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700b1040 con 0x7f6f880b4190 2024-04-25T10:10:05.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.454+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700b0050 con 0x7f6f880b4190 2024-04-25T10:10:05.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8813af90 con 0x7f6f880b4190 2024-04-25T10:10:05.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8813ce60 con 0x7f6f880b4190 2024-04-25T10:10:05.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f880745d0 con 0x7f6f880b4190 2024-04-25T10:10:05.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f700be070 con 0x7f6f880b4190 2024-04-25T10:10:05.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f7f400640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 0x7f6f64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6f7011e8b0 con 0x7f6f880b4190 2024-04-25T10:10:05.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.458+0000 7f6f86800640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 0x7f6f64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.462+0000 7f6f86800640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 0x7f6f64069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6f780014b0 tx=0x7f6f78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.462+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f70015f90 con 0x7f6f880b4190 2024-04-25T10:10:05.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.626+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6f88157700 con 0x7f6f880b4190 2024-04-25T10:10:05.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.626+0000 7f6f7f400640 1 -- 172.21.15.18:0/4249041843 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6f700ef6d0 con 0x7f6f880b4190 2024-04-25T10:10:05.636 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:10:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 msgr2=0x7f6f64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 0x7f6f64069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6f780014b0 tx=0x7f6f78009040 comp rx=0 tx=0).stop 2024-04-25T10:10:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 msgr2=0x7f6f8813a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001aaf0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 shutdown_connections 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f88144e20 0x7f6f8813ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f880b4190 0x7f6f8813a120 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f64066f60 0x7f6f64069420 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 --2- 172.21.15.18:0/4249041843 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f880b0c90 0x7f6f88156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 >> 172.21.15.18:0/4249041843 conn(0x7f6f88066fa0 msgr2=0x7f6f8815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 shutdown_connections 2024-04-25T10:10:05.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.630+0000 7f6f8ca00640 1 -- 172.21.15.18:0/4249041843 wait complete. 2024-04-25T10:10:05.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:10:05.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 Processor -- start 2024-04-25T10:10:05.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 -- start start 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369409a170 0x7f36940d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f369406bf30 0x7f36940cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369415e040 con 0x7f369415dc60 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940cff80 con 0x7f369409a170 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3699400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940d0260 con 0x7f369406bf30 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3689e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f369409a170 0x7f36940d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3692800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f369415dc60 0x7f3694099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55750/0 (socket says 172.21.15.18:55750) 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3692800640 1 -- 172.21.15.18:0/2756307529 learned_addr learned my addr 172.21.15.18:0/2756307529 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:05.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.794+0000 7f3693200640 1 --2- 172.21.15.18:0/2756307529 >> v2:172.21.15.167:3300/0 conn(0x7f369406bf30 0x7f36940cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3689e00640 1 -- 172.21.15.18:0/2756307529 >> v2:172.21.15.167:3300/0 conn(0x7f369406bf30 msgr2=0x7f36940cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:05.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3689e00640 1 --2- 172.21.15.18:0/2756307529 >> v2:172.21.15.167:3300/0 conn(0x7f369406bf30 0x7f36940cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3689e00640 1 -- 172.21.15.18:0/2756307529 >> v1:172.21.15.18:6789/0 conn(0x7f369415dc60 legacy=0x7f3694099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3689e00640 1 -- 172.21.15.18:0/2756307529 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940d0540 con 0x7f369409a170 2024-04-25T10:10:05.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3691e00640 1 -- 172.21.15.18:0/2756307529 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870504188 0 0) 0x7f369415e040 con 0x7f369415dc60 2024-04-25T10:10:05.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3689e00640 1 --2- 172.21.15.18:0/2756307529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369409a170 0x7f36940d1020 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3694071e60 tx=0x7f367c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27787c74908442f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3691e00640 1 -- 172.21.15.18:0/2756307529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0b0070 con 0x7f369409a170 2024-04-25T10:10:05.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3691e00640 1 -- 172.21.15.18:0/2756307529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367c0ab600 con 0x7f369409a170 2024-04-25T10:10:05.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3691e00640 1 -- 172.21.15.18:0/2756307529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367c0ab9d0 con 0x7f369409a170 2024-04-25T10:10:05.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 -- 172.21.15.18:0/2756307529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369409a170 msgr2=0x7f36940d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 --2- 172.21.15.18:0/2756307529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369409a170 0x7f36940d1020 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3694071e60 tx=0x7f367c01c330 comp rx=0 tx=0).stop 2024-04-25T10:10:05.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 -- 172.21.15.18:0/2756307529 shutdown_connections 2024-04-25T10:10:05.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 --2- 172.21.15.18:0/2756307529 >> v2:172.21.15.167:3300/0 conn(0x7f369406bf30 0x7f36940cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 --2- 172.21.15.18:0/2756307529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369409a170 0x7f36940d1020 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.798+0000 7f3699400640 1 -- 172.21.15.18:0/2756307529 >> 172.21.15.18:0/2756307529 conn(0x7f36940b3200 msgr2=0x7f36940b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- 172.21.15.18:0/2756307529 shutdown_connections 2024-04-25T10:10:05.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- 172.21.15.18:0/2756307529 wait complete. 2024-04-25T10:10:05.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 Processor -- start 2024-04-25T10:10:05.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- start start 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 0x7f369415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 0x7f369415ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940cc6f0 con 0x7f369415dc60 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36940cc570 con 0x7f369406bf30 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940cc870 con 0x7f369409a170 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60576/0 (socket says 172.21.15.18:60576) 2024-04-25T10:10:05.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 -- 172.21.15.18:0/2163439994 learned_addr learned my addr 172.21.15.18:0/2163439994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3692800640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 0x7f369415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3689e00640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 0x7f369415ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 -- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 msgr2=0x7f369415ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 0x7f369415ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 -- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 msgr2=0x7f369415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 0x7f369415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 -- 172.21.15.18:0/2163439994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369415ad90 con 0x7f369415dc60 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3689e00640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 0x7f369415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3692800640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 0x7f369415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3693200640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f368c007e60 tx=0x7f368c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c014420 con 0x7f369415dc60 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c019070 con 0x7f369415dc60 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c014820 con 0x7f369415dc60 2024-04-25T10:10:05.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940b7310 con 0x7f369415dc60 2024-04-25T10:10:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.802+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369415b030 con 0x7f369415dc60 2024-04-25T10:10:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36940745d0 con 0x7f369415dc60 2024-04-25T10:10:05.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f368c0149c0 con 0x7f369415dc60 2024-04-25T10:10:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f368b400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 0x7f3670069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f368c085b50 con 0x7f369415dc60 2024-04-25T10:10:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f3692800640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 0x7f3670069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:05.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.806+0000 7f3692800640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 0x7f3670069420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3684007fd0 tx=0x7f3684007c20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:05.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.810+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f368c0568e0 con 0x7f369415dc60 2024-04-25T10:10:05.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.970+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f369415b200 con 0x7f369415dc60 2024-04-25T10:10:05.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.970+0000 7f368b400640 1 -- 172.21.15.18:0/2163439994 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) v1 ==== 100+0+11 (secure 0 0 0) 0x7f368c0561e0 con 0x7f369415dc60 2024-04-25T10:10:05.979 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 msgr2=0x7f3670069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 0x7f3670069420 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3684007fd0 tx=0x7f3684007c20 comp rx=0 tx=0).stop 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 msgr2=0x7f369415bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f368c007e60 tx=0x7f368c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 shutdown_connections 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369415dc60 0x7f369415bfd0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3670066f60 0x7f3670069420 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f369409a170 0x7f369415ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 --2- 172.21.15.18:0/2163439994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f369406bf30 0x7f369415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 >> 172.21.15.18:0/2163439994 conn(0x7f36940b3200 msgr2=0x7f369415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 shutdown_connections 2024-04-25T10:10:05.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:05.974+0000 7f3699400640 1 -- 172.21.15.18:0/2163439994 wait complete. 2024-04-25T10:10:06.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 Processor -- start 2024-04-25T10:10:06.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 -- start start 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1bc015b5a0 0x7f1bc00cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1bc015b980 0x7f1bc00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 0x7f1bc00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00cfcd0 con 0x7f1bc015b5a0 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc00ce7f0 con 0x7f1bc015b980 2024-04-25T10:10:06.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc8200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc00cead0 con 0x7f1bc0071970 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1bc015b5a0 0x7f1bc00cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1bc015b5a0 0x7f1bc00cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60582/0 (socket says 172.21.15.18:60582) 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 -- 172.21.15.18:0/270376349 learned_addr learned my addr 172.21.15.18:0/270376349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc4e00640 1 --2- 172.21.15.18:0/270376349 >> v2:172.21.15.167:3300/0 conn(0x7f1bc015b980 0x7f1bc00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc6200640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 0x7f1bc00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 -- 172.21.15.18:0/270376349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 msgr2=0x7f1bc00cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 0x7f1bc00cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 -- 172.21.15.18:0/270376349 >> v2:172.21.15.167:3300/0 conn(0x7f1bc015b980 msgr2=0x7f1bc00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 --2- 172.21.15.18:0/270376349 >> v2:172.21.15.167:3300/0 conn(0x7f1bc015b980 0x7f1bc00cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc5800640 1 -- 172.21.15.18:0/270376349 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00cf960 con 0x7f1bc015b5a0 2024-04-25T10:10:06.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.134+0000 7f1bc6200640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 0x7f1bc00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc5800640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc015b5a0 0x7f1bc00cdea0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00cf710 tx=0x7f1bb401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d87b7ef7c8048c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bbfe00640 1 -- 172.21.15.18:0/270376349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40aa660 con 0x7f1bc015b5a0 2024-04-25T10:10:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bbfe00640 1 -- 172.21.15.18:0/270376349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40af070 con 0x7f1bc015b5a0 2024-04-25T10:10:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bbfe00640 1 -- 172.21.15.18:0/270376349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40aaa20 con 0x7f1bc015b5a0 2024-04-25T10:10:06.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 -- 172.21.15.18:0/270376349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc015b5a0 msgr2=0x7f1bc00cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc015b5a0 0x7f1bc00cdea0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00cf710 tx=0x7f1bb401c520 comp rx=0 tx=0).stop 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 -- 172.21.15.18:0/270376349 shutdown_connections 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc0071970 0x7f1bc00cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 --2- 172.21.15.18:0/270376349 >> v2:172.21.15.167:3300/0 conn(0x7f1bc015b980 0x7f1bc00cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 --2- 172.21.15.18:0/270376349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc015b5a0 0x7f1bc00cdea0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 -- 172.21.15.18:0/270376349 >> 172.21.15.18:0/270376349 conn(0x7f1bc00b3390 msgr2=0x7f1bc00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 -- 172.21.15.18:0/270376349 shutdown_connections 2024-04-25T10:10:06.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.138+0000 7f1bc8200640 1 -- 172.21.15.18:0/270376349 wait complete. 2024-04-25T10:10:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 Processor -- start 2024-04-25T10:10:06.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- start start 2024-04-25T10:10:06.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc015b5a0 0x7f1bc0146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 0x7f1bc00caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015ff40 con 0x7f1bc0071970 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc015fdc0 con 0x7f1bc015b980 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc01600c0 con 0x7f1bc015b5a0 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60584/0 (socket says 172.21.15.18:60584) 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 -- 172.21.15.18:0/1169211289 learned_addr learned my addr 172.21.15.18:0/1169211289 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc6200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 0x7f1bc00caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc4e00640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc015b5a0 0x7f1bc0146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 -- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc015b5a0 msgr2=0x7f1bc0146870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc015b5a0 0x7f1bc0146870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 -- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 msgr2=0x7f1bc00caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 0x7f1bc00caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 -- 172.21.15.18:0/1169211289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc014e5b0 con 0x7f1bc0071970 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc6200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 0x7f1bc00caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc5800640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ac040 tx=0x7f1bb401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40b3800 con 0x7f1bc0071970 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40b39c0 con 0x7f1bc0071970 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40b3db0 con 0x7f1bc0071970 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc014e890 con 0x7f1bc0071970 2024-04-25T10:10:06.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.142+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc0146db0 con 0x7f1bc0071970 2024-04-25T10:10:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc00745d0 con 0x7f1bc0071970 2024-04-25T10:10:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bb40b2380 con 0x7f1bc0071970 2024-04-25T10:10:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bbd600640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1bb411f110 con 0x7f1bc0071970 2024-04-25T10:10:06.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bc4e00640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.146+0000 7f1bc4e00640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 0x7f1ba0069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1bc01f9ef0 tx=0x7f1bac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.150+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bb4016110 con 0x7f1bc0071970 2024-04-25T10:10:06.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bc00b6c90 con 0x7f1bc0071970 2024-04-25T10:10:06.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bbd600640 1 -- 172.21.15.18:0/1169211289 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f1bb40efa10 con 0x7f1bc0071970 2024-04-25T10:10:06.354 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:06.354 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:09:35.776644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":15,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:10:06.355 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 54 2024-04-25T10:10:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 msgr2=0x7f1ba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 0x7f1ba0069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f1bc01f9ef0 tx=0x7f1bac008040 comp rx=0 tx=0).stop 2024-04-25T10:10:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 msgr2=0x7f1bc015be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40ac040 tx=0x7f1bb401ad60 comp rx=0 tx=0).stop 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 shutdown_connections 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bc015b980 0x7f1bc00caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bc015b5a0 0x7f1bc0146870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 --2- 172.21.15.18:0/1169211289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bc0071970 0x7f1bc015be20 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 >> 172.21.15.18:0/1169211289 conn(0x7f1bc00b3390 msgr2=0x7f1bc0151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.346+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 shutdown_connections 2024-04-25T10:10:06.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.350+0000 7f1bc8200640 1 -- 172.21.15.18:0/1169211289 wait complete. 2024-04-25T10:10:06.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.506+0000 7f441c200640 1 Processor -- start 2024-04-25T10:10:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.506+0000 7f441c200640 1 -- start start 2024-04-25T10:10:06.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4414144140 0x7f44140ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f44140ced60 0x7f441406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f441415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441406ed70 con 0x7f4414144140 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f441415ac60 con 0x7f44140ced60 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f441c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44140cf3e0 con 0x7f441406e900 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4414144140 0x7f44140ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4414144140 0x7f44140ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60598/0 (socket says 172.21.15.18:60598) 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 -- 172.21.15.18:0/116729288 learned_addr learned my addr 172.21.15.18:0/116729288 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 -- 172.21.15.18:0/116729288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 msgr2=0x7f441415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 --2- 172.21.15.18:0/116729288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f441415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 -- 172.21.15.18:0/116729288 >> v2:172.21.15.167:3300/0 conn(0x7f44140ced60 msgr2=0x7f441406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 --2- 172.21.15.18:0/116729288 >> v2:172.21.15.167:3300/0 conn(0x7f44140ced60 0x7f441406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.510+0000 7f4419800640 1 -- 172.21.15.18:0/116729288 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441415af20 con 0x7f4414144140 2024-04-25T10:10:06.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f4419800640 1 --2- 172.21.15.18:0/116729288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4414144140 0x7f44140ce820 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f441406efb0 tx=0x7f440801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be835edccb87537e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f4413e00640 1 -- 172.21.15.18:0/116729288 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080b0070 con 0x7f4414144140 2024-04-25T10:10:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f4413e00640 1 -- 172.21.15.18:0/116729288 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44080ab600 con 0x7f4414144140 2024-04-25T10:10:06.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f4413e00640 1 -- 172.21.15.18:0/116729288 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080ab9d0 con 0x7f4414144140 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- 172.21.15.18:0/116729288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4414144140 msgr2=0x7f44140ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 --2- 172.21.15.18:0/116729288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4414144140 0x7f44140ce820 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f441406efb0 tx=0x7f440801c260 comp rx=0 tx=0).stop 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- 172.21.15.18:0/116729288 shutdown_connections 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 --2- 172.21.15.18:0/116729288 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f441415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 --2- 172.21.15.18:0/116729288 >> v2:172.21.15.167:3300/0 conn(0x7f44140ced60 0x7f441406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 --2- 172.21.15.18:0/116729288 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4414144140 0x7f44140ce820 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- 172.21.15.18:0/116729288 >> 172.21.15.18:0/116729288 conn(0x7f4414066fa0 msgr2=0x7f441406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- 172.21.15.18:0/116729288 shutdown_connections 2024-04-25T10:10:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- 172.21.15.18:0/116729288 wait complete. 2024-04-25T10:10:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 Processor -- start 2024-04-25T10:10:06.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.514+0000 7f441c200640 1 -- start start 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f4414151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 0x7f44140c5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441415ba00 con 0x7f44140ced60 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4414144520 con 0x7f4414144140 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f441415bb80 con 0x7f441406e900 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60608/0 (socket says 172.21.15.18:60608) 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 -- 172.21.15.18:0/2354170479 learned_addr learned my addr 172.21.15.18:0/2354170479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4419800640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f4414151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441a200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 0x7f44140c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 -- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 msgr2=0x7f4414151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f4414151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 -- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 msgr2=0x7f44140c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 0x7f44140c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 -- 172.21.15.18:0/2354170479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4414140b30 con 0x7f44140ced60 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441a200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 0x7f44140c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4418e00640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f440000b580 tx=0x7f440000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400014070 con 0x7f44140ced60 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400010890 con 0x7f44140ced60 2024-04-25T10:10:06.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400010c80 con 0x7f44140ced60 2024-04-25T10:10:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44140c5d50 con 0x7f44140ced60 2024-04-25T10:10:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f441412e920 con 0x7f44140ced60 2024-04-25T10:10:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44140745d0 con 0x7f44140ced60 2024-04-25T10:10:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.518+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4400017070 con 0x7f44140ced60 2024-04-25T10:10:06.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.522+0000 7f4411600640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 0x7f43f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.522+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4400085150 con 0x7f44140ced60 2024-04-25T10:10:06.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.522+0000 7f4419800640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 0x7f43f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.522+0000 7f4419800640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 0x7f43f4069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f44080ad000 tx=0x7f44080a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.526+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4400055e60 con 0x7f44140ced60 2024-04-25T10:10:06.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.690+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f441415db70 con 0x7f44140ced60 2024-04-25T10:10:06.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.690+0000 7f4411600640 1 -- 172.21.15.18:0/2354170479 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17048 (secure 0 0 0) 0x7f4400010e20 con 0x7f44140ced60 2024-04-25T10:10:06.699 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:06.699 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:48.763190+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 msgr2=0x7f43f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 0x7f43f4069420 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f44080ad000 tx=0x7f44080a6000 comp rx=0 tx=0).stop 2024-04-25T10:10:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 msgr2=0x7f44140c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f440000b580 tx=0x7f440000ba40 comp rx=0 tx=0).stop 2024-04-25T10:10:06.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 shutdown_connections 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4414144140 0x7f44140c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44140ced60 0x7f44140c51e0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f43f4066f60 0x7f43f4069420 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 --2- 172.21.15.18:0/2354170479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f441406e900 0x7f4414151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 >> 172.21.15.18:0/2354170479 conn(0x7f4414066fa0 msgr2=0x7f441415bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 shutdown_connections 2024-04-25T10:10:06.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.694+0000 7f441c200640 1 -- 172.21.15.18:0/2354170479 wait complete. 2024-04-25T10:10:06.721 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:10:06.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:06.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 Processor -- start 2024-04-25T10:10:06.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 -- start start 2024-04-25T10:10:06.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9f00146740 0x7f9f0006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9f000aeb50 0x7f9f000aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000af4a0 con 0x7f9f000af840 2024-04-25T10:10:06.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f00146b20 con 0x7f9f000aeb50 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9f05c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000b23e0 con 0x7f9f00146740 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9eff400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9f000aeb50 0x7f9f000aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9ef6000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9f000af840 0x7f9f000b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55764/0 (socket says 172.21.15.18:55764) 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9ef6000640 1 -- 172.21.15.18:0/3772325425 learned_addr learned my addr 172.21.15.18:0/3772325425 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9efea00640 1 --2- 172.21.15.18:0/3772325425 >> v2:172.21.15.167:3300/0 conn(0x7f9f00146740 0x7f9f0006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9eff400640 1 -- 172.21.15.18:0/3772325425 >> v2:172.21.15.167:3300/0 conn(0x7f9f00146740 msgr2=0x7f9f0006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:06.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9eff400640 1 --2- 172.21.15.18:0/3772325425 >> v2:172.21.15.167:3300/0 conn(0x7f9f00146740 0x7f9f0006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9eff400640 1 -- 172.21.15.18:0/3772325425 >> v1:172.21.15.18:6789/0 conn(0x7f9f000af840 legacy=0x7f9f000b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9eff400640 1 -- 172.21.15.18:0/3772325425 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000acb80 con 0x7f9f000aeb50 2024-04-25T10:10:06.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.854+0000 7f9efe000640 1 -- 172.21.15.18:0/3772325425 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912887802 0 0) 0x7f9ee8001120 con 0x7f9f000af840 2024-04-25T10:10:06.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9eff400640 1 --2- 172.21.15.18:0/3772325425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000aeb50 0x7f9f000aef60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9f0006ee60 tx=0x7f9ef801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a80fd3f02e09ccf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9efe000640 1 -- 172.21.15.18:0/3772325425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80b2070 con 0x7f9f000aeb50 2024-04-25T10:10:06.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9efe000640 1 -- 172.21.15.18:0/3772325425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef80a59c0 con 0x7f9f000aeb50 2024-04-25T10:10:06.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9efe000640 1 -- 172.21.15.18:0/3772325425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef80a5d90 con 0x7f9f000aeb50 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 -- 172.21.15.18:0/3772325425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000aeb50 msgr2=0x7f9f000aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 --2- 172.21.15.18:0/3772325425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000aeb50 0x7f9f000aef60 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9f0006ee60 tx=0x7f9ef801c900 comp rx=0 tx=0).stop 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 -- 172.21.15.18:0/3772325425 shutdown_connections 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 --2- 172.21.15.18:0/3772325425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000aeb50 0x7f9f000aef60 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 --2- 172.21.15.18:0/3772325425 >> v2:172.21.15.167:3300/0 conn(0x7f9f00146740 0x7f9f0006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 -- 172.21.15.18:0/3772325425 >> 172.21.15.18:0/3772325425 conn(0x7f9f00066fa0 msgr2=0x7f9f0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 -- 172.21.15.18:0/3772325425 shutdown_connections 2024-04-25T10:10:06.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.858+0000 7f9f05c00640 1 -- 172.21.15.18:0/3772325425 wait complete. 2024-04-25T10:10:06.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 Processor -- start 2024-04-25T10:10:06.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- start start 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 0x7f9f001422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00146740 0x7f9f0015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0006d7f0 con 0x7f9f000af840 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000b20f0 con 0x7f9f00146740 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0006d970 con 0x7f9f000aeb50 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60622/0 (socket says 172.21.15.18:60622) 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 -- 172.21.15.18:0/293771629 learned_addr learned my addr 172.21.15.18:0/293771629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:06.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9efea00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 0x7f9f001422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9eff400640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00146740 0x7f9f0015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 -- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 msgr2=0x7f9f001422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 0x7f9f001422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 -- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00146740 msgr2=0x7f9f0015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00146740 0x7f9f0015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 -- 172.21.15.18:0/293771629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00142800 con 0x7f9f000af840 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9efea00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 0x7f9f001422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef6000640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c780 tx=0x7f9ee800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee8018070 con 0x7f9f000af840 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee80072f0 con 0x7f9f000af840 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee80047f0 con 0x7f9f000af840 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0013e870 con 0x7f9f000af840 2024-04-25T10:10:06.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.862+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f00141ac0 con 0x7f9f000af840 2024-04-25T10:10:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000745d0 con 0x7f9f000af840 2024-04-25T10:10:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ee801b070 con 0x7f9f000af840 2024-04-25T10:10:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9ef7400640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:06.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9ee8084650 con 0x7f9f000af840 2024-04-25T10:10:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9efea00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:06.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.866+0000 7f9efea00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 0x7f9edc069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009b10 tx=0x7f9ef0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:06.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:06.870+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f000af4a0 con 0x7f9f000af840 2024-04-25T10:10:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f0006e2e0 con 0x7f9f000af840 2024-04-25T10:10:07.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9ef7400640 1 -- 172.21.15.18:0/293771629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f9ee8055470 con 0x7f9f000af840 2024-04-25T10:10:07.078 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:07.078 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:09:35.776644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":15,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:10:07.078 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 54 2024-04-25T10:10:07.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 msgr2=0x7f9edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 0x7f9edc069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009b10 tx=0x7f9ef0008040 comp rx=0 tx=0).stop 2024-04-25T10:10:07.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 msgr2=0x7f9f00161770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c780 tx=0x7f9ee800cc40 comp rx=0 tx=0).stop 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 shutdown_connections 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f00146740 0x7f9f0015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f000af840 0x7f9f00161770 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 --2- 172.21.15.18:0/293771629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f000aeb50 0x7f9f001422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 >> 172.21.15.18:0/293771629 conn(0x7f9f00066fa0 msgr2=0x7f9f0006e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 shutdown_connections 2024-04-25T10:10:07.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.070+0000 7f9f05c00640 1 -- 172.21.15.18:0/293771629 wait complete. 2024-04-25T10:10:07.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:07.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 Processor -- start 2024-04-25T10:10:07.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 -- start start 2024-04-25T10:10:07.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 0x7f6a300ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3015ac60 con 0x7f6a3006ead0 2024-04-25T10:10:07.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a300cf3e0 con 0x7f6a300ced60 2024-04-25T10:10:07.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a37600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3015af20 con 0x7f6a30144140 2024-04-25T10:10:07.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a35600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6a3006ead0 0x7f6a300b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55780/0 (socket says 172.21.15.18:55780) 2024-04-25T10:10:07.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a35600640 1 -- 172.21.15.18:0/2346454045 learned_addr learned my addr 172.21.15.18:0/2346454045 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a34c00640 1 --2- 172.21.15.18:0/2346454045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 0x7f6a300ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.230+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918001070 0 0) 0x7f6a3015ac60 con 0x7f6a3006ead0 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.234+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a14003530 con 0x7f6a3006ead0 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.234+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241043960 0 0) 0x7f6a300cf3e0 con 0x7f6a300ced60 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.234+0000 7f6a34c00640 1 -- 172.21.15.18:0/2346454045 >> v1:172.21.15.167:6789/0 conn(0x7f6a300ced60 legacy=0x7f6a3006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.234+0000 7f6a34c00640 1 -- 172.21.15.18:0/2346454045 >> v1:172.21.15.18:6789/0 conn(0x7f6a3006ead0 legacy=0x7f6a300b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.234+0000 7f6a34c00640 1 -- 172.21.15.18:0/2346454045 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3015b200 con 0x7f6a30144140 2024-04-25T10:10:07.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a34c00640 1 --2- 172.21.15.18:0/2346454045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 0x7f6a300ce820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a200097f0 tx=0x7f6a2001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614883a63a55ac04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200b0070 con 0x7f6a30144140 2024-04-25T10:10:07.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a200ab400 con 0x7f6a30144140 2024-04-25T10:10:07.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a2fe00640 1 -- 172.21.15.18:0/2346454045 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a200ab7d0 con 0x7f6a30144140 2024-04-25T10:10:07.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- 172.21.15.18:0/2346454045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 msgr2=0x7f6a300ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 --2- 172.21.15.18:0/2346454045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 0x7f6a300ce820 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a200097f0 tx=0x7f6a2001c4e0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- 172.21.15.18:0/2346454045 shutdown_connections 2024-04-25T10:10:07.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 --2- 172.21.15.18:0/2346454045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a30144140 0x7f6a300ce820 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- 172.21.15.18:0/2346454045 >> 172.21.15.18:0/2346454045 conn(0x7f6a30066fa0 msgr2=0x7f6a3006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- 172.21.15.18:0/2346454045 shutdown_connections 2024-04-25T10:10:07.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- 172.21.15.18:0/2346454045 wait complete. 2024-04-25T10:10:07.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 Processor -- start 2024-04-25T10:10:07.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.238+0000 7f6a37600640 1 -- start start 2024-04-25T10:10:07.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a3006ead0 0x7f6a3013b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a300ced60 0x7f6a301430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3015bb80 con 0x7f6a30144140 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3015ba00 con 0x7f6a300ced60 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a301683f0 con 0x7f6a3006ead0 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60630/0 (socket says 172.21.15.18:60630) 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 -- 172.21.15.18:0/2907658849 learned_addr learned my addr 172.21.15.18:0/2907658849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 -- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a3006ead0 msgr2=0x7f6a3013b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a3006ead0 0x7f6a3013b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 -- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a300ced60 msgr2=0x7f6a301430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a300ced60 0x7f6a301430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 -- 172.21.15.18:0/2907658849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3015bea0 con 0x7f6a30144140 2024-04-25T10:10:07.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a35600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800cae0 tx=0x7f6a2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28017070 con 0x7f6a30144140 2024-04-25T10:10:07.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2800ac40 con 0x7f6a30144140 2024-04-25T10:10:07.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28012640 con 0x7f6a30144140 2024-04-25T10:10:07.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3015c180 con 0x7f6a30144140 2024-04-25T10:10:07.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3015c740 con 0x7f6a30144140 2024-04-25T10:10:07.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a300745d0 con 0x7f6a30144140 2024-04-25T10:10:07.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.242+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a2801a070 con 0x7f6a30144140 2024-04-25T10:10:07.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.246+0000 7f6a2d600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 0x7f6a0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.246+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6a28084fe0 con 0x7f6a30144140 2024-04-25T10:10:07.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.246+0000 7f6a34c00640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 0x7f6a0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.246+0000 7f6a34c00640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 0x7f6a0c069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a200ad000 tx=0x7f6a20004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.250+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a28055dd0 con 0x7f6a30144140 2024-04-25T10:10:07.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.442+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a30073a60 con 0x7f6a30144140 2024-04-25T10:10:07.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a2d600640 1 -- 172.21.15.18:0/2907658849 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4942 (secure 0 0 0) 0x7f6a280556d0 con 0x7f6a30144140 2024-04-25T10:10:07.453 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:07.453 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:08:33.379806+0000","modified":"2024-04-25T10:09:35.776644+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":82,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7020},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7020":{"gid":7020,"name":"a","rank":0,"incarnation":49,"state":"up:active","state_seq":15,"addr":"172.21.15.18:6835/1522131384","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1522131384},{"type":"v1","addr":"172.21.15.18:6835","nonce":1522131384}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T10:10:07.453 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 54 2024-04-25T10:10:07.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 msgr2=0x7f6a0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 0x7f6a0c069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6a200ad000 tx=0x7f6a20004740 comp rx=0 tx=0).stop 2024-04-25T10:10:07.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 msgr2=0x7f6a300b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f6a2800cae0 tx=0x7f6a2800a060 comp rx=0 tx=0).stop 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 shutdown_connections 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a30144140 0x7f6a300b2240 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a300ced60 0x7f6a301430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a0c066f60 0x7f6a0c069420 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 --2- 172.21.15.18:0/2907658849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a3006ead0 0x7f6a3013b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 >> 172.21.15.18:0/2907658849 conn(0x7f6a30066fa0 msgr2=0x7f6a300b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 shutdown_connections 2024-04-25T10:10:07.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.446+0000 7f6a37600640 1 -- 172.21.15.18:0/2907658849 wait complete. 2024-04-25T10:10:07.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:07.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 Processor -- start 2024-04-25T10:10:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 -- start start 2024-04-25T10:10:07.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fba5c145020 0x7fba5c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0ce130 con 0x7fba5c06ac10 2024-04-25T10:10:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c073200 con 0x7fba5c145400 2024-04-25T10:10:07.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba62000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0cd360 con 0x7fba5c145020 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fba5c06ac10 0x7fba5c15f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55788/0 (socket says 172.21.15.18:55788) 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5be00640 1 -- 172.21.15.18:0/3692859788 learned_addr learned my addr 172.21.15.18:0/3692859788 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5b400640 1 --2- 172.21.15.18:0/3692859788 >> v2:172.21.15.167:3300/0 conn(0x7fba5c145020 0x7fba5c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707489791 0 0) 0x7fba5c0ce130 con 0x7fba5c06ac10 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba40003530 con 0x7fba5c06ac10 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413670889 0 0) 0x7fba5c073200 con 0x7fba5c145400 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0ce130 con 0x7fba5c145400 2024-04-25T10:10:07.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5b400640 1 -- 172.21.15.18:0/3692859788 >> v1:172.21.15.167:6789/0 conn(0x7fba5c145400 legacy=0x7fba5c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5b400640 1 -- 172.21.15.18:0/3692859788 >> v1:172.21.15.18:6789/0 conn(0x7fba5c06ac10 legacy=0x7fba5c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072421034 0 0) 0x7fba40003530 con 0x7fba5c06ac10 2024-04-25T10:10:07.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.610+0000 7fba5b400640 1 -- 172.21.15.18:0/3692859788 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0cd5b0 con 0x7fba5c145020 2024-04-25T10:10:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba5b400640 1 --2- 172.21.15.18:0/3692859788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145020 0x7fba5c072cc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0cd4e0 tx=0x7fba4c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf37711aa4eff87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b0070 con 0x7fba5c145020 2024-04-25T10:10:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0ab400 con 0x7fba5c145020 2024-04-25T10:10:07.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba5aa00640 1 -- 172.21.15.18:0/3692859788 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba54001a00 con 0x7fba5c145020 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 -- 172.21.15.18:0/3692859788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145020 msgr2=0x7fba5c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 --2- 172.21.15.18:0/3692859788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145020 0x7fba5c072cc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fba5c0cd4e0 tx=0x7fba4c01c390 comp rx=0 tx=0).stop 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 -- 172.21.15.18:0/3692859788 shutdown_connections 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 --2- 172.21.15.18:0/3692859788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145020 0x7fba5c072cc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 -- 172.21.15.18:0/3692859788 >> 172.21.15.18:0/3692859788 conn(0x7fba5c0b2400 msgr2=0x7fba5c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 -- 172.21.15.18:0/3692859788 shutdown_connections 2024-04-25T10:10:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.614+0000 7fba62000640 1 -- 172.21.15.18:0/3692859788 wait complete. 2024-04-25T10:10:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 Processor -- start 2024-04-25T10:10:07.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- start start 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 0x7fba5c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 0x7fba5c143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0d01e0 con 0x7fba5c06ac10 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c06b4d0 con 0x7fba5c145400 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0d0360 con 0x7fba5c145020 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60646/0 (socket says 172.21.15.18:60646) 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 -- 172.21.15.18:0/1810622799 learned_addr learned my addr 172.21.15.18:0/1810622799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba53e00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 0x7fba5c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 -- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 msgr2=0x7fba5c15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 0x7fba5c15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5be00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 0x7fba5c143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 -- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 msgr2=0x7fba5c143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 0x7fba5c143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 -- 172.21.15.18:0/1810622799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c15ace0 con 0x7fba5c06ac10 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba53e00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 0x7fba5c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5be00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 0x7fba5c143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba5b400640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ae040 tx=0x7fba4c01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b0050 con 0x7fba5c06ac10 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0b1040 con 0x7fba5c06ac10 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0b7650 con 0x7fba5c06ac10 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c13ff10 con 0x7fba5c06ac10 2024-04-25T10:10:07.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c13fc30 con 0x7fba5c06ac10 2024-04-25T10:10:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.618+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c0745d0 con 0x7fba5c06ac10 2024-04-25T10:10:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.622+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba4c0be030 con 0x7fba5c06ac10 2024-04-25T10:10:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.622+0000 7fba53400640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 0x7fba38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.622+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fba4c11efd0 con 0x7fba5c06ac10 2024-04-25T10:10:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.622+0000 7fba53e00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 0x7fba38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.622+0000 7fba53e00640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 0x7fba38069450 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fba5c15f0e0 tx=0x7fba44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.626+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba4c0c5020 con 0x7fba5c06ac10 2024-04-25T10:10:07.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.786+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba5c072550 con 0x7fba5c06ac10 2024-04-25T10:10:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba53400640 1 -- 172.21.15.18:0/1810622799 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+17048 (secure 0 0 0) 0x7fba4c015fb0 con 0x7fba5c06ac10 2024-04-25T10:10:07.797 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:07.797 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:08:48.763190+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:08:31.175528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T10:08:32.386489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 msgr2=0x7fba38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 0x7fba38069450 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fba5c15f0e0 tx=0x7fba44009040 comp rx=0 tx=0).stop 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 msgr2=0x7fba5c140810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ae040 tx=0x7fba4c01abd0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 shutdown_connections 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba5c145400 0x7fba5c143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba38066f90 0x7fba38069450 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fba5c145020 0x7fba5c15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 --2- 172.21.15.18:0/1810622799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fba5c06ac10 0x7fba5c140810 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 >> 172.21.15.18:0/1810622799 conn(0x7fba5c0b2400 msgr2=0x7fba5c15bf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 shutdown_connections 2024-04-25T10:10:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.790+0000 7fba62000640 1 -- 172.21.15.18:0/1810622799 wait complete. 2024-04-25T10:10:07.818 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:10:07.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.950+0000 7fa5cc000640 1 Processor -- start 2024-04-25T10:10:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.950+0000 7fa5cc000640 1 -- start start 2024-04-25T10:10:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c4144120 0x7fa5c415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5c40ccbf0 0x7fa5c415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa5c415ee60 0x7fa5c40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c415e490 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c415bc40 con 0x7fa5c415ee60 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5cc000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c415b3a0 con 0x7fa5c4144120 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5c40ccbf0 0x7fa5c415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa5c40ccbf0 0x7fa5c415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60652/0 (socket says 172.21.15.18:60652) 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 -- 172.21.15.18:0/3412293447 learned_addr learned my addr 172.21.15.18:0/3412293447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c9600640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c4144120 0x7fa5c415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5ca000640 1 --2- 172.21.15.18:0/3412293447 >> v2:172.21.15.167:3300/0 conn(0x7fa5c415ee60 0x7fa5c40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 -- 172.21.15.18:0/3412293447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c4144120 msgr2=0x7fa5c415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c4144120 0x7fa5c415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 -- 172.21.15.18:0/3412293447 >> v2:172.21.15.167:3300/0 conn(0x7fa5c415ee60 msgr2=0x7fa5c40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3412293447 >> v2:172.21.15.167:3300/0 conn(0x7fa5c415ee60 0x7fa5c40b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 -- 172.21.15.18:0/3412293447 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c415b680 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.954+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c415e920 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40b2fe0 tx=0x7fa5b001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf7d83e134f9ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c3e00640 1 -- 172.21.15.18:0/3412293447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00b0070 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c3e00640 1 -- 172.21.15.18:0/3412293447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b00ab600 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c3e00640 1 -- 172.21.15.18:0/3412293447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00ab9d0 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- 172.21.15.18:0/3412293447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 msgr2=0x7fa5c415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c415e920 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40b2fe0 tx=0x7fa5b001c490 comp rx=0 tx=0).stop 2024-04-25T10:10:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- 172.21.15.18:0/3412293447 shutdown_connections 2024-04-25T10:10:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3412293447 >> v2:172.21.15.167:3300/0 conn(0x7fa5c415ee60 0x7fa5c40b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c415e920 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3412293447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c4144120 0x7fa5c415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- 172.21.15.18:0/3412293447 >> 172.21.15.18:0/3412293447 conn(0x7fa5c4067080 msgr2=0x7fa5c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- 172.21.15.18:0/3412293447 shutdown_connections 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- 172.21.15.18:0/3412293447 wait complete. 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 Processor -- start 2024-04-25T10:10:07.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- start start 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5c4144120 0x7fa5c413ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 0x7fa5c4161520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4071e50 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4071cd0 con 0x7fa5c4144120 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5cc000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c4071fd0 con 0x7fa5c415ee60 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60666/0 (socket says 172.21.15.18:60666) 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c9600640 1 -- 172.21.15.18:0/3187267553 learned_addr learned my addr 172.21.15.18:0/3187267553 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:07.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5c4144120 0x7fa5c413ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.958+0000 7fa5ca000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 0x7fa5c4161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 -- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 msgr2=0x7fa5c4161520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 0x7fa5c4161520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 -- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5c4144120 msgr2=0x7fa5c413ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5c4144120 0x7fa5c413ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 -- 172.21.15.18:0/3187267553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c4161f00 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5ca000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 0x7fa5c4161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c9600640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d800 tx=0x7fa5b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8018030 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b80096a0 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009870 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c415f940 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c415ff00 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c40745d0 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5b801b070 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 0x7fa5a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:07.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa5b80854a0 con 0x7fa5c40ccbf0 2024-04-25T10:10:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.962+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 0x7fa5a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:07.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.966+0000 7fa5c8c00640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 0x7fa5a4069450 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00ad000 tx=0x7fa5b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:07.966+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5b8056230 con 0x7fa5c40ccbf0 2024-04-25T10:10:08.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.166+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa5c415cf50 con 0x7fa5c40ccbf0 2024-04-25T10:10:08.173 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:10:08.166+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:10:08.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.166+0000 7fa5c1600640 1 -- 172.21.15.18:0/3187267553 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v55) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa5b8055b30 con 0x7fa5c40ccbf0 2024-04-25T10:10:08.175 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:10:08.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 msgr2=0x7fa5a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 0x7fa5a4069450 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa5b00ad000 tx=0x7fa5b0008040 comp rx=0 tx=0).stop 2024-04-25T10:10:08.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 msgr2=0x7fa5c4160420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fa5b800d800 tx=0x7fa5b800dcc0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 shutdown_connections 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5a4066f90 0x7fa5a4069450 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa5c415ee60 0x7fa5c4161520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5c4144120 0x7fa5c413ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 --2- 172.21.15.18:0/3187267553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5c40ccbf0 0x7fa5c4160420 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 >> 172.21.15.18:0/3187267553 conn(0x7fa5c4067080 msgr2=0x7fa5c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 shutdown_connections 2024-04-25T10:10:08.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.170+0000 7fa5cc000640 1 -- 172.21.15.18:0/3187267553 wait complete. 2024-04-25T10:10:08.186 INFO:tasks.ceph.mds.a.smithi018.stderr: -4063> 2024-04-25T10:08:54.774+0000 7feb2c400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:10:08.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:10:08.235 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:10:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.334+0000 7f5d24800640 1 Processor -- start 2024-04-25T10:10:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.334+0000 7f5d24800640 1 -- start start 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d24800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 0x7f5d1c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d24800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c15fc00 con 0x7f5d1c06e4a0 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d24800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1c15fee0 con 0x7f5d1c15f440 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d24800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c06d640 con 0x7f5d1c159320 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d22800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5d1c06e4a0 0x7f5d1c071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55802/0 (socket says 172.21.15.18:55802) 2024-04-25T10:10:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d22800640 1 -- 172.21.15.18:0/1778278000 learned_addr learned my addr 172.21.15.18:0/1778278000 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:08.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d21e00640 1 --2- 172.21.15.18:0/1778278000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 0x7f5d1c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:08.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770141702 0 0) 0x7f5d1c15fc00 con 0x7f5d1c06e4a0 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d04003530 con 0x7f5d1c06e4a0 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869615591 0 0) 0x7f5d1c15fee0 con 0x7f5d1c15f440 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c15fc00 con 0x7f5d1c15f440 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d21e00640 1 -- 172.21.15.18:0/1778278000 >> v1:172.21.15.167:6789/0 conn(0x7f5d1c15f440 legacy=0x7f5d1c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d21e00640 1 -- 172.21.15.18:0/1778278000 >> v1:172.21.15.18:6789/0 conn(0x7f5d1c06e4a0 legacy=0x7f5d1c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.338+0000 7f5d21e00640 1 -- 172.21.15.18:0/1778278000 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c1601c0 con 0x7f5d1c159320 2024-04-25T10:10:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d21e00640 1 --2- 172.21.15.18:0/1778278000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 0x7f5d1c15c9b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d100097f0 tx=0x7f5d1001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8cf9b9d48a7b0da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100b1070 con 0x7f5d1c159320 2024-04-25T10:10:08.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d100ac620 con 0x7f5d1c159320 2024-04-25T10:10:08.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d20a00640 1 -- 172.21.15.18:0/1778278000 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100ac9f0 con 0x7f5d1c159320 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- 172.21.15.18:0/1778278000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 msgr2=0x7f5d1c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 --2- 172.21.15.18:0/1778278000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 0x7f5d1c15c9b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5d100097f0 tx=0x7f5d1001c420 comp rx=0 tx=0).stop 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- 172.21.15.18:0/1778278000 shutdown_connections 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 --2- 172.21.15.18:0/1778278000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c159320 0x7f5d1c15c9b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- 172.21.15.18:0/1778278000 >> 172.21.15.18:0/1778278000 conn(0x7f5d1c067080 msgr2=0x7f5d1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- 172.21.15.18:0/1778278000 shutdown_connections 2024-04-25T10:10:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- 172.21.15.18:0/1778278000 wait complete. 2024-04-25T10:10:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 Processor -- start 2024-04-25T10:10:08.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.342+0000 7f5d24800640 1 -- start start 2024-04-25T10:10:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c06e4a0 0x7f5d1c127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d1c159320 0x7f5d1c1284e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c15f9a0 con 0x7f5d1c15f440 2024-04-25T10:10:08.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c15f820 con 0x7f5d1c159320 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1c071980 con 0x7f5d1c06e4a0 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60690/0 (socket says 172.21.15.18:60690) 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 -- 172.21.15.18:0/782355543 learned_addr learned my addr 172.21.15.18:0/782355543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d21e00640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c06e4a0 0x7f5d1c127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d21400640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d1c159320 0x7f5d1c1284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 -- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c06e4a0 msgr2=0x7f5d1c127630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c06e4a0 0x7f5d1c127630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 -- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d1c159320 msgr2=0x7f5d1c1284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d1c159320 0x7f5d1c1284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:08.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 -- 172.21.15.18:0/782355543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c145450 con 0x7f5d1c15f440 2024-04-25T10:10:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d22800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800cb10 tx=0x7f5d1800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18017070 con 0x7f5d1c15f440 2024-04-25T10:10:08.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1800ac70 con 0x7f5d1c15f440 2024-04-25T10:10:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18012620 con 0x7f5d1c15f440 2024-04-25T10:10:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1c141180 con 0x7f5d1c15f440 2024-04-25T10:10:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1c1416d0 con 0x7f5d1c15f440 2024-04-25T10:10:08.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1c0745d0 con 0x7f5d1c15f440 2024-04-25T10:10:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.346+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5d1801a070 con 0x7f5d1c15f440 2024-04-25T10:10:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.350+0000 7f5d16000640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 0x7f5d00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.350+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f5d18085080 con 0x7f5d1c15f440 2024-04-25T10:10:08.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.350+0000 7f5d21e00640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 0x7f5d00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:08.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.350+0000 7f5d21e00640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 0x7f5d00069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ae000 tx=0x7f5d100a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:08.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.354+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d1800ae20 con 0x7f5d1c15f440 2024-04-25T10:10:08.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:08.550+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d1c0ad580 con 0x7f5d1c15f440 2024-04-25T10:10:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.170+0000 7f5d16000640 1 -- 172.21.15.18:0/782355543 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d18055db0 con 0x7f5d1c15f440 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.170+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 msgr2=0x7f5d00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 0x7f5d00069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5d100ae000 tx=0x7f5d100a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 msgr2=0x7f5d1c12d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800cb10 tx=0x7f5d1800a060 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 shutdown_connections 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d1c15f440 0x7f5d1c12d9f0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d1c159320 0x7f5d1c1284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d00066f60 0x7f5d00069420 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 --2- 172.21.15.18:0/782355543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d1c06e4a0 0x7f5d1c127630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 >> 172.21.15.18:0/782355543 conn(0x7f5d1c067080 msgr2=0x7f5d1c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:09.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 shutdown_connections 2024-04-25T10:10:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.174+0000 7f5d24800640 1 -- 172.21.15.18:0/782355543 wait complete. 2024-04-25T10:10:09.203 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:10:09.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 Processor -- start 2024-04-25T10:10:09.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 -- start start 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f32e415dd00 0x7f32e40af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32e40ce1c0 0x7f32e40c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32e40c6dc0 con 0x7f32e40c5ed0 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e40d0430 con 0x7f32e40ce1c0 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32eb400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e40c70a0 con 0x7f32e415dd00 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32e3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32e40ce1c0 0x7f32e40c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32e3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f32e40ce1c0 0x7f32e40c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60700/0 (socket says 172.21.15.18:60700) 2024-04-25T10:10:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.390+0000 7f32e3e00640 1 -- 172.21.15.18:0/306973803 learned_addr learned my addr 172.21.15.18:0/306973803 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e8a00640 1 --2- 172.21.15.18:0/306973803 >> v2:172.21.15.167:3300/0 conn(0x7f32e415dd00 0x7f32e40af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3e00640 1 -- 172.21.15.18:0/306973803 >> v2:172.21.15.167:3300/0 conn(0x7f32e415dd00 msgr2=0x7f32e40af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3e00640 1 --2- 172.21.15.18:0/306973803 >> v2:172.21.15.167:3300/0 conn(0x7f32e415dd00 0x7f32e40af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3e00640 1 -- 172.21.15.18:0/306973803 >> v1:172.21.15.167:6789/0 conn(0x7f32e40c5ed0 legacy=0x7f32e406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3e00640 1 -- 172.21.15.18:0/306973803 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e40c7380 con 0x7f32e40ce1c0 2024-04-25T10:10:09.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3e00640 1 --2- 172.21.15.18:0/306973803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e40ce1c0 0x7f32e40c5990 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f32e4071d70 tx=0x7f32d001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8cb5309766eead server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3400640 1 -- 172.21.15.18:0/306973803 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00ab430 con 0x7f32e40ce1c0 2024-04-25T10:10:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3400640 1 -- 172.21.15.18:0/306973803 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d00b0070 con 0x7f32e40ce1c0 2024-04-25T10:10:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32e3400640 1 -- 172.21.15.18:0/306973803 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d00ab7f0 con 0x7f32e40ce1c0 2024-04-25T10:10:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32eb400640 1 -- 172.21.15.18:0/306973803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e40ce1c0 msgr2=0x7f32e40c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.394+0000 7f32eb400640 1 --2- 172.21.15.18:0/306973803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e40ce1c0 0x7f32e40c5990 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f32e4071d70 tx=0x7f32d001c520 comp rx=0 tx=0).stop 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- 172.21.15.18:0/306973803 shutdown_connections 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 --2- 172.21.15.18:0/306973803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e40ce1c0 0x7f32e40c5990 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 --2- 172.21.15.18:0/306973803 >> v2:172.21.15.167:3300/0 conn(0x7f32e415dd00 0x7f32e40af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- 172.21.15.18:0/306973803 >> 172.21.15.18:0/306973803 conn(0x7f32e40b2240 msgr2=0x7f32e40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- 172.21.15.18:0/306973803 shutdown_connections 2024-04-25T10:10:09.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- 172.21.15.18:0/306973803 wait complete. 2024-04-25T10:10:09.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 Processor -- start 2024-04-25T10:10:09.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- start start 2024-04-25T10:10:09.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e40c5ed0 0x7f32e40b3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32e40ce1c0 0x7f32e414fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e416aa80 con 0x7f32e414c960 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e416a900 con 0x7f32e40c5ed0 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32eb400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e416ac00 con 0x7f32e40ce1c0 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e8a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e40c5ed0 0x7f32e40b3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60706/0 (socket says 172.21.15.18:60706) 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 -- 172.21.15.18:0/1691396193 learned_addr learned my addr 172.21.15.18:0/1691396193 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e3e00640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32e40ce1c0 0x7f32e414fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 -- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32e40ce1c0 msgr2=0x7f32e414fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32e40ce1c0 0x7f32e414fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 -- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e40c5ed0 msgr2=0x7f32e40b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e40c5ed0 0x7f32e40b3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 -- 172.21.15.18:0/1691396193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e40b38c0 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.398+0000 7f32e9400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c770 tx=0x7f32dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc003b80 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc003d20 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e40b3ba0 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00aa90 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e40b4160 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e40745d0 con 0x7f32e414c960 2024-04-25T10:10:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32dc00ac30 con 0x7f32e414c960 2024-04-25T10:10:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 0x7f32c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f32dc0850c0 con 0x7f32e414c960 2024-04-25T10:10:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.402+0000 7f32e8a00640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 0x7f32c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.406+0000 7f32e8a00640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 0x7f32c4069420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f32d80079c0 tx=0x7f32d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.406+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32dc055830 con 0x7f32e414c960 2024-04-25T10:10:09.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:09.570+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f32e4153a60 con 0x7f32e414c960 2024-04-25T10:10:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.174+0000 7f32e0c00640 1 -- 172.21.15.18:0/1691396193 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) v1 ==== 181+0+0 (secure 0 0 0) 0x7f32dc0598d0 con 0x7f32e414c960 2024-04-25T10:10:10.184 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:10:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 msgr2=0x7f32c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 0x7f32c4069420 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f32d80079c0 tx=0x7f32d8008040 comp rx=0 tx=0).stop 2024-04-25T10:10:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 msgr2=0x7f32e40b0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c770 tx=0x7f32dc00cc30 comp rx=0 tx=0).stop 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 shutdown_connections 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e414c960 0x7f32e40b0ca0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f32c4066f60 0x7f32c4069420 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f32e40ce1c0 0x7f32e414fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 --2- 172.21.15.18:0/1691396193 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32e40c5ed0 0x7f32e40b3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 >> 172.21.15.18:0/1691396193 conn(0x7f32e40b2240 msgr2=0x7f32e406fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 shutdown_connections 2024-04-25T10:10:10.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.178+0000 7f32eb400640 1 -- 172.21.15.18:0/1691396193 wait complete. 2024-04-25T10:10:10.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:10:10.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 Processor -- start 2024-04-25T10:10:10.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 -- start start 2024-04-25T10:10:10.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e80071b70 0x7f9e80066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e80071f50 0x7f9e800ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8006b990 con 0x7f9e800cf0d0 2024-04-25T10:10:10.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e80067090 con 0x7f9e80071f50 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e86e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8006dbd0 con 0x7f9e80071b70 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e80071f50 0x7f9e800ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e80071f50 0x7f9e800ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60710/0 (socket says 172.21.15.18:60710) 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 -- 172.21.15.18:0/2205460673 learned_addr learned my addr 172.21.15.18:0/2205460673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e84e00640 1 --1- 172.21.15.18:0/2205460673 >> v1:172.21.15.18:6789/0 conn(0x7f9e800cf0d0 0x7f9e800cf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55818/0 (socket says 172.21.15.18:55818) 2024-04-25T10:10:10.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7fe00640 1 --2- 172.21.15.18:0/2205460673 >> v2:172.21.15.167:3300/0 conn(0x7f9e80071b70 0x7f9e80066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 -- 172.21.15.18:0/2205460673 >> v2:172.21.15.167:3300/0 conn(0x7f9e80071b70 msgr2=0x7f9e80066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 --2- 172.21.15.18:0/2205460673 >> v2:172.21.15.167:3300/0 conn(0x7f9e80071b70 0x7f9e80066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7ea00640 1 -- 172.21.15.18:0/2205460673 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850567709 0 0) 0x7f9e8006b990 con 0x7f9e800cf0d0 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 -- 172.21.15.18:0/2205460673 >> v1:172.21.15.18:6789/0 conn(0x7f9e800cf0d0 legacy=0x7f9e800cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.350+0000 7f9e7f400640 1 -- 172.21.15.18:0/2205460673 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8006bc70 con 0x7f9e80071f50 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e7f400640 1 --2- 172.21.15.18:0/2205460673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071f50 0x7f9e800ceb90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b2980 tx=0x7f9e6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461ce9960fe495e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e7ea00640 1 -- 172.21.15.18:0/2205460673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0ab600 con 0x7f9e80071f50 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e7ea00640 1 -- 172.21.15.18:0/2205460673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c0b0070 con 0x7f9e80071f50 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e7ea00640 1 -- 172.21.15.18:0/2205460673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0ab9c0 con 0x7f9e80071f50 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 -- 172.21.15.18:0/2205460673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071f50 msgr2=0x7f9e800ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2205460673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071f50 0x7f9e800ceb90 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f9e800b2980 tx=0x7f9e6c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 -- 172.21.15.18:0/2205460673 shutdown_connections 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2205460673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071f50 0x7f9e800ceb90 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2205460673 >> v2:172.21.15.167:3300/0 conn(0x7f9e80071b70 0x7f9e80066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 -- 172.21.15.18:0/2205460673 >> 172.21.15.18:0/2205460673 conn(0x7f9e800cfd80 msgr2=0x7f9e800d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 -- 172.21.15.18:0/2205460673 shutdown_connections 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 -- 172.21.15.18:0/2205460673 wait complete. 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.354+0000 7f9e86e00640 1 Processor -- start 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- start start 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e80071f50 0x7f9e800af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e800cf0d0 0x7f9e800afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8006b5e0 con 0x7f9e80071b70 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800b4d00 con 0x7f9e80071f50 2024-04-25T10:10:10.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8015f960 con 0x7f9e800cf0d0 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60714/0 (socket says 172.21.15.18:60714) 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 -- 172.21.15.18:0/2311894975 learned_addr learned my addr 172.21.15.18:0/2311894975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e84e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e800cf0d0 0x7f9e800afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7f400640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e80071f50 0x7f9e800af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 -- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e800cf0d0 msgr2=0x7f9e800afee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e800cf0d0 0x7f9e800afee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 -- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e80071f50 msgr2=0x7f9e800af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e80071f50 0x7f9e800af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 -- 172.21.15.18:0/2311894975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80147e40 con 0x7f9e80071b70 2024-04-25T10:10:10.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e7fe00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000d800 tx=0x7f9e7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000b6c0 con 0x7f9e80071b70 2024-04-25T10:10:10.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70019070 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7000ba60 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8015ed50 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8015f310 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.358+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800745d0 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.362+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9e7000bc00 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.362+0000 7f9e77e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 0x7f9e60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.362+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5835+0+0 (secure 0 0 0) 0x7f9e70085520 con 0x7f9e80071b70 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.362+0000 7f9e7f400640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 0x7f9e60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:10.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.362+0000 7f9e7f400640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 0x7f9e60069420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0af000 tx=0x7f9e6c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:10.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.366+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e700564a0 con 0x7f9e80071b70 2024-04-25T10:10:10.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:10.530+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e80072950 con 0x7f9e80071b70 2024-04-25T10:10:11.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.178+0000 7f9e77e00640 1 -- 172.21.15.18:0/2311894975 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9e70055da0 con 0x7f9e80071b70 2024-04-25T10:10:11.186 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 msgr2=0x7f9e60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 0x7f9e60069420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0af000 tx=0x7f9e6c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 msgr2=0x7f9e80147900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000d800 tx=0x7f9e7000dcc0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 shutdown_connections 2024-04-25T10:10:11.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e60066f60 0x7f9e60069420 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e800cf0d0 0x7f9e800afee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e80071f50 0x7f9e800af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 --2- 172.21.15.18:0/2311894975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e80071b70 0x7f9e80147900 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 >> 172.21.15.18:0/2311894975 conn(0x7f9e800cfd80 msgr2=0x7f9e80157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 shutdown_connections 2024-04-25T10:10:11.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.182+0000 7f9e86e00640 1 -- 172.21.15.18:0/2311894975 wait complete. 2024-04-25T10:10:11.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:10:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 Processor -- start 2024-04-25T10:10:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 -- start start 2024-04-25T10:10:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f588406e010 0x7f588406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f588415fc00 con 0x7f5884159320 2024-04-25T10:10:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588406d640 con 0x7f588406e010 2024-04-25T10:10:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f588ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588415fee0 con 0x7f588415c9b0 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f5888e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f588406e010 0x7f588406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f5883e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f5884159320 0x7f588415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:59460/0 (socket says 172.21.15.18:59460) 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:49002/0 (socket says 172.21.15.18:49002) 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f5883e00640 1 -- 172.21.15.18:0/1783860258 learned_addr learned my addr 172.21.15.18:0/1783860258 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 -- 172.21.15.18:0/1783860258 >> v2:172.21.15.167:3300/0 conn(0x7f588406e010 msgr2=0x7f588406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 --2- 172.21.15.18:0/1783860258 >> v2:172.21.15.167:3300/0 conn(0x7f588406e010 0x7f588406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 -- 172.21.15.18:0/1783860258 >> v1:172.21.15.167:6789/0 conn(0x7f5884159320 legacy=0x7f588415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f587be00640 1 -- 172.21.15.18:0/1783860258 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58841601c0 con 0x7f588415c9b0 2024-04-25T10:10:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.366+0000 7f5883400640 1 -- 172.21.15.18:0/1783860258 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977402410 0 0) 0x7f588415fc00 con 0x7f5884159320 2024-04-25T10:10:11.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f587be00640 1 --2- 172.21.15.18:0/1783860258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097c0 tx=0x7f586c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e02106d6300f33e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f5883400640 1 -- 172.21.15.18:0/1783860258 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0b0070 con 0x7f588415c9b0 2024-04-25T10:10:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f5883400640 1 -- 172.21.15.18:0/1783860258 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c0ab600 con 0x7f588415c9b0 2024-04-25T10:10:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f5883400640 1 -- 172.21.15.18:0/1783860258 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c0ab9d0 con 0x7f588415c9b0 2024-04-25T10:10:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 -- 172.21.15.18:0/1783860258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 msgr2=0x7f588406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 --2- 172.21.15.18:0/1783860258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f586c0097c0 tx=0x7f586c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 -- 172.21.15.18:0/1783860258 shutdown_connections 2024-04-25T10:10:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 --2- 172.21.15.18:0/1783860258 >> v2:172.21.15.167:3300/0 conn(0x7f588406e010 0x7f588406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 --2- 172.21.15.18:0/1783860258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f588415c9b0 0x7f588406dad0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 -- 172.21.15.18:0/1783860258 >> 172.21.15.18:0/1783860258 conn(0x7f5884067080 msgr2=0x7f588406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 -- 172.21.15.18:0/1783860258 shutdown_connections 2024-04-25T10:10:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.370+0000 7f588ae00640 1 -- 172.21.15.18:0/1783860258 wait complete. 2024-04-25T10:10:11.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 Processor -- start 2024-04-25T10:10:11.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- start start 2024-04-25T10:10:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5884159320 0x7f5884142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f588415c9b0 0x7f58840b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5884168920 con 0x7f588406e010 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58841687a0 con 0x7f588415c9b0 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5884168aa0 con 0x7f5884159320 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60728/0 (socket says 172.21.15.18:60728) 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 -- 172.21.15.18:0/3039932518 learned_addr learned my addr 172.21.15.18:0/3039932518 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f587be00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5884159320 0x7f5884142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5888e00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f588415c9b0 0x7f58840b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 -- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5884159320 msgr2=0x7f5884142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5884159320 0x7f5884142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 -- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f588415c9b0 msgr2=0x7f58840b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f588415c9b0 0x7f58840b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 -- 172.21.15.18:0/3039932518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840b27a0 con 0x7f588406e010 2024-04-25T10:10:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5883e00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f58740011f0 tx=0x7f587400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874018070 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58740074e0 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874004a10 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5884144e00 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.374+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58841453c0 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58840745d0 con 0x7f588406e010 2024-04-25T10:10:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5874004bb0 con 0x7f588406e010 2024-04-25T10:10:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f5880c00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 0x7f5860069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f5874084190 con 0x7f588406e010 2024-04-25T10:10:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f587be00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 0x7f5860069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.378+0000 7f587be00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 0x7f5860069450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f586c0ad000 tx=0x7f586c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.382+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5874054bd0 con 0x7f588406e010 2024-04-25T10:10:11.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.558+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5884166360 con 0x7f588406e010 2024-04-25T10:10:11.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f5880c00640 1 -- 172.21.15.18:0/3039932518 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5874058c70 con 0x7f588406e010 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 msgr2=0x7f5860069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 0x7f5860069450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f586c0ad000 tx=0x7f586c008040 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 msgr2=0x7f5884164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f58740011f0 tx=0x7f587400c9b0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 shutdown_connections 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f588415c9b0 0x7f58840b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5860066f90 0x7f5860069450 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5884159320 0x7f5884142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 --2- 172.21.15.18:0/3039932518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f588406e010 0x7f5884164bc0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 >> 172.21.15.18:0/3039932518 conn(0x7f5884067080 msgr2=0x7f588406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:11.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 shutdown_connections 2024-04-25T10:10:11.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.566+0000 7f588ae00640 1 -- 172.21.15.18:0/3039932518 wait complete. 2024-04-25T10:10:11.593 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T10:10:11.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 Processor -- start 2024-04-25T10:10:11.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 -- start start 2024-04-25T10:10:11.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4bc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0cc4e0 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0ce040 con 0x7fc4bc0cd4d0 2024-04-25T10:10:11.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4c1200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc145650 con 0x7fc4bc145270 2024-04-25T10:10:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4ba800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4bc0b1e60 0x7fc4bc15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35160/0 (socket says 172.21.15.18:35160) 2024-04-25T10:10:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4ba800640 1 -- 172.21.15.18:0/4176360131 learned_addr learned my addr 172.21.15.18:0/4176360131 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9e00640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4bc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1879529941 0 0) 0x7fc4bc0cc4e0 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a0003530 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493890438 0 0) 0x7fc4a0003530 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 msgr2=0x7fc4bc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4bc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 >> v1:172.21.15.167:6789/0 conn(0x7fc4bc0cd4d0 legacy=0x7fc4bc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0ce320 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fc4b4001a00 con 0x7fc4bc0b1e60 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 >> v1:172.21.15.18:6789/0 conn(0x7fc4bc0b1e60 legacy=0x7fc4bc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4a00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4a0003fc0 0x7fc4a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0004d50 0x7fc4a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc145650 con 0x7fc4a0003fc0 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a000bb10 con 0x7fc4a0004d50 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a000bd10 con 0x7fc4bc145270 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b1400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4a0003fc0 0x7fc4a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b9e00640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4a00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4ba800640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0004d50 0x7fc4a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.726+0000 7fc4b1400640 1 -- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 msgr2=0x7fc4a00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b1400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4bc145270 0x7fc4a00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b1400640 1 -- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0004d50 msgr2=0x7fc4a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b1400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4a0004d50 0x7fc4a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b1400640 1 -- 172.21.15.18:0/4176360131 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a0003530 con 0x7fc4a0003fc0 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b1400640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4a0003fc0 0x7fc4a0004810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4001360 tx=0x7fc4a4020720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57492a372bc1faad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40013a0 con 0x7fc4a0003fc0 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a40052a0 con 0x7fc4a0003fc0 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4b9400640 1 -- 172.21.15.18:0/4176360131 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4003600 con 0x7fc4a0003fc0 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 -- 172.21.15.18:0/4176360131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4a0003fc0 msgr2=0x7fc4a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 --2- 172.21.15.18:0/4176360131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4a0003fc0 0x7fc4a0004810 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc4a4001360 tx=0x7fc4a4020720 comp rx=0 tx=0).stop 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4ba800640 1 -- 172.21.15.18:0/4176360131 reap_dead start 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 -- 172.21.15.18:0/4176360131 shutdown_connections 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 -- 172.21.15.18:0/4176360131 >> 172.21.15.18:0/4176360131 conn(0x7fc4bc066fa0 msgr2=0x7fc4bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 -- 172.21.15.18:0/4176360131 shutdown_connections 2024-04-25T10:10:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.730+0000 7fc4c1200640 1 -- 172.21.15.18:0/4176360131 wait complete. 2024-04-25T10:10:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 Processor -- start 2024-04-25T10:10:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- start start 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0003fc0 0x7fc4bc0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 0x7fc4bc0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15f930 con 0x7fc4bc15b200 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15f650 con 0x7fc4bc0abba0 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15fe50 con 0x7fc4a0003fc0 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33916/0 (socket says 172.21.15.18:33916) 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 -- 172.21.15.18:0/1947594473 learned_addr learned my addr 172.21.15.18:0/1947594473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b9e00640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0003fc0 0x7fc4bc0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4ba800640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 0x7fc4bc0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 -- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0003fc0 msgr2=0x7fc4bc0aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0003fc0 0x7fc4bc0aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 -- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 msgr2=0x7fc4bc0ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 0x7fc4bc0ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 -- 172.21.15.18:0/1947594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc15d370 con 0x7fc4bc15b200 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4ba800640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 0x7fc4bc0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b1400640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc4a401ee20 tx=0x7fc4a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a40bd070 con 0x7fc4bc15b200 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a4007030 con 0x7fc4bc15b200 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4007a40 con 0x7fc4bc15b200 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc15d650 con 0x7fc4bc15b200 2024-04-25T10:10:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.734+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc15dc10 con 0x7fc4bc15b200 2024-04-25T10:10:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc0745d0 con 0x7fc4bc15b200 2024-04-25T10:10:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4a40c0070 con 0x7fc4bc15b200 2024-04-25T10:10:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4b2a00640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 0x7fc498069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:11.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fc4a4122560 con 0x7fc4bc15b200 2024-04-25T10:10:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4b9e00640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 0x7fc498069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.738+0000 7fc4b9e00640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 0x7fc498069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009be0 tx=0x7fc4ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.742+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4a40b0020 con 0x7fc4bc15b200 2024-04-25T10:10:11.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:11.962+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7fc4bc0cdae0 con 0x7fc4bc15b200 2024-04-25T10:10:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4b2a00640 1 -- 172.21.15.18:0/1947594473 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v314) v1 ==== 166+0+0 (secure 0 0 0) 0x7fc4a401a480 con 0x7fc4bc15b200 2024-04-25T10:10:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 msgr2=0x7fc498069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 0x7fc498069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009be0 tx=0x7fc4ac009190 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 msgr2=0x7fc4bc15cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc4a401ee20 tx=0x7fc4a0005840 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 shutdown_connections 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4bc0abba0 0x7fc4bc0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4bc15b200 0x7fc4bc15cb40 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc498066f60 0x7fc498069420 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.190+0000 7fc4c1200640 1 --2- 172.21.15.18:0/1947594473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4a0003fc0 0x7fc4bc0aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.194+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 >> 172.21.15.18:0/1947594473 conn(0x7fc4bc066fa0 msgr2=0x7fc4bc06e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.194+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 shutdown_connections 2024-04-25T10:10:12.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.194+0000 7fc4c1200640 1 -- 172.21.15.18:0/1947594473 wait complete. 2024-04-25T10:10:12.221 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T10:10:12.221 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T10:10:12.221 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:10:12.222 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:12.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 Processor -- start 2024-04-25T10:10:12.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 -- start start 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f88d015b2f0 0x7f88d00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88d006dad0 0x7f88d00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d015def0 con 0x7f88d00b2dc0 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d015e1b0 con 0x7f88d006dad0 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88d5800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d015e490 con 0x7f88d015b2f0 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cf400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88d006dad0 0x7f88d00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88c6000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f88d00b2dc0 0x7f88d006dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35174/0 (socket says 172.21.15.18:35174) 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88c6000640 1 -- 172.21.15.18:0/3241857009 learned_addr learned my addr 172.21.15.18:0/3241857009 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cea00640 1 --2- 172.21.15.18:0/3241857009 >> v2:172.21.15.167:3300/0 conn(0x7f88d015b2f0 0x7f88d00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cf400640 1 -- 172.21.15.18:0/3241857009 >> v2:172.21.15.167:3300/0 conn(0x7f88d015b2f0 msgr2=0x7f88d00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:12.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cf400640 1 --2- 172.21.15.18:0/3241857009 >> v2:172.21.15.167:3300/0 conn(0x7f88d015b2f0 0x7f88d00b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cf400640 1 -- 172.21.15.18:0/3241857009 >> v1:172.21.15.18:6789/0 conn(0x7f88d00b2dc0 legacy=0x7f88d006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88cf400640 1 -- 172.21.15.18:0/3241857009 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d015e770 con 0x7f88d006dad0 2024-04-25T10:10:12.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.354+0000 7f88ce000640 1 -- 172.21.15.18:0/3241857009 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2409041110 0 0) 0x7f88d015def0 con 0x7f88d00b2dc0 2024-04-25T10:10:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88cf400640 1 --2- 172.21.15.18:0/3241857009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d006dad0 0x7f88d00b3780 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f88d0072e20 tx=0x7f88c801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32991e60fafa373 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88ce000640 1 -- 172.21.15.18:0/3241857009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b2070 con 0x7f88d006dad0 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88ce000640 1 -- 172.21.15.18:0/3241857009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c80a59e0 con 0x7f88d006dad0 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88ce000640 1 -- 172.21.15.18:0/3241857009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d015b8e0 con 0x7f88d006dad0 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 -- 172.21.15.18:0/3241857009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d006dad0 msgr2=0x7f88d00b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 --2- 172.21.15.18:0/3241857009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d006dad0 0x7f88d00b3780 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f88d0072e20 tx=0x7f88c801c900 comp rx=0 tx=0).stop 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 -- 172.21.15.18:0/3241857009 shutdown_connections 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 --2- 172.21.15.18:0/3241857009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d006dad0 0x7f88d00b3780 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 --2- 172.21.15.18:0/3241857009 >> v2:172.21.15.167:3300/0 conn(0x7f88d015b2f0 0x7f88d00b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 -- 172.21.15.18:0/3241857009 >> 172.21.15.18:0/3241857009 conn(0x7f88d00b23b0 msgr2=0x7f88d00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 -- 172.21.15.18:0/3241857009 shutdown_connections 2024-04-25T10:10:12.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.358+0000 7f88d5800640 1 -- 172.21.15.18:0/3241857009 wait complete. 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 Processor -- start 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- start start 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 0x7f88d0166ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88d00b2dc0 0x7f88d01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d016a880 con 0x7f88d015b2f0 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d0161730 con 0x7f88d006dad0 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d016aa00 con 0x7f88d00b2dc0 2024-04-25T10:10:12.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33924/0 (socket says 172.21.15.18:33924) 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 -- 172.21.15.18:0/3283192771 learned_addr learned my addr 172.21.15.18:0/3283192771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cea00640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 0x7f88d0166ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88c6000640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88d00b2dc0 0x7f88d01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 -- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88d00b2dc0 msgr2=0x7f88d01573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88d00b2dc0 0x7f88d01573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 -- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 msgr2=0x7f88d0166ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 0x7f88d0166ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 -- 172.21.15.18:0/3283192771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d0159e60 con 0x7f88d015b2f0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cea00640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 0x7f88d0166ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88cf400640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f88c8019510 tx=0x7f88c80196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80b2050 con 0x7f88d015b2f0 2024-04-25T10:10:12.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c80be070 con 0x7f88d015b2f0 2024-04-25T10:10:12.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c80adb90 con 0x7f88d015b2f0 2024-04-25T10:10:12.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d0167320 con 0x7f88d015b2f0 2024-04-25T10:10:12.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.362+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d01678a0 con 0x7f88d015b2f0 2024-04-25T10:10:12.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d00745d0 con 0x7f88d015b2f0 2024-04-25T10:10:12.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88c80c3460 con 0x7f88d015b2f0 2024-04-25T10:10:12.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88c7400640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 0x7f88ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f88c81202f0 con 0x7f88d015b2f0 2024-04-25T10:10:12.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88cea00640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 0x7f88ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.366+0000 7f88cea00640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 0x7f88ac069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b9f0 tx=0x7f88c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.370+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88d0159e60 con 0x7f88d015b2f0 2024-04-25T10:10:12.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.534+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88d015ae10 con 0x7f88d015b2f0 2024-04-25T10:10:12.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88c7400640 1 -- 172.21.15.18:0/3283192771 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+13398 (secure 0 0 0) 0x7f88c8016520 con 0x7f88d015b2f0 2024-04-25T10:10:12.545 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:12.545 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":85,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:11.179515+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/1522131384":"2024-04-26T10:10:08.168539+0000","172.21.15.18:6832/1522131384":"2024-04-26T10:10:08.168539+0000","172.21.15.18:6835/301895266":"2024-04-26T10:08:48.763167+0000","172.21.15.18:6832/301895266":"2024-04-26T10:08:48.763167+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 msgr2=0x7f88ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 0x7f88ac069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f88c000b9f0 tx=0x7f88c0008040 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 msgr2=0x7f88d0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f88c8019510 tx=0x7f88c80196a0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 shutdown_connections 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88d015b2f0 0x7f88d0159920 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f88ac066f60 0x7f88ac069420 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88d00b2dc0 0x7f88d01573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 --2- 172.21.15.18:0/3283192771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f88d006dad0 0x7f88d0166ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 >> 172.21.15.18:0/3283192771 conn(0x7f88d00b23b0 msgr2=0x7f88d00b1010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 shutdown_connections 2024-04-25T10:10:12.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.538+0000 7f88d5800640 1 -- 172.21.15.18:0/3283192771 wait complete. 2024-04-25T10:10:12.565 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:10:12.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:10:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 Processor -- start 2024-04-25T10:10:12.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 -- start start 2024-04-25T10:10:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbabc155b20 0x7fbabc06fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 0x7fbabc06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbabc15bcf0 con 0x7fbabc06c160 2024-04-25T10:10:12.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc06c5d0 con 0x7fbabc155b20 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbac1200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbabc15c620 con 0x7fbabc0af0d0 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbabc155b20 0x7fbabc06fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbabc155b20 0x7fbabc06fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33934/0 (socket says 172.21.15.18:33934) 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 -- 172.21.15.18:0/3597282414 learned_addr learned my addr 172.21.15.18:0/3597282414 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbab2a00640 1 --2- 172.21.15.18:0/3597282414 >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 0x7fbabc06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 -- 172.21.15.18:0/3597282414 >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 msgr2=0x7fbabc06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 --2- 172.21.15.18:0/3597282414 >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 0x7fbabc06bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 -- 172.21.15.18:0/3597282414 >> v1:172.21.15.167:6789/0 conn(0x7fbabc06c160 legacy=0x7fbabc15f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbabb400640 1 -- 172.21.15.18:0/3597282414 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc15bfd0 con 0x7fbabc155b20 2024-04-25T10:10:12.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.702+0000 7fbab2a00640 1 --2- 172.21.15.18:0/3597282414 >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 0x7fbabc06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbabb400640 1 --2- 172.21.15.18:0/3597282414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc155b20 0x7fbabc06fb10 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0cc800 tx=0x7fbaac01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78de117a13243f7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbabaa00640 1 -- 172.21.15.18:0/3597282414 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0ab600 con 0x7fbabc155b20 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbabaa00640 1 -- 172.21.15.18:0/3597282414 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac0b0070 con 0x7fbabc155b20 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbabaa00640 1 -- 172.21.15.18:0/3597282414 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0ab9c0 con 0x7fbabc155b20 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 -- 172.21.15.18:0/3597282414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc155b20 msgr2=0x7fbabc06fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 --2- 172.21.15.18:0/3597282414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc155b20 0x7fbabc06fb10 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fbabc0cc800 tx=0x7fbaac01c4e0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 -- 172.21.15.18:0/3597282414 shutdown_connections 2024-04-25T10:10:12.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 --2- 172.21.15.18:0/3597282414 >> v2:172.21.15.167:3300/0 conn(0x7fbabc0af0d0 0x7fbabc06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 --2- 172.21.15.18:0/3597282414 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc155b20 0x7fbabc06fb10 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 -- 172.21.15.18:0/3597282414 >> 172.21.15.18:0/3597282414 conn(0x7fbabc071950 msgr2=0x7fbabc071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 -- 172.21.15.18:0/3597282414 shutdown_connections 2024-04-25T10:10:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.706+0000 7fbac1200640 1 -- 172.21.15.18:0/3597282414 wait complete. 2024-04-25T10:10:12.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 Processor -- start 2024-04-25T10:10:12.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- start start 2024-04-25T10:10:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbabc06c160 0x7fbabc14c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbabc155b20 0x7fbabc14da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc070210 con 0x7fbabc0af0d0 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc15cab0 con 0x7fbabc155b20 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbabc155f00 con 0x7fbabc06c160 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33938/0 (socket says 172.21.15.18:33938) 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 -- 172.21.15.18:0/788795985 learned_addr learned my addr 172.21.15.18:0/788795985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbabb400640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbabc06c160 0x7fbabc14c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbabbe00640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbabc155b20 0x7fbabc14da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 -- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbabc06c160 msgr2=0x7fbabc14c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbabc06c160 0x7fbabc14c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 -- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbabc155b20 msgr2=0x7fbabc14da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbabc155b20 0x7fbabc14da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 -- 172.21.15.18:0/788795985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbabc14c740 con 0x7fbabc0af0d0 2024-04-25T10:10:12.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab2a00640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400c7c0 tx=0x7fbaa400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4007a30 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa4007bd0 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40113f0 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbabc14c9c0 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbabc14cf80 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.710+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbabc0745d0 con 0x7fbabc0af0d0 2024-04-25T10:10:12.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.714+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbaa4011590 con 0x7fbabc0af0d0 2024-04-25T10:10:12.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.714+0000 7fbab3e00640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 0x7fba98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:12.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.714+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fbaa4085190 con 0x7fbabc0af0d0 2024-04-25T10:10:12.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.714+0000 7fbabb400640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 0x7fba98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:12.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.714+0000 7fbabb400640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 0x7fba98069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af000 tx=0x7fbaac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:12.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.718+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbabc14c740 con 0x7fbabc0af0d0 2024-04-25T10:10:12.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.878+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbabc15b530 con 0x7fbabc0af0d0 2024-04-25T10:10:12.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.878+0000 7fbab3e00640 1 -- 172.21.15.18:0/788795985 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbaa4015020 con 0x7fbabc0af0d0 2024-04-25T10:10:12.887 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 msgr2=0x7fba98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 0x7fba98069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbaac0af000 tx=0x7fbaac0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 msgr2=0x7fbabc13e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400c7c0 tx=0x7fbaa400cc80 comp rx=0 tx=0).stop 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 shutdown_connections 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbabc155b20 0x7fbabc14da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbabc0af0d0 0x7fbabc13e590 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fba98066f60 0x7fba98069420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 --2- 172.21.15.18:0/788795985 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbabc06c160 0x7fbabc14c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:12.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 >> 172.21.15.18:0/788795985 conn(0x7fbabc071950 msgr2=0x7fbabc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:12.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 shutdown_connections 2024-04-25T10:10:12.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:12.882+0000 7fbac1200640 1 -- 172.21.15.18:0/788795985 wait complete. 2024-04-25T10:10:12.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T10:10:13.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 Processor -- start 2024-04-25T10:10:13.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 -- start start 2024-04-25T10:10:13.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb13c06e980 0x7fb13c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c15b240 con 0x7fb13c0b08a0 2024-04-25T10:10:13.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb13c0ce350 con 0x7fb13c0cee30 2024-04-25T10:10:13.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb144000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb13c0b1e20 con 0x7fb13c06e980 2024-04-25T10:10:13.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb142000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb13c0b08a0 0x7fb13c06d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35186/0 (socket says 172.21.15.18:35186) 2024-04-25T10:10:13.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb142000640 1 -- 172.21.15.18:0/3394321695 learned_addr learned my addr 172.21.15.18:0/3394321695 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513789822 0 0) 0x7fb13c15b240 con 0x7fb13c0b08a0 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb124003530 con 0x7fb13c0b08a0 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb141600640 1 --2- 172.21.15.18:0/3394321695 >> v2:172.21.15.167:3300/0 conn(0x7fb13c06e980 0x7fb13c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1340507997 0 0) 0x7fb124003530 con 0x7fb13c0b08a0 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 >> v2:172.21.15.167:3300/0 conn(0x7fb13c06e980 msgr2=0x7fb13c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 --2- 172.21.15.18:0/3394321695 >> v2:172.21.15.167:3300/0 conn(0x7fb13c06e980 0x7fb13c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 >> v1:172.21.15.167:6789/0 conn(0x7fb13c0cee30 legacy=0x7fb13c0b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c0ce630 con 0x7fb13c0b08a0 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fb134001a00 con 0x7fb13c0b08a0 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 >> v1:172.21.15.18:6789/0 conn(0x7fb13c0b08a0 legacy=0x7fb13c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb124003a10 0x7fb124003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb124004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb124005220 0x7fb12400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0b1e20 con 0x7fb124004810 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12400c170 con 0x7fb124005220 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12400c370 con 0x7fb124003a10 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb124004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb141600640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb124003a10 0x7fb124003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb142000640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb124005220 0x7fb12400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 -- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb124003a10 msgr2=0x7fb124003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb124003a10 0x7fb124003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 -- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb124005220 msgr2=0x7fb12400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb124005220 0x7fb12400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb140c00640 1 -- 172.21.15.18:0/3394321695 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb124003530 con 0x7fb124004810 2024-04-25T10:10:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.042+0000 7fb142000640 1 -- 172.21.15.18:0/3394321695 reap_dead start 2024-04-25T10:10:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb140c00640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb124004c90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb128001750 tx=0x7fb12801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=929e3a23d97f9c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280013a0 con 0x7fb124004810 2024-04-25T10:10:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1280a4e50 con 0x7fb124004810 2024-04-25T10:10:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb13be00640 1 -- 172.21.15.18:0/3394321695 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128003600 con 0x7fb124004810 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 -- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 msgr2=0x7fb124004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb124004c90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb128001750 tx=0x7fb12801c390 comp rx=0 tx=0).stop 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 -- 172.21.15.18:0/3394321695 shutdown_connections 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 --2- 172.21.15.18:0/3394321695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb124004c90 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 -- 172.21.15.18:0/3394321695 >> 172.21.15.18:0/3394321695 conn(0x7fb13c066fa0 msgr2=0x7fb13c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 -- 172.21.15.18:0/3394321695 shutdown_connections 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.046+0000 7fb144000640 1 -- 172.21.15.18:0/3394321695 wait complete. 2024-04-25T10:10:13.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 Processor -- start 2024-04-25T10:10:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- start start 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 0x7fb13c151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 0x7fb13c0b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0ce0f0 con 0x7fb124004810 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0cdf70 con 0x7fb13c0b3e90 2024-04-25T10:10:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13c0b0190 con 0x7fb13c1524f0 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33952/0 (socket says 172.21.15.18:33952) 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 -- 172.21.15.18:0/2016967603 learned_addr learned my addr 172.21.15.18:0/2016967603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb142000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 0x7fb13c0b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb140c00640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 0x7fb13c151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 -- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 msgr2=0x7fb13c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 0x7fb13c0b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 -- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 msgr2=0x7fb13c151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 0x7fb13c151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 -- 172.21.15.18:0/2016967603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb13c152a20 con 0x7fb124004810 2024-04-25T10:10:13.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb142000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 0x7fb13c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb140c00640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 0x7fb13c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb141600640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb130011900 tx=0x7fb130011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb130019070 con 0x7fb124004810 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb130004240 con 0x7fb124004810 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1300095b0 con 0x7fb124004810 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13c152d00 con 0x7fb124004810 2024-04-25T10:10:13.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.050+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13c1532c0 con 0x7fb124004810 2024-04-25T10:10:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.054+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb13c0745d0 con 0x7fb124004810 2024-04-25T10:10:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.054+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb13001c070 con 0x7fb124004810 2024-04-25T10:10:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.054+0000 7fb139600640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 0x7fb11c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.054+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fb1300853f0 con 0x7fb124004810 2024-04-25T10:10:13.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.054+0000 7fb140c00640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 0x7fb11c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:13.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.058+0000 7fb140c00640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 0x7fb11c069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb124004790 tx=0x7fb1280011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:13.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.058+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb130056510 con 0x7fb124004810 2024-04-25T10:10:13.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:13.278+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7fb13c0b14b0 con 0x7fb124004810 2024-04-25T10:10:14.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.198+0000 7fb139600640 1 -- 172.21.15.18:0/2016967603 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v316) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb130055e10 con 0x7fb124004810 2024-04-25T10:10:14.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.198+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 msgr2=0x7fb11c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.198+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 0x7fb11c069420 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb124004790 tx=0x7fb1280011a0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.198+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 msgr2=0x7fb13c13a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.198+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb130011900 tx=0x7fb130011dc0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 shutdown_connections 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb11c066f60 0x7fb11c069420 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb13c1524f0 0x7fb13c0b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb13c0b3e90 0x7fb13c151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 --2- 172.21.15.18:0/2016967603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb124004810 0x7fb13c13a0c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 >> 172.21.15.18:0/2016967603 conn(0x7fb13c066fa0 msgr2=0x7fb13c15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 shutdown_connections 2024-04-25T10:10:14.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.202+0000 7fb144000640 1 -- 172.21.15.18:0/2016967603 wait complete. 2024-04-25T10:10:14.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:10:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 Processor -- start 2024-04-25T10:10:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 -- start start 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde64161580 0x7fde6406c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6415ee50 con 0x7fde64099a60 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde6406ce10 con 0x7fde640cf3e0 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde63200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406d0f0 con 0x7fde64161580 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fde64099a60 0x7fde64099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35194/0 (socket says 172.21.15.18:35194) 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61e00640 1 -- 172.21.15.18:0/36964127 learned_addr learned my addr 172.21.15.18:0/36964127 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61400640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde64161580 0x7fde6406c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371502626 0 0) 0x7fde6415ee50 con 0x7fde64099a60 2024-04-25T10:10:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde48003530 con 0x7fde64099a60 2024-04-25T10:10:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580466635 0 0) 0x7fde6406ce10 con 0x7fde640cf3e0 2024-04-25T10:10:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde6415ee50 con 0x7fde640cf3e0 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3216901856 0 0) 0x7fde48003530 con 0x7fde64099a60 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde64161580 msgr2=0x7fde6406c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde64161580 0x7fde6406c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 >> v1:172.21.15.167:6789/0 conn(0x7fde640cf3e0 legacy=0x7fde640cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6406d3d0 con 0x7fde64099a60 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fde54001680 con 0x7fde64099a60 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 >> v1:172.21.15.18:6789/0 conn(0x7fde64099a60 legacy=0x7fde64099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde48003b80 0x7fde48003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde48004810 0x7fde48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde480051d0 0x7fde4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406d0f0 con 0x7fde480051d0 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4800bff0 con 0x7fde48003b80 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4800c1f0 con 0x7fde48004810 2024-04-25T10:10:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61400640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde64161580 0x7fde6406c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde480051d0 0x7fde4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61e00640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde48003b80 0x7fde48003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde61400640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde48004810 0x7fde48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 -- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde48004810 msgr2=0x7fde48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde48004810 0x7fde48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 -- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde48003b80 msgr2=0x7fde48003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde48003b80 0x7fde48003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.374+0000 7fde62800640 1 -- 172.21.15.18:0/36964127 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48003530 con 0x7fde480051d0 2024-04-25T10:10:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde62800640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde480051d0 0x7fde4800b9d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fde5c001fd0 tx=0x7fde5c01c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0639287f0ea9c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c001c20 con 0x7fde480051d0 2024-04-25T10:10:14.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c003ba0 con 0x7fde480051d0 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde60a00640 1 -- 172.21.15.18:0/36964127 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c005080 con 0x7fde480051d0 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 -- 172.21.15.18:0/36964127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde480051d0 msgr2=0x7fde4800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 --2- 172.21.15.18:0/36964127 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde480051d0 0x7fde4800b9d0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fde5c001fd0 tx=0x7fde5c01c720 comp rx=0 tx=0).stop 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde62800640 1 -- 172.21.15.18:0/36964127 reap_dead start 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 -- 172.21.15.18:0/36964127 shutdown_connections 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 -- 172.21.15.18:0/36964127 >> 172.21.15.18:0/36964127 conn(0x7fde640d15d0 msgr2=0x7fde640d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 -- 172.21.15.18:0/36964127 shutdown_connections 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.378+0000 7fde63200640 1 -- 172.21.15.18:0/36964127 wait complete. 2024-04-25T10:10:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 Processor -- start 2024-04-25T10:10:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- start start 2024-04-25T10:10:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde640ce490 0x7fde6414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde640c6a90 0x7fde640c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406c640 con 0x7fde640ce0b0 2024-04-25T10:10:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406c4c0 con 0x7fde640ce490 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6406c7c0 con 0x7fde640c6a90 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33968/0 (socket says 172.21.15.18:33968) 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 -- 172.21.15.18:0/2934324351 learned_addr learned my addr 172.21.15.18:0/2934324351 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61400640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde640ce490 0x7fde6414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde62800640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde640c6a90 0x7fde640c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 -- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde640c6a90 msgr2=0x7fde640c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde640c6a90 0x7fde640c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 -- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde640ce490 msgr2=0x7fde6414db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde640ce490 0x7fde6414db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 -- 172.21.15.18:0/2934324351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde640c7800 con 0x7fde640ce0b0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde61e00640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fde54012490 tx=0x7fde54012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5401c070 con 0x7fde640ce0b0 2024-04-25T10:10:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54014810 con 0x7fde640ce0b0 2024-04-25T10:10:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde640c7ae0 con 0x7fde640ce0b0 2024-04-25T10:10:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54014c00 con 0x7fde640ce0b0 2024-04-25T10:10:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde640c7430 con 0x7fde640ce0b0 2024-04-25T10:10:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.382+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde640c7ce0 con 0x7fde640ce0b0 2024-04-25T10:10:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.386+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fde5401f070 con 0x7fde640ce0b0 2024-04-25T10:10:14.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.386+0000 7fde5a000640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.386+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fde54087b30 con 0x7fde640ce0b0 2024-04-25T10:10:14.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.386+0000 7fde61400640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.386+0000 7fde61400640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fde641516a0 tx=0x7fde50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.390+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fde54058bc0 con 0x7fde640ce0b0 2024-04-25T10:10:14.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.550+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fde640745d0 con 0x7fde640ce0b0 2024-04-25T10:10:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.554+0000 7fde5a000640 1 -- 172.21.15.18:0/2934324351 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fde540584c0 con 0x7fde640ce0b0 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 msgr2=0x7fde44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 0x7fde44069420 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fde641516a0 tx=0x7fde50008040 comp rx=0 tx=0).stop 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 msgr2=0x7fde6414d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fde54012490 tx=0x7fde54012950 comp rx=0 tx=0).stop 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 shutdown_connections 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fde44066f60 0x7fde44069420 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fde640c6a90 0x7fde640c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde640ce490 0x7fde6414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 --2- 172.21.15.18:0/2934324351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde640ce0b0 0x7fde6414d600 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 >> 172.21.15.18:0/2934324351 conn(0x7fde640d15d0 msgr2=0x7fde64160e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:14.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 shutdown_connections 2024-04-25T10:10:14.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.558+0000 7fde63200640 1 -- 172.21.15.18:0/2934324351 wait complete. 2024-04-25T10:10:14.586 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:10:14.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:10:14.659 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:10:14.719 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:10:14.720 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:14.720 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:14.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:10:14.730 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:10:14.730 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:14.739 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:10:14.739 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:14.739 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:14.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:10:14.780 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:10:14.780 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:14.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:10:14.789 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:10:14.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 Processor -- start 2024-04-25T10:10:14.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 -- start start 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24d015efa0 0x7f24d0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00cdb70 0x7f24d0099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f24d00b04b0 0x7f24d00cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00b3fe0 con 0x7f24d015efa0 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00cd6c0 con 0x7f24d00b04b0 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d5400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00cce20 con 0x7f24d00cdb70 2024-04-25T10:10:14.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24d015efa0 0x7f24d0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24d015efa0 0x7f24d0099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33970/0 (socket says 172.21.15.18:33970) 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 -- 172.21.15.18:0/2548684743 learned_addr learned my addr 172.21.15.18:0/2548684743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24d4a00640 1 --2- 172.21.15.18:0/2548684743 >> v2:172.21.15.167:3300/0 conn(0x7f24d00b04b0 0x7f24d00cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24c7400640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00cdb70 0x7f24d0099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 -- 172.21.15.18:0/2548684743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00cdb70 msgr2=0x7f24d0099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00cdb70 0x7f24d0099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 -- 172.21.15.18:0/2548684743 >> v2:172.21.15.167:3300/0 conn(0x7f24d00b04b0 msgr2=0x7f24d00cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 --2- 172.21.15.18:0/2548684743 >> v2:172.21.15.167:3300/0 conn(0x7f24d00b04b0 0x7f24d00cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.962+0000 7f24cfe00640 1 -- 172.21.15.18:0/2548684743 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00cd100 con 0x7f24d015efa0 2024-04-25T10:10:14.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24cfe00640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d0099a60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f24d009f510 tx=0x7f24c001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2b9cabcbcacf6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24cf400640 1 -- 172.21.15.18:0/2548684743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00b0070 con 0x7f24d015efa0 2024-04-25T10:10:14.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24cf400640 1 -- 172.21.15.18:0/2548684743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c00ab600 con 0x7f24d015efa0 2024-04-25T10:10:14.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24cf400640 1 -- 172.21.15.18:0/2548684743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00ab9d0 con 0x7f24d015efa0 2024-04-25T10:10:14.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 -- 172.21.15.18:0/2548684743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 msgr2=0x7f24d0099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d0099a60 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f24d009f510 tx=0x7f24c001c1d0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 -- 172.21.15.18:0/2548684743 shutdown_connections 2024-04-25T10:10:14.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 --2- 172.21.15.18:0/2548684743 >> v2:172.21.15.167:3300/0 conn(0x7f24d00b04b0 0x7f24d00cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00cdb70 0x7f24d0099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 --2- 172.21.15.18:0/2548684743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d0099a60 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 -- 172.21.15.18:0/2548684743 >> 172.21.15.18:0/2548684743 conn(0x7f24d00b3050 msgr2=0x7f24d00b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 -- 172.21.15.18:0/2548684743 shutdown_connections 2024-04-25T10:10:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.966+0000 7f24d5400640 1 -- 172.21.15.18:0/2548684743 wait complete. 2024-04-25T10:10:14.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 Processor -- start 2024-04-25T10:10:14.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- start start 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00b04b0 0x7f24d00c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d00cdb70 0x7f24d0144690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b11a0 con 0x7f24d015efa0 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b3dc0 con 0x7f24d00cdb70 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b1320 con 0x7f24d00b04b0 2024-04-25T10:10:14.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33972/0 (socket says 172.21.15.18:33972) 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 -- 172.21.15.18:0/4073496909 learned_addr learned my addr 172.21.15.18:0/4073496909 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24cfe00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00b04b0 0x7f24d00c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24c7400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d00cdb70 0x7f24d0144690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 -- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00b04b0 msgr2=0x7f24d00c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00b04b0 0x7f24d00c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 -- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d00cdb70 msgr2=0x7f24d0144690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d00cdb70 0x7f24d0144690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 -- 172.21.15.18:0/4073496909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d0144bd0 con 0x7f24d015efa0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d4a00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f24c800eed0 tx=0x7f24c800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8018020 con 0x7f24d015efa0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c8014400 con 0x7f24d015efa0 2024-04-25T10:10:14.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00b7290 con 0x7f24d015efa0 2024-04-25T10:10:14.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c80147f0 con 0x7f24d015efa0 2024-04-25T10:10:14.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d00b64d0 con 0x7f24d015efa0 2024-04-25T10:10:14.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.970+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d004efa0 con 0x7f24d015efa0 2024-04-25T10:10:14.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.974+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24c801b020 con 0x7f24d015efa0 2024-04-25T10:10:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.974+0000 7f24ccc00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 0x7f24ac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.974+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f24c8085600 con 0x7f24d015efa0 2024-04-25T10:10:14.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.974+0000 7f24cfe00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 0x7f24ac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:14.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.974+0000 7f24cfe00640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 0x7f24ac069450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ad000 tx=0x7f24c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:14.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:14.978+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24c8022070 con 0x7f24d015efa0 2024-04-25T10:10:15.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24d00cc330 con 0x7f24d015efa0 2024-04-25T10:10:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24ccc00640 1 -- 172.21.15.18:0/4073496909 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f24d0144bd0 con 0x7f24d015efa0 2024-04-25T10:10:15.181 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:15.181 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6430,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2740588257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2740588257},{"type":"v1","addr":"172.21.15.167:6836","nonce":2740588257}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6789,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/414057018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":414057018},{"type":"v1","addr":"172.21.15.18:6834","nonce":414057018}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6798,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/592980934","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":592980934},{"type":"v1","addr":"172.21.15.167:6837","nonce":592980934}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":7425,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2532180652","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2532180652},{"type":"v1","addr":"172.21.15.18:6835","nonce":2532180652}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":56}],"filesystems":[]} 2024-04-25T10:10:15.181 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 msgr2=0x7f24ac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 0x7f24ac069450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ad000 tx=0x7f24c0008040 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 msgr2=0x7f24d00ae1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f24c800eed0 tx=0x7f24c800b480 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 shutdown_connections 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24d015efa0 0x7f24d00ae1e0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d00cdb70 0x7f24d0144690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24ac066f90 0x7f24ac069450 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 --2- 172.21.15.18:0/4073496909 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24d00b04b0 0x7f24d00c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 >> 172.21.15.18:0/4073496909 conn(0x7f24d00b3050 msgr2=0x7f24d006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:15.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 shutdown_connections 2024-04-25T10:10:15.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.174+0000 7f24d5400640 1 -- 172.21.15.18:0/4073496909 wait complete. 2024-04-25T10:10:15.203 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:10:15.203 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:10:15.203 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:10:15.203 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:10:15.203 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:10:15.204 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:10:15.204 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:10:15.204 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:10:15.204 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:10:15.204 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:10:15.204 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:10:15.204 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:10:15.205 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:10:15.205 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:10:15.205 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:10:15.205 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:10:15.217 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:10:15.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:10:15.218 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:10:15.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:10:15.219 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:10:15.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:10:15.220 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:10:15.220 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:10:15.263 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:10:15.263 DEBUG:teuthology.parallel:result is None 2024-04-25T10:10:15.264 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:10:15.264 DEBUG:teuthology.parallel:result is None 2024-04-25T10:10:15.270 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:10:15.270 DEBUG:teuthology.parallel:result is None 2024-04-25T10:10:15.272 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:10:15.272 DEBUG:teuthology.parallel:result is None 2024-04-25T10:10:15.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:10:15.351 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:10:15.351 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:10:15.361 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:10:15.361 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:10:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.410+0000 7fe039400640 1 Processor -- start 2024-04-25T10:10:15.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.410+0000 7fe039400640 1 -- start start 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe03415b910 0x7fe0340cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe0340cf3c0 0x7fe0340cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0340cd370 0x7fe034099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340d02a0 con 0x7fe0340cf3c0 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0340cc350 con 0x7fe03415b910 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe039400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0340cc630 con 0x7fe0340cd370 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe0340cf3c0 0x7fe0340cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe0340cf3c0 0x7fe0340cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34010/0 (socket says 172.21.15.18:34010) 2024-04-25T10:10:15.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 -- 172.21.15.18:0/702476121 learned_addr learned my addr 172.21.15.18:0/702476121 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe032800640 1 --2- 172.21.15.18:0/702476121 >> v2:172.21.15.167:3300/0 conn(0x7fe03415b910 0x7fe0340cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe033200640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0340cd370 0x7fe034099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 -- 172.21.15.18:0/702476121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0340cd370 msgr2=0x7fe034099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0340cd370 0x7fe034099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 -- 172.21.15.18:0/702476121 >> v2:172.21.15.167:3300/0 conn(0x7fe03415b910 msgr2=0x7fe0340cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 --2- 172.21.15.18:0/702476121 >> v2:172.21.15.167:3300/0 conn(0x7fe03415b910 0x7fe0340cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 -- 172.21.15.18:0/702476121 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0340cc910 con 0x7fe0340cf3c0 2024-04-25T10:10:15.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031e00640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cf3c0 0x7fe0340cce30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe034072650 tx=0x7fe02001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aa94e94f82ed35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:15.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.414+0000 7fe031400640 1 -- 172.21.15.18:0/702476121 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200ab5f0 con 0x7fe0340cf3c0 2024-04-25T10:10:15.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe031400640 1 -- 172.21.15.18:0/702476121 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0200b0070 con 0x7fe0340cf3c0 2024-04-25T10:10:15.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe031400640 1 -- 172.21.15.18:0/702476121 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0200ab9b0 con 0x7fe0340cf3c0 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- 172.21.15.18:0/702476121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cf3c0 msgr2=0x7fe0340cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cf3c0 0x7fe0340cce30 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fe034072650 tx=0x7fe02001c520 comp rx=0 tx=0).stop 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- 172.21.15.18:0/702476121 shutdown_connections 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe0340cd370 0x7fe034099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- 172.21.15.18:0/702476121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cf3c0 0x7fe0340cce30 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- 172.21.15.18:0/702476121 >> v2:172.21.15.167:3300/0 conn(0x7fe03415b910 0x7fe0340cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- 172.21.15.18:0/702476121 >> 172.21.15.18:0/702476121 conn(0x7fe0340b3200 msgr2=0x7fe0340b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:15.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- 172.21.15.18:0/702476121 shutdown_connections 2024-04-25T10:10:15.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- 172.21.15.18:0/702476121 wait complete. 2024-04-25T10:10:15.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 Processor -- start 2024-04-25T10:10:15.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- start start 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0340cf3c0 0x7fe0341657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe03415b910 0x7fe034156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03415f660 con 0x7fe0340cd370 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03409a3b0 con 0x7fe0340cf3c0 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe039400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03415f7e0 con 0x7fe03415b910 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34016/0 (socket says 172.21.15.18:34016) 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 -- 172.21.15.18:0/1437419317 learned_addr learned my addr 172.21.15.18:0/1437419317 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe031e00640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0340cf3c0 0x7fe0341657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe033200640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe03415b910 0x7fe034156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 -- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe03415b910 msgr2=0x7fe034156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe03415b910 0x7fe034156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 -- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0340cf3c0 msgr2=0x7fe0341657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0340cf3c0 0x7fe0341657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.418+0000 7fe032800640 1 -- 172.21.15.18:0/1437419317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034157490 con 0x7fe0340cd370 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe032800640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e870 tx=0x7fe02400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024017070 con 0x7fe0340cd370 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02400c940 con 0x7fe0340cd370 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe034163f10 con 0x7fe0340cd370 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400ccf0 con 0x7fe0340cd370 2024-04-25T10:10:15.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0341644d0 con 0x7fe0340cd370 2024-04-25T10:10:15.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0340745d0 con 0x7fe0340cd370 2024-04-25T10:10:15.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe02401a070 con 0x7fe0340cd370 2024-04-25T10:10:15.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 0x7fe014069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:15.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fe024084d50 con 0x7fe0340cd370 2024-04-25T10:10:15.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.422+0000 7fe031e00640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 0x7fe014069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:15.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.426+0000 7fe031e00640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 0x7fe014069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe0200af000 tx=0x7fe0200a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:15.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.430+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe024055e70 con 0x7fe0340cd370 2024-04-25T10:10:15.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:15.602+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe0340cdcd0 con 0x7fe0340cd370 2024-04-25T10:10:16.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.214+0000 7fe02aa00640 1 -- 172.21.15.18:0/1437419317 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe024055770 con 0x7fe0340cd370 2024-04-25T10:10:16.222 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 msgr2=0x7fe014069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 0x7fe014069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe0200af000 tx=0x7fe0200a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 msgr2=0x7fe034164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe02400e870 tx=0x7fe02400ec70 comp rx=0 tx=0).stop 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 shutdown_connections 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe014066f60 0x7fe014069420 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe03415b910 0x7fe034156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0340cf3c0 0x7fe0341657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 --2- 172.21.15.18:0/1437419317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0340cd370 0x7fe034164fb0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 >> 172.21.15.18:0/1437419317 conn(0x7fe0340b3200 msgr2=0x7fe0340c6740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 shutdown_connections 2024-04-25T10:10:16.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.218+0000 7fe039400640 1 -- 172.21.15.18:0/1437419317 wait complete. 2024-04-25T10:10:16.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:10:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 Processor -- start 2024-04-25T10:10:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 -- start start 2024-04-25T10:10:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 0x7f7acc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc0cc4e0 con 0x7f7acc0b1e60 2024-04-25T10:10:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc0ce040 con 0x7f7acc0cd4d0 2024-04-25T10:10:16.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ad1000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc145650 con 0x7f7acc145270 2024-04-25T10:10:16.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7aca800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7acc0b1e60 0x7f7acc15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35210/0 (socket says 172.21.15.18:35210) 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7aca800640 1 -- 172.21.15.18:0/3454807756 learned_addr learned my addr 172.21.15.18:0/3454807756 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.382+0000 7f7ac9e00640 1 --2- 172.21.15.18:0/3454807756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 0x7f7acc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2720377119 0 0) 0x7f7acc0cc4e0 con 0x7f7acc0b1e60 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab0003530 con 0x7f7acc0b1e60 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239086672 0 0) 0x7f7acc0ce040 con 0x7f7acc0cd4d0 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7acc0cc4e0 con 0x7f7acc0cd4d0 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9e00640 1 -- 172.21.15.18:0/3454807756 >> v1:172.21.15.167:6789/0 conn(0x7f7acc0cd4d0 legacy=0x7f7acc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9e00640 1 -- 172.21.15.18:0/3454807756 >> v1:172.21.15.18:6789/0 conn(0x7f7acc0b1e60 legacy=0x7f7acc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9e00640 1 -- 172.21.15.18:0/3454807756 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0ce320 con 0x7f7acc145270 2024-04-25T10:10:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9e00640 1 --2- 172.21.15.18:0/3454807756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 0x7f7acc15fe50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097f0 tx=0x7f7abc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f5135cf5c1e2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0aa610 con 0x7f7acc145270 2024-04-25T10:10:16.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc0af070 con 0x7f7acc145270 2024-04-25T10:10:16.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.386+0000 7f7ac9400640 1 -- 172.21.15.18:0/3454807756 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc0aa9d0 con 0x7f7acc145270 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- 172.21.15.18:0/3454807756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 msgr2=0x7f7acc15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 --2- 172.21.15.18:0/3454807756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 0x7f7acc15fe50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0097f0 tx=0x7f7abc01c4b0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- 172.21.15.18:0/3454807756 shutdown_connections 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 --2- 172.21.15.18:0/3454807756 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc145270 0x7f7acc15fe50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- 172.21.15.18:0/3454807756 >> 172.21.15.18:0/3454807756 conn(0x7f7acc066fa0 msgr2=0x7f7acc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- 172.21.15.18:0/3454807756 shutdown_connections 2024-04-25T10:10:16.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- 172.21.15.18:0/3454807756 wait complete. 2024-04-25T10:10:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 Processor -- start 2024-04-25T10:10:16.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- start start 2024-04-25T10:10:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc0b1e60 0x7f7acc15b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc0cd4d0 0x7f7acc144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc169720 con 0x7f7acc145270 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0cdcc0 con 0x7f7acc0cd4d0 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ad1000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc1698a0 con 0x7f7acc0b1e60 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34028/0 (socket says 172.21.15.18:34028) 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 -- 172.21.15.18:0/33941468 learned_addr learned my addr 172.21.15.18:0/33941468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ac9e00640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc0b1e60 0x7f7acc15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7ac3e00640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc0cd4d0 0x7f7acc144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 -- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc0b1e60 msgr2=0x7f7acc15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc0b1e60 0x7f7acc15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 -- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc0cd4d0 msgr2=0x7f7acc144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc0cd4d0 0x7f7acc144420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.390+0000 7f7aca800640 1 -- 172.21.15.18:0/33941468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc15b740 con 0x7f7acc145270 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7aca800640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400cb70 tx=0x7f7ac400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4017070 con 0x7f7acc145270 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400ace0 con 0x7f7acc145270 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4012620 con 0x7f7acc145270 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc1f5e80 con 0x7f7acc145270 2024-04-25T10:10:16.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc0ad9b0 con 0x7f7acc145270 2024-04-25T10:10:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc0745d0 con 0x7f7acc145270 2024-04-25T10:10:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ac401a070 con 0x7f7acc145270 2024-04-25T10:10:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 0x7f7aa8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7ac4084c10 con 0x7f7acc145270 2024-04-25T10:10:16.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.394+0000 7f7ac9e00640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 0x7f7aa8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.398+0000 7f7ac9e00640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 0x7f7aa8069450 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0ae000 tx=0x7f7abc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.398+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7acc1f5e80 con 0x7f7acc145270 2024-04-25T10:10:16.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7acc06b8e0 con 0x7f7acc145270 2024-04-25T10:10:16.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ac2000640 1 -- 172.21.15.18:0/33941468 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7ac40556f0 con 0x7f7acc145270 2024-04-25T10:10:16.625 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:16.625 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:10:16.627 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:10:16.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.630 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:10:16.632 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.634 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.635 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:10:16.636 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:10:16.637 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:10:16.638 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:10:16.639 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 msgr2=0x7f7aa8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 0x7f7aa8069450 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0ae000 tx=0x7f7abc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 msgr2=0x7f7acc0cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400cb70 tx=0x7f7ac400a430 comp rx=0 tx=0).stop 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 shutdown_connections 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc145270 0x7f7acc0cb8d0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc0cd4d0 0x7f7acc144420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aa8066f90 0x7f7aa8069450 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 --2- 172.21.15.18:0/33941468 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc0b1e60 0x7f7acc15b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 >> 172.21.15.18:0/33941468 conn(0x7f7acc066fa0 msgr2=0x7f7acc15bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 shutdown_connections 2024-04-25T10:10:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.618+0000 7f7ad1000640 1 -- 172.21.15.18:0/33941468 wait complete. 2024-04-25T10:10:16.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:16.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.778+0000 7fab9be00640 1 Processor -- start 2024-04-25T10:10:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.778+0000 7fab9be00640 1 -- start start 2024-04-25T10:10:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 0x7fab940b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab9be00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fab940b1c90 0x7fab9415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab9be00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab940cc4e0 con 0x7fab94145270 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab9be00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab940b20e0 con 0x7fab940b1c90 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab9be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab94145650 con 0x7fab9415fe50 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab99400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fab94145270 0x7fab940cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35212/0 (socket says 172.21.15.18:35212) 2024-04-25T10:10:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab99400640 1 -- 172.21.15.18:0/3510691373 learned_addr learned my addr 172.21.15.18:0/3510691373 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab98a00640 1 --2- 172.21.15.18:0/3510691373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 0x7fab940b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab99e00640 1 --2- 172.21.15.18:0/3510691373 >> v2:172.21.15.167:3300/0 conn(0x7fab940b1c90 0x7fab9415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619307072 0 0) 0x7fab940cc4e0 con 0x7fab94145270 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab7c003530 con 0x7fab94145270 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305292610 0 0) 0x7fab7c003530 con 0x7fab94145270 2024-04-25T10:10:16.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab98a00640 1 -- 172.21.15.18:0/3510691373 >> v2:172.21.15.167:3300/0 conn(0x7fab940b1c90 msgr2=0x7fab9415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab98a00640 1 --2- 172.21.15.18:0/3510691373 >> v2:172.21.15.167:3300/0 conn(0x7fab940b1c90 0x7fab9415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab98a00640 1 -- 172.21.15.18:0/3510691373 >> v1:172.21.15.18:6789/0 conn(0x7fab94145270 legacy=0x7fab940cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.782+0000 7fab98a00640 1 -- 172.21.15.18:0/3510691373 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab940ce040 con 0x7fab9415fe50 2024-04-25T10:10:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab98a00640 1 --2- 172.21.15.18:0/3510691373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 0x7fab940b1750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fab800097c0 tx=0x7fab8001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95fe4943fb015f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800b0070 con 0x7fab9415fe50 2024-04-25T10:10:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800ab400 con 0x7fab9415fe50 2024-04-25T10:10:16.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab93e00640 1 -- 172.21.15.18:0/3510691373 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88001680 con 0x7fab9415fe50 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- 172.21.15.18:0/3510691373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 msgr2=0x7fab940b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- 172.21.15.18:0/3510691373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 0x7fab940b1750 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fab800097c0 tx=0x7fab8001c3c0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- 172.21.15.18:0/3510691373 shutdown_connections 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- 172.21.15.18:0/3510691373 >> v2:172.21.15.167:3300/0 conn(0x7fab940b1c90 0x7fab9415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- 172.21.15.18:0/3510691373 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab9415fe50 0x7fab940b1750 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- 172.21.15.18:0/3510691373 >> 172.21.15.18:0/3510691373 conn(0x7fab94066fa0 msgr2=0x7fab9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- 172.21.15.18:0/3510691373 shutdown_connections 2024-04-25T10:10:16.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- 172.21.15.18:0/3510691373 wait complete. 2024-04-25T10:10:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 Processor -- start 2024-04-25T10:10:16.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- start start 2024-04-25T10:10:16.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab940b1c90 0x7fab94141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab9415fe50 0x7fab9414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab940cdbe0 con 0x7fab94145270 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9415f930 con 0x7fab9415fe50 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.786+0000 7fab9be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab940cdd60 con 0x7fab940b1c90 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34030/0 (socket says 172.21.15.18:34030) 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 -- 172.21.15.18:0/1575718965 learned_addr learned my addr 172.21.15.18:0/1575718965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab99e00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab9415fe50 0x7fab9414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab99400640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab940b1c90 0x7fab94141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 -- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab940b1c90 msgr2=0x7fab94141ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab940b1c90 0x7fab94141ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 -- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab9415fe50 msgr2=0x7fab9414bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab9415fe50 0x7fab9414bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 -- 172.21.15.18:0/1575718965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94143030 con 0x7fab94145270 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab98a00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fab800ae040 tx=0x7fab8001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800b0050 con 0x7fab94145270 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800bc070 con 0x7fab94145270 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800b7890 con 0x7fab94145270 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab94141be0 con 0x7fab94145270 2024-04-25T10:10:16.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab941f8740 con 0x7fab94145270 2024-04-25T10:10:16.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab940745d0 con 0x7fab94145270 2024-04-25T10:10:16.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab800b7a30 con 0x7fab94145270 2024-04-25T10:10:16.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 0x7fab74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:16.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.790+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fab8011f5b0 con 0x7fab94145270 2024-04-25T10:10:16.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.794+0000 7fab99400640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 0x7fab74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:16.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.794+0000 7fab99400640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 0x7fab74069420 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fab88000fc0 tx=0x7fab88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.794+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab94141be0 con 0x7fab94145270 2024-04-25T10:10:16.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.958+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab940b4060 con 0x7fab94145270 2024-04-25T10:10:16.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.958+0000 7fab91600640 1 -- 172.21.15.18:0/1575718965 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+13141 (secure 0 0 0) 0x7fab80015fb0 con 0x7fab94145270 2024-04-25T10:10:16.966 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:16.966 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:16.229344+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 msgr2=0x7fab74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 0x7fab74069420 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fab88000fc0 tx=0x7fab88009040 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 msgr2=0x7fab9413edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fab800ae040 tx=0x7fab8001ac00 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 shutdown_connections 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab9415fe50 0x7fab9414bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab94145270 0x7fab9413edc0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab74066f60 0x7fab74069420 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 --2- 172.21.15.18:0/1575718965 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab940b1c90 0x7fab94141ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 >> 172.21.15.18:0/1575718965 conn(0x7fab94066fa0 msgr2=0x7fab9415e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 shutdown_connections 2024-04-25T10:10:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:16.962+0000 7fab9be00640 1 -- 172.21.15.18:0/1575718965 wait complete. 2024-04-25T10:10:16.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:10:16.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:10:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 Processor -- start 2024-04-25T10:10:17.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 -- start start 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6dd4161cf0 0x7f6dd40d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd406e5f0 con 0x7f6dd406e0f0 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd406e8d0 con 0x7f6dd40b4810 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd9600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd406ebb0 con 0x7f6dd4161cf0 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6dd4161cf0 0x7f6dd40d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6dd4161cf0 0x7f6dd40d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34046/0 (socket says 172.21.15.18:34046) 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd3400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6dd406e0f0 0x7f6dd40b2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35222/0 (socket says 172.21.15.18:35222) 2024-04-25T10:10:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 -- 172.21.15.18:0/2148813012 learned_addr learned my addr 172.21.15.18:0/2148813012 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 -- 172.21.15.18:0/2148813012 >> v1:172.21.15.167:6789/0 conn(0x7f6dd40b4810 legacy=0x7f6dd41615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 -- 172.21.15.18:0/2148813012 >> v1:172.21.15.18:6789/0 conn(0x7f6dd406e0f0 legacy=0x7f6dd40b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dca000640 1 -- 172.21.15.18:0/2148813012 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd406ee90 con 0x7f6dd4161cf0 2024-04-25T10:10:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.126+0000 7f6dd2000640 1 -- 172.21.15.18:0/2148813012 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366066093 0 0) 0x7f6dd406e5f0 con 0x7f6dd406e0f0 2024-04-25T10:10:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dca000640 1 --2- 172.21.15.18:0/2148813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd4161cf0 0x7f6dd40d04e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25b505ba8842c163 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd2000640 1 -- 172.21.15.18:0/2148813012 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0b0070 con 0x7f6dd4161cf0 2024-04-25T10:10:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd2000640 1 -- 172.21.15.18:0/2148813012 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc0ab600 con 0x7f6dd4161cf0 2024-04-25T10:10:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd2000640 1 -- 172.21.15.18:0/2148813012 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0ab9d0 con 0x7f6dd4161cf0 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- 172.21.15.18:0/2148813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd4161cf0 msgr2=0x7f6dd40d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 --2- 172.21.15.18:0/2148813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd4161cf0 0x7f6dd40d04e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- 172.21.15.18:0/2148813012 shutdown_connections 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 --2- 172.21.15.18:0/2148813012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd4161cf0 0x7f6dd40d04e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- 172.21.15.18:0/2148813012 >> 172.21.15.18:0/2148813012 conn(0x7f6dd40cf9c0 msgr2=0x7f6dd40cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- 172.21.15.18:0/2148813012 shutdown_connections 2024-04-25T10:10:17.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- 172.21.15.18:0/2148813012 wait complete. 2024-04-25T10:10:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 Processor -- start 2024-04-25T10:10:17.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.130+0000 7f6dd9600640 1 -- start start 2024-04-25T10:10:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dd406e0f0 0x7f6dd41f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dd4161cf0 0x7f6dd415fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b3ff0 con 0x7f6dd40b4810 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40b3e70 con 0x7f6dd406e0f0 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd416b990 con 0x7f6dd4161cf0 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34054/0 (socket says 172.21.15.18:34054) 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 -- 172.21.15.18:0/3630676076 learned_addr learned my addr 172.21.15.18:0/3630676076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd2a00640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dd406e0f0 0x7f6dd41f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd3400640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dd4161cf0 0x7f6dd415fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 -- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dd4161cf0 msgr2=0x7f6dd415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dd4161cf0 0x7f6dd415fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 -- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dd406e0f0 msgr2=0x7f6dd41f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dd406e0f0 0x7f6dd41f6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 -- 172.21.15.18:0/3630676076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd41517f0 con 0x7f6dd40b4810 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dca000640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0ba070 con 0x7f6dd40b4810 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dbc004020 con 0x7f6dd40b4810 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd4151ad0 con 0x7f6dd40b4810 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dbc0b0040 con 0x7f6dd40b4810 2024-04-25T10:10:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4152090 con 0x7f6dd40b4810 2024-04-25T10:10:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.134+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd40745d0 con 0x7f6dd40b4810 2024-04-25T10:10:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.138+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6dbc003620 con 0x7f6dd40b4810 2024-04-25T10:10:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.138+0000 7f6dcb400640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 0x7f6db0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.138+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f6dbc11f1b0 con 0x7f6dd40b4810 2024-04-25T10:10:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.138+0000 7f6dd2a00640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 0x7f6db0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.138+0000 7f6dd2a00640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 0x7f6db0069420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000f70 tx=0x7f6dc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.142+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6dbc016150 con 0x7f6dd40b4810 2024-04-25T10:10:17.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.306+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dd4169760 con 0x7f6dd40b4810 2024-04-25T10:10:17.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.306+0000 7f6dcb400640 1 -- 172.21.15.18:0/3630676076 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dbc0f0420 con 0x7f6dd40b4810 2024-04-25T10:10:17.316 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:10:17.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 msgr2=0x7f6db0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 0x7f6db0069420 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4000f70 tx=0x7f6dc4009040 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 msgr2=0x7f6dd40cec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc009870 tx=0x7f6dbc01ad10 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 shutdown_connections 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6db0066f60 0x7f6db0069420 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6dd4161cf0 0x7f6dd415fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6dd40b4810 0x7f6dd40cec00 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 --2- 172.21.15.18:0/3630676076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6dd406e0f0 0x7f6dd41f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 >> 172.21.15.18:0/3630676076 conn(0x7f6dd40cf9c0 msgr2=0x7f6dd4161230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 shutdown_connections 2024-04-25T10:10:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.310+0000 7f6dd9600640 1 -- 172.21.15.18:0/3630676076 wait complete. 2024-04-25T10:10:17.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:10:17.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.470+0000 7f0b0e800640 1 Processor -- start 2024-04-25T10:10:17.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.470+0000 7f0b0e800640 1 -- start start 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.470+0000 7f0b0e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b08145270 0x7f0b0815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b0e800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080cc4e0 con 0x7f0b080cd4d0 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b0e800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b080ce040 con 0x7f0b080b1e60 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b0e800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b08145650 con 0x7f0b08145270 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b07400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b08145270 0x7f0b0815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0afea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b080cd4d0 0x7f0b080b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35226/0 (socket says 172.21.15.18:35226) 2024-04-25T10:10:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0afea00640 1 -- 172.21.15.18:0/2057478291 learned_addr learned my addr 172.21.15.18:0/2057478291 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b07400640 1 -- 172.21.15.18:0/2057478291 >> v1:172.21.15.167:6789/0 conn(0x7f0b080b1e60 legacy=0x7f0b0815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b07400640 1 -- 172.21.15.18:0/2057478291 >> v1:172.21.15.18:6789/0 conn(0x7f0b080cd4d0 legacy=0x7f0b080b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b07400640 1 -- 172.21.15.18:0/2057478291 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b080ce320 con 0x7f0b08145270 2024-04-25T10:10:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b06a00640 1 -- 172.21.15.18:0/2057478291 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873039773 0 0) 0x7f0b080cc4e0 con 0x7f0b080cd4d0 2024-04-25T10:10:17.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b07400640 1 --2- 172.21.15.18:0/2057478291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b08145270 0x7f0b0815fe50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097c0 tx=0x7f0af001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b63f471112feeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b06a00640 1 -- 172.21.15.18:0/2057478291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00ab430 con 0x7f0b08145270 2024-04-25T10:10:17.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b06a00640 1 -- 172.21.15.18:0/2057478291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00b0070 con 0x7f0b08145270 2024-04-25T10:10:17.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.474+0000 7f0b06a00640 1 -- 172.21.15.18:0/2057478291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00ab7f0 con 0x7f0b08145270 2024-04-25T10:10:17.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- 172.21.15.18:0/2057478291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b08145270 msgr2=0x7f0b0815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 --2- 172.21.15.18:0/2057478291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b08145270 0x7f0b0815fe50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097c0 tx=0x7f0af001c430 comp rx=0 tx=0).stop 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- 172.21.15.18:0/2057478291 shutdown_connections 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 --2- 172.21.15.18:0/2057478291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b08145270 0x7f0b0815fe50 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- 172.21.15.18:0/2057478291 >> 172.21.15.18:0/2057478291 conn(0x7f0b08066fa0 msgr2=0x7f0b0806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- 172.21.15.18:0/2057478291 shutdown_connections 2024-04-25T10:10:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- 172.21.15.18:0/2057478291 wait complete. 2024-04-25T10:10:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 Processor -- start 2024-04-25T10:10:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- start start 2024-04-25T10:10:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 0x7f0b0814a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 0x7f0b0813c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08169720 con 0x7f0b080b1e60 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b080cdd00 con 0x7f0b080cd4d0 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b0e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b081698a0 con 0x7f0b08145270 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34064/0 (socket says 172.21.15.18:34064) 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 -- 172.21.15.18:0/3631618356 learned_addr learned my addr 172.21.15.18:0/3631618356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0afea00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 0x7f0b0814a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 -- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 msgr2=0x7f0b0813c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07e00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 0x7f0b0813c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 0x7f0b0813c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 -- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 msgr2=0x7f0b0814a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 0x7f0b0814a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07400640 1 -- 172.21.15.18:0/3631618356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08140330 con 0x7f0b080b1e60 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0afea00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 0x7f0b0814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.478+0000 7f0b07e00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 0x7f0b0813c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0b07400640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f0af0019040 tx=0x7f0af001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00bf610 con 0x7f0b080b1e60 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00bf7d0 con 0x7f0b080b1e60 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0813dd80 con 0x7f0b080b1e60 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00bfbc0 con 0x7f0b080b1e60 2024-04-25T10:10:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b08140610 con 0x7f0b080b1e60 2024-04-25T10:10:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b080745d0 con 0x7f0b080b1e60 2024-04-25T10:10:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0af00bd020 con 0x7f0b080b1e60 2024-04-25T10:10:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 0x7f0ae4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0af00a8030 con 0x7f0b080b1e60 2024-04-25T10:10:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.482+0000 7f0afea00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 0x7f0ae4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.486+0000 7f0afea00640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 0x7f0ae4069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b081436b0 tx=0x7f0af8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.486+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0af00c4060 con 0x7f0b080b1e60 2024-04-25T10:10:17.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0b0806b8e0 con 0x7f0b080b1e60 2024-04-25T10:10:17.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0affe00640 1 -- 172.21.15.18:0/3631618356 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v89) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0af0016050 con 0x7f0b080b1e60 2024-04-25T10:10:17.665 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:17.665 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:10:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:10:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:10:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:10:17.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:17.666 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 msgr2=0x7f0ae4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 0x7f0ae4069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f0b081436b0 tx=0x7f0af8009040 comp rx=0 tx=0).stop 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 msgr2=0x7f0b0814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f0af0019040 tx=0x7f0af001ac70 comp rx=0 tx=0).stop 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 shutdown_connections 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ae4066f60 0x7f0ae4069420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b08145270 0x7f0b0813c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b080cd4d0 0x7f0b0814a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 --2- 172.21.15.18:0/3631618356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b080b1e60 0x7f0b0814d610 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 >> 172.21.15.18:0/3631618356 conn(0x7f0b08066fa0 msgr2=0x7f0b08144420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:17.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 shutdown_connections 2024-04-25T10:10:17.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.658+0000 7f0b0e800640 1 -- 172.21.15.18:0/3631618356 wait complete. 2024-04-25T10:10:17.687 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:10:17.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:10:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 Processor -- start 2024-04-25T10:10:17.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 -- start start 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c815dd00 0x7f12c80af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12c80ce1c0 0x7f12c80c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c80c6dc0 con 0x7f12c80c5ed0 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c80d0430 con 0x7f12c80ce1c0 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12d0600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c80c70a0 con 0x7f12c815dd00 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12c80ce1c0 0x7f12c80c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12ce600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f12c80c5ed0 0x7f12c806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35234/0 (socket says 172.21.15.18:35234) 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12ce600640 1 -- 172.21.15.18:0/1625316982 learned_addr learned my addr 172.21.15.18:0/1625316982 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cdc00640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c815dd00 0x7f12c80af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cd200640 1 -- 172.21.15.18:0/1625316982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c815dd00 msgr2=0x7f12c80af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cd200640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c815dd00 0x7f12c80af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cd200640 1 -- 172.21.15.18:0/1625316982 >> v1:172.21.15.18:6789/0 conn(0x7f12c80c5ed0 legacy=0x7f12c806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12cd200640 1 -- 172.21.15.18:0/1625316982 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c80c7380 con 0x7f12c80ce1c0 2024-04-25T10:10:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.826+0000 7f12c7e00640 1 -- 172.21.15.18:0/1625316982 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765265545 0 0) 0x7f12c80c6dc0 con 0x7f12c80c5ed0 2024-04-25T10:10:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12cd200640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c80ce1c0 0x7f12c80c5990 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097c0 tx=0x7f12b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1cdacd2451360d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12c7e00640 1 -- 172.21.15.18:0/1625316982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40b1070 con 0x7f12c80ce1c0 2024-04-25T10:10:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12c7e00640 1 -- 172.21.15.18:0/1625316982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b40ac410 con 0x7f12c80ce1c0 2024-04-25T10:10:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12c7e00640 1 -- 172.21.15.18:0/1625316982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b40ac7e0 con 0x7f12c80ce1c0 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 -- 172.21.15.18:0/1625316982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c80ce1c0 msgr2=0x7f12c80c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c80ce1c0 0x7f12c80c5990 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f12b40097c0 tx=0x7f12b401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 -- 172.21.15.18:0/1625316982 shutdown_connections 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c80ce1c0 0x7f12c80c5990 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 --2- 172.21.15.18:0/1625316982 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c815dd00 0x7f12c80af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 -- 172.21.15.18:0/1625316982 >> 172.21.15.18:0/1625316982 conn(0x7f12c80b2240 msgr2=0x7f12c80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 -- 172.21.15.18:0/1625316982 shutdown_connections 2024-04-25T10:10:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.830+0000 7f12d0600640 1 -- 172.21.15.18:0/1625316982 wait complete. 2024-04-25T10:10:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 Processor -- start 2024-04-25T10:10:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- start start 2024-04-25T10:10:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 0x7f12c80b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 0x7f12c809b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c816aa80 con 0x7f12c809ca30 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c816a900 con 0x7f12c80c5ed0 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c816ac00 con 0x7f12c80ce1c0 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34084/0 (socket says 172.21.15.18:34084) 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 -- 172.21.15.18:0/3358517897 learned_addr learned my addr 172.21.15.18:0/3358517897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12cdc00640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 0x7f12c80b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12cd200640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 0x7f12c809b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 -- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 msgr2=0x7f12c809b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 0x7f12c809b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 -- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 msgr2=0x7f12c80b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 0x7f12c80b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 -- 172.21.15.18:0/3358517897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c809bd80 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12cdc00640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 0x7f12c80b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12cd200640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 0x7f12c809b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12ce600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f12c000c7a0 tx=0x7f12c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c0018070 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c000a640 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c000aab0 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c80b42f0 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c80b48b0 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.834+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c80745d0 con 0x7f12c809ca30 2024-04-25T10:10:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.838+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f12c001b070 con 0x7f12c809ca30 2024-04-25T10:10:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.838+0000 7f12c5600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 0x7f12a8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.838+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f12c0084800 con 0x7f12c809ca30 2024-04-25T10:10:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.838+0000 7f12cdc00640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 0x7f12a8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.838+0000 7f12cdc00640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 0x7f12a8069450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0097a0 tx=0x7f12bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:17.842+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f12c00559b0 con 0x7f12c809ca30 2024-04-25T10:10:18.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.002+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f12c80adc80 con 0x7f12c809ca30 2024-04-25T10:10:18.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12c5600640 1 -- 172.21.15.18:0/3358517897 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v90) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12c00552b0 con 0x7f12c809ca30 2024-04-25T10:10:18.226 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 msgr2=0x7f12a8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 0x7f12a8069450 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f12bc0097a0 tx=0x7f12bc008040 comp rx=0 tx=0).stop 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 msgr2=0x7f12c81f9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f12c000c7a0 tx=0x7f12c000cc60 comp rx=0 tx=0).stop 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 shutdown_connections 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c809ca30 0x7f12c81f9f90 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a8066f90 0x7f12a8069450 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c80ce1c0 0x7f12c809b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 --2- 172.21.15.18:0/3358517897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c80c5ed0 0x7f12c80b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 >> 172.21.15.18:0/3358517897 conn(0x7f12c80b2240 msgr2=0x7f12c80ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:18.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.218+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 shutdown_connections 2024-04-25T10:10:18.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.222+0000 7f12d0600640 1 -- 172.21.15.18:0/3358517897 wait complete. 2024-04-25T10:10:18.252 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:10:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.390+0000 7f7cf3e00640 1 Processor -- start 2024-04-25T10:10:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.390+0000 7f7cf3e00640 1 -- start start 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7cf40cd670 0x7f7cf409a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7cf406d7b0 0x7f7cf40cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf4161830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40cda50 con 0x7f7cf406d7b0 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf409ae90 con 0x7f7cf40cd670 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406c710 con 0x7f7cf40d0070 2024-04-25T10:10:18.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7cf406d7b0 0x7f7cf40cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7cf406d7b0 0x7f7cf40cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34096/0 (socket says 172.21.15.18:34096) 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 -- 172.21.15.18:0/774197398 learned_addr learned my addr 172.21.15.18:0/774197398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf3400640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf4161830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cf2a00640 1 --2- 172.21.15.18:0/774197398 >> v2:172.21.15.167:3300/0 conn(0x7f7cf40cd670 0x7f7cf409a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 -- 172.21.15.18:0/774197398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 msgr2=0x7f7cf4161830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf4161830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 -- 172.21.15.18:0/774197398 >> v2:172.21.15.167:3300/0 conn(0x7f7cf40cd670 msgr2=0x7f7cf409a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 --2- 172.21.15.18:0/774197398 >> v2:172.21.15.167:3300/0 conn(0x7f7cf40cd670 0x7f7cf409a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.394+0000 7f7cea000640 1 -- 172.21.15.18:0/774197398 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf406c9f0 con 0x7f7cf406d7b0 2024-04-25T10:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cea000640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf40cfb30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4067980 tx=0x7f7cdc01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29b4e3319ec7ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf2000640 1 -- 172.21.15.18:0/774197398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0b0070 con 0x7f7cf406d7b0 2024-04-25T10:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf2000640 1 -- 172.21.15.18:0/774197398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc0ab600 con 0x7f7cf406d7b0 2024-04-25T10:10:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf2000640 1 -- 172.21.15.18:0/774197398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0ab9d0 con 0x7f7cf406d7b0 2024-04-25T10:10:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- 172.21.15.18:0/774197398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 msgr2=0x7f7cf40cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf40cfb30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4067980 tx=0x7f7cdc01c260 comp rx=0 tx=0).stop 2024-04-25T10:10:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- 172.21.15.18:0/774197398 shutdown_connections 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf4161830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/774197398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf40cfb30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/774197398 >> v2:172.21.15.167:3300/0 conn(0x7f7cf40cd670 0x7f7cf409a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- 172.21.15.18:0/774197398 >> 172.21.15.18:0/774197398 conn(0x7f7cf40d1540 msgr2=0x7f7cf40d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- 172.21.15.18:0/774197398 shutdown_connections 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- 172.21.15.18:0/774197398 wait complete. 2024-04-25T10:10:18.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 Processor -- start 2024-04-25T10:10:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- start start 2024-04-25T10:10:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cf40cd670 0x7f7cf415fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf40b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40d2390 con 0x7f7cf406d7b0 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40d2210 con 0x7f7cf40cd670 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf3e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406c2e0 con 0x7f7cf40d0070 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.398+0000 7f7cf2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34104/0 (socket says 172.21.15.18:34104) 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 -- 172.21.15.18:0/1198077862 learned_addr learned my addr 172.21.15.18:0/1198077862 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cea000640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cf40cd670 0x7f7cf415fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf3400640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf40b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 -- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 msgr2=0x7f7cf40b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf40b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 -- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cf40cd670 msgr2=0x7f7cf415fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cf40cd670 0x7f7cf415fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 -- 172.21.15.18:0/1198077862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4159da0 con 0x7f7cf406d7b0 2024-04-25T10:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf2a00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d800 tx=0x7f7ce400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4018020 con 0x7f7cf406d7b0 2024-04-25T10:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce40096a0 con 0x7f7cf406d7b0 2024-04-25T10:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4009a50 con 0x7f7cf406d7b0 2024-04-25T10:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf415a080 con 0x7f7cf406d7b0 2024-04-25T10:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf415a640 con 0x7f7cf406d7b0 2024-04-25T10:10:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.402+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf404efa0 con 0x7f7cf406d7b0 2024-04-25T10:10:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.406+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ce401b020 con 0x7f7cf406d7b0 2024-04-25T10:10:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.406+0000 7f7ceb400640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 0x7f7cd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.406+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f7ce4085a80 con 0x7f7cf406d7b0 2024-04-25T10:10:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.406+0000 7f7cea000640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 0x7f7cd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.406+0000 7f7cea000640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 0x7f7cd0069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0ad000 tx=0x7f7cdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.410+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ce4022020 con 0x7f7cf406d7b0 2024-04-25T10:10:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:18.578+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7cf40b74c0 con 0x7f7cf406d7b0 2024-04-25T10:10:19.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.226+0000 7f7ceb400640 1 -- 172.21.15.18:0/1198077862 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v91) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ce40563e0 con 0x7f7cf406d7b0 2024-04-25T10:10:19.234 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:10:19.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 msgr2=0x7f7cd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 0x7f7cd0069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc0ad000 tx=0x7f7cdc008040 comp rx=0 tx=0).stop 2024-04-25T10:10:19.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 msgr2=0x7f7cf414b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d800 tx=0x7f7ce400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 shutdown_connections 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7cd0066f60 0x7f7cd0069420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7cf40d0070 0x7f7cf40b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cf40cd670 0x7f7cf415fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 --2- 172.21.15.18:0/1198077862 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf406d7b0 0x7f7cf414b8e0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 >> 172.21.15.18:0/1198077862 conn(0x7f7cf40d1540 msgr2=0x7f7cf4070360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:19.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 shutdown_connections 2024-04-25T10:10:19.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.230+0000 7f7cf3e00640 1 -- 172.21.15.18:0/1198077862 wait complete. 2024-04-25T10:10:19.280 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:10:19.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.418+0000 7fc81c800640 1 Processor -- start 2024-04-25T10:10:19.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81c800640 1 -- start start 2024-04-25T10:10:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc814071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81c800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc814072460 con 0x7fc814161e90 2024-04-25T10:10:19.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81c800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc81406ac10 con 0x7fc814072040 2024-04-25T10:10:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8140b2dc0 con 0x7fc81415dd90 2024-04-25T10:10:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81a800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc814161e90 0x7fc8140ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35250/0 (socket says 172.21.15.18:35250) 2024-04-25T10:10:19.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81a800640 1 -- 172.21.15.18:0/507616761 learned_addr learned my addr 172.21.15.18:0/507616761 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:19.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819e00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc814071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551450737 0 0) 0x7fc814072460 con 0x7fc814161e90 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7fc003530 con 0x7fc814161e90 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229165889 0 0) 0x7fc7fc003530 con 0x7fc814161e90 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 msgr2=0x7fc814071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc814071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 >> v1:172.21.15.167:6789/0 conn(0x7fc814072040 legacy=0x7fc814161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81406aeb0 con 0x7fc814161e90 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fc810001a00 con 0x7fc814161e90 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 >> v1:172.21.15.18:6789/0 conn(0x7fc814161e90 legacy=0x7fc8140ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc7fc0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7fc003f30 0x7fc7fc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc00bab0 con 0x7fc7fc003f30 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc00bc60 con 0x7fc7fc004d50 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc00be60 con 0x7fc81415dd90 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7fc003f30 0x7fc7fc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819e00640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc7fc0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc81a800640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 -- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 msgr2=0x7fc7fc0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc81415dd90 0x7fc7fc0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 -- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7fc004d50 msgr2=0x7fc7fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:19.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7fc004d50 0x7fc7fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.422+0000 7fc819400640 1 -- 172.21.15.18:0/507616761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc003530 con 0x7fc7fc003f30 2024-04-25T10:10:19.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc819400640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7fc003f30 0x7fc7fc004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc804001860 tx=0x7fc80401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26521e7799549fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040b5070 con 0x7fc7fc003f30 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8040a8890 con 0x7fc7fc003f30 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc818a00640 1 -- 172.21.15.18:0/507616761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804001460 con 0x7fc7fc003f30 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 -- 172.21.15.18:0/507616761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7fc003f30 msgr2=0x7fc7fc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 --2- 172.21.15.18:0/507616761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7fc003f30 0x7fc7fc004810 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc804001860 tx=0x7fc80401ec70 comp rx=0 tx=0).stop 2024-04-25T10:10:19.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81a800640 1 -- 172.21.15.18:0/507616761 reap_dead start 2024-04-25T10:10:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 -- 172.21.15.18:0/507616761 shutdown_connections 2024-04-25T10:10:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 -- 172.21.15.18:0/507616761 >> 172.21.15.18:0/507616761 conn(0x7fc8140cfd90 msgr2=0x7fc8140d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 -- 172.21.15.18:0/507616761 shutdown_connections 2024-04-25T10:10:19.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.426+0000 7fc81c800640 1 -- 172.21.15.18:0/507616761 wait complete. 2024-04-25T10:10:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 Processor -- start 2024-04-25T10:10:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- start start 2024-04-25T10:10:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7fc003f30 0x7fc8141579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 0x7fc8141602f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81406b750 con 0x7fc8141597c0 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc81406b470 con 0x7fc8141f3fe0 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc814162300 con 0x7fc7fc003f30 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34120/0 (socket says 172.21.15.18:34120) 2024-04-25T10:10:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 -- 172.21.15.18:0/1483805883 learned_addr learned my addr 172.21.15.18:0/1483805883 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81a800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 0x7fc8141602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819e00640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7fc003f30 0x7fc8141579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 -- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7fc003f30 msgr2=0x7fc8141579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7fc003f30 0x7fc8141579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 -- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 msgr2=0x7fc8141602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:19.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 0x7fc8141602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 -- 172.21.15.18:0/1483805883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8141f4480 con 0x7fc8141597c0 2024-04-25T10:10:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81a800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 0x7fc8141602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc819400640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc8040b3040 tx=0x7fc7fc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040c1070 con 0x7fc8141597c0 2024-04-25T10:10:19.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804005270 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040b5040 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8141f4760 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.430+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc814160830 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8140745d0 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8040b8070 con 0x7fc8141597c0 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc80e000640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 0x7fc7f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fc804121a00 con 0x7fc8141597c0 2024-04-25T10:10:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc819e00640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 0x7fc7f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.434+0000 7fc819e00640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 0x7fc7f8069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc808009b20 tx=0x7fc808008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:19.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.438+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc804018980 con 0x7fc8141597c0 2024-04-25T10:10:19.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:19.634+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc814072700 con 0x7fc8141597c0 2024-04-25T10:10:20.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.246+0000 7fc80e000640 1 -- 172.21.15.18:0/1483805883 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc8040f8030 con 0x7fc8141597c0 2024-04-25T10:10:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 msgr2=0x7fc7f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 0x7fc7f8069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc808009b20 tx=0x7fc808008040 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 msgr2=0x7fc8141f3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc8040b3040 tx=0x7fc7fc005840 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 shutdown_connections 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8141f3fe0 0x7fc8141602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8141597c0 0x7fc8141f3aa0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7f8066f60 0x7fc7f8069420 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fc808009b20 tx=0x7fc808008040 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 --2- 172.21.15.18:0/1483805883 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7fc003f30 0x7fc8141579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.258+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 >> 172.21.15.18:0/1483805883 conn(0x7fc8140cfd90 msgr2=0x7fc8140b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.262+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 shutdown_connections 2024-04-25T10:10:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.262+0000 7fc81c800640 1 -- 172.21.15.18:0/1483805883 wait complete. 2024-04-25T10:10:20.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:20.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 Processor -- start 2024-04-25T10:10:20.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 -- start start 2024-04-25T10:10:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c15b2f0 0x7fd46c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd46c06dad0 0x7fd46c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c15def0 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c15e1b0 con 0x7fd46c06dad0 2024-04-25T10:10:20.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd470a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c15e490 con 0x7fd46c15b2f0 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd461400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd46c0b2dc0 0x7fd46c06dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35260/0 (socket says 172.21.15.18:35260) 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd461400640 1 -- 172.21.15.18:0/2384655341 learned_addr learned my addr 172.21.15.18:0/2384655341 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd46a800640 1 --2- 172.21.15.18:0/2384655341 >> v2:172.21.15.18:3300/0 conn(0x7fd46c06dad0 0x7fd46c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd469e00640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c15b2f0 0x7fd46c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd469400640 1 -- 172.21.15.18:0/2384655341 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092165501 0 0) 0x7fd46c15def0 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd469400640 1 -- 172.21.15.18:0/2384655341 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd450003530 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd46a800640 1 -- 172.21.15.18:0/2384655341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c15b2f0 msgr2=0x7fd46c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd46a800640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c15b2f0 0x7fd46c0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd46a800640 1 -- 172.21.15.18:0/2384655341 >> v1:172.21.15.18:6789/0 conn(0x7fd46c0b2dc0 legacy=0x7fd46c06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.434+0000 7fd46a800640 1 -- 172.21.15.18:0/2384655341 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c15e770 con 0x7fd46c06dad0 2024-04-25T10:10:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd46a800640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c06dad0 0x7fd46c0b3780 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd4640097f0 tx=0x7fd46401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfc94e32b343725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd469400640 1 -- 172.21.15.18:0/2384655341 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c15b8e0 con 0x7fd46c06dad0 2024-04-25T10:10:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd469400640 1 -- 172.21.15.18:0/2384655341 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4640af070 con 0x7fd46c06dad0 2024-04-25T10:10:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd469400640 1 -- 172.21.15.18:0/2384655341 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640aa810 con 0x7fd46c06dad0 2024-04-25T10:10:20.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 -- 172.21.15.18:0/2384655341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c06dad0 msgr2=0x7fd46c0b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c06dad0 0x7fd46c0b3780 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd4640097f0 tx=0x7fd46401c470 comp rx=0 tx=0).stop 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 -- 172.21.15.18:0/2384655341 shutdown_connections 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c06dad0 0x7fd46c0b3780 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 --2- 172.21.15.18:0/2384655341 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c15b2f0 0x7fd46c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 -- 172.21.15.18:0/2384655341 >> 172.21.15.18:0/2384655341 conn(0x7fd46c0b23b0 msgr2=0x7fd46c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 -- 172.21.15.18:0/2384655341 shutdown_connections 2024-04-25T10:10:20.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.438+0000 7fd470a00640 1 -- 172.21.15.18:0/2384655341 wait complete. 2024-04-25T10:10:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 Processor -- start 2024-04-25T10:10:20.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- start start 2024-04-25T10:10:20.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 0x7fd46c0cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 0x7fd46c1566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c16a880 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1616f0 con 0x7fd46c15b2f0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c16aa00 con 0x7fd46c06dad0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34132/0 (socket says 172.21.15.18:34132) 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 -- 172.21.15.18:0/1989282820 learned_addr learned my addr 172.21.15.18:0/1989282820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd469e00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 0x7fd46c0cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd46a800640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 0x7fd46c1566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 -- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 msgr2=0x7fd46c0cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 0x7fd46c0cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 -- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 msgr2=0x7fd46c1566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 0x7fd46c1566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 -- 172.21.15.18:0/1989282820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0ccc40 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd469e00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 0x7fd46c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd46a800640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 0x7fd46c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd461400640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c480 tx=0x7fd45400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454017070 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454005cf0 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd454007290 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c0ccf80 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.442+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c0cd7c0 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c0cd160 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd45401a070 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd462a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 0x7fd448069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd454084600 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd469e00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 0x7fd448069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.446+0000 7fd469e00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 0x7fd448069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd45c007440 tx=0x7fd45c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.450+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd46c0ccf80 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd46c0745d0 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd462a00640 1 -- 172.21.15.18:0/1989282820 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16874 (secure 0 0 0) 0x7fd454055470 con 0x7fd46c0b2dc0 2024-04-25T10:10:20.622 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:20.622 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:19.638491+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 msgr2=0x7fd448069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 0x7fd448069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd45c007440 tx=0x7fd45c00b040 comp rx=0 tx=0).stop 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 msgr2=0x7fd46c1602d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fd45400c480 tx=0x7fd45400c940 comp rx=0 tx=0).stop 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 shutdown_connections 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd46c15b2f0 0x7fd46c1566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd46c0b2dc0 0x7fd46c1602d0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd448066f60 0x7fd448069420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 --2- 172.21.15.18:0/1989282820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd46c06dad0 0x7fd46c0cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 >> 172.21.15.18:0/1989282820 conn(0x7fd46c0b23b0 msgr2=0x7fd46c157b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:20.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 shutdown_connections 2024-04-25T10:10:20.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.614+0000 7fd470a00640 1 -- 172.21.15.18:0/1989282820 wait complete. 2024-04-25T10:10:20.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 Processor -- start 2024-04-25T10:10:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 -- start start 2024-04-25T10:10:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f134815b5d0 0x7f13480cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480b13b0 con 0x7f13480d0010 2024-04-25T10:10:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480b1690 con 0x7f13480b2450 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1347e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480b1970 con 0x7f134815b5d0 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f13480d0010 0x7f13480cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35264/0 (socket says 172.21.15.18:35264) 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346000640 1 -- 172.21.15.18:0/129336542 learned_addr learned my addr 172.21.15.18:0/129336542 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346a00640 1 --2- 172.21.15.18:0/129336542 >> v2:172.21.15.167:3300/0 conn(0x7f134815b5d0 0x7f13480cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1345600640 1 -- 172.21.15.18:0/129336542 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073876961 0 0) 0x7f13480b13b0 con 0x7f13480d0010 2024-04-25T10:10:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1345600640 1 -- 172.21.15.18:0/129336542 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f132c003530 con 0x7f13480d0010 2024-04-25T10:10:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346a00640 1 -- 172.21.15.18:0/129336542 >> v1:172.21.15.167:6789/0 conn(0x7f13480b2450 legacy=0x7f13480cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346a00640 1 -- 172.21.15.18:0/129336542 >> v1:172.21.15.18:6789/0 conn(0x7f13480d0010 legacy=0x7f13480cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.778+0000 7f1346a00640 1 -- 172.21.15.18:0/129336542 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480b1c50 con 0x7f134815b5d0 2024-04-25T10:10:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1346a00640 1 --2- 172.21.15.18:0/129336542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134815b5d0 0x7f13480cfad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f13380097c0 tx=0x7f133801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d95732e2f2424e0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1345600640 1 -- 172.21.15.18:0/129336542 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380ab610 con 0x7f134815b5d0 2024-04-25T10:10:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1345600640 1 -- 172.21.15.18:0/129336542 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380b0070 con 0x7f134815b5d0 2024-04-25T10:10:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1345600640 1 -- 172.21.15.18:0/129336542 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380ab9d0 con 0x7f134815b5d0 2024-04-25T10:10:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 -- 172.21.15.18:0/129336542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134815b5d0 msgr2=0x7f13480cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 --2- 172.21.15.18:0/129336542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134815b5d0 0x7f13480cfad0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f13380097c0 tx=0x7f133801c470 comp rx=0 tx=0).stop 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 -- 172.21.15.18:0/129336542 shutdown_connections 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 --2- 172.21.15.18:0/129336542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f134815b5d0 0x7f13480cfad0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 -- 172.21.15.18:0/129336542 >> 172.21.15.18:0/129336542 conn(0x7f13480d14f0 msgr2=0x7f13480d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 -- 172.21.15.18:0/129336542 shutdown_connections 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.782+0000 7f1347e00640 1 -- 172.21.15.18:0/129336542 wait complete. 2024-04-25T10:10:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 Processor -- start 2024-04-25T10:10:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- start start 2024-04-25T10:10:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13480d0010 0x7f1348158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f134815b5d0 0x7f1348149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480cc760 con 0x7f13480b2450 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480cc5e0 con 0x7f13480d0010 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134815b9b0 con 0x7f134815b5d0 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34142/0 (socket says 172.21.15.18:34142) 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 -- 172.21.15.18:0/3723513580 learned_addr learned my addr 172.21.15.18:0/3723513580 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347400640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f134815b5d0 0x7f1348149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346000640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13480d0010 0x7f1348158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 -- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f134815b5d0 msgr2=0x7f1348149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f134815b5d0 0x7f1348149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 -- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13480d0010 msgr2=0x7f1348158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13480d0010 0x7f1348158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 -- 172.21.15.18:0/3723513580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13481594e0 con 0x7f13480b2450 2024-04-25T10:10:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1346a00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f13380ad040 tx=0x7f133801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380bf610 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13380bf7d0 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380bfbc0 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13481597c0 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.786+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1348159d80 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f134804efa0 con 0x7f13480b2450 2024-04-25T10:10:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f13380bd020 con 0x7f13480b2450 2024-04-25T10:10:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f133ea00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 0x7f1328069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f133811f4d0 con 0x7f13480b2450 2024-04-25T10:10:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f1346000640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 0x7f1328069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.790+0000 7f1346000640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 0x7f1328069420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1334005890 tx=0x7f1334009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:20.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.794+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f13380c6030 con 0x7f13480b2450 2024-04-25T10:10:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13480b7470 con 0x7f13480b2450 2024-04-25T10:10:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f133ea00640 1 -- 172.21.15.18:0/3723513580 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16874 (secure 0 0 0) 0x7f13380a8050 con 0x7f13480b2450 2024-04-25T10:10:20.965 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:20.966 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:19.638491+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 msgr2=0x7f1328069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 0x7f1328069420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1334005890 tx=0x7f1334009040 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 msgr2=0x7f13480705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f13380ad040 tx=0x7f133801acb0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 shutdown_connections 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1328066f60 0x7f1328069420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f134815b5d0 0x7f1348149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13480d0010 0x7f1348158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 --2- 172.21.15.18:0/3723513580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13480b2450 0x7f13480705c0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 >> 172.21.15.18:0/3723513580 conn(0x7f13480d14f0 msgr2=0x7f13480738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 shutdown_connections 2024-04-25T10:10:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:20.958+0000 7f1347e00640 1 -- 172.21.15.18:0/3723513580 wait complete. 2024-04-25T10:10:20.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:10:21.088 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:10:21.092 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:10:21.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 Processor -- start 2024-04-25T10:10:21.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 -- start start 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02f80c4510 0x7f02f80c49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02f80b0970 0x7f02f80b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02f8099eb0 con 0x7f02f8165470 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f809a190 con 0x7f02f80c4510 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f7200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f809a470 con 0x7f02f80b0970 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02f80c4510 0x7f02f80c49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02f80c4510 0x7f02f80c49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34150/0 (socket says 172.21.15.18:34150) 2024-04-25T10:10:21.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 -- 172.21.15.18:0/1846524166 learned_addr learned my addr 172.21.15.18:0/1846524166 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02f6800640 1 --2- 172.21.15.18:0/1846524166 >> v2:172.21.15.167:3300/0 conn(0x7f02f80b0970 0x7f02f80b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 -- 172.21.15.18:0/1846524166 >> v2:172.21.15.167:3300/0 conn(0x7f02f80b0970 msgr2=0x7f02f80b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 --2- 172.21.15.18:0/1846524166 >> v2:172.21.15.167:3300/0 conn(0x7f02f80b0970 0x7f02f80b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 -- 172.21.15.18:0/1846524166 >> v1:172.21.15.167:6789/0 conn(0x7f02f8165470 legacy=0x7f02f806bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:21.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.126+0000 7f02efe00640 1 -- 172.21.15.18:0/1846524166 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f809a750 con 0x7f02f80c4510 2024-04-25T10:10:21.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02efe00640 1 --2- 172.21.15.18:0/1846524166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80c49a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41199c9fec8e2dfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f5400640 1 -- 172.21.15.18:0/1846524166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00b0070 con 0x7f02f80c4510 2024-04-25T10:10:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f5400640 1 -- 172.21.15.18:0/1846524166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e00a4e50 con 0x7f02f80c4510 2024-04-25T10:10:21.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f5400640 1 -- 172.21.15.18:0/1846524166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00ab820 con 0x7f02f80c4510 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 -- 172.21.15.18:0/1846524166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 msgr2=0x7f02f80c49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 --2- 172.21.15.18:0/1846524166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80c49a0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f02e0009870 tx=0x7f02e001c3c0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 -- 172.21.15.18:0/1846524166 shutdown_connections 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 --2- 172.21.15.18:0/1846524166 >> v2:172.21.15.167:3300/0 conn(0x7f02f80b0970 0x7f02f80b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 --2- 172.21.15.18:0/1846524166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80c49a0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 -- 172.21.15.18:0/1846524166 >> 172.21.15.18:0/1846524166 conn(0x7f02f80b3030 msgr2=0x7f02f80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 -- 172.21.15.18:0/1846524166 shutdown_connections 2024-04-25T10:10:21.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.130+0000 7f02f7200640 1 -- 172.21.15.18:0/1846524166 wait complete. 2024-04-25T10:10:21.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 Processor -- start 2024-04-25T10:10:21.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- start start 2024-04-25T10:10:21.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 0x7f02f80cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f8165470 0x7f02f815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f816ecd0 con 0x7f02f80c4510 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f8099c70 con 0x7f02f80b0970 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f816ee50 con 0x7f02f8165470 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34154/0 (socket says 172.21.15.18:34154) 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 -- 172.21.15.18:0/3743324303 learned_addr learned my addr 172.21.15.18:0/3743324303 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f5e00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 0x7f02f80cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f6800640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f8165470 0x7f02f815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 -- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f8165470 msgr2=0x7f02f815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f8165470 0x7f02f815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 -- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 msgr2=0x7f02f80cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 0x7f02f80cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 -- 172.21.15.18:0/3743324303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f80c9cf0 con 0x7f02f80c4510 2024-04-25T10:10:21.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f5e00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 0x7f02f80cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02efe00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f02e00ae040 tx=0x7f02e0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00b9070 con 0x7f02f80c4510 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e00abe20 con 0x7f02f80c4510 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e00b0040 con 0x7f02f80c4510 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f80c9fd0 con 0x7f02f80c4510 2024-04-25T10:10:21.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f80ca590 con 0x7f02f80c4510 2024-04-25T10:10:21.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.134+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f80745d0 con 0x7f02f80c4510 2024-04-25T10:10:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.138+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02e00bc070 con 0x7f02f80c4510 2024-04-25T10:10:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.138+0000 7f02ee000640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 0x7f02d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.138+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f02e011e1e0 con 0x7f02f80c4510 2024-04-25T10:10:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.138+0000 7f02f5e00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 0x7f02d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.138+0000 7f02f5e00640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 0x7f02d4069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f02f80c7940 tx=0x7f02e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.142+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02e00160d0 con 0x7f02f80c4510 2024-04-25T10:10:21.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:21.342+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f02f80b3bf0 con 0x7f02f80c4510 2024-04-25T10:10:22.226 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-04-25T10:10:22.218+0000 7f79c9a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:10:22.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.254+0000 7f02ee000640 1 -- 172.21.15.18:0/3743324303 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7f02e00ef060 con 0x7f02f80c4510 2024-04-25T10:10:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.254+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 msgr2=0x7f02d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.254+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 0x7f02d4069420 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f02f80c7940 tx=0x7f02e8008040 comp rx=0 tx=0).stop 2024-04-25T10:10:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.254+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 msgr2=0x7f02f80cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.254+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f02e00ae040 tx=0x7f02e0019160 comp rx=0 tx=0).stop 2024-04-25T10:10:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 shutdown_connections 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f02d4066f60 0x7f02d4069420 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02f8165470 0x7f02f815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02f80c4510 0x7f02f80cf4c0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 --2- 172.21.15.18:0/3743324303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f80b0970 0x7f02f80cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 >> 172.21.15.18:0/3743324303 conn(0x7f02f80b3030 msgr2=0x7f02f80af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 shutdown_connections 2024-04-25T10:10:22.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.258+0000 7f02f7200640 1 -- 172.21.15.18:0/3743324303 wait complete. 2024-04-25T10:10:22.287 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:10:22.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:10:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.474+0000 7f7595c00640 1 Processor -- start 2024-04-25T10:10:22.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.474+0000 7f7595c00640 1 -- start start 2024-04-25T10:10:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7590144120 0x7f759015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f75900ccbf0 0x7f759015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f759015ee60 0x7f75900b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759015e490 con 0x7f7590144120 2024-04-25T10:10:22.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759015bc40 con 0x7f75900ccbf0 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7595c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759015b3a0 con 0x7f759015ee60 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7590144120 0x7f759015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7590144120 0x7f759015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46624/0 (socket says 172.21.15.18:46624) 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 -- 172.21.15.18:0/1345348353 learned_addr learned my addr 172.21.15.18:0/1345348353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758f400640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f759015ee60 0x7f75900b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f7587e00640 1 --2- 172.21.15.18:0/1345348353 >> v2:172.21.15.167:3300/0 conn(0x7f75900ccbf0 0x7f759015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 -- 172.21.15.18:0/1345348353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f759015ee60 msgr2=0x7f75900b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f759015ee60 0x7f75900b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 -- 172.21.15.18:0/1345348353 >> v2:172.21.15.167:3300/0 conn(0x7f75900ccbf0 msgr2=0x7f759015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 --2- 172.21.15.18:0/1345348353 >> v2:172.21.15.167:3300/0 conn(0x7f75900ccbf0 0x7f759015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.478+0000 7f758ea00640 1 -- 172.21.15.18:0/1345348353 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759015b680 con 0x7f7590144120 2024-04-25T10:10:22.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f758ea00640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7590144120 0x7f759015acd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f759006b870 tx=0x7f758001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796d1abdee3ab9b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f758e000640 1 -- 172.21.15.18:0/1345348353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800b2070 con 0x7f7590144120 2024-04-25T10:10:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f758e000640 1 -- 172.21.15.18:0/1345348353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75800a9070 con 0x7f7590144120 2024-04-25T10:10:22.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f758e000640 1 -- 172.21.15.18:0/1345348353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800ad880 con 0x7f7590144120 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- 172.21.15.18:0/1345348353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7590144120 msgr2=0x7f759015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7590144120 0x7f759015acd0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f759006b870 tx=0x7f758001c490 comp rx=0 tx=0).stop 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- 172.21.15.18:0/1345348353 shutdown_connections 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f759015ee60 0x7f75900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 --2- 172.21.15.18:0/1345348353 >> v2:172.21.15.167:3300/0 conn(0x7f75900ccbf0 0x7f759015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 --2- 172.21.15.18:0/1345348353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7590144120 0x7f759015acd0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- 172.21.15.18:0/1345348353 >> 172.21.15.18:0/1345348353 conn(0x7f7590067080 msgr2=0x7f759006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- 172.21.15.18:0/1345348353 shutdown_connections 2024-04-25T10:10:22.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- 172.21.15.18:0/1345348353 wait complete. 2024-04-25T10:10:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 Processor -- start 2024-04-25T10:10:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.482+0000 7f7595c00640 1 -- start start 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7590144120 0x7f759013bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 0x7f7590158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7590071640 con 0x7f75900ccbf0 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75900714c0 con 0x7f759015ee60 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75900717c0 con 0x7f7590144120 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46638/0 (socket says 172.21.15.18:46638) 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 -- 172.21.15.18:0/428402305 learned_addr learned my addr 172.21.15.18:0/428402305 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7587e00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7590144120 0x7f759013bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758f400640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 0x7f7590158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 -- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7590144120 msgr2=0x7f759013bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7590144120 0x7f759013bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 -- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 msgr2=0x7f7590158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 0x7f7590158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 -- 172.21.15.18:0/428402305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590159dc0 con 0x7f75900ccbf0 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758f400640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 0x7f7590158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:22.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f758ea00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f758001cd30 tx=0x7f758001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800bc020 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75800b8420 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75800b2040 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75900b0de0 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f759013c510 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75900745d0 con 0x7f75900ccbf0 2024-04-25T10:10:22.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.486+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75800bf020 con 0x7f75900ccbf0 2024-04-25T10:10:22.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.490+0000 7f7586a00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 0x7f756c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:22.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.490+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f758011f360 con 0x7f75900ccbf0 2024-04-25T10:10:22.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.490+0000 7f7587e00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 0x7f756c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:22.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.490+0000 7f7587e00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 0x7f756c069470 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7590164590 tx=0x7f7578008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:22.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.494+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f75800c6030 con 0x7f75900ccbf0 2024-04-25T10:10:22.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:22.694+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7590159f90 con 0x7f75900ccbf0 2024-04-25T10:10:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.258+0000 7f7586a00640 1 -- 172.21.15.18:0/428402305 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7580016110 con 0x7f75900ccbf0 2024-04-25T10:10:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 msgr2=0x7f756c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 0x7f756c069470 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7590164590 tx=0x7f7578008040 comp rx=0 tx=0).stop 2024-04-25T10:10:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 msgr2=0x7f7590158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f758001cd30 tx=0x7f758001acd0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 shutdown_connections 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f759015ee60 0x7f7590158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f756c066fb0 0x7f756c069470 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7590144120 0x7f759013bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 --2- 172.21.15.18:0/428402305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75900ccbf0 0x7f7590158090 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 >> 172.21.15.18:0/428402305 conn(0x7f7590067080 msgr2=0x7f759006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:23.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 shutdown_connections 2024-04-25T10:10:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.262+0000 7f7595c00640 1 -- 172.21.15.18:0/428402305 wait complete. 2024-04-25T10:10:23.291 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:10:23.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 Processor -- start 2024-04-25T10:10:23.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 -- start start 2024-04-25T10:10:23.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4684161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468406d090 con 0x7f46840713c0 2024-04-25T10:10:23.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4684162390 con 0x7f4684071800 2024-04-25T10:10:23.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4689200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4684161af0 con 0x7f4684070fe0 2024-04-25T10:10:23.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f46840713c0 0x7f4684143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44432/0 (socket says 172.21.15.18:44432) 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681400640 1 -- 172.21.15.18:0/269380185 learned_addr learned my addr 172.21.15.18:0/269380185 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4684161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255955769 0 0) 0x7f4670001120 con 0x7f46840713c0 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4668003530 con 0x7f46840713c0 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3834759153 0 0) 0x7f4668003530 con 0x7f46840713c0 2024-04-25T10:10:23.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 msgr2=0x7f4684161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:23.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4684161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 >> v1:172.21.15.167:6789/0 conn(0x7f4684071800 legacy=0x7f468415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684161dd0 con 0x7f46840713c0 2024-04-25T10:10:23.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f4670001850 con 0x7f46840713c0 2024-04-25T10:10:23.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 >> v1:172.21.15.18:6789/0 conn(0x7f46840713c0 legacy=0x7f4684143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f4668003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4668004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4668004d50 0x7f46680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684161af0 con 0x7f46680039f0 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466800ba80 con 0x7f4668004d50 2024-04-25T10:10:23.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466800bc80 con 0x7f4684070fe0 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f4668003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681400640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4668004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4682800640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4668004d50 0x7f46680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 -- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 msgr2=0x7f4668004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4684070fe0 0x7f4668004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 -- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4668004d50 msgr2=0x7f46680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4668004d50 0x7f46680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.426+0000 7f4681e00640 1 -- 172.21.15.18:0/269380185 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668003530 con 0x7f46680039f0 2024-04-25T10:10:23.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4681e00640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f4668003e10 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ab0 tx=0x7f467401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4529a843cf267b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740096b0 con 0x7f46680039f0 2024-04-25T10:10:23.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740a6510 con 0x7f46680039f0 2024-04-25T10:10:23.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4680a00640 1 -- 172.21.15.18:0/269380185 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a6900 con 0x7f46680039f0 2024-04-25T10:10:23.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 -- 172.21.15.18:0/269380185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 msgr2=0x7f4668003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 --2- 172.21.15.18:0/269380185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f4668003e10 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4674009ab0 tx=0x7f467401ca20 comp rx=0 tx=0).stop 2024-04-25T10:10:23.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4682800640 1 -- 172.21.15.18:0/269380185 reap_dead start 2024-04-25T10:10:23.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 -- 172.21.15.18:0/269380185 shutdown_connections 2024-04-25T10:10:23.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 -- 172.21.15.18:0/269380185 >> 172.21.15.18:0/269380185 conn(0x7f46840b3390 msgr2=0x7f46840b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:23.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 -- 172.21.15.18:0/269380185 shutdown_connections 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.430+0000 7f4689200640 1 -- 172.21.15.18:0/269380185 wait complete. 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 Processor -- start 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- start start 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46841f8500 0x7f46840b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46840ccd60 0x7f46840cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468415ede0 con 0x7f46680039f0 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468415ec60 con 0x7f46841f8500 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46840b0540 con 0x7f46840ccd60 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46654/0 (socket says 172.21.15.18:46654) 2024-04-25T10:10:23.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 -- 172.21.15.18:0/4227690957 learned_addr learned my addr 172.21.15.18:0/4227690957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:23.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4682800640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46840ccd60 0x7f46840cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681400640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46841f8500 0x7f46840b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 -- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46840ccd60 msgr2=0x7f46840cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46840ccd60 0x7f46840cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 -- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46841f8500 msgr2=0x7f46840b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46841f8500 0x7f46840b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 -- 172.21.15.18:0/4227690957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46841fa6f0 con 0x7f46680039f0 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4681e00640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f467401cf00 tx=0x7f4668005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467400f000 con 0x7f46680039f0 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674004020 con 0x7f46680039f0 2024-04-25T10:10:23.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840b22e0 con 0x7f46680039f0 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740041f0 con 0x7f46680039f0 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.434+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46840b5ef0 con 0x7f46680039f0 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46840745d0 con 0x7f46680039f0 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46740c1020 con 0x7f46680039f0 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f467a000640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 0x7f4664069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f467411f520 con 0x7f46680039f0 2024-04-25T10:10:23.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f4681400640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 0x7f4664069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.438+0000 7f4681400640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 0x7f4664069450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4670001060 tx=0x7f4670009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.442+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4674016760 con 0x7f46680039f0 2024-04-25T10:10:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4684162ff0 con 0x7f46680039f0 2024-04-25T10:10:23.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f467a000640 1 -- 172.21.15.18:0/4227690957 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f46740f0390 con 0x7f46680039f0 2024-04-25T10:10:23.650 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:23.650 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:22.696457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7503":{"gid":7503,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2607538595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2607538595},{"type":"v1","addr":"172.21.15.18:6835","nonce":2607538595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:23.650 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 63 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 msgr2=0x7f4664069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 0x7f4664069450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4670001060 tx=0x7f4670009040 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 msgr2=0x7f46841fa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f467401cf00 tx=0x7f4668005840 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 shutdown_connections 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4664066f90 0x7f4664069450 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f46840ccd60 0x7f46840cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46841f8500 0x7f46840b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 --2- 172.21.15.18:0/4227690957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46680039f0 0x7f46841fa1b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 >> 172.21.15.18:0/4227690957 conn(0x7f46840b3390 msgr2=0x7f468413ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:23.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 shutdown_connections 2024-04-25T10:10:23.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.642+0000 7f4689200640 1 -- 172.21.15.18:0/4227690957 wait complete. 2024-04-25T10:10:23.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.802+0000 7f512aa00640 1 Processor -- start 2024-04-25T10:10:23.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.802+0000 7f512aa00640 1 -- start start 2024-04-25T10:10:23.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.802+0000 7f512aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f512415db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.802+0000 7f512aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5124099a60 0x7f512415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512aa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5124099fd0 con 0x7f51241617a0 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f512409a2b0 con 0x7f5124099a60 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512409a590 con 0x7f5124070490 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5124099a60 0x7f512415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5124099a60 0x7f512415e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46664/0 (socket says 172.21.15.18:46664) 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 -- 172.21.15.18:0/2522411557 learned_addr learned my addr 172.21.15.18:0/2522411557 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f5128c00640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f512415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 -- 172.21.15.18:0/2522411557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 msgr2=0x7f512415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f512415db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 -- 172.21.15.18:0/2522411557 >> v1:172.21.15.167:6789/0 conn(0x7f51241617a0 legacy=0x7f51240d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:23.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 -- 172.21.15.18:0/2522411557 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f512409a870 con 0x7f5124099a60 2024-04-25T10:10:23.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f512a000640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124099a60 0x7f512415e040 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f511c009e50 tx=0x7f511c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bb9a77f64671ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.806+0000 7f5123e00640 1 -- 172.21.15.18:0/2522411557 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a5810 con 0x7f5124099a60 2024-04-25T10:10:23.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f5123e00640 1 -- 172.21.15.18:0/2522411557 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0a59b0 con 0x7f5124099a60 2024-04-25T10:10:23.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f5123e00640 1 -- 172.21.15.18:0/2522411557 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0a5d80 con 0x7f5124099a60 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- 172.21.15.18:0/2522411557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124099a60 msgr2=0x7f512415e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124099a60 0x7f512415e040 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f511c009e50 tx=0x7f511c01ca30 comp rx=0 tx=0).stop 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- 172.21.15.18:0/2522411557 shutdown_connections 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5124099a60 0x7f512415e040 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- 172.21.15.18:0/2522411557 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f512415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- 172.21.15.18:0/2522411557 >> 172.21.15.18:0/2522411557 conn(0x7f51240b3050 msgr2=0x7f51240b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- 172.21.15.18:0/2522411557 shutdown_connections 2024-04-25T10:10:23.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- 172.21.15.18:0/2522411557 wait complete. 2024-04-25T10:10:23.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 Processor -- start 2024-04-25T10:10:23.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- start start 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f51240b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124099a60 0x7f51241514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512416ac10 con 0x7f51241617a0 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512416aa90 con 0x7f5124099a60 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f512416ad90 con 0x7f5124070490 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46670/0 (socket says 172.21.15.18:46670) 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 -- 172.21.15.18:0/3527918337 learned_addr learned my addr 172.21.15.18:0/3527918337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f5128c00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124099a60 0x7f51241514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f5129600640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f51240b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 -- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 msgr2=0x7f51240b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f51240b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 -- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124099a60 msgr2=0x7f51241514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124099a60 0x7f51241514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.810+0000 7f512a000640 1 -- 172.21.15.18:0/3527918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240b4690 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f512a000640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f511c01a660 tx=0x7f511c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c009510 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0be070 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0b8ac0 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f512415b740 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512415bd00 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512404efa0 con 0x7f51241617a0 2024-04-25T10:10:23.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f511c0b8c60 con 0x7f51241617a0 2024-04-25T10:10:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 0x7f5104069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f511c120490 con 0x7f51241617a0 2024-04-25T10:10:23.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.814+0000 7f5129600640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 0x7f5104069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:23.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.818+0000 7f5129600640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 0x7f5104069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5118001810 tx=0x7f5118009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:23.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.818+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f511c016620 con 0x7f51241617a0 2024-04-25T10:10:23.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.978+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51240d0fd0 con 0x7f51241617a0 2024-04-25T10:10:23.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f5121600640 1 -- 172.21.15.18:0/3527918337 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16861 (secure 0 0 0) 0x7f511c0f0d50 con 0x7f51241617a0 2024-04-25T10:10:23.989 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:23.990 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:21.244553+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 msgr2=0x7f5104069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 0x7f5104069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5118001810 tx=0x7f5118009040 comp rx=0 tx=0).stop 2024-04-25T10:10:23.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 msgr2=0x7f51241527e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f511c01a660 tx=0x7f511c0197d0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 shutdown_connections 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51241617a0 0x7f51241527e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5124099a60 0x7f51241514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5104066f60 0x7f5104069420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 --2- 172.21.15.18:0/3527918337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5124070490 0x7f51240b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 >> 172.21.15.18:0/3527918337 conn(0x7f51240b3050 msgr2=0x7f51240cd830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 shutdown_connections 2024-04-25T10:10:23.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:23.982+0000 7f512aa00640 1 -- 172.21.15.18:0/3527918337 wait complete. 2024-04-25T10:10:24.011 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:10:24.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:10:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.142+0000 7f1a2aa00640 1 Processor -- start 2024-04-25T10:10:24.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.142+0000 7f1a2aa00640 1 -- start start 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 0x7f1a240ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a240ced60 0x7f1a2406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2406e900 0x7f1a2415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2406ed70 con 0x7f1a2406e900 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2415ac60 con 0x7f1a24144140 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a2aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a240cf3e0 con 0x7f1a240ced60 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2406e900 0x7f1a2415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2406e900 0x7f1a2415e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46676/0 (socket says 172.21.15.18:46676) 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 -- 172.21.15.18:0/1045292559 learned_addr learned my addr 172.21.15.18:0/1045292559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a23e00640 1 --2- 172.21.15.18:0/1045292559 >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 0x7f1a240ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a1b400640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a240ced60 0x7f1a2406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 -- 172.21.15.18:0/1045292559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a240ced60 msgr2=0x7f1a2406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a240ced60 0x7f1a2406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 -- 172.21.15.18:0/1045292559 >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 msgr2=0x7f1a240ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 --2- 172.21.15.18:0/1045292559 >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 0x7f1a240ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a28a00640 1 -- 172.21.15.18:0/1045292559 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2415af20 con 0x7f1a2406e900 2024-04-25T10:10:24.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.146+0000 7f1a23e00640 1 --2- 172.21.15.18:0/1045292559 >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 0x7f1a240ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:24.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a28a00640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a2415e250 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1a2406eef0 tx=0x7f1a1c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d205c7ccaaecce88 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a23400640 1 -- 172.21.15.18:0/1045292559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ac070 con 0x7f1a2406e900 2024-04-25T10:10:24.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a23400640 1 -- 172.21.15.18:0/1045292559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0a8420 con 0x7f1a2406e900 2024-04-25T10:10:24.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a23400640 1 -- 172.21.15.18:0/1045292559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0a87f0 con 0x7f1a2406e900 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- 172.21.15.18:0/1045292559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 msgr2=0x7f1a2415e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a2415e250 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f1a2406eef0 tx=0x7f1a1c01c730 comp rx=0 tx=0).stop 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- 172.21.15.18:0/1045292559 shutdown_connections 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a2415e250 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/1045292559 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a240ced60 0x7f1a2406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/1045292559 >> v2:172.21.15.167:3300/0 conn(0x7f1a24144140 0x7f1a240ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- 172.21.15.18:0/1045292559 >> 172.21.15.18:0/1045292559 conn(0x7f1a24066fa0 msgr2=0x7f1a2406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:24.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- 172.21.15.18:0/1045292559 shutdown_connections 2024-04-25T10:10:24.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- 172.21.15.18:0/1045292559 wait complete. 2024-04-25T10:10:24.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 Processor -- start 2024-04-25T10:10:24.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.150+0000 7f1a2aa00640 1 -- start start 2024-04-25T10:10:24.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a240ced60 0x7f1a241510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a24144140 0x7f1a24163220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2415ba00 con 0x7f1a2406e900 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a24144520 con 0x7f1a240ced60 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2415bb80 con 0x7f1a24144140 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46690/0 (socket says 172.21.15.18:46690) 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 -- 172.21.15.18:0/605785211 learned_addr learned my addr 172.21.15.18:0/605785211 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a1b400640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a240ced60 0x7f1a241510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a28a00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a24144140 0x7f1a24163220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 -- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a24144140 msgr2=0x7f1a24163220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a24144140 0x7f1a24163220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 -- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a240ced60 msgr2=0x7f1a241510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a240ced60 0x7f1a241510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 -- 172.21.15.18:0/605785211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2412ff80 con 0x7f1a2406e900 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a23e00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c7f0 tx=0x7f1a1400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14015070 con 0x7f1a2406e900 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14007820 con 0x7f1a2406e900 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14007c10 con 0x7f1a2406e900 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a24130220 con 0x7f1a2406e900 2024-04-25T10:10:24.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a241307e0 con 0x7f1a2406e900 2024-04-25T10:10:24.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a240745d0 con 0x7f1a2406e900 2024-04-25T10:10:24.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.154+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a14018070 con 0x7f1a2406e900 2024-04-25T10:10:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.158+0000 7f1a20c00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 0x7f1a00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.158+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a14085270 con 0x7f1a2406e900 2024-04-25T10:10:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.158+0000 7f1a1b400640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 0x7f1a00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.158+0000 7f1a1b400640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 0x7f1a00069420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1a2415e030 tx=0x7f1a0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.162+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a140560e0 con 0x7f1a2406e900 2024-04-25T10:10:24.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.322+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a240b2400 con 0x7f1a00066f60 2024-04-25T10:10:24.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.330+0000 7f1a20c00640 1 -- 172.21.15.18:0/605785211 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252076 (secure 0 0 0) 0x7f1a240b2400 con 0x7f1a00066f60 2024-04-25T10:10:24.340 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:24.342 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:10:24.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 msgr2=0x7f1a00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 0x7f1a00069420 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1a2415e030 tx=0x7f1a0c008040 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 msgr2=0x7f1a24160440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f1a1400c7f0 tx=0x7f1a1400ccb0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 shutdown_connections 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a00066f60 0x7f1a00069420 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a24144140 0x7f1a24163220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a240ced60 0x7f1a241510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/605785211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2406e900 0x7f1a24160440 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 >> 172.21.15.18:0/605785211 conn(0x7f1a24066fa0 msgr2=0x7f1a240b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 shutdown_connections 2024-04-25T10:10:24.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.334+0000 7f1a2aa00640 1 -- 172.21.15.18:0/605785211 wait complete. 2024-04-25T10:10:24.360 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-25T10:10:23.494345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259576,"kb_used_data":10120,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715144,"statfs":{"total":773094113280,"available":772828307456,"internally_reserved":0,"allocated":10362880,"data_stored":5385468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.270274"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253724+0000","last_change":"2024-04-25T10:10:20.261892+0000","last_active":"2024-04-25T10:10:21.253724+0000","last_peered":"2024-04-25T10:10:21.253724+0000","last_clean":"2024-04-25T10:10:21.253724+0000","last_became_active":"2024-04-25T10:10:20.261447+0000","last_became_peered":"2024-04-25T10:10:20.261447+0000","last_unstale":"2024-04-25T10:10:21.253724+0000","last_undegraded":"2024-04-25T10:10:21.253724+0000","last_fullsized":"2024-04-25T10:10:21.253724+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:03.314519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261204+0000","last_change":"2024-04-25T10:10:20.256432+0000","last_active":"2024-04-25T10:10:21.261204+0000","last_peered":"2024-04-25T10:10:21.261204+0000","last_clean":"2024-04-25T10:10:21.261204+0000","last_became_active":"2024-04-25T10:10:20.256111+0000","last_became_peered":"2024-04-25T10:10:20.256111+0000","last_unstale":"2024-04-25T10:10:21.261204+0000","last_undegraded":"2024-04-25T10:10:21.261204+0000","last_fullsized":"2024-04-25T10:10:21.261204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253381+0000","last_change":"2024-04-25T10:10:20.254960+0000","last_active":"2024-04-25T10:10:21.253381+0000","last_peered":"2024-04-25T10:10:21.253381+0000","last_clean":"2024-04-25T10:10:21.253381+0000","last_became_active":"2024-04-25T10:10:20.254669+0000","last_became_peered":"2024-04-25T10:10:20.254669+0000","last_unstale":"2024-04-25T10:10:21.253381+0000","last_undegraded":"2024-04-25T10:10:21.253381+0000","last_fullsized":"2024-04-25T10:10:21.253381+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:52.723214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791422+0000","last_change":"2024-04-25T10:10:20.263573+0000","last_active":"2024-04-25T10:10:21.791422+0000","last_peered":"2024-04-25T10:10:21.791422+0000","last_clean":"2024-04-25T10:10:21.791422+0000","last_became_active":"2024-04-25T10:10:20.262153+0000","last_became_peered":"2024-04-25T10:10:20.262153+0000","last_unstale":"2024-04-25T10:10:21.791422+0000","last_undegraded":"2024-04-25T10:10:21.791422+0000","last_fullsized":"2024-04-25T10:10:21.791422+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257478+0000","last_change":"2024-04-25T10:10:20.252661+0000","last_active":"2024-04-25T10:10:21.257478+0000","last_peered":"2024-04-25T10:10:21.257478+0000","last_clean":"2024-04-25T10:10:21.257478+0000","last_became_active":"2024-04-25T10:10:20.249372+0000","last_became_peered":"2024-04-25T10:10:20.249372+0000","last_unstale":"2024-04-25T10:10:21.257478+0000","last_undegraded":"2024-04-25T10:10:21.257478+0000","last_fullsized":"2024-04-25T10:10:21.257478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791180+0000","last_change":"2024-04-25T10:10:20.264570+0000","last_active":"2024-04-25T10:10:21.791180+0000","last_peered":"2024-04-25T10:10:21.791180+0000","last_clean":"2024-04-25T10:10:21.791180+0000","last_became_active":"2024-04-25T10:10:20.264269+0000","last_became_peered":"2024-04-25T10:10:20.264269+0000","last_unstale":"2024-04-25T10:10:21.791180+0000","last_undegraded":"2024-04-25T10:10:21.791180+0000","last_fullsized":"2024-04-25T10:10:21.791180+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257096+0000","last_change":"2024-04-25T10:10:20.257354+0000","last_active":"2024-04-25T10:10:21.257096+0000","last_peered":"2024-04-25T10:10:21.257096+0000","last_clean":"2024-04-25T10:10:21.257096+0000","last_became_active":"2024-04-25T10:10:20.255791+0000","last_became_peered":"2024-04-25T10:10:20.255791+0000","last_unstale":"2024-04-25T10:10:21.257096+0000","last_undegraded":"2024-04-25T10:10:21.257096+0000","last_fullsized":"2024-04-25T10:10:21.257096+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:30.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791270+0000","last_change":"2024-04-25T10:10:20.254510+0000","last_active":"2024-04-25T10:10:21.791270+0000","last_peered":"2024-04-25T10:10:21.791270+0000","last_clean":"2024-04-25T10:10:21.791270+0000","last_became_active":"2024-04-25T10:10:20.253674+0000","last_became_peered":"2024-04-25T10:10:20.253674+0000","last_unstale":"2024-04-25T10:10:21.791270+0000","last_undegraded":"2024-04-25T10:10:21.791270+0000","last_fullsized":"2024-04-25T10:10:21.791270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:05.777569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257821+0000","last_change":"2024-04-25T10:10:20.259147+0000","last_active":"2024-04-25T10:10:21.257821+0000","last_peered":"2024-04-25T10:10:21.257821+0000","last_clean":"2024-04-25T10:10:21.257821+0000","last_became_active":"2024-04-25T10:10:20.257732+0000","last_became_peered":"2024-04-25T10:10:20.257732+0000","last_unstale":"2024-04-25T10:10:21.257821+0000","last_undegraded":"2024-04-25T10:10:21.257821+0000","last_fullsized":"2024-04-25T10:10:21.257821+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:42.342450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792395+0000","last_change":"2024-04-25T10:10:20.258983+0000","last_active":"2024-04-25T10:10:21.792395+0000","last_peered":"2024-04-25T10:10:21.792395+0000","last_clean":"2024-04-25T10:10:21.792395+0000","last_became_active":"2024-04-25T10:10:20.254525+0000","last_became_peered":"2024-04-25T10:10:20.254525+0000","last_unstale":"2024-04-25T10:10:21.792395+0000","last_undegraded":"2024-04-25T10:10:21.792395+0000","last_fullsized":"2024-04-25T10:10:21.792395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:37.441288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257891+0000","last_change":"2024-04-25T10:10:20.261735+0000","last_active":"2024-04-25T10:10:21.257891+0000","last_peered":"2024-04-25T10:10:21.257891+0000","last_clean":"2024-04-25T10:10:21.257891+0000","last_became_active":"2024-04-25T10:10:20.261338+0000","last_became_peered":"2024-04-25T10:10:20.261338+0000","last_unstale":"2024-04-25T10:10:21.257891+0000","last_undegraded":"2024-04-25T10:10:21.257891+0000","last_fullsized":"2024-04-25T10:10:21.257891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.464051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792181+0000","last_change":"2024-04-25T10:10:20.242139+0000","last_active":"2024-04-25T10:10:21.792181+0000","last_peered":"2024-04-25T10:10:21.792181+0000","last_clean":"2024-04-25T10:10:21.792181+0000","last_became_active":"2024-04-25T10:10:20.241816+0000","last_became_peered":"2024-04-25T10:10:20.241816+0000","last_unstale":"2024-04-25T10:10:21.792181+0000","last_undegraded":"2024-04-25T10:10:21.792181+0000","last_fullsized":"2024-04-25T10:10:21.792181+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:54.322372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791423+0000","last_change":"2024-04-25T10:10:20.252401+0000","last_active":"2024-04-25T10:10:21.791423+0000","last_peered":"2024-04-25T10:10:21.791423+0000","last_clean":"2024-04-25T10:10:21.791423+0000","last_became_active":"2024-04-25T10:10:20.252104+0000","last_became_peered":"2024-04-25T10:10:20.252104+0000","last_unstale":"2024-04-25T10:10:21.791423+0000","last_undegraded":"2024-04-25T10:10:21.791423+0000","last_fullsized":"2024-04-25T10:10:21.791423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257562+0000","last_change":"2024-04-25T10:10:20.270898+0000","last_active":"2024-04-25T10:10:21.257562+0000","last_peered":"2024-04-25T10:10:21.257562+0000","last_clean":"2024-04-25T10:10:21.257562+0000","last_became_active":"2024-04-25T10:10:20.270582+0000","last_became_peered":"2024-04-25T10:10:20.270582+0000","last_unstale":"2024-04-25T10:10:21.257562+0000","last_undegraded":"2024-04-25T10:10:21.257562+0000","last_fullsized":"2024-04-25T10:10:21.257562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790932+0000","last_change":"2024-04-25T10:10:20.258552+0000","last_active":"2024-04-25T10:10:21.790932+0000","last_peered":"2024-04-25T10:10:21.790932+0000","last_clean":"2024-04-25T10:10:21.790932+0000","last_became_active":"2024-04-25T10:10:20.255118+0000","last_became_peered":"2024-04-25T10:10:20.255118+0000","last_unstale":"2024-04-25T10:10:21.790932+0000","last_undegraded":"2024-04-25T10:10:21.790932+0000","last_fullsized":"2024-04-25T10:10:21.790932+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:17.791570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790830+0000","last_change":"2024-04-25T10:10:20.256255+0000","last_active":"2024-04-25T10:10:21.790830+0000","last_peered":"2024-04-25T10:10:21.790830+0000","last_clean":"2024-04-25T10:10:21.790830+0000","last_became_active":"2024-04-25T10:10:20.255740+0000","last_became_peered":"2024-04-25T10:10:20.255740+0000","last_unstale":"2024-04-25T10:10:21.790830+0000","last_undegraded":"2024-04-25T10:10:21.790830+0000","last_fullsized":"2024-04-25T10:10:21.790830+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:41.001050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792724+0000","last_change":"2024-04-25T10:10:20.250972+0000","last_active":"2024-04-25T10:10:21.792724+0000","last_peered":"2024-04-25T10:10:21.792724+0000","last_clean":"2024-04-25T10:10:21.792724+0000","last_became_active":"2024-04-25T10:10:20.250665+0000","last_became_peered":"2024-04-25T10:10:20.250665+0000","last_unstale":"2024-04-25T10:10:21.792724+0000","last_undegraded":"2024-04-25T10:10:21.792724+0000","last_fullsized":"2024-04-25T10:10:21.792724+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:17.741585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253406+0000","last_change":"2024-04-25T10:10:20.256431+0000","last_active":"2024-04-25T10:10:21.253406+0000","last_peered":"2024-04-25T10:10:21.253406+0000","last_clean":"2024-04-25T10:10:21.253406+0000","last_became_active":"2024-04-25T10:10:20.256164+0000","last_became_peered":"2024-04-25T10:10:20.256164+0000","last_unstale":"2024-04-25T10:10:21.253406+0000","last_undegraded":"2024-04-25T10:10:21.253406+0000","last_fullsized":"2024-04-25T10:10:21.253406+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:05.181006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258063+0000","last_change":"2024-04-25T10:10:20.265107+0000","last_active":"2024-04-25T10:10:21.258063+0000","last_peered":"2024-04-25T10:10:21.258063+0000","last_clean":"2024-04-25T10:10:21.258063+0000","last_became_active":"2024-04-25T10:10:20.264614+0000","last_became_peered":"2024-04-25T10:10:20.264614+0000","last_unstale":"2024-04-25T10:10:21.258063+0000","last_undegraded":"2024-04-25T10:10:21.258063+0000","last_fullsized":"2024-04-25T10:10:21.258063+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:40.914011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791580+0000","last_change":"2024-04-25T10:10:20.253537+0000","last_active":"2024-04-25T10:10:21.791580+0000","last_peered":"2024-04-25T10:10:21.791580+0000","last_clean":"2024-04-25T10:10:21.791580+0000","last_became_active":"2024-04-25T10:10:20.253278+0000","last_became_peered":"2024-04-25T10:10:20.253278+0000","last_unstale":"2024-04-25T10:10:21.791580+0000","last_undegraded":"2024-04-25T10:10:21.791580+0000","last_fullsized":"2024-04-25T10:10:21.791580+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257357+0000","last_change":"2024-04-25T10:10:20.253805+0000","last_active":"2024-04-25T10:10:21.257357+0000","last_peered":"2024-04-25T10:10:21.257357+0000","last_clean":"2024-04-25T10:10:21.257357+0000","last_became_active":"2024-04-25T10:10:20.251752+0000","last_became_peered":"2024-04-25T10:10:20.251752+0000","last_unstale":"2024-04-25T10:10:21.257357+0000","last_undegraded":"2024-04-25T10:10:21.257357+0000","last_fullsized":"2024-04-25T10:10:21.257357+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257867+0000","last_change":"2024-04-25T10:10:20.264514+0000","last_active":"2024-04-25T10:10:21.257867+0000","last_peered":"2024-04-25T10:10:21.257867+0000","last_clean":"2024-04-25T10:10:21.257867+0000","last_became_active":"2024-04-25T10:10:20.263854+0000","last_became_peered":"2024-04-25T10:10:20.263854+0000","last_unstale":"2024-04-25T10:10:21.257867+0000","last_undegraded":"2024-04-25T10:10:21.257867+0000","last_fullsized":"2024-04-25T10:10:21.257867+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:44.909359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793371+0000","last_change":"2024-04-25T10:10:20.256670+0000","last_active":"2024-04-25T10:10:21.793371+0000","last_peered":"2024-04-25T10:10:21.793371+0000","last_clean":"2024-04-25T10:10:21.793371+0000","last_became_active":"2024-04-25T10:10:20.256265+0000","last_became_peered":"2024-04-25T10:10:20.256265+0000","last_unstale":"2024-04-25T10:10:21.793371+0000","last_undegraded":"2024-04-25T10:10:21.793371+0000","last_fullsized":"2024-04-25T10:10:21.793371+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:05.777569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253103+0000","last_change":"2024-04-25T10:10:20.253142+0000","last_active":"2024-04-25T10:10:21.253103+0000","last_peered":"2024-04-25T10:10:21.253103+0000","last_clean":"2024-04-25T10:10:21.253103+0000","last_became_active":"2024-04-25T10:10:20.252603+0000","last_became_peered":"2024-04-25T10:10:20.252603+0000","last_unstale":"2024-04-25T10:10:21.253103+0000","last_undegraded":"2024-04-25T10:10:21.253103+0000","last_fullsized":"2024-04-25T10:10:21.253103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:50.752058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261172+0000","last_change":"2024-04-25T10:10:20.257580+0000","last_active":"2024-04-25T10:10:21.261172+0000","last_peered":"2024-04-25T10:10:21.261172+0000","last_clean":"2024-04-25T10:10:21.261172+0000","last_became_active":"2024-04-25T10:10:20.257367+0000","last_became_peered":"2024-04-25T10:10:20.257367+0000","last_unstale":"2024-04-25T10:10:21.261172+0000","last_undegraded":"2024-04-25T10:10:21.261172+0000","last_fullsized":"2024-04-25T10:10:21.261172+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:16.696124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257737+0000","last_change":"2024-04-25T10:10:20.264748+0000","last_active":"2024-04-25T10:10:21.257737+0000","last_peered":"2024-04-25T10:10:21.257737+0000","last_clean":"2024-04-25T10:10:21.257737+0000","last_became_active":"2024-04-25T10:10:20.264447+0000","last_became_peered":"2024-04-25T10:10:20.264447+0000","last_unstale":"2024-04-25T10:10:21.257737+0000","last_undegraded":"2024-04-25T10:10:21.257737+0000","last_fullsized":"2024-04-25T10:10:21.257737+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:59.325348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792363+0000","last_change":"2024-04-25T10:10:20.245231+0000","last_active":"2024-04-25T10:10:21.792363+0000","last_peered":"2024-04-25T10:10:21.792363+0000","last_clean":"2024-04-25T10:10:21.792363+0000","last_became_active":"2024-04-25T10:10:20.243711+0000","last_became_peered":"2024-04-25T10:10:20.243711+0000","last_unstale":"2024-04-25T10:10:21.792363+0000","last_undegraded":"2024-04-25T10:10:21.792363+0000","last_fullsized":"2024-04-25T10:10:21.792363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:40.529221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791741+0000","last_change":"2024-04-25T10:10:20.264678+0000","last_active":"2024-04-25T10:10:21.791741+0000","last_peered":"2024-04-25T10:10:21.791741+0000","last_clean":"2024-04-25T10:10:21.791741+0000","last_became_active":"2024-04-25T10:10:20.263557+0000","last_became_peered":"2024-04-25T10:10:20.263557+0000","last_unstale":"2024-04-25T10:10:21.791741+0000","last_undegraded":"2024-04-25T10:10:21.791741+0000","last_fullsized":"2024-04-25T10:10:21.791741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:59.325348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257521+0000","last_change":"2024-04-25T10:10:20.258730+0000","last_active":"2024-04-25T10:10:21.257521+0000","last_peered":"2024-04-25T10:10:21.257521+0000","last_clean":"2024-04-25T10:10:21.257521+0000","last_became_active":"2024-04-25T10:10:20.258370+0000","last_became_peered":"2024-04-25T10:10:20.258370+0000","last_unstale":"2024-04-25T10:10:21.257521+0000","last_undegraded":"2024-04-25T10:10:21.257521+0000","last_fullsized":"2024-04-25T10:10:21.257521+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:12.576984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258175+0000","last_change":"2024-04-25T10:10:20.253409+0000","last_active":"2024-04-25T10:10:21.258175+0000","last_peered":"2024-04-25T10:10:21.258175+0000","last_clean":"2024-04-25T10:10:21.258175+0000","last_became_active":"2024-04-25T10:10:20.253081+0000","last_became_peered":"2024-04-25T10:10:20.253081+0000","last_unstale":"2024-04-25T10:10:21.258175+0000","last_undegraded":"2024-04-25T10:10:21.258175+0000","last_fullsized":"2024-04-25T10:10:21.258175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260835+0000","last_change":"2024-04-25T10:10:20.263132+0000","last_active":"2024-04-25T10:10:21.260835+0000","last_peered":"2024-04-25T10:10:21.260835+0000","last_clean":"2024-04-25T10:10:21.260835+0000","last_became_active":"2024-04-25T10:10:20.262794+0000","last_became_peered":"2024-04-25T10:10:20.262794+0000","last_unstale":"2024-04-25T10:10:21.260835+0000","last_undegraded":"2024-04-25T10:10:21.260835+0000","last_fullsized":"2024-04-25T10:10:21.260835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:07.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790970+0000","last_change":"2024-04-25T10:10:20.255947+0000","last_active":"2024-04-25T10:10:21.790970+0000","last_peered":"2024-04-25T10:10:21.790970+0000","last_clean":"2024-04-25T10:10:21.790970+0000","last_became_active":"2024-04-25T10:10:20.255529+0000","last_became_peered":"2024-04-25T10:10:20.255529+0000","last_unstale":"2024-04-25T10:10:21.790970+0000","last_undegraded":"2024-04-25T10:10:21.790970+0000","last_fullsized":"2024-04-25T10:10:21.790970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:32.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792455+0000","last_change":"2024-04-25T10:10:20.260529+0000","last_active":"2024-04-25T10:10:21.792455+0000","last_peered":"2024-04-25T10:10:21.792455+0000","last_clean":"2024-04-25T10:10:21.792455+0000","last_became_active":"2024-04-25T10:10:20.260227+0000","last_became_peered":"2024-04-25T10:10:20.260227+0000","last_unstale":"2024-04-25T10:10:21.792455+0000","last_undegraded":"2024-04-25T10:10:21.792455+0000","last_fullsized":"2024-04-25T10:10:21.792455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:59.565657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793707+0000","last_change":"2024-04-25T10:10:19.256431+0000","last_active":"2024-04-25T10:10:21.793707+0000","last_peered":"2024-04-25T10:10:21.793707+0000","last_clean":"2024-04-25T10:10:21.793707+0000","last_became_active":"2024-04-25T10:10:19.256106+0000","last_became_peered":"2024-04-25T10:10:19.256106+0000","last_unstale":"2024-04-25T10:10:21.793707+0000","last_undegraded":"2024-04-25T10:10:21.793707+0000","last_fullsized":"2024-04-25T10:10:21.793707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:01.170942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792444+0000","last_change":"2024-04-25T10:10:20.259058+0000","last_active":"2024-04-25T10:10:21.792444+0000","last_peered":"2024-04-25T10:10:21.792444+0000","last_clean":"2024-04-25T10:10:21.792444+0000","last_became_active":"2024-04-25T10:10:20.258245+0000","last_became_peered":"2024-04-25T10:10:20.258245+0000","last_unstale":"2024-04-25T10:10:21.792444+0000","last_undegraded":"2024-04-25T10:10:21.792444+0000","last_fullsized":"2024-04-25T10:10:21.792444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:07.951974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257933+0000","last_change":"2024-04-25T10:10:19.249781+0000","last_active":"2024-04-25T10:10:21.257933+0000","last_peered":"2024-04-25T10:10:21.257933+0000","last_clean":"2024-04-25T10:10:21.257933+0000","last_became_active":"2024-04-25T10:10:19.247643+0000","last_became_peered":"2024-04-25T10:10:19.247643+0000","last_unstale":"2024-04-25T10:10:21.257933+0000","last_undegraded":"2024-04-25T10:10:21.257933+0000","last_fullsized":"2024-04-25T10:10:21.257933+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:01.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258500+0000","last_change":"2024-04-25T10:10:20.262825+0000","last_active":"2024-04-25T10:10:21.258500+0000","last_peered":"2024-04-25T10:10:21.258500+0000","last_clean":"2024-04-25T10:10:21.258500+0000","last_became_active":"2024-04-25T10:10:20.262511+0000","last_became_peered":"2024-04-25T10:10:20.262511+0000","last_unstale":"2024-04-25T10:10:21.258500+0000","last_undegraded":"2024-04-25T10:10:21.258500+0000","last_fullsized":"2024-04-25T10:10:21.258500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:31.156810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258559+0000","last_change":"2024-04-25T10:10:19.258361+0000","last_active":"2024-04-25T10:10:21.258559+0000","last_peered":"2024-04-25T10:10:21.258559+0000","last_clean":"2024-04-25T10:10:21.258559+0000","last_became_active":"2024-04-25T10:10:19.258055+0000","last_became_peered":"2024-04-25T10:10:19.258055+0000","last_unstale":"2024-04-25T10:10:21.258559+0000","last_undegraded":"2024-04-25T10:10:21.258559+0000","last_fullsized":"2024-04-25T10:10:21.258559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:24.931999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792726+0000","last_change":"2024-04-25T10:10:20.248725+0000","last_active":"2024-04-25T10:10:21.792726+0000","last_peered":"2024-04-25T10:10:21.792726+0000","last_clean":"2024-04-25T10:10:21.792726+0000","last_became_active":"2024-04-25T10:10:20.248393+0000","last_became_peered":"2024-04-25T10:10:20.248393+0000","last_unstale":"2024-04-25T10:10:21.792726+0000","last_undegraded":"2024-04-25T10:10:21.792726+0000","last_fullsized":"2024-04-25T10:10:21.792726+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:31.363155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793474+0000","last_change":"2024-04-25T10:10:19.254951+0000","last_active":"2024-04-25T10:10:21.793474+0000","last_peered":"2024-04-25T10:10:21.793474+0000","last_clean":"2024-04-25T10:10:21.793474+0000","last_became_active":"2024-04-25T10:10:19.254691+0000","last_became_peered":"2024-04-25T10:10:19.254691+0000","last_unstale":"2024-04-25T10:10:21.793474+0000","last_undegraded":"2024-04-25T10:10:21.793474+0000","last_fullsized":"2024-04-25T10:10:21.793474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:13.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791801+0000","last_change":"2024-04-25T10:10:20.254750+0000","last_active":"2024-04-25T10:10:21.791801+0000","last_peered":"2024-04-25T10:10:21.791801+0000","last_clean":"2024-04-25T10:10:21.791801+0000","last_became_active":"2024-04-25T10:10:20.253994+0000","last_became_peered":"2024-04-25T10:10:20.253994+0000","last_unstale":"2024-04-25T10:10:21.791801+0000","last_undegraded":"2024-04-25T10:10:21.791801+0000","last_fullsized":"2024-04-25T10:10:21.791801+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:42.342450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257411+0000","last_change":"2024-04-25T10:10:19.251349+0000","last_active":"2024-04-25T10:10:21.257411+0000","last_peered":"2024-04-25T10:10:21.257411+0000","last_clean":"2024-04-25T10:10:21.257411+0000","last_became_active":"2024-04-25T10:10:19.250847+0000","last_became_peered":"2024-04-25T10:10:19.250847+0000","last_unstale":"2024-04-25T10:10:21.257411+0000","last_undegraded":"2024-04-25T10:10:21.257411+0000","last_fullsized":"2024-04-25T10:10:21.257411+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:39.285057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793432+0000","last_change":"2024-04-25T10:10:20.255196+0000","last_active":"2024-04-25T10:10:21.793432+0000","last_peered":"2024-04-25T10:10:21.793432+0000","last_clean":"2024-04-25T10:10:21.793432+0000","last_became_active":"2024-04-25T10:10:20.253764+0000","last_became_peered":"2024-04-25T10:10:20.253764+0000","last_unstale":"2024-04-25T10:10:21.793432+0000","last_undegraded":"2024-04-25T10:10:21.793432+0000","last_fullsized":"2024-04-25T10:10:21.793432+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791218+0000","last_change":"2024-04-25T10:10:19.258044+0000","last_active":"2024-04-25T10:10:21.791218+0000","last_peered":"2024-04-25T10:10:21.791218+0000","last_clean":"2024-04-25T10:10:21.791218+0000","last_became_active":"2024-04-25T10:10:19.256861+0000","last_became_peered":"2024-04-25T10:10:19.256861+0000","last_unstale":"2024-04-25T10:10:21.791218+0000","last_undegraded":"2024-04-25T10:10:21.791218+0000","last_fullsized":"2024-04-25T10:10:21.791218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:14.385527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791317+0000","last_change":"2024-04-25T10:10:20.264448+0000","last_active":"2024-04-25T10:10:21.791317+0000","last_peered":"2024-04-25T10:10:21.791317+0000","last_clean":"2024-04-25T10:10:21.791317+0000","last_became_active":"2024-04-25T10:10:20.263858+0000","last_became_peered":"2024-04-25T10:10:20.263858+0000","last_unstale":"2024-04-25T10:10:21.791317+0000","last_undegraded":"2024-04-25T10:10:21.791317+0000","last_fullsized":"2024-04-25T10:10:21.791317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.693158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253101+0000","last_change":"2024-04-25T10:10:19.246605+0000","last_active":"2024-04-25T10:10:21.253101+0000","last_peered":"2024-04-25T10:10:21.253101+0000","last_clean":"2024-04-25T10:10:21.253101+0000","last_became_active":"2024-04-25T10:10:19.246317+0000","last_became_peered":"2024-04-25T10:10:19.246317+0000","last_unstale":"2024-04-25T10:10:21.253101+0000","last_undegraded":"2024-04-25T10:10:21.253101+0000","last_fullsized":"2024-04-25T10:10:21.253101+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:26.095795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791499+0000","last_change":"2024-04-25T10:10:20.251788+0000","last_active":"2024-04-25T10:10:21.791499+0000","last_peered":"2024-04-25T10:10:21.791499+0000","last_clean":"2024-04-25T10:10:21.791499+0000","last_became_active":"2024-04-25T10:10:20.251509+0000","last_became_peered":"2024-04-25T10:10:20.251509+0000","last_unstale":"2024-04-25T10:10:21.791499+0000","last_undegraded":"2024-04-25T10:10:21.791499+0000","last_fullsized":"2024-04-25T10:10:21.791499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256863+0000","last_change":"2024-04-25T10:10:19.254976+0000","last_active":"2024-04-25T10:10:21.256863+0000","last_peered":"2024-04-25T10:10:21.256863+0000","last_clean":"2024-04-25T10:10:21.256863+0000","last_became_active":"2024-04-25T10:10:19.254269+0000","last_became_peered":"2024-04-25T10:10:19.254269+0000","last_unstale":"2024-04-25T10:10:21.256863+0000","last_undegraded":"2024-04-25T10:10:21.256863+0000","last_fullsized":"2024-04-25T10:10:21.256863+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.457685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257543+0000","last_change":"2024-04-25T10:10:20.247429+0000","last_active":"2024-04-25T10:10:21.257543+0000","last_peered":"2024-04-25T10:10:21.257543+0000","last_clean":"2024-04-25T10:10:21.257543+0000","last_became_active":"2024-04-25T10:10:20.247149+0000","last_became_peered":"2024-04-25T10:10:20.247149+0000","last_unstale":"2024-04-25T10:10:21.257543+0000","last_undegraded":"2024-04-25T10:10:21.257543+0000","last_fullsized":"2024-04-25T10:10:21.257543+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:33.954123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261209+0000","last_change":"2024-04-25T10:10:19.254581+0000","last_active":"2024-04-25T10:10:21.261209+0000","last_peered":"2024-04-25T10:10:21.261209+0000","last_clean":"2024-04-25T10:10:21.261209+0000","last_became_active":"2024-04-25T10:10:19.254306+0000","last_became_peered":"2024-04-25T10:10:19.254306+0000","last_unstale":"2024-04-25T10:10:21.261209+0000","last_undegraded":"2024-04-25T10:10:21.261209+0000","last_fullsized":"2024-04-25T10:10:21.261209+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:40.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258762+0000","last_change":"2024-04-25T10:10:20.255636+0000","last_active":"2024-04-25T10:10:21.258762+0000","last_peered":"2024-04-25T10:10:21.258762+0000","last_clean":"2024-04-25T10:10:21.258762+0000","last_became_active":"2024-04-25T10:10:20.255275+0000","last_became_peered":"2024-04-25T10:10:20.255275+0000","last_unstale":"2024-04-25T10:10:21.258762+0000","last_undegraded":"2024-04-25T10:10:21.258762+0000","last_fullsized":"2024-04-25T10:10:21.258762+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:24.678599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253523+0000","last_change":"2024-04-25T10:10:19.249559+0000","last_active":"2024-04-25T10:10:21.253523+0000","last_peered":"2024-04-25T10:10:21.253523+0000","last_clean":"2024-04-25T10:10:21.253523+0000","last_became_active":"2024-04-25T10:10:19.249217+0000","last_became_peered":"2024-04-25T10:10:19.249217+0000","last_unstale":"2024-04-25T10:10:21.253523+0000","last_undegraded":"2024-04-25T10:10:21.253523+0000","last_fullsized":"2024-04-25T10:10:21.253523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:01.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253550+0000","last_change":"2024-04-25T10:10:20.263700+0000","last_active":"2024-04-25T10:10:21.253550+0000","last_peered":"2024-04-25T10:10:21.253550+0000","last_clean":"2024-04-25T10:10:21.253550+0000","last_became_active":"2024-04-25T10:10:20.263408+0000","last_became_peered":"2024-04-25T10:10:20.263408+0000","last_unstale":"2024-04-25T10:10:21.253550+0000","last_undegraded":"2024-04-25T10:10:21.253550+0000","last_fullsized":"2024-04-25T10:10:21.253550+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:30.002478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"92'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258232+0000","last_change":"2024-04-25T10:10:19.254021+0000","last_active":"2024-04-25T10:10:21.258232+0000","last_peered":"2024-04-25T10:10:21.258232+0000","last_clean":"2024-04-25T10:10:21.258232+0000","last_became_active":"2024-04-25T10:10:19.253457+0000","last_became_peered":"2024-04-25T10:10:19.253457+0000","last_unstale":"2024-04-25T10:10:21.258232+0000","last_undegraded":"2024-04-25T10:10:21.258232+0000","last_fullsized":"2024-04-25T10:10:21.258232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:39.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792031+0000","last_change":"2024-04-25T10:10:20.257794+0000","last_active":"2024-04-25T10:10:21.792031+0000","last_peered":"2024-04-25T10:10:21.792031+0000","last_clean":"2024-04-25T10:10:21.792031+0000","last_became_active":"2024-04-25T10:10:20.257520+0000","last_became_peered":"2024-04-25T10:10:20.257520+0000","last_unstale":"2024-04-25T10:10:21.792031+0000","last_undegraded":"2024-04-25T10:10:21.792031+0000","last_fullsized":"2024-04-25T10:10:21.792031+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:44.909359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792581+0000","last_change":"2024-04-25T10:10:19.254031+0000","last_active":"2024-04-25T10:10:21.792581+0000","last_peered":"2024-04-25T10:10:21.792581+0000","last_clean":"2024-04-25T10:10:21.792581+0000","last_became_active":"2024-04-25T10:10:19.253740+0000","last_became_peered":"2024-04-25T10:10:19.253740+0000","last_unstale":"2024-04-25T10:10:21.792581+0000","last_undegraded":"2024-04-25T10:10:21.792581+0000","last_fullsized":"2024-04-25T10:10:21.792581+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:24.607804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791710+0000","last_change":"2024-04-25T10:10:20.254291+0000","last_active":"2024-04-25T10:10:21.791710+0000","last_peered":"2024-04-25T10:10:21.791710+0000","last_clean":"2024-04-25T10:10:21.791710+0000","last_became_active":"2024-04-25T10:10:20.253625+0000","last_became_peered":"2024-04-25T10:10:20.253625+0000","last_unstale":"2024-04-25T10:10:21.791710+0000","last_undegraded":"2024-04-25T10:10:21.791710+0000","last_fullsized":"2024-04-25T10:10:21.791710+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:33.954123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258343+0000","last_change":"2024-04-25T10:10:19.254701+0000","last_active":"2024-04-25T10:10:21.258343+0000","last_peered":"2024-04-25T10:10:21.258343+0000","last_clean":"2024-04-25T10:10:21.258343+0000","last_became_active":"2024-04-25T10:10:19.254392+0000","last_became_peered":"2024-04-25T10:10:19.254392+0000","last_unstale":"2024-04-25T10:10:21.258343+0000","last_undegraded":"2024-04-25T10:10:21.258343+0000","last_fullsized":"2024-04-25T10:10:21.258343+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:39.907645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256898+0000","last_change":"2024-04-25T10:10:20.246723+0000","last_active":"2024-04-25T10:10:21.256898+0000","last_peered":"2024-04-25T10:10:21.256898+0000","last_clean":"2024-04-25T10:10:21.256898+0000","last_became_active":"2024-04-25T10:10:20.246441+0000","last_became_peered":"2024-04-25T10:10:20.246441+0000","last_unstale":"2024-04-25T10:10:21.256898+0000","last_undegraded":"2024-04-25T10:10:21.256898+0000","last_fullsized":"2024-04-25T10:10:21.256898+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791404+0000","last_change":"2024-04-25T10:10:19.253396+0000","last_active":"2024-04-25T10:10:21.791404+0000","last_peered":"2024-04-25T10:10:21.791404+0000","last_clean":"2024-04-25T10:10:21.791404+0000","last_became_active":"2024-04-25T10:10:19.253065+0000","last_became_peered":"2024-04-25T10:10:19.253065+0000","last_unstale":"2024-04-25T10:10:21.791404+0000","last_undegraded":"2024-04-25T10:10:21.791404+0000","last_fullsized":"2024-04-25T10:10:21.791404+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:30.150444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791259+0000","last_change":"2024-04-25T10:10:20.260787+0000","last_active":"2024-04-25T10:10:21.791259+0000","last_peered":"2024-04-25T10:10:21.791259+0000","last_clean":"2024-04-25T10:10:21.791259+0000","last_became_active":"2024-04-25T10:10:20.260535+0000","last_became_peered":"2024-04-25T10:10:20.260535+0000","last_unstale":"2024-04-25T10:10:21.791259+0000","last_undegraded":"2024-04-25T10:10:21.791259+0000","last_fullsized":"2024-04-25T10:10:21.791259+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:07.686617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792647+0000","last_change":"2024-04-25T10:10:19.246877+0000","last_active":"2024-04-25T10:10:21.792647+0000","last_peered":"2024-04-25T10:10:21.792647+0000","last_clean":"2024-04-25T10:10:21.792647+0000","last_became_active":"2024-04-25T10:10:19.246017+0000","last_became_peered":"2024-04-25T10:10:19.246017+0000","last_unstale":"2024-04-25T10:10:21.792647+0000","last_undegraded":"2024-04-25T10:10:21.792647+0000","last_fullsized":"2024-04-25T10:10:21.792647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:39.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792431+0000","last_change":"2024-04-25T10:10:20.246304+0000","last_active":"2024-04-25T10:10:21.792431+0000","last_peered":"2024-04-25T10:10:21.792431+0000","last_clean":"2024-04-25T10:10:21.792431+0000","last_became_active":"2024-04-25T10:10:20.245995+0000","last_became_peered":"2024-04-25T10:10:20.245995+0000","last_unstale":"2024-04-25T10:10:21.792431+0000","last_undegraded":"2024-04-25T10:10:21.792431+0000","last_fullsized":"2024-04-25T10:10:21.792431+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:37.475297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791823+0000","last_change":"2024-04-25T10:10:19.252240+0000","last_active":"2024-04-25T10:10:21.791823+0000","last_peered":"2024-04-25T10:10:21.791823+0000","last_clean":"2024-04-25T10:10:21.791823+0000","last_became_active":"2024-04-25T10:10:19.251960+0000","last_became_peered":"2024-04-25T10:10:19.251960+0000","last_unstale":"2024-04-25T10:10:21.791823+0000","last_undegraded":"2024-04-25T10:10:21.791823+0000","last_fullsized":"2024-04-25T10:10:21.791823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:15.932801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792569+0000","last_change":"2024-04-25T10:10:20.259676+0000","last_active":"2024-04-25T10:10:21.792569+0000","last_peered":"2024-04-25T10:10:21.792569+0000","last_clean":"2024-04-25T10:10:21.792569+0000","last_became_active":"2024-04-25T10:10:20.258509+0000","last_became_peered":"2024-04-25T10:10:20.258509+0000","last_unstale":"2024-04-25T10:10:21.792569+0000","last_undegraded":"2024-04-25T10:10:21.792569+0000","last_fullsized":"2024-04-25T10:10:21.792569+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:19.428228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793754+0000","last_change":"2024-04-25T10:10:19.250005+0000","last_active":"2024-04-25T10:10:21.793754+0000","last_peered":"2024-04-25T10:10:21.793754+0000","last_clean":"2024-04-25T10:10:21.793754+0000","last_became_active":"2024-04-25T10:10:19.249265+0000","last_became_peered":"2024-04-25T10:10:19.249265+0000","last_unstale":"2024-04-25T10:10:21.793754+0000","last_undegraded":"2024-04-25T10:10:21.793754+0000","last_fullsized":"2024-04-25T10:10:21.793754+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:51.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793707+0000","last_change":"2024-04-25T10:10:20.252595+0000","last_active":"2024-04-25T10:10:21.793707+0000","last_peered":"2024-04-25T10:10:21.793707+0000","last_clean":"2024-04-25T10:10:21.793707+0000","last_became_active":"2024-04-25T10:10:20.252323+0000","last_became_peered":"2024-04-25T10:10:20.252323+0000","last_unstale":"2024-04-25T10:10:21.793707+0000","last_undegraded":"2024-04-25T10:10:21.793707+0000","last_fullsized":"2024-04-25T10:10:21.793707+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258509+0000","last_change":"2024-04-25T10:10:19.256882+0000","last_active":"2024-04-25T10:10:21.258509+0000","last_peered":"2024-04-25T10:10:21.258509+0000","last_clean":"2024-04-25T10:10:21.258509+0000","last_became_active":"2024-04-25T10:10:19.256151+0000","last_became_peered":"2024-04-25T10:10:19.256151+0000","last_unstale":"2024-04-25T10:10:21.258509+0000","last_undegraded":"2024-04-25T10:10:21.258509+0000","last_fullsized":"2024-04-25T10:10:21.258509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:06.437188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257924+0000","last_change":"2024-04-25T10:10:20.255579+0000","last_active":"2024-04-25T10:10:21.257924+0000","last_peered":"2024-04-25T10:10:21.257924+0000","last_clean":"2024-04-25T10:10:21.257924+0000","last_became_active":"2024-04-25T10:10:20.255287+0000","last_became_peered":"2024-04-25T10:10:20.255287+0000","last_unstale":"2024-04-25T10:10:21.257924+0000","last_undegraded":"2024-04-25T10:10:21.257924+0000","last_fullsized":"2024-04-25T10:10:21.257924+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:07.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258241+0000","last_change":"2024-04-25T10:10:19.259596+0000","last_active":"2024-04-25T10:10:21.258241+0000","last_peered":"2024-04-25T10:10:21.258241+0000","last_clean":"2024-04-25T10:10:21.258241+0000","last_became_active":"2024-04-25T10:10:19.259311+0000","last_became_peered":"2024-04-25T10:10:19.259311+0000","last_unstale":"2024-04-25T10:10:21.258241+0000","last_undegraded":"2024-04-25T10:10:21.258241+0000","last_fullsized":"2024-04-25T10:10:21.258241+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:15.932801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792404+0000","last_change":"2024-04-25T10:10:20.262734+0000","last_active":"2024-04-25T10:10:21.792404+0000","last_peered":"2024-04-25T10:10:21.792404+0000","last_clean":"2024-04-25T10:10:21.792404+0000","last_became_active":"2024-04-25T10:10:20.262325+0000","last_became_peered":"2024-04-25T10:10:20.262325+0000","last_unstale":"2024-04-25T10:10:21.792404+0000","last_undegraded":"2024-04-25T10:10:21.792404+0000","last_fullsized":"2024-04-25T10:10:21.792404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:45.454826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260795+0000","last_change":"2024-04-25T10:10:19.252634+0000","last_active":"2024-04-25T10:10:21.260795+0000","last_peered":"2024-04-25T10:10:21.260795+0000","last_clean":"2024-04-25T10:10:21.260795+0000","last_became_active":"2024-04-25T10:10:19.252272+0000","last_became_peered":"2024-04-25T10:10:19.252272+0000","last_unstale":"2024-04-25T10:10:21.260795+0000","last_undegraded":"2024-04-25T10:10:21.260795+0000","last_fullsized":"2024-04-25T10:10:21.260795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:04.771203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260873+0000","last_change":"2024-04-25T10:10:20.251463+0000","last_active":"2024-04-25T10:10:21.260873+0000","last_peered":"2024-04-25T10:10:21.260873+0000","last_clean":"2024-04-25T10:10:21.260873+0000","last_became_active":"2024-04-25T10:10:20.251119+0000","last_became_peered":"2024-04-25T10:10:20.251119+0000","last_unstale":"2024-04-25T10:10:21.260873+0000","last_undegraded":"2024-04-25T10:10:21.260873+0000","last_fullsized":"2024-04-25T10:10:21.260873+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:40.914011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791447+0000","last_change":"2024-04-25T10:10:19.257952+0000","last_active":"2024-04-25T10:10:21.791447+0000","last_peered":"2024-04-25T10:10:21.791447+0000","last_clean":"2024-04-25T10:10:21.791447+0000","last_became_active":"2024-04-25T10:10:19.257455+0000","last_became_peered":"2024-04-25T10:10:19.257455+0000","last_unstale":"2024-04-25T10:10:21.791447+0000","last_undegraded":"2024-04-25T10:10:21.791447+0000","last_fullsized":"2024-04-25T10:10:21.791447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:21.249103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260883+0000","last_change":"2024-04-25T10:10:20.263516+0000","last_active":"2024-04-25T10:10:21.260883+0000","last_peered":"2024-04-25T10:10:21.260883+0000","last_clean":"2024-04-25T10:10:21.260883+0000","last_became_active":"2024-04-25T10:10:20.263124+0000","last_became_peered":"2024-04-25T10:10:20.263124+0000","last_unstale":"2024-04-25T10:10:21.260883+0000","last_undegraded":"2024-04-25T10:10:21.260883+0000","last_fullsized":"2024-04-25T10:10:21.260883+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260900+0000","last_change":"2024-04-25T10:10:19.252947+0000","last_active":"2024-04-25T10:10:21.260900+0000","last_peered":"2024-04-25T10:10:21.260900+0000","last_clean":"2024-04-25T10:10:21.260900+0000","last_became_active":"2024-04-25T10:10:19.252655+0000","last_became_peered":"2024-04-25T10:10:19.252655+0000","last_unstale":"2024-04-25T10:10:21.260900+0000","last_undegraded":"2024-04-25T10:10:21.260900+0000","last_fullsized":"2024-04-25T10:10:21.260900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:49.671941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791747+0000","last_change":"2024-04-25T10:10:20.256790+0000","last_active":"2024-04-25T10:10:21.791747+0000","last_peered":"2024-04-25T10:10:21.791747+0000","last_clean":"2024-04-25T10:10:21.791747+0000","last_became_active":"2024-04-25T10:10:20.256504+0000","last_became_peered":"2024-04-25T10:10:20.256504+0000","last_unstale":"2024-04-25T10:10:21.791747+0000","last_undegraded":"2024-04-25T10:10:21.791747+0000","last_fullsized":"2024-04-25T10:10:21.791747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:39.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790740+0000","last_change":"2024-04-25T10:10:19.246454+0000","last_active":"2024-04-25T10:10:21.790740+0000","last_peered":"2024-04-25T10:10:21.790740+0000","last_clean":"2024-04-25T10:10:21.790740+0000","last_became_active":"2024-04-25T10:10:19.246134+0000","last_became_peered":"2024-04-25T10:10:19.246134+0000","last_unstale":"2024-04-25T10:10:21.790740+0000","last_undegraded":"2024-04-25T10:10:21.790740+0000","last_fullsized":"2024-04-25T10:10:21.790740+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:31.266738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793583+0000","last_change":"2024-04-25T10:10:20.250462+0000","last_active":"2024-04-25T10:10:21.793583+0000","last_peered":"2024-04-25T10:10:21.793583+0000","last_clean":"2024-04-25T10:10:21.793583+0000","last_became_active":"2024-04-25T10:10:20.250173+0000","last_became_peered":"2024-04-25T10:10:20.250173+0000","last_unstale":"2024-04-25T10:10:21.793583+0000","last_undegraded":"2024-04-25T10:10:21.793583+0000","last_fullsized":"2024-04-25T10:10:21.793583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258660+0000","last_change":"2024-04-25T10:10:19.258221+0000","last_active":"2024-04-25T10:10:21.258660+0000","last_peered":"2024-04-25T10:10:21.258660+0000","last_clean":"2024-04-25T10:10:21.258660+0000","last_became_active":"2024-04-25T10:10:19.257937+0000","last_became_peered":"2024-04-25T10:10:19.257937+0000","last_unstale":"2024-04-25T10:10:21.258660+0000","last_undegraded":"2024-04-25T10:10:21.258660+0000","last_fullsized":"2024-04-25T10:10:21.258660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:15.689758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792608+0000","last_change":"2024-04-25T10:10:20.258009+0000","last_active":"2024-04-25T10:10:21.792608+0000","last_peered":"2024-04-25T10:10:21.792608+0000","last_clean":"2024-04-25T10:10:21.792608+0000","last_became_active":"2024-04-25T10:10:20.257758+0000","last_became_peered":"2024-04-25T10:10:20.257758+0000","last_unstale":"2024-04-25T10:10:21.792608+0000","last_undegraded":"2024-04-25T10:10:21.792608+0000","last_fullsized":"2024-04-25T10:10:21.792608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:10.693872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"93'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258037+0000","last_change":"2024-04-25T10:10:19.249615+0000","last_active":"2024-04-25T10:10:21.258037+0000","last_peered":"2024-04-25T10:10:21.258037+0000","last_clean":"2024-04-25T10:10:21.258037+0000","last_became_active":"2024-04-25T10:10:19.249348+0000","last_became_peered":"2024-04-25T10:10:19.249348+0000","last_unstale":"2024-04-25T10:10:21.258037+0000","last_undegraded":"2024-04-25T10:10:21.258037+0000","last_fullsized":"2024-04-25T10:10:21.258037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:34.152207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792559+0000","last_change":"2024-04-25T10:10:20.263048+0000","last_active":"2024-04-25T10:10:21.792559+0000","last_peered":"2024-04-25T10:10:21.792559+0000","last_clean":"2024-04-25T10:10:21.792559+0000","last_became_active":"2024-04-25T10:10:20.262772+0000","last_became_peered":"2024-04-25T10:10:20.262772+0000","last_unstale":"2024-04-25T10:10:21.792559+0000","last_undegraded":"2024-04-25T10:10:21.792559+0000","last_fullsized":"2024-04-25T10:10:21.792559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:24.386484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258366+0000","last_change":"2024-04-25T10:10:19.254234+0000","last_active":"2024-04-25T10:10:21.258366+0000","last_peered":"2024-04-25T10:10:21.258366+0000","last_clean":"2024-04-25T10:10:21.258366+0000","last_became_active":"2024-04-25T10:10:19.253368+0000","last_became_peered":"2024-04-25T10:10:19.253368+0000","last_unstale":"2024-04-25T10:10:21.258366+0000","last_undegraded":"2024-04-25T10:10:21.258366+0000","last_fullsized":"2024-04-25T10:10:21.258366+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:14.385527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261208+0000","last_change":"2024-04-25T10:10:20.257049+0000","last_active":"2024-04-25T10:10:21.261208+0000","last_peered":"2024-04-25T10:10:21.261208+0000","last_clean":"2024-04-25T10:10:21.261208+0000","last_became_active":"2024-04-25T10:10:20.256751+0000","last_became_peered":"2024-04-25T10:10:20.256751+0000","last_unstale":"2024-04-25T10:10:21.261208+0000","last_undegraded":"2024-04-25T10:10:21.261208+0000","last_fullsized":"2024-04-25T10:10:21.261208+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.664582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793627+0000","last_change":"2024-04-25T10:10:19.252608+0000","last_active":"2024-04-25T10:10:21.793627+0000","last_peered":"2024-04-25T10:10:21.793627+0000","last_clean":"2024-04-25T10:10:21.793627+0000","last_became_active":"2024-04-25T10:10:19.252354+0000","last_became_peered":"2024-04-25T10:10:19.252354+0000","last_unstale":"2024-04-25T10:10:21.793627+0000","last_undegraded":"2024-04-25T10:10:21.793627+0000","last_fullsized":"2024-04-25T10:10:21.793627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:30.317152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790648+0000","last_change":"2024-04-25T10:10:20.258958+0000","last_active":"2024-04-25T10:10:21.790648+0000","last_peered":"2024-04-25T10:10:21.790648+0000","last_clean":"2024-04-25T10:10:21.790648+0000","last_became_active":"2024-04-25T10:10:20.258688+0000","last_became_peered":"2024-04-25T10:10:20.258688+0000","last_unstale":"2024-04-25T10:10:21.790648+0000","last_undegraded":"2024-04-25T10:10:21.790648+0000","last_fullsized":"2024-04-25T10:10:21.790648+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:03.473806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792235+0000","last_change":"2024-04-25T10:10:19.253981+0000","last_active":"2024-04-25T10:10:21.792235+0000","last_peered":"2024-04-25T10:10:21.792235+0000","last_clean":"2024-04-25T10:10:21.792235+0000","last_became_active":"2024-04-25T10:10:19.253705+0000","last_became_peered":"2024-04-25T10:10:19.253705+0000","last_unstale":"2024-04-25T10:10:21.792235+0000","last_undegraded":"2024-04-25T10:10:21.792235+0000","last_fullsized":"2024-04-25T10:10:21.792235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:23.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253103+0000","last_change":"2024-04-25T10:10:20.266522+0000","last_active":"2024-04-25T10:10:21.253103+0000","last_peered":"2024-04-25T10:10:21.253103+0000","last_clean":"2024-04-25T10:10:21.253103+0000","last_became_active":"2024-04-25T10:10:20.266217+0000","last_became_peered":"2024-04-25T10:10:20.266217+0000","last_unstale":"2024-04-25T10:10:21.253103+0000","last_undegraded":"2024-04-25T10:10:21.253103+0000","last_fullsized":"2024-04-25T10:10:21.253103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:14.566025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260915+0000","last_change":"2024-04-25T10:10:19.251872+0000","last_active":"2024-04-25T10:10:21.260915+0000","last_peered":"2024-04-25T10:10:21.260915+0000","last_clean":"2024-04-25T10:10:21.260915+0000","last_became_active":"2024-04-25T10:10:19.251608+0000","last_became_peered":"2024-04-25T10:10:19.251608+0000","last_unstale":"2024-04-25T10:10:21.260915+0000","last_undegraded":"2024-04-25T10:10:21.260915+0000","last_fullsized":"2024-04-25T10:10:21.260915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:25.026107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793376+0000","last_change":"2024-04-25T10:10:20.256509+0000","last_active":"2024-04-25T10:10:21.793376+0000","last_peered":"2024-04-25T10:10:21.793376+0000","last_clean":"2024-04-25T10:10:21.793376+0000","last_became_active":"2024-04-25T10:10:20.256194+0000","last_became_peered":"2024-04-25T10:10:20.256194+0000","last_unstale":"2024-04-25T10:10:21.793376+0000","last_undegraded":"2024-04-25T10:10:21.793376+0000","last_fullsized":"2024-04-25T10:10:21.793376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793437+0000","last_change":"2024-04-25T10:10:19.247738+0000","last_active":"2024-04-25T10:10:21.793437+0000","last_peered":"2024-04-25T10:10:21.793437+0000","last_clean":"2024-04-25T10:10:21.793437+0000","last_became_active":"2024-04-25T10:10:19.247204+0000","last_became_peered":"2024-04-25T10:10:19.247204+0000","last_unstale":"2024-04-25T10:10:21.793437+0000","last_undegraded":"2024-04-25T10:10:21.793437+0000","last_fullsized":"2024-04-25T10:10:21.793437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:18.674170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792045+0000","last_change":"2024-04-25T10:10:20.250943+0000","last_active":"2024-04-25T10:10:21.792045+0000","last_peered":"2024-04-25T10:10:21.792045+0000","last_clean":"2024-04-25T10:10:21.792045+0000","last_became_active":"2024-04-25T10:10:20.250596+0000","last_became_peered":"2024-04-25T10:10:20.250596+0000","last_unstale":"2024-04-25T10:10:21.792045+0000","last_undegraded":"2024-04-25T10:10:21.792045+0000","last_fullsized":"2024-04-25T10:10:21.792045+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:04.374172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256833+0000","last_change":"2024-04-25T10:10:19.257554+0000","last_active":"2024-04-25T10:10:21.256833+0000","last_peered":"2024-04-25T10:10:21.256833+0000","last_clean":"2024-04-25T10:10:21.256833+0000","last_became_active":"2024-04-25T10:10:19.257255+0000","last_became_peered":"2024-04-25T10:10:19.257255+0000","last_unstale":"2024-04-25T10:10:21.256833+0000","last_undegraded":"2024-04-25T10:10:21.256833+0000","last_fullsized":"2024-04-25T10:10:21.256833+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:43.902993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258536+0000","last_change":"2024-04-25T10:10:20.252107+0000","last_active":"2024-04-25T10:10:21.258536+0000","last_peered":"2024-04-25T10:10:21.258536+0000","last_clean":"2024-04-25T10:10:21.258536+0000","last_became_active":"2024-04-25T10:10:20.251794+0000","last_became_peered":"2024-04-25T10:10:20.251794+0000","last_unstale":"2024-04-25T10:10:21.258536+0000","last_undegraded":"2024-04-25T10:10:21.258536+0000","last_fullsized":"2024-04-25T10:10:21.258536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:25.614170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791861+0000","last_change":"2024-04-25T10:10:19.249667+0000","last_active":"2024-04-25T10:10:21.791861+0000","last_peered":"2024-04-25T10:10:21.791861+0000","last_clean":"2024-04-25T10:10:21.791861+0000","last_became_active":"2024-04-25T10:10:19.247060+0000","last_became_peered":"2024-04-25T10:10:19.247060+0000","last_unstale":"2024-04-25T10:10:21.791861+0000","last_undegraded":"2024-04-25T10:10:21.791861+0000","last_fullsized":"2024-04-25T10:10:21.791861+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:01.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":303,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256960+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:10:21.256960+0000","last_peered":"2024-04-25T10:10:21.256960+0000","last_clean":"2024-04-25T10:10:21.256960+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:10:21.256960+0000","last_undegraded":"2024-04-25T10:10:21.256960+0000","last_fullsized":"2024-04-25T10:10:21.256960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1115413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":527205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":525149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542228,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":525059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1757184,"data_stored":1117675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:10:24.365 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:10:24.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.534+0000 7f31cfa00640 1 Processor -- start 2024-04-25T10:10:24.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.534+0000 7f31cfa00640 1 -- start start 2024-04-25T10:10:24.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cfa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31c8144140 0x7f31c80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cfa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c815ac60 con 0x7f31c806ead0 2024-04-25T10:10:24.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cfa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c80cf3e0 con 0x7f31c80ced60 2024-04-25T10:10:24.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cfa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31c815af20 con 0x7f31c8144140 2024-04-25T10:10:24.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cda00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f31c806ead0 0x7f31c80b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44442/0 (socket says 172.21.15.18:44442) 2024-04-25T10:10:24.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cda00640 1 -- 172.21.15.18:0/2772679567 learned_addr learned my addr 172.21.15.18:0/2772679567 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 --2- 172.21.15.18:0/2772679567 >> v2:172.21.15.167:3300/0 conn(0x7f31c8144140 0x7f31c80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527559345 0 0) 0x7f31c815ac60 con 0x7f31c806ead0 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b0003530 con 0x7f31c806ead0 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018494755 0 0) 0x7f31b0003530 con 0x7f31c806ead0 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 >> v2:172.21.15.167:3300/0 conn(0x7f31c8144140 msgr2=0x7f31c80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 --2- 172.21.15.18:0/2772679567 >> v2:172.21.15.167:3300/0 conn(0x7f31c8144140 0x7f31c80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 >> v1:172.21.15.167:6789/0 conn(0x7f31c80ced60 legacy=0x7f31c806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c815b200 con 0x7f31c806ead0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f31c0001a00 con 0x7f31c806ead0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 >> v1:172.21.15.18:6789/0 conn(0x7f31c806ead0 legacy=0x7f31c80b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 0x7f31b0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31b0004810 0x7f31b0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00051d0 0x7f31b000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815af20 con 0x7f31b00039c0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000c070 con 0x7f31b0004810 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000c270 con 0x7f31b00051d0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 0x7f31b0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31c7e00640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31b0004810 0x7f31b0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cda00640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00051d0 0x7f31b000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 -- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00051d0 msgr2=0x7f31b000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00051d0 0x7f31b000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 -- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31b0004810 msgr2=0x7f31b0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31b0004810 0x7f31b0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cd000640 1 -- 172.21.15.18:0/2772679567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0003530 con 0x7f31b00039c0 2024-04-25T10:10:24.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.538+0000 7f31cda00640 1 -- 172.21.15.18:0/2772679567 reap_dead start 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cd000640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 0x7f31b0003de0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ae0 tx=0x7f31bc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e68cad17a140cdea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0096b0 con 0x7f31b00039c0 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31bc0a6470 con 0x7f31b00039c0 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31c7400640 1 -- 172.21.15.18:0/2772679567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc0a6860 con 0x7f31b00039c0 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 msgr2=0x7f31b0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 0x7f31b0003de0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009ae0 tx=0x7f31bc01ca90 comp rx=0 tx=0).stop 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- 172.21.15.18:0/2772679567 shutdown_connections 2024-04-25T10:10:24.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2772679567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31b00039c0 0x7f31b0003de0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- 172.21.15.18:0/2772679567 >> 172.21.15.18:0/2772679567 conn(0x7f31c8066fa0 msgr2=0x7f31c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:24.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- 172.21.15.18:0/2772679567 shutdown_connections 2024-04-25T10:10:24.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- 172.21.15.18:0/2772679567 wait complete. 2024-04-25T10:10:24.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 Processor -- start 2024-04-25T10:10:24.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.542+0000 7f31cfa00640 1 -- start start 2024-04-25T10:10:24.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 0x7f31c814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c81657c0 0x7f31c8165c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815bb80 con 0x7f31c81420c0 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815ba00 con 0x7f31c81657c0 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c815ea60 con 0x7f31b00039c0 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46708/0 (socket says 172.21.15.18:46708) 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 -- 172.21.15.18:0/2743159027 learned_addr learned my addr 172.21.15.18:0/2743159027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:24.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cd000640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 0x7f31c814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cda00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c81657c0 0x7f31c8165c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 -- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 msgr2=0x7f31c814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 0x7f31c814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 -- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c81657c0 msgr2=0x7f31c8165c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c81657c0 0x7f31c8165c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 -- 172.21.15.18:0/2743159027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8142b80 con 0x7f31c81420c0 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cd000640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 0x7f31c814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c7e00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e4d0 tx=0x7f31b400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b40053a0 con 0x7f31c81420c0 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4018070 con 0x7f31c81420c0 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4003820 con 0x7f31c81420c0 2024-04-25T10:10:24.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c8142e60 con 0x7f31c81420c0 2024-04-25T10:10:24.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c814f9d0 con 0x7f31c81420c0 2024-04-25T10:10:24.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.546+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c814f4e0 con 0x7f31c81420c0 2024-04-25T10:10:24.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.550+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31b40039c0 con 0x7f31c81420c0 2024-04-25T10:10:24.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.550+0000 7f31c4c00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 0x7f31a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.550+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f31b4084eb0 con 0x7f31c81420c0 2024-04-25T10:10:24.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.550+0000 7f31cd000640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 0x7f31a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.550+0000 7f31cd000640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 0x7f31a8069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0ad000 tx=0x7f31bc0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.554+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31b4055d30 con 0x7f31c81420c0 2024-04-25T10:10:24.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.710+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31c80745d0 con 0x7f31a8066f60 2024-04-25T10:10:24.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.718+0000 7f31c4c00640 1 -- 172.21.15.18:0/2743159027 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252076 (secure 0 0 0) 0x7f31c80745d0 con 0x7f31a8066f60 2024-04-25T10:10:24.732 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:24.734 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:10:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 msgr2=0x7f31a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 0x7f31a8069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0ad000 tx=0x7f31bc0046d0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 msgr2=0x7f31c8142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f31b400e4d0 tx=0x7f31b400e990 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 shutdown_connections 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31c81657c0 0x7f31c8165c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c81420c0 0x7f31c8142540 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31a8066f60 0x7f31a8069420 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 --2- 172.21.15.18:0/2743159027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31b00039c0 0x7f31c814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 >> 172.21.15.18:0/2743159027 conn(0x7f31c8066fa0 msgr2=0x7f31c8159e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 shutdown_connections 2024-04-25T10:10:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.722+0000 7f31cfa00640 1 -- 172.21.15.18:0/2743159027 wait complete. 2024-04-25T10:10:24.747 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-04-25T10:10:23.494345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259576,"kb_used_data":10120,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715144,"statfs":{"total":773094113280,"available":772828307456,"internally_reserved":0,"allocated":10362880,"data_stored":5385468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.270274"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253724+0000","last_change":"2024-04-25T10:10:20.261892+0000","last_active":"2024-04-25T10:10:21.253724+0000","last_peered":"2024-04-25T10:10:21.253724+0000","last_clean":"2024-04-25T10:10:21.253724+0000","last_became_active":"2024-04-25T10:10:20.261447+0000","last_became_peered":"2024-04-25T10:10:20.261447+0000","last_unstale":"2024-04-25T10:10:21.253724+0000","last_undegraded":"2024-04-25T10:10:21.253724+0000","last_fullsized":"2024-04-25T10:10:21.253724+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:03.314519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261204+0000","last_change":"2024-04-25T10:10:20.256432+0000","last_active":"2024-04-25T10:10:21.261204+0000","last_peered":"2024-04-25T10:10:21.261204+0000","last_clean":"2024-04-25T10:10:21.261204+0000","last_became_active":"2024-04-25T10:10:20.256111+0000","last_became_peered":"2024-04-25T10:10:20.256111+0000","last_unstale":"2024-04-25T10:10:21.261204+0000","last_undegraded":"2024-04-25T10:10:21.261204+0000","last_fullsized":"2024-04-25T10:10:21.261204+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.983551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253381+0000","last_change":"2024-04-25T10:10:20.254960+0000","last_active":"2024-04-25T10:10:21.253381+0000","last_peered":"2024-04-25T10:10:21.253381+0000","last_clean":"2024-04-25T10:10:21.253381+0000","last_became_active":"2024-04-25T10:10:20.254669+0000","last_became_peered":"2024-04-25T10:10:20.254669+0000","last_unstale":"2024-04-25T10:10:21.253381+0000","last_undegraded":"2024-04-25T10:10:21.253381+0000","last_fullsized":"2024-04-25T10:10:21.253381+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:52.723214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791422+0000","last_change":"2024-04-25T10:10:20.263573+0000","last_active":"2024-04-25T10:10:21.791422+0000","last_peered":"2024-04-25T10:10:21.791422+0000","last_clean":"2024-04-25T10:10:21.791422+0000","last_became_active":"2024-04-25T10:10:20.262153+0000","last_became_peered":"2024-04-25T10:10:20.262153+0000","last_unstale":"2024-04-25T10:10:21.791422+0000","last_undegraded":"2024-04-25T10:10:21.791422+0000","last_fullsized":"2024-04-25T10:10:21.791422+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257478+0000","last_change":"2024-04-25T10:10:20.252661+0000","last_active":"2024-04-25T10:10:21.257478+0000","last_peered":"2024-04-25T10:10:21.257478+0000","last_clean":"2024-04-25T10:10:21.257478+0000","last_became_active":"2024-04-25T10:10:20.249372+0000","last_became_peered":"2024-04-25T10:10:20.249372+0000","last_unstale":"2024-04-25T10:10:21.257478+0000","last_undegraded":"2024-04-25T10:10:21.257478+0000","last_fullsized":"2024-04-25T10:10:21.257478+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791180+0000","last_change":"2024-04-25T10:10:20.264570+0000","last_active":"2024-04-25T10:10:21.791180+0000","last_peered":"2024-04-25T10:10:21.791180+0000","last_clean":"2024-04-25T10:10:21.791180+0000","last_became_active":"2024-04-25T10:10:20.264269+0000","last_became_peered":"2024-04-25T10:10:20.264269+0000","last_unstale":"2024-04-25T10:10:21.791180+0000","last_undegraded":"2024-04-25T10:10:21.791180+0000","last_fullsized":"2024-04-25T10:10:21.791180+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:06.899931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257096+0000","last_change":"2024-04-25T10:10:20.257354+0000","last_active":"2024-04-25T10:10:21.257096+0000","last_peered":"2024-04-25T10:10:21.257096+0000","last_clean":"2024-04-25T10:10:21.257096+0000","last_became_active":"2024-04-25T10:10:20.255791+0000","last_became_peered":"2024-04-25T10:10:20.255791+0000","last_unstale":"2024-04-25T10:10:21.257096+0000","last_undegraded":"2024-04-25T10:10:21.257096+0000","last_fullsized":"2024-04-25T10:10:21.257096+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:30.350077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791270+0000","last_change":"2024-04-25T10:10:20.254510+0000","last_active":"2024-04-25T10:10:21.791270+0000","last_peered":"2024-04-25T10:10:21.791270+0000","last_clean":"2024-04-25T10:10:21.791270+0000","last_became_active":"2024-04-25T10:10:20.253674+0000","last_became_peered":"2024-04-25T10:10:20.253674+0000","last_unstale":"2024-04-25T10:10:21.791270+0000","last_undegraded":"2024-04-25T10:10:21.791270+0000","last_fullsized":"2024-04-25T10:10:21.791270+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:05.777569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257821+0000","last_change":"2024-04-25T10:10:20.259147+0000","last_active":"2024-04-25T10:10:21.257821+0000","last_peered":"2024-04-25T10:10:21.257821+0000","last_clean":"2024-04-25T10:10:21.257821+0000","last_became_active":"2024-04-25T10:10:20.257732+0000","last_became_peered":"2024-04-25T10:10:20.257732+0000","last_unstale":"2024-04-25T10:10:21.257821+0000","last_undegraded":"2024-04-25T10:10:21.257821+0000","last_fullsized":"2024-04-25T10:10:21.257821+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:42.342450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792395+0000","last_change":"2024-04-25T10:10:20.258983+0000","last_active":"2024-04-25T10:10:21.792395+0000","last_peered":"2024-04-25T10:10:21.792395+0000","last_clean":"2024-04-25T10:10:21.792395+0000","last_became_active":"2024-04-25T10:10:20.254525+0000","last_became_peered":"2024-04-25T10:10:20.254525+0000","last_unstale":"2024-04-25T10:10:21.792395+0000","last_undegraded":"2024-04-25T10:10:21.792395+0000","last_fullsized":"2024-04-25T10:10:21.792395+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:37.441288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257891+0000","last_change":"2024-04-25T10:10:20.261735+0000","last_active":"2024-04-25T10:10:21.257891+0000","last_peered":"2024-04-25T10:10:21.257891+0000","last_clean":"2024-04-25T10:10:21.257891+0000","last_became_active":"2024-04-25T10:10:20.261338+0000","last_became_peered":"2024-04-25T10:10:20.261338+0000","last_unstale":"2024-04-25T10:10:21.257891+0000","last_undegraded":"2024-04-25T10:10:21.257891+0000","last_fullsized":"2024-04-25T10:10:21.257891+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:48.464051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792181+0000","last_change":"2024-04-25T10:10:20.242139+0000","last_active":"2024-04-25T10:10:21.792181+0000","last_peered":"2024-04-25T10:10:21.792181+0000","last_clean":"2024-04-25T10:10:21.792181+0000","last_became_active":"2024-04-25T10:10:20.241816+0000","last_became_peered":"2024-04-25T10:10:20.241816+0000","last_unstale":"2024-04-25T10:10:21.792181+0000","last_undegraded":"2024-04-25T10:10:21.792181+0000","last_fullsized":"2024-04-25T10:10:21.792181+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:54.322372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791423+0000","last_change":"2024-04-25T10:10:20.252401+0000","last_active":"2024-04-25T10:10:21.791423+0000","last_peered":"2024-04-25T10:10:21.791423+0000","last_clean":"2024-04-25T10:10:21.791423+0000","last_became_active":"2024-04-25T10:10:20.252104+0000","last_became_peered":"2024-04-25T10:10:20.252104+0000","last_unstale":"2024-04-25T10:10:21.791423+0000","last_undegraded":"2024-04-25T10:10:21.791423+0000","last_fullsized":"2024-04-25T10:10:21.791423+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257562+0000","last_change":"2024-04-25T10:10:20.270898+0000","last_active":"2024-04-25T10:10:21.257562+0000","last_peered":"2024-04-25T10:10:21.257562+0000","last_clean":"2024-04-25T10:10:21.257562+0000","last_became_active":"2024-04-25T10:10:20.270582+0000","last_became_peered":"2024-04-25T10:10:20.270582+0000","last_unstale":"2024-04-25T10:10:21.257562+0000","last_undegraded":"2024-04-25T10:10:21.257562+0000","last_fullsized":"2024-04-25T10:10:21.257562+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790932+0000","last_change":"2024-04-25T10:10:20.258552+0000","last_active":"2024-04-25T10:10:21.790932+0000","last_peered":"2024-04-25T10:10:21.790932+0000","last_clean":"2024-04-25T10:10:21.790932+0000","last_became_active":"2024-04-25T10:10:20.255118+0000","last_became_peered":"2024-04-25T10:10:20.255118+0000","last_unstale":"2024-04-25T10:10:21.790932+0000","last_undegraded":"2024-04-25T10:10:21.790932+0000","last_fullsized":"2024-04-25T10:10:21.790932+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:17.791570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790830+0000","last_change":"2024-04-25T10:10:20.256255+0000","last_active":"2024-04-25T10:10:21.790830+0000","last_peered":"2024-04-25T10:10:21.790830+0000","last_clean":"2024-04-25T10:10:21.790830+0000","last_became_active":"2024-04-25T10:10:20.255740+0000","last_became_peered":"2024-04-25T10:10:20.255740+0000","last_unstale":"2024-04-25T10:10:21.790830+0000","last_undegraded":"2024-04-25T10:10:21.790830+0000","last_fullsized":"2024-04-25T10:10:21.790830+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:41.001050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792724+0000","last_change":"2024-04-25T10:10:20.250972+0000","last_active":"2024-04-25T10:10:21.792724+0000","last_peered":"2024-04-25T10:10:21.792724+0000","last_clean":"2024-04-25T10:10:21.792724+0000","last_became_active":"2024-04-25T10:10:20.250665+0000","last_became_peered":"2024-04-25T10:10:20.250665+0000","last_unstale":"2024-04-25T10:10:21.792724+0000","last_undegraded":"2024-04-25T10:10:21.792724+0000","last_fullsized":"2024-04-25T10:10:21.792724+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:45:17.741585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253406+0000","last_change":"2024-04-25T10:10:20.256431+0000","last_active":"2024-04-25T10:10:21.253406+0000","last_peered":"2024-04-25T10:10:21.253406+0000","last_clean":"2024-04-25T10:10:21.253406+0000","last_became_active":"2024-04-25T10:10:20.256164+0000","last_became_peered":"2024-04-25T10:10:20.256164+0000","last_unstale":"2024-04-25T10:10:21.253406+0000","last_undegraded":"2024-04-25T10:10:21.253406+0000","last_fullsized":"2024-04-25T10:10:21.253406+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:05.181006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258063+0000","last_change":"2024-04-25T10:10:20.265107+0000","last_active":"2024-04-25T10:10:21.258063+0000","last_peered":"2024-04-25T10:10:21.258063+0000","last_clean":"2024-04-25T10:10:21.258063+0000","last_became_active":"2024-04-25T10:10:20.264614+0000","last_became_peered":"2024-04-25T10:10:20.264614+0000","last_unstale":"2024-04-25T10:10:21.258063+0000","last_undegraded":"2024-04-25T10:10:21.258063+0000","last_fullsized":"2024-04-25T10:10:21.258063+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:40.914011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791580+0000","last_change":"2024-04-25T10:10:20.253537+0000","last_active":"2024-04-25T10:10:21.791580+0000","last_peered":"2024-04-25T10:10:21.791580+0000","last_clean":"2024-04-25T10:10:21.791580+0000","last_became_active":"2024-04-25T10:10:20.253278+0000","last_became_peered":"2024-04-25T10:10:20.253278+0000","last_unstale":"2024-04-25T10:10:21.791580+0000","last_undegraded":"2024-04-25T10:10:21.791580+0000","last_fullsized":"2024-04-25T10:10:21.791580+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257357+0000","last_change":"2024-04-25T10:10:20.253805+0000","last_active":"2024-04-25T10:10:21.257357+0000","last_peered":"2024-04-25T10:10:21.257357+0000","last_clean":"2024-04-25T10:10:21.257357+0000","last_became_active":"2024-04-25T10:10:20.251752+0000","last_became_peered":"2024-04-25T10:10:20.251752+0000","last_unstale":"2024-04-25T10:10:21.257357+0000","last_undegraded":"2024-04-25T10:10:21.257357+0000","last_fullsized":"2024-04-25T10:10:21.257357+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257867+0000","last_change":"2024-04-25T10:10:20.264514+0000","last_active":"2024-04-25T10:10:21.257867+0000","last_peered":"2024-04-25T10:10:21.257867+0000","last_clean":"2024-04-25T10:10:21.257867+0000","last_became_active":"2024-04-25T10:10:20.263854+0000","last_became_peered":"2024-04-25T10:10:20.263854+0000","last_unstale":"2024-04-25T10:10:21.257867+0000","last_undegraded":"2024-04-25T10:10:21.257867+0000","last_fullsized":"2024-04-25T10:10:21.257867+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:44.909359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793371+0000","last_change":"2024-04-25T10:10:20.256670+0000","last_active":"2024-04-25T10:10:21.793371+0000","last_peered":"2024-04-25T10:10:21.793371+0000","last_clean":"2024-04-25T10:10:21.793371+0000","last_became_active":"2024-04-25T10:10:20.256265+0000","last_became_peered":"2024-04-25T10:10:20.256265+0000","last_unstale":"2024-04-25T10:10:21.793371+0000","last_undegraded":"2024-04-25T10:10:21.793371+0000","last_fullsized":"2024-04-25T10:10:21.793371+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:05.777569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253103+0000","last_change":"2024-04-25T10:10:20.253142+0000","last_active":"2024-04-25T10:10:21.253103+0000","last_peered":"2024-04-25T10:10:21.253103+0000","last_clean":"2024-04-25T10:10:21.253103+0000","last_became_active":"2024-04-25T10:10:20.252603+0000","last_became_peered":"2024-04-25T10:10:20.252603+0000","last_unstale":"2024-04-25T10:10:21.253103+0000","last_undegraded":"2024-04-25T10:10:21.253103+0000","last_fullsized":"2024-04-25T10:10:21.253103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:35:50.752058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261172+0000","last_change":"2024-04-25T10:10:20.257580+0000","last_active":"2024-04-25T10:10:21.261172+0000","last_peered":"2024-04-25T10:10:21.261172+0000","last_clean":"2024-04-25T10:10:21.261172+0000","last_became_active":"2024-04-25T10:10:20.257367+0000","last_became_peered":"2024-04-25T10:10:20.257367+0000","last_unstale":"2024-04-25T10:10:21.261172+0000","last_undegraded":"2024-04-25T10:10:21.261172+0000","last_fullsized":"2024-04-25T10:10:21.261172+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:16.696124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257737+0000","last_change":"2024-04-25T10:10:20.264748+0000","last_active":"2024-04-25T10:10:21.257737+0000","last_peered":"2024-04-25T10:10:21.257737+0000","last_clean":"2024-04-25T10:10:21.257737+0000","last_became_active":"2024-04-25T10:10:20.264447+0000","last_became_peered":"2024-04-25T10:10:20.264447+0000","last_unstale":"2024-04-25T10:10:21.257737+0000","last_undegraded":"2024-04-25T10:10:21.257737+0000","last_fullsized":"2024-04-25T10:10:21.257737+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:59.325348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792363+0000","last_change":"2024-04-25T10:10:20.245231+0000","last_active":"2024-04-25T10:10:21.792363+0000","last_peered":"2024-04-25T10:10:21.792363+0000","last_clean":"2024-04-25T10:10:21.792363+0000","last_became_active":"2024-04-25T10:10:20.243711+0000","last_became_peered":"2024-04-25T10:10:20.243711+0000","last_unstale":"2024-04-25T10:10:21.792363+0000","last_undegraded":"2024-04-25T10:10:21.792363+0000","last_fullsized":"2024-04-25T10:10:21.792363+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:40.529221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791741+0000","last_change":"2024-04-25T10:10:20.264678+0000","last_active":"2024-04-25T10:10:21.791741+0000","last_peered":"2024-04-25T10:10:21.791741+0000","last_clean":"2024-04-25T10:10:21.791741+0000","last_became_active":"2024-04-25T10:10:20.263557+0000","last_became_peered":"2024-04-25T10:10:20.263557+0000","last_unstale":"2024-04-25T10:10:21.791741+0000","last_undegraded":"2024-04-25T10:10:21.791741+0000","last_fullsized":"2024-04-25T10:10:21.791741+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:59.325348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257521+0000","last_change":"2024-04-25T10:10:20.258730+0000","last_active":"2024-04-25T10:10:21.257521+0000","last_peered":"2024-04-25T10:10:21.257521+0000","last_clean":"2024-04-25T10:10:21.257521+0000","last_became_active":"2024-04-25T10:10:20.258370+0000","last_became_peered":"2024-04-25T10:10:20.258370+0000","last_unstale":"2024-04-25T10:10:21.257521+0000","last_undegraded":"2024-04-25T10:10:21.257521+0000","last_fullsized":"2024-04-25T10:10:21.257521+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:12.576984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258175+0000","last_change":"2024-04-25T10:10:20.253409+0000","last_active":"2024-04-25T10:10:21.258175+0000","last_peered":"2024-04-25T10:10:21.258175+0000","last_clean":"2024-04-25T10:10:21.258175+0000","last_became_active":"2024-04-25T10:10:20.253081+0000","last_became_peered":"2024-04-25T10:10:20.253081+0000","last_unstale":"2024-04-25T10:10:21.258175+0000","last_undegraded":"2024-04-25T10:10:21.258175+0000","last_fullsized":"2024-04-25T10:10:21.258175+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260835+0000","last_change":"2024-04-25T10:10:20.263132+0000","last_active":"2024-04-25T10:10:21.260835+0000","last_peered":"2024-04-25T10:10:21.260835+0000","last_clean":"2024-04-25T10:10:21.260835+0000","last_became_active":"2024-04-25T10:10:20.262794+0000","last_became_peered":"2024-04-25T10:10:20.262794+0000","last_unstale":"2024-04-25T10:10:21.260835+0000","last_undegraded":"2024-04-25T10:10:21.260835+0000","last_fullsized":"2024-04-25T10:10:21.260835+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:07.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790970+0000","last_change":"2024-04-25T10:10:20.255947+0000","last_active":"2024-04-25T10:10:21.790970+0000","last_peered":"2024-04-25T10:10:21.790970+0000","last_clean":"2024-04-25T10:10:21.790970+0000","last_became_active":"2024-04-25T10:10:20.255529+0000","last_became_peered":"2024-04-25T10:10:20.255529+0000","last_unstale":"2024-04-25T10:10:21.790970+0000","last_undegraded":"2024-04-25T10:10:21.790970+0000","last_fullsized":"2024-04-25T10:10:21.790970+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:32.792792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792455+0000","last_change":"2024-04-25T10:10:20.260529+0000","last_active":"2024-04-25T10:10:21.792455+0000","last_peered":"2024-04-25T10:10:21.792455+0000","last_clean":"2024-04-25T10:10:21.792455+0000","last_became_active":"2024-04-25T10:10:20.260227+0000","last_became_peered":"2024-04-25T10:10:20.260227+0000","last_unstale":"2024-04-25T10:10:21.792455+0000","last_undegraded":"2024-04-25T10:10:21.792455+0000","last_fullsized":"2024-04-25T10:10:21.792455+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:59.565657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"92'4","reported_seq":18,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793707+0000","last_change":"2024-04-25T10:10:19.256431+0000","last_active":"2024-04-25T10:10:21.793707+0000","last_peered":"2024-04-25T10:10:21.793707+0000","last_clean":"2024-04-25T10:10:21.793707+0000","last_became_active":"2024-04-25T10:10:19.256106+0000","last_became_peered":"2024-04-25T10:10:19.256106+0000","last_unstale":"2024-04-25T10:10:21.793707+0000","last_undegraded":"2024-04-25T10:10:21.793707+0000","last_fullsized":"2024-04-25T10:10:21.793707+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:01.170942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792444+0000","last_change":"2024-04-25T10:10:20.259058+0000","last_active":"2024-04-25T10:10:21.792444+0000","last_peered":"2024-04-25T10:10:21.792444+0000","last_clean":"2024-04-25T10:10:21.792444+0000","last_became_active":"2024-04-25T10:10:20.258245+0000","last_became_peered":"2024-04-25T10:10:20.258245+0000","last_unstale":"2024-04-25T10:10:21.792444+0000","last_undegraded":"2024-04-25T10:10:21.792444+0000","last_fullsized":"2024-04-25T10:10:21.792444+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:07.951974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257933+0000","last_change":"2024-04-25T10:10:19.249781+0000","last_active":"2024-04-25T10:10:21.257933+0000","last_peered":"2024-04-25T10:10:21.257933+0000","last_clean":"2024-04-25T10:10:21.257933+0000","last_became_active":"2024-04-25T10:10:19.247643+0000","last_became_peered":"2024-04-25T10:10:19.247643+0000","last_unstale":"2024-04-25T10:10:21.257933+0000","last_undegraded":"2024-04-25T10:10:21.257933+0000","last_fullsized":"2024-04-25T10:10:21.257933+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:01.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258500+0000","last_change":"2024-04-25T10:10:20.262825+0000","last_active":"2024-04-25T10:10:21.258500+0000","last_peered":"2024-04-25T10:10:21.258500+0000","last_clean":"2024-04-25T10:10:21.258500+0000","last_became_active":"2024-04-25T10:10:20.262511+0000","last_became_peered":"2024-04-25T10:10:20.262511+0000","last_unstale":"2024-04-25T10:10:21.258500+0000","last_undegraded":"2024-04-25T10:10:21.258500+0000","last_fullsized":"2024-04-25T10:10:21.258500+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:31.156810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258559+0000","last_change":"2024-04-25T10:10:19.258361+0000","last_active":"2024-04-25T10:10:21.258559+0000","last_peered":"2024-04-25T10:10:21.258559+0000","last_clean":"2024-04-25T10:10:21.258559+0000","last_became_active":"2024-04-25T10:10:19.258055+0000","last_became_peered":"2024-04-25T10:10:19.258055+0000","last_unstale":"2024-04-25T10:10:21.258559+0000","last_undegraded":"2024-04-25T10:10:21.258559+0000","last_fullsized":"2024-04-25T10:10:21.258559+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:24.931999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792726+0000","last_change":"2024-04-25T10:10:20.248725+0000","last_active":"2024-04-25T10:10:21.792726+0000","last_peered":"2024-04-25T10:10:21.792726+0000","last_clean":"2024-04-25T10:10:21.792726+0000","last_became_active":"2024-04-25T10:10:20.248393+0000","last_became_peered":"2024-04-25T10:10:20.248393+0000","last_unstale":"2024-04-25T10:10:21.792726+0000","last_undegraded":"2024-04-25T10:10:21.792726+0000","last_fullsized":"2024-04-25T10:10:21.792726+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:31.363155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793474+0000","last_change":"2024-04-25T10:10:19.254951+0000","last_active":"2024-04-25T10:10:21.793474+0000","last_peered":"2024-04-25T10:10:21.793474+0000","last_clean":"2024-04-25T10:10:21.793474+0000","last_became_active":"2024-04-25T10:10:19.254691+0000","last_became_peered":"2024-04-25T10:10:19.254691+0000","last_unstale":"2024-04-25T10:10:21.793474+0000","last_undegraded":"2024-04-25T10:10:21.793474+0000","last_fullsized":"2024-04-25T10:10:21.793474+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:13.479590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791801+0000","last_change":"2024-04-25T10:10:20.254750+0000","last_active":"2024-04-25T10:10:21.791801+0000","last_peered":"2024-04-25T10:10:21.791801+0000","last_clean":"2024-04-25T10:10:21.791801+0000","last_became_active":"2024-04-25T10:10:20.253994+0000","last_became_peered":"2024-04-25T10:10:20.253994+0000","last_unstale":"2024-04-25T10:10:21.791801+0000","last_undegraded":"2024-04-25T10:10:21.791801+0000","last_fullsized":"2024-04-25T10:10:21.791801+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:42.342450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257411+0000","last_change":"2024-04-25T10:10:19.251349+0000","last_active":"2024-04-25T10:10:21.257411+0000","last_peered":"2024-04-25T10:10:21.257411+0000","last_clean":"2024-04-25T10:10:21.257411+0000","last_became_active":"2024-04-25T10:10:19.250847+0000","last_became_peered":"2024-04-25T10:10:19.250847+0000","last_unstale":"2024-04-25T10:10:21.257411+0000","last_undegraded":"2024-04-25T10:10:21.257411+0000","last_fullsized":"2024-04-25T10:10:21.257411+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:25:39.285057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793432+0000","last_change":"2024-04-25T10:10:20.255196+0000","last_active":"2024-04-25T10:10:21.793432+0000","last_peered":"2024-04-25T10:10:21.793432+0000","last_clean":"2024-04-25T10:10:21.793432+0000","last_became_active":"2024-04-25T10:10:20.253764+0000","last_became_peered":"2024-04-25T10:10:20.253764+0000","last_unstale":"2024-04-25T10:10:21.793432+0000","last_undegraded":"2024-04-25T10:10:21.793432+0000","last_fullsized":"2024-04-25T10:10:21.793432+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:26.032473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791218+0000","last_change":"2024-04-25T10:10:19.258044+0000","last_active":"2024-04-25T10:10:21.791218+0000","last_peered":"2024-04-25T10:10:21.791218+0000","last_clean":"2024-04-25T10:10:21.791218+0000","last_became_active":"2024-04-25T10:10:19.256861+0000","last_became_peered":"2024-04-25T10:10:19.256861+0000","last_unstale":"2024-04-25T10:10:21.791218+0000","last_undegraded":"2024-04-25T10:10:21.791218+0000","last_fullsized":"2024-04-25T10:10:21.791218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:14.385527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791317+0000","last_change":"2024-04-25T10:10:20.264448+0000","last_active":"2024-04-25T10:10:21.791317+0000","last_peered":"2024-04-25T10:10:21.791317+0000","last_clean":"2024-04-25T10:10:21.791317+0000","last_became_active":"2024-04-25T10:10:20.263858+0000","last_became_peered":"2024-04-25T10:10:20.263858+0000","last_unstale":"2024-04-25T10:10:21.791317+0000","last_undegraded":"2024-04-25T10:10:21.791317+0000","last_fullsized":"2024-04-25T10:10:21.791317+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:03:02.693158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253101+0000","last_change":"2024-04-25T10:10:19.246605+0000","last_active":"2024-04-25T10:10:21.253101+0000","last_peered":"2024-04-25T10:10:21.253101+0000","last_clean":"2024-04-25T10:10:21.253101+0000","last_became_active":"2024-04-25T10:10:19.246317+0000","last_became_peered":"2024-04-25T10:10:19.246317+0000","last_unstale":"2024-04-25T10:10:21.253101+0000","last_undegraded":"2024-04-25T10:10:21.253101+0000","last_fullsized":"2024-04-25T10:10:21.253101+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:26.095795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791499+0000","last_change":"2024-04-25T10:10:20.251788+0000","last_active":"2024-04-25T10:10:21.791499+0000","last_peered":"2024-04-25T10:10:21.791499+0000","last_clean":"2024-04-25T10:10:21.791499+0000","last_became_active":"2024-04-25T10:10:20.251509+0000","last_became_peered":"2024-04-25T10:10:20.251509+0000","last_unstale":"2024-04-25T10:10:21.791499+0000","last_undegraded":"2024-04-25T10:10:21.791499+0000","last_fullsized":"2024-04-25T10:10:21.791499+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256863+0000","last_change":"2024-04-25T10:10:19.254976+0000","last_active":"2024-04-25T10:10:21.256863+0000","last_peered":"2024-04-25T10:10:21.256863+0000","last_clean":"2024-04-25T10:10:21.256863+0000","last_became_active":"2024-04-25T10:10:19.254269+0000","last_became_peered":"2024-04-25T10:10:19.254269+0000","last_unstale":"2024-04-25T10:10:21.256863+0000","last_undegraded":"2024-04-25T10:10:21.256863+0000","last_fullsized":"2024-04-25T10:10:21.256863+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:47.457685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257543+0000","last_change":"2024-04-25T10:10:20.247429+0000","last_active":"2024-04-25T10:10:21.257543+0000","last_peered":"2024-04-25T10:10:21.257543+0000","last_clean":"2024-04-25T10:10:21.257543+0000","last_became_active":"2024-04-25T10:10:20.247149+0000","last_became_peered":"2024-04-25T10:10:20.247149+0000","last_unstale":"2024-04-25T10:10:21.257543+0000","last_undegraded":"2024-04-25T10:10:21.257543+0000","last_fullsized":"2024-04-25T10:10:21.257543+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:33.954123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261209+0000","last_change":"2024-04-25T10:10:19.254581+0000","last_active":"2024-04-25T10:10:21.261209+0000","last_peered":"2024-04-25T10:10:21.261209+0000","last_clean":"2024-04-25T10:10:21.261209+0000","last_became_active":"2024-04-25T10:10:19.254306+0000","last_became_peered":"2024-04-25T10:10:19.254306+0000","last_unstale":"2024-04-25T10:10:21.261209+0000","last_undegraded":"2024-04-25T10:10:21.261209+0000","last_fullsized":"2024-04-25T10:10:21.261209+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:40.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258762+0000","last_change":"2024-04-25T10:10:20.255636+0000","last_active":"2024-04-25T10:10:21.258762+0000","last_peered":"2024-04-25T10:10:21.258762+0000","last_clean":"2024-04-25T10:10:21.258762+0000","last_became_active":"2024-04-25T10:10:20.255275+0000","last_became_peered":"2024-04-25T10:10:20.255275+0000","last_unstale":"2024-04-25T10:10:21.258762+0000","last_undegraded":"2024-04-25T10:10:21.258762+0000","last_fullsized":"2024-04-25T10:10:21.258762+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:24.678599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253523+0000","last_change":"2024-04-25T10:10:19.249559+0000","last_active":"2024-04-25T10:10:21.253523+0000","last_peered":"2024-04-25T10:10:21.253523+0000","last_clean":"2024-04-25T10:10:21.253523+0000","last_became_active":"2024-04-25T10:10:19.249217+0000","last_became_peered":"2024-04-25T10:10:19.249217+0000","last_unstale":"2024-04-25T10:10:21.253523+0000","last_undegraded":"2024-04-25T10:10:21.253523+0000","last_fullsized":"2024-04-25T10:10:21.253523+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:01.511868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253550+0000","last_change":"2024-04-25T10:10:20.263700+0000","last_active":"2024-04-25T10:10:21.253550+0000","last_peered":"2024-04-25T10:10:21.253550+0000","last_clean":"2024-04-25T10:10:21.253550+0000","last_became_active":"2024-04-25T10:10:20.263408+0000","last_became_peered":"2024-04-25T10:10:20.263408+0000","last_unstale":"2024-04-25T10:10:21.253550+0000","last_undegraded":"2024-04-25T10:10:21.253550+0000","last_fullsized":"2024-04-25T10:10:21.253550+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:30.002478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"92'3","reported_seq":17,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258232+0000","last_change":"2024-04-25T10:10:19.254021+0000","last_active":"2024-04-25T10:10:21.258232+0000","last_peered":"2024-04-25T10:10:21.258232+0000","last_clean":"2024-04-25T10:10:21.258232+0000","last_became_active":"2024-04-25T10:10:19.253457+0000","last_became_peered":"2024-04-25T10:10:19.253457+0000","last_unstale":"2024-04-25T10:10:21.258232+0000","last_undegraded":"2024-04-25T10:10:21.258232+0000","last_fullsized":"2024-04-25T10:10:21.258232+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:39.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792031+0000","last_change":"2024-04-25T10:10:20.257794+0000","last_active":"2024-04-25T10:10:21.792031+0000","last_peered":"2024-04-25T10:10:21.792031+0000","last_clean":"2024-04-25T10:10:21.792031+0000","last_became_active":"2024-04-25T10:10:20.257520+0000","last_became_peered":"2024-04-25T10:10:20.257520+0000","last_unstale":"2024-04-25T10:10:21.792031+0000","last_undegraded":"2024-04-25T10:10:21.792031+0000","last_fullsized":"2024-04-25T10:10:21.792031+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:44.909359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"92'6","reported_seq":20,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792581+0000","last_change":"2024-04-25T10:10:19.254031+0000","last_active":"2024-04-25T10:10:21.792581+0000","last_peered":"2024-04-25T10:10:21.792581+0000","last_clean":"2024-04-25T10:10:21.792581+0000","last_became_active":"2024-04-25T10:10:19.253740+0000","last_became_peered":"2024-04-25T10:10:19.253740+0000","last_unstale":"2024-04-25T10:10:21.792581+0000","last_undegraded":"2024-04-25T10:10:21.792581+0000","last_fullsized":"2024-04-25T10:10:21.792581+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:24.607804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791710+0000","last_change":"2024-04-25T10:10:20.254291+0000","last_active":"2024-04-25T10:10:21.791710+0000","last_peered":"2024-04-25T10:10:21.791710+0000","last_clean":"2024-04-25T10:10:21.791710+0000","last_became_active":"2024-04-25T10:10:20.253625+0000","last_became_peered":"2024-04-25T10:10:20.253625+0000","last_unstale":"2024-04-25T10:10:21.791710+0000","last_undegraded":"2024-04-25T10:10:21.791710+0000","last_fullsized":"2024-04-25T10:10:21.791710+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:33.954123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258343+0000","last_change":"2024-04-25T10:10:19.254701+0000","last_active":"2024-04-25T10:10:21.258343+0000","last_peered":"2024-04-25T10:10:21.258343+0000","last_clean":"2024-04-25T10:10:21.258343+0000","last_became_active":"2024-04-25T10:10:19.254392+0000","last_became_peered":"2024-04-25T10:10:19.254392+0000","last_unstale":"2024-04-25T10:10:21.258343+0000","last_undegraded":"2024-04-25T10:10:21.258343+0000","last_fullsized":"2024-04-25T10:10:21.258343+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:39.907645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256898+0000","last_change":"2024-04-25T10:10:20.246723+0000","last_active":"2024-04-25T10:10:21.256898+0000","last_peered":"2024-04-25T10:10:21.256898+0000","last_clean":"2024-04-25T10:10:21.256898+0000","last_became_active":"2024-04-25T10:10:20.246441+0000","last_became_peered":"2024-04-25T10:10:20.246441+0000","last_unstale":"2024-04-25T10:10:21.256898+0000","last_undegraded":"2024-04-25T10:10:21.256898+0000","last_fullsized":"2024-04-25T10:10:21.256898+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791404+0000","last_change":"2024-04-25T10:10:19.253396+0000","last_active":"2024-04-25T10:10:21.791404+0000","last_peered":"2024-04-25T10:10:21.791404+0000","last_clean":"2024-04-25T10:10:21.791404+0000","last_became_active":"2024-04-25T10:10:19.253065+0000","last_became_peered":"2024-04-25T10:10:19.253065+0000","last_unstale":"2024-04-25T10:10:21.791404+0000","last_undegraded":"2024-04-25T10:10:21.791404+0000","last_fullsized":"2024-04-25T10:10:21.791404+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:30.150444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791259+0000","last_change":"2024-04-25T10:10:20.260787+0000","last_active":"2024-04-25T10:10:21.791259+0000","last_peered":"2024-04-25T10:10:21.791259+0000","last_clean":"2024-04-25T10:10:21.791259+0000","last_became_active":"2024-04-25T10:10:20.260535+0000","last_became_peered":"2024-04-25T10:10:20.260535+0000","last_unstale":"2024-04-25T10:10:21.791259+0000","last_undegraded":"2024-04-25T10:10:21.791259+0000","last_fullsized":"2024-04-25T10:10:21.791259+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:37:07.686617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792647+0000","last_change":"2024-04-25T10:10:19.246877+0000","last_active":"2024-04-25T10:10:21.792647+0000","last_peered":"2024-04-25T10:10:21.792647+0000","last_clean":"2024-04-25T10:10:21.792647+0000","last_became_active":"2024-04-25T10:10:19.246017+0000","last_became_peered":"2024-04-25T10:10:19.246017+0000","last_unstale":"2024-04-25T10:10:21.792647+0000","last_undegraded":"2024-04-25T10:10:21.792647+0000","last_fullsized":"2024-04-25T10:10:21.792647+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:39.941754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792431+0000","last_change":"2024-04-25T10:10:20.246304+0000","last_active":"2024-04-25T10:10:21.792431+0000","last_peered":"2024-04-25T10:10:21.792431+0000","last_clean":"2024-04-25T10:10:21.792431+0000","last_became_active":"2024-04-25T10:10:20.245995+0000","last_became_peered":"2024-04-25T10:10:20.245995+0000","last_unstale":"2024-04-25T10:10:21.792431+0000","last_undegraded":"2024-04-25T10:10:21.792431+0000","last_fullsized":"2024-04-25T10:10:21.792431+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:14:37.475297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"92'8","reported_seq":22,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791823+0000","last_change":"2024-04-25T10:10:19.252240+0000","last_active":"2024-04-25T10:10:21.791823+0000","last_peered":"2024-04-25T10:10:21.791823+0000","last_clean":"2024-04-25T10:10:21.791823+0000","last_became_active":"2024-04-25T10:10:19.251960+0000","last_became_peered":"2024-04-25T10:10:19.251960+0000","last_unstale":"2024-04-25T10:10:21.791823+0000","last_undegraded":"2024-04-25T10:10:21.791823+0000","last_fullsized":"2024-04-25T10:10:21.791823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:15.932801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792569+0000","last_change":"2024-04-25T10:10:20.259676+0000","last_active":"2024-04-25T10:10:21.792569+0000","last_peered":"2024-04-25T10:10:21.792569+0000","last_clean":"2024-04-25T10:10:21.792569+0000","last_became_active":"2024-04-25T10:10:20.258509+0000","last_became_peered":"2024-04-25T10:10:20.258509+0000","last_unstale":"2024-04-25T10:10:21.792569+0000","last_undegraded":"2024-04-25T10:10:21.792569+0000","last_fullsized":"2024-04-25T10:10:21.792569+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:19.428228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793754+0000","last_change":"2024-04-25T10:10:19.250005+0000","last_active":"2024-04-25T10:10:21.793754+0000","last_peered":"2024-04-25T10:10:21.793754+0000","last_clean":"2024-04-25T10:10:21.793754+0000","last_became_active":"2024-04-25T10:10:19.249265+0000","last_became_peered":"2024-04-25T10:10:19.249265+0000","last_unstale":"2024-04-25T10:10:21.793754+0000","last_undegraded":"2024-04-25T10:10:21.793754+0000","last_fullsized":"2024-04-25T10:10:21.793754+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:51.512401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793707+0000","last_change":"2024-04-25T10:10:20.252595+0000","last_active":"2024-04-25T10:10:21.793707+0000","last_peered":"2024-04-25T10:10:21.793707+0000","last_clean":"2024-04-25T10:10:21.793707+0000","last_became_active":"2024-04-25T10:10:20.252323+0000","last_became_peered":"2024-04-25T10:10:20.252323+0000","last_unstale":"2024-04-25T10:10:21.793707+0000","last_undegraded":"2024-04-25T10:10:21.793707+0000","last_fullsized":"2024-04-25T10:10:21.793707+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:09.984788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258509+0000","last_change":"2024-04-25T10:10:19.256882+0000","last_active":"2024-04-25T10:10:21.258509+0000","last_peered":"2024-04-25T10:10:21.258509+0000","last_clean":"2024-04-25T10:10:21.258509+0000","last_became_active":"2024-04-25T10:10:19.256151+0000","last_became_peered":"2024-04-25T10:10:19.256151+0000","last_unstale":"2024-04-25T10:10:21.258509+0000","last_undegraded":"2024-04-25T10:10:21.258509+0000","last_fullsized":"2024-04-25T10:10:21.258509+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:06.437188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.257924+0000","last_change":"2024-04-25T10:10:20.255579+0000","last_active":"2024-04-25T10:10:21.257924+0000","last_peered":"2024-04-25T10:10:21.257924+0000","last_clean":"2024-04-25T10:10:21.257924+0000","last_became_active":"2024-04-25T10:10:20.255287+0000","last_became_peered":"2024-04-25T10:10:20.255287+0000","last_unstale":"2024-04-25T10:10:21.257924+0000","last_undegraded":"2024-04-25T10:10:21.257924+0000","last_fullsized":"2024-04-25T10:10:21.257924+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:07.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"92'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258241+0000","last_change":"2024-04-25T10:10:19.259596+0000","last_active":"2024-04-25T10:10:21.258241+0000","last_peered":"2024-04-25T10:10:21.258241+0000","last_clean":"2024-04-25T10:10:21.258241+0000","last_became_active":"2024-04-25T10:10:19.259311+0000","last_became_peered":"2024-04-25T10:10:19.259311+0000","last_unstale":"2024-04-25T10:10:21.258241+0000","last_undegraded":"2024-04-25T10:10:21.258241+0000","last_fullsized":"2024-04-25T10:10:21.258241+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:15.932801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792404+0000","last_change":"2024-04-25T10:10:20.262734+0000","last_active":"2024-04-25T10:10:21.792404+0000","last_peered":"2024-04-25T10:10:21.792404+0000","last_clean":"2024-04-25T10:10:21.792404+0000","last_became_active":"2024-04-25T10:10:20.262325+0000","last_became_peered":"2024-04-25T10:10:20.262325+0000","last_unstale":"2024-04-25T10:10:21.792404+0000","last_undegraded":"2024-04-25T10:10:21.792404+0000","last_fullsized":"2024-04-25T10:10:21.792404+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:07:45.454826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260795+0000","last_change":"2024-04-25T10:10:19.252634+0000","last_active":"2024-04-25T10:10:21.260795+0000","last_peered":"2024-04-25T10:10:21.260795+0000","last_clean":"2024-04-25T10:10:21.260795+0000","last_became_active":"2024-04-25T10:10:19.252272+0000","last_became_peered":"2024-04-25T10:10:19.252272+0000","last_unstale":"2024-04-25T10:10:21.260795+0000","last_undegraded":"2024-04-25T10:10:21.260795+0000","last_fullsized":"2024-04-25T10:10:21.260795+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:16:04.771203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260873+0000","last_change":"2024-04-25T10:10:20.251463+0000","last_active":"2024-04-25T10:10:21.260873+0000","last_peered":"2024-04-25T10:10:21.260873+0000","last_clean":"2024-04-25T10:10:21.260873+0000","last_became_active":"2024-04-25T10:10:20.251119+0000","last_became_peered":"2024-04-25T10:10:20.251119+0000","last_unstale":"2024-04-25T10:10:21.260873+0000","last_undegraded":"2024-04-25T10:10:21.260873+0000","last_fullsized":"2024-04-25T10:10:21.260873+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:40.914011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791447+0000","last_change":"2024-04-25T10:10:19.257952+0000","last_active":"2024-04-25T10:10:21.791447+0000","last_peered":"2024-04-25T10:10:21.791447+0000","last_clean":"2024-04-25T10:10:21.791447+0000","last_became_active":"2024-04-25T10:10:19.257455+0000","last_became_peered":"2024-04-25T10:10:19.257455+0000","last_unstale":"2024-04-25T10:10:21.791447+0000","last_undegraded":"2024-04-25T10:10:21.791447+0000","last_fullsized":"2024-04-25T10:10:21.791447+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:21.249103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260883+0000","last_change":"2024-04-25T10:10:20.263516+0000","last_active":"2024-04-25T10:10:21.260883+0000","last_peered":"2024-04-25T10:10:21.260883+0000","last_clean":"2024-04-25T10:10:21.260883+0000","last_became_active":"2024-04-25T10:10:20.263124+0000","last_became_peered":"2024-04-25T10:10:20.263124+0000","last_unstale":"2024-04-25T10:10:21.260883+0000","last_undegraded":"2024-04-25T10:10:21.260883+0000","last_fullsized":"2024-04-25T10:10:21.260883+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:25.938365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260900+0000","last_change":"2024-04-25T10:10:19.252947+0000","last_active":"2024-04-25T10:10:21.260900+0000","last_peered":"2024-04-25T10:10:21.260900+0000","last_clean":"2024-04-25T10:10:21.260900+0000","last_became_active":"2024-04-25T10:10:19.252655+0000","last_became_peered":"2024-04-25T10:10:19.252655+0000","last_unstale":"2024-04-25T10:10:21.260900+0000","last_undegraded":"2024-04-25T10:10:21.260900+0000","last_fullsized":"2024-04-25T10:10:21.260900+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:49.671941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791747+0000","last_change":"2024-04-25T10:10:20.256790+0000","last_active":"2024-04-25T10:10:21.791747+0000","last_peered":"2024-04-25T10:10:21.791747+0000","last_clean":"2024-04-25T10:10:21.791747+0000","last_became_active":"2024-04-25T10:10:20.256504+0000","last_became_peered":"2024-04-25T10:10:20.256504+0000","last_unstale":"2024-04-25T10:10:21.791747+0000","last_undegraded":"2024-04-25T10:10:21.791747+0000","last_fullsized":"2024-04-25T10:10:21.791747+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:04:39.509255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790740+0000","last_change":"2024-04-25T10:10:19.246454+0000","last_active":"2024-04-25T10:10:21.790740+0000","last_peered":"2024-04-25T10:10:21.790740+0000","last_clean":"2024-04-25T10:10:21.790740+0000","last_became_active":"2024-04-25T10:10:19.246134+0000","last_became_peered":"2024-04-25T10:10:19.246134+0000","last_unstale":"2024-04-25T10:10:21.790740+0000","last_undegraded":"2024-04-25T10:10:21.790740+0000","last_fullsized":"2024-04-25T10:10:21.790740+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:31.266738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793583+0000","last_change":"2024-04-25T10:10:20.250462+0000","last_active":"2024-04-25T10:10:21.793583+0000","last_peered":"2024-04-25T10:10:21.793583+0000","last_clean":"2024-04-25T10:10:21.793583+0000","last_became_active":"2024-04-25T10:10:20.250173+0000","last_became_peered":"2024-04-25T10:10:20.250173+0000","last_unstale":"2024-04-25T10:10:21.793583+0000","last_undegraded":"2024-04-25T10:10:21.793583+0000","last_fullsized":"2024-04-25T10:10:21.793583+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:04:41.200423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"92'2","reported_seq":16,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258660+0000","last_change":"2024-04-25T10:10:19.258221+0000","last_active":"2024-04-25T10:10:21.258660+0000","last_peered":"2024-04-25T10:10:21.258660+0000","last_clean":"2024-04-25T10:10:21.258660+0000","last_became_active":"2024-04-25T10:10:19.257937+0000","last_became_peered":"2024-04-25T10:10:19.257937+0000","last_unstale":"2024-04-25T10:10:21.258660+0000","last_undegraded":"2024-04-25T10:10:21.258660+0000","last_fullsized":"2024-04-25T10:10:21.258660+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:15.689758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792608+0000","last_change":"2024-04-25T10:10:20.258009+0000","last_active":"2024-04-25T10:10:21.792608+0000","last_peered":"2024-04-25T10:10:21.792608+0000","last_clean":"2024-04-25T10:10:21.792608+0000","last_became_active":"2024-04-25T10:10:20.257758+0000","last_became_peered":"2024-04-25T10:10:20.257758+0000","last_unstale":"2024-04-25T10:10:21.792608+0000","last_undegraded":"2024-04-25T10:10:21.792608+0000","last_fullsized":"2024-04-25T10:10:21.792608+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:10.693872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"93'1","reported_seq":15,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258037+0000","last_change":"2024-04-25T10:10:19.249615+0000","last_active":"2024-04-25T10:10:21.258037+0000","last_peered":"2024-04-25T10:10:21.258037+0000","last_clean":"2024-04-25T10:10:21.258037+0000","last_became_active":"2024-04-25T10:10:19.249348+0000","last_became_peered":"2024-04-25T10:10:19.249348+0000","last_unstale":"2024-04-25T10:10:21.258037+0000","last_undegraded":"2024-04-25T10:10:21.258037+0000","last_fullsized":"2024-04-25T10:10:21.258037+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:34.152207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792559+0000","last_change":"2024-04-25T10:10:20.263048+0000","last_active":"2024-04-25T10:10:21.792559+0000","last_peered":"2024-04-25T10:10:21.792559+0000","last_clean":"2024-04-25T10:10:21.792559+0000","last_became_active":"2024-04-25T10:10:20.262772+0000","last_became_peered":"2024-04-25T10:10:20.262772+0000","last_unstale":"2024-04-25T10:10:21.792559+0000","last_undegraded":"2024-04-25T10:10:21.792559+0000","last_fullsized":"2024-04-25T10:10:21.792559+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:24.386484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258366+0000","last_change":"2024-04-25T10:10:19.254234+0000","last_active":"2024-04-25T10:10:21.258366+0000","last_peered":"2024-04-25T10:10:21.258366+0000","last_clean":"2024-04-25T10:10:21.258366+0000","last_became_active":"2024-04-25T10:10:19.253368+0000","last_became_peered":"2024-04-25T10:10:19.253368+0000","last_unstale":"2024-04-25T10:10:21.258366+0000","last_undegraded":"2024-04-25T10:10:21.258366+0000","last_fullsized":"2024-04-25T10:10:21.258366+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:38:14.385527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.261208+0000","last_change":"2024-04-25T10:10:20.257049+0000","last_active":"2024-04-25T10:10:21.261208+0000","last_peered":"2024-04-25T10:10:21.261208+0000","last_clean":"2024-04-25T10:10:21.261208+0000","last_became_active":"2024-04-25T10:10:20.256751+0000","last_became_peered":"2024-04-25T10:10:20.256751+0000","last_unstale":"2024-04-25T10:10:21.261208+0000","last_undegraded":"2024-04-25T10:10:21.261208+0000","last_fullsized":"2024-04-25T10:10:21.261208+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:47.664582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793627+0000","last_change":"2024-04-25T10:10:19.252608+0000","last_active":"2024-04-25T10:10:21.793627+0000","last_peered":"2024-04-25T10:10:21.793627+0000","last_clean":"2024-04-25T10:10:21.793627+0000","last_became_active":"2024-04-25T10:10:19.252354+0000","last_became_peered":"2024-04-25T10:10:19.252354+0000","last_unstale":"2024-04-25T10:10:21.793627+0000","last_undegraded":"2024-04-25T10:10:21.793627+0000","last_fullsized":"2024-04-25T10:10:21.793627+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:30.317152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.790648+0000","last_change":"2024-04-25T10:10:20.258958+0000","last_active":"2024-04-25T10:10:21.790648+0000","last_peered":"2024-04-25T10:10:21.790648+0000","last_clean":"2024-04-25T10:10:21.790648+0000","last_became_active":"2024-04-25T10:10:20.258688+0000","last_became_peered":"2024-04-25T10:10:20.258688+0000","last_unstale":"2024-04-25T10:10:21.790648+0000","last_undegraded":"2024-04-25T10:10:21.790648+0000","last_fullsized":"2024-04-25T10:10:21.790648+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:33:03.473806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792235+0000","last_change":"2024-04-25T10:10:19.253981+0000","last_active":"2024-04-25T10:10:21.792235+0000","last_peered":"2024-04-25T10:10:21.792235+0000","last_clean":"2024-04-25T10:10:21.792235+0000","last_became_active":"2024-04-25T10:10:19.253705+0000","last_became_peered":"2024-04-25T10:10:19.253705+0000","last_unstale":"2024-04-25T10:10:21.792235+0000","last_undegraded":"2024-04-25T10:10:21.792235+0000","last_fullsized":"2024-04-25T10:10:21.792235+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:23.672233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.253103+0000","last_change":"2024-04-25T10:10:20.266522+0000","last_active":"2024-04-25T10:10:21.253103+0000","last_peered":"2024-04-25T10:10:21.253103+0000","last_clean":"2024-04-25T10:10:21.253103+0000","last_became_active":"2024-04-25T10:10:20.266217+0000","last_became_peered":"2024-04-25T10:10:20.266217+0000","last_unstale":"2024-04-25T10:10:21.253103+0000","last_undegraded":"2024-04-25T10:10:21.253103+0000","last_fullsized":"2024-04-25T10:10:21.253103+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:14.566025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.260915+0000","last_change":"2024-04-25T10:10:19.251872+0000","last_active":"2024-04-25T10:10:21.260915+0000","last_peered":"2024-04-25T10:10:21.260915+0000","last_clean":"2024-04-25T10:10:21.260915+0000","last_became_active":"2024-04-25T10:10:19.251608+0000","last_became_peered":"2024-04-25T10:10:19.251608+0000","last_unstale":"2024-04-25T10:10:21.260915+0000","last_undegraded":"2024-04-25T10:10:21.260915+0000","last_fullsized":"2024-04-25T10:10:21.260915+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:25.026107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793376+0000","last_change":"2024-04-25T10:10:20.256509+0000","last_active":"2024-04-25T10:10:21.793376+0000","last_peered":"2024-04-25T10:10:21.793376+0000","last_clean":"2024-04-25T10:10:21.793376+0000","last_became_active":"2024-04-25T10:10:20.256194+0000","last_became_peered":"2024-04-25T10:10:20.256194+0000","last_unstale":"2024-04-25T10:10:21.793376+0000","last_undegraded":"2024-04-25T10:10:21.793376+0000","last_fullsized":"2024-04-25T10:10:21.793376+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:50.678307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.793437+0000","last_change":"2024-04-25T10:10:19.247738+0000","last_active":"2024-04-25T10:10:21.793437+0000","last_peered":"2024-04-25T10:10:21.793437+0000","last_clean":"2024-04-25T10:10:21.793437+0000","last_became_active":"2024-04-25T10:10:19.247204+0000","last_became_peered":"2024-04-25T10:10:19.247204+0000","last_unstale":"2024-04-25T10:10:21.793437+0000","last_undegraded":"2024-04-25T10:10:21.793437+0000","last_fullsized":"2024-04-25T10:10:21.793437+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:18.674170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.792045+0000","last_change":"2024-04-25T10:10:20.250943+0000","last_active":"2024-04-25T10:10:21.792045+0000","last_peered":"2024-04-25T10:10:21.792045+0000","last_clean":"2024-04-25T10:10:21.792045+0000","last_became_active":"2024-04-25T10:10:20.250596+0000","last_became_peered":"2024-04-25T10:10:20.250596+0000","last_unstale":"2024-04-25T10:10:21.792045+0000","last_undegraded":"2024-04-25T10:10:21.792045+0000","last_fullsized":"2024-04-25T10:10:21.792045+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:04.374172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256833+0000","last_change":"2024-04-25T10:10:19.257554+0000","last_active":"2024-04-25T10:10:21.256833+0000","last_peered":"2024-04-25T10:10:21.256833+0000","last_clean":"2024-04-25T10:10:21.256833+0000","last_became_active":"2024-04-25T10:10:19.257255+0000","last_became_peered":"2024-04-25T10:10:19.257255+0000","last_unstale":"2024-04-25T10:10:21.256833+0000","last_undegraded":"2024-04-25T10:10:21.256833+0000","last_fullsized":"2024-04-25T10:10:21.256833+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:33:43.902993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":12,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.258536+0000","last_change":"2024-04-25T10:10:20.252107+0000","last_active":"2024-04-25T10:10:21.258536+0000","last_peered":"2024-04-25T10:10:21.258536+0000","last_clean":"2024-04-25T10:10:21.258536+0000","last_became_active":"2024-04-25T10:10:20.251794+0000","last_became_peered":"2024-04-25T10:10:20.251794+0000","last_unstale":"2024-04-25T10:10:21.258536+0000","last_undegraded":"2024-04-25T10:10:21.258536+0000","last_fullsized":"2024-04-25T10:10:21.258536+0000","mapping_epoch":91,"log_start":"0'0","ondisk_log_start":"0'0","created":91,"last_epoch_clean":92,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:19.221883+0000","last_clean_scrub_stamp":"2024-04-25T10:10:19.221883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:25.614170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":14,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.791861+0000","last_change":"2024-04-25T10:10:19.249667+0000","last_active":"2024-04-25T10:10:21.791861+0000","last_peered":"2024-04-25T10:10:21.791861+0000","last_clean":"2024-04-25T10:10:21.791861+0000","last_became_active":"2024-04-25T10:10:19.247060+0000","last_became_peered":"2024-04-25T10:10:19.247060+0000","last_unstale":"2024-04-25T10:10:21.791861+0000","last_undegraded":"2024-04-25T10:10:21.791861+0000","last_fullsized":"2024-04-25T10:10:21.791861+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:10:18.215517+0000","last_clean_scrub_stamp":"2024-04-25T10:10:18.215517+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:01.249092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":303,"reported_epoch":93,"state":"active+clean","last_fresh":"2024-04-25T10:10:21.256960+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:10:21.256960+0000","last_peered":"2024-04-25T10:10:21.256960+0000","last_clean":"2024-04-25T10:10:21.256960+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:10:21.256960+0000","last_undegraded":"2024-04-25T10:10:21.256960+0000","last_fullsized":"2024-04-25T10:10:21.256960+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1700,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1740800,"data_stored":1115413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1159168,"data_stored":527205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509522,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1146880,"data_stored":525149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542228,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542226,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32292,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339548,"statfs":{"total":96636764160,"available":96603697152,"internally_reserved":0,"allocated":1138688,"data_stored":524989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542228,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1142784,"data_stored":525059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542226,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1757184,"data_stored":1117675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:10:24.751 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:10:24.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:10:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.930+0000 7f0e48000640 1 Processor -- start 2024-04-25T10:10:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.930+0000 7f0e48000640 1 -- start start 2024-04-25T10:10:24.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e48000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e48000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0e4015af40 0x7f0e40071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e48000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4015e9a0 con 0x7f0e40072040 2024-04-25T10:10:24.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e48000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e40072490 con 0x7f0e4015af40 2024-04-25T10:10:24.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e48000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4006f530 con 0x7f0e40150f40 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0e4015af40 0x7f0e40071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e45600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0e4015af40 0x7f0e40071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38128/0 (socket says 172.21.15.18:38128) 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e45600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50636/0 (socket says 172.21.15.18:50636) 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 -- 172.21.15.18:0/3014161039 learned_addr learned my addr 172.21.15.18:0/3014161039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e46000640 1 --1- 172.21.15.18:0/3014161039 >> v1:172.21.15.167:6789/0 conn(0x7f0e40072040 0x7f0e4006d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:60928/0 (socket says 172.21.15.18:60928) 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 -- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 msgr2=0x7f0e4006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 -- 172.21.15.18:0/3014161039 >> v1:172.21.15.167:6789/0 conn(0x7f0e40072040 legacy=0x7f0e4006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e44c00640 1 -- 172.21.15.18:0/3014161039 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4015dbe0 con 0x7f0e4015af40 2024-04-25T10:10:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.934+0000 7f0e45600640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e40071b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db953e12d806ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e3fe00640 1 -- 172.21.15.18:0/3014161039 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0b0070 con 0x7f0e4015af40 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e3fe00640 1 -- 172.21.15.18:0/3014161039 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c0ab600 con 0x7f0e4015af40 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e3fe00640 1 -- 172.21.15.18:0/3014161039 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c0ab9d0 con 0x7f0e4015af40 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 msgr2=0x7f0e40071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e40071b00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c009870 tx=0x7f0e2c01c440 comp rx=0 tx=0).stop 2024-04-25T10:10:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- 172.21.15.18:0/3014161039 shutdown_connections 2024-04-25T10:10:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e40071b00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 --2- 172.21.15.18:0/3014161039 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- 172.21.15.18:0/3014161039 >> 172.21.15.18:0/3014161039 conn(0x7f0e40067080 msgr2=0x7f0e4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- 172.21.15.18:0/3014161039 shutdown_connections 2024-04-25T10:10:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- 172.21.15.18:0/3014161039 wait complete. 2024-04-25T10:10:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 Processor -- start 2024-04-25T10:10:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.938+0000 7f0e48000640 1 -- start start 2024-04-25T10:10:24.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4014a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e4014c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cecd0 con 0x7f0e40072040 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e40151320 con 0x7f0e4015af40 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400cee50 con 0x7f0e40150f40 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46716/0 (socket says 172.21.15.18:46716) 2024-04-25T10:10:24.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 -- 172.21.15.18:0/3194766718 learned_addr learned my addr 172.21.15.18:0/3194766718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:24.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4014a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 -- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 msgr2=0x7f0e4014a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e46000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e4014c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4014a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 -- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 msgr2=0x7f0e4014c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e4014c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 -- 172.21.15.18:0/3194766718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4014b1a0 con 0x7f0e40072040 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e46000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e4014c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e45600640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400e9b0 tx=0x7f0e3400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34017070 con 0x7f0e40072040 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3400ca00 con 0x7f0e40072040 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400cdd0 con 0x7f0e40072040 2024-04-25T10:10:24.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4014b480 con 0x7f0e40072040 2024-04-25T10:10:24.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4014ba40 con 0x7f0e40072040 2024-04-25T10:10:24.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e400745d0 con 0x7f0e40072040 2024-04-25T10:10:24.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.942+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e3401a070 con 0x7f0e40072040 2024-04-25T10:10:24.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.946+0000 7f0e3d600640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 0x7f0e20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:24.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.946+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0e340854d0 con 0x7f0e40072040 2024-04-25T10:10:24.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.946+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 0x7f0e20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:24.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.946+0000 7f0e44c00640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 0x7f0e20069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0ad000 tx=0x7f0e2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:24.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:24.950+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e340562b0 con 0x7f0e40072040 2024-04-25T10:10:25.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.166+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0e4006de40 con 0x7f0e40072040 2024-04-25T10:10:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e3d600640 1 -- 172.21.15.18:0/3194766718 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0e34055bb0 con 0x7f0e40072040 2024-04-25T10:10:25.176 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:10:25.176 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:10:25.176 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:10:25.176 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:10:25.177 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:10:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:10:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 msgr2=0x7f0e20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 0x7f0e20069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0ad000 tx=0x7f0e2c008040 comp rx=0 tx=0).stop 2024-04-25T10:10:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 msgr2=0x7f0e40149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400e9b0 tx=0x7f0e3400ee70 comp rx=0 tx=0).stop 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 shutdown_connections 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e4015af40 0x7f0e4014c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0e20066f60 0x7f0e20069420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0e40150f40 0x7f0e4014a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 --2- 172.21.15.18:0/3194766718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0e40072040 0x7f0e40149f40 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 >> 172.21.15.18:0/3194766718 conn(0x7f0e40067080 msgr2=0x7f0e4006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 shutdown_connections 2024-04-25T10:10:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.170+0000 7f0e48000640 1 -- 172.21.15.18:0/3194766718 wait complete. 2024-04-25T10:10:25.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:25.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.330+0000 7f9534800640 1 Processor -- start 2024-04-25T10:10:25.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.330+0000 7f9534800640 1 -- start start 2024-04-25T10:10:25.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.330+0000 7f9534800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9534800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9534800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f952c06c650 con 0x7f952c099a60 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9534800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952c06c930 con 0x7f952c15ee00 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9534800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c06cc10 con 0x7f952c0cff30 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9531400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50660/0 (socket says 172.21.15.18:50660) 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 -- 172.21.15.18:0/2221455777 learned_addr learned my addr 172.21.15.18:0/2221455777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:25.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9531400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38140/0 (socket says 172.21.15.18:38140) 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 -- 172.21.15.18:0/2221455777 >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 msgr2=0x7f952c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 --2- 172.21.15.18:0/2221455777 >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 -- 172.21.15.18:0/2221455777 >> v1:172.21.15.167:6789/0 conn(0x7f952c099a60 legacy=0x7f952c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9532800640 1 -- 172.21.15.18:0/2221455777 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c06cef0 con 0x7f952c0cff30 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9531400640 1 --2- 172.21.15.18:0/2221455777 >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:25.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.334+0000 7f9530a00640 1 -- 172.21.15.18:0/2221455777 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827759362 0 0) 0x7f952c06c650 con 0x7f952c099a60 2024-04-25T10:10:25.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9532800640 1 --2- 172.21.15.18:0/2221455777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9528009e50 tx=0x7f952801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32d5d7611f079c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:25.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9530a00640 1 -- 172.21.15.18:0/2221455777 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280a5700 con 0x7f952c0cff30 2024-04-25T10:10:25.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9530a00640 1 -- 172.21.15.18:0/2221455777 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95280a58a0 con 0x7f952c0cff30 2024-04-25T10:10:25.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9530a00640 1 -- 172.21.15.18:0/2221455777 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95280a5c70 con 0x7f952c0cff30 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- 172.21.15.18:0/2221455777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 msgr2=0x7f952c0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 --2- 172.21.15.18:0/2221455777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9528009e50 tx=0x7f952801ca30 comp rx=0 tx=0).stop 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- 172.21.15.18:0/2221455777 shutdown_connections 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 --2- 172.21.15.18:0/2221455777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c0cff30 0x7f952c0d03e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 --2- 172.21.15.18:0/2221455777 >> v2:172.21.15.167:3300/0 conn(0x7f952c15ee00 0x7f952c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- 172.21.15.18:0/2221455777 >> 172.21.15.18:0/2221455777 conn(0x7f952c0d17a0 msgr2=0x7f952c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- 172.21.15.18:0/2221455777 shutdown_connections 2024-04-25T10:10:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- 172.21.15.18:0/2221455777 wait complete. 2024-04-25T10:10:25.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 Processor -- start 2024-04-25T10:10:25.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.338+0000 7f9534800640 1 -- start start 2024-04-25T10:10:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f952c0cff30 0x7f952c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 0x7f952c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16ab80 con 0x7f952c099a60 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16aa00 con 0x7f952c0cff30 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952c16ad00 con 0x7f952c15ee00 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46728/0 (socket says 172.21.15.18:46728) 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 -- 172.21.15.18:0/3887899627 learned_addr learned my addr 172.21.15.18:0/3887899627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 -- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 msgr2=0x7f952c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9532800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 0x7f952c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 0x7f952c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 -- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f952c0cff30 msgr2=0x7f952c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f952c0cff30 0x7f952c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 -- 172.21.15.18:0/3887899627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952c0c8ac0 con 0x7f952c099a60 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9532800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 0x7f952c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9531e00640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f952000c440 tx=0x7f952000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9520005480 con 0x7f952c099a60 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9520003600 con 0x7f952c099a60 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95200039f0 con 0x7f952c099a60 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952c0c8da0 con 0x7f952c099a60 2024-04-25T10:10:25.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952c152470 con 0x7f952c099a60 2024-04-25T10:10:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952c0c8850 con 0x7f952c099a60 2024-04-25T10:10:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.342+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9520003b90 con 0x7f952c099a60 2024-04-25T10:10:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.346+0000 7f9526000640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 0x7f9510069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.346+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9520084de0 con 0x7f952c099a60 2024-04-25T10:10:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.346+0000 7f9531400640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 0x7f9510069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.346+0000 7f9531400640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 0x7f9510069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f951c006e90 tx=0x7f951c006de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.350+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9520055600 con 0x7f952c099a60 2024-04-25T10:10:25.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.542+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f952c0745d0 con 0x7f952c099a60 2024-04-25T10:10:25.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9526000640 1 -- 172.21.15.18:0/3887899627 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f95200596a0 con 0x7f952c099a60 2024-04-25T10:10:25.553 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:25.553 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:22.696457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7503":{"gid":7503,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2607538595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2607538595},{"type":"v1","addr":"172.21.15.18:6835","nonce":2607538595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:25.553 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 63 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 msgr2=0x7f9510069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 0x7f9510069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f951c006e90 tx=0x7f951c006de0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 msgr2=0x7f952c0cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f952000c440 tx=0x7f952000c900 comp rx=0 tx=0).stop 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 shutdown_connections 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9510066f60 0x7f9510069420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f952c15ee00 0x7f952c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f952c0cff30 0x7f952c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 --2- 172.21.15.18:0/3887899627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f952c099a60 0x7f952c0cb320 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:25.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 >> 172.21.15.18:0/3887899627 conn(0x7f952c0d17a0 msgr2=0x7f952c0d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:25.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 shutdown_connections 2024-04-25T10:10:25.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:25.546+0000 7f9534800640 1 -- 172.21.15.18:0/3887899627 wait complete. 2024-04-25T10:10:25.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:10:22.696457+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7503}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7503': {'gid': 7503, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/2607538595', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2607538595}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2607538595}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:10:25.977 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:10:25.977 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T10:10:26.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 Processor -- start 2024-04-25T10:10:26.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 -- start start 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe3015b910 0x7fbe300cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 0x7fbe300cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe300d02a0 con 0x7fbe300cd370 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300cc350 con 0x7fbe3015b910 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe35600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe300cc630 con 0x7fbe300cf3c0 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2ea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbe3015b910 0x7fbe300cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbe300cd370 0x7fbe30099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44446/0 (socket says 172.21.15.18:44446) 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2f400640 1 -- 172.21.15.18:0/1257155032 learned_addr learned my addr 172.21.15.18:0/1257155032 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:26.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe26000640 1 --2- 172.21.15.18:0/1257155032 >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 0x7fbe300cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2ea00640 1 -- 172.21.15.18:0/1257155032 >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 msgr2=0x7fbe300cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/1257155032 >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 0x7fbe300cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2ea00640 1 -- 172.21.15.18:0/1257155032 >> v1:172.21.15.18:6789/0 conn(0x7fbe300cd370 legacy=0x7fbe30099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2ea00640 1 -- 172.21.15.18:0/1257155032 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe300cc910 con 0x7fbe3015b910 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe26000640 1 --2- 172.21.15.18:0/1257155032 >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 0x7fbe300cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:26.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.114+0000 7fbe2e000640 1 -- 172.21.15.18:0/1257155032 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835666402 0 0) 0x7fbe300d02a0 con 0x7fbe300cd370 2024-04-25T10:10:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/1257155032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3015b910 0x7fbe300cf9a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbe30072e20 tx=0x7fbe2001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7012c23f7ed4600f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe2e000640 1 -- 172.21.15.18:0/1257155032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200b2070 con 0x7fbe3015b910 2024-04-25T10:10:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe2e000640 1 -- 172.21.15.18:0/1257155032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe200a5900 con 0x7fbe3015b910 2024-04-25T10:10:26.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe2e000640 1 -- 172.21.15.18:0/1257155032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200a5cd0 con 0x7fbe3015b910 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 -- 172.21.15.18:0/1257155032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3015b910 msgr2=0x7fbe300cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 --2- 172.21.15.18:0/1257155032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3015b910 0x7fbe300cf9a0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fbe30072e20 tx=0x7fbe2001c930 comp rx=0 tx=0).stop 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 -- 172.21.15.18:0/1257155032 shutdown_connections 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 --2- 172.21.15.18:0/1257155032 >> v2:172.21.15.167:3300/0 conn(0x7fbe300cf3c0 0x7fbe300cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 --2- 172.21.15.18:0/1257155032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe3015b910 0x7fbe300cf9a0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 -- 172.21.15.18:0/1257155032 >> 172.21.15.18:0/1257155032 conn(0x7fbe300b3200 msgr2=0x7fbe300b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 -- 172.21.15.18:0/1257155032 shutdown_connections 2024-04-25T10:10:26.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.118+0000 7fbe35600640 1 -- 172.21.15.18:0/1257155032 wait complete. 2024-04-25T10:10:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 Processor -- start 2024-04-25T10:10:26.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- start start 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 0x7fbe3006d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3015b910 0x7fbe301548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3009a2f0 con 0x7fbe300cd370 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3009a170 con 0x7fbe300cf3c0 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3015bcf0 con 0x7fbe3015b910 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46752/0 (socket says 172.21.15.18:46752) 2024-04-25T10:10:26.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 -- 172.21.15.18:0/2631613866 learned_addr learned my addr 172.21.15.18:0/2631613866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe26000640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 0x7fbe3006d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2f400640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3015b910 0x7fbe301548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 -- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3015b910 msgr2=0x7fbe301548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3015b910 0x7fbe301548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 -- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 msgr2=0x7fbe3006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 0x7fbe3006d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 -- 172.21.15.18:0/2631613866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30071210 con 0x7fbe300cd370 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe26000640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 0x7fbe3006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbe20019540 tx=0x7fbe200196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe27400640 1 -- 172.21.15.18:0/2631613866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200b2050 con 0x7fbe300cd370 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe27400640 1 -- 172.21.15.18:0/2631613866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe200be070 con 0x7fbe300cd370 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3015c220 con 0x7fbe300cd370 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe27400640 1 -- 172.21.15.18:0/2631613866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe200ada70 con 0x7fbe300cd370 2024-04-25T10:10:26.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.122+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3006dad0 con 0x7fbe300cd370 2024-04-25T10:10:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe27400640 1 -- 172.21.15.18:0/2631613866 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe200adc10 con 0x7fbe300cd370 2024-04-25T10:10:26.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe27400640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 0x7fbe0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe27400640 1 -- 172.21.15.18:0/2631613866 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe20120520 con 0x7fbe300cd370 2024-04-25T10:10:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe26000640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 0x7fbe0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 Processor -- start 2024-04-25T10:10:26.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 -- start start 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe26000640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 0x7fbe0c069420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe300b2c30 tx=0x7fbe18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645be4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a645a825f0 con 0x55a645b9af30 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6459e9da0 con 0x55a645be4920 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a645972150 con 0x55a645be5240 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46756/0 (socket says 172.21.15.18:46756) 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe2f400640 1 -- 172.21.15.18:0/1774067616 learned_addr learned my addr 172.21.15.18:0/1774067616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe26000640 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.126+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645be4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 -- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 msgr2=0x55a645b9a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 -- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 msgr2=0x55a645be4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645be4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 -- 172.21.15.18:0/1774067616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a64598bca0 con 0x55a645b9af30 2024-04-25T10:10:26.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbe280073d0 tx=0x7fbe28005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9863462c599d7638 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe1f400640 1 -- 172.21.15.18:0/1774067616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28019070 con 0x55a645b9af30 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe1f400640 1 -- 172.21.15.18:0/1774067616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28005e20 con 0x55a645b9af30 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe1f400640 1 -- 172.21.15.18:0/1774067616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28001ae0 con 0x55a645b9af30 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- 172.21.15.18:0/1774067616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 msgr2=0x55a645b9b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fbe280073d0 tx=0x7fbe28005bd0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- 172.21.15.18:0/1774067616 shutdown_connections 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645b9af30 0x55a645b9b310 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1774067616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645be4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- 172.21.15.18:0/1774067616 >> 172.21.15.18:0/1774067616 conn(0x55a645ba12a0 msgr2=0x55a645b992d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- 172.21.15.18:0/1774067616 shutdown_connections 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- 172.21.15.18:0/1774067616 wait complete. 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- start start 2024-04-25T10:10:26.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 Processor -- start 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645bebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6459a4990 con 0x55a645be4920 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6459e5e40 con 0x55a645b9af30 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a645975900 con 0x55a645be5240 2024-04-25T10:10:26.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe38a29000 10 client.0 _ll_register_callbacks cb 0x55a645a9d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe26000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe26000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46768/0 (socket says 172.21.15.18:46768) 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe26000640 1 -- 172.21.15.18:0/2731161000 learned_addr learned my addr 172.21.15.18:0/2731161000 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645bebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.130+0000 7fbe2f400640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 -- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 msgr2=0x55a645b9eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 -- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 msgr2=0x55a645bebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645bebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 -- 172.21.15.18:0/2731161000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a6459a2630 con 0x55a645be4920 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe26000640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbe300cf7c0 tx=0x7fbe18004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96841fca1e77f453 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18026020 con 0x55a645be4920 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe18016970 con 0x55a645be4920 2024-04-25T10:10:26.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe28005e20 con 0x55a645be4920 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe18030050 con 0x55a645be4920 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 10 client.7638 fetch_fsmap learned FSMap version 63 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55a6459723a0 con 0x55a645be4920 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28005e20 con 0x55a645be4920 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe18033020 con 0x55a645be4920 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 10 client.7638 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 10 client.7638 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 20 client.7638 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645ba0160 0x55a645bf5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 4 client.7638 mds_command: new command op to 7503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 --> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a645985a50 con 0x55a645ba0160 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645ba0160 0x55a645bf5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645ba0160 0x55a645bf5e30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=635a7cc606031164 server_cookie=b0de85d27ed028f6 in_seq=0 out_seq=0 2024-04-25T10:10:26.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 10 client.7638 ms_handle_connect on v2:172.21.15.18:6833/2607538595 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 1 -- 172.21.15.18:0/2731161000 <== mds.0 v2:172.21.15.18:6833/2607538595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a645985a50 con 0x55a645ba0160 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 10 client.7638 handle_command_reply: tid=0 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 client.7638 shutdown 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 msgr2=0x55a645bec310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fbe300cf7c0 tx=0x7fbe18004740 comp rx=0 tx=0).stop 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 shutdown_connections 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645b9eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645ba0160 0x55a645bf5e30 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645bec310 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 --2- 172.21.15.18:0/2731161000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645bebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe13e00640 0 client.7638 ms_handle_reset on v2:172.21.15.18:6833/2607538595 2024-04-25T10:10:26.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 >> 172.21.15.18:0/2731161000 conn(0x55a645ba12a0 msgr2=0x55a645b999e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 shutdown_connections 2024-04-25T10:10:26.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 1 -- 172.21.15.18:0/2731161000 wait complete. 2024-04-25T10:10:26.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.134+0000 7fbe38a29000 20 client.7638 trim_cache size 0 max 16384 2024-04-25T10:10:26.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.150+0000 7fbe38a29000 1 Processor -- start 2024-04-25T10:10:26.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.150+0000 7fbe38a29000 1 -- start start 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.150+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645b9e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.150+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645bee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30202200 con 0x55a645be4920 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3006ca90 con 0x55a645b9af30 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe300c8ed0 con 0x55a645be5240 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46776/0 (socket says 172.21.15.18:46776) 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 -- 172.21.15.18:0/605212418 learned_addr learned my addr 172.21.15.18:0/605212418 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe2f400640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645bee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 -- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 msgr2=0x55a645bee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645b9e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645bee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 -- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 msgr2=0x55a645b9e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645b9e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 -- 172.21.15.18:0/605212418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a645be5070 con 0x55a645be4920 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe2f400640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645bee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645b9e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe26000640 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbe18004780 tx=0x7fbe18021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b413cdf1301ee237 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe1ea00640 1 -- 172.21.15.18:0/605212418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18026040 con 0x55a645be4920 2024-04-25T10:10:26.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe1ea00640 1 -- 172.21.15.18:0/605212418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1801d040 con 0x55a645be4920 2024-04-25T10:10:26.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe1ea00640 1 -- 172.21.15.18:0/605212418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1801c070 con 0x55a645be4920 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- 172.21.15.18:0/605212418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 msgr2=0x55a645b9e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbe18004780 tx=0x7fbe18021000 comp rx=0 tx=0).stop 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- 172.21.15.18:0/605212418 shutdown_connections 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645be5240 0x55a645bee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be4920 0x55a645b9e870 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- 172.21.15.18:0/605212418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645b9af30 0x55a645b9e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- 172.21.15.18:0/605212418 >> 172.21.15.18:0/605212418 conn(0x55a645ba12a0 msgr2=0x55a645bd1170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- 172.21.15.18:0/605212418 shutdown_connections 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- 172.21.15.18:0/605212418 wait complete. 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- start start 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 Processor -- start 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 0x55a645bf17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645bf1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6459ee3d0 con 0x55a645be5240 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a645aa5d50 con 0x55a645be4920 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a645984980 con 0x55a645b9af30 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe38a29000 10 client.0 _ll_register_callbacks cb 0x7fbe28007d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.154+0000 7fbe2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 0x55a645bf17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46788/0 (socket says 172.21.15.18:46788) 2024-04-25T10:10:26.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2ea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 0x55a645bf17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50710/0 (socket says 172.21.15.18:50710) 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 -- 172.21.15.18:0/1691501108 learned_addr learned my addr 172.21.15.18:0/1691501108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe26000640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645bf1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 -- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 msgr2=0x55a645bf17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 0x55a645bf17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 -- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 msgr2=0x55a645bf1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645bf1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 -- 172.21.15.18:0/1691501108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a645a6b600 con 0x55a645be5240 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2f400640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000f70 tx=0x7fbe28007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4ac694ef3c59e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28019030 con 0x55a645be5240 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe28001bf0 con 0x55a645be5240 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe1801d040 con 0x55a645be5240 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe28029430 con 0x55a645be5240 2024-04-25T10:10:26.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 10 client.7644 fetch_fsmap learned FSMap version 63 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x55a64597e9b0 con 0x55a645be5240 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1801d040 con 0x55a645be5240 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 63) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbe28031020 con 0x55a645be5240 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 10 client.7644 fetch_fsmap finished waiting for FSMap version 63 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 10 client.7644 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 20 client.7644 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645c2c220 0x55a645bffdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 4 client.7644 mds_command: new command op to 7503 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:10:26.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 --> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a6459f72e0 con 0x55a645c2c220 2024-04-25T10:10:26.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645c2c220 0x55a645bffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe2ea00640 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645c2c220 0x55a645bffdf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fff7eee35ced50f5 server_cookie=1085c22e3907fde5 in_seq=0 out_seq=0 2024-04-25T10:10:26.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 10 client.7644 ms_handle_connect on v2:172.21.15.18:6833/2607538595 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 1 -- 172.21.15.18:0/1691501108 <== mds.0 v2:172.21.15.18:6833/2607538595 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a6459f72e0 con 0x55a645c2c220 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 10 client.7644 handle_command_reply: tid=0 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 client.7644 shutdown 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 msgr2=0x55a645bff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000f70 tx=0x7fbe28007a20 comp rx=0 tx=0).stop 2024-04-25T10:10:26.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 shutdown_connections 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:6833/2607538595,v1:172.21.15.18:6835/2607538595] conn(0x55a645c2c220 0x55a645bffdf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a645be5240 0x55a645bff8b0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a645be4920 0x55a645bf1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 --2- 172.21.15.18:0/1691501108 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a645b9af30 0x55a645bf17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe13e00640 0 client.7644 ms_handle_reset on v2:172.21.15.18:6833/2607538595 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 >> 172.21.15.18:0/1691501108 conn(0x55a645ba12a0 msgr2=0x55a645b9d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 shutdown_connections 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 1 -- 172.21.15.18:0/1691501108 wait complete. 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe38a29000 20 client.7644 trim_cache size 0 max 16384 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:10:26.172 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7503, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.9165808479999997, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 63, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 93, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 93, 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 10.810674068999999 2024-04-25T10:10:26.173 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 msgr2=0x7fbe0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 0x7fbe0c069420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbe300b2c30 tx=0x7fbe18008040 comp rx=0 tx=0).stop 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 msgr2=0x7fbe3014f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fbe20019540 tx=0x7fbe200196d0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 shutdown_connections 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbe0c066f60 0x7fbe0c069420 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbe3015b910 0x7fbe301548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe300cf3c0 0x7fbe3006d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 --2- 172.21.15.18:0/2631613866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe300cd370 0x7fbe3014f6a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.158+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 >> 172.21.15.18:0/2631613866 conn(0x7fbe300b3200 msgr2=0x7fbe30073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.162+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 shutdown_connections 2024-04-25T10:10:26.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.162+0000 7fbe35600640 1 -- 172.21.15.18:0/2631613866 wait complete. 2024-04-25T10:10:26.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:10:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 Processor -- start 2024-04-25T10:10:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 -- start start 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f10d80d0f90 0x7f10d815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10d80b5390 0x7f10d8161a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d8161f90 0x7f10d806e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d815e4d0 con 0x7f10d80b5390 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10d815e7b0 con 0x7f10d80d0f90 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10df000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d815ea90 con 0x7f10d8161f90 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10d80b5390 0x7f10d8161a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10d80b5390 0x7f10d8161a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46804/0 (socket says 172.21.15.18:46804) 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 -- 172.21.15.18:0/2399741849 learned_addr learned my addr 172.21.15.18:0/2399741849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10de600640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d8161f90 0x7f10d806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10ddc00640 1 --2- 172.21.15.18:0/2399741849 >> v2:172.21.15.167:3300/0 conn(0x7f10d80d0f90 0x7f10d815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 -- 172.21.15.18:0/2399741849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d8161f90 msgr2=0x7f10d806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d8161f90 0x7f10d806e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 -- 172.21.15.18:0/2399741849 >> v2:172.21.15.167:3300/0 conn(0x7f10d80d0f90 msgr2=0x7f10d815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 --2- 172.21.15.18:0/2399741849 >> v2:172.21.15.167:3300/0 conn(0x7f10d80d0f90 0x7f10d815dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.322+0000 7f10dd200640 1 -- 172.21.15.18:0/2399741849 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8161530 con 0x7f10d80b5390 2024-04-25T10:10:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10dd200640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d80b5390 0x7f10d8161a50 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f10d80718a0 tx=0x7f10c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc7b545397f61ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10d7e00640 1 -- 172.21.15.18:0/2399741849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40b0070 con 0x7f10d80b5390 2024-04-25T10:10:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10d7e00640 1 -- 172.21.15.18:0/2399741849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c40ab600 con 0x7f10d80b5390 2024-04-25T10:10:26.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10d7e00640 1 -- 172.21.15.18:0/2399741849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c40ab9d0 con 0x7f10d80b5390 2024-04-25T10:10:26.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- 172.21.15.18:0/2399741849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d80b5390 msgr2=0x7f10d8161a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d80b5390 0x7f10d8161a50 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f10d80718a0 tx=0x7f10c401c520 comp rx=0 tx=0).stop 2024-04-25T10:10:26.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- 172.21.15.18:0/2399741849 shutdown_connections 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d8161f90 0x7f10d806e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 --2- 172.21.15.18:0/2399741849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d80b5390 0x7f10d8161a50 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 --2- 172.21.15.18:0/2399741849 >> v2:172.21.15.167:3300/0 conn(0x7f10d80d0f90 0x7f10d815dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- 172.21.15.18:0/2399741849 >> 172.21.15.18:0/2399741849 conn(0x7f10d80b5a90 msgr2=0x7f10d8099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- 172.21.15.18:0/2399741849 shutdown_connections 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- 172.21.15.18:0/2399741849 wait complete. 2024-04-25T10:10:26.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 Processor -- start 2024-04-25T10:10:26.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.326+0000 7f10df000640 1 -- start start 2024-04-25T10:10:26.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d80b5390 0x7f10d81447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d80d0f90 0x7f10d81f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d806afa0 con 0x7f10d8161f90 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d806ae20 con 0x7f10d80d0f90 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d806b120 con 0x7f10d80b5390 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46806/0 (socket says 172.21.15.18:46806) 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 -- 172.21.15.18:0/4147404918 learned_addr learned my addr 172.21.15.18:0/4147404918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10ddc00640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d80b5390 0x7f10d81447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10dd200640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d80d0f90 0x7f10d81f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 -- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d80b5390 msgr2=0x7f10d81447b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d80b5390 0x7f10d81447b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 -- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d80d0f90 msgr2=0x7f10d81f9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d80d0f90 0x7f10d81f9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 -- 172.21.15.18:0/4147404918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d8144fe0 con 0x7f10d8161f90 2024-04-25T10:10:26.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10de600640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f10d000efc0 tx=0x7f10d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0018020 con 0x7f10d8161f90 2024-04-25T10:10:26.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0014480 con 0x7f10d8161f90 2024-04-25T10:10:26.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0014870 con 0x7f10d8161f90 2024-04-25T10:10:26.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d81452c0 con 0x7f10d8161f90 2024-04-25T10:10:26.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d8145880 con 0x7f10d8161f90 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d804efa0 con 0x7f10d8161f90 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.330+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f10d001b020 con 0x7f10d8161f90 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.334+0000 7f10d5600640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 0x7f10b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.334+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f10d0085b00 con 0x7f10d8161f90 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.334+0000 7f10ddc00640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 0x7f10b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:26.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.334+0000 7f10ddc00640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 0x7f10b8069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009ae0 tx=0x7f10cc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:26.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.338+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f10d0022070 con 0x7f10d8161f90 2024-04-25T10:10:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.534+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f10d8072d80 con 0x7f10d8161f90 2024-04-25T10:10:26.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.534+0000 7f10d5600640 1 -- 172.21.15.18:0/4147404918 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7f10d0085e20 con 0x7f10d8161f90 2024-04-25T10:10:26.543 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:10:26.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 msgr2=0x7f10b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 0x7f10b8069420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f10cc009ae0 tx=0x7f10cc009190 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 msgr2=0x7f10d81fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f10d000efc0 tx=0x7f10d000c490 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 shutdown_connections 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10d8161f90 0x7f10d81fa530 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10d80d0f90 0x7f10d81f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f10b8066f60 0x7f10b8069420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 --2- 172.21.15.18:0/4147404918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f10d80b5390 0x7f10d81447b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 >> 172.21.15.18:0/4147404918 conn(0x7f10d80b5a90 msgr2=0x7f10d815eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 shutdown_connections 2024-04-25T10:10:26.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:26.538+0000 7f10df000640 1 -- 172.21.15.18:0/4147404918 wait complete. 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:10:26.565 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:10:26.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:10:26.566 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:26.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.566 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:26.575 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42078sec preferred_lft 42078sec 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:10:26.576 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.577 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:10:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:10:26.578 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:26.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.579 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:10:26.641 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:10:26.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.644 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:10:26.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:10:26.698 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:10:26.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.790 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:10:26.799 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:10:26.799 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:10:26.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:26.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:10:26.859 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:26.860 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:26.912 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:26.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:26.912 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:26.970 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:10:26.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:26.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:27.061 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:27.061 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:27.074 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:27.074 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:27.075 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:10:27.075 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:10:27.075 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:10:27.078 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:10:27.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:27.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.100 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:10:27.163 INFO:teuthology.orchestra.run.smithi018.stdout:client36422 2024-04-25T10:10:27.165 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:27.165 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:27.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.212 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T10:10:27.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.275 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T10:10:27.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.331 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T10:10:27.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:27.382 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T10:10:27.442 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:10:27.549 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:10:27.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:10:27.559 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:27.559 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:27.612 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:27.612 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:27.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:10:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.838+0000 7f4b6b400640 1 Processor -- start 2024-04-25T10:10:27.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.838+0000 7f4b6b400640 1 -- start start 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b6b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b64144140 0x7f4b640ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b6b400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 0x7f4b640b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b6b400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6415ac60 con 0x7f4b640ced60 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b6b400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b640cf3e0 con 0x7f4b64144140 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b6b400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6415af20 con 0x7f4b6406ead0 2024-04-25T10:10:27.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b64144140 0x7f4b640ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4b64144140 0x7f4b640ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46820/0 (socket says 172.21.15.18:46820) 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 -- 172.21.15.18:0/2374129631 learned_addr learned my addr 172.21.15.18:0/2374129631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b69400640 1 --2- 172.21.15.18:0/2374129631 >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 0x7f4b640b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 -- 172.21.15.18:0/2374129631 >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 msgr2=0x7f4b640b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 --2- 172.21.15.18:0/2374129631 >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 0x7f4b640b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 -- 172.21.15.18:0/2374129631 >> v1:172.21.15.167:6789/0 conn(0x7f4b640ced60 legacy=0x7f4b6406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b68a00640 1 -- 172.21.15.18:0/2374129631 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6415b200 con 0x7f4b64144140 2024-04-25T10:10:27.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.842+0000 7f4b69400640 1 --2- 172.21.15.18:0/2374129631 >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 0x7f4b640b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b68a00640 1 --2- 172.21.15.18:0/2374129631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b64144140 0x7f4b640ce820 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4b640cc520 tx=0x7f4b5401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f08465f34c260 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b63e00640 1 -- 172.21.15.18:0/2374129631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540b1070 con 0x7f4b64144140 2024-04-25T10:10:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b63e00640 1 -- 172.21.15.18:0/2374129631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b540ac440 con 0x7f4b64144140 2024-04-25T10:10:27.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b63e00640 1 -- 172.21.15.18:0/2374129631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540ac810 con 0x7f4b64144140 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- 172.21.15.18:0/2374129631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b64144140 msgr2=0x7f4b640ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- 172.21.15.18:0/2374129631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b64144140 0x7f4b640ce820 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f4b640cc520 tx=0x7f4b5401c4e0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- 172.21.15.18:0/2374129631 shutdown_connections 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- 172.21.15.18:0/2374129631 >> v2:172.21.15.167:3300/0 conn(0x7f4b6406ead0 0x7f4b640b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- 172.21.15.18:0/2374129631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b64144140 0x7f4b640ce820 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- 172.21.15.18:0/2374129631 >> 172.21.15.18:0/2374129631 conn(0x7f4b64066fa0 msgr2=0x7f4b6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:27.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- 172.21.15.18:0/2374129631 shutdown_connections 2024-04-25T10:10:27.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- 172.21.15.18:0/2374129631 wait complete. 2024-04-25T10:10:27.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 Processor -- start 2024-04-25T10:10:27.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- start start 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b640ced60 0x7f4b64160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b64144140 0x7f4b6415e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6415bb80 con 0x7f4b6406ead0 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6415ba00 con 0x7f4b64144140 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b6b400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b641673e0 con 0x7f4b640ced60 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b68a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b68a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46824/0 (socket says 172.21.15.18:46824) 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.846+0000 7f4b68a00640 1 -- 172.21.15.18:0/1068833496 learned_addr learned my addr 172.21.15.18:0/1068833496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b69400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b64144140 0x7f4b6415e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b5be00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b640ced60 0x7f4b64160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 -- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b640ced60 msgr2=0x7f4b64160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b640ced60 0x7f4b64160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 -- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b64144140 msgr2=0x7f4b6415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b64144140 0x7f4b6415e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 -- 172.21.15.18:0/1068833496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b641f6b30 con 0x7f4b6406ead0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b68a00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4b5401a110 tx=0x7f4b54019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540bc070 con 0x7f4b6406ead0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b540aa830 con 0x7f4b6406ead0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b64160690 con 0x7f4b6406ead0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540b1070 con 0x7f4b6406ead0 2024-04-25T10:10:27.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b641f70d0 con 0x7f4b6406ead0 2024-04-25T10:10:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b641f7a70 con 0x7f4b6406ead0 2024-04-25T10:10:27.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b540bf070 con 0x7f4b6406ead0 2024-04-25T10:10:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.850+0000 7f4b61600640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 0x7f4b40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.854+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4b5411ee00 con 0x7f4b6406ead0 2024-04-25T10:10:27.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.854+0000 7f4b5be00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 0x7f4b40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:27.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.854+0000 7f4b5be00640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 0x7f4b40069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4b6406d750 tx=0x7f4b4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:27.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:27.854+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b641f7a70 con 0x7f4b6406ead0 2024-04-25T10:10:28.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b6415cc90 con 0x7f4b6406ead0 2024-04-25T10:10:28.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b61600640 1 -- 172.21.15.18:0/1068833496 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+16861 (secure 0 0 0) 0x7f4b540160d0 con 0x7f4b6406ead0 2024-04-25T10:10:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:28.026 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":93,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:21.244553+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 msgr2=0x7f4b40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 0x7f4b40069420 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4b6406d750 tx=0x7f4b4c009040 comp rx=0 tx=0).stop 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 msgr2=0x7f4b6415f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f4b5401a110 tx=0x7f4b54019280 comp rx=0 tx=0).stop 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 shutdown_connections 2024-04-25T10:10:28.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.018+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b64144140 0x7f4b6415e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4b40066f60 0x7f4b40069420 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4b640ced60 0x7f4b64160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 --2- 172.21.15.18:0/1068833496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6406ead0 0x7f4b6415f380 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 >> 172.21.15.18:0/1068833496 conn(0x7f4b64066fa0 msgr2=0x7f4b6415c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 shutdown_connections 2024-04-25T10:10:28.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.022+0000 7f4b6b400640 1 -- 172.21.15.18:0/1068833496 wait complete. 2024-04-25T10:10:28.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:10:18.053140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:10:18.626398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:10:28.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:10:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 Processor -- start 2024-04-25T10:10:28.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 -- start start 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4f0144120 0x7fc4f015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4f00ccbf0 0x7fc4f015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f015bc40 con 0x7fc4f015ee60 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f015e490 con 0x7fc4f0144120 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4f6a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f015b3a0 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.186+0000 7fc4efe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4f0144120 0x7fc4f015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4f0144120 0x7fc4f015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46840/0 (socket says 172.21.15.18:46840) 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 -- 172.21.15.18:0/3875348924 learned_addr learned my addr 172.21.15.18:0/3875348924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:28.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4e7400640 1 --2- 172.21.15.18:0/3875348924 >> v2:172.21.15.167:3300/0 conn(0x7fc4f00ccbf0 0x7fc4f015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 -- 172.21.15.18:0/3875348924 >> v2:172.21.15.167:3300/0 conn(0x7fc4f00ccbf0 msgr2=0x7fc4f015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 --2- 172.21.15.18:0/3875348924 >> v2:172.21.15.167:3300/0 conn(0x7fc4f00ccbf0 0x7fc4f015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 -- 172.21.15.18:0/3875348924 >> v1:172.21.15.167:6789/0 conn(0x7fc4f015ee60 legacy=0x7fc4f00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 -- 172.21.15.18:0/3875348924 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f015b680 con 0x7fc4f0144120 2024-04-25T10:10:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4efe00640 1 --2- 172.21.15.18:0/3875348924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f0144120 0x7fc4f015acd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc4f006b870 tx=0x7fc4e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d605e98a643acd8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4ef400640 1 -- 172.21.15.18:0/3875348924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00b1070 con 0x7fc4f0144120 2024-04-25T10:10:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4ef400640 1 -- 172.21.15.18:0/3875348924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e00ac600 con 0x7fc4f0144120 2024-04-25T10:10:28.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.190+0000 7fc4ef400640 1 -- 172.21.15.18:0/3875348924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00ac9d0 con 0x7fc4f0144120 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- 172.21.15.18:0/3875348924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f0144120 msgr2=0x7fc4f015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/3875348924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f0144120 0x7fc4f015acd0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc4f006b870 tx=0x7fc4e001c490 comp rx=0 tx=0).stop 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- 172.21.15.18:0/3875348924 shutdown_connections 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/3875348924 >> v2:172.21.15.167:3300/0 conn(0x7fc4f00ccbf0 0x7fc4f015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/3875348924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f0144120 0x7fc4f015acd0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- 172.21.15.18:0/3875348924 >> 172.21.15.18:0/3875348924 conn(0x7fc4f0067080 msgr2=0x7fc4f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- 172.21.15.18:0/3875348924 shutdown_connections 2024-04-25T10:10:28.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- 172.21.15.18:0/3875348924 wait complete. 2024-04-25T10:10:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 Processor -- start 2024-04-25T10:10:28.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- start start 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4f0144120 0x7fc4f01430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 0x7fc4f013d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f01675c0 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0167440 con 0x7fc4f015ee60 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f6a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f0167740 con 0x7fc4f0144120 2024-04-25T10:10:28.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46842/0 (socket says 172.21.15.18:46842) 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 -- 172.21.15.18:0/1773788629 learned_addr learned my addr 172.21.15.18:0/1773788629 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4e7400640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4f0144120 0x7fc4f01430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f4a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 0x7fc4f013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 -- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4f0144120 msgr2=0x7fc4f01430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4f0144120 0x7fc4f01430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 -- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 msgr2=0x7fc4f013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 0x7fc4f013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 -- 172.21.15.18:0/1773788629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f00af520 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4f4a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 0x7fc4f013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:28.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.194+0000 7fc4efe00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00190a0 tx=0x7fc4e001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00bb020 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4e00b7420 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e00b1040 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f00afa90 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f00b0050 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f00745d0 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4e00be020 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 0x7fc4cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc4e011eef0 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.198+0000 7fc4e7400640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 0x7fc4cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.202+0000 7fc4e7400640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 0x7fc4cc069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc4f01f7ab0 tx=0x7fc4d8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.202+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4e00c5070 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4f015ae30 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4ecc00640 1 -- 172.21.15.18:0/1773788629 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4e0016110 con 0x7fc4f00ccbf0 2024-04-25T10:10:28.381 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 msgr2=0x7fc4cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 0x7fc4cc069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc4f01f7ab0 tx=0x7fc4d8009190 comp rx=0 tx=0).stop 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 msgr2=0x7fc4f00b0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00190a0 tx=0x7fc4e001acd0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 shutdown_connections 2024-04-25T10:10:28.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4f015ee60 0x7fc4f013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4cc066f60 0x7fc4cc069420 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4f0144120 0x7fc4f01430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 --2- 172.21.15.18:0/1773788629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4f00ccbf0 0x7fc4f00b0570 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 >> 172.21.15.18:0/1773788629 conn(0x7fc4f0067080 msgr2=0x7fc4f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 shutdown_connections 2024-04-25T10:10:28.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.374+0000 7fc4f6a00640 1 -- 172.21.15.18:0/1773788629 wait complete. 2024-04-25T10:10:28.402 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:10:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 Processor -- start 2024-04-25T10:10:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 -- start start 2024-04-25T10:10:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe4580af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4580b30d0 con 0x7fe4580c72a0 2024-04-25T10:10:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4580ccf30 con 0x7fe4580d0150 2024-04-25T10:10:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580cd860 con 0x7fe45815dc00 2024-04-25T10:10:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe4580c72a0 0x7fe4580c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44458/0 (socket says 172.21.15.18:44458) 2024-04-25T10:10:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.538+0000 7fe45d400640 1 -- 172.21.15.18:0/960949474 learned_addr learned my addr 172.21.15.18:0/960949474 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe45ca00640 1 --2- 172.21.15.18:0/960949474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe4580af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242849369 0 0) 0x7fe4580b30d0 con 0x7fe4580c72a0 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe43c003530 con 0x7fe4580c72a0 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe45ca00640 1 -- 172.21.15.18:0/960949474 >> v1:172.21.15.167:6789/0 conn(0x7fe4580d0150 legacy=0x7fe4580c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470063207 0 0) 0x7fe4580ccf30 con 0x7fe4580d0150 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe45ca00640 1 -- 172.21.15.18:0/960949474 >> v1:172.21.15.18:6789/0 conn(0x7fe4580c72a0 legacy=0x7fe4580c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe45ca00640 1 -- 172.21.15.18:0/960949474 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4580cd210 con 0x7fe45815dc00 2024-04-25T10:10:28.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.542+0000 7fe45ca00640 1 --2- 172.21.15.18:0/960949474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe4580af770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe448009820 tx=0x7fe44801c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea6131a37c82c650 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480b0070 con 0x7fe45815dc00 2024-04-25T10:10:28.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480ab400 con 0x7fe45815dc00 2024-04-25T10:10:28.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe457e00640 1 -- 172.21.15.18:0/960949474 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450001a00 con 0x7fe45815dc00 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- 172.21.15.18:0/960949474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 msgr2=0x7fe4580af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 --2- 172.21.15.18:0/960949474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe4580af770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe448009820 tx=0x7fe44801c340 comp rx=0 tx=0).stop 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- 172.21.15.18:0/960949474 shutdown_connections 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 --2- 172.21.15.18:0/960949474 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe4580af770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- 172.21.15.18:0/960949474 >> 172.21.15.18:0/960949474 conn(0x7fe4580b2240 msgr2=0x7fe4580b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- 172.21.15.18:0/960949474 shutdown_connections 2024-04-25T10:10:28.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- 172.21.15.18:0/960949474 wait complete. 2024-04-25T10:10:28.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 Processor -- start 2024-04-25T10:10:28.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- start start 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580d0150 0x7fe458146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe45809e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45816b650 con 0x7fe4580c72a0 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4580cdf00 con 0x7fe4580d0150 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45816b7d0 con 0x7fe45815dc00 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46850/0 (socket says 172.21.15.18:46850) 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45ca00640 1 -- 172.21.15.18:0/3539271539 learned_addr learned my addr 172.21.15.18:0/3539271539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:28.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe45d400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe45809e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.546+0000 7fe44fe00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580d0150 0x7fe458146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 -- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 msgr2=0x7fe45809e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe45809e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 -- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580d0150 msgr2=0x7fe458146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580d0150 0x7fe458146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 -- 172.21.15.18:0/3539271539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45809ac10 con 0x7fe4580c72a0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45d400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe45809e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45ca00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fe448019f70 tx=0x7fe4480190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480b9020 con 0x7fe4580c72a0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4480038a0 con 0x7fe4580c72a0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4480b0040 con 0x7fe4580c72a0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45809aef0 con 0x7fe4580c72a0 2024-04-25T10:10:28.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45809b4b0 con 0x7fe4580c72a0 2024-04-25T10:10:28.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45806ccb0 con 0x7fe4580c72a0 2024-04-25T10:10:28.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4480bc020 con 0x7fe4580c72a0 2024-04-25T10:10:28.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 0x7fe434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe44811efc0 con 0x7fe4580c72a0 2024-04-25T10:10:28.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.550+0000 7fe44fe00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 0x7fe434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.554+0000 7fe44fe00640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 0x7fe434069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe4580ced90 tx=0x7fe440009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.554+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe4480c3030 con 0x7fe4580c72a0 2024-04-25T10:10:28.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.714+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4580745d0 con 0x7fe4580c72a0 2024-04-25T10:10:28.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.714+0000 7fe455600640 1 -- 172.21.15.18:0/3539271539 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v93) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe448015ff0 con 0x7fe4580c72a0 2024-04-25T10:10:28.723 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 msgr2=0x7fe434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 0x7fe434069420 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fe4580ced90 tx=0x7fe440009040 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 msgr2=0x7fe45809a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fe448019f70 tx=0x7fe4480190e0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 shutdown_connections 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe434066f60 0x7fe434069420 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe45815dc00 0x7fe45809e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe4580d0150 0x7fe458146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 --2- 172.21.15.18:0/3539271539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4580c72a0 0x7fe45809a630 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 >> 172.21.15.18:0/3539271539 conn(0x7fe4580b2240 msgr2=0x7fe4580adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 shutdown_connections 2024-04-25T10:10:28.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.718+0000 7fe45f400640 1 -- 172.21.15.18:0/3539271539 wait complete. 2024-04-25T10:10:28.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:10:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.878+0000 7f3823200640 1 Processor -- start 2024-04-25T10:10:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 -- start start 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381c0b4810 0x7f381c0d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f381c06e0f0 0x7f381c1615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f381c161f30 con 0x7f381c161b20 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c06e5f0 con 0x7f381c0b4810 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3823200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f381c06e8d0 con 0x7f381c06e0f0 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381c0b4810 0x7f381c0d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f381c0b4810 0x7f381c0d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46864/0 (socket says 172.21.15.18:46864) 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 -- 172.21.15.18:0/1850341117 learned_addr learned my addr 172.21.15.18:0/1850341117 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:28.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f3813400640 1 --2- 172.21.15.18:0/1850341117 >> v2:172.21.15.167:3300/0 conn(0x7f381c06e0f0 0x7f381c1615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 -- 172.21.15.18:0/1850341117 >> v2:172.21.15.167:3300/0 conn(0x7f381c06e0f0 msgr2=0x7f381c1615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 --2- 172.21.15.18:0/1850341117 >> v2:172.21.15.167:3300/0 conn(0x7f381c06e0f0 0x7f381c1615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 -- 172.21.15.18:0/1850341117 >> v1:172.21.15.18:6789/0 conn(0x7f381c161b20 legacy=0x7f381c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381be00640 1 -- 172.21.15.18:0/1850341117 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c06ebb0 con 0x7f381c0b4810 2024-04-25T10:10:28.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.882+0000 7f381b400640 1 -- 172.21.15.18:0/1850341117 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288101592 0 0) 0x7f3814001120 con 0x7f381c161b20 2024-04-25T10:10:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f381be00640 1 --2- 172.21.15.18:0/1850341117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c0b4810 0x7f381c0d04e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f381c072e50 tx=0x7f380c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557e718a6aa80fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f381b400640 1 -- 172.21.15.18:0/1850341117 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0a56f0 con 0x7f381c0b4810 2024-04-25T10:10:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f381b400640 1 -- 172.21.15.18:0/1850341117 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c0a5890 con 0x7f381c0b4810 2024-04-25T10:10:28.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f381b400640 1 -- 172.21.15.18:0/1850341117 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c0a5c60 con 0x7f381c0b4810 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- 172.21.15.18:0/1850341117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c0b4810 msgr2=0x7f381c0d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 --2- 172.21.15.18:0/1850341117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c0b4810 0x7f381c0d04e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f381c072e50 tx=0x7f380c01c960 comp rx=0 tx=0).stop 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- 172.21.15.18:0/1850341117 shutdown_connections 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 --2- 172.21.15.18:0/1850341117 >> v2:172.21.15.167:3300/0 conn(0x7f381c06e0f0 0x7f381c1615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 --2- 172.21.15.18:0/1850341117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c0b4810 0x7f381c0d04e0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- 172.21.15.18:0/1850341117 >> 172.21.15.18:0/1850341117 conn(0x7f381c0cf9c0 msgr2=0x7f381c0cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- 172.21.15.18:0/1850341117 shutdown_connections 2024-04-25T10:10:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- 172.21.15.18:0/1850341117 wait complete. 2024-04-25T10:10:28.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 Processor -- start 2024-04-25T10:10:28.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.886+0000 7f3823200640 1 -- start start 2024-04-25T10:10:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f381c06e0f0 0x7f381c153910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c0b4810 0x7f381c1f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c16ab00 con 0x7f381c161b20 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f381c16a980 con 0x7f381c0b4810 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f381c16ac80 con 0x7f381c06e0f0 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 -- 172.21.15.18:0/2798231678 learned_addr learned my addr 172.21.15.18:0/2798231678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:28.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3813400640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c0b4810 0x7f381c1f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f381be00640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f381c06e0f0 0x7f381c153910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 -- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f381c06e0f0 msgr2=0x7f381c153910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f381c06e0f0 0x7f381c153910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 -- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c0b4810 msgr2=0x7f381c1f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c0b4810 0x7f381c1f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:28.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 -- 172.21.15.18:0/2798231678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f381c1f7c40 con 0x7f381c161b20 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3821200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f381400c410 tx=0x7f381400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814017070 con 0x7f381c161b20 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814003600 con 0x7f381c161b20 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140039f0 con 0x7f381c161b20 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f381c0ad710 con 0x7f381c161b20 2024-04-25T10:10:28.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381c0adcd0 con 0x7f381c161b20 2024-04-25T10:10:28.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.890+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381c0745d0 con 0x7f381c161b20 2024-04-25T10:10:28.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.894+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f381401a070 con 0x7f381c161b20 2024-04-25T10:10:28.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.894+0000 7f3818c00640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 0x7f37f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:28.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.894+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f38140845f0 con 0x7f381c161b20 2024-04-25T10:10:28.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.894+0000 7f381be00640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 0x7f37f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:28.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.894+0000 7f381be00640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 0x7f37f8069420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f380c0ae000 tx=0x7f380c0a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:28.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:28.898+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f381c1f7c40 con 0x7f381c161b20 2024-04-25T10:10:29.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.058+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f381c0cbe00 con 0x7f381c161b20 2024-04-25T10:10:29.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3818c00640 1 -- 172.21.15.18:0/2798231678 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v93) v1 ==== 100+0+11 (secure 0 0 0) 0x7f381c161f30 con 0x7f381c161b20 2024-04-25T10:10:29.068 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 msgr2=0x7f37f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 0x7f37f8069420 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f380c0ae000 tx=0x7f380c0a7070 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 msgr2=0x7f381c160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f381400c410 tx=0x7f381400c810 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 shutdown_connections 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f381c161b20 0x7f381c160a00 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f381c0b4810 0x7f381c1f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f37f8066f60 0x7f37f8069420 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 --2- 172.21.15.18:0/2798231678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f381c06e0f0 0x7f381c153910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 >> 172.21.15.18:0/2798231678 conn(0x7f381c0cf9c0 msgr2=0x7f381c14e740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 shutdown_connections 2024-04-25T10:10:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.062+0000 7f3823200640 1 -- 172.21.15.18:0/2798231678 wait complete. 2024-04-25T10:10:29.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:10:29.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 Processor -- start 2024-04-25T10:10:29.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 -- start start 2024-04-25T10:10:29.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc040b4810 0x7fbc040d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 0x7fbc041615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc04161f30 con 0x7fbc04161b20 2024-04-25T10:10:29.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0406e5f0 con 0x7fbc040b4810 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc09400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0406e8d0 con 0x7fbc0406e0f0 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.222+0000 7fbc02800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc040b4810 0x7fbc040d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc03200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbc04161b20 0x7fbc0415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44476/0 (socket says 172.21.15.18:44476) 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc03200640 1 -- 172.21.15.18:0/3475180506 learned_addr learned my addr 172.21.15.18:0/3475180506 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbbf9e00640 1 --2- 172.21.15.18:0/3475180506 >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 0x7fbc041615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc02800640 1 -- 172.21.15.18:0/3475180506 >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 msgr2=0x7fbc041615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc02800640 1 --2- 172.21.15.18:0/3475180506 >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 0x7fbc041615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc02800640 1 -- 172.21.15.18:0/3475180506 >> v1:172.21.15.18:6789/0 conn(0x7fbc04161b20 legacy=0x7fbc0415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc02800640 1 -- 172.21.15.18:0/3475180506 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0406ebb0 con 0x7fbc040b4810 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbbf9e00640 1 --2- 172.21.15.18:0/3475180506 >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 0x7fbc041615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:29.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc01e00640 1 -- 172.21.15.18:0/3475180506 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2003783829 0 0) 0x7fbbfc0014a0 con 0x7fbc04161b20 2024-04-25T10:10:29.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc02800640 1 --2- 172.21.15.18:0/3475180506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc040d04e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fbc04072e50 tx=0x7fbbf401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ebd3853169df1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc01e00640 1 -- 172.21.15.18:0/3475180506 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40b0070 con 0x7fbc040b4810 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc01e00640 1 -- 172.21.15.18:0/3475180506 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40ab600 con 0x7fbc040b4810 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.226+0000 7fbc01e00640 1 -- 172.21.15.18:0/3475180506 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab9d0 con 0x7fbc040b4810 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- 172.21.15.18:0/3475180506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 msgr2=0x7fbc040d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- 172.21.15.18:0/3475180506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc040d04e0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fbc04072e50 tx=0x7fbbf401c3f0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- 172.21.15.18:0/3475180506 shutdown_connections 2024-04-25T10:10:29.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- 172.21.15.18:0/3475180506 >> v2:172.21.15.167:3300/0 conn(0x7fbc0406e0f0 0x7fbc041615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- 172.21.15.18:0/3475180506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc040d04e0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- 172.21.15.18:0/3475180506 >> 172.21.15.18:0/3475180506 conn(0x7fbc040cf9c0 msgr2=0x7fbc040cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:29.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- 172.21.15.18:0/3475180506 shutdown_connections 2024-04-25T10:10:29.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- 172.21.15.18:0/3475180506 wait complete. 2024-04-25T10:10:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 Processor -- start 2024-04-25T10:10:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- start start 2024-04-25T10:10:29.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc0406e0f0 0x7fbc040ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc04161b20 0x7fbc0414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0416ab00 con 0x7fbc040b4810 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0416a980 con 0x7fbc04161b20 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc09400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0416ac80 con 0x7fbc0406e0f0 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46880/0 (socket says 172.21.15.18:46880) 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 -- 172.21.15.18:0/4079375646 learned_addr learned my addr 172.21.15.18:0/4079375646 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:29.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc02800640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc0406e0f0 0x7fbc040ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbc03200640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc04161b20 0x7fbc0414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 -- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc0406e0f0 msgr2=0x7fbc040ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc0406e0f0 0x7fbc040ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 -- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc04161b20 msgr2=0x7fbc0414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc04161b20 0x7fbc0414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 -- 172.21.15.18:0/4079375646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc040cd170 con 0x7fbc040b4810 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbf9e00640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e840 tx=0x7fbbec00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.230+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec017070 con 0x7fbc040b4810 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbec00c6d0 con 0x7fbc040b4810 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc040cd940 con 0x7fbc040b4810 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbec00f040 con 0x7fbc040b4810 2024-04-25T10:10:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc040cdf00 con 0x7fbc040b4810 2024-04-25T10:10:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc040745d0 con 0x7fbc040b4810 2024-04-25T10:10:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbec01a070 con 0x7fbc040b4810 2024-04-25T10:10:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbbfb400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 0x7fbbe0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbbec084da0 con 0x7fbc040b4810 2024-04-25T10:10:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.234+0000 7fbc02800640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 0x7fbbe0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.238+0000 7fbc02800640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 0x7fbbe0069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad000 tx=0x7fbbf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.238+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbec055c10 con 0x7fbc040b4810 2024-04-25T10:10:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc040cbe00 con 0x7fbc040b4810 2024-04-25T10:10:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbbfb400640 1 -- 172.21.15.18:0/4079375646 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v93) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbec055510 con 0x7fbc040b4810 2024-04-25T10:10:29.421 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 msgr2=0x7fbbe0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 0x7fbbe0069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40ad000 tx=0x7fbbf4008040 comp rx=0 tx=0).stop 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 msgr2=0x7fbc04153650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fbbec00e840 tx=0x7fbbec00ed00 comp rx=0 tx=0).stop 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 shutdown_connections 2024-04-25T10:10:29.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc04161b20 0x7fbc0414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc040b4810 0x7fbc04153650 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbbe0066f60 0x7fbbe0069420 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 --2- 172.21.15.18:0/4079375646 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc0406e0f0 0x7fbc040ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 >> 172.21.15.18:0/4079375646 conn(0x7fbc040cf9c0 msgr2=0x7fbc04160950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 shutdown_connections 2024-04-25T10:10:29.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.414+0000 7fbc09400640 1 -- 172.21.15.18:0/4079375646 wait complete. 2024-04-25T10:10:29.442 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:10:29.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:29.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:29.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:10:29.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:29.504 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:10:29.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 Processor -- start 2024-04-25T10:10:29.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 -- start start 2024-04-25T10:10:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7940cef00 con 0x7fb79406bc20 2024-04-25T10:10:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7940cfa80 con 0x7fb7940b40b0 2024-04-25T10:10:29.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb794066dd0 con 0x7fb79415dc70 2024-04-25T10:10:29.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38302/0 (socket says 172.21.15.18:38302) 2024-04-25T10:10:29.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb78a000640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fb79406bc20 0x7fb7940cdb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:60980/0 (socket says 172.21.15.18:60980) 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:50802/0 (socket says 172.21.15.18:50802) 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793400640 1 -- 172.21.15.18:0/293038620 learned_addr learned my addr 172.21.15.18:0/293038620 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 -- 172.21.15.18:0/293038620 >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 msgr2=0x7fb79406c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 --2- 172.21.15.18:0/293038620 >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 -- 172.21.15.18:0/293038620 >> v1:172.21.15.167:6789/0 conn(0x7fb79406bc20 legacy=0x7fb7940cdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb792a00640 1 -- 172.21.15.18:0/293038620 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7940cf1e0 con 0x7fb79415dc70 2024-04-25T10:10:29.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.697+0000 7fb793400640 1 --2- 172.21.15.18:0/293038620 >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:29.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb792a00640 1 --2- 172.21.15.18:0/293038620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb78401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b65cdd943c48d99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb792000640 1 -- 172.21.15.18:0/293038620 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840b2070 con 0x7fb79415dc70 2024-04-25T10:10:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb792000640 1 -- 172.21.15.18:0/293038620 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7840ad640 con 0x7fb79415dc70 2024-04-25T10:10:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb792000640 1 -- 172.21.15.18:0/293038620 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840ada10 con 0x7fb79415dc70 2024-04-25T10:10:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 -- 172.21.15.18:0/293038620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 msgr2=0x7fb7940cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 --2- 172.21.15.18:0/293038620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb78401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 -- 172.21.15.18:0/293038620 shutdown_connections 2024-04-25T10:10:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 --2- 172.21.15.18:0/293038620 >> v2:172.21.15.167:3300/0 conn(0x7fb7940b40b0 0x7fb79406c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 --2- 172.21.15.18:0/293038620 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb79415dc70 0x7fb7940cbeb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 -- 172.21.15.18:0/293038620 >> 172.21.15.18:0/293038620 conn(0x7fb7940cd560 msgr2=0x7fb794071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 -- 172.21.15.18:0/293038620 shutdown_connections 2024-04-25T10:10:29.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.701+0000 7fb793e00640 1 -- 172.21.15.18:0/293038620 wait complete. 2024-04-25T10:10:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 Processor -- start 2024-04-25T10:10:29.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- start start 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 0x7fb79413b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 0x7fb794152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940cebb0 con 0x7fb79406bc20 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7940cea30 con 0x7fb79415dc70 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79416a690 con 0x7fb7940b40b0 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46884/0 (socket says 172.21.15.18:46884) 2024-04-25T10:10:29.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 -- 172.21.15.18:0/2892780687 learned_addr learned my addr 172.21.15.18:0/2892780687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb78a000640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 0x7fb79413b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793400640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 0x7fb794152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 -- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 msgr2=0x7fb79413b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 0x7fb79413b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 -- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 msgr2=0x7fb794152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 0x7fb794152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 -- 172.21.15.18:0/2892780687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79413b9d0 con 0x7fb79406bc20 2024-04-25T10:10:29.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb78a000640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 0x7fb79413b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793400640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 0x7fb794152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb792a00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb784019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840b2040 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7840be070 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7840b8680 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb794149770 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.705+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb794149d30 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb79404efa0 con 0x7fb79406bc20 2024-04-25T10:10:29.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb7840b8820 con 0x7fb79406bc20 2024-04-25T10:10:29.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb78b400640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 0x7fb770069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:29.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb78411f850 con 0x7fb79406bc20 2024-04-25T10:10:29.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb78a000640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 0x7fb770069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:29.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.709+0000 7fb78a000640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 0x7fb770069450 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb7940b0d80 tx=0x7fb77c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:29.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.713+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb784016090 con 0x7fb79406bc20 2024-04-25T10:10:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.905+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb794073200 con 0x7fb79406bc20 2024-04-25T10:10:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb78b400640 1 -- 172.21.15.18:0/2892780687 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fb7840f0630 con 0x7fb79406bc20 2024-04-25T10:10:29.916 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:29.917 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:22.696457+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7503},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7503":{"gid":7503,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2607538595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2607538595},{"type":"v1","addr":"172.21.15.18:6835","nonce":2607538595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 63 2024-04-25T10:10:29.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 msgr2=0x7fb770069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 0x7fb770069450 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb7940b0d80 tx=0x7fb77c009040 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 msgr2=0x7fb79415e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fb7840097c0 tx=0x7fb784019240 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 shutdown_connections 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb79415dc70 0x7fb794152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb770066f90 0x7fb770069450 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb7940b40b0 0x7fb79413b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 --2- 172.21.15.18:0/2892780687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb79406bc20 0x7fb79415e050 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 >> 172.21.15.18:0/2892780687 conn(0x7fb7940cd560 msgr2=0x7fb7940cdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 shutdown_connections 2024-04-25T10:10:29.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:29.909+0000 7fb793e00640 1 -- 172.21.15.18:0/2892780687 wait complete. 2024-04-25T10:10:29.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T10:10:30.106 INFO:teuthology.orchestra.run.smithi018.stdout:{"message":"","return_code":0} 2024-04-25T10:10:30.106 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:10:30.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:10:30.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 Processor -- start 2024-04-25T10:10:30.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 -- start start 2024-04-25T10:10:30.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 0x7f7c5006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c5015fc00 con 0x7f7c5006e010 2024-04-25T10:10:30.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c5006d640 con 0x7f7c50159320 2024-04-25T10:10:30.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c54a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5015fee0 con 0x7f7c5015f440 2024-04-25T10:10:30.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c4de00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c45400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 0x7f7c5006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c4de00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38330/0 (socket says 172.21.15.18:38330) 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c4de00640 1 -- 172.21.15.18:0/3630564439 learned_addr learned my addr 172.21.15.18:0/3630564439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c4d400640 1 -- 172.21.15.18:0/3630564439 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866759509 0 0) 0x7f7c5015fc00 con 0x7f7c5006e010 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c45400640 1 -- 172.21.15.18:0/3630564439 >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 msgr2=0x7f7c5015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c45400640 1 --2- 172.21.15.18:0/3630564439 >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c45400640 1 -- 172.21.15.18:0/3630564439 >> v1:172.21.15.167:6789/0 conn(0x7f7c5006e010 legacy=0x7f7c5006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c45400640 1 -- 172.21.15.18:0/3630564439 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c501601c0 con 0x7f7c5015f440 2024-04-25T10:10:30.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.241+0000 7f7c4de00640 1 --2- 172.21.15.18:0/3630564439 >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:30.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c45400640 1 --2- 172.21.15.18:0/3630564439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 0x7f7c5006dad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c380097c0 tx=0x7f7c3801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e856e7f1a1d9051 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c4d400640 1 -- 172.21.15.18:0/3630564439 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380ab600 con 0x7f7c5015f440 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c4d400640 1 -- 172.21.15.18:0/3630564439 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c380b0070 con 0x7f7c5015f440 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c4d400640 1 -- 172.21.15.18:0/3630564439 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380ab9c0 con 0x7f7c5015f440 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 -- 172.21.15.18:0/3630564439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 msgr2=0x7f7c5006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 --2- 172.21.15.18:0/3630564439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 0x7f7c5006dad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c380097c0 tx=0x7f7c3801c3e0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 -- 172.21.15.18:0/3630564439 shutdown_connections 2024-04-25T10:10:30.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 --2- 172.21.15.18:0/3630564439 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c5015f440 0x7f7c5006dad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 --2- 172.21.15.18:0/3630564439 >> v2:172.21.15.167:3300/0 conn(0x7f7c50159320 0x7f7c5015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 -- 172.21.15.18:0/3630564439 >> 172.21.15.18:0/3630564439 conn(0x7f7c50067080 msgr2=0x7f7c5006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 -- 172.21.15.18:0/3630564439 shutdown_connections 2024-04-25T10:10:30.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.245+0000 7f7c54a00640 1 -- 172.21.15.18:0/3630564439 wait complete. 2024-04-25T10:10:30.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 Processor -- start 2024-04-25T10:10:30.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- start start 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c50159320 0x7f7c501438f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5015f440 0x7f7c50157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50071c00 con 0x7f7c5006e010 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50071a80 con 0x7f7c5015f440 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5006ebb0 con 0x7f7c50159320 2024-04-25T10:10:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46900/0 (socket says 172.21.15.18:46900) 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 -- 172.21.15.18:0/1316753633 learned_addr learned my addr 172.21.15.18:0/1316753633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 -- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c50159320 msgr2=0x7f7c501438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c50159320 0x7f7c501438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 -- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5015f440 msgr2=0x7f7c50157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5015f440 0x7f7c50157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 -- 172.21.15.18:0/1316753633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5013b050 con 0x7f7c5006e010 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c4de00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9d0 tx=0x7f7c4000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40017070 con 0x7f7c5006e010 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000ca60 con 0x7f7c5006e010 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000ce10 con 0x7f7c5006e010 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5013b2c0 con 0x7f7c5006e010 2024-04-25T10:10:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.249+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5013ab90 con 0x7f7c5006e010 2024-04-25T10:10:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500745d0 con 0x7f7c5006e010 2024-04-25T10:10:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c4001a070 con 0x7f7c5006e010 2024-04-25T10:10:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c46a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 0x7f7c2c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7c400850c0 con 0x7f7c5006e010 2024-04-25T10:10:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c45400640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 0x7f7c2c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.253+0000 7f7c45400640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 0x7f7c2c069450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c38004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.257+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c40055f30 con 0x7f7c5006e010 2024-04-25T10:10:30.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.457+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7c500cbdb0 con 0x7f7c5006e010 2024-04-25T10:10:30.465 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:10:30.457+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:10:30.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.457+0000 7f7c46a00640 1 -- 172.21.15.18:0/1316753633 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7c40055830 con 0x7f7c5006e010 2024-04-25T10:10:30.467 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 msgr2=0x7f7c2c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 0x7f7c2c069450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c38004740 comp rx=0 tx=0).stop 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 msgr2=0x7f7c5013d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000e9d0 tx=0x7f7c4000ee90 comp rx=0 tx=0).stop 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 shutdown_connections 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c5015f440 0x7f7c50157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7c2c066f90 0x7f7c2c069450 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7c50159320 0x7f7c501438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 --2- 172.21.15.18:0/1316753633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c5006e010 0x7f7c5013d630 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 >> 172.21.15.18:0/1316753633 conn(0x7f7c50067080 msgr2=0x7f7c5006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 shutdown_connections 2024-04-25T10:10:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.461+0000 7f7c54a00640 1 -- 172.21.15.18:0/1316753633 wait complete. 2024-04-25T10:10:30.484 INFO:tasks.ceph.mds.c.smithi018.stderr: -4854> 2024-04-25T10:10:22.218+0000 7f79c9a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:10:30.497 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T10:10:30.539 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:10:30.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 Processor -- start 2024-04-25T10:10:30.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 -- start start 2024-04-25T10:10:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320ab49b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320ab32870 0x56320ab4a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320aa209f0 con 0x56320ab32490 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320aa24950 con 0x56320aa7ce80 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.533+0000 7f1399b59080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56320ab34b50 con 0x56320ab32870 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320ab49b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38368/0 (socket says 172.21.15.18:38368) 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 -- 172.21.15.18:0/952188089 learned_addr learned my addr 172.21.15.18:0/952188089 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1397800640 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320ab32870 0x56320ab4a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 -- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320ab32870 msgr2=0x56320ab4a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320ab32870 0x56320ab4a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 -- 172.21.15.18:0/952188089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 msgr2=0x56320ab49b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320ab49b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 -- 172.21.15.18:0/952188089 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56320ab322a0 con 0x56320aa7ce80 2024-04-25T10:10:30.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396400640 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320ab49b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1396e00640 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f138800a500 tx=0x7f1388003030 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c7cce9279ca02e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1395000640 1 -- 172.21.15.18:0/952188089 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880af040 con 0x56320aa7ce80 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1395000640 1 -- 172.21.15.18:0/952188089 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13880b9070 con 0x56320aa7ce80 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1395000640 1 -- 172.21.15.18:0/952188089 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13880b4410 con 0x56320aa7ce80 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 msgr2=0x56320ab4af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f138800a500 tx=0x7f1388003030 comp rx=0 tx=0).stop 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- 172.21.15.18:0/952188089 shutdown_connections 2024-04-25T10:10:30.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320ab32870 0x56320ab4a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320ab49b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 --2- 172.21.15.18:0/952188089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320aa7ce80 0x56320ab4af10 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- 172.21.15.18:0/952188089 >> 172.21.15.18:0/952188089 conn(0x56320aa7a400 msgr2=0x56320aaa5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- 172.21.15.18:0/952188089 shutdown_connections 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- 172.21.15.18:0/952188089 wait complete. 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 Processor -- start 2024-04-25T10:10:30.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 -- start start 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.537+0000 7f1399b59080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320aa7ce80 0x56320abed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320aac2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320ab32870 0x56320aac2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320ab4f3b0 con 0x56320ab32490 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56320aaa8f60 con 0x56320ab32870 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56320ab4f650 con 0x56320aa7ce80 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320aac2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320aac2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46944/0 (socket says 172.21.15.18:46944) 2024-04-25T10:10:30.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 -- 172.21.15.18:0/527177272 learned_addr learned my addr 172.21.15.18:0/527177272 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396e00640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320aa7ce80 0x56320abed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1397800640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320ab32870 0x56320aac2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 -- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320aa7ce80 msgr2=0x56320abed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320aa7ce80 0x56320abed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 -- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320ab32870 msgr2=0x56320aac2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320ab32870 0x56320aac2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 -- 172.21.15.18:0/527177272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56320aabec90 con 0x56320ab32490 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396e00640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56320aa7ce80 0x56320abed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1397800640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56320ab32870 0x56320aac2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1396400640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320aac2050 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f138400efd0 tx=0x7f1384002f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f138f400640 1 -- 172.21.15.18:0/527177272 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1384015020 con 0x56320ab32490 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f138f400640 1 -- 172.21.15.18:0/527177272 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1384011660 con 0x56320ab32490 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f138f400640 1 -- 172.21.15.18:0/527177272 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138400a040 con 0x56320ab32490 2024-04-25T10:10:30.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56320aabef30 con 0x56320ab32490 2024-04-25T10:10:30.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56320aabf470 con 0x56320ab32490 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.541+0000 7f138f400640 1 -- 172.21.15.18:0/527177272 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1384018020 con 0x56320ab32490 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f138f400640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378065970 0x7f1378067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f138f400640 1 -- 172.21.15.18:0/527177272 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f13840840f0 con 0x56320ab32490 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1399b59080 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56320ab5a7f0 0x56320aabfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e94) v9 -- 0x56320aac00f0 con 0x56320ab5a7f0 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1396e00640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378065970 0x7f1378067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1397800640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56320ab5a7f0 0x56320aabfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1397800640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56320ab5a7f0 0x56320aabfbb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.545+0000 7f1396e00640 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378065970 0x7f1378067e30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f138800a500 tx=0x7f13880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1397800640 1 -- 172.21.15.18:0/527177272 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v94'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1390004530 con 0x56320ab5a7f0 2024-04-25T10:10:30.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56320ab5a7f0 msgr2=0x56320aabfbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x56320ab5a7f0 0x56320aabfbb0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378065970 msgr2=0x7f1378067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378065970 0x7f1378067e30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f138800a500 tx=0x7f13880a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 msgr2=0x56320aac2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 --2- 172.21.15.18:0/527177272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56320ab32490 0x56320aac2050 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f138400efd0 tx=0x7f1384002f90 comp rx=0 tx=0).stop 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1397800640 1 -- 172.21.15.18:0/527177272 reap_dead start 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 shutdown_connections 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 >> 172.21.15.18:0/527177272 conn(0x56320aa7a400 msgr2=0x56320aaa4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 shutdown_connections 2024-04-25T10:10:30.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.549+0000 7f1399b59080 1 -- 172.21.15.18:0/527177272 wait complete. 2024-04-25T10:10:30.562 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T10:10:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- start start 2024-04-25T10:10:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 Processor -- start 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb736b7800 0x55bb73870580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb736b7400 0x55bb73870b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74486600 con 0x55bb736b7000 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74486480 con 0x55bb736b7400 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb74486300 con 0x55bb736b7800 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46946/0 (socket says 172.21.15.18:46946) 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 -- 172.21.15.18:0/2872248111 learned_addr learned my addr 172.21.15.18:0/2872248111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3670e00640 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb736b7400 0x55bb73870b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3671800640 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb736b7800 0x55bb73870580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 -- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb736b7800 msgr2=0x55bb73870580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb736b7800 0x55bb73870580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 -- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb736b7400 msgr2=0x55bb73870b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb736b7400 0x55bb73870b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 -- 172.21.15.18:0/2872248111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb73758960 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f3672200640 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55bb74517380 tx=0x55bb7377ade0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211cab0ebdd282f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f366e600640 1 -- 172.21.15.18:0/2872248111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ec4e0 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f366e600640 1 -- 172.21.15.18:0/2872248111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb737001c0 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f366e600640 1 -- 172.21.15.18:0/2872248111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ecb60 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb73758d20 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bb73758f00 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 4 waiting for MDS map... 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f366e600640 1 -- 172.21.15.18:0/2872248111 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x55bb745e0600 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f366e600640 1 -- 172.21.15.18:0/2872248111 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 64) v1 ==== 2723+0+0 (secure 0 0 0) 0x55bb7370d180 con 0x55bb736b7000 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 4 Got MDS map 64 2024-04-25T10:10:30.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 10 main: JournalTool::main 2024-04-25T10:10:30.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.641+0000 7f367383a400 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:10:30.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 Processor -- start 2024-04-25T10:10:30.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- start start 2024-04-25T10:10:30.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c0c00 0x55bb73871600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74486180 con 0x55bb745c1000 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb73716480 con 0x55bb745c0c00 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb73716900 con 0x55bb745c1400 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46950/0 (socket says 172.21.15.18:46950) 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 -- 172.21.15.18:0/2676935888 learned_addr learned my addr 172.21.15.18:0/2676935888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3670e00640 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c0c00 0x55bb73871600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3670e00640 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 -- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 msgr2=0x55bb73872100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 -- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c0c00 msgr2=0x55bb73871600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c0c00 0x55bb73871600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 -- 172.21.15.18:0/2676935888 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb73758d20 con 0x55bb745c1000 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f3671800640 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55bb745169c0 tx=0x55bb7378e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00fdca402807531 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f366be00640 1 -- 172.21.15.18:0/2676935888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ec9c0 con 0x55bb745c1000 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f366be00640 1 -- 172.21.15.18:0/2676935888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb73700a80 con 0x55bb745c1000 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f366be00640 1 -- 172.21.15.18:0/2676935888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ec4e0 con 0x55bb745c1000 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- 172.21.15.18:0/2676935888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 msgr2=0x55bb73871b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x55bb745169c0 tx=0x55bb7378e000 comp rx=0 tx=0).stop 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- 172.21.15.18:0/2676935888 shutdown_connections 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c1000 0x55bb73871b80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 --2- 172.21.15.18:0/2676935888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c0c00 0x55bb73871600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- 172.21.15.18:0/2676935888 >> 172.21.15.18:0/2676935888 conn(0x55bb736b6c00 msgr2=0x55bb736e3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- 172.21.15.18:0/2676935888 shutdown_connections 2024-04-25T10:10:30.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- 172.21.15.18:0/2676935888 wait complete. 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 Processor -- start 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.645+0000 7f367383a400 1 -- start start 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c1000 0x55bb73872c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74487200 con 0x55bb745c0c00 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74486180 con 0x55bb745c1000 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb74487380 con 0x55bb745c1400 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46956/0 (socket says 172.21.15.18:46956) 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 -- 172.21.15.18:0/1747208919 learned_addr learned my addr 172.21.15.18:0/1747208919 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3671800640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c1000 0x55bb73872c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 -- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 msgr2=0x55bb73872680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 -- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c1000 msgr2=0x55bb73872c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c1000 0x55bb73872c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 -- 172.21.15.18:0/1747208919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb73759c20 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f3670e00640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55bb745d7440 tx=0x55bb73778ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f366a000640 1 -- 172.21.15.18:0/1747208919 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ec9c0 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f366a000640 1 -- 172.21.15.18:0/1747208919 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb73700540 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f366a000640 1 -- 172.21.15.18:0/1747208919 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb736ec4e0 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bb73759e00 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb737581e0 con 0x55bb745c0c00 2024-04-25T10:10:30.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f367383a400 4 main: JournalTool: resolving pool 13 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.649+0000 7f366a000640 1 -- 172.21.15.18:0/1747208919 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55bb739f0c00 con 0x55bb745c0c00 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f366a000640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 0x55bb73873700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f366a000640 1 -- 172.21.15.18:0/1747208919 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x55bb739faa00 con 0x55bb745c0c00 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 4 main: Executing for rank 0 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3671800640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 0x55bb73873700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3671800640 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 0x55bb73873700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55bb745169c0 tx=0x55bb7378e300 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- start start 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 Processor -- start 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1c00 0x55bb73872100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb739f9000 0x55bb73871b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 0x55bb73871600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74487680 con 0x55bb739f9400 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bb74487800 con 0x55bb739f9000 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bb73716900 con 0x55bb745c1c00 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 0x55bb73871600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3672200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1c00 0x55bb73872100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 0x55bb73871600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46968/0 (socket says 172.21.15.18:46968) 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 learned_addr learned my addr 172.21.15.18:0/1298274562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3671800640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb739f9000 0x55bb73871b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1c00 msgr2=0x55bb73872100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1c00 0x55bb73872100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb739f9000 msgr2=0x55bb73871b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb739f9000 0x55bb73871b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bb73b2c1e0 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1c00 0x55bb73872100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3670e00640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 0x55bb73871600 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x55bb73aa75c0 tx=0x55bb745f1560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dd9f7dc8ad9d849 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3666400640 1 -- 172.21.15.18:0/1298274562 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb73a73ba0 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3666400640 1 -- 172.21.15.18:0/1298274562 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bb73700a80 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3666400640 1 -- 172.21.15.18:0/1298274562 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bb73a73d40 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bb73b2c3c0 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bb73b2c5a0 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 4 waiting for MDS map... 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3666400640 1 -- 172.21.15.18:0/1298274562 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x55bb73b40200 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f3666400640 1 -- 172.21.15.18:0/1298274562 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 64) v1 ==== 2723+0+0 (secure 0 0 0) 0x55bb73b4a000 con 0x55bb739f9400 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 4 Got MDS map 64 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.653+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55bb739f9800 0x55bb73b5c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb739f9c00 con 0x55bb739f9800 2024-04-25T10:10:30.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55bb739f9800 0x55bb73b5c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55bb739f9800 0x55bb73b5c000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=6ccd47abff057391 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55bb73832000 con 0x55bb739f9800 2024-04-25T10:10:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55bb73b3f000 0x55bb73b5c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b3f400 con 0x55bb73b3f000 2024-04-25T10:10:30.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3671800640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55bb73b3f000 0x55bb73b5c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3671800640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55bb73b3f000 0x55bb73b5c580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=1663ead61a0dbc7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3671800640 1 -- 172.21.15.18:0/1298274562 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55bb73832500 con 0x55bb73b3f000 2024-04-25T10:10:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3664600640 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b64000 con 0x55bb73b3f000 2024-04-25T10:10:30.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3664600640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55bb73b64400 0x55bb73b5e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3664600640 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b64800 con 0x55bb73b64400 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3671800640 1 -- 172.21.15.18:0/1298274562 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x55bb73832500 con 0x55bb73b3f000 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.657+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55bb73b64400 0x55bb73b5e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55bb73b64400 0x55bb73b5e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=661e9713ac285721 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb73b64400 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stdout:old journal was 4212018~2544 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stdout:new journal start will be 8388608 (4174046 bytes past old end) 2024-04-25T10:10:30.671 INFO:teuthology.orchestra.run.smithi018.stdout:writing journal head 2024-04-25T10:10:30.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b3f800 con 0x55bb73b3f000 2024-04-25T10:10:30.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3671800640 1 -- 172.21.15.18:0/1298274562 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v94'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832500 con 0x55bb73b3f000 2024-04-25T10:10:30.672 INFO:teuthology.orchestra.run.smithi018.stdout:writing EResetJournal entry 2024-04-25T10:10:30.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b3fc00 con 0x55bb73b64400 2024-04-25T10:10:30.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55bb73b64000 0x55bb73b5cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b64c00 con 0x55bb73b64000 2024-04-25T10:10:30.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b65000 con 0x55bb739f9800 2024-04-25T10:10:30.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55bb73b65400 0x55bb73b5d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b65800 con 0x55bb73b65400 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b3f400 con 0x55bb73b64400 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55bb73b3f800 0x55bb73b5d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb74489400 con 0x55bb73b3f800 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3670e00640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55bb73b65400 0x55bb73b5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3671800640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55bb73b64000 0x55bb73b5cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55bb73b3f800 0x55bb73b5d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3670e00640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55bb73b65400 0x55bb73b5d080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=b573c569b17f15f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3671800640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55bb73b64000 0x55bb73b5cb00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=fcbabf019dbd11f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.661+0000 7f3672200640 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55bb73b3f800 0x55bb73b5d600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=2b5454982daaebae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(8 200.00000004 [delete] v94'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb739f9800 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(6 200.00000002 [delete] v94'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb73b64400 2024-04-25T10:10:30.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(9 200.00000005 [delete] v94'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832780 con 0x55bb73b65400 2024-04-25T10:10:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(10 200.00000006 [delete] v94'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb73b64400 2024-04-25T10:10:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3671800640 1 -- 172.21.15.18:0/1298274562 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(7 200.00000003 [delete] v94'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832500 con 0x55bb73b64000 2024-04-25T10:10:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3664600640 1 -- 172.21.15.18:0/1298274562 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e94) v9 -- 0x55bb73b3fc00 con 0x55bb73b64400 2024-04-25T10:10:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v94'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb73b64400 2024-04-25T10:10:30.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.665+0000 7f3672200640 1 -- 172.21.15.18:0/1298274562 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(11 200.00000007 [delete] v94'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bb73832000 con 0x55bb73b3f800 2024-04-25T10:10:30.677 INFO:teuthology.orchestra.run.smithi018.stdout:done 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55bb73b3f000 msgr2=0x55bb73b5c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55bb73b3f000 0x55bb73b5c580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55bb73b65400 msgr2=0x55bb73b5d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55bb73b65400 0x55bb73b5d080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55bb73b64400 msgr2=0x55bb73b5e680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55bb73b64400 0x55bb73b5e680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55bb73b64000 msgr2=0x55bb73b5cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55bb73b64000 0x55bb73b5cb00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55bb739f9800 msgr2=0x55bb73b5c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55bb739f9800 0x55bb73b5c000 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55bb73b3f800 msgr2=0x55bb73b5d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55bb73b3f800 0x55bb73b5d600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 msgr2=0x55bb73871600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1298274562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb739f9400 0x55bb73871600 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x55bb73aa75c0 tx=0x55bb745f1560 comp rx=0 tx=0).stop 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 reap_dead start 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f3670e00640 1 -- 172.21.15.18:0/1298274562 reap_dead start 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 shutdown_connections 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 >> 172.21.15.18:0/1298274562 conn(0x55bb745c1800 msgr2=0x55bb736e2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 shutdown_connections 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1298274562 wait complete. 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 msgr2=0x55bb73873700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 0x55bb73873700 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55bb745169c0 tx=0x55bb7378e300 comp rx=0 tx=0).stop 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 msgr2=0x55bb73873180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x55bb745d7440 tx=0x55bb73778ae0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 shutdown_connections 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55bb739f8c00 0x55bb73873700 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb745c1400 0x55bb73872680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb745c1000 0x55bb73872c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/1747208919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb745c0c00 0x55bb73873180 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 >> 172.21.15.18:0/1747208919 conn(0x55bb736b6c00 msgr2=0x55bb736e3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 shutdown_connections 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/1747208919 wait complete. 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 msgr2=0x55bb73871080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x55bb74517380 tx=0x55bb7377ade0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 shutdown_connections 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bb736b7000 0x55bb73871080 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bb736b7400 0x55bb73870b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 --2- 172.21.15.18:0/2872248111 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bb736b7800 0x55bb73870580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 >> 172.21.15.18:0/2872248111 conn(0x55bb736b7c00 msgr2=0x55bb736e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 shutdown_connections 2024-04-25T10:10:30.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.669+0000 7f367383a400 1 -- 172.21.15.18:0/2872248111 wait complete. 2024-04-25T10:10:30.683 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.120577, result: old journal was 4212018~2544 new journal start will be 8388608 (4174046 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T10:10:30.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:10:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 Processor -- start 2024-04-25T10:10:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 -- start start 2024-04-25T10:10:30.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f148015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148015bc40 con 0x7f14800b3090 2024-04-25T10:10:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148015b3a0 con 0x7f14800ccbf0 2024-04-25T10:10:30.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.817+0000 7f1485c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148015e490 con 0x7f1480144120 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f14800b3090 0x7f148006e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44518/0 (socket says 172.21.15.18:44518) 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147f400640 1 -- 172.21.15.18:0/281621507 learned_addr learned my addr 172.21.15.18:0/281621507 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147ea00640 1 --2- 172.21.15.18:0/281621507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f148015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356790443 0 0) 0x7f148015bc40 con 0x7f14800b3090 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1464003530 con 0x7f14800b3090 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820361257 0 0) 0x7f148015b3a0 con 0x7f14800ccbf0 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f148015bc40 con 0x7f14800ccbf0 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147ea00640 1 -- 172.21.15.18:0/281621507 >> v1:172.21.15.167:6789/0 conn(0x7f14800ccbf0 legacy=0x7f148015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147ea00640 1 -- 172.21.15.18:0/281621507 >> v1:172.21.15.18:6789/0 conn(0x7f14800b3090 legacy=0x7f148006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147ea00640 1 -- 172.21.15.18:0/281621507 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148015b680 con 0x7f1480144120 2024-04-25T10:10:30.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.821+0000 7f147ea00640 1 --2- 172.21.15.18:0/281621507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f148015acd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14700097f0 tx=0x7f147001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5015f2ade188890b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700b0070 con 0x7f1480144120 2024-04-25T10:10:30.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14700ab600 con 0x7f1480144120 2024-04-25T10:10:30.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147e000640 1 -- 172.21.15.18:0/281621507 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700ab9d0 con 0x7f1480144120 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- 172.21.15.18:0/281621507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 msgr2=0x7f148015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 --2- 172.21.15.18:0/281621507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f148015acd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f14700097f0 tx=0x7f147001c450 comp rx=0 tx=0).stop 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- 172.21.15.18:0/281621507 shutdown_connections 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 --2- 172.21.15.18:0/281621507 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f148015acd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- 172.21.15.18:0/281621507 >> 172.21.15.18:0/281621507 conn(0x7f1480067080 msgr2=0x7f148006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- 172.21.15.18:0/281621507 shutdown_connections 2024-04-25T10:10:30.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- 172.21.15.18:0/281621507 wait complete. 2024-04-25T10:10:30.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 Processor -- start 2024-04-25T10:10:30.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- start start 2024-04-25T10:10:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14800ccbf0 0x7f14800b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f14800b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148006ec70 con 0x7f14800b3090 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148006eaf0 con 0x7f14800ccbf0 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f1485c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14800b3470 con 0x7f1480144120 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46978/0 (socket says 172.21.15.18:46978) 2024-04-25T10:10:30.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 -- 172.21.15.18:0/4198999046 learned_addr learned my addr 172.21.15.18:0/4198999046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 -- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 msgr2=0x7f14800b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f14800b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 -- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14800ccbf0 msgr2=0x7f14800b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.825+0000 7f147ea00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14800ccbf0 0x7f14800b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f147ea00640 1 -- 172.21.15.18:0/4198999046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148013e6b0 con 0x7f14800b3090 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f147ea00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f14700097f0 tx=0x7f147001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14700b0050 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14700bc070 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148013e990 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470006e20 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148013acf0 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14800745d0 con 0x7f14800b3090 2024-04-25T10:10:30.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f14700b76b0 con 0x7f14800b3090 2024-04-25T10:10:30.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 0x7f145c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:30.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f147011f120 con 0x7f14800b3090 2024-04-25T10:10:30.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.829+0000 7f1476000640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 0x7f145c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:30.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.833+0000 7f1476000640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 0x7f145c069450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1468007fd0 tx=0x7f1468007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:30.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:30.833+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f14700c5020 con 0x7f14800b3090 2024-04-25T10:10:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.029+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f14800b4430 con 0x7f14800b3090 2024-04-25T10:10:31.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1477400640 1 -- 172.21.15.18:0/4198999046 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v65) v1 ==== 162+0+0 (secure 0 0 0) 0x7f14700160d0 con 0x7f14800b3090 2024-04-25T10:10:31.469 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 msgr2=0x7f145c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 0x7f145c069450 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f1468007fd0 tx=0x7f1468007900 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 msgr2=0x7f14800ac8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f14700097f0 tx=0x7f147001ac90 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 shutdown_connections 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f145c066f90 0x7f145c069450 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1480144120 0x7f14800b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14800ccbf0 0x7f14800b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 --2- 172.21.15.18:0/4198999046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14800b3090 0x7f14800ac8d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 >> 172.21.15.18:0/4198999046 conn(0x7f1480067080 msgr2=0x7f148015e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:31.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 shutdown_connections 2024-04-25T10:10:31.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.461+0000 7f1485c00640 1 -- 172.21.15.18:0/4198999046 wait complete. 2024-04-25T10:10:31.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:31.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.629+0000 7fb588800640 1 Processor -- start 2024-04-25T10:10:31.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.629+0000 7fb588800640 1 -- start start 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.629+0000 7fb588800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 0x7fb5800b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.629+0000 7fb588800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5800b2dc0 0x7fb5800b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb588800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58015def0 con 0x7fb58006dad0 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb588800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58015e1b0 con 0x7fb5800b2dc0 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb588800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb58015e490 con 0x7fb58015b2f0 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5800b2dc0 0x7fb5800b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb5800b2dc0 0x7fb5800b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50074/0 (socket says 172.21.15.18:50074) 2024-04-25T10:10:31.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 -- 172.21.15.18:0/3729575334 learned_addr learned my addr 172.21.15.18:0/3729575334 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 -- 172.21.15.18:0/3729575334 >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 msgr2=0x7fb5800b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585e00640 1 --2- 172.21.15.18:0/3729575334 >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 0x7fb5800b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 --2- 172.21.15.18:0/3729575334 >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 0x7fb5800b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 -- 172.21.15.18:0/3729575334 >> v1:172.21.15.167:6789/0 conn(0x7fb58006dad0 legacy=0x7fb58006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 -- 172.21.15.18:0/3729575334 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58015e770 con 0x7fb5800b2dc0 2024-04-25T10:10:31.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585e00640 1 --2- 172.21.15.18:0/3729575334 >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 0x7fb5800b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb585400640 1 --2- 172.21.15.18:0/3729575334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5800b2dc0 0x7fb5800b3780 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb580072e20 tx=0x7fb57001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cabbf91ccad85ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb584a00640 1 -- 172.21.15.18:0/3729575334 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58015b8e0 con 0x7fb5800b2dc0 2024-04-25T10:10:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb584a00640 1 -- 172.21.15.18:0/3729575334 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5700af070 con 0x7fb5800b2dc0 2024-04-25T10:10:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.633+0000 7fb584a00640 1 -- 172.21.15.18:0/3729575334 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700aa650 con 0x7fb5800b2dc0 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- 172.21.15.18:0/3729575334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5800b2dc0 msgr2=0x7fb5800b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- 172.21.15.18:0/3729575334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5800b2dc0 0x7fb5800b3780 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb580072e20 tx=0x7fb57001c4b0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- 172.21.15.18:0/3729575334 shutdown_connections 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- 172.21.15.18:0/3729575334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5800b2dc0 0x7fb5800b3780 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- 172.21.15.18:0/3729575334 >> v2:172.21.15.167:3300/0 conn(0x7fb58015b2f0 0x7fb5800b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- 172.21.15.18:0/3729575334 >> 172.21.15.18:0/3729575334 conn(0x7fb5800b23b0 msgr2=0x7fb5800cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- 172.21.15.18:0/3729575334 shutdown_connections 2024-04-25T10:10:31.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- 172.21.15.18:0/3729575334 wait complete. 2024-04-25T10:10:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 Processor -- start 2024-04-25T10:10:31.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- start start 2024-04-25T10:10:31.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5800b2dc0 0x7fb5801477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 0x7fb580156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58016a880 con 0x7fb58006dad0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580161730 con 0x7fb58015b2f0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb588800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58016aa00 con 0x7fb5800b2dc0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50090/0 (socket says 172.21.15.18:50090) 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 -- 172.21.15.18:0/3454187531 learned_addr learned my addr 172.21.15.18:0/3454187531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb586800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 0x7fb580156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585400640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5800b2dc0 0x7fb5801477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 -- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5800b2dc0 msgr2=0x7fb5801477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5800b2dc0 0x7fb5801477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 -- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 msgr2=0x7fb580156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 0x7fb580156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb585e00640 1 -- 172.21.15.18:0/3454187531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb580147d10 con 0x7fb58006dad0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.637+0000 7fb586800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 0x7fb580156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb585e00640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c820 tx=0x7fb57400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574015070 con 0x7fb58006dad0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574007a30 con 0x7fb58006dad0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5800cd530 con 0x7fb58006dad0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574007e40 con 0x7fb58006dad0 2024-04-25T10:10:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb580158760 con 0x7fb58006dad0 2024-04-25T10:10:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb580158550 con 0x7fb58006dad0 2024-04-25T10:10:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb574018070 con 0x7fb58006dad0 2024-04-25T10:10:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 0x7fb564069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb574085020 con 0x7fb58006dad0 2024-04-25T10:10:31.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.641+0000 7fb585400640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 0x7fb564069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:31.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.645+0000 7fb585400640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 0x7fb564069450 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5700ae000 tx=0x7fb5700a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.645+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb5740557f0 con 0x7fb58006dad0 2024-04-25T10:10:31.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.841+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5800745d0 con 0x7fb58006dad0 2024-04-25T10:10:31.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.841+0000 7fb57a000640 1 -- 172.21.15.18:0/3454187531 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fb574059890 con 0x7fb58006dad0 2024-04-25T10:10:31.852 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:31.852 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:31.467143+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:replay","state_seq":1,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 66 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 msgr2=0x7fb564069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 0x7fb564069450 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fb5700ae000 tx=0x7fb5700a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 msgr2=0x7fb5800ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb57400c820 tx=0x7fb57400cce0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 shutdown_connections 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb58015b2f0 0x7fb580156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb564066f90 0x7fb564069450 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb5800b2dc0 0x7fb5801477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 --2- 172.21.15.18:0/3454187531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb58006dad0 0x7fb5800ccec0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 >> 172.21.15.18:0/3454187531 conn(0x7fb5800b23b0 msgr2=0x7fb5801579e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 shutdown_connections 2024-04-25T10:10:31.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:31.845+0000 7fb588800640 1 -- 172.21.15.18:0/3454187531 wait complete. 2024-04-25T10:10:32.275 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:10:31.467143+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/4209604816', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 4209604816}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 4209604816}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:10:32.275 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7704:up:replay 2024-04-25T10:10:33.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:33.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 Processor -- start 2024-04-25T10:10:33.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 -- start start 2024-04-25T10:10:33.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f333815b2f0 0x7f33380b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 0x7f33380b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333815def0 con 0x7f33380b2dc0 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f333815e1b0 con 0x7f333815b2f0 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f3340200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333815e490 con 0x7f333806dad0 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f333815b2f0 0x7f33380b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f333815b2f0 0x7f33380b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50094/0 (socket says 172.21.15.18:50094) 2024-04-25T10:10:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 -- 172.21.15.18:0/169734254 learned_addr learned my addr 172.21.15.18:0/169734254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 -- 172.21.15.18:0/169734254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 msgr2=0x7f33380b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333e200640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 0x7f33380b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 0x7f33380b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 -- 172.21.15.18:0/169734254 >> v1:172.21.15.167:6789/0 conn(0x7f33380b2dc0 legacy=0x7f333806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:33.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333d800640 1 -- 172.21.15.18:0/169734254 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f333815e770 con 0x7f333815b2f0 2024-04-25T10:10:33.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.421+0000 7f333e200640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 0x7f33380b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:33.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f333d800640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f333815b2f0 0x7f33380b3240 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f332c009870 tx=0x7f332c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbe9af4d8679cbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:33.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f3337e00640 1 -- 172.21.15.18:0/169734254 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333815b8e0 con 0x7f333815b2f0 2024-04-25T10:10:33.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f3337e00640 1 -- 172.21.15.18:0/169734254 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c0af070 con 0x7f333815b2f0 2024-04-25T10:10:33.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f3337e00640 1 -- 172.21.15.18:0/169734254 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c0aa650 con 0x7f333815b2f0 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f3340200640 1 -- 172.21.15.18:0/169734254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f333815b2f0 msgr2=0x7f33380b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.425+0000 7f3340200640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f333815b2f0 0x7f33380b3240 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f332c009870 tx=0x7f332c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- 172.21.15.18:0/169734254 shutdown_connections 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333806dad0 0x7f33380b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 --2- 172.21.15.18:0/169734254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f333815b2f0 0x7f33380b3240 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- 172.21.15.18:0/169734254 >> 172.21.15.18:0/169734254 conn(0x7f33380b23b0 msgr2=0x7f33380cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:33.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- 172.21.15.18:0/169734254 shutdown_connections 2024-04-25T10:10:33.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- 172.21.15.18:0/169734254 wait complete. 2024-04-25T10:10:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 Processor -- start 2024-04-25T10:10:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- start start 2024-04-25T10:10:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333806dad0 0x7f33380cdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333815b2f0 0x7f33381527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333816a880 con 0x7f33380b2dc0 2024-04-25T10:10:33.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3338161730 con 0x7f333806dad0 2024-04-25T10:10:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f3340200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333816aa00 con 0x7f333815b2f0 2024-04-25T10:10:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50110/0 (socket says 172.21.15.18:50110) 2024-04-25T10:10:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 -- 172.21.15.18:0/316907767 learned_addr learned my addr 172.21.15.18:0/316907767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:33.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333d800640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333806dad0 0x7f33380cdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333e200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333815b2f0 0x7f33381527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 -- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333815b2f0 msgr2=0x7f33381527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333815b2f0 0x7f33381527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 -- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333806dad0 msgr2=0x7f33380cdc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333806dad0 0x7f33380cdc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 -- 172.21.15.18:0/316907767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338158930 con 0x7f33380b2dc0 2024-04-25T10:10:33.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.429+0000 7f333ce00640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f332400c480 tx=0x7f332400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:33.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324012830 con 0x7f33380b2dc0 2024-04-25T10:10:33.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3324017070 con 0x7f33380b2dc0 2024-04-25T10:10:33.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3324012c30 con 0x7f33380b2dc0 2024-04-25T10:10:33.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33380cc770 con 0x7f33380b2dc0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33380cebd0 con 0x7f33380b2dc0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33380745d0 con 0x7f33380b2dc0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f332401c460 con 0x7f33380b2dc0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 0x7f3318069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3324084ee0 con 0x7f33380b2dc0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.433+0000 7f333d800640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 0x7f3318069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:33.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.437+0000 7f333d800640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 0x7f3318069450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f332c0ae000 tx=0x7f332c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:33.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.437+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3324055d00 con 0x7f33380b2dc0 2024-04-25T10:10:33.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.637+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3338158b00 con 0x7f33380b2dc0 2024-04-25T10:10:33.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3335600640 1 -- 172.21.15.18:0/316907767 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f3324055600 con 0x7f33380b2dc0 2024-04-25T10:10:33.648 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:33.648 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:32.478087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:33.648 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 68 2024-04-25T10:10:33.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 msgr2=0x7f3318069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:33.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 0x7f3318069450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f332c0ae000 tx=0x7f332c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:10:33.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 msgr2=0x7f3338144670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f332400c480 tx=0x7f332400c940 comp rx=0 tx=0).stop 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 shutdown_connections 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3318066f90 0x7f3318069450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f333815b2f0 0x7f33381527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33380b2dc0 0x7f3338144670 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 --2- 172.21.15.18:0/316907767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f333806dad0 0x7f33380cdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 >> 172.21.15.18:0/316907767 conn(0x7f33380b23b0 msgr2=0x7f333806b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 shutdown_connections 2024-04-25T10:10:33.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:33.641+0000 7f3340200640 1 -- 172.21.15.18:0/316907767 wait complete. 2024-04-25T10:10:34.074 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:10:32.478087+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.18:6835/4209604816', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 4209604816}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 4209604816}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:10:34.074 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7704:up:rejoin 2024-04-25T10:10:35.075 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:10:35.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.217+0000 7ffb8d800640 1 Processor -- start 2024-04-25T10:10:35.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.217+0000 7ffb8d800640 1 -- start start 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb8d800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb8815fe50 0x7ffb880b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb8d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb880b1c90 0x7ffb8815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb8d800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb880cc4e0 con 0x7ffb88145270 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb8d800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb88145650 con 0x7ffb8815fe50 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb8d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb881602b0 con 0x7ffb880b1c90 2024-04-25T10:10:35.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb8815fe50 0x7ffb880b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb8815fe50 0x7ffb880b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50112/0 (socket says 172.21.15.18:50112) 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 -- 172.21.15.18:0/2575456087 learned_addr learned my addr 172.21.15.18:0/2575456087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb87400640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb880b1c90 0x7ffb8815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 -- 172.21.15.18:0/2575456087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb880b1c90 msgr2=0x7ffb8815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb880b1c90 0x7ffb8815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 -- 172.21.15.18:0/2575456087 >> v1:172.21.15.167:6789/0 conn(0x7ffb88145270 legacy=0x7ffb880cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.221+0000 7ffb7e000640 1 -- 172.21.15.18:0/2575456087 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb880ce040 con 0x7ffb8815fe50 2024-04-25T10:10:35.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb7e000640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb880b1750 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009870 tx=0x7ffb7801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0b295787652af7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb86000640 1 -- 172.21.15.18:0/2575456087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780ab650 con 0x7ffb8815fe50 2024-04-25T10:10:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb86000640 1 -- 172.21.15.18:0/2575456087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb780b0070 con 0x7ffb8815fe50 2024-04-25T10:10:35.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb86000640 1 -- 172.21.15.18:0/2575456087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb780aba10 con 0x7ffb8815fe50 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- 172.21.15.18:0/2575456087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 msgr2=0x7ffb880b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb880b1750 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009870 tx=0x7ffb7801c560 comp rx=0 tx=0).stop 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- 172.21.15.18:0/2575456087 shutdown_connections 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb880b1c90 0x7ffb8815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 --2- 172.21.15.18:0/2575456087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb880b1750 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- 172.21.15.18:0/2575456087 >> 172.21.15.18:0/2575456087 conn(0x7ffb88066fa0 msgr2=0x7ffb8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- 172.21.15.18:0/2575456087 shutdown_connections 2024-04-25T10:10:35.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- 172.21.15.18:0/2575456087 wait complete. 2024-04-25T10:10:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 Processor -- start 2024-04-25T10:10:35.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.225+0000 7ffb8d800640 1 -- start start 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 0x7ffb881400e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb88145270 0x7ffb8813cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880cdbe0 con 0x7ffb8815fe50 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8815f930 con 0x7ffb880b1c90 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb880cdd60 con 0x7ffb88145270 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50122/0 (socket says 172.21.15.18:50122) 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 -- 172.21.15.18:0/4092210239 learned_addr learned my addr 172.21.15.18:0/4092210239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb7e000640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb88145270 0x7ffb8813cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb86a00640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 0x7ffb881400e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 -- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb88145270 msgr2=0x7ffb8813cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb88145270 0x7ffb8813cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 -- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 msgr2=0x7ffb881400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 0x7ffb881400e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 -- 172.21.15.18:0/4092210239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8813dee0 con 0x7ffb8815fe50 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb86a00640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 0x7ffb881400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:35.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb87400640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009dd0 tx=0x7ffb8000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80018020 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb80014480 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80014870 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8813e1c0 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb88140620 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb880745d0 con 0x7ffb8815fe50 2024-04-25T10:10:35.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.229+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffb8001b020 con 0x7ffb8815fe50 2024-04-25T10:10:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.233+0000 7ffb7f400640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.233+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffb80085ca0 con 0x7ffb8815fe50 2024-04-25T10:10:35.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.233+0000 7ffb86a00640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:35.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.233+0000 7ffb86a00640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 0x7ffb64069420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffb70000f70 tx=0x7ffb70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:35.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.237+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb80022070 con 0x7ffb8815fe50 2024-04-25T10:10:35.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.433+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb8806b8e0 con 0x7ffb8815fe50 2024-04-25T10:10:35.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.433+0000 7ffb7f400640 1 -- 172.21.15.18:0/4092210239 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ffb80010040 con 0x7ffb8815fe50 2024-04-25T10:10:35.443 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:10:35.443 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:33.485842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:10:35.444 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 69 2024-04-25T10:10:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 msgr2=0x7ffb64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 0x7ffb64069420 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ffb70000f70 tx=0x7ffb70009040 comp rx=0 tx=0).stop 2024-04-25T10:10:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 msgr2=0x7ffb8813d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009dd0 tx=0x7ffb8000c490 comp rx=0 tx=0).stop 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 shutdown_connections 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb8815fe50 0x7ffb8813d0a0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffb88145270 0x7ffb8813cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 --2- 172.21.15.18:0/4092210239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb880b1c90 0x7ffb881400e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 >> 172.21.15.18:0/4092210239 conn(0x7ffb88066fa0 msgr2=0x7ffb88142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 shutdown_connections 2024-04-25T10:10:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:35.437+0000 7ffb8d800640 1 -- 172.21.15.18:0/4092210239 wait complete. 2024-04-25T10:10:35.867 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:10:33.485842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 94, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7704}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7704': {'gid': 7704, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/4209604816', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 4209604816}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 4209604816}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:10:35.867 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:10:35.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T10:10:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 Processor -- start 2024-04-25T10:10:36.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 -- start start 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a38159320 0x7f9a3815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3815fc00 con 0x7f9a3806e010 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3806d640 con 0x7f9a38159320 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a3cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815fee0 con 0x7f9a3815f440 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.005+0000 7f9a35e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a38159320 0x7f9a3815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a38159320 0x7f9a3815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50130/0 (socket says 172.21.15.18:50130) 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 -- 172.21.15.18:0/2593257137 learned_addr learned my addr 172.21.15.18:0/2593257137 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a36800640 1 --1- 172.21.15.18:0/2593257137 >> v1:172.21.15.18:6789/0 conn(0x7f9a3806e010 0x7f9a3806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46056/0 (socket says 172.21.15.18:46056) 2024-04-25T10:10:36.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a2d400640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 -- 172.21.15.18:0/2593257137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 msgr2=0x7f9a3806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 -- 172.21.15.18:0/2593257137 >> v1:172.21.15.18:6789/0 conn(0x7f9a3806e010 legacy=0x7f9a3806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 -- 172.21.15.18:0/2593257137 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a381601c0 con 0x7f9a38159320 2024-04-25T10:10:36.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a2d400640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35e00640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38159320 0x7f9a3815c9b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009870 tx=0x7f9a2801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315e17b0eb53221a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35400640 1 -- 172.21.15.18:0/2593257137 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280aa620 con 0x7f9a38159320 2024-04-25T10:10:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35400640 1 -- 172.21.15.18:0/2593257137 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280af070 con 0x7f9a38159320 2024-04-25T10:10:36.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.009+0000 7f9a35400640 1 -- 172.21.15.18:0/2593257137 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280aa9e0 con 0x7f9a38159320 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- 172.21.15.18:0/2593257137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38159320 msgr2=0x7f9a3815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38159320 0x7f9a3815c9b0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f9a28009870 tx=0x7f9a2801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- 172.21.15.18:0/2593257137 shutdown_connections 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/2593257137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a38159320 0x7f9a3815c9b0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- 172.21.15.18:0/2593257137 >> 172.21.15.18:0/2593257137 conn(0x7f9a38067080 msgr2=0x7f9a3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- 172.21.15.18:0/2593257137 shutdown_connections 2024-04-25T10:10:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- 172.21.15.18:0/2593257137 wait complete. 2024-04-25T10:10:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 Processor -- start 2024-04-25T10:10:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- start start 2024-04-25T10:10:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38159320 0x7f9a38158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3813c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815f9a0 con 0x7f9a3806e010 2024-04-25T10:10:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3815f820 con 0x7f9a38159320 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a3cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3806ebb0 con 0x7f9a3815f440 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50132/0 (socket says 172.21.15.18:50132) 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 -- 172.21.15.18:0/581191668 learned_addr learned my addr 172.21.15.18:0/581191668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 -- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 msgr2=0x7f9a3813c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3813c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 -- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38159320 msgr2=0x7f9a38158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38159320 0x7f9a38158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 -- 172.21.15.18:0/581191668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a381586b0 con 0x7f9a3806e010 2024-04-25T10:10:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a35e00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ac040 tx=0x7f9a2801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.013+0000 7f9a2ea00640 1 -- 172.21.15.18:0/581191668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280aadb0 con 0x7f9a3806e010 2024-04-25T10:10:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2ea00640 1 -- 172.21.15.18:0/581191668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280bd3f0 con 0x7f9a3806e010 2024-04-25T10:10:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3813c790 con 0x7f9a3806e010 2024-04-25T10:10:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2ea00640 1 -- 172.21.15.18:0/581191668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280bd7e0 con 0x7f9a3806e010 2024-04-25T10:10:36.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3813fba0 con 0x7f9a3806e010 2024-04-25T10:10:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2ea00640 1 -- 172.21.15.18:0/581191668 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a280c6430 con 0x7f9a3806e010 2024-04-25T10:10:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2ea00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 0x7f9a14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2ea00640 1 -- 172.21.15.18:0/581191668 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9a2811f9d0 con 0x7f9a3806e010 2024-04-25T10:10:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a4011b000 1 Processor -- start 2024-04-25T10:10:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a2d400640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 0x7f9a14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.017+0000 7f9a4011b000 1 -- start start 2024-04-25T10:10:36.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 0x7f9a14069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9a20006f10 tx=0x7f9a20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343aacf30 0x560343aad310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603439945f0 con 0x560343af7240 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603438fbda0 con 0x560343aacf30 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560343884150 con 0x560343af6920 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50140/0 (socket says 172.21.15.18:50140) 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 -- 172.21.15.18:0/1648926059 learned_addr learned my addr 172.21.15.18:0/1648926059 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a35e00640 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a36800640 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343aacf30 0x560343aad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 -- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 msgr2=0x560343af6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 -- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343aacf30 msgr2=0x560343aad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343aacf30 0x560343aad310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 -- 172.21.15.18:0/1648926059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56034389dca0 con 0x560343af7240 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a2d400640 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000d890 tx=0x7f9a20010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3bccf0112852570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a26a00640 1 -- 172.21.15.18:0/1648926059 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20024070 con 0x560343af7240 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a26a00640 1 -- 172.21.15.18:0/1648926059 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2001b040 con 0x560343af7240 2024-04-25T10:10:36.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a26a00640 1 -- 172.21.15.18:0/1648926059 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20014b90 con 0x560343af7240 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- 172.21.15.18:0/1648926059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 msgr2=0x560343aac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f9a2000d890 tx=0x7f9a20010000 comp rx=0 tx=0).stop 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- 172.21.15.18:0/1648926059 shutdown_connections 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343aacf30 0x560343aad310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343aac9f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1648926059 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- 172.21.15.18:0/1648926059 >> 172.21.15.18:0/1648926059 conn(0x560343ab32a0 msgr2=0x560343aab2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- 172.21.15.18:0/1648926059 shutdown_connections 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- 172.21.15.18:0/1648926059 wait complete. 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 -- start start 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.021+0000 7f9a4011b000 1 Processor -- start 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343afde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343ab0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603438b6990 con 0x560343af6920 2024-04-25T10:10:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603438f7e40 con 0x560343af7240 2024-04-25T10:10:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560343887900 con 0x560343aacf30 2024-04-25T10:10:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 10 client.0 _ll_register_callbacks cb 0x5603439af1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50156/0 (socket says 172.21.15.18:50156) 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 -- 172.21.15.18:0/3811402995 learned_addr learned my addr 172.21.15.18:0/3811402995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a35e00640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343afde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a36800640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343ab0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 -- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 msgr2=0x560343afde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343afde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 -- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 msgr2=0x560343ab0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343ab0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 -- 172.21.15.18:0/3811402995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603438b4630 con 0x560343af6920 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a2d400640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9a20022040 tx=0x7f9a20006e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b952a0cc5a2debe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:36.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20024050 con 0x560343af6920 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9a20020cc0 con 0x560343af6920 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a2001b040 con 0x560343af6920 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a20035450 con 0x560343af6920 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 10 client.7764 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x5603438843a0 con 0x560343af6920 2024-04-25T10:10:36.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2001b040 con 0x560343af6920 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a20013050 con 0x560343af6920 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 10 client.7764 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 10 client.7764 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 20 client.7764 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343ab2160 0x560343b07ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 4 client.7764 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560343897a50 con 0x560343ab2160 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a35e00640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343ab2160 0x560343b07ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a1b400640 10 client.7764 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.025+0000 7f9a35e00640 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343ab2160 0x560343b07ec0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9a804b884fe820c server_cookie=84b7ff2a04c493d2 in_seq=0 out_seq=0 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a1b400640 1 -- 172.21.15.18:0/3811402995 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560343897a50 con 0x560343ab2160 2024-04-25T10:10:36.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a1b400640 10 client.7764 handle_command_reply: tid=0 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 client.7764 shutdown 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 msgr2=0x560343afe3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f9a20022040 tx=0x7f9a20006e00 comp rx=0 tx=0).stop 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 shutdown_connections 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343ab2160 0x560343b07ec0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343ab0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af6920 0x560343afe3a0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 --2- 172.21.15.18:0/3811402995 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343afde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a1b400640 0 client.7764 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 >> 172.21.15.18:0/3811402995 conn(0x560343ab32a0 msgr2=0x560343aab9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 shutdown_connections 2024-04-25T10:10:36.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 1 -- 172.21.15.18:0/3811402995 wait complete. 2024-04-25T10:10:36.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.029+0000 7f9a4011b000 20 client.7764 trim_cache size 0 max 16384 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 Processor -- start 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- start start 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343b08ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a382030c0 con 0x560343aacf30 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a38202280 con 0x560343af7240 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a380b0440 con 0x560343af6920 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50166/0 (socket says 172.21.15.18:50166) 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 -- 172.21.15.18:0/2141866124 learned_addr learned my addr 172.21.15.18:0/2141866124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 -- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 msgr2=0x560343af5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 -- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 msgr2=0x560343b08ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343b08ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 -- 172.21.15.18:0/2141866124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560343af7070 con 0x560343aacf30 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a35e00640 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9a2801ca10 tx=0x7f9a280ec4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edd0f254aa85bb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a26000640 1 -- 172.21.15.18:0/2141866124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2811b070 con 0x560343aacf30 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a26000640 1 -- 172.21.15.18:0/2141866124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280af030 con 0x560343aacf30 2024-04-25T10:10:36.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a26000640 1 -- 172.21.15.18:0/2141866124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280f4240 con 0x560343aacf30 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- 172.21.15.18:0/2141866124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 msgr2=0x560343af5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f9a2801ca10 tx=0x7f9a280ec4c0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- 172.21.15.18:0/2141866124 shutdown_connections 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af7240 0x560343b08ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343af6920 0x560343af5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 --2- 172.21.15.18:0/2141866124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343aacf30 0x560343af5910 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- 172.21.15.18:0/2141866124 >> 172.21.15.18:0/2141866124 conn(0x560343ab32a0 msgr2=0x560343af5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- 172.21.15.18:0/2141866124 shutdown_connections 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- 172.21.15.18:0/2141866124 wait complete. 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 -- start start 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.045+0000 7f9a4011b000 1 Processor -- start 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343b0c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af6920 0x560343b3aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603439003d0 con 0x560343af7240 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603439b7d50 con 0x560343af6920 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560343896980 con 0x560343aacf30 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 10 client.0 _ll_register_callbacks cb 0x7f9a2000b560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50176/0 (socket says 172.21.15.18:50176) 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 -- 172.21.15.18:0/1274718925 learned_addr learned my addr 172.21.15.18:0/1274718925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a35e00640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343b0c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a2d400640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af6920 0x560343b3aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 -- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 msgr2=0x560343b0c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343b0c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 -- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af6920 msgr2=0x560343b3aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af6920 0x560343b3aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 -- 172.21.15.18:0/1274718925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56034397d600 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a36800640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806e440 tx=0x7f9a30007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f447aac54938627 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3001b060 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9a30016cc0 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a280af030 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a30013540 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 10 client.7770 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x5603438909b0 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280af030 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a300136e0 con 0x560343af7240 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 10 client.7770 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 10 client.7770 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 20 client.7770 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343b3ba70 0x560343b57170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 4 client.7770 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5603439092e0 con 0x560343b3ba70 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a35e00640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343b3ba70 0x560343b57170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 10 client.7770 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a35e00640 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343b3ba70 0x560343b57170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc5600d6f34e181e server_cookie=bd38d135c57deae5 in_seq=0 out_seq=0 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 1 -- 172.21.15.18:0/1274718925 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5603439092e0 con 0x560343b3ba70 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 10 client.7770 handle_command_reply: tid=0 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 client.7770 shutdown 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 msgr2=0x560343b3b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f9a3806e440 tx=0x7f9a30007b90 comp rx=0 tx=0).stop 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 shutdown_connections 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x560343b3ba70 0x560343b57170 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560343af7240 0x560343b3b530 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560343af6920 0x560343b3aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 --2- 172.21.15.18:0/1274718925 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560343aacf30 0x560343b0c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a1b400640 0 client.7770 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 >> 172.21.15.18:0/1274718925 conn(0x560343ab32a0 msgr2=0x560343af5910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 shutdown_connections 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.049+0000 7f9a4011b000 1 -- 172.21.15.18:0/1274718925 wait complete. 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a4011b000 20 client.7770 trim_cache size 0 max 16384 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7704, 2024-04-25T10:10:36.069 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.5819141410000004, 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 69, 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 94, 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 94, 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 5.516856239 2024-04-25T10:10:36.070 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 msgr2=0x7f9a14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 0x7f9a14069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9a20006f10 tx=0x7f9a20008040 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 msgr2=0x7f9a3813f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ac040 tx=0x7f9a2801ace0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 shutdown_connections 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9a14066f60 0x7f9a14069420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9a3815f440 0x7f9a3813c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38159320 0x7f9a38158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 --2- 172.21.15.18:0/581191668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a3806e010 0x7f9a3813f1c0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 >> 172.21.15.18:0/581191668 conn(0x7f9a38067080 msgr2=0x7f9a38164db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 shutdown_connections 2024-04-25T10:10:36.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.053+0000 7f9a3cc00640 1 -- 172.21.15.18:0/581191668 wait complete. 2024-04-25T10:10:36.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:10:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 Processor -- start 2024-04-25T10:10:36.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 -- start start 2024-04-25T10:10:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6a380b2dc0 0x7f6a3806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3815def0 con 0x7f6a3815b2f0 2024-04-25T10:10:36.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a3815e1b0 con 0x7f6a380b3950 2024-04-25T10:10:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3fe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a3815e490 con 0x7f6a380b2dc0 2024-04-25T10:10:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6a3815b2f0 0x7f6a380b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46064/0 (socket says 172.21.15.18:46064) 2024-04-25T10:10:36.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.213+0000 7f6a3d400640 1 -- 172.21.15.18:0/2233728664 learned_addr learned my addr 172.21.15.18:0/2233728664 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/2233728664 >> v2:172.21.15.167:3300/0 conn(0x7f6a380b2dc0 0x7f6a3806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080059070 0 0) 0x7f6a3815def0 con 0x7f6a3815b2f0 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a20003530 con 0x7f6a3815b2f0 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 972654293 0 0) 0x7f6a3815e1b0 con 0x7f6a380b3950 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3815def0 con 0x7f6a380b3950 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3112763949 0 0) 0x7f6a20003530 con 0x7f6a3815b2f0 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 >> v2:172.21.15.167:3300/0 conn(0x7f6a380b2dc0 msgr2=0x7f6a3806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 --2- 172.21.15.18:0/2233728664 >> v2:172.21.15.167:3300/0 conn(0x7f6a380b2dc0 0x7f6a3806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 >> v1:172.21.15.167:6789/0 conn(0x7f6a380b3950 legacy=0x7f6a3806b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3815e770 con 0x7f6a3815b2f0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6a2c001680 con 0x7f6a3815b2f0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 >> v1:172.21.15.18:6789/0 conn(0x7f6a3815b2f0 legacy=0x7f6a380b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a20003ba0 0x7f6a20003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a20004810 0x7f6a20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3815e490 con 0x7f6a200051d0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2000c0a0 con 0x7f6a20003ba0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2000c2a0 con 0x7f6a20004810 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/2233728664 >> v2:172.21.15.167:3300/0 conn(0x7f6a380b2dc0 0x7f6a3806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3d400640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a20003ba0 0x7f6a20003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a20004810 0x7f6a20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 -- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a20004810 msgr2=0x7f6a20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a20004810 0x7f6a20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 -- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a20003ba0 msgr2=0x7f6a20003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:36.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a20003ba0 0x7f6a20003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3de00640 1 -- 172.21.15.18:0/2233728664 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a20003530 con 0x7f6a200051d0 2024-04-25T10:10:36.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.217+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a20004810 0x7f6a20004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3de00640 1 -- 172.21.15.18:0/2233728664 reap_dead start 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3de00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a2000b9d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f6a380d0630 tx=0x7f6a3001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e57e06ebd411475 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30001c20 con 0x7f6a200051d0 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a30003b80 con 0x7f6a200051d0 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a37e00640 1 -- 172.21.15.18:0/2233728664 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a300050d0 con 0x7f6a200051d0 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 msgr2=0x7f6a2000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a2000b9d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f6a380d0630 tx=0x7f6a3001c8e0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- 172.21.15.18:0/2233728664 shutdown_connections 2024-04-25T10:10:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/2233728664 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a2000b9d0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- 172.21.15.18:0/2233728664 >> 172.21.15.18:0/2233728664 conn(0x7f6a380b23b0 msgr2=0x7f6a380cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- 172.21.15.18:0/2233728664 shutdown_connections 2024-04-25T10:10:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- 172.21.15.18:0/2233728664 wait complete. 2024-04-25T10:10:36.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 Processor -- start 2024-04-25T10:10:36.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- start start 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a38159710 0x7f6a381e7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a381581e0 0x7f6a380cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3815b850 con 0x7f6a200051d0 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.221+0000 7f6a3fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3815b6d0 con 0x7f6a38159710 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3806dad0 con 0x7f6a381581e0 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50192/0 (socket says 172.21.15.18:50192) 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 -- 172.21.15.18:0/1269560460 learned_addr learned my addr 172.21.15.18:0/1269560460 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 -- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a381581e0 msgr2=0x7f6a380cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a381581e0 0x7f6a380cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 -- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a38159710 msgr2=0x7f6a381e7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a38159710 0x7f6a381e7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 -- 172.21.15.18:0/1269560460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a38158670 con 0x7f6a200051d0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3d400640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c000c10 tx=0x7f6a2c0129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c01c070 con 0x7f6a200051d0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c014770 con 0x7f6a200051d0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c014b60 con 0x7f6a200051d0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a38158950 con 0x7f6a200051d0 2024-04-25T10:10:36.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a38158f10 con 0x7f6a200051d0 2024-04-25T10:10:36.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a380745d0 con 0x7f6a200051d0 2024-04-25T10:10:36.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.225+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a2c014d00 con 0x7f6a200051d0 2024-04-25T10:10:36.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.229+0000 7f6a35600640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 0x7f6a18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:36.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.229+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6a2c087b80 con 0x7f6a200051d0 2024-04-25T10:10:36.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.229+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 0x7f6a18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:36.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.229+0000 7f6a3ca00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 0x7f6a18069420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6a380afe20 tx=0x7f6a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:36.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.233+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a2c0589a0 con 0x7f6a200051d0 2024-04-25T10:10:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.433+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6a381612c0 con 0x7f6a200051d0 2024-04-25T10:10:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.433+0000 7f6a35600640 1 -- 172.21.15.18:0/1269560460 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6a2c0582a0 con 0x7f6a200051d0 2024-04-25T10:10:36.443 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:10:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 msgr2=0x7f6a18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 0x7f6a18069420 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f6a380afe20 tx=0x7f6a24008040 comp rx=0 tx=0).stop 2024-04-25T10:10:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 msgr2=0x7f6a3814f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c000c10 tx=0x7f6a2c0129a0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 shutdown_connections 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6a18066f60 0x7f6a18069420 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6a381581e0 0x7f6a380cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a38159710 0x7f6a381e7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 --2- 172.21.15.18:0/1269560460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a200051d0 0x7f6a3814f2e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 >> 172.21.15.18:0/1269560460 conn(0x7f6a380b23b0 msgr2=0x7f6a381504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 shutdown_connections 2024-04-25T10:10:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:36.437+0000 7f6a3fe00640 1 -- 172.21.15.18:0/1269560460 wait complete. 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:10:36.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:10:36.465 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:10:36.465 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:36.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.465 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:10:36.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42068sec preferred_lft 42068sec 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.476 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:10:36.477 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:10:36.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.478 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:10:36.542 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:10:36.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.544 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:10:36.597 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:10:36.597 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:10:36.597 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:10:36.597 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:10:36.597 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:10:36.598 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:10:36.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:10:36.598 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:10:36.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.690 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:10:36.699 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:10:36.699 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:10:36.699 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:36.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:10:36.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:36.765 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:36.816 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:10:36.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:10:36.817 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:36.867 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:10:36.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:36.960 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:36.961 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:36.974 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:10:36.975 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:10:36.975 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:10:36.975 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:10:36.975 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:10:36.979 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:10:36.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:36.980 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:10:37.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:37.001 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:10:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:client36491 2024-04-25T10:10:37.054 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:10:37.055 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:10:37.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:37.105 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T10:10:37.158 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-04-25T10:10:37.149+0000 7fc11e800640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T10:10:37.159 INFO:teuthology.orchestra.run.smithi018.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T10:10:37.160 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:10:37.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:37.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T10:10:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.337+0000 7fd3bdc00640 1 Processor -- start 2024-04-25T10:10:37.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.337+0000 7fd3bdc00640 1 -- start start 2024-04-25T10:10:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3bdc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 0x7fd3b815f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3bdc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd3b806d2b0 0x7fd3b8071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3bdc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80adcf0 con 0x7fd3b806d730 2024-04-25T10:10:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3bdc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80ae000 con 0x7fd3b806d2b0 2024-04-25T10:10:37.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3bdc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8147620 con 0x7fd3b8147240 2024-04-25T10:10:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b7400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd3b806d730 0x7fd3b80ae490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46070/0 (socket says 172.21.15.18:46070) 2024-04-25T10:10:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b7400640 1 -- 172.21.15.18:0/2602973365 learned_addr learned my addr 172.21.15.18:0/2602973365 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 0x7fd3b815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2602973365 >> v2:172.21.15.167:3300/0 conn(0x7fd3b806d2b0 0x7fd3b8071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b5600640 1 -- 172.21.15.18:0/2602973365 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153919704 0 0) 0x7fd3b00014a0 con 0x7fd3b806d730 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b5600640 1 -- 172.21.15.18:0/2602973365 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c003530 con 0x7fd3b806d730 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6000640 1 -- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 msgr2=0x7fd3b815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 0x7fd3b815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6000640 1 -- 172.21.15.18:0/2602973365 >> v1:172.21.15.18:6789/0 conn(0x7fd3b806d730 legacy=0x7fd3b80ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6000640 1 -- 172.21.15.18:0/2602973365 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b806dd00 con 0x7fd3b806d2b0 2024-04-25T10:10:37.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.341+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 0x7fd3b815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:10:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8071250 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40097c0 tx=0x7fd3a401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6504794bfd5ea3d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3b5600640 1 -- 172.21.15.18:0/2602973365 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40b0070 con 0x7fd3b806d2b0 2024-04-25T10:10:37.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3b5600640 1 -- 172.21.15.18:0/2602973365 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a40ab600 con 0x7fd3b806d2b0 2024-04-25T10:10:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3b5600640 1 -- 172.21.15.18:0/2602973365 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40ab9d0 con 0x7fd3b806d2b0 2024-04-25T10:10:37.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b806d2b0 msgr2=0x7fd3b8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8071250 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40097c0 tx=0x7fd3a401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2602973365 shutdown_connections 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8071250 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2602973365 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b8147240 0x7fd3b815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2602973365 >> 172.21.15.18:0/2602973365 conn(0x7fd3b806ac10 msgr2=0x7fd3b806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2602973365 shutdown_connections 2024-04-25T10:10:37.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2602973365 wait complete. 2024-04-25T10:10:37.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 Processor -- start 2024-04-25T10:10:37.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.345+0000 7fd3bdc00640 1 -- start start 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b806d730 0x7fd3b813dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 0x7fd3b813e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80aefb0 con 0x7fd3b806d2b0 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8071ba0 con 0x7fd3b8147240 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b80af130 con 0x7fd3b806d730 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50198/0 (socket says 172.21.15.18:50198) 2024-04-25T10:10:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2867537409 learned_addr learned my addr 172.21.15.18:0/2867537409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b7400640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 0x7fd3b813e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b806d730 0x7fd3b813dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b806d730 msgr2=0x7fd3b813dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b806d730 0x7fd3b813dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 msgr2=0x7fd3b813e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 0x7fd3b813e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2867537409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b8139440 con 0x7fd3b806d2b0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b7400640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 0x7fd3b813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800e980 tx=0x7fd3a800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3aea00640 1 -- 172.21.15.18:0/2867537409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8017070 con 0x7fd3b806d2b0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3aea00640 1 -- 172.21.15.18:0/2867537409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800ca00 con 0x7fd3b806d2b0 2024-04-25T10:10:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3aea00640 1 -- 172.21.15.18:0/2867537409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800cdd0 con 0x7fd3b806d2b0 2024-04-25T10:10:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b8139720 con 0x7fd3b806d2b0 2024-04-25T10:10:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8139ce0 con 0x7fd3b806d2b0 2024-04-25T10:10:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.349+0000 7fd3aea00640 1 -- 172.21.15.18:0/2867537409 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd3a801a070 con 0x7fd3b806d2b0 2024-04-25T10:10:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3aea00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3aea00640 1 -- 172.21.15.18:0/2867537409 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd3a80854f0 con 0x7fd3b806d2b0 2024-04-25T10:10:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 Processor -- start 2024-04-25T10:10:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 -- start start 2024-04-25T10:10:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 0x7fd398069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40ad000 tx=0x7fd3a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6cac590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c912f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eb6aaffd0 con 0x564eb6cacad0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eb6a38170 con 0x564eb6c90f10 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eb6aac070 con 0x564eb6cac1b0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50208/0 (socket says 172.21.15.18:50208) 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 -- 172.21.15.18:0/1099080503 learned_addr learned my addr 172.21.15.18:0/1099080503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b7400640 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6cac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 -- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 msgr2=0x564eb6cac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6cac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 -- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 msgr2=0x564eb6c912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c912f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 -- 172.21.15.18:0/1099080503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eb6af6d20 con 0x564eb6cacad0 2024-04-25T10:10:37.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3b6000640 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c10 tx=0x7fd3a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98061c17125a59d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3a3400640 1 -- 172.21.15.18:0/1099080503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40c7070 con 0x564eb6cacad0 2024-04-25T10:10:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3a3400640 1 -- 172.21.15.18:0/1099080503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a40b1040 con 0x564eb6cacad0 2024-04-25T10:10:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.353+0000 7fd3a3400640 1 -- 172.21.15.18:0/1099080503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40b7430 con 0x564eb6cacad0 2024-04-25T10:10:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/1099080503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 msgr2=0x564eb6c909d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c10 tx=0x7fd3a4004740 comp rx=0 tx=0).stop 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/1099080503 shutdown_connections 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cacad0 0x564eb6c909d0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- 172.21.15.18:0/1099080503 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6cac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/1099080503 >> 172.21.15.18:0/1099080503 conn(0x564eb6c68710 msgr2=0x564eb6c68af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/1099080503 shutdown_connections 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/1099080503 wait complete. 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- start start 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 Processor -- start 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6cb3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cacad0 0x564eb6c912f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eb6b6dc10 con 0x564eb6cac1b0 2024-04-25T10:10:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eb6a6a680 con 0x564eb6c90f10 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eb6ab4600 con 0x564eb6cacad0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 10 client.0 _ll_register_callbacks cb 0x564eb6b65080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50224/0 (socket says 172.21.15.18:50224) 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 -- 172.21.15.18:0/3886016782 learned_addr learned my addr 172.21.15.18:0/3886016782 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6cb3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b7400640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cacad0 0x564eb6c912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 -- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cacad0 msgr2=0x564eb6c912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cacad0 0x564eb6c912f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 -- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 msgr2=0x564eb6cb3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6cb3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 -- 172.21.15.18:0/3886016782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eb6a87d30 con 0x564eb6cac1b0 2024-04-25T10:10:37.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3b6000640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c10 tx=0x7fd3a401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2c4e8c2f020256 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd397e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40d2060 con 0x564eb6cac1b0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd3a4003820 con 0x564eb6cac1b0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3a40b1040 con 0x564eb6cac1b0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3a40c7040 con 0x564eb6cac1b0 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 10 client.7788 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.357+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x564eb6a383c0 con 0x564eb6cac1b0 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a40b1040 con 0x564eb6cac1b0 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd3a4003a20 con 0x564eb6cac1b0 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 10 client.7788 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 10 client.7788 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 20 client.7788 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6c92090 0x564eb6c92470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 4 client.7788 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:10:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eb6a4be00 con 0x564eb6c92090 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6c92090 0x564eb6c92470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 10 client.7788 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6c92090 0x564eb6c92470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b2b974c0906f3ac server_cookie=24038e843af56665 in_seq=0 out_seq=0 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 1 -- 172.21.15.18:0/3886016782 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564eb6a4be00 con 0x564eb6c92090 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 10 client.7788 handle_command_reply: tid=0 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 client.7788 shutdown 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 msgr2=0x564eb6cb3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4000c10 tx=0x7fd3a401ace0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 shutdown_connections 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6c92090 0x564eb6c92470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cacad0 0x564eb6c912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cb3c60 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 --2- 172.21.15.18:0/3886016782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6cb3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 >> 172.21.15.18:0/3886016782 conn(0x564eb6c68710 msgr2=0x564eb6c60950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd397e00640 0 client.7788 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 shutdown_connections 2024-04-25T10:10:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 1 -- 172.21.15.18:0/3886016782 wait complete. 2024-04-25T10:10:37.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.361+0000 7fd3c1010000 20 client.7788 trim_cache size 0 max 16384 2024-04-25T10:10:37.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 Processor -- start 2024-04-25T10:10:37.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 -- start start 2024-04-25T10:10:37.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6caaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6caafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8203af0 con 0x564eb6c68710 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8202d20 con 0x564eb6c90f10 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8136ab0 con 0x564eb6cac1b0 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50232/0 (socket says 172.21.15.18:50232) 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2341317669 learned_addr learned my addr 172.21.15.18:0/2341317669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 msgr2=0x564eb6caafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6caafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 msgr2=0x564eb6caaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6caaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 -- 172.21.15.18:0/2341317669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eb6b320f0 con 0x564eb6c68710 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c520 tx=0x7fd3a8085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd30308858c7b6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3a2a00640 1 -- 172.21.15.18:0/2341317669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a806d030 con 0x564eb6c68710 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3a2a00640 1 -- 172.21.15.18:0/2341317669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8053f10 con 0x564eb6c68710 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3a2a00640 1 -- 172.21.15.18:0/2341317669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8021040 con 0x564eb6c68710 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 -- 172.21.15.18:0/2341317669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 msgr2=0x564eb6caa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.377+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800c520 tx=0x7fd3a8085040 comp rx=0 tx=0).stop 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2341317669 shutdown_connections 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6cac1b0 0x564eb6caafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6caaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2341317669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6c68710 0x564eb6caa530 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2341317669 >> 172.21.15.18:0/2341317669 conn(0x564eb6cb9b10 msgr2=0x564eb6c905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2341317669 shutdown_connections 2024-04-25T10:10:37.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2341317669 wait complete. 2024-04-25T10:10:37.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- start start 2024-04-25T10:10:37.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 Processor -- start 2024-04-25T10:10:37.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 0x564eb6c62020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c62560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8202720 con 0x564eb6cac1b0 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eb6c59d90 con 0x564eb6c90f10 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564eb6b6aeb0 con 0x564eb6c68710 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 10 client.0 _ll_register_callbacks cb 0x564eb6a4db90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50236/0 (socket says 172.21.15.18:50236) 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 -- 172.21.15.18:0/2757387748 learned_addr learned my addr 172.21.15.18:0/2757387748 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 0x564eb6c62020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b6000640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c62560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 -- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 msgr2=0x564eb6c62020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 0x564eb6c62020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 -- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 msgr2=0x564eb6c62560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c62560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 -- 172.21.15.18:0/2757387748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eb6a44d20 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 0x564eb6c62020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b7400640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0012980 tx=0x7fd3b0012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a546bf87fa78ac09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b0019020 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd3b0005df0 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd3a8053f10 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3b0023050 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 10 client.7794 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x564eb6a570c0 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a8053f10 con 0x564eb6cac1b0 2024-04-25T10:10:37.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd3b0026020 con 0x564eb6cac1b0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 10 client.7794 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 10 client.7794 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 20 client.7794 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6cacad0 0x564eb6cca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 4 client.7794 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x564eb6abd510 con 0x564eb6cacad0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.381+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6cacad0 0x564eb6cca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3b6a00640 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6cacad0 0x564eb6cca320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b34a058fb44110b9 server_cookie=c70e8351f7684860 in_seq=0 out_seq=0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd397e00640 10 client.7794 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd397e00640 1 -- 172.21.15.18:0/2757387748 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564eb6abd510 con 0x564eb6cacad0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd397e00640 10 client.7794 handle_command_reply: tid=0 2024-04-25T10:10:37.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 client.7794 shutdown 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 msgr2=0x564eb6cc9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0012980 tx=0x7fd3b0012e40 comp rx=0 tx=0).stop 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 shutdown_connections 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x564eb6cacad0 0x564eb6cca320 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564eb6cac1b0 0x564eb6cc9de0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564eb6c90f10 0x564eb6c62560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 --2- 172.21.15.18:0/2757387748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564eb6c68710 0x564eb6c62020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd397e00640 0 client.7794 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 >> 172.21.15.18:0/2757387748 conn(0x564eb6cb9b10 msgr2=0x564eb6c669f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.399 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fc11e800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0) n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55bc8baf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T10:10:37.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 shutdown_connections 2024-04-25T10:10:37.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 1 -- 172.21.15.18:0/2757387748 wait complete. 2024-04-25T10:10:37.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3c1010000 20 client.7794 trim_cache size 0 max 16384 2024-04-25T10:10:37.400 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:10:37.400 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:10:37.400 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "9b0502f5-886a-4665-bd1a-45041db5240f", 2024-04-25T10:10:37.400 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:10:37.400 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 msgr2=0x7fd398069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 0x7fd398069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40ad000 tx=0x7fd3a4008040 comp rx=0 tx=0).stop 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 msgr2=0x7fd3b8138cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd3a800e980 tx=0x7fd3a800ee40 comp rx=0 tx=0).stop 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 shutdown_connections 2024-04-25T10:10:37.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3b8147240 0x7fd3b813e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3b806d730 0x7fd3b813dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 --2- 172.21.15.18:0/2867537409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3b806d2b0 0x7fd3b8138cd0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 >> 172.21.15.18:0/2867537409 conn(0x7fd3b806ac10 msgr2=0x7fd3b8145800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 shutdown_connections 2024-04-25T10:10:37.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.385+0000 7fd3bdc00640 1 -- 172.21.15.18:0/2867537409 wait complete. 2024-04-25T10:10:37.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:10:37.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:10:37.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 Processor -- start 2024-04-25T10:10:37.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 -- start start 2024-04-25T10:10:37.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f811c15bcf0 0x7f811c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0d02a0 con 0x7f811c15b910 2024-04-25T10:10:37.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0cc350 con 0x7f811c0cf3c0 2024-04-25T10:10:37.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8120c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c0cc630 con 0x7f811c15bcf0 2024-04-25T10:10:37.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8119e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f811c15b910 0x7f811c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46072/0 (socket says 172.21.15.18:46072) 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8119e00640 1 -- 172.21.15.18:0/2471351782 learned_addr learned my addr 172.21.15.18:0/2471351782 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f811a800640 1 --2- 172.21.15.18:0/2471351782 >> v2:172.21.15.167:3300/0 conn(0x7f811c15bcf0 0x7f811c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8119400640 1 -- 172.21.15.18:0/2471351782 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505688933 0 0) 0x7f811c0d02a0 con 0x7f811c15b910 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f8119400640 1 -- 172.21.15.18:0/2471351782 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8100003530 con 0x7f811c15b910 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f811a800640 1 -- 172.21.15.18:0/2471351782 >> v1:172.21.15.167:6789/0 conn(0x7f811c0cf3c0 legacy=0x7f811c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f811a800640 1 -- 172.21.15.18:0/2471351782 >> v1:172.21.15.18:6789/0 conn(0x7f811c15b910 legacy=0x7f811c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.553+0000 7f811a800640 1 -- 172.21.15.18:0/2471351782 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0cc910 con 0x7f811c15bcf0 2024-04-25T10:10:37.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f811a800640 1 --2- 172.21.15.18:0/2471351782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15bcf0 0x7f811c099a60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8114009d90 tx=0x7f811401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccd98571062cc847 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8119400640 1 -- 172.21.15.18:0/2471351782 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140b2070 con 0x7f811c15bcf0 2024-04-25T10:10:37.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8119400640 1 -- 172.21.15.18:0/2471351782 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140a5830 con 0x7f811c15bcf0 2024-04-25T10:10:37.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8119400640 1 -- 172.21.15.18:0/2471351782 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140a5be0 con 0x7f811c15bcf0 2024-04-25T10:10:37.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 -- 172.21.15.18:0/2471351782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15bcf0 msgr2=0x7f811c099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 --2- 172.21.15.18:0/2471351782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15bcf0 0x7f811c099a60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8114009d90 tx=0x7f811401c970 comp rx=0 tx=0).stop 2024-04-25T10:10:37.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 -- 172.21.15.18:0/2471351782 shutdown_connections 2024-04-25T10:10:37.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 --2- 172.21.15.18:0/2471351782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15bcf0 0x7f811c099a60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 -- 172.21.15.18:0/2471351782 >> 172.21.15.18:0/2471351782 conn(0x7f811c0b3200 msgr2=0x7f811c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 -- 172.21.15.18:0/2471351782 shutdown_connections 2024-04-25T10:10:37.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.557+0000 7f8120c00640 1 -- 172.21.15.18:0/2471351782 wait complete. 2024-04-25T10:10:37.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 Processor -- start 2024-04-25T10:10:37.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- start start 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f811c0cf3c0 0x7f811c14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15b910 0x7f811c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c169d40 con 0x7f811c15bcf0 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c169bc0 con 0x7f811c15b910 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c169ec0 con 0x7f811c0cf3c0 2024-04-25T10:10:37.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50242/0 (socket says 172.21.15.18:50242) 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 -- 172.21.15.18:0/238456911 learned_addr learned my addr 172.21.15.18:0/238456911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 -- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f811c0cf3c0 msgr2=0x7f811c14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f811c0cf3c0 0x7f811c14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 -- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15b910 msgr2=0x7f811c06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15b910 0x7f811c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 -- 172.21.15.18:0/238456911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c15c9e0 con 0x7f811c15bcf0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f811a800640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8114009d90 tx=0x7f8114019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8112000640 1 -- 172.21.15.18:0/238456911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140bd020 con 0x7f811c15bcf0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8112000640 1 -- 172.21.15.18:0/238456911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140b3040 con 0x7f811c15bcf0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8112000640 1 -- 172.21.15.18:0/238456911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140b2050 con 0x7f811c15bcf0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c06cea0 con 0x7f811c15bcf0 2024-04-25T10:10:37.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.561+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c06d460 con 0x7f811c15bcf0 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8112000640 1 -- 172.21.15.18:0/238456911 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8114003ba0 con 0x7f811c15bcf0 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8112000640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 0x7f80f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8112000640 1 -- 172.21.15.18:0/238456911 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f811411fde0 con 0x7f811c15bcf0 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8119e00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 0x7f80f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8124113000 1 Processor -- start 2024-04-25T10:10:37.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8124113000 1 -- start start 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.565+0000 7f8119e00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 0x7f80f8069420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f810c007fd0 tx=0x7f810c007940 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba517fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba517b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba51600ff0 con 0x55ba517b40a0 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba51589150 con 0x55ba517fe2f0 2024-04-25T10:10:37.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba515fd090 con 0x55ba517fd9d0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50246/0 (socket says 172.21.15.18:50246) 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 -- 172.21.15.18:0/4004186801 learned_addr learned my addr 172.21.15.18:0/4004186801 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8119e00640 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba517fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8113e00640 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba517b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 -- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 msgr2=0x55ba517fddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba517fddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 -- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 msgr2=0x55ba517b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba517b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 -- 172.21.15.18:0/4004186801 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba517970d0 con 0x55ba517b40a0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f811a800640 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f81140f0420 tx=0x7f81140f0100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a518bcbb61bcf597 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f810aa00640 1 -- 172.21.15.18:0/4004186801 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114108020 con 0x55ba517b40a0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f810aa00640 1 -- 172.21.15.18:0/4004186801 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140b8e90 con 0x55ba517b40a0 2024-04-25T10:10:37.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f810aa00640 1 -- 172.21.15.18:0/4004186801 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140f0490 con 0x55ba517b40a0 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- 172.21.15.18:0/4004186801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 msgr2=0x55ba517b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f81140f0420 tx=0x7f81140f0100 comp rx=0 tx=0).stop 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- 172.21.15.18:0/4004186801 shutdown_connections 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba517b4480 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba517b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- 172.21.15.18:0/4004186801 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba517fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- 172.21.15.18:0/4004186801 >> 172.21.15.18:0/4004186801 conn(0x55ba517b0020 msgr2=0x55ba517b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- 172.21.15.18:0/4004186801 shutdown_connections 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- 172.21.15.18:0/4004186801 wait complete. 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- start start 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 Processor -- start 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 0x55ba517e27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 0x55ba517e2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.569+0000 7f8124113000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba515c5250 con 0x55ba517fe2f0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba515bb690 con 0x55ba517fd9d0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba51589a40 con 0x55ba517b40a0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 10 client.0 _ll_register_callbacks cb 0x55ba5179ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8119e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 0x55ba517e27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8119e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 0x55ba517e27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:46826/0 (socket says 172.21.15.18:46826) 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50260/0 (socket says 172.21.15.18:50260) 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8119e00640 1 -- 172.21.15.18:0/3360005679 learned_addr learned my addr 172.21.15.18:0/3360005679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8113e00640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 0x55ba517e2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 -- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 msgr2=0x55ba517e27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 0x55ba517e27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 -- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 msgr2=0x55ba517e2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 0x55ba517e2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 -- 172.21.15.18:0/3360005679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba516ae1c0 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8113e00640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 0x55ba517e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f811a800640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f81140ec8f0 tx=0x7f811401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19104e2b16b6f4ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140f4360 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f81140f8710 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81140b8e90 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81140f45e0 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 10 client.7806 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55ba516aa170 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140b8e90 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f81140ef8e0 con 0x55ba517fe2f0 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 10 client.7806 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 10 client.7806 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:10:37.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 20 client.7806 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba5180dc80 0x55ba51810070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 4 client.7806 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba5159cc60 con 0x55ba5180dc80 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8119e00640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba5180dc80 0x55ba51810070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8119e00640 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba5180dc80 0x55ba51810070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b751c43dd525c11 server_cookie=15254ecd341c473f in_seq=0 out_seq=0 2024-04-25T10:10:37.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 10 client.7806 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 1 -- 172.21.15.18:0/3360005679 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ba5159cc60 con 0x55ba5180dc80 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 10 client.7806 handle_command_reply: tid=0 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 client.7806 shutdown 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 msgr2=0x55ba517e3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f81140ec8f0 tx=0x7f811401c970 comp rx=0 tx=0).stop 2024-04-25T10:10:37.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 shutdown_connections 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba5180dc80 0x55ba51810070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba517e3270 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fd9d0 0x55ba517e2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 --2- 172.21.15.18:0/3360005679 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517b40a0 0x55ba517e27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f80ff400640 0 client.7806 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 >> 172.21.15.18:0/3360005679 conn(0x55ba517b0020 msgr2=0x55ba517b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 shutdown_connections 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 1 -- 172.21.15.18:0/3360005679 wait complete. 2024-04-25T10:10:37.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.573+0000 7f8124113000 20 client.7806 trim_cache size 0 max 16384 2024-04-25T10:10:37.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 Processor -- start 2024-04-25T10:10:37.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 -- start start 2024-04-25T10:10:37.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 0x55ba51859ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c203a00 con 0x55ba517fe2f0 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c202b40 con 0x55ba517b40a0 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c201f40 con 0x55ba517fd9d0 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f811a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50274/0 (socket says 172.21.15.18:50274) 2024-04-25T10:10:37.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.589+0000 7f811a800640 1 -- 172.21.15.18:0/3367793894 learned_addr learned my addr 172.21.15.18:0/3367793894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 -- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 msgr2=0x55ba5185a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8113e00640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 0x55ba51859ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 -- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 msgr2=0x55ba51859ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 0x55ba51859ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 -- 172.21.15.18:0/3367793894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba51647de0 con 0x55ba517fe2f0 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8113e00640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:37.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 0x55ba51859ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8114108190 tx=0x7f8114118000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeeb77768e35f2f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f810a000640 1 -- 172.21.15.18:0/3367793894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140f0490 con 0x55ba517fe2f0 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f810a000640 1 -- 172.21.15.18:0/3367793894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140f4160 con 0x55ba517fe2f0 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f810a000640 1 -- 172.21.15.18:0/3367793894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81140f8710 con 0x55ba517fe2f0 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- 172.21.15.18:0/3367793894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 msgr2=0x55ba5185a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8114108190 tx=0x7f8114118000 comp rx=0 tx=0).stop 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- 172.21.15.18:0/3367793894 shutdown_connections 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517fe2f0 0x55ba5185a960 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- 172.21.15.18:0/3367793894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517b40a0 0x55ba51859ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- 172.21.15.18:0/3367793894 >> 172.21.15.18:0/3367793894 conn(0x55ba517b0020 msgr2=0x55ba5180afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- 172.21.15.18:0/3367793894 shutdown_connections 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- 172.21.15.18:0/3367793894 wait complete. 2024-04-25T10:10:37.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- start start 2024-04-25T10:10:37.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 Processor -- start 2024-04-25T10:10:37.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba5180ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba5159be00 con 0x55ba517b40a0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c202540 con 0x55ba517fe2f0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ba51600300 con 0x55ba517fd9d0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8124113000 10 client.0 _ll_register_callbacks cb 0x55ba5177f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50280/0 (socket says 172.21.15.18:50280) 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 -- 172.21.15.18:0/189930545 learned_addr learned my addr 172.21.15.18:0/189930545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f811a800640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba5180ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8113e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 -- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 msgr2=0x55ba5185e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 -- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 msgr2=0x55ba5180ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba5180ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.593+0000 7f8119e00640 1 -- 172.21.15.18:0/189930545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba515a28e0 con 0x55ba517b40a0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8119e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f70 tx=0x7f810c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933c36aa5f636f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:10:37.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0248e0 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f810c014430 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81140f4160 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7f810c031050 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 10 client.7812 fetch_fsmap learned FSMap version 69 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55ba5165a8f0 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81140f4160 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 69) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f810c034020 con 0x55ba517b40a0 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 10 client.7812 fetch_fsmap finished waiting for FSMap version 69 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 10 client.7812 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 20 client.7812 populate_metadata read hostname 'smithi018' 2024-04-25T10:10:37.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba51810e10 0x55ba51811220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 4 client.7812 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ba5160e530 con 0x55ba51810e10 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8113e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba51810e10 0x55ba51811220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8113e00640 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba51810e10 0x55ba51811220 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2980fd170265e3 server_cookie=a2ce87983f18ae20 in_seq=0 out_seq=0 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 10 client.7812 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 1 -- 172.21.15.18:0/189930545 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x55ba5160e530 con 0x55ba51810e10 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 10 client.7812 handle_command_reply: tid=0 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 client.7812 shutdown 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 msgr2=0x55ba5185db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f810c000f70 tx=0x7f810c005800 comp rx=0 tx=0).stop 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 shutdown_connections 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55ba51810e10 0x55ba51811220 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba517fe2f0 0x55ba5180ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55ba517fd9d0 0x55ba5185e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f80ff400640 0 client.7812 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 --2- 172.21.15.18:0/189930545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba517b40a0 0x55ba5185db40 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 >> 172.21.15.18:0/189930545 conn(0x55ba517b0020 msgr2=0x55ba517fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 shutdown_connections 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 1 -- 172.21.15.18:0/189930545 wait complete. 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8124113000 20 client.7812 trim_cache size 0 max 16384 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:10:37.611 INFO:teuthology.orchestra.run.smithi018.stdout: "9b0502f5-886a-4665-bd1a-45041db5240f": { 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir", 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "9b0502f5-886a-4665-bd1a-45041db5240f", 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive" 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:10:37.612 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 msgr2=0x7f80f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 0x7f80f8069420 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f810c007fd0 tx=0x7f810c007940 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 msgr2=0x7f811c14b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f8114009d90 tx=0x7f8114019710 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 shutdown_connections 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811c15bcf0 0x7f811c14b4d0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f811c15b910 0x7f811c06c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f8066f60 0x7f80f8069420 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 --2- 172.21.15.18:0/238456911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f811c0cf3c0 0x7f811c14ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:10:37.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 >> 172.21.15.18:0/238456911 conn(0x7f811c0b3200 msgr2=0x7f811c0c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:10:37.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 shutdown_connections 2024-04-25T10:10:37.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:10:37.597+0000 7f8120c00640 1 -- 172.21.15.18:0/238456911 wait complete. 2024-04-25T10:10:37.626 INFO:tasks.cephfs.filesystem:scrub status for tag:9b0502f5-886a-4665-bd1a-45041db5240f - {'path': '/dir', 'tag': '9b0502f5-886a-4665-bd1a-45041db5240f', 'options': 'recursive'} 2024-04-25T10:10:41.529 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:10:41.521+0000 7fb22fa00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T10:10:51.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:10:51.152 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:11:07.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:07.627 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:11:07.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.773+0000 7fbb6ec00640 1 Processor -- start 2024-04-25T10:11:07.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.773+0000 7fbb6ec00640 1 -- start start 2024-04-25T10:11:07.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6ec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6ec00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb6806e4a0 0x7fbb6806e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6ec00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6815fc00 con 0x7fbb6815f440 2024-04-25T10:11:07.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6ec00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6806d640 con 0x7fbb6806e4a0 2024-04-25T10:11:07.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6ec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815fee0 con 0x7fbb68159320 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb6806e4a0 0x7fbb6806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb6806e4a0 0x7fbb6806e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34432/0 (socket says 172.21.15.18:34432) 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 -- 172.21.15.18:0/3545316030 learned_addr learned my addr 172.21.15.18:0/3545316030 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb67e00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 -- 172.21.15.18:0/3545316030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 msgr2=0x7fbb6815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 -- 172.21.15.18:0/3545316030 >> v1:172.21.15.18:6789/0 conn(0x7fbb6815f440 legacy=0x7fbb6806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 -- 172.21.15.18:0/3545316030 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb681601c0 con 0x7fbb6806e4a0 2024-04-25T10:11:07.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb6806e930 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009870 tx=0x7fbb6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee47969582f8a1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.777+0000 7fbb67400640 1 -- 172.21.15.18:0/3545316030 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600b2070 con 0x7fbb6806e4a0 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67400640 1 -- 172.21.15.18:0/3545316030 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb600a9070 con 0x7fbb6806e4a0 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67400640 1 -- 172.21.15.18:0/3545316030 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600ad880 con 0x7fbb6806e4a0 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- 172.21.15.18:0/3545316030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 msgr2=0x7fbb6806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb6806e930 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbb60009870 tx=0x7fbb6001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- 172.21.15.18:0/3545316030 shutdown_connections 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb6806e930 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/3545316030 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- 172.21.15.18:0/3545316030 >> 172.21.15.18:0/3545316030 conn(0x7fbb68067080 msgr2=0x7fbb6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- 172.21.15.18:0/3545316030 shutdown_connections 2024-04-25T10:11:07.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- 172.21.15.18:0/3545316030 wait complete. 2024-04-25T10:11:07.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 Processor -- start 2024-04-25T10:11:07.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- start start 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6813dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb6815f440 0x7fbb68164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815f9a0 con 0x7fbb6806e4a0 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815f820 con 0x7fbb6815f440 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6ec00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68168590 con 0x7fbb68159320 2024-04-25T10:11:07.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34434/0 (socket says 172.21.15.18:34434) 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 -- 172.21.15.18:0/233957178 learned_addr learned my addr 172.21.15.18:0/233957178 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb5f400640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6813dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb6815f440 0x7fbb68164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 -- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 msgr2=0x7fbb6813dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6813dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 -- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb6815f440 msgr2=0x7fbb68164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.781+0000 7fbb67e00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb6815f440 0x7fbb68164960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb67e00640 1 -- 172.21.15.18:0/233957178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6813af60 con 0x7fbb6806e4a0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb67e00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800d800 tx=0x7fbb5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb64c00640 1 -- 172.21.15.18:0/233957178 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800b6c0 con 0x7fbb6806e4a0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb64c00640 1 -- 172.21.15.18:0/233957178 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58019070 con 0x7fbb6806e4a0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb64c00640 1 -- 172.21.15.18:0/233957178 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5800ba60 con 0x7fbb6806e4a0 2024-04-25T10:11:07.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6813b240 con 0x7fbb6806e4a0 2024-04-25T10:11:07.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6813b800 con 0x7fbb6806e4a0 2024-04-25T10:11:07.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.785+0000 7fbb64c00640 1 -- 172.21.15.18:0/233957178 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb5800bc00 con 0x7fbb6806e4a0 2024-04-25T10:11:07.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb64c00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 0x7fbb44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb64c00640 1 -- 172.21.15.18:0/233957178 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fbb58085780 con 0x7fbb6806e4a0 2024-04-25T10:11:07.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5f400640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 0x7fbb44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 Processor -- start 2024-04-25T10:11:07.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- start start 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5f400640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 0x7fbb44069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb681f9e50 tx=0x7fbb50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 0x55e99fdaab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99fbf7ff0 con 0x55e99fdf49d0 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99fb80150 con 0x55e99fdf52f0 2024-04-25T10:11:07.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e99fbf4090 con 0x55e99fdab0a0 2024-04-25T10:11:07.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34438/0 (socket says 172.21.15.18:34438) 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 -- 172.21.15.18:0/143443362 learned_addr learned my addr 172.21.15.18:0/143443362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5f400640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 0x55e99fdaab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 -- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 msgr2=0x55e99fdab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 -- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 msgr2=0x55e99fdaab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 0x55e99fdaab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 -- 172.21.15.18:0/143443362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e99fd8e0d0 con 0x55e99fdf49d0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5f400640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 0x55e99fdaab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb67e00640 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbb58055aa0 tx=0x7fbb580564a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e656d85785d30e33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5cc00640 1 -- 172.21.15.18:0/143443362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58059030 con 0x55e99fdf49d0 2024-04-25T10:11:07.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5cc00640 1 -- 172.21.15.18:0/143443362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5805e4b0 con 0x55e99fdf49d0 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb5cc00640 1 -- 172.21.15.18:0/143443362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5805c0c0 con 0x55e99fdf49d0 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- 172.21.15.18:0/143443362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 msgr2=0x55e99fdf4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fbb58055aa0 tx=0x7fbb580564a0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- 172.21.15.18:0/143443362 shutdown_connections 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf52f0 0x55e99fdaab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 --2- 172.21.15.18:0/143443362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fdf4db0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- 172.21.15.18:0/143443362 >> 172.21.15.18:0/143443362 conn(0x55e99fda7020 msgr2=0x55e99fda9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- 172.21.15.18:0/143443362 shutdown_connections 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.789+0000 7fbb71fec000 1 -- 172.21.15.18:0/143443362 wait complete. 2024-04-25T10:11:07.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- start start 2024-04-25T10:11:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 Processor -- start 2024-04-25T10:11:07.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdd97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fdd9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99fbbc250 con 0x55e99fdf52f0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99fbb2690 con 0x55e99fdf49d0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e99fb80a40 con 0x55e99fdab0a0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 10 client.0 _ll_register_callbacks cb 0x55e99fd95e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34440/0 (socket says 172.21.15.18:34440) 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 -- 172.21.15.18:0/2110379807 learned_addr learned my addr 172.21.15.18:0/2110379807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb67e00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdd97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb5f400640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fdd9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 -- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 msgr2=0x55e99fdd97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdd97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 -- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 msgr2=0x55e99fdd9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fdd9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 -- 172.21.15.18:0/2110379807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e99fca51c0 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001a100 tx=0x7fbb6001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514be190d45dc0e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb600bc070 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fbb600adb90 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb5805e4b0 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb600b2040 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 10 client.7827 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55e99fca1170 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5805e4b0 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb68071a80 con 0x55e99fdf52f0 2024-04-25T10:11:07.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 10 client.7827 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 10 client.7827 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 20 client.7827 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe04c80 0x55e99fe07070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 4 client.7827 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e99fb93c60 con 0x55e99fe04c80 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.793+0000 7fbb67e00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe04c80 0x55e99fe07070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb67e00640 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe04c80 0x55e99fe07070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98b58fbe0d0c2f1b server_cookie=2fb648101191b8dd in_seq=0 out_seq=0 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb55600640 10 client.7827 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb55600640 1 -- 172.21.15.18:0/2110379807 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e99fb93c60 con 0x55e99fe04c80 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb55600640 10 client.7827 handle_command_reply: tid=0 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 client.7827 shutdown 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 msgr2=0x55e99fdda270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fbb6001a100 tx=0x7fbb6001ad10 comp rx=0 tx=0).stop 2024-04-25T10:11:07.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 shutdown_connections 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe04c80 0x55e99fe07070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf52f0 0x55e99fdda270 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fdd9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb55600640 0 client.7827 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 --2- 172.21.15.18:0/2110379807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdab0a0 0x55e99fdd97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 >> 172.21.15.18:0/2110379807 conn(0x55e99fda7020 msgr2=0x55e99fda9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 shutdown_connections 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 1 -- 172.21.15.18:0/2110379807 wait complete. 2024-04-25T10:11:07.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.797+0000 7fbb71fec000 20 client.7827 trim_cache size 0 max 16384 2024-04-25T10:11:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 Processor -- start 2024-04-25T10:11:07.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- start start 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdab0a0 0x55e99fe51300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe51d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb682038b0 con 0x55e99fdf49d0 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb68202ae0 con 0x55e99fdab0a0 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6815ef00 con 0x55e99fdf52f0 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34456/0 (socket says 172.21.15.18:34456) 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 -- 172.21.15.18:0/1573868825 learned_addr learned my addr 172.21.15.18:0/1573868825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb67e00640 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdab0a0 0x55e99fe51300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe51d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 -- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 msgr2=0x55e99fe51d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe51d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 -- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdab0a0 msgr2=0x55e99fe51300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdab0a0 0x55e99fe51300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 -- 172.21.15.18:0/1573868825 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e99fc3ede0 con 0x55e99fdf49d0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb5f400640 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbb50001740 tx=0x7fbb50012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfcdd31d04b5686 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb57e00640 1 -- 172.21.15.18:0/1573868825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50026070 con 0x55e99fdf49d0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb57e00640 1 -- 172.21.15.18:0/1573868825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500050d0 con 0x55e99fdf49d0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb57e00640 1 -- 172.21.15.18:0/1573868825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50005280 con 0x55e99fdf49d0 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- 172.21.15.18:0/1573868825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 msgr2=0x55e99fe51840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fbb50001740 tx=0x7fbb50012000 comp rx=0 tx=0).stop 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- 172.21.15.18:0/1573868825 shutdown_connections 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe51d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdf49d0 0x55e99fe51840 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 --2- 172.21.15.18:0/1573868825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdab0a0 0x55e99fe51300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- 172.21.15.18:0/1573868825 >> 172.21.15.18:0/1573868825 conn(0x55e99fda7020 msgr2=0x55e99fe01fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- 172.21.15.18:0/1573868825 shutdown_connections 2024-04-25T10:11:07.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.813+0000 7fbb71fec000 1 -- 172.21.15.18:0/1573868825 wait complete. 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- start start 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 Processor -- start 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fe07aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe07fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e99fb92e00 con 0x55e99fdab0a0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb682024e0 con 0x55e99fdf49d0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e99fbf7300 con 0x55e99fdf52f0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 10 client.0 _ll_register_callbacks cb 0x55e99fd76040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34468/0 (socket says 172.21.15.18:34468) 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 -- 172.21.15.18:0/3975503437 learned_addr learned my addr 172.21.15.18:0/3975503437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe07fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb5f400640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fe07aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 -- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 msgr2=0x55e99fe07fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe07fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 -- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 msgr2=0x55e99fe07aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fe07aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 -- 172.21.15.18:0/3975503437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e99fb998e0 con 0x55e99fdab0a0 2024-04-25T10:11:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb6cc00640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe07fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb5f400640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fe07aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb67e00640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbb58055f60 tx=0x7fbb58010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d9b5294ca501cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58059040 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fbb58052410 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb500050d0 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb5807c050 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 10 client.7833 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55e99fc518f0 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500050d0 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb58013070 con 0x55e99fdab0a0 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 10 client.7833 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:07.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 10 client.7833 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 20 client.7833 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe089d0 0x55e99fe5cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 4 client.7833 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e99fc05530 con 0x55e99fe089d0 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb5f400640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe089d0 0x55e99fe5cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb5f400640 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe089d0 0x55e99fe5cf60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=212010c07bd7fe6c server_cookie=3222af7d3dd4a981 in_seq=0 out_seq=0 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 10 client.7833 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 1 -- 172.21.15.18:0/3975503437 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e99fc05530 con 0x55e99fe089d0 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb55600640 10 client.7833 handle_command_reply: tid=0 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 client.7833 shutdown 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 msgr2=0x55e99fe07560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.817+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fbb58055f60 tx=0x7fbb58010000 comp rx=0 tx=0).stop 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 shutdown_connections 2024-04-25T10:11:07.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55e99fe089d0 0x55e99fe5cf60 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55e99fdf52f0 0x55e99fe07fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e99fdf49d0 0x55e99fe07aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb55600640 0 client.7833 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 --2- 172.21.15.18:0/3975503437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e99fdab0a0 0x55e99fe07560 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 >> 172.21.15.18:0/3975503437 conn(0x55e99fda7020 msgr2=0x55e99fdf3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 shutdown_connections 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 1 -- 172.21.15.18:0/3975503437 wait complete. 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb71fec000 20 client.7833 trim_cache size 0 max 16384 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:07.833 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:11:07.834 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:11:07.834 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:07.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 msgr2=0x7fbb44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 0x7fbb44069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fbb681f9e50 tx=0x7fbb50009040 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 msgr2=0x7fbb68157cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbb5800d800 tx=0x7fbb5800dcc0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 shutdown_connections 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb6815f440 0x7fbb68164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbb44066f60 0x7fbb44069420 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbb68159320 0x7fbb6813dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 --2- 172.21.15.18:0/233957178 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb6806e4a0 0x7fbb68157cb0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 >> 172.21.15.18:0/233957178 conn(0x7fbb68067080 msgr2=0x7fbb6806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 shutdown_connections 2024-04-25T10:11:07.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.821+0000 7fbb6ec00640 1 -- 172.21.15.18:0/233957178 wait complete. 2024-04-25T10:11:07.847 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:11:07.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:07.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.977+0000 7f3f5ae00640 1 Processor -- start 2024-04-25T10:11:07.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5ae00640 1 -- start start 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5ae00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3f5415efa0 0x7f3f54099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5ae00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540d0280 con 0x7f3f540b21b0 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5ae00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f540cd6c0 con 0x7f3f540cdb70 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5ae00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540b3fe0 con 0x7f3f5415efa0 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5a400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3f540b21b0 0x7f3f540cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35910/0 (socket says 172.21.15.18:35910) 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f5a400640 1 -- 172.21.15.18:0/272671118 learned_addr learned my addr 172.21.15.18:0/272671118 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:07.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f59a00640 1 --2- 172.21.15.18:0/272671118 >> v2:172.21.15.167:3300/0 conn(0x7f3f5415efa0 0x7f3f54099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463283438 0 0) 0x7f3f540d0280 con 0x7f3f540b21b0 2024-04-25T10:11:07.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f3c003530 con 0x7f3f540b21b0 2024-04-25T10:11:07.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923744432 0 0) 0x7f3f540cd6c0 con 0x7f3f540cdb70 2024-04-25T10:11:07.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f59a00640 1 -- 172.21.15.18:0/272671118 >> v1:172.21.15.167:6789/0 conn(0x7f3f540cdb70 legacy=0x7f3f540cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f59a00640 1 -- 172.21.15.18:0/272671118 >> v1:172.21.15.18:6789/0 conn(0x7f3f540b21b0 legacy=0x7f3f540cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.981+0000 7f3f59a00640 1 -- 172.21.15.18:0/272671118 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540cce20 con 0x7f3f5415efa0 2024-04-25T10:11:07.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f59a00640 1 --2- 172.21.15.18:0/272671118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f5415efa0 0x7f3f54099a60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f480097c0 tx=0x7f3f4801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5907a9f0a82ed496 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480b0070 con 0x7f3f5415efa0 2024-04-25T10:11:07.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480ab600 con 0x7f3f5415efa0 2024-04-25T10:11:07.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f53e00640 1 -- 172.21.15.18:0/272671118 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480ab9d0 con 0x7f3f5415efa0 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 -- 172.21.15.18:0/272671118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f5415efa0 msgr2=0x7f3f54099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/272671118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f5415efa0 0x7f3f54099a60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3f480097c0 tx=0x7f3f4801c410 comp rx=0 tx=0).stop 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 -- 172.21.15.18:0/272671118 shutdown_connections 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/272671118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f5415efa0 0x7f3f54099a60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 -- 172.21.15.18:0/272671118 >> 172.21.15.18:0/272671118 conn(0x7f3f540b3050 msgr2=0x7f3f540b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 -- 172.21.15.18:0/272671118 shutdown_connections 2024-04-25T10:11:07.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 -- 172.21.15.18:0/272671118 wait complete. 2024-04-25T10:11:07.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.985+0000 7f3f5ae00640 1 Processor -- start 2024-04-25T10:11:07.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- start start 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 0x7f3f541544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f540cdb70 0x7f3f54151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b3b70 con 0x7f3f5415efa0 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5409a3b0 con 0x7f3f540b21b0 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540b3cf0 con 0x7f3f540cdb70 2024-04-25T10:11:07.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34476/0 (socket says 172.21.15.18:34476) 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 -- 172.21.15.18:0/715055195 learned_addr learned my addr 172.21.15.18:0/715055195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f59a00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 0x7f3f541544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f59000640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f540cdb70 0x7f3f54151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 -- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f540cdb70 msgr2=0x7f3f54151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f540cdb70 0x7f3f54151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 -- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 msgr2=0x7f3f541544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 0x7f3f541544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 -- 172.21.15.18:0/715055195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f540b61f0 con 0x7f3f5415efa0 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f59a00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 0x7f3f541544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:07.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5a400640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00cb40 tx=0x7f3f4c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:07.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c017070 con 0x7f3f5415efa0 2024-04-25T10:11:07.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00aca0 con 0x7f3f5415efa0 2024-04-25T10:11:07.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c012620 con 0x7f3f5415efa0 2024-04-25T10:11:07.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540b64d0 con 0x7f3f5415efa0 2024-04-25T10:11:07.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f540c5f20 con 0x7f3f5415efa0 2024-04-25T10:11:08.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.989+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f540c5a70 con 0x7f3f5415efa0 2024-04-25T10:11:08.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.993+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f4c01a070 con 0x7f3f5415efa0 2024-04-25T10:11:08.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.993+0000 7f3f51600640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.993+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f3f4c0850a0 con 0x7f3f5415efa0 2024-04-25T10:11:08.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.993+0000 7f3f59a00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.993+0000 7f3f59a00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 0x7f3f34069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ad000 tx=0x7f3f48008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:07.997+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f4c055e50 con 0x7f3f5415efa0 2024-04-25T10:11:08.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f5404efa0 con 0x7f3f5415efa0 2024-04-25T10:11:08.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f51600640 1 -- 172.21.15.18:0/715055195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f3f4c055750 con 0x7f3f5415efa0 2024-04-25T10:11:08.204 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:08.204 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:41.488105+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":6,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:08.205 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 70 2024-04-25T10:11:08.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 msgr2=0x7f3f34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 0x7f3f34069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3f480ad000 tx=0x7f3f48008040 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 msgr2=0x7f3f540c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00cb40 tx=0x7f3f4c00a060 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 shutdown_connections 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f5415efa0 0x7f3f540c6440 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3f540cdb70 0x7f3f54151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 --2- 172.21.15.18:0/715055195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f540b21b0 0x7f3f541544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 >> 172.21.15.18:0/715055195 conn(0x7f3f540b3050 msgr2=0x7f3f540b3430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 shutdown_connections 2024-04-25T10:11:08.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.197+0000 7f3f5ae00640 1 -- 172.21.15.18:0/715055195 wait complete. 2024-04-25T10:11:08.226 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T10:11:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.361+0000 7f8623e00640 1 Processor -- start 2024-04-25T10:11:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.361+0000 7f8623e00640 1 -- start start 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8623e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 0x7f861c168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8623e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c06ac10 con 0x7f861c15dd90 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8623e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c06aeb0 con 0x7f861c072210 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8623e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0b2dc0 con 0x7f861c0cf3b0 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f861c15dd90 0x7f861c071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35912/0 (socket says 172.21.15.18:35912) 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621400640 1 -- 172.21.15.18:0/1739808067 learned_addr learned my addr 172.21.15.18:0/1739808067 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:08.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621e00640 1 --2- 172.21.15.18:0/1739808067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 0x7f861c168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586846485 0 0) 0x7f861c06ac10 con 0x7f861c15dd90 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8604003530 con 0x7f861c15dd90 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724042864 0 0) 0x7f861c06aeb0 con 0x7f861c072210 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f861c06ac10 con 0x7f861c072210 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621e00640 1 -- 172.21.15.18:0/1739808067 >> v1:172.21.15.167:6789/0 conn(0x7f861c072210 legacy=0x7f861c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621e00640 1 -- 172.21.15.18:0/1739808067 >> v1:172.21.15.18:6789/0 conn(0x7f861c15dd90 legacy=0x7f861c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.365+0000 7f8621e00640 1 -- 172.21.15.18:0/1739808067 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c06b190 con 0x7f861c0cf3b0 2024-04-25T10:11:08.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8621e00640 1 --2- 172.21.15.18:0/1739808067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 0x7f861c168ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8614009dc0 tx=0x7f861401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d70104542b85eaf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140b2070 con 0x7f861c0cf3b0 2024-04-25T10:11:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86140a58b0 con 0x7f861c0cf3b0 2024-04-25T10:11:08.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f861be00640 1 -- 172.21.15.18:0/1739808067 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140a5c80 con 0x7f861c0cf3b0 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 -- 172.21.15.18:0/1739808067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 msgr2=0x7f861c168ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 --2- 172.21.15.18:0/1739808067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 0x7f861c168ab0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8614009dc0 tx=0x7f861401c900 comp rx=0 tx=0).stop 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 -- 172.21.15.18:0/1739808067 shutdown_connections 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 --2- 172.21.15.18:0/1739808067 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c0cf3b0 0x7f861c168ab0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 -- 172.21.15.18:0/1739808067 >> 172.21.15.18:0/1739808067 conn(0x7f861c0cfd90 msgr2=0x7f861c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 -- 172.21.15.18:0/1739808067 shutdown_connections 2024-04-25T10:11:08.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 -- 172.21.15.18:0/1739808067 wait complete. 2024-04-25T10:11:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.369+0000 7f8623e00640 1 Processor -- start 2024-04-25T10:11:08.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- start start 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 0x7f861c0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 0x7f861c1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c16b810 con 0x7f861c15dd90 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c16b990 con 0x7f861c0cf3b0 2024-04-25T10:11:08.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c16bb10 con 0x7f861c072210 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34480/0 (socket says 172.21.15.18:34480) 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 -- 172.21.15.18:0/954724947 learned_addr learned my addr 172.21.15.18:0/954724947 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621400640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 0x7f861c0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 -- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 msgr2=0x7f861c0b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 0x7f861c0b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 -- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 msgr2=0x7f861c1427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8620a00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 0x7f861c1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 0x7f861c1427c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 -- 172.21.15.18:0/954724947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c160920 con 0x7f861c15dd90 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621400640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 0x7f861c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8620a00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 0x7f861c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8621e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f861401cde0 tx=0x7f86140196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8619600640 1 -- 172.21.15.18:0/954724947 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140b2050 con 0x7f861c15dd90 2024-04-25T10:11:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8619600640 1 -- 172.21.15.18:0/954724947 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86140be070 con 0x7f861c15dd90 2024-04-25T10:11:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c160c00 con 0x7f861c15dd90 2024-04-25T10:11:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8619600640 1 -- 172.21.15.18:0/954724947 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140ad870 con 0x7f861c15dd90 2024-04-25T10:11:08.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.373+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c1432e0 con 0x7f861c15dd90 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8619600640 1 -- 172.21.15.18:0/954724947 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86140ada10 con 0x7f861c15dd90 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8619600640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 0x7f85fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8619600640 1 -- 172.21.15.18:0/954724947 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8614120220 con 0x7f861c15dd90 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 0x7f85fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 Processor -- start 2024-04-25T10:11:08.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 -- start start 2024-04-25T10:11:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 0x7f85fc069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8610000f70 tx=0x7f8610009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab53e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab53e8e0 0x5626ab53ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab425ba0 con 0x5626ab5882e0 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab38b090 con 0x5626ab588c00 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ab313160 con 0x5626ab53e8e0 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34490/0 (socket says 172.21.15.18:34490) 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 -- 172.21.15.18:0/2107694248 learned_addr learned my addr 172.21.15.18:0/2107694248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621e00640 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab53e8e0 0x5626ab53ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8620a00640 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab53e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 -- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab53e8e0 msgr2=0x5626ab53ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab53e8e0 0x5626ab53ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 -- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 msgr2=0x5626ab53e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab53e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 -- 172.21.15.18:0/2107694248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ab434c20 con 0x5626ab5882e0 2024-04-25T10:11:08.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.377+0000 7f8621400640 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8610005b70 tx=0x7f8610010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220c27360f949dd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f860e000640 1 -- 172.21.15.18:0/2107694248 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861000dbe0 con 0x5626ab5882e0 2024-04-25T10:11:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f860e000640 1 -- 172.21.15.18:0/2107694248 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000dd80 con 0x5626ab5882e0 2024-04-25T10:11:08.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f860e000640 1 -- 172.21.15.18:0/2107694248 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610020670 con 0x5626ab5882e0 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- 172.21.15.18:0/2107694248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 msgr2=0x5626ab5886c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f8610005b70 tx=0x7f8610010000 comp rx=0 tx=0).stop 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- 172.21.15.18:0/2107694248 shutdown_connections 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab53e8e0 0x5626ab53ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab53e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- 172.21.15.18:0/2107694248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab5882e0 0x5626ab5886c0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- 172.21.15.18:0/2107694248 >> 172.21.15.18:0/2107694248 conn(0x5626ab53a890 msgr2=0x5626ab53cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- 172.21.15.18:0/2107694248 shutdown_connections 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- 172.21.15.18:0/2107694248 wait complete. 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- start start 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 Processor -- start 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab5882e0 0x5626ab5499c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab588c00 0x5626ab549f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab387130 con 0x5626ab53e8e0 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab34f130 con 0x5626ab5882e0 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ab449300 con 0x5626ab588c00 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f86271b2000 10 client.0 _ll_register_callbacks cb 0x5626ab529bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34500/0 (socket says 172.21.15.18:34500) 2024-04-25T10:11:08.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 -- 172.21.15.18:0/1750255739 learned_addr learned my addr 172.21.15.18:0/1750255739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621e00640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab588c00 0x5626ab549f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8620a00640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab5882e0 0x5626ab5499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 -- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab588c00 msgr2=0x5626ab549f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab588c00 0x5626ab549f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 -- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab5882e0 msgr2=0x5626ab5499c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab5882e0 0x5626ab5499c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 -- 172.21.15.18:0/1750255739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626ab368060 con 0x5626ab53e8e0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8621400640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f8610007bd0 tx=0x7f8610012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a1f44868d5783e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.381+0000 7f8602a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007710 con 0x5626ab53e8e0 2024-04-25T10:11:08.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8610021d50 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f861000dd80 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8610031050 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 10 client.7851 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5626ab32c7c0 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861000dd80 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8610034020 con 0x5626ab53e8e0 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 10 client.7851 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 10 client.7851 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 20 client.7851 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:08.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab54a7a0 0x5626ab599850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 4 client.7851 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626ab326cd0 con 0x5626ab54a7a0 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8620a00640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab54a7a0 0x5626ab599850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8620a00640 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab54a7a0 0x5626ab599850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=589ed280e3a23dca server_cookie=d69f351d8236dfaa in_seq=0 out_seq=0 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 10 client.7851 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 1 -- 172.21.15.18:0/1750255739 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5626ab326cd0 con 0x5626ab54a7a0 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 10 client.7851 handle_command_reply: tid=0 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 client.7851 shutdown 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 msgr2=0x5626ab549480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f8610007bd0 tx=0x7f8610012000 comp rx=0 tx=0).stop 2024-04-25T10:11:08.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 shutdown_connections 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab54a7a0 0x5626ab599850 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab588c00 0x5626ab549f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab5882e0 0x5626ab5499c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f8602a00640 0 client.7851 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 --2- 172.21.15.18:0/1750255739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab549480 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 >> 172.21.15.18:0/1750255739 conn(0x5626ab53a890 msgr2=0x5626ab53d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 shutdown_connections 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 1 -- 172.21.15.18:0/1750255739 wait complete. 2024-04-25T10:11:08.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.385+0000 7f86271b2000 20 client.7851 trim_cache size 0 max 16384 2024-04-25T10:11:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 Processor -- start 2024-04-25T10:11:08.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 -- start start 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab53e8e0 0x5626ab587aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab53dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c2024f0 con 0x5626ab588c00 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0ad810 con 0x5626ab53e8e0 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c15efc0 con 0x5626ab5882e0 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f8621e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f8621e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34506/0 (socket says 172.21.15.18:34506) 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.397+0000 7f8621e00640 1 -- 172.21.15.18:0/551304477 learned_addr learned my addr 172.21.15.18:0/551304477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8620a00640 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab53dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab53e8e0 0x5626ab587aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 -- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 msgr2=0x5626ab53dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab53dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 -- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab53e8e0 msgr2=0x5626ab587aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab53e8e0 0x5626ab587aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 -- 172.21.15.18:0/551304477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ab346fc0 con 0x5626ab588c00 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f86140f0980 tx=0x7f86140c5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b062bbae02970c6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f860d600640 1 -- 172.21.15.18:0/551304477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140f09f0 con 0x5626ab588c00 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f860d600640 1 -- 172.21.15.18:0/551304477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614117e50 con 0x5626ab588c00 2024-04-25T10:11:08.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f860d600640 1 -- 172.21.15.18:0/551304477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140f4b40 con 0x5626ab588c00 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- 172.21.15.18:0/551304477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 msgr2=0x5626ab53e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f86140f0980 tx=0x7f86140c5040 comp rx=0 tx=0).stop 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- 172.21.15.18:0/551304477 shutdown_connections 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab588c00 0x5626ab53e1d0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab53dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- 172.21.15.18:0/551304477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab53e8e0 0x5626ab587aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- 172.21.15.18:0/551304477 >> 172.21.15.18:0/551304477 conn(0x5626ab53a890 msgr2=0x5626ab586d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- 172.21.15.18:0/551304477 shutdown_connections 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- 172.21.15.18:0/551304477 wait complete. 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- start start 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 Processor -- start 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab5e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab5a32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab325e70 con 0x5626ab53e8e0 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ab313a50 con 0x5626ab588c00 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ab38a3a0 con 0x5626ab5882e0 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f86271b2000 10 client.0 _ll_register_callbacks cb 0x5626ab337240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34508/0 (socket says 172.21.15.18:34508) 2024-04-25T10:11:08.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 -- 172.21.15.18:0/1117581851 learned_addr learned my addr 172.21.15.18:0/1117581851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8620a00640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab5e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621e00640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab5a32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 -- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 msgr2=0x5626ab5e87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab5e87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 -- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 msgr2=0x5626ab5a32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab5a32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.401+0000 7f8621400640 1 -- 172.21.15.18:0/1117581851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5626ab3e49e0 con 0x5626ab53e8e0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8621400640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8610007e90 tx=0x7f8610000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a58d39489f255f76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8610007690 con 0x5626ab53e8e0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f861000dcf0 con 0x5626ab53e8e0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8614117e50 con 0x5626ab53e8e0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8610043050 con 0x5626ab53e8e0 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 10 client.7857 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:08.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5626ab32a630 con 0x5626ab53e8e0 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614117e50 con 0x5626ab53e8e0 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8610046020 con 0x5626ab53e8e0 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 10 client.7857 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 10 client.7857 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 20 client.7857 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab5a3c30 0x5626ab5a4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 4 client.7857 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5626ab3985d0 con 0x5626ab5a3c30 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8620a00640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab5a3c30 0x5626ab5a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 10 client.7857 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8620a00640 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab5a3c30 0x5626ab5a4010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d1814cdbbb21c8 server_cookie=727c198618f0b069 in_seq=0 out_seq=0 2024-04-25T10:11:08.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 1 -- 172.21.15.18:0/1117581851 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+419 (crc 0 0 0) 0x5626ab3985d0 con 0x5626ab5a3c30 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 10 client.7857 handle_command_reply: tid=0 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 client.7857 shutdown 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 msgr2=0x5626ab5e8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f8610007e90 tx=0x7f8610000ee0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 shutdown_connections 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5626ab5a3c30 0x5626ab5a4010 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ab588c00 0x5626ab5a32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5626ab5882e0 0x5626ab5e87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 --2- 172.21.15.18:0/1117581851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626ab53e8e0 0x5626ab5e8280 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8602a00640 0 client.7857 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 >> 172.21.15.18:0/1117581851 conn(0x5626ab53a890 msgr2=0x5626ab5875f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 shutdown_connections 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 1 -- 172.21.15.18:0/1117581851 wait complete. 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f86271b2000 20 client.7857 trim_cache size 0 max 16384 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "backtrace", 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 644364103, 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:11:08.420 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/testdir/hardlink" 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "backtrace", 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 2145364379, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627776, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir" 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "dir_frag", 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 2380934281, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627776, 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "frag": "*", 2024-04-25T10:11:08.421 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir" 2024-04-25T10:11:08.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:08.422 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:11:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 msgr2=0x7f85fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 0x7f85fc069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8610000f70 tx=0x7f8610009040 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 msgr2=0x7f861c1600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f861401cde0 tx=0x7f86140196a0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 shutdown_connections 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f861c15dd90 0x7f861c1600d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f861c0cf3b0 0x7f861c1427c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f85fc066f60 0x7f85fc069420 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 --2- 172.21.15.18:0/954724947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f861c072210 0x7f861c0b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 >> 172.21.15.18:0/954724947 conn(0x7f861c0cfd90 msgr2=0x7f861c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 shutdown_connections 2024-04-25T10:11:08.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.405+0000 7f8623e00640 1 -- 172.21.15.18:0/954724947 wait complete. 2024-04-25T10:11:08.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:11:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.565+0000 7fc5fc000640 1 Processor -- start 2024-04-25T10:11:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.565+0000 7fc5fc000640 1 -- start start 2024-04-25T10:11:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fc000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5f4070fe0 0x7fc5f4161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fc000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fc000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5f406d090 con 0x7fc5f40713c0 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fc000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5f4162390 con 0x7fc5f4070fe0 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fc000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f4161af0 con 0x7fc5f4071830 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5f4070fe0 0x7fc5f4161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5f4070fe0 0x7fc5f4161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34522/0 (socket says 172.21.15.18:34522) 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 -- 172.21.15.18:0/907408774 learned_addr learned my addr 172.21.15.18:0/907408774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5fa000640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 -- 172.21.15.18:0/907408774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 msgr2=0x7fc5f415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 -- 172.21.15.18:0/907408774 >> v1:172.21.15.167:6789/0 conn(0x7fc5f40713c0 legacy=0x7fc5f4143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.569+0000 7fc5f9600640 1 -- 172.21.15.18:0/907408774 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4161dd0 con 0x7fc5f4070fe0 2024-04-25T10:11:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f9600640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f4070fe0 0x7fc5f4161510 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1924dc8f21858b6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f3e00640 1 -- 172.21.15.18:0/907408774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80ab640 con 0x7fc5f4070fe0 2024-04-25T10:11:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f3e00640 1 -- 172.21.15.18:0/907408774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e80b0070 con 0x7fc5f4070fe0 2024-04-25T10:11:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f3e00640 1 -- 172.21.15.18:0/907408774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e80aba00 con 0x7fc5f4070fe0 2024-04-25T10:11:08.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- 172.21.15.18:0/907408774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f4070fe0 msgr2=0x7fc5f4161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f4070fe0 0x7fc5f4161510 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fc5e8009870 tx=0x7fc5e801c530 comp rx=0 tx=0).stop 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- 172.21.15.18:0/907408774 shutdown_connections 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- 172.21.15.18:0/907408774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f4070fe0 0x7fc5f4161510 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- 172.21.15.18:0/907408774 >> 172.21.15.18:0/907408774 conn(0x7fc5f40b3390 msgr2=0x7fc5f40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- 172.21.15.18:0/907408774 shutdown_connections 2024-04-25T10:11:08.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- 172.21.15.18:0/907408774 wait complete. 2024-04-25T10:11:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 Processor -- start 2024-04-25T10:11:08.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- start start 2024-04-25T10:11:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5f4070fe0 0x7fc5f413b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f41578d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b06c0 con 0x7fc5f40713c0 2024-04-25T10:11:08.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b0540 con 0x7fc5f4070fe0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fc000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f40b0840 con 0x7fc5f4071830 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f8c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34536/0 (socket says 172.21.15.18:34536) 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f8c00640 1 -- 172.21.15.18:0/468153372 learned_addr learned my addr 172.21.15.18:0/468153372 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5f9600640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5f4070fe0 0x7fc5f413b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.573+0000 7fc5fa000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f41578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 -- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 msgr2=0x7fc5f41578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f41578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 -- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5f4070fe0 msgr2=0x7fc5f413b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5f4070fe0 0x7fc5f413b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 -- 172.21.15.18:0/468153372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4157e10 con 0x7fc5f40713c0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f8c00640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c420 tx=0x7fc5e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e00052d0 con 0x7fc5f40713c0 2024-04-25T10:11:08.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e0005470 con 0x7fc5f40713c0 2024-04-25T10:11:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e0007260 con 0x7fc5f40713c0 2024-04-25T10:11:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5f40d0c90 con 0x7fc5f40713c0 2024-04-25T10:11:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5f40d1250 con 0x7fc5f40713c0 2024-04-25T10:11:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5f40745d0 con 0x7fc5f40713c0 2024-04-25T10:11:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc5e0007400 con 0x7fc5f40713c0 2024-04-25T10:11:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 0x7fc5d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.577+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fc5e00847a0 con 0x7fc5f40713c0 2024-04-25T10:11:08.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.581+0000 7fc5f9600640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 0x7fc5d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.581+0000 7fc5f9600640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 0x7fc5d4069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80af000 tx=0x7fc5e80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.581+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc5f4157e10 con 0x7fc5f40713c0 2024-04-25T10:11:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.777+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc5f40cef80 con 0x7fc5f40713c0 2024-04-25T10:11:08.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.777+0000 7fc5f1600640 1 -- 172.21.15.18:0/468153372 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fc5f406d090 con 0x7fc5f40713c0 2024-04-25T10:11:08.787 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:08.787 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T10:11:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 msgr2=0x7fc5d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 0x7fc5d4069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc5e80af000 tx=0x7fc5e80a7000 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 msgr2=0x7fc5f40d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fc5e000c420 tx=0x7fc5e000c8e0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 shutdown_connections 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc5d4066f60 0x7fc5d4069420 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5f4071830 0x7fc5f41578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5f40713c0 0x7fc5f40d0520 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 --2- 172.21.15.18:0/468153372 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc5f4070fe0 0x7fc5f413b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 >> 172.21.15.18:0/468153372 conn(0x7fc5f40b3390 msgr2=0x7fc5f406d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 shutdown_connections 2024-04-25T10:11:08.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.781+0000 7fc5fc000640 1 -- 172.21.15.18:0/468153372 wait complete. 2024-04-25T10:11:08.808 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:11:08.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:08.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T10:11:08.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 Processor -- start 2024-04-25T10:11:08.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 -- start start 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f91840cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f91840713c0 0x7f91840b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918415f7d0 con 0x7f91840d1220 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840ce4d0 con 0x7f91840713c0 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f918b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918415fab0 con 0x7f918415b6d0 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f917b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f91840d1220 0x7f9184070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35916/0 (socket says 172.21.15.18:35916) 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f917b400640 1 -- 172.21.15.18:0/18892643 learned_addr learned my addr 172.21.15.18:0/18892643 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183e00640 1 --2- 172.21.15.18:0/18892643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f91840cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9189200640 1 --2- 172.21.15.18:0/18892643 >> v2:172.21.15.167:3300/0 conn(0x7f91840713c0 0x7f91840b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183400640 1 -- 172.21.15.18:0/18892643 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148390626 0 0) 0x7f918415f7d0 con 0x7f91840d1220 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183400640 1 -- 172.21.15.18:0/18892643 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9168003530 con 0x7f91840d1220 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183e00640 1 -- 172.21.15.18:0/18892643 >> v2:172.21.15.167:3300/0 conn(0x7f91840713c0 msgr2=0x7f91840b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183e00640 1 --2- 172.21.15.18:0/18892643 >> v2:172.21.15.167:3300/0 conn(0x7f91840713c0 0x7f91840b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183e00640 1 -- 172.21.15.18:0/18892643 >> v1:172.21.15.18:6789/0 conn(0x7f91840d1220 legacy=0x7f9184070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.945+0000 7f9183e00640 1 -- 172.21.15.18:0/18892643 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918415fd90 con 0x7f918415b6d0 2024-04-25T10:11:08.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f9183e00640 1 --2- 172.21.15.18:0/18892643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f91840cdf90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f91740097c0 tx=0x7f917401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6cfd26790c080b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f9183400640 1 -- 172.21.15.18:0/18892643 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740b1070 con 0x7f918415b6d0 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f9183400640 1 -- 172.21.15.18:0/18892643 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91740ac410 con 0x7f918415b6d0 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f9183400640 1 -- 172.21.15.18:0/18892643 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918415bcc0 con 0x7f918415b6d0 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 -- 172.21.15.18:0/18892643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 msgr2=0x7f91840cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 --2- 172.21.15.18:0/18892643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f91840cdf90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f91740097c0 tx=0x7f917401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 -- 172.21.15.18:0/18892643 shutdown_connections 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 --2- 172.21.15.18:0/18892643 >> v2:172.21.15.167:3300/0 conn(0x7f91840713c0 0x7f91840b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 --2- 172.21.15.18:0/18892643 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f91840cdf90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 -- 172.21.15.18:0/18892643 >> 172.21.15.18:0/18892643 conn(0x7f918406f510 msgr2=0x7f918406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 -- 172.21.15.18:0/18892643 shutdown_connections 2024-04-25T10:11:08.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.949+0000 7f918b200640 1 -- 172.21.15.18:0/18892643 wait complete. 2024-04-25T10:11:08.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 Processor -- start 2024-04-25T10:11:08.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- start start 2024-04-25T10:11:08.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91840d1220 0x7f918413e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f9184155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184168700 con 0x7f91840713c0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918415f5b0 con 0x7f91840d1220 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9184168880 con 0x7f918415b6d0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34542/0 (socket says 172.21.15.18:34542) 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 -- 172.21.15.18:0/48653893 learned_addr learned my addr 172.21.15.18:0/48653893 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f917b400640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91840d1220 0x7f918413e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9189200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f9184155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 -- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 msgr2=0x7f9184155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f9184155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 -- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91840d1220 msgr2=0x7f918413e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91840d1220 0x7f918413e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 -- 172.21.15.18:0/48653893 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184164930 con 0x7f91840713c0 2024-04-25T10:11:08.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9183e00640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f91740af040 tx=0x7f9174019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9180c00640 1 -- 172.21.15.18:0/48653893 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740b9020 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9180c00640 1 -- 172.21.15.18:0/48653893 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91740acce0 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9184158c20 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f9180c00640 1 -- 172.21.15.18:0/48653893 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91740b1040 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.953+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918415e8d0 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9180c00640 1 -- 172.21.15.18:0/48653893 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91740bc020 con 0x7f91840713c0 2024-04-25T10:11:08.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9180c00640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 0x7f9160069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9180c00640 1 -- 172.21.15.18:0/48653893 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f917411eaf0 con 0x7f91840713c0 2024-04-25T10:11:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f917b400640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 0x7f9160069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 Processor -- start 2024-04-25T10:11:08.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 -- start start 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f917b400640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 0x7f9160069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9184158870 tx=0x7f916c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6165070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e61655b0 0x5563e611ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e6001f40 con 0x5563e611b290 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e5f69070 con 0x5563e6164c90 2024-04-25T10:11:08.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563e5ef11a0 con 0x5563e61655b0 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34558/0 (socket says 172.21.15.18:34558) 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f9189200640 1 -- 172.21.15.18:0/3812117894 learned_addr learned my addr 172.21.15.18:0/3812117894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.957+0000 7f917b400640 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e61655b0 0x5563e611ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9183e00640 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 -- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e61655b0 msgr2=0x5563e611ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e61655b0 0x5563e611ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 -- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 msgr2=0x5563e6165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6165070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 -- 172.21.15.18:0/3812117894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563e5eef510 con 0x5563e611b290 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9189200640 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f917c009b80 tx=0x7f917c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f35c219681311b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9178c00640 1 -- 172.21.15.18:0/3812117894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c019070 con 0x5563e611b290 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9178c00640 1 -- 172.21.15.18:0/3812117894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c009c70 con 0x5563e611b290 2024-04-25T10:11:08.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9178c00640 1 -- 172.21.15.18:0/3812117894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c015680 con 0x5563e611b290 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- 172.21.15.18:0/3812117894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 msgr2=0x5563e611b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f917c009b80 tx=0x7f917c009190 comp rx=0 tx=0).stop 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- 172.21.15.18:0/3812117894 shutdown_connections 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e611b290 0x5563e611b670 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e61655b0 0x5563e611ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- 172.21.15.18:0/3812117894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- 172.21.15.18:0/3812117894 >> 172.21.15.18:0/3812117894 conn(0x5563e6117240 msgr2=0x5563e6119630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- 172.21.15.18:0/3812117894 shutdown_connections 2024-04-25T10:11:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- 172.21.15.18:0/3812117894 wait complete. 2024-04-25T10:11:08.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- start start 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 Processor -- start 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6125e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 0x5563e61268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e5f236c0 con 0x5563e6164c90 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e5f65110 con 0x5563e61655b0 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563e601ff20 con 0x5563e611b290 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f918e758000 10 client.0 _ll_register_callbacks cb 0x5563e6106570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f917b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f917b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34566/0 (socket says 172.21.15.18:34566) 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f917b400640 1 -- 172.21.15.18:0/969881728 learned_addr learned my addr 172.21.15.18:0/969881728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.961+0000 7f9183e00640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6125e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9189200640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 0x5563e61268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 -- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 msgr2=0x5563e6125e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6125e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 -- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 msgr2=0x5563e61268b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 0x5563e61268b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 -- 172.21.15.18:0/969881728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563e5ef13b0 con 0x5563e6164c90 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9189200640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 0x5563e61268b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f917b400640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f916c0075d0 tx=0x7f916c001430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa29054acd94bb6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c007a90 con 0x5563e6164c90 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f916c010040 con 0x5563e6164c90 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f917c009c70 con 0x5563e6164c90 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f916c02e050 con 0x5563e6164c90 2024-04-25T10:11:08.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 10 client.7875 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5563e5feae00 con 0x5563e6164c90 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c009c70 con 0x5563e6164c90 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f916c031020 con 0x5563e6164c90 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 10 client.7875 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 10 client.7875 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 20 client.7875 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6127180 0x5563e6176410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 4 client.7875 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563e5f04d60 con 0x5563e6127180 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9183e00640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6127180 0x5563e6176410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 10 client.7875 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9183e00640 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6127180 0x5563e6176410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52092022e2168ddd server_cookie=736e35dd436da92d in_seq=0 out_seq=0 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 1 -- 172.21.15.18:0/969881728 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5563e5f04d60 con 0x5563e6127180 2024-04-25T10:11:08.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 10 client.7875 handle_command_reply: tid=0 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 client.7875 shutdown 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 msgr2=0x5563e6126370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f916c0075d0 tx=0x7f916c001430 comp rx=0 tx=0).stop 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 shutdown_connections 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6127180 0x5563e6176410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e61655b0 0x5563e61268b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e6164c90 0x5563e6126370 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 --2- 172.21.15.18:0/969881728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6125e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f9171600640 0 client.7875 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 >> 172.21.15.18:0/969881728 conn(0x5563e6117240 msgr2=0x5563e6119ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 shutdown_connections 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 1 -- 172.21.15.18:0/969881728 wait complete. 2024-04-25T10:11:08.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.965+0000 7f918e758000 20 client.7875 trim_cache size 0 max 16384 2024-04-25T10:11:08.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 Processor -- start 2024-04-25T10:11:08.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 -- start start 2024-04-25T10:11:08.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e611b290 0x5563e611a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e6164c90 0x5563e611ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91842036c0 con 0x5563e61655b0 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91842027e0 con 0x5563e611b290 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918415a150 con 0x5563e6164c90 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34572/0 (socket says 172.21.15.18:34572) 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.981+0000 7f9189200640 1 -- 172.21.15.18:0/3765926958 learned_addr learned my addr 172.21.15.18:0/3765926958 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f917b400640 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e6164c90 0x5563e611ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9183e00640 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e611b290 0x5563e611a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 -- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e6164c90 msgr2=0x5563e611ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e6164c90 0x5563e611ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 -- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e611b290 msgr2=0x5563e611a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e611b290 0x5563e611a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 -- 172.21.15.18:0/3765926958 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563e5fc0c50 con 0x5563e61655b0 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f917c000c10 tx=0x7f917c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8206a992feedb77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9173e00640 1 -- 172.21.15.18:0/3765926958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c02d070 con 0x5563e61655b0 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9173e00640 1 -- 172.21.15.18:0/3765926958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c006a30 con 0x5563e61655b0 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9173e00640 1 -- 172.21.15.18:0/3765926958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c019040 con 0x5563e61655b0 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- 172.21.15.18:0/3765926958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 msgr2=0x5563e6176410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f917c000c10 tx=0x7f917c016000 comp rx=0 tx=0).stop 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- 172.21.15.18:0/3765926958 shutdown_connections 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6176410 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e6164c90 0x5563e611ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- 172.21.15.18:0/3765926958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e611b290 0x5563e611a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- 172.21.15.18:0/3765926958 >> 172.21.15.18:0/3765926958 conn(0x5563e6117240 msgr2=0x5563e611fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:08.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- 172.21.15.18:0/3765926958 shutdown_connections 2024-04-25T10:11:08.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- 172.21.15.18:0/3765926958 wait complete. 2024-04-25T10:11:08.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- start start 2024-04-25T10:11:08.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 Processor -- start 2024-04-25T10:11:08.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6178620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6180ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563e6120b70 con 0x5563e61655b0 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91842021e0 con 0x5563e6164c90 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563e6124200 con 0x5563e611b290 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f918e758000 10 client.0 _ll_register_callbacks cb 0x7f917c009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34580/0 (socket says 172.21.15.18:34580) 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9189200640 1 -- 172.21.15.18:0/324039876 learned_addr learned my addr 172.21.15.18:0/324039876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f9183e00640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6178620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.985+0000 7f917b400640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6180ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 -- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 msgr2=0x5563e6178620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6178620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 -- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 msgr2=0x5563e6180ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:08.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6180ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 -- 172.21.15.18:0/324039876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563e5f31120 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f917b400640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6180ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9189200640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f917c008010 tx=0x7f917c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca8ca6c6860ca62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c038060 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f917c003830 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f917c006a30 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f917c02d030 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 10 client.7881 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5563e5f10170 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c006a30 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f917c027070 con 0x5563e61655b0 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 10 client.7881 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 10 client.7881 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:08.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 20 client.7881 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6181960 0x5563e61c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 4 client.7881 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x5563e5f765b0 con 0x5563e6181960 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9183e00640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6181960 0x5563e61c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9183e00640 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6181960 0x5563e61c4f70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e2331e118b4eb61 server_cookie=f3d9de05799aca5b in_seq=0 out_seq=0 2024-04-25T10:11:09.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 10 client.7881 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 1 -- 172.21.15.18:0/324039876 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5563e5f765b0 con 0x5563e6181960 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 10 client.7881 handle_command_reply: tid=0 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 client.7881 shutdown 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 msgr2=0x5563e6181420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f917c008010 tx=0x7f917c004740 comp rx=0 tx=0).stop 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 shutdown_connections 2024-04-25T10:11:09.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5563e6181960 0x5563e61c4f70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5563e61655b0 0x5563e6181420 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5563e6164c90 0x5563e6180ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 --2- 172.21.15.18:0/324039876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5563e611b290 0x5563e6178620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f9171600640 0 client.7881 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 >> 172.21.15.18:0/324039876 conn(0x5563e6117240 msgr2=0x5563e6119630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 shutdown_connections 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 1 -- 172.21.15.18:0/324039876 wait complete. 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918e758000 20 client.7881 trim_cache size 0 max 16384 2024-04-25T10:11:09.002 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:09.003 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:11:09.003 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "88f2a099-2b7a-4067-b5e7-0b820a58ba3f", 2024-04-25T10:11:09.003 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:11:09.003 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:09.003 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-04-25T10:11:08.989+0000 7fc11e800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)->f(v1 m2024-04-25T10:10:27.322017+0000) n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)->n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55bc8baf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 msgr2=0x7f9160069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 0x7f9160069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9184158870 tx=0x7f916c009040 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 msgr2=0x7f9184141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f91740af040 tx=0x7f9174019240 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 shutdown_connections 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9160066f60 0x7f9160069420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f918415b6d0 0x7f9184155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91840d1220 0x7f918413e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 --2- 172.21.15.18:0/48653893 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840713c0 0x7f9184141830 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.989+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 >> 172.21.15.18:0/48653893 conn(0x7f918406f510 msgr2=0x7f9184073830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.993+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 shutdown_connections 2024-04-25T10:11:09.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:08.993+0000 7f918b200640 1 -- 172.21.15.18:0/48653893 wait complete. 2024-04-25T10:11:09.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:09.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:11:09.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 Processor -- start 2024-04-25T10:11:09.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 -- start start 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f190806bf30 0x7f19080d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190815e040 con 0x7f190809a170 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19080cff80 con 0x7f190815dc60 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f190e200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080d0260 con 0x7f190806bf30 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.153+0000 7f1907e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f190806bf30 0x7f19080d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f190806bf30 0x7f19080d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34594/0 (socket says 172.21.15.18:34594) 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 -- 172.21.15.18:0/2802446718 learned_addr learned my addr 172.21.15.18:0/2802446718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f18fea00640 1 --1- 172.21.15.18:0/2802446718 >> v1:172.21.15.18:6789/0 conn(0x7f190809a170 0x7f19080cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35928/0 (socket says 172.21.15.18:35928) 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 -- 172.21.15.18:0/2802446718 >> v1:172.21.15.167:6789/0 conn(0x7f190815dc60 legacy=0x7f1908099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 -- 172.21.15.18:0/2802446718 >> v1:172.21.15.18:6789/0 conn(0x7f190809a170 legacy=0x7f19080cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 -- 172.21.15.18:0/2802446718 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080d0540 con 0x7f190806bf30 2024-04-25T10:11:09.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1906a00640 1 -- 172.21.15.18:0/2802446718 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693394327 0 0) 0x7f190815e040 con 0x7f190809a170 2024-04-25T10:11:09.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1907e00640 1 --2- 172.21.15.18:0/2802446718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190806bf30 0x7f19080d1020 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1900009870 tx=0x7f190001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13de1a9365cd7f2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1906a00640 1 -- 172.21.15.18:0/2802446718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ab610 con 0x7f190806bf30 2024-04-25T10:11:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1906a00640 1 -- 172.21.15.18:0/2802446718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000b0070 con 0x7f190806bf30 2024-04-25T10:11:09.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.157+0000 7f1906a00640 1 -- 172.21.15.18:0/2802446718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000ab9d0 con 0x7f190806bf30 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- 172.21.15.18:0/2802446718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190806bf30 msgr2=0x7f19080d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 --2- 172.21.15.18:0/2802446718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190806bf30 0x7f19080d1020 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f1900009870 tx=0x7f190001c410 comp rx=0 tx=0).stop 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- 172.21.15.18:0/2802446718 shutdown_connections 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 --2- 172.21.15.18:0/2802446718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190806bf30 0x7f19080d1020 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- 172.21.15.18:0/2802446718 >> 172.21.15.18:0/2802446718 conn(0x7f19080b3200 msgr2=0x7f19080b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- 172.21.15.18:0/2802446718 shutdown_connections 2024-04-25T10:11:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- 172.21.15.18:0/2802446718 wait complete. 2024-04-25T10:11:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 Processor -- start 2024-04-25T10:11:09.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- start start 2024-04-25T10:11:09.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190806bf30 0x7f190815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 0x7f190815d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f190806cfa0 con 0x7f190815dc60 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080cc880 con 0x7f190809a170 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f190e200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1908153010 con 0x7f190806bf30 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34608/0 (socket says 172.21.15.18:34608) 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 -- 172.21.15.18:0/3769202088 learned_addr learned my addr 172.21.15.18:0/3769202088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907400640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190806bf30 0x7f190815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f18fea00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 0x7f190815d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 -- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190806bf30 msgr2=0x7f190815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190806bf30 0x7f190815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 -- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 msgr2=0x7f190815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 0x7f190815d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 -- 172.21.15.18:0/3769202088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19080c9390 con 0x7f190815dc60 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f18fea00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 0x7f190815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.161+0000 7f1907e00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f1900019020 tx=0x7f190001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 -- 172.21.15.18:0/3769202088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000be5f0 con 0x7f190815dc60 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 -- 172.21.15.18:0/3769202088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000be790 con 0x7f190815dc60 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 -- 172.21.15.18:0/3769202088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000beb80 con 0x7f190815dc60 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080b6220 con 0x7f190815dc60 2024-04-25T10:11:09.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19080c9630 con 0x7f190815dc60 2024-04-25T10:11:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 -- 172.21.15.18:0/3769202088 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19000b43f0 con 0x7f190815dc60 2024-04-25T10:11:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 0x7f18e4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f18ffe00640 1 -- 172.21.15.18:0/3769202088 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f190011ff40 con 0x7f190815dc60 2024-04-25T10:11:09.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f19116e6000 1 Processor -- start 2024-04-25T10:11:09.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f1907400640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 0x7f18e4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.165+0000 7f19116e6000 1 -- start start 2024-04-25T10:11:09.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f1907400640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 0x7f18e4069450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18f80012f0 tx=0x7f18f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc79d0 0x55a8e4dc7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4bcaff0 con 0x55a8e4dc82f0 2024-04-25T10:11:09.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4b53150 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4bc7090 con 0x55a8e4dc79d0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34620/0 (socket says 172.21.15.18:34620) 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 -- 172.21.15.18:0/4026682152 learned_addr learned my addr 172.21.15.18:0/4026682152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f1907e00640 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f1907400640 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc79d0 0x55a8e4dc7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 -- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc79d0 msgr2=0x55a8e4dc7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc79d0 0x55a8e4dc7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 -- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4d7e0a0 msgr2=0x55a8e4d7e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 -- 172.21.15.18:0/4026682152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e4d610d0 con 0x55a8e4dc82f0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18fea00640 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f18f00074d0 tx=0x7f18f0005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a727c0b5a9aa17 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18f7e00640 1 -- 172.21.15.18:0/4026682152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0019070 con 0x55a8e4dc82f0 2024-04-25T10:11:09.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18f7e00640 1 -- 172.21.15.18:0/4026682152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00018a0 con 0x55a8e4dc82f0 2024-04-25T10:11:09.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f18f7e00640 1 -- 172.21.15.18:0/4026682152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0001c70 con 0x55a8e4dc82f0 2024-04-25T10:11:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- 172.21.15.18:0/4026682152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 msgr2=0x55a8e4d7db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f18f00074d0 tx=0x7f18f0005bd0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- 172.21.15.18:0/4026682152 shutdown_connections 2024-04-25T10:11:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc82f0 0x55a8e4d7db60 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 --2- 172.21.15.18:0/4026682152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc79d0 0x55a8e4dc7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- 172.21.15.18:0/4026682152 >> 172.21.15.18:0/4026682152 conn(0x55a8e4d7a020 msgr2=0x55a8e4d7c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- 172.21.15.18:0/4026682152 shutdown_connections 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- 172.21.15.18:0/4026682152 wait complete. 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 -- start start 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.169+0000 7f19116e6000 1 Processor -- start 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4dac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4b8f250 con 0x55a8e4dc79d0 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4b85690 con 0x55a8e4dc82f0 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4b53a40 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 10 client.0 _ll_register_callbacks cb 0x55a8e4d68e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f1907400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4dac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34622/0 (socket says 172.21.15.18:34622) 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 -- 172.21.15.18:0/1084199911 learned_addr learned my addr 172.21.15.18:0/1084199911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f1907e00640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 -- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 msgr2=0x55a8e4dac7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4dac7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 -- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 msgr2=0x55a8e4dad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 -- 172.21.15.18:0/1084199911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e4c781c0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18fea00640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005c10 tx=0x7f18f0007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e594383db5a377e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0019030 con 0x55a8e4dc79d0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f18f0010040 con 0x55a8e4dc79d0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18f00018a0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18f002d050 con 0x55a8e4dc79d0 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 10 client.7896 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55a8e4c74170 con 0x55a8e4dc79d0 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f00018a0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18f0030020 con 0x55a8e4dc79d0 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 10 client.7896 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 10 client.7896 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 20 client.7896 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dd7c80 0x55a8e4dda070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 4 client.7896 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8e4b66c60 con 0x55a8e4dd7c80 2024-04-25T10:11:09.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f1907400640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dd7c80 0x55a8e4dda070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 10 client.7896 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f1907400640 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dd7c80 0x55a8e4dda070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b26b692c89e0f091 server_cookie=a6faec9d2b9f74da in_seq=0 out_seq=0 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 1 -- 172.21.15.18:0/1084199911 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a8e4b66c60 con 0x55a8e4dd7c80 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f18f4c00640 10 client.7896 handle_command_reply: tid=0 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.173+0000 7f19116e6000 1 client.7896 shutdown 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 msgr2=0x55a8e4dacd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005c10 tx=0x7f18f0007a20 comp rx=0 tx=0).stop 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 shutdown_connections 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dd7c80 0x55a8e4dda070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4dacd30 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 --2- 172.21.15.18:0/1084199911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4dac7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f18f4c00640 0 client.7896 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 >> 172.21.15.18:0/1084199911 conn(0x55a8e4d7a020 msgr2=0x55a8e4d7cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 shutdown_connections 2024-04-25T10:11:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 1 -- 172.21.15.18:0/1084199911 wait complete. 2024-04-25T10:11:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.177+0000 7f19116e6000 20 client.7896 trim_cache size 0 max 16384 2024-04-25T10:11:09.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.189+0000 7f19116e6000 1 Processor -- start 2024-04-25T10:11:09.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.189+0000 7f19116e6000 1 -- start start 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 0x55a8e4d7c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc82f0 0x55a8e4d7ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908203930 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1908202b40 con 0x55a8e4dc79d0 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080ca600 con 0x55a8e4dc82f0 2024-04-25T10:11:09.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34634/0 (socket says 172.21.15.18:34634) 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 -- 172.21.15.18:0/2833338455 learned_addr learned my addr 172.21.15.18:0/2833338455 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f18fea00640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 0x55a8e4d7c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907e00640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc82f0 0x55a8e4d7ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 -- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc82f0 msgr2=0x55a8e4d7ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc82f0 0x55a8e4d7ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 -- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 msgr2=0x55a8e4d7c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 0x55a8e4d7c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 -- 172.21.15.18:0/2833338455 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8e4c11de0 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f18fea00640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 0x55a8e4d7c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:09.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f1907400640 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f18f800fae0 tx=0x7f18f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b187e511dbc0bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f18f7400640 1 -- 172.21.15.18:0/2833338455 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f8014510 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f18f7400640 1 -- 172.21.15.18:0/2833338455 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f802c030 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f18f7400640 1 -- 172.21.15.18:0/2833338455 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f80148d0 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- 172.21.15.18:0/2833338455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 msgr2=0x55a8e4d7c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f18f800fae0 tx=0x7f18f8012000 comp rx=0 tx=0).stop 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- 172.21.15.18:0/2833338455 shutdown_connections 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4dc82f0 0x55a8e4d7ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc79d0 0x55a8e4d7c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 --2- 172.21.15.18:0/2833338455 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4d7e0a0 0x55a8e4d7c410 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- 172.21.15.18:0/2833338455 >> 172.21.15.18:0/2833338455 conn(0x55a8e4d7a020 msgr2=0x55a8e4dd4730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- 172.21.15.18:0/2833338455 shutdown_connections 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- 172.21.15.18:0/2833338455 wait complete. 2024-04-25T10:11:09.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 -- start start 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.193+0000 7f19116e6000 1 Processor -- start 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4e27720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dd9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4b65e00 con 0x55a8e4dc79d0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19082025a0 con 0x55a8e4dc82f0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8e4bca300 con 0x55a8e4d7e0a0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 10 client.0 _ll_register_callbacks cb 0x55a8e4d49040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34644/0 (socket says 172.21.15.18:34644) 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 -- 172.21.15.18:0/237487615 learned_addr learned my addr 172.21.15.18:0/237487615 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f1907400640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4e27720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f1907e00640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dd9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 -- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 msgr2=0x55a8e4e27720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4e27720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 -- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 msgr2=0x55a8e4dd9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dd9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 -- 172.21.15.18:0/237487615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8e4b6c8e0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f1907e00640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18fea00640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f18f0007260 tx=0x7f18f0007050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b8bb9fd96923256 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0019070 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f18f0032cf0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18f802c030 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18f0028720 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 10 client.7902 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55a8e4c248f0 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f802c030 con 0x55a8e4dc79d0 2024-04-25T10:11:09.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18f0039050 con 0x55a8e4dc79d0 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 10 client.7902 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 10 client.7902 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 20 client.7902 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dda410 0x55a8e4dda820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 4 client.7902 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a8e4bd8530 con 0x55a8e4dda410 2024-04-25T10:11:09.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f1907400640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dda410 0x55a8e4dda820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:09.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 10 client.7902 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f1907400640 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dda410 0x55a8e4dda820 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b7bd97b1218d71c server_cookie=26f18e2c5d9447f6 in_seq=0 out_seq=0 2024-04-25T10:11:09.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 1 -- 172.21.15.18:0/237487615 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55a8e4bd8530 con 0x55a8e4dda410 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 10 client.7902 handle_command_reply: tid=0 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 client.7902 shutdown 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 msgr2=0x55a8e4e27c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f18f0007260 tx=0x7f18f0007050 comp rx=0 tx=0).stop 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 shutdown_connections 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55a8e4dda410 0x55a8e4dda820 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a8e4dc82f0 0x55a8e4dd9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8e4dc79d0 0x55a8e4e27c60 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f18f4c00640 0 client.7902 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 --2- 172.21.15.18:0/237487615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a8e4d7e0a0 0x55a8e4e27720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 >> 172.21.15.18:0/237487615 conn(0x55a8e4d7a020 msgr2=0x55a8e4dd4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 shutdown_connections 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 1 -- 172.21.15.18:0/237487615 wait complete. 2024-04-25T10:11:09.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.197+0000 7f19116e6000 20 client.7902 trim_cache size 0 max 16384 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "88f2a099-2b7a-4067-b5e7-0b820a58ba3f": { 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir", 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "88f2a099-2b7a-4067-b5e7-0b820a58ba3f", 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:09.212 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 msgr2=0x7f18e4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 0x7f18e4069450 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f18f80012f0 tx=0x7f18f8009040 comp rx=0 tx=0).stop 2024-04-25T10:11:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 msgr2=0x7f19081558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f1900019020 tx=0x7f190001ac50 comp rx=0 tx=0).stop 2024-04-25T10:11:09.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 shutdown_connections 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f190815dc60 0x7f19081558c0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f190809a170 0x7f190815d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f18e4066f90 0x7f18e4069450 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 --2- 172.21.15.18:0/3769202088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f190806bf30 0x7f190815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 >> 172.21.15.18:0/3769202088 conn(0x7f19080b3200 msgr2=0x7f19080b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 shutdown_connections 2024-04-25T10:11:09.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:09.201+0000 7f190e200640 1 -- 172.21.15.18:0/3769202088 wait complete. 2024-04-25T10:11:09.227 INFO:tasks.cephfs.filesystem:scrub status for tag:88f2a099-2b7a-4067-b5e7-0b820a58ba3f - {'path': '/dir', 'tag': '88f2a099-2b7a-4067-b5e7-0b820a58ba3f', 'options': 'recursive,repair'} 2024-04-25T10:11:21.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:11:21.327 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:11:39.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:39.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:11:39.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 Processor -- start 2024-04-25T10:11:39.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 -- start start 2024-04-25T10:11:39.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 0x7f8f840adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f840b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f840714e0 0x7f8f84071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f8406d410 con 0x7f8f840714e0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f840ae130 con 0x7f8f841474b0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f8a200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f840b41e0 con 0x7f8f840b3c00 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.377+0000 7f8f89800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f840714e0 0x7f8f84071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f840714e0 0x7f8f84071970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35596/0 (socket says 172.21.15.18:35596) 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 -- 172.21.15.18:0/2416050310 learned_addr learned my addr 172.21.15.18:0/2416050310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f88e00640 1 --2- 172.21.15.18:0/2416050310 >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 0x7f8f840adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f7be00640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f840b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 -- 172.21.15.18:0/2416050310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 msgr2=0x7f8f840b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f840b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 -- 172.21.15.18:0/2416050310 >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 msgr2=0x7f8f840adbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 --2- 172.21.15.18:0/2416050310 >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 0x7f8f840adbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 -- 172.21.15.18:0/2416050310 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840b44c0 con 0x7f8f840714e0 2024-04-25T10:11:39.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f88e00640 1 --2- 172.21.15.18:0/2416050310 >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 0x7f8f840adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f89800640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f840714e0 0x7f8f84071970 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8f8406c980 tx=0x7f8f7c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5593bf96d7c10507 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f83e00640 1 -- 172.21.15.18:0/2416050310 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0a56d0 con 0x7f8f840714e0 2024-04-25T10:11:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f83e00640 1 -- 172.21.15.18:0/2416050310 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0a5870 con 0x7f8f840714e0 2024-04-25T10:11:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.381+0000 7f8f83e00640 1 -- 172.21.15.18:0/2416050310 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0a5c40 con 0x7f8f840714e0 2024-04-25T10:11:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- 172.21.15.18:0/2416050310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f840714e0 msgr2=0x7f8f84071970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f840714e0 0x7f8f84071970 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8f8406c980 tx=0x7f8f7c01c960 comp rx=0 tx=0).stop 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- 172.21.15.18:0/2416050310 shutdown_connections 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f840714e0 0x7f8f84071970 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- 172.21.15.18:0/2416050310 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f840b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- 172.21.15.18:0/2416050310 >> v2:172.21.15.167:3300/0 conn(0x7f8f841474b0 0x7f8f840adbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- 172.21.15.18:0/2416050310 >> 172.21.15.18:0/2416050310 conn(0x7f8f840b1660 msgr2=0x7f8f840b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- 172.21.15.18:0/2416050310 shutdown_connections 2024-04-25T10:11:39.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- 172.21.15.18:0/2416050310 wait complete. 2024-04-25T10:11:39.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 Processor -- start 2024-04-25T10:11:39.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- start start 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 0x7f8f8415b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f84162530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8406e210 con 0x7f8f841474b0 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8406e090 con 0x7f8f840714e0 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f8a200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8406e390 con 0x7f8f840b3c00 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35610/0 (socket says 172.21.15.18:35610) 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 -- 172.21.15.18:0/4089965545 learned_addr learned my addr 172.21.15.18:0/4089965545 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f7be00640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f84162530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f88e00640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 0x7f8f8415b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 -- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 msgr2=0x7f8f84162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f84162530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 -- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 msgr2=0x7f8f8415b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 0x7f8f8415b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 -- 172.21.15.18:0/4089965545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f840cc490 con 0x7f8f841474b0 2024-04-25T10:11:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f88e00640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 0x7f8f8415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:39.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.385+0000 7f8f89800640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0af040 tx=0x7f8f7c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 -- 172.21.15.18:0/4089965545 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0bc020 con 0x7f8f841474b0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 -- 172.21.15.18:0/4089965545 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0b8670 con 0x7f8f841474b0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 -- 172.21.15.18:0/4089965545 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c009510 con 0x7f8f841474b0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f840cc770 con 0x7f8f841474b0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f84162a70 con 0x7f8f841474b0 2024-04-25T10:11:39.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 -- 172.21.15.18:0/4089965545 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8f7c0bf020 con 0x7f8f841474b0 2024-04-25T10:11:39.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 0x7f8f60069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f81600640 1 -- 172.21.15.18:0/4089965545 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8f7c11fff0 con 0x7f8f841474b0 2024-04-25T10:11:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f8ed5d000 1 Processor -- start 2024-04-25T10:11:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f8ed5d000 1 -- start start 2024-04-25T10:11:39.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.389+0000 7f8f88e00640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 0x7f8f60069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f88e00640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 0x7f8f60069450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400b990 tx=0x7f8f74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298379d0 0x558929837db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x5589297edb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55892963aff0 con 0x5589297ee0a0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589295c3150 con 0x5589298382f0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558929637090 con 0x5589298379d0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f88e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298379d0 0x558929837db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35616/0 (socket says 172.21.15.18:35616) 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 -- 172.21.15.18:0/3620975103 learned_addr learned my addr 172.21.15.18:0/3620975103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f7be00640 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x5589297edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 -- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298379d0 msgr2=0x558929837db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298379d0 0x558929837db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 -- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 msgr2=0x5589297edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x5589297edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 -- 172.21.15.18:0/3620975103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589297d10d0 con 0x5589297ee0a0 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f89800640 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0f0500 tx=0x7f8f7c0f0160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843516d8e20bb73c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f79600640 1 -- 172.21.15.18:0/3620975103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0f4950 con 0x5589297ee0a0 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f79600640 1 -- 172.21.15.18:0/3620975103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0f8f10 con 0x5589297ee0a0 2024-04-25T10:11:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f79600640 1 -- 172.21.15.18:0/3620975103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0ece70 con 0x5589297ee0a0 2024-04-25T10:11:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3620975103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 msgr2=0x5589297ee480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0f0500 tx=0x7f8f7c0f0160 comp rx=0 tx=0).stop 2024-04-25T10:11:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3620975103 shutdown_connections 2024-04-25T10:11:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589297ee0a0 0x5589297ee480 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x5589297edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3620975103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298379d0 0x558929837db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3620975103 >> 172.21.15.18:0/3620975103 conn(0x5589297ea020 msgr2=0x5589297ec440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3620975103 shutdown_connections 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3620975103 wait complete. 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 -- start start 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.393+0000 7f8f8ed5d000 1 Processor -- start 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892981c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298379d0 0x55892981cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589295ff250 con 0x5589298382f0 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589295f5690 con 0x5589298379d0 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589295c3a40 con 0x5589297ee0a0 2024-04-25T10:11:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 10 client.0 _ll_register_callbacks cb 0x5589297d8e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f88e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892981c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35630/0 (socket says 172.21.15.18:35630) 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 -- 172.21.15.18:0/217791345 learned_addr learned my addr 172.21.15.18:0/217791345 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f7be00640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298379d0 0x55892981cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 -- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 msgr2=0x55892981c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892981c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 -- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298379d0 msgr2=0x55892981cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298379d0 0x55892981cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 -- 172.21.15.18:0/217791345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589296e81c0 con 0x5589298382f0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f89800640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0f0500 tx=0x7f8f7c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50be54eebcb8354 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c0f0c60 con 0x5589298382f0 2024-04-25T10:11:39.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8f7c0f8a80 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f7c0f8f10 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f7c0f4950 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 10 client.7914 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5589296e4170 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7c0f8f10 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f7c108070 con 0x5589298382f0 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 10 client.7914 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 10 client.7914 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 20 client.7914 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x558929847c80 0x55892984a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 4 client.7914 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589295d6c60 con 0x558929847c80 2024-04-25T10:11:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f88e00640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x558929847c80 0x55892984a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f88e00640 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x558929847c80 0x55892984a070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a64e115705733fed server_cookie=6ddfccb3c872bf55 in_seq=0 out_seq=0 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 10 client.7914 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 1 -- 172.21.15.18:0/217791345 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589295d6c60 con 0x558929847c80 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 10 client.7914 handle_command_reply: tid=0 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 client.7914 shutdown 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 msgr2=0x55892981d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0f0500 tx=0x7f8f7c009810 comp rx=0 tx=0).stop 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 shutdown_connections 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x558929847c80 0x55892984a070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298382f0 0x55892981d270 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298379d0 0x55892981cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f72000640 0 client.7914 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/217791345 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892981c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.397+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 >> 172.21.15.18:0/217791345 conn(0x5589297ea020 msgr2=0x5589297ecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.401+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 shutdown_connections 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.401+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/217791345 wait complete. 2024-04-25T10:11:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.401+0000 7f8f8ed5d000 20 client.7914 trim_cache size 0 max 16384 2024-04-25T10:11:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.413+0000 7f8f8ed5d000 1 Processor -- start 2024-04-25T10:11:39.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- start start 2024-04-25T10:11:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589297ee0a0 0x5589297ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298382f0 0x5589297ed150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84202fc0 con 0x5589298379d0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f842021a0 con 0x5589297ee0a0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f841fa350 con 0x5589298382f0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35632/0 (socket says 172.21.15.18:35632) 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 -- 172.21.15.18:0/3552816969 learned_addr learned my addr 172.21.15.18:0/3552816969 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f89800640 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298382f0 0x5589297ed150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f88e00640 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589297ee0a0 0x5589297ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 -- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298382f0 msgr2=0x5589297ed150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298382f0 0x5589297ed150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 -- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589297ee0a0 msgr2=0x5589297ec410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589297ee0a0 0x5589297ec410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 -- 172.21.15.18:0/3552816969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558929681de0 con 0x5589298379d0 2024-04-25T10:11:39.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f7be00640 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00b500 tx=0x7f8f6c00b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29545212189369f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f78c00640 1 -- 172.21.15.18:0/3552816969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c003a30 con 0x5589298379d0 2024-04-25T10:11:39.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f78c00640 1 -- 172.21.15.18:0/3552816969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c003bd0 con 0x5589298379d0 2024-04-25T10:11:39.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f78c00640 1 -- 172.21.15.18:0/3552816969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c003f80 con 0x5589298379d0 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3552816969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 msgr2=0x5589297ec950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00b500 tx=0x7f8f6c00b9c0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3552816969 shutdown_connections 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589298382f0 0x5589297ed150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x5589297ec950 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/3552816969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589297ee0a0 0x5589297ec410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3552816969 >> 172.21.15.18:0/3552816969 conn(0x5589297ea020 msgr2=0x558929844fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3552816969 shutdown_connections 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/3552816969 wait complete. 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 -- start start 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.417+0000 7f8f8ed5d000 1 Processor -- start 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892984a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x55892984ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589295d5e00 con 0x5589298379d0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f84201bd0 con 0x5589298382f0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55892963a300 con 0x5589297ee0a0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 10 client.0 _ll_register_callbacks cb 0x5589297b9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35646/0 (socket says 172.21.15.18:35646) 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 -- 172.21.15.18:0/173797268 learned_addr learned my addr 172.21.15.18:0/173797268 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f88e00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892984a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f89800640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x55892984ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 -- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 msgr2=0x55892984a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892984a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 -- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 msgr2=0x55892984ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x55892984ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 -- 172.21.15.18:0/173797268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5589295dc8e0 con 0x5589298379d0 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f89800640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x55892984ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f7be00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00ba00 tx=0x7f8f6c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ff74653667eafb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6c01f650 con 0x5589298379d0 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8f6c01f7f0 con 0x5589298379d0 2024-04-25T10:11:39.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f6c003bd0 con 0x5589298379d0 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f6c030050 con 0x5589298379d0 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 10 client.7920 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5589296948f0 con 0x5589298379d0 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6c003bd0 con 0x5589298379d0 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f6c033020 con 0x5589298379d0 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 10 client.7920 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 10 client.7920 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 20 client.7920 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55892984b7f0 0x55892989ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 4 client.7920 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558929648530 con 0x55892984b7f0 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f88e00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55892984b7f0 0x55892989ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f88e00640 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55892984b7f0 0x55892989ff60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685108ca9eeddd48 server_cookie=e95e521db94c968a in_seq=0 out_seq=0 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 10 client.7920 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 1 -- 172.21.15.18:0/173797268 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558929648530 con 0x55892984b7f0 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 10 client.7920 handle_command_reply: tid=0 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 client.7920 shutdown 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 msgr2=0x55892984a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00ba00 tx=0x7f8f6c004740 comp rx=0 tx=0).stop 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 shutdown_connections 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x55892984b7f0 0x55892989ff60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589298382f0 0x55892984ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5589298379d0 0x55892984a8c0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 --2- 172.21.15.18:0/173797268 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5589297ee0a0 0x55892984a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f72000640 0 client.7920 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 >> 172.21.15.18:0/173797268 conn(0x5589297ea020 msgr2=0x5589298360d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 shutdown_connections 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 1 -- 172.21.15.18:0/173797268 wait complete. 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.421+0000 7f8f8ed5d000 20 client.7920 trim_cache size 0 max 16384 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:11:39.435 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:39.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 msgr2=0x7f8f60069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 0x7f8f60069450 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f8f7400b990 tx=0x7f8f74008040 comp rx=0 tx=0).stop 2024-04-25T10:11:39.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 msgr2=0x7f8f840ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c0af040 tx=0x7f8f7c019700 comp rx=0 tx=0).stop 2024-04-25T10:11:39.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 shutdown_connections 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f841474b0 0x7f8f840ce0b0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8f60066f90 0x7f8f60069450 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8f840b3c00 0x7f8f84162530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 --2- 172.21.15.18:0/4089965545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f840714e0 0x7f8f8415b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 >> 172.21.15.18:0/4089965545 conn(0x7f8f840b1660 msgr2=0x7f8f840ac970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 shutdown_connections 2024-04-25T10:11:39.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.425+0000 7f8f8a200640 1 -- 172.21.15.18:0/4089965545 wait complete. 2024-04-25T10:11:39.450 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:11:39.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:39.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 Processor -- start 2024-04-25T10:11:39.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 -- start start 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f473015a6c0 0x7f473015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f47300b3700 0x7f47300d05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 0x7f47300d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473015f0d0 con 0x7f473015a6c0 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473015aaa0 con 0x7f47300b3700 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4736c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300b40e0 con 0x7f47300b3b60 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f473015a6c0 0x7f473015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f473015a6c0 0x7f473015eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35660/0 (socket says 172.21.15.18:35660) 2024-04-25T10:11:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 -- 172.21.15.18:0/1449751487 learned_addr learned my addr 172.21.15.18:0/1449751487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472f400640 1 --2- 172.21.15.18:0/1449751487 >> v2:172.21.15.167:3300/0 conn(0x7f47300b3700 0x7f47300d05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4734c00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 0x7f47300d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 -- 172.21.15.18:0/1449751487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 msgr2=0x7f47300d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 0x7f47300d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 -- 172.21.15.18:0/1449751487 >> v2:172.21.15.167:3300/0 conn(0x7f47300b3700 msgr2=0x7f47300d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 --2- 172.21.15.18:0/1449751487 >> v2:172.21.15.167:3300/0 conn(0x7f47300b3700 0x7f47300d05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f472fe00640 1 -- 172.21.15.18:0/1449751487 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300b43c0 con 0x7f473015a6c0 2024-04-25T10:11:39.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.585+0000 7f4734c00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 0x7f47300d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:39.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f472fe00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f473015a6c0 0x7f473015eb90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f47300b34c0 tx=0x7f472001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=584eb3b64cb7b76f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f472ea00640 1 -- 172.21.15.18:0/1449751487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200b1070 con 0x7f473015a6c0 2024-04-25T10:11:39.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f472ea00640 1 -- 172.21.15.18:0/1449751487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200ac630 con 0x7f473015a6c0 2024-04-25T10:11:39.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f472ea00640 1 -- 172.21.15.18:0/1449751487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200a8050 con 0x7f473015a6c0 2024-04-25T10:11:39.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- 172.21.15.18:0/1449751487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f473015a6c0 msgr2=0x7f473015eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f473015a6c0 0x7f473015eb90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f47300b34c0 tx=0x7f472001c520 comp rx=0 tx=0).stop 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- 172.21.15.18:0/1449751487 shutdown_connections 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47300b3b60 0x7f47300d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 --2- 172.21.15.18:0/1449751487 >> v2:172.21.15.167:3300/0 conn(0x7f47300b3700 0x7f47300d05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 --2- 172.21.15.18:0/1449751487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f473015a6c0 0x7f473015eb90 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- 172.21.15.18:0/1449751487 >> 172.21.15.18:0/1449751487 conn(0x7f47300b2400 msgr2=0x7f47300b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- 172.21.15.18:0/1449751487 shutdown_connections 2024-04-25T10:11:39.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- 172.21.15.18:0/1449751487 wait complete. 2024-04-25T10:11:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 Processor -- start 2024-04-25T10:11:39.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.589+0000 7f4736c00640 1 -- start start 2024-04-25T10:11:39.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47300b3b60 0x7f4730160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f473015a6c0 0x7f4730160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300ceee0 con 0x7f47300b3700 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300ced60 con 0x7f47300b3b60 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47300cf060 con 0x7f473015a6c0 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35670/0 (socket says 172.21.15.18:35670) 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 -- 172.21.15.18:0/366248107 learned_addr learned my addr 172.21.15.18:0/366248107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 -- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f473015a6c0 msgr2=0x7f4730160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f473015a6c0 0x7f4730160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 -- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47300b3b60 msgr2=0x7f4730160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47300b3b60 0x7f4730160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 -- 172.21.15.18:0/366248107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4730152980 con 0x7f47300b3700 2024-04-25T10:11:39.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f472fe00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f47200af040 tx=0x7f47200192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200bc070 con 0x7f47300b3700 2024-04-25T10:11:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200b7430 con 0x7f47300b3700 2024-04-25T10:11:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47200b1040 con 0x7f47300b3700 2024-04-25T10:11:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4730152c20 con 0x7f47300b3700 2024-04-25T10:11:39.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47301531e0 con 0x7f47300b3700 2024-04-25T10:11:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47300745d0 con 0x7f47300b3700 2024-04-25T10:11:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.593+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f47200bf070 con 0x7f47300b3700 2024-04-25T10:11:39.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.597+0000 7f4727e00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 0x7f4710069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.597+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f472011ea30 con 0x7f47300b3700 2024-04-25T10:11:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.597+0000 7f472f400640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 0x7f4710069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.597+0000 7f472f400640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 0x7f4710069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f47301653f0 tx=0x7f471c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.601+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4720016110 con 0x7f47300b3700 2024-04-25T10:11:39.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4730160520 con 0x7f47300b3700 2024-04-25T10:11:39.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4727e00640 1 -- 172.21.15.18:0/366248107 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f47200ef7e0 con 0x7f47300b3700 2024-04-25T10:11:39.804 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:39.805 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:41.488105+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":6,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:39.805 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 70 2024-04-25T10:11:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 msgr2=0x7f4710069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 0x7f4710069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f47301653f0 tx=0x7f471c008040 comp rx=0 tx=0).stop 2024-04-25T10:11:39.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 msgr2=0x7f4730153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f47200af040 tx=0x7f47200192c0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 shutdown_connections 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4710066f60 0x7f4710069420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f473015a6c0 0x7f4730160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47300b3b60 0x7f4730160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 --2- 172.21.15.18:0/366248107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47300b3700 0x7f4730153c70 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 >> 172.21.15.18:0/366248107 conn(0x7f47300b2400 msgr2=0x7f47300738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 shutdown_connections 2024-04-25T10:11:39.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.797+0000 7f4736c00640 1 -- 172.21.15.18:0/366248107 wait complete. 2024-04-25T10:11:39.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T10:11:39.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 Processor -- start 2024-04-25T10:11:39.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 -- start start 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5548144120 0x7f554815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55480ccbf0 0x7f554815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f554815bc40 con 0x7f554815ee60 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554815e490 con 0x7f55480ccbf0 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f554de00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554815b3a0 con 0x7f5548144120 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f553e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55480ccbf0 0x7f554815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f5547400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f554815ee60 0x7f55480b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55168/0 (socket says 172.21.15.18:55168) 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f5547400640 1 -- 172.21.15.18:0/2148990196 learned_addr learned my addr 172.21.15.18:0/2148990196 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f5546a00640 1 --2- 172.21.15.18:0/2148990196 >> v2:172.21.15.167:3300/0 conn(0x7f5548144120 0x7f554815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f553e000640 1 -- 172.21.15.18:0/2148990196 >> v2:172.21.15.167:3300/0 conn(0x7f5548144120 msgr2=0x7f554815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f553e000640 1 --2- 172.21.15.18:0/2148990196 >> v2:172.21.15.167:3300/0 conn(0x7f5548144120 0x7f554815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f553e000640 1 -- 172.21.15.18:0/2148990196 >> v1:172.21.15.18:6789/0 conn(0x7f554815ee60 legacy=0x7f55480b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.961+0000 7f553e000640 1 -- 172.21.15.18:0/2148990196 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554815b680 con 0x7f55480ccbf0 2024-04-25T10:11:39.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f553e000640 1 --2- 172.21.15.18:0/2148990196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55480ccbf0 0x7f554815e920 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f554806b9b0 tx=0x7f553001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a32482fedb517a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f5546000640 1 -- 172.21.15.18:0/2148990196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b0070 con 0x7f55480ccbf0 2024-04-25T10:11:39.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f5546000640 1 -- 172.21.15.18:0/2148990196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55300ab600 con 0x7f55480ccbf0 2024-04-25T10:11:39.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f5546000640 1 -- 172.21.15.18:0/2148990196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab9d0 con 0x7f55480ccbf0 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 -- 172.21.15.18:0/2148990196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55480ccbf0 msgr2=0x7f554815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 --2- 172.21.15.18:0/2148990196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55480ccbf0 0x7f554815e920 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f554806b9b0 tx=0x7f553001c280 comp rx=0 tx=0).stop 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 -- 172.21.15.18:0/2148990196 shutdown_connections 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 --2- 172.21.15.18:0/2148990196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55480ccbf0 0x7f554815e920 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 --2- 172.21.15.18:0/2148990196 >> v2:172.21.15.167:3300/0 conn(0x7f5548144120 0x7f554815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 -- 172.21.15.18:0/2148990196 >> 172.21.15.18:0/2148990196 conn(0x7f5548067080 msgr2=0x7f554806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 -- 172.21.15.18:0/2148990196 shutdown_connections 2024-04-25T10:11:39.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.965+0000 7f554de00640 1 -- 172.21.15.18:0/2148990196 wait complete. 2024-04-25T10:11:39.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 Processor -- start 2024-04-25T10:11:39.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- start start 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55480ccbf0 0x7f554813f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548144120 0x7f55481f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480b37a0 con 0x7f554815ee60 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480cd070 con 0x7f5548144120 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480b3920 con 0x7f55480ccbf0 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35698/0 (socket says 172.21.15.18:35698) 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 -- 172.21.15.18:0/281082120 learned_addr learned my addr 172.21.15.18:0/281082120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f553e000640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548144120 0x7f55481f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5546a00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55480ccbf0 0x7f554813f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 -- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55480ccbf0 msgr2=0x7f554813f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55480ccbf0 0x7f554813f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 -- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548144120 msgr2=0x7f55481f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548144120 0x7f55481f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 -- 172.21.15.18:0/281082120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f554813fd50 con 0x7f554815ee60 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f5547400640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f554000e580 tx=0x7f554000ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f553fe00640 1 -- 172.21.15.18:0/281082120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540016020 con 0x7f554815ee60 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f553fe00640 1 -- 172.21.15.18:0/281082120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540009500 con 0x7f554815ee60 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55480adf60 con 0x7f554815ee60 2024-04-25T10:11:39.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f553fe00640 1 -- 172.21.15.18:0/281082120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400098f0 con 0x7f554815ee60 2024-04-25T10:11:39.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.969+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55480ab150 con 0x7f554815ee60 2024-04-25T10:11:39.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f553fe00640 1 -- 172.21.15.18:0/281082120 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5540019020 con 0x7f554815ee60 2024-04-25T10:11:39.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f553fe00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 0x7f5524069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f553fe00640 1 -- 172.21.15.18:0/281082120 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f5540087ff0 con 0x7f554815ee60 2024-04-25T10:11:39.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 Processor -- start 2024-04-25T10:11:39.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 0x7f5524069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 -- start start 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 0x7f5524069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f55480ad140 tx=0x7f5538008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b855b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b855bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b8442ba0 con 0x5629b85a52e0 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b83a8090 con 0x5629b855b8e0 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b8330160 con 0x5629b85a5c00 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35706/0 (socket says 172.21.15.18:35706) 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 -- 172.21.15.18:0/847269306 learned_addr learned my addr 172.21.15.18:0/847269306 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5547400640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b855bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f553e000640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b855b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 -- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 msgr2=0x5629b855b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b855b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 -- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 msgr2=0x5629b855bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b855bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f5546a00640 1 -- 172.21.15.18:0/847269306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b8451c20 con 0x5629b85a52e0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.973+0000 7f553e000640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b855b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5546a00640 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f553800fa50 tx=0x7f5538012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a44ed0e5d3c54e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5537e00640 1 -- 172.21.15.18:0/847269306 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553801b050 con 0x5629b85a52e0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5537e00640 1 -- 172.21.15.18:0/847269306 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538025070 con 0x5629b85a52e0 2024-04-25T10:11:39.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5537e00640 1 -- 172.21.15.18:0/847269306 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538014e20 con 0x5629b85a52e0 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- 172.21.15.18:0/847269306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 msgr2=0x5629b85a56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f553800fa50 tx=0x7f5538012000 comp rx=0 tx=0).stop 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- 172.21.15.18:0/847269306 shutdown_connections 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b855bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b855b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- 172.21.15.18:0/847269306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85a56c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- 172.21.15.18:0/847269306 >> 172.21.15.18:0/847269306 conn(0x5629b8557890 msgr2=0x5629b8559c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- 172.21.15.18:0/847269306 shutdown_connections 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- 172.21.15.18:0/847269306 wait complete. 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- start start 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 Processor -- start 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b85b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b85974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b83a4130 con 0x5629b85a52e0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b836c130 con 0x5629b855b8e0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b8466300 con 0x5629b85a5c00 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5551286000 10 client.0 _ll_register_callbacks cb 0x5629b8546bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35716/0 (socket says 172.21.15.18:35716) 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 -- 172.21.15.18:0/2508401760 learned_addr learned my addr 172.21.15.18:0/2508401760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5547400640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b85974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f5546a00640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b85b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 -- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 msgr2=0x5629b85974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b85974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 -- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 msgr2=0x5629b85b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b85b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.977+0000 7f553e000640 1 -- 172.21.15.18:0/2508401760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629b8385060 con 0x5629b85a52e0 2024-04-25T10:11:39.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f553e000640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f5530019eb0 tx=0x7f553001aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7639aa07aeea3ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b0040 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f55300c0cf0 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5538025070 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5530006e20 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 10 client.7941 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5629b83497c0 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538025070 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f55300c7050 con 0x5629b85a52e0 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 10 client.7941 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 10 client.7941 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 20 client.7941 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8598210 0x5629b85985f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:39.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 4 client.7941 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:39.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629b8343cd0 con 0x5629b8598210 2024-04-25T10:11:39.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5546a00640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8598210 0x5629b85985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:39.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5546a00640 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8598210 0x5629b85985f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67e02b423cf0f9df server_cookie=377dc140e43edc02 in_seq=0 out_seq=0 2024-04-25T10:11:39.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 10 client.7941 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 1 -- 172.21.15.18:0/2508401760 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5629b8343cd0 con 0x5629b8598210 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 10 client.7941 handle_command_reply: tid=0 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 client.7941 shutdown 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 msgr2=0x5629b85b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f5530019eb0 tx=0x7f553001aac0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 shutdown_connections 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8598210 0x5629b85985f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a5c00 0x5629b85974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b85b0dd0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 --2- 172.21.15.18:0/2508401760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b855b8e0 0x5629b85b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5534c00640 0 client.7941 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 >> 172.21.15.18:0/2508401760 conn(0x5629b8557890 msgr2=0x5629b855a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 shutdown_connections 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 1 -- 172.21.15.18:0/2508401760 wait complete. 2024-04-25T10:11:39.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.981+0000 7f5551286000 20 client.7941 trim_cache size 0 max 16384 2024-04-25T10:11:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 Processor -- start 2024-04-25T10:11:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 -- start start 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b855b8e0 0x5629b8559c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b855a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554815d620 con 0x5629b85a52e0 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55481f57b0 con 0x5629b85a5c00 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.993+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554815d020 con 0x5629b855b8e0 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35726/0 (socket says 172.21.15.18:35726) 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 -- 172.21.15.18:0/2436499534 learned_addr learned my addr 172.21.15.18:0/2436499534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5546a00640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b855b8e0 0x5629b8559c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5547400640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b855a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 -- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b855b8e0 msgr2=0x5629b8559c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b855b8e0 0x5629b8559c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 -- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 msgr2=0x5629b855a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b855a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 -- 172.21.15.18:0/2436499534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629b8363fc0 con 0x5629b85a52e0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5547400640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b855a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f553001a930 tx=0x7f55300b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b2de17a15e4b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5537400640 1 -- 172.21.15.18:0/2436499534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300b0040 con 0x5629b85a52e0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5537400640 1 -- 172.21.15.18:0/2436499534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530000e50 con 0x5629b85a52e0 2024-04-25T10:11:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5537400640 1 -- 172.21.15.18:0/2436499534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55300ab7a0 con 0x5629b85a52e0 2024-04-25T10:11:40.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- 172.21.15.18:0/2436499534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 msgr2=0x5629b855a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f553001a930 tx=0x7f55300b6000 comp rx=0 tx=0).stop 2024-04-25T10:11:40.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- 172.21.15.18:0/2436499534 shutdown_connections 2024-04-25T10:11:40.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b855a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b85a52e0 0x5629b855a1c0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- 172.21.15.18:0/2436499534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b855b8e0 0x5629b8559c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- 172.21.15.18:0/2436499534 >> 172.21.15.18:0/2436499534 conn(0x5629b8557890 msgr2=0x5629b85b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- 172.21.15.18:0/2436499534 shutdown_connections 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- 172.21.15.18:0/2436499534 wait complete. 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- start start 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 Processor -- start 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a52e0 0x5629b86098f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b85bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b8342e70 con 0x5629b855b8e0 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629b8330a50 con 0x5629b85a5c00 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5629b83a73a0 con 0x5629b85a52e0 2024-04-25T10:11:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5551286000 10 client.0 _ll_register_callbacks cb 0x5629b8354240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5546a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5546a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35732/0 (socket says 172.21.15.18:35732) 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5546a00640 1 -- 172.21.15.18:0/2419958654 learned_addr learned my addr 172.21.15.18:0/2419958654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f553e000640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a52e0 0x5629b86098f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:39.997+0000 7f5547400640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b85bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 -- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a52e0 msgr2=0x5629b86098f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a52e0 0x5629b86098f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 -- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 msgr2=0x5629b85bd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b85bd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 -- 172.21.15.18:0/2419958654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629b84019e0 con 0x5629b855b8e0 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5547400640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b85bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:40.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5546a00640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5538022040 tx=0x7f5538004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e453bc02596d1aeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553801b040 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f5538036410 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5530000e50 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5538036610 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 10 client.7947 fetch_fsmap learned FSMap version 70 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x5629b8347630 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5530000e50 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 70) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5538020440 con 0x5629b855b8e0 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 10 client.7947 fetch_fsmap finished waiting for FSMap version 70 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 10 client.7947 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 20 client.7947 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:40.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8610210 0x5629b8612600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 4 client.7947 mds_command: new command op to 7704 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 --> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5629b83b55d0 con 0x5629b8610210 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f553e000640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8610210 0x5629b8612600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f553e000640 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8610210 0x5629b8612600 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b61a2fc98a08b4ba server_cookie=d78d1a9683682098 in_seq=0 out_seq=0 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 10 client.7947 ms_handle_connect on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 1 -- 172.21.15.18:0/2419958654 <== mds.0 v2:172.21.15.18:6833/4209604816 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+143 (crc 0 0 0) 0x5629b83b55d0 con 0x5629b8610210 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 10 client.7947 handle_command_reply: tid=0 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 client.7947 shutdown 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 msgr2=0x5629b86093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f5538022040 tx=0x7f5538004740 comp rx=0 tx=0).stop 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 shutdown_connections 2024-04-25T10:11:40.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:6833/4209604816,v1:172.21.15.18:6835/4209604816] conn(0x5629b8610210 0x5629b8612600 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5629b85a5c00 0x5629b85bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5629b85a52e0 0x5629b86098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5534c00640 0 client.7947 ms_handle_reset on v2:172.21.15.18:6833/4209604816 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 --2- 172.21.15.18:0/2419958654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629b855b8e0 0x5629b86093b0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 >> 172.21.15.18:0/2419958654 conn(0x5629b8557890 msgr2=0x5629b85b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 shutdown_connections 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 1 -- 172.21.15.18:0/2419958654 wait complete. 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f5551286000 20 client.7947 trim_cache size 0 max 16384 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:40.015 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: "damage_type": "backtrace", 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 644364103, 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 1099511627777, 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/testdir/hardlink" 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:40.016 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 msgr2=0x7f5524069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 0x7f5524069420 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f55480ad140 tx=0x7f5538008040 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 msgr2=0x7f55480b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f554000e580 tx=0x7f554000ea40 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 shutdown_connections 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f554815ee60 0x7f55480b12e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548144120 0x7f55481f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5524066f60 0x7f5524069420 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 --2- 172.21.15.18:0/281082120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55480ccbf0 0x7f554813f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 >> 172.21.15.18:0/281082120 conn(0x7f5548067080 msgr2=0x7f55480b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 shutdown_connections 2024-04-25T10:11:40.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.001+0000 7f554de00640 1 -- 172.21.15.18:0/281082120 wait complete. 2024-04-25T10:11:40.029 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:11:40.029 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:11:40.039 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:11:40.039 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:11:40.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:11:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.269+0000 7f24e8a00640 1 Processor -- start 2024-04-25T10:11:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.269+0000 7f24e8a00640 1 -- start start 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cf2b0 0x7f24e40cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e8a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24e40b2760 0x7f24e40cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e8a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e40ada40 con 0x7f24e415b8d0 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e8a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40ccea0 con 0x7f24e40b2760 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e8a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e406afb0 con 0x7f24e40cf2b0 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24e40b2760 0x7f24e40cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24e40b2760 0x7f24e40cfdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35734/0 (socket says 172.21.15.18:35734) 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 -- 172.21.15.18:0/1154430533 learned_addr learned my addr 172.21.15.18:0/1154430533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24d9e00640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cf2b0 0x7f24e40cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 -- 172.21.15.18:0/1154430533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cf2b0 msgr2=0x7f24e40cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cf2b0 0x7f24e40cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 -- 172.21.15.18:0/1154430533 >> v1:172.21.15.167:6789/0 conn(0x7f24e415b8d0 legacy=0x7f24e40ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 -- 172.21.15.18:0/1154430533 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e406b290 con 0x7f24e40b2760 2024-04-25T10:11:40.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e3200640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40cfdf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009870 tx=0x7f24dc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126b0c4f1a3e5061 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e1e00640 1 -- 172.21.15.18:0/1154430533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0b2070 con 0x7f24e40b2760 2024-04-25T10:11:40.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e1e00640 1 -- 172.21.15.18:0/1154430533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc0a9070 con 0x7f24e40b2760 2024-04-25T10:11:40.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.273+0000 7f24e1e00640 1 -- 172.21.15.18:0/1154430533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0ad880 con 0x7f24e40b2760 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- 172.21.15.18:0/1154430533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 msgr2=0x7f24e40cfdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40cfdf0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009870 tx=0x7f24dc01c560 comp rx=0 tx=0).stop 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- 172.21.15.18:0/1154430533 shutdown_connections 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40cfdf0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- 172.21.15.18:0/1154430533 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e40cf2b0 0x7f24e40cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- 172.21.15.18:0/1154430533 >> 172.21.15.18:0/1154430533 conn(0x7f24e4099a60 msgr2=0x7f24e40b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- 172.21.15.18:0/1154430533 shutdown_connections 2024-04-25T10:11:40.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- 172.21.15.18:0/1154430533 wait complete. 2024-04-25T10:11:40.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 Processor -- start 2024-04-25T10:11:40.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- start start 2024-04-25T10:11:40.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 0x7f24e40c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 0x7f24e40c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4168340 con 0x7f24e40b2760 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40cddb0 con 0x7f24e40cf2b0 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e8a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41684c0 con 0x7f24e415b8d0 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35736/0 (socket says 172.21.15.18:35736) 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 -- 172.21.15.18:0/2126499390 learned_addr learned my addr 172.21.15.18:0/2126499390 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e3200640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 0x7f24e40c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24d9e00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 0x7f24e40c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 -- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 msgr2=0x7f24e40c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 0x7f24e40c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 -- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 msgr2=0x7f24e40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 0x7f24e40c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e2800640 1 -- 172.21.15.18:0/2126499390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e40c5d20 con 0x7f24e40b2760 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24d9e00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 0x7f24e40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.277+0000 7f24e3200640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 0x7f24e40c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24e2800640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c500 tx=0x7f24d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4016020 con 0x7f24e40b2760 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d4005220 con 0x7f24e40b2760 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4007030 con 0x7f24e40b2760 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e40c6000 con 0x7f24e40b2760 2024-04-25T10:11:40.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e40c65c0 con 0x7f24e40b2760 2024-04-25T10:11:40.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e404efa0 con 0x7f24e40b2760 2024-04-25T10:11:40.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24d40071f0 con 0x7f24e40b2760 2024-04-25T10:11:40.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 0x7f24c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f24d4084d30 con 0x7f24e40b2760 2024-04-25T10:11:40.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.281+0000 7f24d9e00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 0x7f24c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.285+0000 7f24d9e00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 0x7f24c0069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f24e40b1a70 tx=0x7f24cc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.285+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24d4020020 con 0x7f24e40b2760 2024-04-25T10:11:40.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.449+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24e40ad820 con 0x7f24e40b2760 2024-04-25T10:11:40.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24db400640 1 -- 172.21.15.18:0/2126499390 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17184 (secure 0 0 0) 0x7f24d4055a60 con 0x7f24e40b2760 2024-04-25T10:11:40.460 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:40.460 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:10:38.503360+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 msgr2=0x7f24c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 0x7f24c0069420 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f24e40b1a70 tx=0x7f24cc00b040 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 msgr2=0x7f24e40c6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f24d400c500 tx=0x7f24d400c9c0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 shutdown_connections 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f24c0066f60 0x7f24c0069420 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f24e415b8d0 0x7f24e40c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24e40cf2b0 0x7f24e40c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 --2- 172.21.15.18:0/2126499390 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24e40b2760 0x7f24e40c6ae0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 >> 172.21.15.18:0/2126499390 conn(0x7f24e4099a60 msgr2=0x7f24e4157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 shutdown_connections 2024-04-25T10:11:40.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.453+0000 7f24e8a00640 1 -- 172.21.15.18:0/2126499390 wait complete. 2024-04-25T10:11:40.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:10:18.053140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:10:18.626398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:11:40.481 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:11:40.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.617+0000 7f9f42200640 1 Processor -- start 2024-04-25T10:11:40.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.617+0000 7f9f42200640 1 -- start start 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f42200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 0x7f9f3c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f42200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0b0220 con 0x7f9f3c06b320 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f42200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f3c0b0500 con 0x7f9f3c144090 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f42200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0b07e0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f33e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9f3c06b320 0x7f9f3c0ad4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55170/0 (socket says 172.21.15.18:55170) 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f33e00640 1 -- 172.21.15.18:0/1813313438 learned_addr learned my addr 172.21.15.18:0/1813313438 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:40.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f41800640 1 --2- 172.21.15.18:0/1813313438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 0x7f9f3c0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562095730 0 0) 0x7f9f3c0b0220 con 0x7f9f3c06b320 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f20003530 con 0x7f9f3c06b320 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119330089 0 0) 0x7f9f3c0b0500 con 0x7f9f3c144090 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c0b0220 con 0x7f9f3c144090 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f41800640 1 -- 172.21.15.18:0/1813313438 >> v1:172.21.15.167:6789/0 conn(0x7f9f3c144090 legacy=0x7f9f3c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f41800640 1 -- 172.21.15.18:0/1813313438 >> v1:172.21.15.18:6789/0 conn(0x7f9f3c06b320 legacy=0x7f9f3c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.621+0000 7f9f41800640 1 -- 172.21.15.18:0/1813313438 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c0b0ac0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f41800640 1 --2- 172.21.15.18:0/1813313438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 0x7f9f3c0b0fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009dc0 tx=0x7f9f3401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212d553c49b8fcac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340b2070 con 0x7f9f3c0b3790 2024-04-25T10:11:40.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f340a57c0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f3be00640 1 -- 172.21.15.18:0/1813313438 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f340a5b90 con 0x7f9f3c0b3790 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- 172.21.15.18:0/1813313438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 msgr2=0x7f9f3c0b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 --2- 172.21.15.18:0/1813313438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 0x7f9f3c0b0fe0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009dc0 tx=0x7f9f3401c900 comp rx=0 tx=0).stop 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- 172.21.15.18:0/1813313438 shutdown_connections 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 --2- 172.21.15.18:0/1813313438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c0b3790 0x7f9f3c0b0fe0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- 172.21.15.18:0/1813313438 >> 172.21.15.18:0/1813313438 conn(0x7f9f3c0b5ca0 msgr2=0x7f9f3c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- 172.21.15.18:0/1813313438 shutdown_connections 2024-04-25T10:11:40.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- 172.21.15.18:0/1813313438 wait complete. 2024-04-25T10:11:40.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 Processor -- start 2024-04-25T10:11:40.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.625+0000 7f9f42200640 1 -- start start 2024-04-25T10:11:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c06b320 0x7f9f3c140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f3c144090 0x7f9f3c142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c16bf20 con 0x7f9f3c0b3790 2024-04-25T10:11:40.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c0ae200 con 0x7f9f3c144090 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3c16c0a0 con 0x7f9f3c06b320 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35752/0 (socket says 172.21.15.18:35752) 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 -- 172.21.15.18:0/2778322964 learned_addr learned my addr 172.21.15.18:0/2778322964 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f41800640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f3c144090 0x7f9f3c142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f40e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c06b320 0x7f9f3c140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 -- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c06b320 msgr2=0x7f9f3c140d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c06b320 0x7f9f3c140d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 -- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f3c144090 msgr2=0x7f9f3c142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f3c144090 0x7f9f3c142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 -- 172.21.15.18:0/2778322964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c1419b0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f33e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c450 tx=0x7f9f2400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24017070 con 0x7f9f3c0b3790 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24005cf0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240072b0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c141c90 con 0x7f9f3c0b3790 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f3c142250 con 0x7f9f3c0b3790 2024-04-25T10:11:40.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f3c0745d0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.629+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f2401a070 con 0x7f9f3c0b3790 2024-04-25T10:11:40.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.633+0000 7f9f39600640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 0x7f9f18069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.633+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f9f24084610 con 0x7f9f3c0b3790 2024-04-25T10:11:40.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.633+0000 7f9f40e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 0x7f9f18069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.633+0000 7f9f40e00640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 0x7f9f18069450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0017c0 tx=0x7f9f2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.637+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f24054c50 con 0x7f9f3c0b3790 2024-04-25T10:11:40.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f3c06d210 con 0x7f9f3c0b3790 2024-04-25T10:11:40.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f39600640 1 -- 172.21.15.18:0/2778322964 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f24058cf0 con 0x7f9f3c0b3790 2024-04-25T10:11:40.809 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:11:40.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 msgr2=0x7f9f18069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 0x7f9f18069450 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0017c0 tx=0x7f9f2c009040 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 msgr2=0x7f9f3c1412c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400c450 tx=0x7f9f2400c910 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 shutdown_connections 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9f3c144090 0x7f9f3c142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f3c0b3790 0x7f9f3c1412c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9f18066f90 0x7f9f18069450 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 --2- 172.21.15.18:0/2778322964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9f3c06b320 0x7f9f3c140d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 >> 172.21.15.18:0/2778322964 conn(0x7f9f3c0b5ca0 msgr2=0x7f9f3c06ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 shutdown_connections 2024-04-25T10:11:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.801+0000 7f9f42200640 1 -- 172.21.15.18:0/2778322964 wait complete. 2024-04-25T10:11:40.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:11:40.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.965+0000 7f605ce00640 1 Processor -- start 2024-04-25T10:11:40.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.965+0000 7f605ce00640 1 -- start start 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f605ce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f605815dc60 0x7f60580d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f605ce00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 0x7f60580cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f605ce00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605815e040 con 0x7f605806bf30 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f605ce00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580cff80 con 0x7f605815dc60 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f605ce00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580d0260 con 0x7f605809a170 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f605815dc60 0x7f60580d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f605815dc60 0x7f60580d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35764/0 (socket says 172.21.15.18:35764) 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 -- 172.21.15.18:0/696929933 learned_addr learned my addr 172.21.15.18:0/696929933 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6056800640 1 --2- 172.21.15.18:0/696929933 >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 0x7f60580cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 -- 172.21.15.18:0/696929933 >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 msgr2=0x7f60580cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 --2- 172.21.15.18:0/696929933 >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 0x7f60580cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 -- 172.21.15.18:0/696929933 >> v1:172.21.15.167:6789/0 conn(0x7f605806bf30 legacy=0x7f6058099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:40.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6055e00640 1 -- 172.21.15.18:0/696929933 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60580d0540 con 0x7f605815dc60 2024-04-25T10:11:40.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.969+0000 7f6056800640 1 --2- 172.21.15.18:0/696929933 >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 0x7f60580cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:40.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055e00640 1 --2- 172.21.15.18:0/696929933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605815dc60 0x7f60580d1020 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6058072a70 tx=0x7f604801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4db2233cb0ad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055400640 1 -- 172.21.15.18:0/696929933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480ab620 con 0x7f605815dc60 2024-04-25T10:11:40.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055400640 1 -- 172.21.15.18:0/696929933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480b0070 con 0x7f605815dc60 2024-04-25T10:11:40.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055400640 1 -- 172.21.15.18:0/696929933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480ab9e0 con 0x7f605815dc60 2024-04-25T10:11:40.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- 172.21.15.18:0/696929933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605815dc60 msgr2=0x7f60580d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- 172.21.15.18:0/696929933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605815dc60 0x7f60580d1020 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f6058072a70 tx=0x7f604801c420 comp rx=0 tx=0).stop 2024-04-25T10:11:40.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- 172.21.15.18:0/696929933 shutdown_connections 2024-04-25T10:11:40.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- 172.21.15.18:0/696929933 >> v2:172.21.15.167:3300/0 conn(0x7f605809a170 0x7f60580cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- 172.21.15.18:0/696929933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605815dc60 0x7f60580d1020 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- 172.21.15.18:0/696929933 >> 172.21.15.18:0/696929933 conn(0x7f60580b3200 msgr2=0x7f60580b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- 172.21.15.18:0/696929933 shutdown_connections 2024-04-25T10:11:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- 172.21.15.18:0/696929933 wait complete. 2024-04-25T10:11:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 Processor -- start 2024-04-25T10:11:40.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- start start 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f605809a170 0x7f6058157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f605815dc60 0x7f60580cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580cc6f0 con 0x7f605806bf30 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580cc570 con 0x7f605809a170 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f605ce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60580cc870 con 0x7f605815dc60 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35774/0 (socket says 172.21.15.18:35774) 2024-04-25T10:11:40.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.973+0000 7f6055e00640 1 -- 172.21.15.18:0/3804009633 learned_addr learned my addr 172.21.15.18:0/3804009633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604fe00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f605809a170 0x7f6058157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6056800640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f605815dc60 0x7f60580cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 -- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f605815dc60 msgr2=0x7f60580cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f605815dc60 0x7f60580cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 -- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f605809a170 msgr2=0x7f6058157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f605809a170 0x7f6058157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 -- 172.21.15.18:0/3804009633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058158fd0 con 0x7f605806bf30 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f6055e00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f60480ad040 tx=0x7f604801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480abdb0 con 0x7f605806bf30 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60480be3f0 con 0x7f605806bf30 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60480be7a0 con 0x7f605806bf30 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60581592b0 con 0x7f605806bf30 2024-04-25T10:11:40.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60580c91f0 con 0x7f605806bf30 2024-04-25T10:11:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60580745d0 con 0x7f605806bf30 2024-04-25T10:11:40.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60480b43f0 con 0x7f605806bf30 2024-04-25T10:11:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.977+0000 7f604e000640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 0x7f6034069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.981+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f604811ef10 con 0x7f605806bf30 2024-04-25T10:11:40.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.981+0000 7f604fe00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 0x7f6034069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:40.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.981+0000 7f604fe00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 0x7f6034069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f60580c8770 tx=0x7f6040008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:40.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:40.981+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f60480160d0 con 0x7f605806bf30 2024-04-25T10:11:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.141+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60580b7590 con 0x7f605806bf30 2024-04-25T10:11:41.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f604e000640 1 -- 172.21.15.18:0/3804009633 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60480ef550 con 0x7f605806bf30 2024-04-25T10:11:41.152 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 msgr2=0x7f6034069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 0x7f6034069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f60580c8770 tx=0x7f6040008040 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 msgr2=0x7f60581457e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f60480ad040 tx=0x7f604801ac60 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 shutdown_connections 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6034066f60 0x7f6034069420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f605815dc60 0x7f60580cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f605809a170 0x7f6058157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 --2- 172.21.15.18:0/3804009633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f605806bf30 0x7f60581457e0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 >> 172.21.15.18:0/3804009633 conn(0x7f60580b3200 msgr2=0x7f6058070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 shutdown_connections 2024-04-25T10:11:41.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.145+0000 7f605ce00640 1 -- 172.21.15.18:0/3804009633 wait complete. 2024-04-25T10:11:41.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:11:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 Processor -- start 2024-04-25T10:11:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 -- start start 2024-04-25T10:11:41.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3da015dd90 0x7f3da0071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 0x7f3da00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da0072460 con 0x7f3da0072040 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00b2dc0 con 0x7f3da015dd90 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da6a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da006ac10 con 0x7f3da0161e90 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3da015dd90 0x7f3da0071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3da015dd90 0x7f3da0071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35780/0 (socket says 172.21.15.18:35780) 2024-04-25T10:11:41.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 -- 172.21.15.18:0/3729763237 learned_addr learned my addr 172.21.15.18:0/3729763237 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:41.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 -- 172.21.15.18:0/3729763237 >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 msgr2=0x7f3da00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:41.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da4a00640 1 --2- 172.21.15.18:0/3729763237 >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 0x7f3da00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 --2- 172.21.15.18:0/3729763237 >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 0x7f3da00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 -- 172.21.15.18:0/3729763237 >> v1:172.21.15.167:6789/0 conn(0x7f3da0072040 legacy=0x7f3da0161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3d9fe00640 1 -- 172.21.15.18:0/3729763237 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da006aeb0 con 0x7f3da015dd90 2024-04-25T10:11:41.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.309+0000 7f3da4a00640 1 --2- 172.21.15.18:0/3729763237 >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 0x7f3da00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:41.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3d9fe00640 1 --2- 172.21.15.18:0/3729763237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da0071b00 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f3da0162820 tx=0x7f3d9001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12039db40ebf0629 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3d9f400640 1 -- 172.21.15.18:0/3729763237 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900b2070 con 0x7f3da015dd90 2024-04-25T10:11:41.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3d9f400640 1 -- 172.21.15.18:0/3729763237 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d900ad680 con 0x7f3da015dd90 2024-04-25T10:11:41.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3d9f400640 1 -- 172.21.15.18:0/3729763237 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d900ada50 con 0x7f3da015dd90 2024-04-25T10:11:41.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 -- 172.21.15.18:0/3729763237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 msgr2=0x7f3da0071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 --2- 172.21.15.18:0/3729763237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da0071b00 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f3da0162820 tx=0x7f3d9001c490 comp rx=0 tx=0).stop 2024-04-25T10:11:41.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 -- 172.21.15.18:0/3729763237 shutdown_connections 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 --2- 172.21.15.18:0/3729763237 >> v2:172.21.15.167:3300/0 conn(0x7f3da0161e90 0x7f3da00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 --2- 172.21.15.18:0/3729763237 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da0071b00 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 -- 172.21.15.18:0/3729763237 >> 172.21.15.18:0/3729763237 conn(0x7f3da00cfd90 msgr2=0x7f3da00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 -- 172.21.15.18:0/3729763237 shutdown_connections 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.313+0000 7f3da6a00640 1 -- 172.21.15.18:0/3729763237 wait complete. 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 Processor -- start 2024-04-25T10:11:41.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- start start 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3da0072040 0x7f3da0156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 0x7f3da00b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da016ac40 con 0x7f3da015dd90 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da016aac0 con 0x7f3da0161e90 2024-04-25T10:11:41.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da016adc0 con 0x7f3da0072040 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35782/0 (socket says 172.21.15.18:35782) 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 -- 172.21.15.18:0/2298871037 learned_addr learned my addr 172.21.15.18:0/2298871037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d9fe00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3da0072040 0x7f3da0156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da4a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 0x7f3da00b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 -- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3da0072040 msgr2=0x7f3da0156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3da0072040 0x7f3da0156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 -- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 msgr2=0x7f3da00b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 0x7f3da00b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 -- 172.21.15.18:0/2298871037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00ad7a0 con 0x7f3da015dd90 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da4a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 0x7f3da00b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d97400640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3a0 tx=0x7f3d8800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880052d0 con 0x7f3da015dd90 2024-04-25T10:11:41.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88005470 con 0x7f3da015dd90 2024-04-25T10:11:41.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88007260 con 0x7f3da015dd90 2024-04-25T10:11:41.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da00ada80 con 0x7f3da015dd90 2024-04-25T10:11:41.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da0156d90 con 0x7f3da015dd90 2024-04-25T10:11:41.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.317+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00745d0 con 0x7f3da015dd90 2024-04-25T10:11:41.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.321+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d88007400 con 0x7f3da015dd90 2024-04-25T10:11:41.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.321+0000 7f3d9cc00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 0x7f3d7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.321+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f3d88084670 con 0x7f3da015dd90 2024-04-25T10:11:41.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.321+0000 7f3d9fe00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 0x7f3d7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.321+0000 7f3d9fe00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 0x7f3d7c069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3d900af000 tx=0x7f3d900a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.325+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d88054dd0 con 0x7f3da015dd90 2024-04-25T10:11:41.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.485+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3da0072700 con 0x7f3da015dd90 2024-04-25T10:11:41.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.485+0000 7f3d9cc00640 1 -- 172.21.15.18:0/2298871037 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d88058e70 con 0x7f3da015dd90 2024-04-25T10:11:41.494 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:11:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 msgr2=0x7f3d7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 0x7f3d7c069420 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3d900af000 tx=0x7f3d900a7000 comp rx=0 tx=0).stop 2024-04-25T10:11:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 msgr2=0x7f3da00ae560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c3a0 tx=0x7f3d8800c860 comp rx=0 tx=0).stop 2024-04-25T10:11:41.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 shutdown_connections 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3da0161e90 0x7f3da00b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3da015dd90 0x7f3da00ae560 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3d7c066f60 0x7f3d7c069420 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 --2- 172.21.15.18:0/2298871037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3da0072040 0x7f3da0156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 >> 172.21.15.18:0/2298871037 conn(0x7f3da00cfd90 msgr2=0x7f3da00b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 shutdown_connections 2024-04-25T10:11:41.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.489+0000 7f3da6a00640 1 -- 172.21.15.18:0/2298871037 wait complete. 2024-04-25T10:11:41.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:11:41.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 Processor -- start 2024-04-25T10:11:41.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 -- start start 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 0x7fb12015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb12015f440 0x7fb12006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12015fc00 con 0x7fb12006e010 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12006d640 con 0x7fb12015f440 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb124a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12015fee0 con 0x7fb120159320 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb115400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb12015f440 0x7fb12006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb11e800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb12006e010 0x7fb12006e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57062/0 (socket says 172.21.15.18:57062) 2024-04-25T10:11:41.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb11e800640 1 -- 172.21.15.18:0/3216676623 learned_addr learned my addr 172.21.15.18:0/3216676623 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:41.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb11de00640 1 --2- 172.21.15.18:0/3216676623 >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 0x7fb12015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb115400640 1 -- 172.21.15.18:0/3216676623 >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 msgr2=0x7fb12015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:41.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb115400640 1 --2- 172.21.15.18:0/3216676623 >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 0x7fb12015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb115400640 1 -- 172.21.15.18:0/3216676623 >> v1:172.21.15.18:6789/0 conn(0x7fb12006e010 legacy=0x7fb12006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb11d400640 1 -- 172.21.15.18:0/3216676623 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545895249 0 0) 0x7fb12015fc00 con 0x7fb12006e010 2024-04-25T10:11:41.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb115400640 1 -- 172.21.15.18:0/3216676623 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1201601c0 con 0x7fb12015f440 2024-04-25T10:11:41.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.649+0000 7fb11de00640 1 --2- 172.21.15.18:0/3216676623 >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 0x7fb12015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:41.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb115400640 1 --2- 172.21.15.18:0/3216676623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb12015f440 0x7fb12006dad0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fb12006e470 tx=0x7fb10801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f0cdb01cde33a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb11d400640 1 -- 172.21.15.18:0/3216676623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080b1070 con 0x7fb12015f440 2024-04-25T10:11:41.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb11d400640 1 -- 172.21.15.18:0/3216676623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080a8050 con 0x7fb12015f440 2024-04-25T10:11:41.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb11d400640 1 -- 172.21.15.18:0/3216676623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080ac860 con 0x7fb12015f440 2024-04-25T10:11:41.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 -- 172.21.15.18:0/3216676623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb12015f440 msgr2=0x7fb12006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 --2- 172.21.15.18:0/3216676623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb12015f440 0x7fb12006dad0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fb12006e470 tx=0x7fb10801c3c0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 -- 172.21.15.18:0/3216676623 shutdown_connections 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 --2- 172.21.15.18:0/3216676623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb12015f440 0x7fb12006dad0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 --2- 172.21.15.18:0/3216676623 >> v2:172.21.15.167:3300/0 conn(0x7fb120159320 0x7fb12015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 -- 172.21.15.18:0/3216676623 >> 172.21.15.18:0/3216676623 conn(0x7fb120067080 msgr2=0x7fb12006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 -- 172.21.15.18:0/3216676623 shutdown_connections 2024-04-25T10:11:41.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.653+0000 7fb124a00640 1 -- 172.21.15.18:0/3216676623 wait complete. 2024-04-25T10:11:41.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 Processor -- start 2024-04-25T10:11:41.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- start start 2024-04-25T10:11:41.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 0x7fb120141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 0x7fb120160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120071c00 con 0x7fb120159320 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb120071a80 con 0x7fb12006e010 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12006ebb0 con 0x7fb12015f440 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40238/0 (socket says 172.21.15.18:40238) 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 -- 172.21.15.18:0/159566311 learned_addr learned my addr 172.21.15.18:0/159566311 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb11de00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 0x7fb120141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb11e800640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 0x7fb120160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 -- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 msgr2=0x7fb120160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 0x7fb120160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 -- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 msgr2=0x7fb120141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 0x7fb120141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 -- 172.21.15.18:0/159566311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120163260 con 0x7fb120159320 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb11de00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 0x7fb120141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb11e800640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 0x7fb120160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb115400640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb108018fd0 tx=0x7fb10801ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080b1040 con 0x7fb120159320 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1080acc10 con 0x7fb120159320 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb120163510 con 0x7fb120159320 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080b7450 con 0x7fb120159320 2024-04-25T10:11:41.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.657+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb120163ad0 con 0x7fb120159320 2024-04-25T10:11:41.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1200745d0 con 0x7fb120159320 2024-04-25T10:11:41.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1080be030 con 0x7fb120159320 2024-04-25T10:11:41.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb116a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 0x7fb0fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:41.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fb10811ed10 con 0x7fb120159320 2024-04-25T10:11:41.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb11de00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 0x7fb0fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:41.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.661+0000 7fb11de00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 0x7fb0fc069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb11000d430 tx=0x7fb110007530 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:41.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.665+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb108124020 con 0x7fb120159320 2024-04-25T10:11:41.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.837+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb12006ad40 con 0x7fb120159320 2024-04-25T10:11:41.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.837+0000 7fb116a00640 1 -- 172.21.15.18:0/159566311 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v96) v1 ==== 80+0+122 (secure 0 0 0) 0x7fb1080c5060 con 0x7fb120159320 2024-04-25T10:11:41.846 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6835/2607538595 2024-04-26T10:10:30.461064+0000 2024-04-25T10:11:41.846 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6833/2607538595 2024-04-26T10:10:30.461064+0000 2024-04-25T10:11:41.846 INFO:teuthology.orchestra.run.smithi018.stderr:listed 2 entries 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 msgr2=0x7fb0fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 0x7fb0fc069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb11000d430 tx=0x7fb110007530 comp rx=0 tx=0).stop 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 msgr2=0x7fb1200b16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fb108018fd0 tx=0x7fb10801ac00 comp rx=0 tx=0).stop 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 shutdown_connections 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0fc066f60 0x7fb0fc069420 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb12015f440 0x7fb120160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb120159320 0x7fb1200b16a0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 --2- 172.21.15.18:0/159566311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb12006e010 0x7fb120141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 >> 172.21.15.18:0/159566311 conn(0x7fb120067080 msgr2=0x7fb12006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 shutdown_connections 2024-04-25T10:11:41.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:41.841+0000 7fb124a00640 1 -- 172.21.15.18:0/159566311 wait complete. 2024-04-25T10:11:41.867 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:11:41.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:41.867 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:11:41.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:11:41.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:41.894 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:11:41.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:42.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.117+0000 7fd378e00640 1 Processor -- start 2024-04-25T10:11:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.117+0000 7fd378e00640 1 -- start start 2024-04-25T10:11:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd378e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd37415fe50 0x7fd3740b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd378e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 0x7fd37415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd378e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3740cc4e0 con 0x7fd374145270 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd378e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd374145650 con 0x7fd37415fe50 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd378e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3741602b0 con 0x7fd3740b1c90 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd371e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd374145270 0x7fd3740cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57074/0 (socket says 172.21.15.18:57074) 2024-04-25T10:11:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd371e00640 1 -- 172.21.15.18:0/3630302318 learned_addr learned my addr 172.21.15.18:0/3630302318 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd372800640 1 --2- 172.21.15.18:0/3630302318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 0x7fd37415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd36be00640 1 --2- 172.21.15.18:0/3630302318 >> v2:172.21.15.167:3300/0 conn(0x7fd37415fe50 0x7fd3740b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442390873 0 0) 0x7fd3740cc4e0 con 0x7fd374145270 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd358003530 con 0x7fd374145270 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd372800640 1 -- 172.21.15.18:0/3630302318 >> v2:172.21.15.167:3300/0 conn(0x7fd37415fe50 msgr2=0x7fd3740b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd372800640 1 --2- 172.21.15.18:0/3630302318 >> v2:172.21.15.167:3300/0 conn(0x7fd37415fe50 0x7fd3740b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd372800640 1 -- 172.21.15.18:0/3630302318 >> v1:172.21.15.18:6789/0 conn(0x7fd374145270 legacy=0x7fd3740cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2135159371 0 0) 0x7fd358003530 con 0x7fd374145270 2024-04-25T10:11:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.121+0000 7fd372800640 1 -- 172.21.15.18:0/3630302318 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740ce040 con 0x7fd3740b1c90 2024-04-25T10:11:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd372800640 1 --2- 172.21.15.18:0/3630302318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 0x7fd37415bd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009d90 tx=0x7fd36c01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af408d19b0df96d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0b2070 con 0x7fd3740b1c90 2024-04-25T10:11:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0a5580 con 0x7fd3740b1c90 2024-04-25T10:11:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd371400640 1 -- 172.21.15.18:0/3630302318 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364001680 con 0x7fd3740b1c90 2024-04-25T10:11:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- 172.21.15.18:0/3630302318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 msgr2=0x7fd37415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 --2- 172.21.15.18:0/3630302318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 0x7fd37415bd80 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009d90 tx=0x7fd36c01c890 comp rx=0 tx=0).stop 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- 172.21.15.18:0/3630302318 shutdown_connections 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 --2- 172.21.15.18:0/3630302318 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd3740b1c90 0x7fd37415bd80 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 --2- 172.21.15.18:0/3630302318 >> v2:172.21.15.167:3300/0 conn(0x7fd37415fe50 0x7fd3740b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- 172.21.15.18:0/3630302318 >> 172.21.15.18:0/3630302318 conn(0x7fd374066fa0 msgr2=0x7fd37406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- 172.21.15.18:0/3630302318 shutdown_connections 2024-04-25T10:11:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- 172.21.15.18:0/3630302318 wait complete. 2024-04-25T10:11:42.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 Processor -- start 2024-04-25T10:11:42.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.125+0000 7fd378e00640 1 -- start start 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3740b1c90 0x7fd3741f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd37415fe50 0x7fd37415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740cdbe0 con 0x7fd374145270 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37415f930 con 0x7fd3740b1c90 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3740cdd60 con 0x7fd37415fe50 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40244/0 (socket says 172.21.15.18:40244) 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 -- 172.21.15.18:0/3511875973 learned_addr learned my addr 172.21.15.18:0/3511875973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd372800640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd37415fe50 0x7fd37415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd371e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3740b1c90 0x7fd3741f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 -- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd37415fe50 msgr2=0x7fd37415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd37415fe50 0x7fd37415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 -- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3740b1c90 msgr2=0x7fd3741f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3740b1c90 0x7fd3741f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 -- 172.21.15.18:0/3511875973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3740b1220 con 0x7fd374145270 2024-04-25T10:11:42.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36be00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00e870 tx=0x7fd35c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c017070 con 0x7fd374145270 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd35c00c8e0 con 0x7fd374145270 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd35c00cc90 con 0x7fd374145270 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3740ae1e0 con 0x7fd374145270 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3740b1a60 con 0x7fd374145270 2024-04-25T10:11:42.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3740745d0 con 0x7fd374145270 2024-04-25T10:11:42.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.129+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd35c01a070 con 0x7fd374145270 2024-04-25T10:11:42.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.133+0000 7fd36a000640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 0x7fd350069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.133+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fd35c084ff0 con 0x7fd374145270 2024-04-25T10:11:42.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.133+0000 7fd371e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 0x7fd350069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.133+0000 7fd371e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 0x7fd350069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd3741f9c90 tx=0x7fd364009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.137+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3740b1220 con 0x7fd374145270 2024-04-25T10:11:42.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd37406b8e0 con 0x7fd374145270 2024-04-25T10:11:42.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd36a000640 1 -- 172.21.15.18:0/3511875973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fd35c055790 con 0x7fd374145270 2024-04-25T10:11:42.341 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:42.341 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:10:41.488105+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":94,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7704},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7704":{"gid":7704,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":6,"addr":"172.21.15.18:6835/4209604816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4209604816},{"type":"v1","addr":"172.21.15.18:6835","nonce":4209604816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:42.341 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 70 2024-04-25T10:11:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 msgr2=0x7fd350069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 0x7fd350069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fd3741f9c90 tx=0x7fd364009040 comp rx=0 tx=0).stop 2024-04-25T10:11:42.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 msgr2=0x7fd37415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fd35c00e870 tx=0x7fd35c00ec70 comp rx=0 tx=0).stop 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 shutdown_connections 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd350066f60 0x7fd350069420 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd37415fe50 0x7fd37415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd374145270 0x7fd37415a6b0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 --2- 172.21.15.18:0/3511875973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd3740b1c90 0x7fd3741f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 >> 172.21.15.18:0/3511875973 conn(0x7fd374066fa0 msgr2=0x7fd3740b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 shutdown_connections 2024-04-25T10:11:42.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.333+0000 7fd378e00640 1 -- 172.21.15.18:0/3511875973 wait complete. 2024-04-25T10:11:42.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T10:11:42.532 INFO:teuthology.orchestra.run.smithi018.stdout:{"message":"","return_code":0} 2024-04-25T10:11:42.533 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:11:42.533 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:11:42.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 Processor -- start 2024-04-25T10:11:42.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 -- start start 2024-04-25T10:11:42.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5afc159320 0x7f5afc15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5afc15f440 0x7f5afc06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5afc15fc00 con 0x7f5afc06e010 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc06d640 con 0x7f5afc15f440 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b03400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5afc15fee0 con 0x7f5afc159320 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5afc15f440 0x7f5afc06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5afc15f440 0x7f5afc06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40260/0 (socket says 172.21.15.18:40260) 2024-04-25T10:11:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 -- 172.21.15.18:0/1212022356 learned_addr learned my addr 172.21.15.18:0/1212022356 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5b00a00640 1 --2- 172.21.15.18:0/1212022356 >> v2:172.21.15.167:3300/0 conn(0x7f5afc159320 0x7f5afc15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 -- 172.21.15.18:0/1212022356 >> v2:172.21.15.167:3300/0 conn(0x7f5afc159320 msgr2=0x7f5afc15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 --2- 172.21.15.18:0/1212022356 >> v2:172.21.15.167:3300/0 conn(0x7f5afc159320 0x7f5afc15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 -- 172.21.15.18:0/1212022356 >> v1:172.21.15.18:6789/0 conn(0x7f5afc06e010 legacy=0x7f5afc06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.669+0000 7f5afbe00640 1 -- 172.21.15.18:0/1212022356 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc1601c0 con 0x7f5afc15f440 2024-04-25T10:11:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5afbe00640 1 --2- 172.21.15.18:0/1212022356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc15f440 0x7f5afc06dad0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5afc06e470 tx=0x7f5ae801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d562517afe377b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5afb400640 1 -- 172.21.15.18:0/1212022356 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80ab680 con 0x7f5afc15f440 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5afb400640 1 -- 172.21.15.18:0/1212022356 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae80b0070 con 0x7f5afc15f440 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5afb400640 1 -- 172.21.15.18:0/1212022356 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae80aba40 con 0x7f5afc15f440 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 -- 172.21.15.18:0/1212022356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc15f440 msgr2=0x7f5afc06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 --2- 172.21.15.18:0/1212022356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc15f440 0x7f5afc06dad0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f5afc06e470 tx=0x7f5ae801c460 comp rx=0 tx=0).stop 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 -- 172.21.15.18:0/1212022356 shutdown_connections 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 --2- 172.21.15.18:0/1212022356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc15f440 0x7f5afc06dad0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 --2- 172.21.15.18:0/1212022356 >> v2:172.21.15.167:3300/0 conn(0x7f5afc159320 0x7f5afc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 -- 172.21.15.18:0/1212022356 >> 172.21.15.18:0/1212022356 conn(0x7f5afc067080 msgr2=0x7f5afc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 -- 172.21.15.18:0/1212022356 shutdown_connections 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 -- 172.21.15.18:0/1212022356 wait complete. 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.673+0000 7f5b03400640 1 Processor -- start 2024-04-25T10:11:42.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- start start 2024-04-25T10:11:42.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5afc159320 0x7f5afc0b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5afc15f440 0x7f5afc0b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc071c00 con 0x7f5afc06e010 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc071a80 con 0x7f5afc15f440 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5afc06ebb0 con 0x7f5afc159320 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40264/0 (socket says 172.21.15.18:40264) 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 -- 172.21.15.18:0/1172842391 learned_addr learned my addr 172.21.15.18:0/1172842391 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b01400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5afc15f440 0x7f5afc0b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5afbe00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5afc159320 0x7f5afc0b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 -- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5afc159320 msgr2=0x7f5afc0b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5afc159320 0x7f5afc0b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 -- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5afc15f440 msgr2=0x7f5afc0b2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5afc15f440 0x7f5afc0b2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 -- 172.21.15.18:0/1172842391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc12f6a0 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b00a00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d830 tx=0x7f5af000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000b6c0 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af0019070 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af000ba60 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5afc12f980 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5afc12cd80 con 0x7f5afc06e010 2024-04-25T10:11:42.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.677+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5afc0745d0 con 0x7f5afc06e010 2024-04-25T10:11:42.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.681+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5af001e460 con 0x7f5afc06e010 2024-04-25T10:11:42.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.681+0000 7f5af8c00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 0x7f5adc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.681+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f5af0085950 con 0x7f5afc06e010 2024-04-25T10:11:42.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.681+0000 7f5afbe00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 0x7f5adc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.681+0000 7f5afbe00640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 0x7f5adc069450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af000 tx=0x7f5ae80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.685+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5af0056700 con 0x7f5afc06e010 2024-04-25T10:11:42.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.881+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5afc0b44f0 con 0x7f5afc06e010 2024-04-25T10:11:42.889 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:11:42.881+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:11:42.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5af8c00640 1 -- 172.21.15.18:0/1172842391 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5af0056000 con 0x7f5afc06e010 2024-04-25T10:11:42.891 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 msgr2=0x7f5adc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 0x7f5adc069450 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80af000 tx=0x7f5ae80a7000 comp rx=0 tx=0).stop 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 msgr2=0x7f5afc158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5af000d830 tx=0x7f5af000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 shutdown_connections 2024-04-25T10:11:42.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5afc15f440 0x7f5afc0b2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5adc066f90 0x7f5adc069450 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5afc159320 0x7f5afc0b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 --2- 172.21.15.18:0/1172842391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5afc06e010 0x7f5afc158200 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.885+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 >> 172.21.15.18:0/1172842391 conn(0x7f5afc067080 msgr2=0x7f5afc0cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.889+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 shutdown_connections 2024-04-25T10:11:42.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.889+0000 7f5b03400640 1 -- 172.21.15.18:0/1172842391 wait complete. 2024-04-25T10:11:42.905 INFO:tasks.ceph.mds.c.smithi018.stderr: -4241> 2024-04-25T10:10:37.149+0000 7fc11e800640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T10:11:42.905 INFO:tasks.ceph.mds.c.smithi018.stderr: -4083> 2024-04-25T10:10:37.385+0000 7fc11e800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0) n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55bc8baf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T10:11:42.909 INFO:tasks.ceph.mds.c.smithi018.stderr: -2227> 2024-04-25T10:11:08.989+0000 7fc11e800640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv20 ap=3 DIRTYPARENT f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)->f(v1 m2024-04-25T10:10:27.322017+0000) n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)->n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55bc8baf5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T10:10:27.322017+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T10:10:27.430016+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T10:11:42.915 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T10:11:42.951 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:11:42.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- start start 2024-04-25T10:11:42.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 Processor -- start 2024-04-25T10:11:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 0x55697de4a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697dc91000 0x55697de4b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8e600 con 0x55697dc91400 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8e480 con 0x55697dc91000 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8e300 con 0x55697dc91800 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40284/0 (socket says 172.21.15.18:40284) 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 -- 172.21.15.18:0/3211365987 learned_addr learned my addr 172.21.15.18:0/3211365987 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb900800640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697dc91000 0x55697de4b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 0x55697de4a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 -- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 msgr2=0x55697de4a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 0x55697de4a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 -- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697dc91000 msgr2=0x55697de4b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697dc91000 0x55697de4b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 -- 172.21.15.18:0/3211365987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697dcb61e0 con 0x55697dc91400 2024-04-25T10:11:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 0x55697de4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8ff400640 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55697ead1b60 tx=0x55697dd54de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930f3047481aed8f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8fcc00640 1 -- 172.21.15.18:0/3211365987 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc64e0 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8fcc00640 1 -- 172.21.15.18:0/3211365987 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55697dcda1c0 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8fcc00640 1 -- 172.21.15.18:0/3211365987 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc6b60 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55697dcb74a0 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55697dcb7a40 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 4 waiting for MDS map... 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8fcc00640 1 -- 172.21.15.18:0/3211365987 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x55697ebb2600 con 0x55697dc91400 2024-04-25T10:11:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb8fcc00640 1 -- 172.21.15.18:0/3211365987 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 71) v1 ==== 2723+0+0 (secure 0 0 0) 0x55697dce7180 con 0x55697dc91400 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 4 Got MDS map 71 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 4 datascan.main: Using metadata pool output 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.953+0000 7fb901cb58c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 Processor -- start 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- start start 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d000 0x55697de4bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8e180 con 0x55697ea5d400 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dcf0480 con 0x55697ea5cc00 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55697dcf0900 con 0x55697ea5d000 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40298/0 (socket says 172.21.15.18:40298) 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 -- 172.21.15.18:0/2059922274 learned_addr learned my addr 172.21.15.18:0/2059922274 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d000 0x55697de4bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb900800640 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 -- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d000 msgr2=0x55697de4bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d000 0x55697de4bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 -- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 msgr2=0x55697de4b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 -- 172.21.15.18:0/2059922274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697dcb7c20 con 0x55697ea5d400 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55697eba4f60 tx=0x55697dd6b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2cb3a542db798 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8fa400640 1 -- 172.21.15.18:0/2059922274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc6340 con 0x55697ea5d400 2024-04-25T10:11:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8fa400640 1 -- 172.21.15.18:0/2059922274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55697dcdac40 con 0x55697ea5d400 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb8fa400640 1 -- 172.21.15.18:0/2059922274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc64e0 con 0x55697ea5d400 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2059922274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 msgr2=0x55697de4c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55697eba4f60 tx=0x55697dd6b3e0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2059922274 shutdown_connections 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d400 0x55697de4c100 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d000 0x55697de4bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2059922274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2059922274 >> 172.21.15.18:0/2059922274 conn(0x55697dc90c00 msgr2=0x55697dcbd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2059922274 shutdown_connections 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2059922274 wait complete. 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 Processor -- start 2024-04-25T10:11:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.957+0000 7fb901cb58c0 1 -- start start 2024-04-25T10:11:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d400 0x55697de4c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8f380 con 0x55697ea5d000 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8f500 con 0x55697ea5cc00 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55697dd8e180 con 0x55697ea5d400 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40310/0 (socket says 172.21.15.18:40310) 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 learned_addr learned my addr 172.21.15.18:0/2643202274 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d400 0x55697de4c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d400 msgr2=0x55697de4c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d400 0x55697de4c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 msgr2=0x55697de4d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697dcb61e0 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697ea5cc00 0x55697de4d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697ea5d400 0x55697de4c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55697ead10b0 tx=0x55697dd32000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8f8600640 1 -- 172.21.15.18:0/2643202274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc69c0 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8f8600640 1 -- 172.21.15.18:0/2643202274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55697dcdaa80 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8f8600640 1 -- 172.21.15.18:0/2643202274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55697dcc6340 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55697dcb74a0 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55697dcb7e00 con 0x55697ea5d000 2024-04-25T10:11:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb901cb58c0 4 datascan.init: resolving metadata pool 13 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.961+0000 7fb8f8600640 1 -- 172.21.15.18:0/2643202274 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55697ec18c00 con 0x55697ea5d000 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8f8600640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 0x55697de4d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8f8600640 1 -- 172.21.15.18:0/2643202274 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x55697dfce400 con 0x55697ea5d000 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb901cb58c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb901cb58c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb901cb58c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55697ea5d800 0x55697de4c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5dc00 con 0x55697ea5d800 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 0x55697de4d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55697ea5d800 0x55697de4c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55697ea5d800 0x55697de4c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 0x55697de4d700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55697dd6d050 tx=0x55697e0c2000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(1 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8f9a00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55697e0b7000 0x55697e0cc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7400 con 0x55697e0b7000 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55697e0b7000 0x55697e0cc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.965+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55697e0b7000 0x55697e0cc000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(2 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8fa400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55697e0b7c00 0x55697e0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0000 con 0x55697e0b7c00 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55697e0b7c00 0x55697e0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55697e0b7c00 0x55697e0cc580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(3 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7800 con 0x55697e0b7000 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(4 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0b7000 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(5 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8f9a00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55697e0b6c00 0x55697e0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.969+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7400 con 0x55697e0b6c00 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55697e0b6c00 0x55697e0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55697e0b6c00 0x55697e0ccb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(6 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0b7c00 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(7 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7800 con 0x55697e0b7c00 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(8 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8fa400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55697e0d0800 0x55697e0cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0c00 con 0x55697e0d0800 2024-04-25T10:11:42.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.973+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55697e0d0800 0x55697e0cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55697e0d0800 0x55697e0cd600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(9 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0d0800 2024-04-25T10:11:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1000 con 0x55697e0b7c00 2024-04-25T10:11:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(10 [pgnls start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:42.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8fa400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55697e0d0000 0x55697e0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0d0000 2024-04-25T10:11:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55697e0d0000 0x55697e0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ffe00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55697e0d0000 0x55697e0cdb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(11 [pgnls start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1400 con 0x55697ea5d800 2024-04-25T10:11:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(12 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:42.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7800 con 0x55697e0b7000 2024-04-25T10:11:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(13 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8f9a00640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55697e0d1800 0x55697e0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1c00 con 0x55697e0d1800 2024-04-25T10:11:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.977+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55697e0d1800 0x55697e0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8ff400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55697e0d1800 0x55697e0cd080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(14 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea61400 con 0x55697e0b7000 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(15 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1400 con 0x55697e0b7c00 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(16 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:42.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1000 con 0x55697e0d0800 2024-04-25T10:11:42.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(17 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0d0800 2024-04-25T10:11:42.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.981+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7400 con 0x55697e0d0000 2024-04-25T10:11:42.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(18 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8000 con 0x55697ea5d800 2024-04-25T10:11:42.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(19 [pgnls start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:42.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5c400 con 0x55697e0d0000 2024-04-25T10:11:42.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(20 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8400 con 0x55697e0d1800 2024-04-25T10:11:42.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(21 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:42.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5c800 con 0x55697e0d0000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(22 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8800 con 0x55697e0b7000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(23 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5dc00 con 0x55697e0b7000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(24 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8c00 con 0x55697e0b7000 2024-04-25T10:11:42.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(25 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:42.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8800 con 0x55697e0d0000 2024-04-25T10:11:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(26 [pgnls start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9000 con 0x55697e0b6c00 2024-04-25T10:11:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(27 [pgnls start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.985+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9800 con 0x55697ea5d800 2024-04-25T10:11:42.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(28 [pgnls start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9400 con 0x55697e0d0000 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(29 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0c00 con 0x55697e0b6c00 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(30 [pgnls start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8fa400640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55697ea5c400 0x55697e0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5c800 con 0x55697ea5c400 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55697ea5c400 0x55697e0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:42.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.989+0000 7fb900800640 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55697ea5c400 0x55697e0ce100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:42.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(31 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697ea5c400 2024-04-25T10:11:42.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1000 con 0x55697e0d1800 2024-04-25T10:11:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(32 [pgnls start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7400 con 0x55697e0b6c00 2024-04-25T10:11:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(33 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:43.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea61400 con 0x55697e0d1800 2024-04-25T10:11:43.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(34 [pgnls start_epoch 97 out=49b] v93'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1c00 con 0x55697e0d0000 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 7 ==== osd_op_reply(35 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7800 con 0x55697e0b7c00 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(36 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0c00 con 0x55697e0d1800 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(37 [pgnls start_epoch 97 out=49b] v93'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8000 con 0x55697e0d0800 2024-04-25T10:11:43.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(38 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0d0800 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0d0800 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(39 [pgnls start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0d0800 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.993+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8400 con 0x55697ea5c400 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(40 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697ea5c400 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1400 con 0x55697e0b7000 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 9 ==== osd_op_reply(41 [pgnls start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9000 con 0x55697ea5d800 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 5 ==== osd_op_reply(42 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:43.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8c00 con 0x55697ea5c400 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(43 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697ea5c400 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9800 con 0x55697e0d0000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 8 ==== osd_op_reply(44 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8000 con 0x55697e0d0800 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(45 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0d0800 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8800 con 0x55697e0d0000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 9 ==== osd_op_reply(46 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e8400 con 0x55697e0b7000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 10 ==== osd_op_reply(47 [pgnls start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0e9c00 con 0x55697e0b6c00 2024-04-25T10:11:43.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 5 ==== osd_op_reply(48 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:43.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0b7000 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 11 ==== osd_op_reply(49 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f8000 con 0x55697ea5c400 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(50 [pgnls start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697ea5c400 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:42.997+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5dc00 con 0x55697ea5d800 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.2 v2:172.21.15.18:6816/2456241268 6 ==== osd_op_reply(51 [pgnls start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697ea5d800 2024-04-25T10:11:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f8400 con 0x55697e0b7c00 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(52 [pgnls start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5c800 con 0x55697e0b7000 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 12 ==== osd_op_reply(53 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f8800 con 0x55697e0d0000 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 10 ==== osd_op_reply(54 [pgnls start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1c00 con 0x55697e0b7c00 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(55 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f8c00 con 0x55697e0d0000 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 11 ==== osd_op_reply(56 [pgnls start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1400 con 0x55697e0d1800 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(57 [pgnls start_epoch 97 out=81b] v93'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5c800 con 0x55697e0d1800 2024-04-25T10:11:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb901cb58c0 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T10:11:43.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.001+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea5dc00 con 0x55697e0d1800 2024-04-25T10:11:43.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(59 10000000001.00000000 [call] v97'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d1000 con 0x55697e0d1800 2024-04-25T10:11:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.5 v2:172.21.15.167:6824/2931035891 9 ==== osd_op_reply(60 [pgnls start_epoch 97 out=49b] v93'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0d1800 2024-04-25T10:11:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0d0400 con 0x55697e0b7c00 2024-04-25T10:11:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.1 v2:172.21.15.18:6808/600232426 9 ==== osd_op_reply(61 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0b7c00 2024-04-25T10:11:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f9000 con 0x55697e0d0000 2024-04-25T10:11:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 <== osd.4 v2:172.21.15.167:6800/3323785626 12 ==== osd_op_reply(62 [pgnls start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0780 con 0x55697e0d0000 2024-04-25T10:11:43.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697ea61400 con 0x55697ea5c400 2024-04-25T10:11:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(63 [pgnls start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697ea5c400 2024-04-25T10:11:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f9400 con 0x55697e0b7000 2024-04-25T10:11:43.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 13 ==== osd_op_reply(64 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8fa400640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0b7800 con 0x55697e0b7000 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb900800640 1 -- 172.21.15.18:0/2643202274 <== osd.0 v2:172.21.15.18:6800/3884042883 14 ==== osd_op_reply(65 [pgnls start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0500 con 0x55697e0b7000 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8f9a00640 1 -- 172.21.15.18:0/2643202274 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55697e0f9800 con 0x55697e0b6c00 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.005+0000 7fb8ff400640 1 -- 172.21.15.18:0/2643202274 <== osd.3 v2:172.21.15.18:6817/3876934381 6 ==== osd_op_reply(66 [pgnls start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55697dda0000 con 0x55697e0b6c00 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55697e0b7000 msgr2=0x55697e0cc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55697e0b7000 0x55697e0cc000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55697e0b7c00 msgr2=0x55697e0cc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55697e0b7c00 0x55697e0cc580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55697ea5d800 msgr2=0x55697de4c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55697ea5d800 0x55697de4c100 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55697e0b6c00 msgr2=0x55697e0ccb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55697e0b6c00 0x55697e0ccb00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55697e0d0000 msgr2=0x55697e0cdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55697e0d0000 0x55697e0cdb80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55697e0d1800 msgr2=0x55697e0cd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55697e0d1800 0x55697e0cd080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55697e0d0800 msgr2=0x55697e0cd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55697e0d0800 0x55697e0cd600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55697ea5c400 msgr2=0x55697e0ce100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55697ea5c400 0x55697e0ce100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 reap_dead start 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 reap_dead start 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb8ffe00640 1 -- 172.21.15.18:0/2643202274 reap_dead start 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 msgr2=0x55697de4d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 0x55697de4d700 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x55697dd6d050 tx=0x55697e0c2000 comp rx=0 tx=0).stop 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 msgr2=0x55697de4cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55697ead10b0 tx=0x55697dd32000 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 shutdown_connections 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55697e0b6000 0x55697de4d700 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/2643202274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697ea5d000 0x55697de4cc00 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 >> 172.21.15.18:0/2643202274 conn(0x55697dc90c00 msgr2=0x55697dcbd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 shutdown_connections 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/2643202274 wait complete. 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 msgr2=0x55697de4ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55697ead1b60 tx=0x55697dd54de0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 shutdown_connections 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55697dc91000 0x55697de4b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55697dc91400 0x55697de4ab00 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 --2- 172.21.15.18:0/3211365987 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55697dc91800 0x55697de4a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 >> 172.21.15.18:0/3211365987 conn(0x55697dc91c00 msgr2=0x55697dcbd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 shutdown_connections 2024-04-25T10:11:43.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.009+0000 7fb901cb58c0 1 -- 172.21.15.18:0/3211365987 wait complete. 2024-04-25T10:11:43.021 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.106450, result: 2024-04-25T10:11:43.022 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T10:11:43.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 -- start start 2024-04-25T10:11:43.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 Processor -- start 2024-04-25T10:11:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d8f79400 0x5562d9132b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 0x5562d9133080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44600 con 0x5562d8f79000 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44480 con 0x5562d8f79800 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.097+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44300 con 0x5562d8f79400 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eea400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 0x5562d9133080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eea400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:49090/0 (socket says 172.21.15.18:49090) 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d8f79400 0x5562d9132b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eea400640 1 -- 172.21.15.18:0/4093683317 learned_addr learned my addr 172.21.15.18:0/4093683317 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 -- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d8f79400 msgr2=0x5562d9132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d8f79400 0x5562d9132b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 -- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 msgr2=0x5562d9132580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 -- 172.21.15.18:0/4093683317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d8f9e1e0 con 0x5562d8f79000 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eea400640 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eeae00640 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 0x5562d9133080 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x5562d9dbf020 tx=0x5562d9076000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64766ee9a538ac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee7200640 1 -- 172.21.15.18:0/4093683317 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae9c0 con 0x5562d8f79000 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee7200640 1 -- 172.21.15.18:0/4093683317 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562d8fc2e00 con 0x5562d8f79000 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee7200640 1 -- 172.21.15.18:0/4093683317 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae4e0 con 0x5562d8f79000 2024-04-25T10:11:43.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562d8f9f2c0 con 0x5562d8f79000 2024-04-25T10:11:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5562d8f9e3c0 con 0x5562d8f79000 2024-04-25T10:11:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 4 waiting for MDS map... 2024-04-25T10:11:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee7200640 1 -- 172.21.15.18:0/4093683317 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x5562d9e92200 con 0x5562d8f79000 2024-04-25T10:11:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee7200640 1 -- 172.21.15.18:0/4093683317 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 71) v1 ==== 2723+0+0 (secure 0 0 0) 0x5562d8fcf180 con 0x5562d8f79000 2024-04-25T10:11:43.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 4 Got MDS map 71 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 4 datascan.main: Using metadata pool output 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 Processor -- start 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- start start 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9d47c00 0x5562d9133600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9eec000 0x5562d9133b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44180 con 0x5562d9eec400 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44900 con 0x5562d9d47c00 2024-04-25T10:11:43.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562d8fd8900 con 0x5562d9eec000 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40326/0 (socket says 172.21.15.18:40326) 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1372142143 learned_addr learned my addr 172.21.15.18:0/1372142143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.101+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9d47c00 0x5562d9133600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eea400640 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9eec000 0x5562d9133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9eec000 msgr2=0x5562d9133b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9eec000 0x5562d9133b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9d47c00 msgr2=0x5562d9133600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9d47c00 0x5562d9133600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1372142143 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d8f9e1e0 con 0x5562d9eec400 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x5562d9d48840 tx=0x5562d9d4ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2182315d4f12a3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1372142143 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae9c0 con 0x5562d9eec400 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1372142143 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562d8fc2a80 con 0x5562d9eec400 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1372142143 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae4e0 con 0x5562d9eec400 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1372142143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 msgr2=0x5562d9134100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x5562d9d48840 tx=0x5562d9d4ec60 comp rx=0 tx=0).stop 2024-04-25T10:11:43.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1372142143 shutdown_connections 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eec400 0x5562d9134100 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9eec000 0x5562d9133b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1372142143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9d47c00 0x5562d9133600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1372142143 >> 172.21.15.18:0/1372142143 conn(0x5562d8f78c00 msgr2=0x5562d8fa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1372142143 shutdown_connections 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1372142143 wait complete. 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 Processor -- start 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- start start 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9d47c00 0x5562d9135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9eed800 0x5562d9134c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44900 con 0x5562d9eed400 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d45500 con 0x5562d9eed800 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eec36d8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562d9d44180 con 0x5562d9d47c00 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40334/0 (socket says 172.21.15.18:40334) 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 learned_addr learned my addr 172.21.15.18:0/1176150415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9eed800 0x5562d9134c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9d47c00 0x5562d9135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9d47c00 msgr2=0x5562d9135180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d9d47c00 0x5562d9135180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9eed800 msgr2=0x5562d9134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d9eed800 0x5562d9134c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562d8f9f4a0 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.105+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x5562d9d49b00 tx=0x5562d9076180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 -- 172.21.15.18:0/1176150415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae000 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 -- 172.21.15.18:0/1176150415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5562d8fc3340 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 -- 172.21.15.18:0/1176150415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5562d8fae9c0 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5562d8f9fa40 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562d8f9fc20 con 0x5562d9eed400 2024-04-25T10:11:43.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 4 datascan.init: resolving metadata pool 13 2024-04-25T10:11:43.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 -- 172.21.15.18:0/1176150415 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x5562d9ef4c00 con 0x5562d9eed400 2024-04-25T10:11:43.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 0x5562d9135700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee2c00640 1 -- 172.21.15.18:0/1176150415 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x5562d9ef2a00 con 0x5562d9eed400 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5562d9eed000 0x5562d9134100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d9eed000 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 0x5562d9135700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5562d9eed000 0x5562d9134100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5562d9eed000 0x5562d9134100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 0x5562d9135700 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5562d9dbfb00 tx=0x5562d939c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5562d9eec800 0x5562d9133b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.109+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eec400 con 0x5562d9eec800 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5562d9eec800 0x5562d9133b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5562d9eec800 0x5562d9133b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x5562d9eec000 0x5562d9133600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab400 con 0x5562d9eec000 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x5562d9eec000 0x5562d9133600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x5562d9eec000 0x5562d9133600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d9eed000 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee4a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5562d93a8400 0x5562d93b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d93a8400 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5562d93a8400 0x5562d93b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5562d93a8400 0x5562d93b4000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.113+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d9eed000 2024-04-25T10:11:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d9eed000 2024-04-25T10:11:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4000640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x5562d93a9400 0x5562d93b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d93a9400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x5562d93a9400 0x5562d93b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x5562d93a9400 0x5562d93b4580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d93a8400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d93a8400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d9eec800 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d93a8400 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x5562d93a9c00 0x5562d93b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6000 con 0x5562d93a9c00 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.117+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x5562d93a9c00 0x5562d93b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9eea400640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x5562d93a9c00 0x5562d93b4b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d9eec000 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6400 con 0x5562d9eed000 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4000640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5562d93c7400 0x5562d93b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d93c7400 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5562d93c7400 0x5562d93b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5562d93c7400 0x5562d93b5600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d9eed000 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d93a8400 2024-04-25T10:11:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(18 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6c00 con 0x5562d9eec800 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.121+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d93a9c00 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eec400 con 0x5562d9eec000 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d93a9c00 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d93c7400 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93a9c00 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9d47400 con 0x5562d93a9c00 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab400 con 0x5562d93a9400 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d9eec000 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(30 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.125+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d93a9c00 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d93a9400 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4a00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x5562d93c6000 0x5562d93b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9d47400 con 0x5562d93c6000 2024-04-25T10:11:43.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x5562d93c6000 0x5562d93b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eeae00640 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x5562d93c6000 0x5562d93b5080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(33 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d93c7400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d93a9400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d93c7400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 97 out=49b] v93'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93a9c00 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.129+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d93a8400 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(38 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eec400 con 0x5562d93c7400 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 97 out=49b] v93'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d9eec800 2024-04-25T10:11:43.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d9eec800 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d93c6000 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(42 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6c00 con 0x5562d9eed000 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d9eec000 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6400 con 0x5562d93c6000 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(45 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d93a9c00 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.133+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da000 con 0x5562d9eec800 2024-04-25T10:11:43.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d93a9c00 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da400 con 0x5562d9eed000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9d47400 con 0x5562d93a9400 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da800 con 0x5562d9eed000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab400 con 0x5562d93c6000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(52 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dac00 con 0x5562d9eec000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d93a8400 2024-04-25T10:11:43.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db000 con 0x5562d9eed000 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d93a9c00 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db400 con 0x5562d93a8400 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(57 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eec400 con 0x5562d93a9c00 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.137+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 97 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db800 con 0x5562d93c7400 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(59 [pgnls-filter start_epoch 97 out=81b] v97'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab800 con 0x5562d9eec000 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 7 ==== osd_op_reply(60 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dbc00 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93a8400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 9 ==== osd_op_reply(62 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dac00 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da400 con 0x5562d93a9400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d93a8400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 10 ==== osd_op_reply(66 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d93a8400 2024-04-25T10:11:43.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 11 ==== osd_op_reply(67 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d9eec800 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.141+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d93a8400 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d93a9c00 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6c00 con 0x5562d9eec000 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 8 ==== osd_op_reply(71 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d9eed000 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da000 con 0x5562d93c7400 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d9eed000 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da400 con 0x5562d93a8400 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d9eec800 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da800 con 0x5562d93a9c00 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6400 con 0x5562d9eec000 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 9 ==== osd_op_reply(78 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.145+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dac00 con 0x5562d93a9c00 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d93c7400 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(80 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db000 con 0x5562d93a9c00 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab400 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db400 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9d47400 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db800 con 0x5562d93a9c00 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da000 con 0x5562d93a9400 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dbc00 con 0x5562d9eec000 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 10 ==== osd_op_reply(87 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.149+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da400 con 0x5562d93a9c00 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d93a9400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d93c6000 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d93c7400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 9 ==== osd_op_reply(91 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d93a9400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7800 con 0x5562d93c7400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 10 ==== osd_op_reply(93 [pgnls-filter start_epoch 97 out=49b] v93'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d93a9c00 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6c00 con 0x5562d93a8400 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 14 ==== osd_op_reply(95 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.153+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93c7400 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 11 ==== osd_op_reply(96 [pgnls-filter start_epoch 97 out=49b] v93'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6400 con 0x5562d9eec800 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d9eec800 2024-04-25T10:11:43.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da800 con 0x5562d93c6000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 6 ==== osd_op_reply(99 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab800 con 0x5562d9eed000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 97 out=49b] v93'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da000 con 0x5562d9eec000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 11 ==== osd_op_reply(101 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eecc00 con 0x5562d93c6000 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 7 ==== osd_op_reply(102 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da800 con 0x5562d93a9c00 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d9eec400 con 0x5562d9eec800 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.157+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9800 con 0x5562d93a9c00 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dac00 con 0x5562d9eed000 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8800 con 0x5562d93a9400 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db000 con 0x5562d9eed000 2024-04-25T10:11:43.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a9000 con 0x5562d93c6000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 8 ==== osd_op_reply(109 [pgnls-filter start_epoch 97 out=49b] v93'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db800 con 0x5562d9eec000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.2 v2:172.21.15.18:6816/2456241268 12 ==== osd_op_reply(110 [pgnls-filter start_epoch 97 out=49b] v93'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d9eec000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d93a8400 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 15 ==== osd_op_reply(111 [pgnls-filter start_epoch 97 out=49b] v93'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dbc00 con 0x5562d9eed000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7000 con 0x5562d93a9c00 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da400 con 0x5562d93a8400 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 16 ==== osd_op_reply(114 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.161+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6400 con 0x5562d93a9c00 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 97 out=49b] v93'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da000 con 0x5562d93c7400 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 12 ==== osd_op_reply(116 [pgnls-filter start_epoch 97 out=81b] v97'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 10 datascan.operator(): handling object 10000000001.0 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db400 con 0x5562d93c7400 2024-04-25T10:11:43.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 13 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93dac00 con 0x5562d93a8400 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 17 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93db000 con 0x5562d9eec800 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.6 v2:172.21.15.167:6808/3449298510 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+520 (crc 0 0 0) 0x5562d902c500 con 0x5562d9eec800 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.get_frag_of: frag is * 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab400 con 0x5562d93a8400 2024-04-25T10:11:43.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 18 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d92ab800 con 0x5562d93a8400 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 19 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 20 datascan.read_dentry: file_head not found in result 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.165+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93a8400 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 20 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v97'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:11:43.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d93c7400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.5 v2:172.21.15.167:6824/2931035891 14 ==== osd_op_reply(123 [pgnls-filter start_epoch 97 out=49b] v93'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93c7400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93da800 con 0x5562d93a8400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.1 v2:172.21.15.18:6808/600232426 21 ==== osd_op_reply(124 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d93a8400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c6800 con 0x5562d93a9c00 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 <== osd.4 v2:172.21.15.167:6800/3323785626 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 97 out=49b] v93'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c780 con 0x5562d93a9c00 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8000 con 0x5562d93c6000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.7 v2:172.21.15.167:6809/19218082 9 ==== osd_op_reply(126 [pgnls-filter start_epoch 97 out=49b] v93'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93c6000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93c7c00 con 0x5562d9eed000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4000640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93d6000 con 0x5562d9eed000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee9a00640 1 -- 172.21.15.18:0/1176150415 <== osd.0 v2:172.21.15.18:6800/3884042883 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 97 out=49b] v93'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c000 con 0x5562d9eed000 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9ee4a00640 1 -- 172.21.15.18:0/1176150415 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 97 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x5562d93a8c00 con 0x5562d93a9400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eeae00640 1 -- 172.21.15.18:0/1176150415 <== osd.3 v2:172.21.15.18:6817/3876934381 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 97 out=49b] v93'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5562d902c500 con 0x5562d93a9400 2024-04-25T10:11:43.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5562d9eed000 msgr2=0x5562d9134100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5562d9eed000 0x5562d9134100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5562d93a8400 msgr2=0x5562d93b4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5562d93a8400 0x5562d93b4000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x5562d9eec000 msgr2=0x5562d9133600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x5562d9eec000 0x5562d9133600 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x5562d93a9400 msgr2=0x5562d93b4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x5562d93a9400 0x5562d93b4580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 reap_dead start 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x5562d93a9c00 msgr2=0x5562d93b4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x5562d93a9c00 0x5562d93b4b00 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5562d93c7400 msgr2=0x5562d93b5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x5562d93c7400 0x5562d93b5600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5562d9eec800 msgr2=0x5562d9133b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5562d9eec800 0x5562d9133b80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x5562d93c6000 msgr2=0x5562d93b5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x5562d93c6000 0x5562d93b5080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.169+0000 7f9eea400640 1 -- 172.21.15.18:0/1176150415 reap_dead start 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 msgr2=0x5562d9135700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 0x5562d9135700 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x5562d9dbfb00 tx=0x5562d939c000 comp rx=0 tx=0).stop 2024-04-25T10:11:43.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 msgr2=0x5562d9134680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x5562d9d49b00 tx=0x5562d9076180 comp rx=0 tx=0).stop 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 shutdown_connections 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d9eed400 0x5562d9134680 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/1176150415 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5562d92aa800 0x5562d9135700 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 >> 172.21.15.18:0/1176150415 conn(0x5562d8f78c00 msgr2=0x5562d8fa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 shutdown_connections 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/1176150415 wait complete. 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 msgr2=0x5562d9133080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 0x5562d9133080 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x5562d9dbf020 tx=0x5562d9076000 comp rx=0 tx=0).stop 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 shutdown_connections 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5562d8f79000 0x5562d9133080 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5562d8f79400 0x5562d9132b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 --2- 172.21.15.18:0/4093683317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5562d8f79800 0x5562d9132580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 >> 172.21.15.18:0/4093683317 conn(0x5562d8f79c00 msgr2=0x5562d8fa7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 shutdown_connections 2024-04-25T10:11:43.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.173+0000 7f9eec36d8c0 1 -- 172.21.15.18:0/4093683317 wait complete. 2024-04-25T10:11:43.199 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.177964, result: 2024-04-25T10:11:43.200 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T10:11:43.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- start start 2024-04-25T10:11:43.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 Processor -- start 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c478783800 0x55c47893c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c478783400 0x55c47893cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479546180 con 0x55c478783000 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479546300 con 0x55c478783400 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479546480 con 0x55c478783800 2024-04-25T10:11:43.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40340/0 (socket says 172.21.15.18:40340) 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 -- 172.21.15.18:0/1571385682 learned_addr learned my addr 172.21.15.18:0/1571385682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bef800640 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c478783800 0x55c47893c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3beee00640 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c478783400 0x55c47893cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 -- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c478783800 msgr2=0x55c47893c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c478783800 0x55c47893c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 -- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c478783400 msgr2=0x55c47893cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c478783400 0x55c47893cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 -- 172.21.15.18:0/1571385682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4787a81e0 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf0200640 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x55c4795c7b60 tx=0x55c47885c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b856573f779d8121 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bec600640 1 -- 172.21.15.18:0/1571385682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b84e0 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bec600640 1 -- 172.21.15.18:0/1571385682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4787cc540 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bec600640 1 -- 172.21.15.18:0/1571385682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b8b60 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4787a94a0 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c4787a9a40 con 0x55c478783000 2024-04-25T10:11:43.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 4 waiting for MDS map... 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bec600640 1 -- 172.21.15.18:0/1571385682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x55c4796a0600 con 0x55c478783000 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bec600640 1 -- 172.21.15.18:0/1571385682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 71) v1 ==== 2723+0+0 (secure 0 0 0) 0x55c4787d9180 con 0x55c478783000 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 4 Got MDS map 71 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 4 datascan.main: Using metadata pool output 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.265+0000 7f3bf17388c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:11:43.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 Processor -- start 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- start start 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479546600 con 0x55c479689400 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479546780 con 0x55c479688c00 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479546900 con 0x55c479689000 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40342/0 (socket says 172.21.15.18:40342) 2024-04-25T10:11:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 -- 172.21.15.18:0/14259501 learned_addr learned my addr 172.21.15.18:0/14259501 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bef800640 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 -- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 msgr2=0x55c47893db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 -- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 msgr2=0x55c47893d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 -- 172.21.15.18:0/14259501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4787a9c20 con 0x55c479689400 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3beee00640 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x55c4795c7110 tx=0x55c4788803c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cdb12a6f204a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3be9e00640 1 -- 172.21.15.18:0/14259501 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b89c0 con 0x55c479689400 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3be9e00640 1 -- 172.21.15.18:0/14259501 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4787cce00 con 0x55c479689400 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3be9e00640 1 -- 172.21.15.18:0/14259501 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b84e0 con 0x55c479689400 2024-04-25T10:11:43.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- 172.21.15.18:0/14259501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 msgr2=0x55c47893e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x55c4795c7110 tx=0x55c4788803c0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- 172.21.15.18:0/14259501 shutdown_connections 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e100 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/14259501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- 172.21.15.18:0/14259501 >> 172.21.15.18:0/14259501 conn(0x55c478782c00 msgr2=0x55c4787b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- 172.21.15.18:0/14259501 shutdown_connections 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- 172.21.15.18:0/14259501 wait complete. 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 Processor -- start 2024-04-25T10:11:43.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.269+0000 7f3bf17388c0 1 -- start start 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479547b00 con 0x55c479689400 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c479547980 con 0x55c479688c00 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c479547800 con 0x55c479689000 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40352/0 (socket says 172.21.15.18:40352) 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 learned_addr learned my addr 172.21.15.18:0/2200260662 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 msgr2=0x55c47893ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c479689000 0x55c47893ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 msgr2=0x55c47893f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c479688c00 0x55c47893f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4787a92c0 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x55c4796909c0 tx=0x55c4788802a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3be8000640 1 -- 172.21.15.18:0/2200260662 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b8b60 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3be8000640 1 -- 172.21.15.18:0/2200260662 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4787ccc40 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4787a83c0 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3be8000640 1 -- 172.21.15.18:0/2200260662 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c4787b8000 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4787a9c20 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3bf17388c0 4 datascan.init: resolving metadata pool 13 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.273+0000 7f3be8000640 1 -- 172.21.15.18:0/2200260662 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55c47968cc00 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3be8000640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 0x55c47893f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3be8000640 1 -- 172.21.15.18:0/2200260662 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x55c478aba600 con 0x55c479689400 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf17388c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:11:43.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf17388c0 4 datascan.main: resolving metadata pool 13 2024-04-25T10:11:43.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55c479689800 0x55c47893e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c479689c00 con 0x55c479689800 2024-04-25T10:11:43.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 0x55c47893f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55c479689800 0x55c47893e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 0x55c47893f700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55c47885eea0 tx=0x55c4796b7f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55c479689800 0x55c47893e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(1 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55c479689c00 0x55c478ba6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c47954b400 con 0x55c479689c00 2024-04-25T10:11:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55c479689c00 0x55c478ba6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55c479689c00 0x55c478ba6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(2 [pgnls start_epoch 97 out=177b] v97'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55c47954b400 0x55c478ba6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c479688400 con 0x55c47954b400 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55c47954b400 0x55c478ba6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.277+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55c47954b400 0x55c478ba6580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(3 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c479688400 con 0x55c479689800 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(4 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55c479688400 0x55c478ba6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b000 con 0x55c479688400 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55c479688400 0x55c478ba6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55c479688400 0x55c478ba6b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(5 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c478b9b000 0x55c478ba7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b400 con 0x55c478b9b000 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c478b9b000 0x55c478ba7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c478b9b000 0x55c478ba7080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(6 [pgnls start_epoch 97 out=149b] v96'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b400 con 0x55c479689c00 2024-04-25T10:11:43.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(7 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b400 con 0x55c479688400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(8 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55c478b9b400 0x55c478ba7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b800 con 0x55c478b9b400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.281+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55c478b9b400 0x55c478ba7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bef800640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55c478b9b400 0x55c478ba7600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(9 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b800 con 0x55c478b9b000 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(10 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b800 con 0x55c47954b400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(11 [pgnls start_epoch 97 out=81b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9b800 con 0x55c479689c00 2024-04-25T10:11:43.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(12 [pgnls start_epoch 97 out=49b] v94'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55c478b9b800 0x55c478ba8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c479688800 con 0x55c478b9b800 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55c478b9b800 0x55c478ba8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55c478b9b800 0x55c478ba8680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(13 [pgnls start_epoch 97 out=77b] v96'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3beee00640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55c479688800 0x55c478ba7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479688800 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55c479688800 0x55c478ba7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55c479688800 0x55c478ba7b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.285+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(14 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479688800 2024-04-25T10:11:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(15 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(16 [pgnls start_epoch 97 out=49b] v94'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479688400 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(17 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689c00 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(18 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b400 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(19 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479688800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(20 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479688800 2024-04-25T10:11:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(21 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(22 [pgnls start_epoch 97 out=97b] v96'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(23 [pgnls start_epoch 97 out=74b] v92'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.289+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689800 2024-04-25T10:11:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(24 [pgnls start_epoch 97 out=73b] v96'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b000 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(25 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(26 [pgnls start_epoch 97 out=98b] v96'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b400 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(27 [pgnls start_epoch 97 out=76b] v96'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(28 [pgnls start_epoch 97 out=73b] v96'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689800 2024-04-25T10:11:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 6 ==== osd_op_reply(29 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c478b9b400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(30 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479688400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(31 [pgnls start_epoch 97 out=73b] v92'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479688400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(32 [pgnls start_epoch 97 out=101b] v96'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.293+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca000 con 0x55c479689c00 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T10:11:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca800 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 20 datascan.scan_links: injected ino detected 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcac00 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb000 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:11:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb400 con 0x55c478b9b000 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T10:11:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb800 con 0x55c479688400 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca000 con 0x55c47954b400 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T10:11:43.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca800 con 0x55c478b9b800 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T10:11:43.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.297+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcac00 con 0x55c479689800 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb000 con 0x55c479689800 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T10:11:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcbc00 con 0x55c479689800 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb800 con 0x55c479688400 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 11 ==== osd_op_reply(47 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689c00 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 10 ==== osd_op_reply(48 [pgnls start_epoch 97 out=177b] v97'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c47954b400 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(49 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 12 ==== osd_op_reply(50 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688400 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 8 ==== osd_op_reply(51 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b000 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(52 [pgnls start_epoch 97 out=149b] v96'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.301+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689c00 2024-04-25T10:11:43.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 11 ==== osd_op_reply(53 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 9 ==== osd_op_reply(54 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(55 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b000 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(56 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c47954b400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 5 ==== osd_op_reply(57 [pgnls start_epoch 97 out=81b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689c00 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 12 ==== osd_op_reply(58 [pgnls start_epoch 97 out=49b] v94'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 8 ==== osd_op_reply(59 [pgnls start_epoch 97 out=77b] v96'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(60 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479688800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 13 ==== osd_op_reply(61 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 9 ==== osd_op_reply(62 [pgnls start_epoch 97 out=49b] v94'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688400 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 10 ==== osd_op_reply(63 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.305+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689c00 2024-04-25T10:11:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 13 ==== osd_op_reply(64 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b400 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(65 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(66 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c479688800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 10 ==== osd_op_reply(67 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 11 ==== osd_op_reply(68 [pgnls start_epoch 97 out=97b] v96'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 12 ==== osd_op_reply(69 [pgnls start_epoch 97 out=74b] v92'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 14 ==== osd_op_reply(70 [pgnls start_epoch 97 out=73b] v96'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b000 2024-04-25T10:11:43.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(71 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 15 ==== osd_op_reply(72 [pgnls start_epoch 97 out=98b] v96'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.309+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(73 [pgnls start_epoch 97 out=76b] v96'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 13 ==== osd_op_reply(74 [pgnls start_epoch 97 out=73b] v96'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 16 ==== osd_op_reply(75 [pgnls start_epoch 97 out=73b] v96'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c478b9b400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(76 [pgnls start_epoch 97 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c478836780 con 0x55c478b9b400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 11 ==== osd_op_reply(77 [pgnls start_epoch 97 out=73b] v92'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 97 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479688400 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 12 ==== osd_op_reply(78 [pgnls start_epoch 97 out=101b] v96'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca800 con 0x55c479689c00 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcac00 con 0x55c479689c00 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb000 con 0x55c479689c00 2024-04-25T10:11:43.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 20 datascan.scan_links: injected ino detected 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689c00 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.313+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdc000 con 0x55c479689c00 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:11:43.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdc400 con 0x55c478b9b000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836500 con 0x55c478b9b000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdc800 con 0x55c479688400 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdcc00 con 0x55c47954b400 2024-04-25T10:11:43.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 <== osd.2 v2:172.21.15.18:6816/2456241268 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55c478836780 con 0x55c47954b400 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdd000 con 0x55c479689800 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdd400 con 0x55c478b9b800 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T10:11:43.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdd800 con 0x55c479689800 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bddc00 con 0x55c479689800 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T10:11:43.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdc800 con 0x55c479689800 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.317+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdd000 con 0x55c479688400 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.6 v2:172.21.15.167:6808/3449298510 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55c478836000 con 0x55c479688400 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T10:11:43.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bdd400 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478b9bc00 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v97'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcbc00 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.scan_links: first is now 2 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb800 con 0x55c479689c00 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf0200640 1 -- 172.21.15.18:0/2200260662 <== osd.1 v2:172.21.15.18:6808/600232426 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v97'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c478836500 con 0x55c479689c00 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 10 datascan.scan_links: updating inotable 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.321+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca400 con 0x55c479689800 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bcb400 con 0x55c479689800 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.7 v2:172.21.15.167:6809/19218082 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v97'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55c478836000 con 0x55c479689800 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 10 datascan.scan_links: updating snaptable 2024-04-25T10:11:43.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e97) v9 -- 0x55c478bca800 con 0x55c478b9b800 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3beee00640 1 -- 172.21.15.18:0/2200260662 <== osd.4 v2:172.21.15.167:6800/3323785626 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55c478836000 con 0x55c478b9b800 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c478b9b000 msgr2=0x55c478ba7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55c478b9b000 0x55c478ba7080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55c479689c00 msgr2=0x55c478ba6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55c479689c00 0x55c478ba6000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55c47954b400 msgr2=0x55c478ba6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55c47954b400 0x55c478ba6580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55c479688800 msgr2=0x55c478ba7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55c479688800 0x55c478ba7b80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55c478b9b800 msgr2=0x55c478ba8680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55c478b9b800 0x55c478ba8680 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 reap_dead start 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55c478b9b400 msgr2=0x55c478ba7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55c478b9b400 0x55c478ba7600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55c479688400 msgr2=0x55c478ba6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55c479688400 0x55c478ba6b00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55c479689800 msgr2=0x55c47893e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55c479689800 0x55c47893e100 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bef800640 1 -- 172.21.15.18:0/2200260662 reap_dead start 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 msgr2=0x55c47893f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 0x55c47893f700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x55c47885eea0 tx=0x55c4796b7f20 comp rx=0 tx=0).stop 2024-04-25T10:11:43.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 msgr2=0x55c47893e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x55c4796909c0 tx=0x55c4788802a0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 shutdown_connections 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c479689400 0x55c47893e680 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/2200260662 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55c478b9a000 0x55c47893f700 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 >> 172.21.15.18:0/2200260662 conn(0x55c478782c00 msgr2=0x55c4787b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 shutdown_connections 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/2200260662 wait complete. 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 msgr2=0x55c47893d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x55c4795c7b60 tx=0x55c47885c8a0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 shutdown_connections 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c478783000 0x55c47893d080 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c478783400 0x55c47893cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 --2- 172.21.15.18:0/1571385682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c478783800 0x55c47893c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 >> 172.21.15.18:0/1571385682 conn(0x55c478783c00 msgr2=0x55c4787b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 shutdown_connections 2024-04-25T10:11:43.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.325+0000 7f3bf17388c0 1 -- 172.21.15.18:0/1571385682 wait complete. 2024-04-25T10:11:43.350 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.149864, result: 2024-04-25T10:11:43.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:11:43.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.525+0000 7fd750c00640 1 Processor -- start 2024-04-25T10:11:43.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.525+0000 7fd750c00640 1 -- start start 2024-04-25T10:11:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd750c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 0x7fd74c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd750c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c09ade0 con 0x7fd74c15b9e0 2024-04-25T10:11:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd750c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c099a60 con 0x7fd74c15f3b0 2024-04-25T10:11:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd750c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c099d40 con 0x7fd74c15f860 2024-04-25T10:11:43.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd74c15b9e0 0x7fd74c0cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57110/0 (socket says 172.21.15.18:57110) 2024-04-25T10:11:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74b400640 1 -- 172.21.15.18:0/4193401731 learned_addr learned my addr 172.21.15.18:0/4193401731 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74be00640 1 --2- 172.21.15.18:0/4193401731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 0x7fd74c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412564712 0 0) 0x7fd73c0014a0 con 0x7fd74c15b9e0 2024-04-25T10:11:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd730003530 con 0x7fd74c15b9e0 2024-04-25T10:11:43.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431525208 0 0) 0x7fd74c099a60 con 0x7fd74c15f3b0 2024-04-25T10:11:43.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd73c0014a0 con 0x7fd74c15f3b0 2024-04-25T10:11:43.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2239826501 0 0) 0x7fd730003530 con 0x7fd74c15b9e0 2024-04-25T10:11:43.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74be00640 1 -- 172.21.15.18:0/4193401731 >> v1:172.21.15.167:6789/0 conn(0x7fd74c15f3b0 legacy=0x7fd74c0cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74be00640 1 -- 172.21.15.18:0/4193401731 >> v1:172.21.15.18:6789/0 conn(0x7fd74c15b9e0 legacy=0x7fd74c0cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.529+0000 7fd74be00640 1 -- 172.21.15.18:0/4193401731 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c09a020 con 0x7fd74c15f860 2024-04-25T10:11:43.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd74be00640 1 --2- 172.21.15.18:0/4193401731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 0x7fd74c0cc760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097f0 tx=0x7fd74401c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c894c45a1cfe54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b0070 con 0x7fd74c15f860 2024-04-25T10:11:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744004030 con 0x7fd74c15f860 2024-04-25T10:11:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd74aa00640 1 -- 172.21.15.18:0/4193401731 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73c001bf0 con 0x7fd74c15f860 2024-04-25T10:11:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- 172.21.15.18:0/4193401731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 msgr2=0x7fd74c0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 --2- 172.21.15.18:0/4193401731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 0x7fd74c0cc760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097f0 tx=0x7fd74401c3d0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- 172.21.15.18:0/4193401731 shutdown_connections 2024-04-25T10:11:43.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 --2- 172.21.15.18:0/4193401731 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15f860 0x7fd74c0cc760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- 172.21.15.18:0/4193401731 >> 172.21.15.18:0/4193401731 conn(0x7fd74c0b3030 msgr2=0x7fd74c0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- 172.21.15.18:0/4193401731 shutdown_connections 2024-04-25T10:11:43.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- 172.21.15.18:0/4193401731 wait complete. 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 Processor -- start 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- start start 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c15f3b0 0x7fd74c0c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 0x7fd74c15e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c0d0250 con 0x7fd74c15f860 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c15fc70 con 0x7fd74c15f3b0 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.533+0000 7fd750c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c0d03d0 con 0x7fd74c15b9e0 2024-04-25T10:11:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 0x7fd74c15e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74b400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:47278/0 (socket says 172.21.15.18:47278) 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74b400640 1 -- 172.21.15.18:0/4248154717 learned_addr learned my addr 172.21.15.18:0/4248154717 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd742a00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c15f3b0 0x7fd74c0c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 -- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 msgr2=0x7fd74c147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 -- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c15f3b0 msgr2=0x7fd74c0c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c15f3b0 0x7fd74c0c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 -- 172.21.15.18:0/4248154717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c06f440 con 0x7fd74c15f860 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74b400640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:11:43.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd74be00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 0x7fd74c15e0d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd744004000 tx=0x7fd744019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b0040 con 0x7fd74c15f860 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd744003760 con 0x7fd74c15f860 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd744003b50 con 0x7fd74c15f860 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c159b30 con 0x7fd74c15f860 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c15ec40 con 0x7fd74c15f860 2024-04-25T10:11:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c0745d0 con 0x7fd74c15f860 2024-04-25T10:11:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.537+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd7440be030 con 0x7fd74c15f860 2024-04-25T10:11:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.541+0000 7fd743e00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 0x7fd728069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.541+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fd74411e7b0 con 0x7fd74c15f860 2024-04-25T10:11:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.541+0000 7fd74b400640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 0x7fd728069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.541+0000 7fd74b400640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 0x7fd728069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd73c001340 tx=0x7fd73c001c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.545+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7440c5020 con 0x7fd74c15f860 2024-04-25T10:11:43.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.741+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd74c0d1320 con 0x7fd74c15f860 2024-04-25T10:11:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.885+0000 7fd743e00640 1 -- 172.21.15.18:0/4248154717 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v72) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd744015ff0 con 0x7fd74c15f860 2024-04-25T10:11:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:11:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 msgr2=0x7fd728069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 0x7fd728069420 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd73c001340 tx=0x7fd73c001c00 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 msgr2=0x7fd74c15e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 0x7fd74c15e0d0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd744004000 tx=0x7fd744019170 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 shutdown_connections 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd74c15f860 0x7fd74c15e0d0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd74c15f3b0 0x7fd74c0c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd728066f60 0x7fd728069420 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 --2- 172.21.15.18:0/4248154717 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd74c15b9e0 0x7fd74c147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 >> 172.21.15.18:0/4248154717 conn(0x7fd74c0b3030 msgr2=0x7fd74c06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 shutdown_connections 2024-04-25T10:11:43.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:43.889+0000 7fd750c00640 1 -- 172.21.15.18:0/4248154717 wait complete. 2024-04-25T10:11:43.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:44.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.049+0000 7fdf79200640 1 Processor -- start 2024-04-25T10:11:44.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.049+0000 7fdf79200640 1 -- start start 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf79200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf740b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf79200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740cc4e0 con 0x7fdf74145270 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf79200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740ce040 con 0x7fdf740b1c90 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf79200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740b20e0 con 0x7fdf7415fe50 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdf74145270 0x7fdf740cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57126/0 (socket says 172.21.15.18:57126) 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71e00640 1 -- 172.21.15.18:0/1527457256 learned_addr learned my addr 172.21.15.18:0/1527457256 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf6be00640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf740b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570829095 0 0) 0x7fdf740cc4e0 con 0x7fdf74145270 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf58003530 con 0x7fdf74145270 2024-04-25T10:11:44.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1741903600 0 0) 0x7fdf740ce040 con 0x7fdf740b1c90 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf740cc4e0 con 0x7fdf740b1c90 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2072087133 0 0) 0x7fdf58003530 con 0x7fdf74145270 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 msgr2=0x7fdf740b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf740b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 >> v1:172.21.15.167:6789/0 conn(0x7fdf740b1c90 legacy=0x7fdf7415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740ce320 con 0x7fdf74145270 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fdf64001680 con 0x7fdf74145270 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 >> v1:172.21.15.18:6789/0 conn(0x7fdf74145270 legacy=0x7fdf740cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf58003b80 0x7fdf58003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740b20e0 con 0x7fdf58004d50 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5800ba80 con 0x7fdf58003b80 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5800bc30 con 0x7fdf7415fe50 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71e00640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf58003b80 0x7fdf58003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf6be00640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 -- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 msgr2=0x7fdf58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf7415fe50 0x7fdf58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 -- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf58003b80 msgr2=0x7fdf58003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf58003b80 0x7fdf58003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf72800640 1 -- 172.21.15.18:0/1527457256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58003530 con 0x7fdf58004d50 2024-04-25T10:11:44.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.053+0000 7fdf71e00640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf58003b80 0x7fdf58003f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf72800640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf580051d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001fd0 tx=0x7fdf6c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a80baad88faa72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c001c20 con 0x7fdf58004d50 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c003ba0 con 0x7fdf58004d50 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf71400640 1 -- 172.21.15.18:0/1527457256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0050d0 con 0x7fdf58004d50 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 -- 172.21.15.18:0/1527457256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 msgr2=0x7fdf580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 --2- 172.21.15.18:0/1527457256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf580051d0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c001fd0 tx=0x7fdf6c01c900 comp rx=0 tx=0).stop 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf72800640 1 -- 172.21.15.18:0/1527457256 reap_dead start 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 -- 172.21.15.18:0/1527457256 shutdown_connections 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 -- 172.21.15.18:0/1527457256 >> 172.21.15.18:0/1527457256 conn(0x7fdf74066fa0 msgr2=0x7fdf7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 -- 172.21.15.18:0/1527457256 shutdown_connections 2024-04-25T10:11:44.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.057+0000 7fdf79200640 1 -- 172.21.15.18:0/1527457256 wait complete. 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 Processor -- start 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- start start 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf740cb3d0 0x7fdf740ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf741423d0 0x7fdf740ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf741602b0 con 0x7fdf58004d50 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf74145650 con 0x7fdf741423d0 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7415f650 con 0x7fdf740cb3d0 2024-04-25T10:11:44.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40382/0 (socket says 172.21.15.18:40382) 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 -- 172.21.15.18:0/1576097229 learned_addr learned my addr 172.21.15.18:0/1576097229 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 -- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf740cb3d0 msgr2=0x7fdf740ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf6be00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf740cb3d0 0x7fdf740ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf740cb3d0 0x7fdf740ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 -- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf741423d0 msgr2=0x7fdf740ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf741423d0 0x7fdf740ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 -- 172.21.15.18:0/1576097229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf741f3d40 con 0x7fdf58004d50 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf71e00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fdf640017f0 tx=0x7fdf640129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6401c070 con 0x7fdf58004d50 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf64014750 con 0x7fdf58004d50 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf64014b00 con 0x7fdf58004d50 2024-04-25T10:11:44.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf741f4020 con 0x7fdf58004d50 2024-04-25T10:11:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf740c6c60 con 0x7fdf58004d50 2024-04-25T10:11:44.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.061+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf740745d0 con 0x7fdf58004d50 2024-04-25T10:11:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.065+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdf64014ca0 con 0x7fdf58004d50 2024-04-25T10:11:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.065+0000 7fdf6a000640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 0x7fdf50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.065+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fdf64087ce0 con 0x7fdf58004d50 2024-04-25T10:11:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.065+0000 7fdf6be00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 0x7fdf50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:44.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.065+0000 7fdf6be00640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 0x7fdf50069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ae6e0 tx=0x7fdf5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:44.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.069+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf64058a30 con 0x7fdf58004d50 2024-04-25T10:11:44.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf7406e9e0 con 0x7fdf58004d50 2024-04-25T10:11:44.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf6a000640 1 -- 172.21.15.18:0/1576097229 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fdf64058330 con 0x7fdf58004d50 2024-04-25T10:11:44.277 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:44.277 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:43.892108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:replay","state_seq":1,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:44.277 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 73 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 msgr2=0x7fdf50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 0x7fdf50069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdf740ae6e0 tx=0x7fdf5c008040 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 msgr2=0x7fdf741f33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fdf640017f0 tx=0x7fdf640129a0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 shutdown_connections 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf741423d0 0x7fdf740ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf50066f60 0x7fdf50069420 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf740cb3d0 0x7fdf740ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 --2- 172.21.15.18:0/1576097229 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf58004d50 0x7fdf741f33d0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 >> 172.21.15.18:0/1576097229 conn(0x7fdf74066fa0 msgr2=0x7fdf740b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:44.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 shutdown_connections 2024-04-25T10:11:44.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:44.269+0000 7fdf79200640 1 -- 172.21.15.18:0/1576097229 wait complete. 2024-04-25T10:11:44.702 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:11:43.892108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8004}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8004': {'gid': 8004, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/2720545627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2720545627}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2720545627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:11:44.702 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8004:up:replay 2024-04-25T10:11:45.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 Processor -- start 2024-04-25T10:11:45.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 -- start start 2024-04-25T10:11:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7b415fe50 0x7fa7b40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b40b1c90 0x7fa7b415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b40cc4e0 con 0x7fa7b4145270 2024-04-25T10:11:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b4145650 con 0x7fa7b415fe50 2024-04-25T10:11:45.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b41602b0 con 0x7fa7b40b1c90 2024-04-25T10:11:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7b415fe50 0x7fa7b40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b40b1c90 0x7fa7b415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b1e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fa7b4145270 0x7fa7b40cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:39082/0 (socket says 172.21.15.18:39082) 2024-04-25T10:11:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7b1e00640 1 -- 172.21.15.18:0/1472345676 learned_addr learned my addr 172.21.15.18:0/1472345676 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:45.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa7b415fe50 0x7fa7b40b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:49174/0 (socket says 172.21.15.18:49174) 2024-04-25T10:11:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 -- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b40b1c90 msgr2=0x7fa7b415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 --2- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b40b1c90 0x7fa7b415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 -- 172.21.15.18:0/1472345676 >> v1:172.21.15.167:6789/0 conn(0x7fa7b4145270 legacy=0x7fa7b40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:45.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.849+0000 7fa7abe00640 1 -- 172.21.15.18:0/1472345676 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40ce040 con 0x7fa7b415fe50 2024-04-25T10:11:45.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7abe00640 1 --2- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b40b1750 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0097c0 tx=0x7fa79c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66d849c46846920a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:45.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b1400640 1 -- 172.21.15.18:0/1472345676 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b2070 con 0x7fa7b415fe50 2024-04-25T10:11:45.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b1400640 1 -- 172.21.15.18:0/1472345676 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0ad640 con 0x7fa7b415fe50 2024-04-25T10:11:45.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b1400640 1 -- 172.21.15.18:0/1472345676 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0ada10 con 0x7fa7b415fe50 2024-04-25T10:11:45.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 -- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 msgr2=0x7fa7b40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 --2- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b40b1750 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0097c0 tx=0x7fa79c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 -- 172.21.15.18:0/1472345676 shutdown_connections 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 --2- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b40b1c90 0x7fa7b415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 --2- 172.21.15.18:0/1472345676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b40b1750 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 -- 172.21.15.18:0/1472345676 >> 172.21.15.18:0/1472345676 conn(0x7fa7b4066fa0 msgr2=0x7fa7b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 -- 172.21.15.18:0/1472345676 shutdown_connections 2024-04-25T10:11:45.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.853+0000 7fa7b9200640 1 -- 172.21.15.18:0/1472345676 wait complete. 2024-04-25T10:11:45.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 Processor -- start 2024-04-25T10:11:45.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- start start 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b4145270 0x7fa7b413cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b4143c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40cdbe0 con 0x7fa7b40b1c90 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b415f930 con 0x7fa7b415fe50 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b40cdd60 con 0x7fa7b4145270 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40386/0 (socket says 172.21.15.18:40386) 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 -- 172.21.15.18:0/983189259 learned_addr learned my addr 172.21.15.18:0/983189259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b2800640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b4143c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7abe00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b4145270 0x7fa7b413cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 -- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b4145270 msgr2=0x7fa7b413cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b4145270 0x7fa7b413cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 -- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 msgr2=0x7fa7b4143c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b4143c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 -- 172.21.15.18:0/983189259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b40b1560 con 0x7fa7b40b1c90 2024-04-25T10:11:45.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b1e00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c450 tx=0x7fa7a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4017070 con 0x7fa7b40b1c90 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a4005cf0 con 0x7fa7b40b1c90 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4007290 con 0x7fa7b40b1c90 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b40b07a0 con 0x7fa7b40b1c90 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.857+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b40b1040 con 0x7fa7b40b1c90 2024-04-25T10:11:45.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b40b0970 con 0x7fa7b40b1c90 2024-04-25T10:11:45.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7a401a070 con 0x7fa7b40b1c90 2024-04-25T10:11:45.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7aa000640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 0x7fa790069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:45.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fa7a4084660 con 0x7fa7b40b1c90 2024-04-25T10:11:45.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7abe00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 0x7fa790069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:45.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.861+0000 7fa7abe00640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 0x7fa790069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0af000 tx=0x7fa79c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:45.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:45.865+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7b40b1560 con 0x7fa7b40b1c90 2024-04-25T10:11:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.061+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7b40745d0 con 0x7fa7b40b1c90 2024-04-25T10:11:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7aa000640 1 -- 172.21.15.18:0/983189259 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa7a4054c40 con 0x7fa7b40b1c90 2024-04-25T10:11:46.071 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:46.072 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:44.898797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 75 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 msgr2=0x7fa790069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 0x7fa790069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0af000 tx=0x7fa79c008040 comp rx=0 tx=0).stop 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 msgr2=0x7fa7b413f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c450 tx=0x7fa7a400c910 comp rx=0 tx=0).stop 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 shutdown_connections 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7b415fe50 0x7fa7b4143c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa790066f60 0x7fa790069420 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa7b4145270 0x7fa7b413cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 --2- 172.21.15.18:0/983189259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa7b40b1c90 0x7fa7b413f820 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 >> 172.21.15.18:0/983189259 conn(0x7fa7b4066fa0 msgr2=0x7fa7b40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 shutdown_connections 2024-04-25T10:11:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:46.065+0000 7fa7b9200640 1 -- 172.21.15.18:0/983189259 wait complete. 2024-04-25T10:11:46.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:11:44.898797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8004}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8004': {'gid': 8004, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.18:6835/2720545627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2720545627}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2720545627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:11:46.496 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8004:up:rejoin 2024-04-25T10:11:47.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:11:47.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 Processor -- start 2024-04-25T10:11:47.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 -- start start 2024-04-25T10:11:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 0x7f14940b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14940b1c90 0x7f149415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14940b20a0 con 0x7f1494145270 2024-04-25T10:11:47.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1494145650 con 0x7f14940b1c90 2024-04-25T10:11:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.641+0000 7f1498c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14941602b0 con 0x7f149415fe50 2024-04-25T10:11:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1491e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1494145270 0x7f14940cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57134/0 (socket says 172.21.15.18:57134) 2024-04-25T10:11:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1491e00640 1 -- 172.21.15.18:0/4062279509 learned_addr learned my addr 172.21.15.18:0/4062279509 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 --2- 172.21.15.18:0/4062279509 >> v2:172.21.15.18:3300/0 conn(0x7f14940b1c90 0x7f149415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1489400640 1 --2- 172.21.15.18:0/4062279509 >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 0x7f14940b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1491400640 1 -- 172.21.15.18:0/4062279509 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029000183 0 0) 0x7f147c001120 con 0x7f1494145270 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1491400640 1 -- 172.21.15.18:0/4062279509 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003530 con 0x7f1494145270 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 -- 172.21.15.18:0/4062279509 >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 msgr2=0x7f14940b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 --2- 172.21.15.18:0/4062279509 >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 0x7f14940b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 -- 172.21.15.18:0/4062279509 >> v1:172.21.15.18:6789/0 conn(0x7f1494145270 legacy=0x7f14940cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 -- 172.21.15.18:0/4062279509 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940cc4e0 con 0x7f14940b1c90 2024-04-25T10:11:47.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1489400640 1 --2- 172.21.15.18:0/4062279509 >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 0x7f14940b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:47.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1492800640 1 --2- 172.21.15.18:0/4062279509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14940b1c90 0x7f149415bd80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f14940b24b0 tx=0x7f148c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a238ce4ff9912d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:47.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.645+0000 7f1491400640 1 -- 172.21.15.18:0/4062279509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0b2070 con 0x7f14940b1c90 2024-04-25T10:11:47.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1491400640 1 -- 172.21.15.18:0/4062279509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0a59c0 con 0x7f14940b1c90 2024-04-25T10:11:47.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1491400640 1 -- 172.21.15.18:0/4062279509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a5d90 con 0x7f14940b1c90 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- 172.21.15.18:0/4062279509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14940b1c90 msgr2=0x7f149415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- 172.21.15.18:0/4062279509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14940b1c90 0x7f149415bd80 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f14940b24b0 tx=0x7f148c01c900 comp rx=0 tx=0).stop 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- 172.21.15.18:0/4062279509 shutdown_connections 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- 172.21.15.18:0/4062279509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14940b1c90 0x7f149415bd80 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- 172.21.15.18:0/4062279509 >> v2:172.21.15.167:3300/0 conn(0x7f149415fe50 0x7f14940b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- 172.21.15.18:0/4062279509 >> 172.21.15.18:0/4062279509 conn(0x7f1494066fa0 msgr2=0x7f149406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:47.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- 172.21.15.18:0/4062279509 shutdown_connections 2024-04-25T10:11:47.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- 172.21.15.18:0/4062279509 wait complete. 2024-04-25T10:11:47.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 Processor -- start 2024-04-25T10:11:47.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- start start 2024-04-25T10:11:47.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14940b1c90 0x7f149414bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1494145270 0x7f1494160e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149415f930 con 0x7f149415fe50 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149415f650 con 0x7f14940b1c90 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1498c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14940cdbe0 con 0x7f1494145270 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1492800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1492800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40404/0 (socket says 172.21.15.18:40404) 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1492800640 1 -- 172.21.15.18:0/4150157840 learned_addr learned my addr 172.21.15.18:0/4150157840 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1489400640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1494145270 0x7f1494160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.649+0000 7f1491e00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14940b1c90 0x7f149414bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 -- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1494145270 msgr2=0x7f1494160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1494145270 0x7f1494160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 -- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14940b1c90 msgr2=0x7f149414bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14940b1c90 0x7f149414bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 -- 172.21.15.18:0/4150157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149414c500 con 0x7f149415fe50 2024-04-25T10:11:47.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1492800640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f148c009d90 tx=0x7f148c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0b2050 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0be070 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14940b3950 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0ada90 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14940b3f10 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14940745d0 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f148c0adc30 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 0x7f1470069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.653+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f148c120500 con 0x7f149415fe50 2024-04-25T10:11:47.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.657+0000 7f1491e00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 0x7f1470069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:47.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.657+0000 7f1491e00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 0x7f1470069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f147c005890 tx=0x7f147c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:47.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.657+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f148c016520 con 0x7f149415fe50 2024-04-25T10:11:47.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.857+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f149406e3c0 con 0x7f149415fe50 2024-04-25T10:11:47.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.857+0000 7f148aa00640 1 -- 172.21.15.18:0/4150157840 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f148c0f0b70 con 0x7f149415fe50 2024-04-25T10:11:47.867 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:11:47.867 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:11:47.867 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 msgr2=0x7f1470069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 0x7f1470069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f147c005890 tx=0x7f147c009040 comp rx=0 tx=0).stop 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 msgr2=0x7f1494161360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f148c009d90 tx=0x7f148c0196a0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 shutdown_connections 2024-04-25T10:11:47.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149415fe50 0x7f1494161360 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1470066f60 0x7f1470069420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1494145270 0x7f1494160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 --2- 172.21.15.18:0/4150157840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f14940b1c90 0x7f149414bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 >> 172.21.15.18:0/4150157840 conn(0x7f1494066fa0 msgr2=0x7f149413f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 shutdown_connections 2024-04-25T10:11:47.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:47.861+0000 7f1498c00640 1 -- 172.21.15.18:0/4150157840 wait complete. 2024-04-25T10:11:48.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:10:19.638807+0000', 'modified': '2024-04-25T10:11:45.900024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 97, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8004}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8004': {'gid': 8004, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/2720545627', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2720545627}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2720545627}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:11:48.291 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:11:48.291 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T10:11:48.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 Processor -- start 2024-04-25T10:11:48.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 -- start start 2024-04-25T10:11:48.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 0x7ff2740cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff27406ac10 0x7ff27406b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff274145330 con 0x7ff274144f50 2024-04-25T10:11:48.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27406b5a0 con 0x7ff27406ac10 2024-04-25T10:11:48.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff273200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740cc6d0 con 0x7ff2740cf070 2024-04-25T10:11:48.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff269400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 0x7ff2740cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff271e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7ff274144f50 0x7ff2740cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:39086/0 (socket says 172.21.15.18:39086) 2024-04-25T10:11:48.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff272800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff27406ac10 0x7ff27406b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff271e00640 1 -- 172.21.15.18:0/1908672375 learned_addr learned my addr 172.21.15.18:0/1908672375 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:11:48.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff269400640 1 -- 172.21.15.18:0/1908672375 >> v2:172.21.15.167:3300/0 conn(0x7ff27406ac10 msgr2=0x7ff27406b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff269400640 1 --2- 172.21.15.18:0/1908672375 >> v2:172.21.15.167:3300/0 conn(0x7ff27406ac10 0x7ff27406b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff269400640 1 -- 172.21.15.18:0/1908672375 >> v1:172.21.15.167:6789/0 conn(0x7ff274144f50 legacy=0x7ff2740cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.429+0000 7ff269400640 1 -- 172.21.15.18:0/1908672375 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2740cc990 con 0x7ff2740cf070 2024-04-25T10:11:48.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff269400640 1 --2- 172.21.15.18:0/1908672375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 0x7ff2740cbe50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76c8b17308d2e654 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff271400640 1 -- 172.21.15.18:0/1908672375 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b0070 con 0x7ff2740cf070 2024-04-25T10:11:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff271400640 1 -- 172.21.15.18:0/1908672375 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0ab600 con 0x7ff2740cf070 2024-04-25T10:11:48.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff271400640 1 -- 172.21.15.18:0/1908672375 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0ab9d0 con 0x7ff2740cf070 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 -- 172.21.15.18:0/1908672375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 msgr2=0x7ff2740cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 --2- 172.21.15.18:0/1908672375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 0x7ff2740cbe50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0097c0 tx=0x7ff25c01c410 comp rx=0 tx=0).stop 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 -- 172.21.15.18:0/1908672375 shutdown_connections 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 --2- 172.21.15.18:0/1908672375 >> v2:172.21.15.167:3300/0 conn(0x7ff27406ac10 0x7ff27406b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 --2- 172.21.15.18:0/1908672375 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2740cf070 0x7ff2740cbe50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 -- 172.21.15.18:0/1908672375 >> 172.21.15.18:0/1908672375 conn(0x7ff274099a60 msgr2=0x7ff2740b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 -- 172.21.15.18:0/1908672375 shutdown_connections 2024-04-25T10:11:48.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.433+0000 7ff273200640 1 -- 172.21.15.18:0/1908672375 wait complete. 2024-04-25T10:11:48.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 Processor -- start 2024-04-25T10:11:48.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- start start 2024-04-25T10:11:48.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff27406ac10 0x7ff27415b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff274144f50 0x7ff274143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740adc50 con 0x7ff2740cf070 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740cc390 con 0x7ff274144f50 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740addd0 con 0x7ff27406ac10 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40406/0 (socket says 172.21.15.18:40406) 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 -- 172.21.15.18:0/1213276174 learned_addr learned my addr 172.21.15.18:0/1213276174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff272800640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff274144f50 0x7ff274143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff271e00640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff27406ac10 0x7ff27415b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 -- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff27406ac10 msgr2=0x7ff27415b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff27406ac10 0x7ff27415b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 -- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff274144f50 msgr2=0x7ff274143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff274144f50 0x7ff274143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 -- 172.21.15.18:0/1213276174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27406dea0 con 0x7ff2740cf070 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff269400640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ae040 tx=0x7ff25c0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff26aa00640 1 -- 172.21.15.18:0/1213276174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b0040 con 0x7ff2740cf070 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff26aa00640 1 -- 172.21.15.18:0/1213276174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0b43f0 con 0x7ff2740cf070 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff26aa00640 1 -- 172.21.15.18:0/1213276174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0b47c0 con 0x7ff2740cf070 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27406e400 con 0x7ff2740cf070 2024-04-25T10:11:48.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.437+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff274143000 con 0x7ff2740cf070 2024-04-25T10:11:48.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff26aa00640 1 -- 172.21.15.18:0/1213276174 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff25c0b4960 con 0x7ff2740cf070 2024-04-25T10:11:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff26aa00640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 0x7ff250069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff26aa00640 1 -- 172.21.15.18:0/1213276174 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ff25c11ec00 con 0x7ff2740cf070 2024-04-25T10:11:48.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff27c4de000 1 Processor -- start 2024-04-25T10:11:48.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff271e00640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 0x7ff250069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.441+0000 7ff27c4de000 1 -- start start 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff271e00640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 0x7ff250069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff2640012f0 tx=0x7ff2640019a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea827d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea7de310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea6c55f0 con 0x55c8ea828240 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea62cda0 con 0x55c8ea827920 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea5b5150 con 0x55c8ea7ddf30 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40412/0 (socket says 172.21.15.18:40412) 2024-04-25T10:11:48.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 -- 172.21.15.18:0/4096158994 learned_addr learned my addr 172.21.15.18:0/4096158994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff271e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea827d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff272800640 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea7de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 -- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 msgr2=0x55c8ea7de310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea7de310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 -- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 msgr2=0x55c8ea827d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea827d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 -- 172.21.15.18:0/4096158994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ea5ceca0 con 0x55c8ea828240 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff269400640 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ef330 tx=0x7ff25c0eb770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9badedc880f6c0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff262a00640 1 -- 172.21.15.18:0/4096158994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0f3440 con 0x55c8ea828240 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff262a00640 1 -- 172.21.15.18:0/4096158994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0f7a00 con 0x55c8ea828240 2024-04-25T10:11:48.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff262a00640 1 -- 172.21.15.18:0/4096158994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25c0eba10 con 0x55c8ea828240 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- 172.21.15.18:0/4096158994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 msgr2=0x55c8ea7dd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ef330 tx=0x7ff25c0eb770 comp rx=0 tx=0).stop 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- 172.21.15.18:0/4096158994 shutdown_connections 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea7de310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7dd9f0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 --2- 172.21.15.18:0/4096158994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea827d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- 172.21.15.18:0/4096158994 >> 172.21.15.18:0/4096158994 conn(0x55c8ea7e42a0 msgr2=0x55c8ea7dc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- 172.21.15.18:0/4096158994 shutdown_connections 2024-04-25T10:11:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- 172.21.15.18:0/4096158994 wait complete. 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 -- start start 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.445+0000 7ff27c4de000 1 Processor -- start 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea82ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea82f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea5e7990 con 0x55c8ea828240 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea628e40 con 0x55c8ea827920 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea5b8900 con 0x55c8ea7ddf30 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 10 client.0 _ll_register_callbacks cb 0x55c8ea6e01c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40416/0 (socket says 172.21.15.18:40416) 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 -- 172.21.15.18:0/336375850 learned_addr learned my addr 172.21.15.18:0/336375850 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff271e00640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea82ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff269400640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea82f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 -- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 msgr2=0x55c8ea82ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea82ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 -- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 msgr2=0x55c8ea82f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea82f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 -- 172.21.15.18:0/336375850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8ea5e5630 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff269400640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea82f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff272800640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0149d0 tx=0x7ff26c014e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f5a8654e305f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c022060 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ff26c012b00 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff25c0f7a00 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff26c028050 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 10 client.8070 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55c8ea5b53a0 con 0x55c8ea828240 2024-04-25T10:11:48.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0f7a00 con 0x55c8ea828240 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff26c02b020 con 0x55c8ea828240 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 10 client.8070 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 10 client.8070 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 20 client.8070 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea7e8af0 0x55c8ea7e24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 4 client.8070 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8ea5c8a50 con 0x55c8ea7e8af0 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff271e00640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea7e8af0 0x55c8ea7e24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff271e00640 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea7e8af0 0x55c8ea7e24b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6efb686ebb1e7586 server_cookie=368307e1cee9a88b in_seq=0 out_seq=0 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.449+0000 7ff257400640 10 client.8070 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff257400640 1 -- 172.21.15.18:0/336375850 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c8ea5c8a50 con 0x55c8ea7e8af0 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff257400640 10 client.8070 handle_command_reply: tid=0 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 client.8070 shutdown 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 msgr2=0x55c8ea7e1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0149d0 tx=0x7ff26c014e90 comp rx=0 tx=0).stop 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 shutdown_connections 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea7e8af0 0x55c8ea7e24b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea828240 0x55c8ea7e1aa0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea827920 0x55c8ea82f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 --2- 172.21.15.18:0/336375850 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea82ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 >> 172.21.15.18:0/336375850 conn(0x55c8ea7e42a0 msgr2=0x55c8ea7dc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff257400640 0 client.8070 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 shutdown_connections 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 1 -- 172.21.15.18:0/336375850 wait complete. 2024-04-25T10:11:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.453+0000 7ff27c4de000 20 client.8070 trim_cache size 0 max 16384 2024-04-25T10:11:48.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 Processor -- start 2024-04-25T10:11:48.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- start start 2024-04-25T10:11:48.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7e42a0 0x55c8ea883940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea883e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff274202540 con 0x55c8ea827920 2024-04-25T10:11:48.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2740ca550 con 0x55c8ea7e42a0 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27415cfa0 con 0x55c8ea7ddf30 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40430/0 (socket says 172.21.15.18:40430) 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 -- 172.21.15.18:0/1588819125 learned_addr learned my addr 172.21.15.18:0/1588819125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff271e00640 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7e42a0 0x55c8ea883940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff269400640 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea883e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 -- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 msgr2=0x55c8ea883e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea883e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 -- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7e42a0 msgr2=0x55c8ea883940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7e42a0 0x55c8ea883940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 -- 172.21.15.18:0/1588819125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ea828070 con 0x55c8ea827920 2024-04-25T10:11:48.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff272800640 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001ec0 tx=0x7ff26c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85982f34fe2818e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff262000640 1 -- 172.21.15.18:0/1588819125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c012b00 con 0x55c8ea827920 2024-04-25T10:11:48.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff262000640 1 -- 172.21.15.18:0/1588819125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c012ca0 con 0x55c8ea827920 2024-04-25T10:11:48.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff262000640 1 -- 172.21.15.18:0/1588819125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c004280 con 0x55c8ea827920 2024-04-25T10:11:48.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- 172.21.15.18:0/1588819125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 msgr2=0x55c8ea8843c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001ec0 tx=0x7ff26c017000 comp rx=0 tx=0).stop 2024-04-25T10:11:48.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- 172.21.15.18:0/1588819125 shutdown_connections 2024-04-25T10:11:48.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea8843c0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7ddf30 0x55c8ea883e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 --2- 172.21.15.18:0/1588819125 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7e42a0 0x55c8ea883940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- 172.21.15.18:0/1588819125 >> 172.21.15.18:0/1588819125 conn(0x55c8ea82ee20 msgr2=0x55c8ea813f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- 172.21.15.18:0/1588819125 shutdown_connections 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- 172.21.15.18:0/1588819125 wait complete. 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 -- start start 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.469+0000 7ff27c4de000 1 Processor -- start 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7ddf30 0x55c8ea888290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7e42a0 0x55c8ea843330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea6313d0 con 0x55c8ea827920 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea6e8d50 con 0x55c8ea7ddf30 2024-04-25T10:11:48.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ea5c7980 con 0x55c8ea7e42a0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 10 client.0 _ll_register_callbacks cb 0x7ff25c009420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40446/0 (socket says 172.21.15.18:40446) 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 -- 172.21.15.18:0/690681946 learned_addr learned my addr 172.21.15.18:0/690681946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff271e00640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7ddf30 0x55c8ea888290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff269400640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7e42a0 0x55c8ea843330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 -- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7e42a0 msgr2=0x55c8ea843330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7e42a0 0x55c8ea843330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 -- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7ddf30 msgr2=0x55c8ea888290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7ddf30 0x55c8ea888290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 -- 172.21.15.18:0/690681946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8ea6ae600 con 0x55c8ea827920 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff272800640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001ec0 tx=0x7ff26c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e3a2f438340aa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c012b00 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ff26c01eda0 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff26c012ca0 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff26c003620 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 10 client.8076 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55c8ea5c19b0 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c012ca0 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff26c025020 con 0x55c8ea827920 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 10 client.8076 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 10 client.8076 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 20 client.8076 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:48.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea828240 0x55c8ea843db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 4 client.8076 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c8ea63a2e0 con 0x55c8ea828240 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff271e00640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea828240 0x55c8ea843db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 10 client.8076 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff271e00640 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea828240 0x55c8ea843db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=724cc297d1c5c56d server_cookie=6ad3b244356c097a in_seq=0 out_seq=0 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 1 -- 172.21.15.18:0/690681946 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55c8ea63a2e0 con 0x55c8ea828240 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff257400640 10 client.8076 handle_command_reply: tid=0 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 client.8076 shutdown 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 msgr2=0x55c8ea843870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.473+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7ff26c001ec0 tx=0x7ff26c0046d0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 shutdown_connections 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55c8ea828240 0x55c8ea843db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c8ea827920 0x55c8ea843870 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c8ea7e42a0 0x55c8ea843330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 --2- 172.21.15.18:0/690681946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c8ea7ddf30 0x55c8ea888290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff257400640 0 client.8076 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 >> 172.21.15.18:0/690681946 conn(0x55c8ea82ee20 msgr2=0x55c8ea7e24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 shutdown_connections 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 1 -- 172.21.15.18:0/690681946 wait complete. 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff27c4de000 20 client.8076 trim_cache size 0 max 16384 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:11:48.488 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 8004, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.5819821860000003, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 76, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 97, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 97, 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 5.527955897 2024-04-25T10:11:48.489 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 msgr2=0x7ff250069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 0x7ff250069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ff2640012f0 tx=0x7ff2640019a0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 msgr2=0x7ff27415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0ae040 tx=0x7ff25c0191b0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 shutdown_connections 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff274144f50 0x7ff274143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2740cf070 0x7ff27415e4f0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff250066f60 0x7ff250069420 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 --2- 172.21.15.18:0/1213276174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff27406ac10 0x7ff27415b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 >> 172.21.15.18:0/1213276174 conn(0x7ff274099a60 msgr2=0x7ff2740af390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 shutdown_connections 2024-04-25T10:11:48.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.477+0000 7ff273200640 1 -- 172.21.15.18:0/1213276174 wait complete. 2024-04-25T10:11:48.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:11:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 Processor -- start 2024-04-25T10:11:48.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 -- start start 2024-04-25T10:11:48.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc17c15b860 0x7fc17c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc17c072c70 0x7fc17c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17c15c180 con 0x7fc17c0cd540 2024-04-25T10:11:48.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c15f4e0 con 0x7fc17c15b860 2024-04-25T10:11:48.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc182a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c15c430 con 0x7fc17c072c70 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc17c15b860 0x7fc17c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc17c15b860 0x7fc17c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40452/0 (socket says 172.21.15.18:40452) 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 -- 172.21.15.18:0/2931102258 learned_addr learned my addr 172.21.15.18:0/2931102258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc180a00640 1 --1- 172.21.15.18:0/2931102258 >> v1:172.21.15.18:6789/0 conn(0x7fc17c0cd540 0x7fc17c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57140/0 (socket says 172.21.15.18:57140) 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc173400640 1 --2- 172.21.15.18:0/2931102258 >> v2:172.21.15.167:3300/0 conn(0x7fc17c072c70 0x7fc17c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 -- 172.21.15.18:0/2931102258 >> v2:172.21.15.167:3300/0 conn(0x7fc17c072c70 msgr2=0x7fc17c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 --2- 172.21.15.18:0/2931102258 >> v2:172.21.15.167:3300/0 conn(0x7fc17c072c70 0x7fc17c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 -- 172.21.15.18:0/2931102258 >> v1:172.21.15.18:6789/0 conn(0x7fc17c0cd540 legacy=0x7fc17c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17b400640 1 -- 172.21.15.18:0/2931102258 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784124417 0 0) 0x7fc17c15c180 con 0x7fc17c0cd540 2024-04-25T10:11:48.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.637+0000 7fc17be00640 1 -- 172.21.15.18:0/2931102258 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c15c710 con 0x7fc17c15b860 2024-04-25T10:11:48.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc17be00640 1 --2- 172.21.15.18:0/2931102258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c15b860 0x7fc17c15bc40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0b34c0 tx=0x7fc16c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8291a476454794 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc17b400640 1 -- 172.21.15.18:0/2931102258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0aa5f0 con 0x7fc17c15b860 2024-04-25T10:11:48.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc17b400640 1 -- 172.21.15.18:0/2931102258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0af070 con 0x7fc17c15b860 2024-04-25T10:11:48.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc17b400640 1 -- 172.21.15.18:0/2931102258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0aa9b0 con 0x7fc17c15b860 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 -- 172.21.15.18:0/2931102258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c15b860 msgr2=0x7fc17c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 --2- 172.21.15.18:0/2931102258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c15b860 0x7fc17c15bc40 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0b34c0 tx=0x7fc16c01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 -- 172.21.15.18:0/2931102258 shutdown_connections 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 --2- 172.21.15.18:0/2931102258 >> v2:172.21.15.167:3300/0 conn(0x7fc17c072c70 0x7fc17c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 --2- 172.21.15.18:0/2931102258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c15b860 0x7fc17c15bc40 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 -- 172.21.15.18:0/2931102258 >> 172.21.15.18:0/2931102258 conn(0x7fc17c0b2400 msgr2=0x7fc17c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 -- 172.21.15.18:0/2931102258 shutdown_connections 2024-04-25T10:11:48.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.641+0000 7fc182a00640 1 -- 172.21.15.18:0/2931102258 wait complete. 2024-04-25T10:11:48.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 Processor -- start 2024-04-25T10:11:48.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- start start 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17c0cd540 0x7fc17c158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 0x7fc17c0b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c0731d0 con 0x7fc17c072c70 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c073050 con 0x7fc17c0cd540 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c06b320 con 0x7fc17c15b860 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40464/0 (socket says 172.21.15.18:40464) 2024-04-25T10:11:48.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 -- 172.21.15.18:0/373714624 learned_addr learned my addr 172.21.15.18:0/373714624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc173400640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17c0cd540 0x7fc17c158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc180a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 0x7fc17c0b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 -- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 msgr2=0x7fc17c0b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 0x7fc17c0b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 -- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17c0cd540 msgr2=0x7fc17c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17c0cd540 0x7fc17c158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 -- 172.21.15.18:0/373714624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c155250 con 0x7fc17c072c70 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc180a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 0x7fc17c0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc17be00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0ac040 tx=0x7fc16c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0bd5f0 con 0x7fc17c072c70 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c0bd7b0 con 0x7fc17c072c70 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c0bdba0 con 0x7fc17c072c70 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c155530 con 0x7fc17c072c70 2024-04-25T10:11:48.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c155af0 con 0x7fc17c072c70 2024-04-25T10:11:48.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.645+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c0745d0 con 0x7fc17c072c70 2024-04-25T10:11:48.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.649+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc16c0b33f0 con 0x7fc17c072c70 2024-04-25T10:11:48.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.649+0000 7fc178c00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 0x7fc158069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:48.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.649+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fc16c11f3e0 con 0x7fc17c072c70 2024-04-25T10:11:48.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.649+0000 7fc173400640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 0x7fc158069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:48.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.649+0000 7fc173400640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 0x7fc158069420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0b4070 tx=0x7fc164008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:48.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.653+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc16c016110 con 0x7fc17c072c70 2024-04-25T10:11:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.853+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc17c072550 con 0x7fc17c072c70 2024-04-25T10:11:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.853+0000 7fc178c00640 1 -- 172.21.15.18:0/373714624 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc16c0efa50 con 0x7fc17c072c70 2024-04-25T10:11:48.863 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 msgr2=0x7fc158069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 0x7fc158069420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0b4070 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 msgr2=0x7fc17c149c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0ac040 tx=0x7fc16c01ad30 comp rx=0 tx=0).stop 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 shutdown_connections 2024-04-25T10:11:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc158066f60 0x7fc158069420 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc17c15b860 0x7fc17c0b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc17c0cd540 0x7fc17c158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 --2- 172.21.15.18:0/373714624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc17c072c70 0x7fc17c149c20 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 >> 172.21.15.18:0/373714624 conn(0x7fc17c0b2400 msgr2=0x7fc17c0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 shutdown_connections 2024-04-25T10:11:48.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:48.857+0000 7fc182a00640 1 -- 172.21.15.18:0/373714624 wait complete. 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:11:48.884 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:11:48.885 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:11:48.885 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:11:48.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:48.885 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:11:48.895 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:11:48.895 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:11:48.895 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41996sec preferred_lft 41996sec 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.896 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:11:48.897 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:11:48.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:48.899 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:11:48.957 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:11:48.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:48.959 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:11:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:11:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:11:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:11:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:11:49.013 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:11:49.014 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:11:49.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:11:49.014 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:11:49.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.105 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:11:49.114 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:11:49.114 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:11:49.115 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:11:49.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:11:49.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:11:49.183 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:11:49.235 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:11:49.236 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:11:49.236 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:11:49.286 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:11:49.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:11:49.376 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:11:49.376 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:11:49.389 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:11:49.389 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:11:49.389 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:11:49.389 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:11:49.389 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:11:49.393 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:11:49.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:11:49.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.413 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:11:49.469 INFO:teuthology.orchestra.run.smithi018.stdout:client36719 2024-04-25T10:11:49.469 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:11:49.469 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:11:49.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T10:11:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.697+0000 7f6b12000640 1 Processor -- start 2024-04-25T10:11:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.697+0000 7f6b12000640 1 -- start start 2024-04-25T10:11:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b12000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b12000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 0x7f6b0c06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b12000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0c15b9f0 con 0x7f6b0c0cf610 2024-04-25T10:11:49.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b12000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0c0cf180 con 0x7f6b0c06fb80 2024-04-25T10:11:49.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b12000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c0727a0 con 0x7f6b0c15b610 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:47424/0 (socket says 172.21.15.18:47424) 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 -- 172.21.15.18:0/3434394159 learned_addr learned my addr 172.21.15.18:0/3434394159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3434394159 >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 0x7f6b0c06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 -- 172.21.15.18:0/3434394159 >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 msgr2=0x7f6b0c06bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3434394159 >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 0x7f6b0c06bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 -- 172.21.15.18:0/3434394159 >> v1:172.21.15.167:6789/0 conn(0x7f6b0c0cf610 legacy=0x7f6b0c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b10c00640 1 -- 172.21.15.18:0/3434394159 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c072a80 con 0x7f6b0c15b610 2024-04-25T10:11:49.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.701+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3434394159 >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 0x7f6b0c06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3434394159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009870 tx=0x7f6afc01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b96fa4953b80df1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b0be00640 1 -- 172.21.15.18:0/3434394159 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0a9610 con 0x7f6b0c15b610 2024-04-25T10:11:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b0be00640 1 -- 172.21.15.18:0/3434394159 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc0a97b0 con 0x7f6b0c15b610 2024-04-25T10:11:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b0be00640 1 -- 172.21.15.18:0/3434394159 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0a9b80 con 0x7f6b0c15b610 2024-04-25T10:11:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 -- 172.21.15.18:0/3434394159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 msgr2=0x7f6b0c0cd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 --2- 172.21.15.18:0/3434394159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009870 tx=0x7f6afc01c530 comp rx=0 tx=0).stop 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 -- 172.21.15.18:0/3434394159 shutdown_connections 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 --2- 172.21.15.18:0/3434394159 >> v2:172.21.15.167:3300/0 conn(0x7f6b0c06fb80 0x7f6b0c06bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 --2- 172.21.15.18:0/3434394159 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c0cd2a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 -- 172.21.15.18:0/3434394159 >> 172.21.15.18:0/3434394159 conn(0x7f6b0c071930 msgr2=0x7f6b0c071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 -- 172.21.15.18:0/3434394159 shutdown_connections 2024-04-25T10:11:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.705+0000 7f6b12000640 1 -- 172.21.15.18:0/3434394159 wait complete. 2024-04-25T10:11:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 Processor -- start 2024-04-25T10:11:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- start start 2024-04-25T10:11:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 0x7f6b0c15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c168300 con 0x7f6b0c06fb80 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c06c570 con 0x7f6b0c0cf610 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c168480 con 0x7f6b0c15b610 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40470/0 (socket says 172.21.15.18:40470) 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 -- 172.21.15.18:0/1453027249 learned_addr learned my addr 172.21.15.18:0/1453027249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 0x7f6b0c15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b11600640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 -- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 msgr2=0x7f6b0c155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 -- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 msgr2=0x7f6b0c15e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 0x7f6b0c15e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 -- 172.21.15.18:0/1453027249 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c15fa10 con 0x7f6b0c06fb80 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 0x7f6b0c15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b10c00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f6afc01abe0 tx=0x7f6afc0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b09600640 1 -- 172.21.15.18:0/1453027249 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0a9610 con 0x7f6b0c06fb80 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b09600640 1 -- 172.21.15.18:0/1453027249 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc0bb610 con 0x7f6b0c06fb80 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b09600640 1 -- 172.21.15.18:0/1453027249 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0bba00 con 0x7f6b0c06fb80 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b0c156a80 con 0x7f6b0c06fb80 2024-04-25T10:11:49.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.709+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b0c157040 con 0x7f6b0c06fb80 2024-04-25T10:11:49.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b09600640 1 -- 172.21.15.18:0/1453027249 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6afc0bbba0 con 0x7f6b0c06fb80 2024-04-25T10:11:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b09600640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 0x7f6ae8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b09600640 1 -- 172.21.15.18:0/1453027249 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6afc11f820 con 0x7f6b0c06fb80 2024-04-25T10:11:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 0x7f6ae8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 Processor -- start 2024-04-25T10:11:49.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 -- start start 2024-04-25T10:11:49.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 0x7f6ae8069420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c067130 tx=0x7f6af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92e1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba9296d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bba917df40 con 0x55bba9297290 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bba90e5070 con 0x55bba92e15b0 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bba906d1a0 con 0x55bba92e0c90 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40476/0 (socket says 172.21.15.18:40476) 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 -- 172.21.15.18:0/3401290033 learned_addr learned my addr 172.21.15.18:0/3401290033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92e1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba9296d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 -- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 msgr2=0x55bba92e1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92e1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 -- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 msgr2=0x55bba9296d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba9296d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.713+0000 7f6b11600640 1 -- 172.21.15.18:0/3401290033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bba906b510 con 0x55bba9297290 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b11600640 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001c60 tx=0x7f6b04002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890be3bd32fbe3c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b01600640 1 -- 172.21.15.18:0/3401290033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04019070 con 0x55bba9297290 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b01600640 1 -- 172.21.15.18:0/3401290033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04003b90 con 0x55bba9297290 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b01600640 1 -- 172.21.15.18:0/3401290033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0400e860 con 0x55bba9297290 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3401290033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 msgr2=0x55bba9297670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001c60 tx=0x7f6b04002120 comp rx=0 tx=0).stop 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3401290033 shutdown_connections 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba9297670 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba9296d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3401290033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92e1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3401290033 >> 172.21.15.18:0/3401290033 conn(0x55bba9293240 msgr2=0x55bba9295630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3401290033 shutdown_connections 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3401290033 wait complete. 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- start start 2024-04-25T10:11:49.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 Processor -- start 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba929c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92ce450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bba909f6c0 con 0x55bba92e0c90 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bba90e1110 con 0x55bba92e15b0 2024-04-25T10:11:49.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bba90e4380 con 0x55bba9297290 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b16a1a000 10 client.0 _ll_register_callbacks cb 0x55bba9282570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40492/0 (socket says 172.21.15.18:40492) 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 -- 172.21.15.18:0/3619037568 learned_addr learned my addr 172.21.15.18:0/3619037568 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba929c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b11600640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 -- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 msgr2=0x55bba929c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba929c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 -- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 msgr2=0x55bba92ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.717+0000 7f6b03e00640 1 -- 172.21.15.18:0/3619037568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bba906d3b0 con 0x55bba92e0c90 2024-04-25T10:11:49.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b03e00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f6af4015720 tx=0x7f6af40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbfc0bd99110c38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4026020 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6af4016a70 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b04003b90 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6af4030050 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 10 client.8094 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55bba9166e00 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04003b90 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6af4033020 con 0x55bba92e0c90 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 10 client.8094 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 10 client.8094 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:49.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 20 client.8094 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba92e74e0 0x55bba92e78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 4 client.8094 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bba9080d60 con 0x55bba92e74e0 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba92e74e0 0x55bba92e78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b10c00640 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba92e74e0 0x55bba92e78c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f77b9936c9253ee4 server_cookie=4954933f79cd60ac in_seq=0 out_seq=0 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 10 client.8094 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 1 -- 172.21.15.18:0/3619037568 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55bba9080d60 con 0x55bba92e74e0 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 10 client.8094 handle_command_reply: tid=0 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 client.8094 shutdown 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 msgr2=0x55bba92cdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f6af4015720 tx=0x7f6af40046d0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 shutdown_connections 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba92e74e0 0x55bba92e78c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba92cdf10 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6afa000640 0 client.8094 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/3619037568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba929c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 >> 172.21.15.18:0/3619037568 conn(0x55bba9293240 msgr2=0x55bba9295ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 shutdown_connections 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 1 -- 172.21.15.18:0/3619037568 wait complete. 2024-04-25T10:11:49.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.721+0000 7f6b16a1a000 20 client.8094 trim_cache size 0 max 16384 2024-04-25T10:11:49.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 Processor -- start 2024-04-25T10:11:49.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 -- start start 2024-04-25T10:11:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba933d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba933df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c2035f0 con 0x55bba92e0c90 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c2027d0 con 0x55bba92e15b0 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c140a20 con 0x55bba9297290 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40498/0 (socket says 172.21.15.18:40498) 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 -- 172.21.15.18:0/1579418797 learned_addr learned my addr 172.21.15.18:0/1579418797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 -- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 msgr2=0x55bba933d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba933d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 -- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 msgr2=0x55bba933df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b11600640 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba933df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba933df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 -- 172.21.15.18:0/1579418797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bba92e13e0 con 0x55bba92e0c90 2024-04-25T10:11:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b11600640 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba933df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:49.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b03e00640 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f6af40092e0 tx=0x7f6af401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7827a36f041c241 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b00c00640 1 -- 172.21.15.18:0/1579418797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af4026040 con 0x55bba92e0c90 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b00c00640 1 -- 172.21.15.18:0/1579418797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4038030 con 0x55bba92e0c90 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.737+0000 7f6b00c00640 1 -- 172.21.15.18:0/1579418797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af401c030 con 0x55bba92e0c90 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/1579418797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 msgr2=0x55bba933da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f6af40092e0 tx=0x7f6af401a000 comp rx=0 tx=0).stop 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/1579418797 shutdown_connections 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba933df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba92e0c90 0x55bba933da20 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/1579418797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba9297290 0x55bba933d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/1579418797 >> 172.21.15.18:0/1579418797 conn(0x55bba9293240 msgr2=0x55bba9295630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/1579418797 shutdown_connections 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/1579418797 wait complete. 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- start start 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 Processor -- start 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92fdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92fe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bba919bf20 con 0x55bba9297290 2024-04-25T10:11:49.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b0c2021d0 con 0x55bba92e15b0 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bba92a0200 con 0x55bba92e0c90 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 10 client.0 _ll_register_callbacks cb 0x7f6b040016f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40504/0 (socket says 172.21.15.18:40504) 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 -- 172.21.15.18:0/927763538 learned_addr learned my addr 172.21.15.18:0/927763538 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b03e00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92fdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b11600640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92fe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 -- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 msgr2=0x55bba92fdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92fdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 -- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 msgr2=0x55bba92fe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92fe000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 -- 172.21.15.18:0/927763538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bba913cc50 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b11600640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b10c00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009870 tx=0x7f6afc006d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73258beb7f75b2ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc0c0040 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6afc0ee170 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6af4038030 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6afc11de60 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 10 client.8100 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55bba90ad120 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af4038030 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6afc0ba030 con 0x55bba9297290 2024-04-25T10:11:49.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 10 client.8100 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 10 client.8100 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 20 client.8100 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba9341100 0x55bba9341510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 4 client.8100 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.741+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x55bba90f25b0 con 0x55bba9341100 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b03e00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba9341100 0x55bba9341510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b03e00640 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba9341100 0x55bba9341510 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877fd0ae92bdf479 server_cookie=c6dbfce10e019882 in_seq=0 out_seq=0 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6afa000640 10 client.8100 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6afa000640 1 -- 172.21.15.18:0/927763538 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bba90f25b0 con 0x55bba9341100 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6afa000640 10 client.8100 handle_command_reply: tid=0 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 client.8100 shutdown 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 msgr2=0x55bba92e60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f6afc009870 tx=0x7f6afc006d00 comp rx=0 tx=0).stop 2024-04-25T10:11:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 shutdown_connections 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55bba9341100 0x55bba9341510 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bba92e15b0 0x55bba92fe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55bba92e0c90 0x55bba92fdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 --2- 172.21.15.18:0/927763538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bba9297290 0x55bba92e60b0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6afa000640 0 client.8100 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 >> 172.21.15.18:0/927763538 conn(0x55bba9293240 msgr2=0x55bba9295ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 shutdown_connections 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 1 -- 172.21.15.18:0/927763538 wait complete. 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b16a1a000 20 client.8100 trim_cache size 0 max 16384 2024-04-25T10:11:49.758 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:49.759 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:11:49.759 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "6a9a22fe-38d3-40e7-b8e4-cc8fd8ee4059", 2024-04-25T10:11:49.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:11:49.759 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 msgr2=0x7f6ae8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 0x7f6ae8069420 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c067130 tx=0x7f6af4008040 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 msgr2=0x7f6b0c15ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f6afc01abe0 tx=0x7f6afc0192d0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 shutdown_connections 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ae8066f60 0x7f6ae8069420 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b0c15b610 0x7f6b0c155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b0c0cf610 0x7f6b0c15e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 --2- 172.21.15.18:0/1453027249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b0c06fb80 0x7f6b0c15ddc0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 >> 172.21.15.18:0/1453027249 conn(0x7f6b0c071930 msgr2=0x7f6b0c0cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 shutdown_connections 2024-04-25T10:11:49.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f6b12000640 1 -- 172.21.15.18:0/1453027249 wait complete. 2024-04-25T10:11:49.761 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-04-25T10:11:49.745+0000 7f301a000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x562fa4986100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:11:49.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:11:49.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:11:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 Processor -- start 2024-04-25T10:11:49.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 -- start start 2024-04-25T10:11:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 0x7fbfb00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb015e040 con 0x7fbfb006bf30 2024-04-25T10:11:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00cff80 con 0x7fbfb015dc60 2024-04-25T10:11:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.909+0000 7fbfb7400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00d0260 con 0x7fbfb009a170 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb4a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 0x7fbfb00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:47472/0 (socket says 172.21.15.18:47472) 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 -- 172.21.15.18:0/3185009173 learned_addr learned my addr 172.21.15.18:0/3185009173 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfafe00640 1 -- 172.21.15.18:0/3185009173 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729280337 0 0) 0x7fbfb015e040 con 0x7fbfb006bf30 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfafe00640 1 -- 172.21.15.18:0/3185009173 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003530 con 0x7fbfb006bf30 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 -- 172.21.15.18:0/3185009173 >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 msgr2=0x7fbfb00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 --2- 172.21.15.18:0/3185009173 >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 0x7fbfb00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 -- 172.21.15.18:0/3185009173 >> v1:172.21.15.167:6789/0 conn(0x7fbfb006bf30 legacy=0x7fbfb0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 -- 172.21.15.18:0/3185009173 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00d0540 con 0x7fbfb009a170 2024-04-25T10:11:49.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/3185009173 >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 0x7fbfb00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:11:49.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfb5400640 1 --2- 172.21.15.18:0/3185009173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2f7f6273ea674c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.913+0000 7fbfafe00640 1 -- 172.21.15.18:0/3185009173 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80a5830 con 0x7fbfb009a170 2024-04-25T10:11:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfafe00640 1 -- 172.21.15.18:0/3185009173 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa80a59d0 con 0x7fbfb009a170 2024-04-25T10:11:49.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfafe00640 1 -- 172.21.15.18:0/3185009173 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80a5d80 con 0x7fbfb009a170 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- 172.21.15.18:0/3185009173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 msgr2=0x7fbfb00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- 172.21.15.18:0/3185009173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa801c970 comp rx=0 tx=0).stop 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- 172.21.15.18:0/3185009173 shutdown_connections 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- 172.21.15.18:0/3185009173 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb009a170 0x7fbfb00cf8a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- 172.21.15.18:0/3185009173 >> v2:172.21.15.167:3300/0 conn(0x7fbfb015dc60 0x7fbfb00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- 172.21.15.18:0/3185009173 >> 172.21.15.18:0/3185009173 conn(0x7fbfb00b3200 msgr2=0x7fbfb00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- 172.21.15.18:0/3185009173 shutdown_connections 2024-04-25T10:11:49.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- 172.21.15.18:0/3185009173 wait complete. 2024-04-25T10:11:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 Processor -- start 2024-04-25T10:11:49.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- start start 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb006bf30 0x7fbfb0153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb015dc60 0x7fbfb00ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cc6f0 con 0x7fbfb009a170 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cc570 con 0x7fbfb015dc60 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb7400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cc870 con 0x7fbfb006bf30 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40510/0 (socket says 172.21.15.18:40510) 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfa7e00640 1 -- 172.21.15.18:0/1519026749 learned_addr learned my addr 172.21.15.18:0/1519026749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb5400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb015dc60 0x7fbfb00ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb006bf30 0x7fbfb0153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfa7e00640 1 -- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb006bf30 msgr2=0x7fbfb0153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.917+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb006bf30 0x7fbfb0153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfa7e00640 1 -- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb015dc60 msgr2=0x7fbfb00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb015dc60 0x7fbfb00ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfa7e00640 1 -- 172.21.15.18:0/1519026749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00b6fa0 con 0x7fbfb009a170 2024-04-25T10:11:49.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c460 tx=0x7fbf9800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 -- 172.21.15.18:0/1519026749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98017070 con 0x7fbfb009a170 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 -- 172.21.15.18:0/1519026749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf980052f0 con 0x7fbfb009a170 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb01f63c0 con 0x7fbfb009a170 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 -- 172.21.15.18:0/1519026749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98003840 con 0x7fbfb009a170 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb01f6980 con 0x7fbfb009a170 2024-04-25T10:11:49.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 -- 172.21.15.18:0/1519026749 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf9801a070 con 0x7fbfb009a170 2024-04-25T10:11:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 0x7fbf8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfad600640 1 -- 172.21.15.18:0/1519026749 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbf98084690 con 0x7fbfb009a170 2024-04-25T10:11:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfba805000 1 Processor -- start 2024-04-25T10:11:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.921+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 0x7fbf8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- start start 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 0x7fbf8c069420 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfb015d5e0 tx=0x7fbfa0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df95857db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9580e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9565aff0 con 0x55df958582f0 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df955e3150 con 0x55df9580e0a0 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df95657090 con 0x55df958579d0 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40522/0 (socket says 172.21.15.18:40522) 2024-04-25T10:11:49.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 -- 172.21.15.18:0/524645704 learned_addr learned my addr 172.21.15.18:0/524645704 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df95857db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfb5400640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9580e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 -- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 msgr2=0x55df95857db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df95857db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 -- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 msgr2=0x55df9580e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9580e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 -- 172.21.15.18:0/524645704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df957f10d0 con 0x55df958582f0 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df95857db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfb5400640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9580e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800a040 tx=0x7fbf98054970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3297e98e5ca5cba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa5600640 1 -- 172.21.15.18:0/524645704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9805d360 con 0x55df958582f0 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa5600640 1 -- 172.21.15.18:0/524645704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98053000 con 0x55df958582f0 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfa5600640 1 -- 172.21.15.18:0/524645704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98054150 con 0x55df958582f0 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- 172.21.15.18:0/524645704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 msgr2=0x55df9580db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800a040 tx=0x7fbf98054970 comp rx=0 tx=0).stop 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- 172.21.15.18:0/524645704 shutdown_connections 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9580e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9580db60 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 --2- 172.21.15.18:0/524645704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df95857db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- 172.21.15.18:0/524645704 >> 172.21.15.18:0/524645704 conn(0x55df9580a020 msgr2=0x55df9580c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- 172.21.15.18:0/524645704 shutdown_connections 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- 172.21.15.18:0/524645704 wait complete. 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 -- start start 2024-04-25T10:11:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.925+0000 7fbfba805000 1 Processor -- start 2024-04-25T10:11:49.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9583c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9583cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df9561f250 con 0x55df958582f0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df95615690 con 0x55df9580e0a0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df955e3a40 con 0x55df958579d0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 10 client.0 _ll_register_callbacks cb 0x55df957f8e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9583c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40538/0 (socket says 172.21.15.18:40538) 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 -- 172.21.15.18:0/925851986 learned_addr learned my addr 172.21.15.18:0/925851986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9583cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 -- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 msgr2=0x55df9583cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9583cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 -- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 msgr2=0x55df9583c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9583c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 -- 172.21.15.18:0/925851986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df957081c0 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb5400640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa801b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf1a164b971c1b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa80bc070 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbfa80c1d60 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf98053000 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfa80a5af0 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 10 client.8109 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55df95704170 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf98053000 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbfa80a5c90 con 0x55df958582f0 2024-04-25T10:11:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 10 client.8109 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 10 client.8109 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 20 client.8109 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df95867c80 0x55df9586a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 4 client.8109 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df955f6c60 con 0x55df95867c80 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df95867c80 0x55df9586a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df95867c80 0x55df9586a070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8649ab5e840e9e server_cookie=fd103fa8774975ec in_seq=0 out_seq=0 2024-04-25T10:11:49.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.929+0000 7fbf9e000640 10 client.8109 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbf9e000640 1 -- 172.21.15.18:0/925851986 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df955f6c60 con 0x55df95867c80 2024-04-25T10:11:49.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbf9e000640 10 client.8109 handle_command_reply: tid=0 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 client.8109 shutdown 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 msgr2=0x55df9583d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fbfa8009e50 tx=0x7fbfa801b1b0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 shutdown_connections 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df95867c80 0x55df9586a070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df958582f0 0x55df9583d270 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9583cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbf9e000640 0 client.8109 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 --2- 172.21.15.18:0/925851986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df9580e0a0 0x55df9583c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 >> 172.21.15.18:0/925851986 conn(0x55df9580a020 msgr2=0x55df9580cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 shutdown_connections 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 1 -- 172.21.15.18:0/925851986 wait complete. 2024-04-25T10:11:49.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.933+0000 7fbfba805000 20 client.8109 trim_cache size 0 max 16384 2024-04-25T10:11:49.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.945+0000 7fbfba805000 1 Processor -- start 2024-04-25T10:11:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.945+0000 7fbfba805000 1 -- start start 2024-04-25T10:11:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df958b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df958b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0203180 con 0x55df9580e0a0 2024-04-25T10:11:49.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0202380 con 0x55df958582f0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0201780 con 0x55df958579d0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40540/0 (socket says 172.21.15.18:40540) 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 -- 172.21.15.18:0/2928249016 learned_addr learned my addr 172.21.15.18:0/2928249016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb5400640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df958b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 -- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 msgr2=0x55df958b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df958b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df958b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 -- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 msgr2=0x55df958b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df958b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 -- 172.21.15.18:0/2928249016 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df956a1de0 con 0x55df9580e0a0 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb5400640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df958b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df958b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:11:49.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0011ec0 tx=0x7fbfa0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8198c96e253fd446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfa4c00640 1 -- 172.21.15.18:0/2928249016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa002a2c0 con 0x55df9580e0a0 2024-04-25T10:11:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfa4c00640 1 -- 172.21.15.18:0/2928249016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002f070 con 0x55df9580e0a0 2024-04-25T10:11:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfa4c00640 1 -- 172.21.15.18:0/2928249016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa002a680 con 0x55df9580e0a0 2024-04-25T10:11:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- 172.21.15.18:0/2928249016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 msgr2=0x55df958b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0011ec0 tx=0x7fbfa0019000 comp rx=0 tx=0).stop 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- 172.21.15.18:0/2928249016 shutdown_connections 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df958b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df958b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 --2- 172.21.15.18:0/2928249016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df958b40f0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- 172.21.15.18:0/2928249016 >> 172.21.15.18:0/2928249016 conn(0x55df9580a020 msgr2=0x55df95864fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- 172.21.15.18:0/2928249016 shutdown_connections 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- 172.21.15.18:0/2928249016 wait complete. 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 -- start start 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.949+0000 7fbfba805000 1 Processor -- start 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9586a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df9586ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df955f5e00 con 0x55df9580e0a0 2024-04-25T10:11:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0201d80 con 0x55df958582f0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df9565a300 con 0x55df958579d0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 10 client.0 _ll_register_callbacks cb 0x55df957d9040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40552/0 (socket says 172.21.15.18:40552) 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 -- 172.21.15.18:0/1100841956 learned_addr learned my addr 172.21.15.18:0/1100841956 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9586a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb5400640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df9586ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 -- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 msgr2=0x55df9586a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9586a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 -- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 msgr2=0x55df9586ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df9586ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 -- 172.21.15.18:0/1100841956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df955fc8e0 con 0x55df9580e0a0 2024-04-25T10:11:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfb4a00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009450 tx=0x7fbfa0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f164688628dbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:11:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:11:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00059a0 con 0x55df9580e0a0 2024-04-25T10:11:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbfa0005b40 con 0x55df9580e0a0 2024-04-25T10:11:49.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfa002f070 con 0x55df9580e0a0 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfa0043050 con 0x55df9580e0a0 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 10 client.8115 fetch_fsmap learned FSMap version 76 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55df956b48f0 con 0x55df9580e0a0 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa002f070 con 0x55df9580e0a0 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbfa0046020 con 0x55df9580e0a0 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 10 client.8115 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 10 client.8115 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 20 client.8115 populate_metadata read hostname 'smithi018' 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df958bdf50 0x55df958c0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 4 client.8115 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df95668530 con 0x55df958bdf50 2024-04-25T10:11:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df958bdf50 0x55df958c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfa7e00640 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df958bdf50 0x55df958c0340 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30649b12786fffc9 server_cookie=f228353092dafc0c in_seq=0 out_seq=0 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 10 client.8115 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 1 -- 172.21.15.18:0/1100841956 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55df95668530 con 0x55df958bdf50 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 10 client.8115 handle_command_reply: tid=0 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 client.8115 shutdown 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 msgr2=0x55df9586a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009450 tx=0x7fbfa0004740 comp rx=0 tx=0).stop 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 shutdown_connections 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55df958bdf50 0x55df958c0340 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df958582f0 0x55df9586ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df958579d0 0x55df9586a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 --2- 172.21.15.18:0/1100841956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df9580e0a0 0x55df9586a380 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbf9e000640 0 client.8115 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 >> 172.21.15.18:0/1100841956 conn(0x55df9580a020 msgr2=0x55df958560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 shutdown_connections 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 1 -- 172.21.15.18:0/1100841956 wait complete. 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.953+0000 7fbfba805000 20 client.8115 trim_cache size 0 max 16384 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout: "6a9a22fe-38d3-40e7-b8e4-cc8fd8ee4059": { 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/dir", 2024-04-25T10:11:49.967 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "6a9a22fe-38d3-40e7-b8e4-cc8fd8ee4059", 2024-04-25T10:11:49.968 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:11:49.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:49.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:11:49.968 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:11:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 msgr2=0x7fbf8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 0x7fbf8c069420 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfb015d5e0 tx=0x7fbfa0009190 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 msgr2=0x7fbfb01fa030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800c460 tx=0x7fbf9800c920 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 shutdown_connections 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbfb015dc60 0x7fbfb00ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb009a170 0x7fbfb01fa030 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbf8c066f60 0x7fbf8c069420 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 --2- 172.21.15.18:0/1519026749 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbfb006bf30 0x7fbfb0153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 >> 172.21.15.18:0/1519026749 conn(0x7fbfb00b3200 msgr2=0x7fbfb00ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 shutdown_connections 2024-04-25T10:11:49.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:11:49.957+0000 7fbfb7400640 1 -- 172.21.15.18:0/1519026749 wait complete. 2024-04-25T10:11:49.983 INFO:tasks.cephfs.filesystem:scrub status for tag:6a9a22fe-38d3-40e7-b8e4-cc8fd8ee4059 - {'path': '/dir', 'tag': '6a9a22fe-38d3-40e7-b8e4-cc8fd8ee4059', 'options': 'recursive,repair'} 2024-04-25T10:11:51.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:11:51.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:12:19.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:19.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T10:12:20.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.133+0000 7f620ca00640 1 Processor -- start 2024-04-25T10:12:20.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.133+0000 7f620ca00640 1 -- start start 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f620ca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6208144120 0x7f620815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f620ca00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62080ccbf0 0x7f620815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f620ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620815bc40 con 0x7f620815ee60 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f620ca00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620815e490 con 0x7f6208144120 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f620ca00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620815b3a0 con 0x7f62080ccbf0 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6208144120 0x7f620815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6208144120 0x7f620815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55424/0 (socket says 172.21.15.18:55424) 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 -- 172.21.15.18:0/85677809 learned_addr learned my addr 172.21.15.18:0/85677809 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f61fd400640 1 --2- 172.21.15.18:0/85677809 >> v2:172.21.15.167:3300/0 conn(0x7f62080ccbf0 0x7f620815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 -- 172.21.15.18:0/85677809 >> v2:172.21.15.167:3300/0 conn(0x7f62080ccbf0 msgr2=0x7f620815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 --2- 172.21.15.18:0/85677809 >> v2:172.21.15.167:3300/0 conn(0x7f62080ccbf0 0x7f620815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 -- 172.21.15.18:0/85677809 >> v1:172.21.15.167:6789/0 conn(0x7f620815ee60 legacy=0x7f62080b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.137+0000 7f6205e00640 1 -- 172.21.15.18:0/85677809 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620815b680 con 0x7f6208144120 2024-04-25T10:12:20.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6205e00640 1 --2- 172.21.15.18:0/85677809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208144120 0x7f620815acd0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f620806b870 tx=0x7f61f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d86e5a75084e1ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6205400640 1 -- 172.21.15.18:0/85677809 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b1070 con 0x7f6208144120 2024-04-25T10:12:20.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6205400640 1 -- 172.21.15.18:0/85677809 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00ac600 con 0x7f6208144120 2024-04-25T10:12:20.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6205400640 1 -- 172.21.15.18:0/85677809 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ac9d0 con 0x7f6208144120 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- 172.21.15.18:0/85677809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208144120 msgr2=0x7f620815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- 172.21.15.18:0/85677809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208144120 0x7f620815acd0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f620806b870 tx=0x7f61f001c490 comp rx=0 tx=0).stop 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- 172.21.15.18:0/85677809 shutdown_connections 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- 172.21.15.18:0/85677809 >> v2:172.21.15.167:3300/0 conn(0x7f62080ccbf0 0x7f620815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- 172.21.15.18:0/85677809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208144120 0x7f620815acd0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- 172.21.15.18:0/85677809 >> 172.21.15.18:0/85677809 conn(0x7f6208067080 msgr2=0x7f620806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- 172.21.15.18:0/85677809 shutdown_connections 2024-04-25T10:12:20.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- 172.21.15.18:0/85677809 wait complete. 2024-04-25T10:12:20.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 Processor -- start 2024-04-25T10:12:20.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- start start 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62080ccbf0 0x7f620813f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 0x7f62081f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62081675c0 con 0x7f620815ee60 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208167440 con 0x7f6208144120 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f620ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208167740 con 0x7f62080ccbf0 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6206800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.141+0000 7f6206800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55430/0 (socket says 172.21.15.18:55430) 2024-04-25T10:12:20.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 -- 172.21.15.18:0/1972155137 learned_addr learned my addr 172.21.15.18:0/1972155137 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fd400640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 0x7f62081f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6205e00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62080ccbf0 0x7f620813f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 -- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62080ccbf0 msgr2=0x7f620813f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62080ccbf0 0x7f620813f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 -- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 msgr2=0x7f62081f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 0x7f62081f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 -- 172.21.15.18:0/1972155137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62081fa300 con 0x7f620815ee60 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fd400640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 0x7f62081f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f6206800640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f620000c730 tx=0x7f620000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 -- 172.21.15.18:0/1972155137 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200003b80 con 0x7f620815ee60 2024-04-25T10:12:20.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 -- 172.21.15.18:0/1972155137 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200003d20 con 0x7f620815ee60 2024-04-25T10:12:20.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62081fa5e0 con 0x7f620815ee60 2024-04-25T10:12:20.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 -- 172.21.15.18:0/1972155137 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000aa30 con 0x7f620815ee60 2024-04-25T10:12:20.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62080afb60 con 0x7f620815ee60 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 -- 172.21.15.18:0/1972155137 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f620000abd0 con 0x7f620815ee60 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 0x7f61e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.145+0000 7f61fea00640 1 -- 172.21.15.18:0/1972155137 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6200085150 con 0x7f620815ee60 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 Processor -- start 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- start start 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 0x7f61e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 0x7f61e4069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae000 tx=0x7f61f00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c578b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c579480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920c3c5ff0 con 0x55920c5c29d0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920c34e150 con 0x55920c5c32f0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55920c3c2090 con 0x55920c5790a0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55440/0 (socket says 172.21.15.18:55440) 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 -- 172.21.15.18:0/2881727033 learned_addr learned my addr 172.21.15.18:0/2881727033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f61fd400640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c578b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6206800640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c579480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 -- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 msgr2=0x55920c579480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c579480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 -- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 msgr2=0x55920c578b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c578b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 -- 172.21.15.18:0/2881727033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920c55c0d0 con 0x55920c5c29d0 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6206800640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c579480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f61fd400640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c578b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f6205e00640 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f61f00af040 tx=0x7f61f0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d01b7037b25e3c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f61f6a00640 1 -- 172.21.15.18:0/2881727033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b1040 con 0x55920c5c29d0 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f61f6a00640 1 -- 172.21.15.18:0/2881727033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00c7070 con 0x55920c5c29d0 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f61f6a00640 1 -- 172.21.15.18:0/2881727033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00b6440 con 0x55920c5c29d0 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- 172.21.15.18:0/2881727033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 msgr2=0x55920c5c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f61f00af040 tx=0x7f61f0004740 comp rx=0 tx=0).stop 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- 172.21.15.18:0/2881727033 shutdown_connections 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c579480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c578b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 --2- 172.21.15.18:0/2881727033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5c2db0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- 172.21.15.18:0/2881727033 >> 172.21.15.18:0/2881727033 conn(0x55920c575020 msgr2=0x55920c577440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- 172.21.15.18:0/2881727033 shutdown_connections 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.149+0000 7f620fecf000 1 -- 172.21.15.18:0/2881727033 wait complete. 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- start start 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 Processor -- start 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c5a77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 0x55920c5a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920c38a250 con 0x55920c5c32f0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920c380690 con 0x55920c5c29d0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55920c34ea40 con 0x55920c5790a0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 10 client.0 _ll_register_callbacks cb 0x55920c563e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55448/0 (socket says 172.21.15.18:55448) 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 -- 172.21.15.18:0/3915080037 learned_addr learned my addr 172.21.15.18:0/3915080037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6205e00640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c5a77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61fd400640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 0x55920c5a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 -- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 msgr2=0x55920c5a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c5a77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 -- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 msgr2=0x55920c5a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 0x55920c5a7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 -- 172.21.15.18:0/3915080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55920c4731c0 con 0x55920c5c32f0 2024-04-25T10:12:20.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61fd400640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 0x55920c5a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6206800640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f62000556a0 tx=0x7f620000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a24bd977bdd75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200059860 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6200051d80 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f00c7070 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f620005de20 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 10 client.8127 fetch_fsmap learned FSMap version 76 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55920c46f170 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00c7070 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6200054b60 con 0x55920c5c32f0 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 10 client.8127 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 10 client.8127 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 20 client.8127 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d2c80 0x55920c5d5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 4 client.8127 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55920c361c60 con 0x55920c5d2c80 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.153+0000 7f6205e00640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d2c80 0x55920c5d5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f6205e00640 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d2c80 0x55920c5d5070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fff59cdeac4c205 server_cookie=4869072a2d07e103 in_seq=0 out_seq=0 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f61eb400640 10 client.8127 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f61eb400640 1 -- 172.21.15.18:0/3915080037 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55920c361c60 con 0x55920c5d2c80 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f61eb400640 10 client.8127 handle_command_reply: tid=0 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 client.8127 shutdown 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 msgr2=0x55920c5a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f62000556a0 tx=0x7f620000cf80 comp rx=0 tx=0).stop 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 shutdown_connections 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d2c80 0x55920c5d5070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c32f0 0x55920c5a8270 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c29d0 0x55920c5a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 --2- 172.21.15.18:0/3915080037 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c5a77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f61eb400640 0 client.8127 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 >> 172.21.15.18:0/3915080037 conn(0x55920c575020 msgr2=0x55920c577ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 shutdown_connections 2024-04-25T10:12:20.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 1 -- 172.21.15.18:0/3915080037 wait complete. 2024-04-25T10:12:20.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.157+0000 7f620fecf000 20 client.8127 trim_cache size 0 max 16384 2024-04-25T10:12:20.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 Processor -- start 2024-04-25T10:12:20.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- start start 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c61f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c61fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208203800 con 0x55920c5c29d0 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62082029e0 con 0x55920c5c32f0 2024-04-25T10:12:20.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208201e10 con 0x55920c5790a0 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55454/0 (socket says 172.21.15.18:55454) 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 -- 172.21.15.18:0/3194361224 learned_addr learned my addr 172.21.15.18:0/3194361224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f6206800640 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c61fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f6205e00640 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c61f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 -- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 msgr2=0x55920c61f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c61f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 -- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 msgr2=0x55920c61fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c61fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 -- 172.21.15.18:0/3194361224 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920c40cde0 con 0x55920c5c29d0 2024-04-25T10:12:20.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61fd400640 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f620813e850 tx=0x7f61f8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7676a467f46e7fd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61f6000640 1 -- 172.21.15.18:0/3194361224 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f801a030 con 0x55920c5c29d0 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61f6000640 1 -- 172.21.15.18:0/3194361224 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f80138d0 con 0x55920c5c29d0 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f61f6000640 1 -- 172.21.15.18:0/3194361224 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8013aa0 con 0x55920c5c29d0 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- 172.21.15.18:0/3194361224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 msgr2=0x55920c61f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f620813e850 tx=0x7f61f8007dd0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- 172.21.15.18:0/3194361224 shutdown_connections 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5c32f0 0x55920c61fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c61f630 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 --2- 172.21.15.18:0/3194361224 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5790a0 0x55920c61f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- 172.21.15.18:0/3194361224 >> 172.21.15.18:0/3194361224 conn(0x55920c575020 msgr2=0x55920c5cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.173+0000 7f620fecf000 1 -- 172.21.15.18:0/3194361224 shutdown_connections 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- 172.21.15.18:0/3194361224 wait complete. 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- start start 2024-04-25T10:12:20.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 Processor -- start 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5790a0 0x55920c5d5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5c32f0 0x55920c5d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920c360e00 con 0x55920c5c29d0 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62082023e0 con 0x55920c5790a0 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55920c3c5300 con 0x55920c5c32f0 2024-04-25T10:12:20.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 10 client.0 _ll_register_callbacks cb 0x55920c544040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55460/0 (socket says 172.21.15.18:55460) 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 -- 172.21.15.18:0/3818559983 learned_addr learned my addr 172.21.15.18:0/3818559983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f6205e00640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5790a0 0x55920c5d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f6206800640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5c32f0 0x55920c5d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 -- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5c32f0 msgr2=0x55920c5d5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5c32f0 0x55920c5d5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 -- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5790a0 msgr2=0x55920c5d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5790a0 0x55920c5d5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 -- 172.21.15.18:0/3818559983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55920c3678e0 con 0x55920c5c29d0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61fd400640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x55920c381350 tx=0x7f61f8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b536dbef77841b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:20.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8016460 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f61f8029d90 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61f80138d0 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f8030050 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 10 client.8133 fetch_fsmap learned FSMap version 76 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55920c41f8f0 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f80138d0 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f61f8033020 con 0x55920c5c29d0 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 10 client.8133 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 10 client.8133 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.c 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 20 client.8133 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d67f0 0x55920c62af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 4 client.8133 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:12:20.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.177+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55920c3d3530 con 0x55920c5d67f0 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f6205e00640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d67f0 0x55920c62af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f6205e00640 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d67f0 0x55920c62af60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0e39aa99a0906e server_cookie=49dc865cb2817e99 in_seq=0 out_seq=0 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f61eb400640 10 client.8133 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f61eb400640 1 -- 172.21.15.18:0/3818559983 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55920c3d3530 con 0x55920c5d67f0 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f61eb400640 10 client.8133 handle_command_reply: tid=0 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 client.8133 shutdown 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 msgr2=0x55920c5d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x55920c381350 tx=0x7f61f8004740 comp rx=0 tx=0).stop 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 shutdown_connections 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x55920c5d67f0 0x55920c62af60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55920c5c32f0 0x55920c5d5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55920c5c29d0 0x55920c5d58c0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f61eb400640 0 client.8133 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 --2- 172.21.15.18:0/3818559983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55920c5790a0 0x55920c5d5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 >> 172.21.15.18:0/3818559983 conn(0x55920c575020 msgr2=0x55920c5c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 shutdown_connections 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 1 -- 172.21.15.18:0/3818559983 wait complete. 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620fecf000 20 client.8133 trim_cache size 0 max 16384 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:12:20.193 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 msgr2=0x7f61e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 0x7f61e4069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae000 tx=0x7f61f00a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 msgr2=0x7f620806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f620000c730 tx=0x7f620000cbf0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 shutdown_connections 2024-04-25T10:12:20.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f620815ee60 0x7f620806d2d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6208144120 0x7f62081f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f61e4066f60 0x7f61e4069420 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 --2- 172.21.15.18:0/1972155137 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62080ccbf0 0x7f620813f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 >> 172.21.15.18:0/1972155137 conn(0x7f6208067080 msgr2=0x7f620806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 shutdown_connections 2024-04-25T10:12:20.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.181+0000 7f620ca00640 1 -- 172.21.15.18:0/1972155137 wait complete. 2024-04-25T10:12:20.209 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:12:20.209 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:20.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 Processor -- start 2024-04-25T10:12:20.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 -- start start 2024-04-25T10:12:20.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1a2c15b2f0 0x7f1a2c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2c06dad0 0x7f1a2c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c15def0 con 0x7f1a2c0b2dc0 2024-04-25T10:12:20.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c15e1b0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.345+0000 7f1a30a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c15e490 con 0x7f1a2c15b2f0 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2c06dad0 0x7f1a2c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a21400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1a2c0b2dc0 0x7f1a2c06dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50008/0 (socket says 172.21.15.18:50008) 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a21400640 1 -- 172.21.15.18:0/2804015193 learned_addr learned my addr 172.21.15.18:0/2804015193 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a2c06dad0 0x7f1a2c0b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55466/0 (socket says 172.21.15.18:55466) 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a29e00640 1 --2- 172.21.15.18:0/2804015193 >> v2:172.21.15.167:3300/0 conn(0x7f1a2c15b2f0 0x7f1a2c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 -- 172.21.15.18:0/2804015193 >> v2:172.21.15.167:3300/0 conn(0x7f1a2c15b2f0 msgr2=0x7f1a2c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 --2- 172.21.15.18:0/2804015193 >> v2:172.21.15.167:3300/0 conn(0x7f1a2c15b2f0 0x7f1a2c0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 -- 172.21.15.18:0/2804015193 >> v1:172.21.15.18:6789/0 conn(0x7f1a2c0b2dc0 legacy=0x7f1a2c06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 -- 172.21.15.18:0/2804015193 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c15e770 con 0x7f1a2c06dad0 2024-04-25T10:12:20.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a29400640 1 -- 172.21.15.18:0/2804015193 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845972526 0 0) 0x7f1a2c15def0 con 0x7f1a2c0b2dc0 2024-04-25T10:12:20.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a2a800640 1 --2- 172.21.15.18:0/2804015193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c0b3780 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c072e20 tx=0x7f1a2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8a9d880eaf766c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a29400640 1 -- 172.21.15.18:0/2804015193 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240a7070 con 0x7f1a2c06dad0 2024-04-25T10:12:20.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a29400640 1 -- 172.21.15.18:0/2804015193 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a240b0070 con 0x7f1a2c06dad0 2024-04-25T10:12:20.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.349+0000 7f1a29400640 1 -- 172.21.15.18:0/2804015193 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c15b8e0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- 172.21.15.18:0/2804015193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 msgr2=0x7f1a2c0b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- 172.21.15.18:0/2804015193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c0b3780 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c072e20 tx=0x7f1a2401c450 comp rx=0 tx=0).stop 2024-04-25T10:12:20.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- 172.21.15.18:0/2804015193 shutdown_connections 2024-04-25T10:12:20.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- 172.21.15.18:0/2804015193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c0b3780 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- 172.21.15.18:0/2804015193 >> v2:172.21.15.167:3300/0 conn(0x7f1a2c15b2f0 0x7f1a2c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- 172.21.15.18:0/2804015193 >> 172.21.15.18:0/2804015193 conn(0x7f1a2c0b23b0 msgr2=0x7f1a2c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- 172.21.15.18:0/2804015193 shutdown_connections 2024-04-25T10:12:20.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- 172.21.15.18:0/2804015193 wait complete. 2024-04-25T10:12:20.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 Processor -- start 2024-04-25T10:12:20.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- start start 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0b2dc0 0x7f1a2c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15b2f0 0x7f1a2c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c16a880 con 0x7f1a2c06dad0 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c161730 con 0x7f1a2c15b2f0 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a30a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c16aa00 con 0x7f1a2c0b2dc0 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55480/0 (socket says 172.21.15.18:55480) 2024-04-25T10:12:20.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 -- 172.21.15.18:0/647875855 learned_addr learned my addr 172.21.15.18:0/647875855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a21400640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0b2dc0 0x7f1a2c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a2a800640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15b2f0 0x7f1a2c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 -- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0b2dc0 msgr2=0x7f1a2c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0b2dc0 0x7f1a2c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 -- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15b2f0 msgr2=0x7f1a2c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15b2f0 0x7f1a2c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 -- 172.21.15.18:0/647875855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c154e80 con 0x7f1a2c06dad0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.353+0000 7f1a29e00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c007e40 tx=0x7f1a1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c014620 con 0x7f1a2c06dad0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c019070 con 0x7f1a2c06dad0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c014a00 con 0x7f1a2c06dad0 2024-04-25T10:12:20.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c155100 con 0x7f1a2c06dad0 2024-04-25T10:12:20.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c1565a0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0745d0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a1c014ba0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 0x7f1a08069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f1a1c085be0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.357+0000 7f1a21400640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 0x7f1a08069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.361+0000 7f1a21400640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 0x7f1a08069450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0d03d0 tx=0x7f1a14007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.361+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a2c154e80 con 0x7f1a2c06dad0 2024-04-25T10:12:20.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.557+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a2c0d0ab0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.557+0000 7f1a22a00640 1 -- 172.21.15.18:0/647875855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f1a1c0568a0 con 0x7f1a2c06dad0 2024-04-25T10:12:20.567 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:20.567 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:12:20.567 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 msgr2=0x7f1a08069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 0x7f1a08069450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0d03d0 tx=0x7f1a14007b60 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 msgr2=0x7f1a2c1553e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c007e40 tx=0x7f1a1c00e4b0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 shutdown_connections 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15b2f0 0x7f1a2c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f90 0x7f1a08069450 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0b2dc0 0x7f1a2c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 --2- 172.21.15.18:0/647875855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c06dad0 0x7f1a2c1553e0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 >> 172.21.15.18:0/647875855 conn(0x7f1a2c0b23b0 msgr2=0x7f1a2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 shutdown_connections 2024-04-25T10:12:20.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.561+0000 7f1a30a00640 1 -- 172.21.15.18:0/647875855 wait complete. 2024-04-25T10:12:20.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T10:12:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 Processor -- start 2024-04-25T10:12:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 -- start start 2024-04-25T10:12:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f478415acd0 0x7f478415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47840b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f478415bc40 con 0x7f4784144120 2024-04-25T10:12:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f478415e490 con 0x7f478415acd0 2024-04-25T10:12:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f478a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478415b150 con 0x7f478415ee60 2024-04-25T10:12:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4784144120 0x7f47840ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50012/0 (socket says 172.21.15.18:50012) 2024-04-25T10:12:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 -- 172.21.15.18:0/1026828996 learned_addr learned my addr 172.21.15.18:0/1026828996 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f477be00640 1 --2- 172.21.15.18:0/1026828996 >> v2:172.21.15.167:3300/0 conn(0x7f478415acd0 0x7f478415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783e00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47840b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375285272 0 0) 0x7f478415bc40 con 0x7f4784144120 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4768003530 con 0x7f4784144120 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3243630392 0 0) 0x7f4768003530 con 0x7f4784144120 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 msgr2=0x7f47840b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47840b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 >> v2:172.21.15.167:3300/0 conn(0x7f478415acd0 msgr2=0x7f478415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 --2- 172.21.15.18:0/1026828996 >> v2:172.21.15.167:3300/0 conn(0x7f478415acd0 0x7f478415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478415b3a0 con 0x7f4784144120 2024-04-25T10:12:20.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f4774001680 con 0x7f4784144120 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 >> v1:172.21.15.18:6789/0 conn(0x7f4784144120 legacy=0x7f47840ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47680039c0 0x7f4768003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478415e490 con 0x7f47680039c0 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478415b150 con 0x7f4768004810 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476800ba50 con 0x7f478415ee60 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47680039c0 0x7f4768003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f477be00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783e00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 -- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 msgr2=0x7f47680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 -- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4768004810 msgr2=0x7f4768004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783400640 1 -- 172.21.15.18:0/1026828996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4768003530 con 0x7f47680039c0 2024-04-25T10:12:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.725+0000 7f4783e00640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f478415ee60 0x7f47680051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f4783400640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47680039c0 0x7f4768003de0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f477400c190 tx=0x7f477401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648da3340b76786b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774007c70 con 0x7f47680039c0 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47740a9020 con 0x7f47680039c0 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f4782a00640 1 -- 172.21.15.18:0/1026828996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4774005b00 con 0x7f47680039c0 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 -- 172.21.15.18:0/1026828996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47680039c0 msgr2=0x7f4768003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 --2- 172.21.15.18:0/1026828996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47680039c0 0x7f4768003de0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f477400c190 tx=0x7f477401cbe0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f4783e00640 1 -- 172.21.15.18:0/1026828996 reap_dead start 2024-04-25T10:12:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 -- 172.21.15.18:0/1026828996 shutdown_connections 2024-04-25T10:12:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 -- 172.21.15.18:0/1026828996 >> 172.21.15.18:0/1026828996 conn(0x7f4784067080 msgr2=0x7f478406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 -- 172.21.15.18:0/1026828996 shutdown_connections 2024-04-25T10:12:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.729+0000 7f478a400640 1 -- 172.21.15.18:0/1026828996 wait complete. 2024-04-25T10:12:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 Processor -- start 2024-04-25T10:12:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- start start 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 0x7f478415a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 0x7f4784140170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47841657c0 con 0x7f47841406b0 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784165640 con 0x7f47680039c0 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784165940 con 0x7f47840cc060 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55500/0 (socket says 172.21.15.18:55500) 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 -- 172.21.15.18:0/3925923425 learned_addr learned my addr 172.21.15.18:0/3925923425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 0x7f478415a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f477be00640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 0x7f4784140170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 -- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 msgr2=0x7f4784140170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 0x7f4784140170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 -- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 msgr2=0x7f478415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 0x7f478415a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 -- 172.21.15.18:0/3925923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478415a810 con 0x7f47841406b0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f477be00640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 0x7f4784140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 0x7f478415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f4783e00640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f478415e230 tx=0x7f477c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f477b400640 1 -- 172.21.15.18:0/3925923425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c010e80 con 0x7f47841406b0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f477b400640 1 -- 172.21.15.18:0/3925923425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0039a0 con 0x7f47841406b0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f477b400640 1 -- 172.21.15.18:0/3925923425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c003d70 con 0x7f47841406b0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4784140b50 con 0x7f47841406b0 2024-04-25T10:12:20.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.733+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4784141110 con 0x7f47841406b0 2024-04-25T10:12:20.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f477b400640 1 -- 172.21.15.18:0/3925923425 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f477c01e020 con 0x7f47841406b0 2024-04-25T10:12:20.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f477b400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 0x7f4760069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f477b400640 1 -- 172.21.15.18:0/3925923425 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f477c085ad0 con 0x7f47841406b0 2024-04-25T10:12:20.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f4783400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 0x7f4760069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f478d85e000 1 Processor -- start 2024-04-25T10:12:20.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.737+0000 7f478d85e000 1 -- start start 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 0x7f4760069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f477400c190 tx=0x7f478415e400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2ced3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2bd4ba0 con 0x5606d2ced8e0 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2b3a090 con 0x5606d2d372e0 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d2ac2160 con 0x5606d2d37c00 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55514/0 (socket says 172.21.15.18:55514) 2024-04-25T10:12:20.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 -- 172.21.15.18:0/2846057728 learned_addr learned my addr 172.21.15.18:0/2846057728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f477be00640 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2ced3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783400640 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 -- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 msgr2=0x5606d2ced3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2ced3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 -- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 msgr2=0x5606d2d376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 -- 172.21.15.18:0/2846057728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d2be3c20 con 0x5606d2ced8e0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4783e00640 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f477c0524f0 tx=0x7f477c056850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad013ac3a36fc5a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4773e00640 1 -- 172.21.15.18:0/2846057728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c05e7a0 con 0x5606d2ced8e0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4773e00640 1 -- 172.21.15.18:0/2846057728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c054390 con 0x5606d2ced8e0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f4773e00640 1 -- 172.21.15.18:0/2846057728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c013340 con 0x5606d2ced8e0 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- 172.21.15.18:0/2846057728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 msgr2=0x5606d2cedcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f477c0524f0 tx=0x7f477c056850 comp rx=0 tx=0).stop 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- 172.21.15.18:0/2846057728 shutdown_connections 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2cedcc0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2ced3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 --2- 172.21.15.18:0/2846057728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- 172.21.15.18:0/2846057728 >> 172.21.15.18:0/2846057728 conn(0x5606d2ce9890 msgr2=0x5606d2cebc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- 172.21.15.18:0/2846057728 shutdown_connections 2024-04-25T10:12:20.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- 172.21.15.18:0/2846057728 wait complete. 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 -- start start 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.741+0000 7f478d85e000 1 Processor -- start 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d3eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2d25090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2b36130 con 0x5606d2ced8e0 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2afe130 con 0x5606d2d372e0 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d2bf8300 con 0x5606d2d37c00 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 10 client.0 _ll_register_callbacks cb 0x5606d2cd8bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55522/0 (socket says 172.21.15.18:55522) 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 -- 172.21.15.18:0/2613540014 learned_addr learned my addr 172.21.15.18:0/2613540014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f477be00640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d3eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783e00640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2d25090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 -- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 msgr2=0x5606d2d25090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2d25090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 -- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 msgr2=0x5606d2d3eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d3eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 -- 172.21.15.18:0/2613540014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606d2b17060 con 0x5606d2ced8e0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4783400640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f477401cc20 tx=0x7f4774019980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92487176db0312fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740c9060 con 0x5606d2ced8e0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f47740b4030 con 0x5606d2ced8e0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f477c054390 con 0x5606d2ced8e0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47740cf050 con 0x5606d2ced8e0 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 10 client.8154 fetch_fsmap learned FSMap version 76 2024-04-25T10:12:20.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x5606d2adb7c0 con 0x5606d2ced8e0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c054390 con 0x5606d2ced8e0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4774007070 con 0x5606d2ced8e0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 10 client.8154 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 10 client.8154 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 20 client.8154 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d25e00 0x5606d2d261e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 4 client.8154 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5606d2ad5cd0 con 0x5606d2d25e00 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f477be00640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d25e00 0x5606d2d261e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f477be00640 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d25e00 0x5606d2d261e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7a1aa86af2ae5e server_cookie=3b9245e5920da6e4 in_seq=0 out_seq=0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 10 client.8154 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 1 -- 172.21.15.18:0/2613540014 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5606d2ad5cd0 con 0x5606d2d25e00 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 10 client.8154 handle_command_reply: tid=0 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 client.8154 shutdown 2024-04-25T10:12:20.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 msgr2=0x5606d2d3e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f477401cc20 tx=0x7f4774019980 comp rx=0 tx=0).stop 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 shutdown_connections 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d25e00 0x5606d2d261e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d37c00 0x5606d2d25090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d3eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 --2- 172.21.15.18:0/2613540014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2ced8e0 0x5606d2d3e640 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f4770c00640 0 client.8154 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.745+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 >> 172.21.15.18:0/2613540014 conn(0x5606d2ce9890 msgr2=0x5606d2cec510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.749+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 shutdown_connections 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.749+0000 7f478d85e000 1 -- 172.21.15.18:0/2613540014 wait complete. 2024-04-25T10:12:20.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.749+0000 7f478d85e000 20 client.8154 trim_cache size 0 max 16384 2024-04-25T10:12:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 Processor -- start 2024-04-25T10:12:20.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- start start 2024-04-25T10:12:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2ced8e0 0x5606d2d9bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d9c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784203030 con 0x5606d2d37c00 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4784167b30 con 0x5606d2d372e0 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4784202a40 con 0x5606d2ced8e0 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55534/0 (socket says 172.21.15.18:55534) 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 -- 172.21.15.18:0/2322000386 learned_addr learned my addr 172.21.15.18:0/2322000386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783400640 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2ced8e0 0x5606d2d9bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f477be00640 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d9c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 -- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2ced8e0 msgr2=0x5606d2d9bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2ced8e0 0x5606d2d9bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 -- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 msgr2=0x5606d2d9c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d9c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 -- 172.21.15.18:0/2322000386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606d2af5fc0 con 0x5606d2d37c00 2024-04-25T10:12:20.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4783e00640 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f477c055d40 tx=0x7f477c055f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701066b8c952669 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4773400640 1 -- 172.21.15.18:0/2322000386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c054130 con 0x5606d2d37c00 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4773400640 1 -- 172.21.15.18:0/2322000386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c054390 con 0x5606d2d37c00 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f4773400640 1 -- 172.21.15.18:0/2322000386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c013340 con 0x5606d2d37c00 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- 172.21.15.18:0/2322000386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 msgr2=0x5606d2d9c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f477c055d40 tx=0x7f477c055f90 comp rx=0 tx=0).stop 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- 172.21.15.18:0/2322000386 shutdown_connections 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d9c790 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2d372e0 0x5606d2d9c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 --2- 172.21.15.18:0/2322000386 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2ced8e0 0x5606d2d9bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- 172.21.15.18:0/2322000386 >> 172.21.15.18:0/2322000386 conn(0x5606d2ce9890 msgr2=0x5606d2d36260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- 172.21.15.18:0/2322000386 shutdown_connections 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- 172.21.15.18:0/2322000386 wait complete. 2024-04-25T10:12:20.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 -- start start 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.761+0000 7f478d85e000 1 Processor -- start 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2ced8e0 0x5606d2d9ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d372e0 0x5606d2da0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2ad4e70 con 0x5606d2d37c00 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606d2ac2a50 con 0x5606d2ced8e0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5606d2b393a0 con 0x5606d2d372e0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 10 client.0 _ll_register_callbacks cb 0x5606d2ae6240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55542/0 (socket says 172.21.15.18:55542) 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 -- 172.21.15.18:0/524991688 learned_addr learned my addr 172.21.15.18:0/524991688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783400640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2ced8e0 0x5606d2d9ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f477be00640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d372e0 0x5606d2da0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 -- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d372e0 msgr2=0x5606d2da0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d372e0 0x5606d2da0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 -- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2ced8e0 msgr2=0x5606d2d9ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2ced8e0 0x5606d2d9ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 -- 172.21.15.18:0/524991688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606d2b939e0 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783e00640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f477c0524f0 tx=0x7f477c007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879b63d5b70372db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c079060 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f477c083040 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f477c054390 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f477c013550 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 10 client.8160 fetch_fsmap learned FSMap version 76 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x5606d2ad9630 con 0x5606d2d37c00 2024-04-25T10:12:20.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c054390 con 0x5606d2d37c00 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 76) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f477c0562f0 con 0x5606d2d37c00 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 10 client.8160 fetch_fsmap finished waiting for FSMap version 76 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 10 client.8160 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 20 client.8160 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d3c310 0x5606d2d3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 4 client.8160 mds_command: new command op to 8004 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 --> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5606d2b475d0 con 0x5606d2d3c310 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783400640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d3c310 0x5606d2d3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4783400640 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d3c310 0x5606d2d3c6f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e44d71259f5f9bb server_cookie=8b18a4c9d17518f7 in_seq=0 out_seq=0 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 10 client.8160 ms_handle_connect on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 1 -- 172.21.15.18:0/524991688 <== mds.0 v2:172.21.15.18:6833/2720545627 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5606d2b475d0 con 0x5606d2d3c310 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 10 client.8160 handle_command_reply: tid=0 2024-04-25T10:12:20.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 client.8160 shutdown 2024-04-25T10:12:20.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 msgr2=0x5606d2d3b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f477c0524f0 tx=0x7f477c007040 comp rx=0 tx=0).stop 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 shutdown_connections 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:6833/2720545627,v1:172.21.15.18:6835/2720545627] conn(0x5606d2d3c310 0x5606d2d3c6f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5606d2d37c00 0x5606d2d3b9b0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5606d2d372e0 0x5606d2da0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f4770c00640 0 client.8160 ms_handle_reset on v2:172.21.15.18:6833/2720545627 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 --2- 172.21.15.18:0/524991688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5606d2ced8e0 0x5606d2d9ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 >> 172.21.15.18:0/524991688 conn(0x5606d2ce9890 msgr2=0x5606d2d36af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 shutdown_connections 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 1 -- 172.21.15.18:0/524991688 wait complete. 2024-04-25T10:12:20.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.765+0000 7f478d85e000 20 client.8160 trim_cache size 0 max 16384 2024-04-25T10:12:20.780 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:20.780 INFO:teuthology.orchestra.run.smithi018.stdout:[] 2024-04-25T10:12:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 msgr2=0x7f4760069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 0x7f4760069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f477400c190 tx=0x7f478415e400 comp rx=0 tx=0).stop 2024-04-25T10:12:20.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 msgr2=0x7f47840b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f478415e230 tx=0x7f477c009f90 comp rx=0 tx=0).stop 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 shutdown_connections 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47841406b0 0x7f47840b0700 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4760066f60 0x7f4760069420 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f47840cc060 0x7f4784140170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 --2- 172.21.15.18:0/3925923425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47680039c0 0x7f478415a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 >> 172.21.15.18:0/3925923425 conn(0x7f4784067080 msgr2=0x7f47840b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 shutdown_connections 2024-04-25T10:12:20.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.769+0000 7f478a400640 1 -- 172.21.15.18:0/3925923425 wait complete. 2024-04-25T10:12:20.794 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T10:12:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.925+0000 7f02c2800640 1 Processor -- start 2024-04-25T10:12:20.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.925+0000 7f02c2800640 1 -- start start 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc070490 0x7f02bc15db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c2800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f02bc099a60 0x7f02bc15e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c2800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc099fd0 con 0x7f02bc1617a0 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c2800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02bc09a2b0 con 0x7f02bc099a60 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc09a590 con 0x7f02bc070490 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f02bc1617a0 0x7f02bc0d0480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50024/0 (socket says 172.21.15.18:50024) 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1400640 1 -- 172.21.15.18:0/3538689352 learned_addr learned my addr 172.21.15.18:0/3538689352 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1e00640 1 --2- 172.21.15.18:0/3538689352 >> v2:172.21.15.18:3300/0 conn(0x7f02bc099a60 0x7f02bc15e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c0a00640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc070490 0x7f02bc15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1e00640 1 -- 172.21.15.18:0/3538689352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc070490 msgr2=0x7f02bc15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02bbe00640 1 -- 172.21.15.18:0/3538689352 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617603672 0 0) 0x7f02bc099fd0 con 0x7f02bc1617a0 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1e00640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc070490 0x7f02bc15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1e00640 1 -- 172.21.15.18:0/3538689352 >> v1:172.21.15.18:6789/0 conn(0x7f02bc1617a0 legacy=0x7f02bc0d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.929+0000 7f02c1e00640 1 -- 172.21.15.18:0/3538689352 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc09a870 con 0x7f02bc099a60 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c1e00640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15e040 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009d90 tx=0x7f02b401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c70cc213110e77b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02bbe00640 1 -- 172.21.15.18:0/3538689352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40b2070 con 0x7f02bc099a60 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02bbe00640 1 -- 172.21.15.18:0/3538689352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b40a5940 con 0x7f02bc099a60 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02bbe00640 1 -- 172.21.15.18:0/3538689352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b40a5d10 con 0x7f02bc099a60 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- 172.21.15.18:0/3538689352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 msgr2=0x7f02bc15e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15e040 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f02b4009d90 tx=0x7f02b401c970 comp rx=0 tx=0).stop 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- 172.21.15.18:0/3538689352 shutdown_connections 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15e040 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- 172.21.15.18:0/3538689352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc070490 0x7f02bc15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- 172.21.15.18:0/3538689352 >> 172.21.15.18:0/3538689352 conn(0x7f02bc0b3050 msgr2=0x7f02bc0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- 172.21.15.18:0/3538689352 shutdown_connections 2024-04-25T10:12:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- 172.21.15.18:0/3538689352 wait complete. 2024-04-25T10:12:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 Processor -- start 2024-04-25T10:12:20.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- start start 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02bc070490 0x7f02bc15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc1617a0 0x7f02bc1f9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc16ac10 con 0x7f02bc099a60 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc16aa90 con 0x7f02bc070490 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c2800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc16ad90 con 0x7f02bc1617a0 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.933+0000 7f02c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55558/0 (socket says 172.21.15.18:55558) 2024-04-25T10:12:20.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 -- 172.21.15.18:0/3076187480 learned_addr learned my addr 172.21.15.18:0/3076187480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c1e00640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc1617a0 0x7f02bc1f9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c1400640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02bc070490 0x7f02bc15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 -- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc1617a0 msgr2=0x7f02bc1f9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc1617a0 0x7f02bc1f9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 -- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02bc070490 msgr2=0x7f02bc15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02bc070490 0x7f02bc15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 -- 172.21.15.18:0/3076187480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0c83f0 con 0x7f02bc099a60 2024-04-25T10:12:20.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c0a00640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e840 tx=0x7f02a800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a8017070 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a800ee90 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a800cb80 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc1f8a70 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc1f7a80 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc04efa0 con 0x7f02bc099a60 2024-04-25T10:12:20.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02a801a070 con 0x7f02bc099a60 2024-04-25T10:12:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 0x7f029c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:20.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.937+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f02a80851b0 con 0x7f02bc099a60 2024-04-25T10:12:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.941+0000 7f02c1400640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 0x7f029c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:20.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.941+0000 7f02c1400640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 0x7f029c069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007fd0 tx=0x7f02b0007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:20.941+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02a8055820 con 0x7f02bc099a60 2024-04-25T10:12:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f02bc0d0fd0 con 0x7f02bc099a60 2024-04-25T10:12:21.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02b9600640 1 -- 172.21.15.18:0/3076187480 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f02a80598c0 con 0x7f02bc099a60 2024-04-25T10:12:21.147 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:21.147 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T10:12:21.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 msgr2=0x7f029c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 0x7f029c069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007fd0 tx=0x7f02b0007d60 comp rx=0 tx=0).stop 2024-04-25T10:12:21.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 msgr2=0x7f02bc15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f02a800e840 tx=0x7f02a800ec40 comp rx=0 tx=0).stop 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 shutdown_connections 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f029c066f60 0x7f029c069420 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f02bc1617a0 0x7f02bc1f9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02bc099a60 0x7f02bc15d0e0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 --2- 172.21.15.18:0/3076187480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02bc070490 0x7f02bc15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 >> 172.21.15.18:0/3076187480 conn(0x7f02bc0b3050 msgr2=0x7f02bc0cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 shutdown_connections 2024-04-25T10:12:21.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.141+0000 7f02c2800640 1 -- 172.21.15.18:0/3076187480 wait complete. 2024-04-25T10:12:21.168 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T10:12:21.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:12:21.168 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:12:21.257 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:12:21.349 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:12:21.349 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:21.349 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:21.359 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:21.359 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:21.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:21.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:12:21.459 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:12:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 Processor -- start 2024-04-25T10:12:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 -- start start 2024-04-25T10:12:21.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1f5815dcd0 0x7f1f58099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f580d0280 con 0x7f1f5809a7a0 2024-04-25T10:12:21.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f5806d740 con 0x7f1f580cd460 2024-04-25T10:12:21.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5ee00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f580cbfc0 con 0x7f1f5815dcd0 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5d000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1f5809a7a0 0x7f1f580cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49408/0 (socket says 172.21.15.18:49408) 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5d000640 1 -- 172.21.15.18:0/3846940120 learned_addr learned my addr 172.21.15.18:0/3846940120 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f5da00640 1 --2- 172.21.15.18:0/3846940120 >> v2:172.21.15.167:3300/0 conn(0x7f1f5815dcd0 0x7f1f58099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862662672 0 0) 0x7f1f580d0280 con 0x7f1f5809a7a0 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f40003530 con 0x7f1f5809a7a0 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1102303098 0 0) 0x7f1f40003530 con 0x7f1f5809a7a0 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 >> v2:172.21.15.167:3300/0 conn(0x7f1f5815dcd0 msgr2=0x7f1f58099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 --2- 172.21.15.18:0/3846940120 >> v2:172.21.15.167:3300/0 conn(0x7f1f5815dcd0 0x7f1f58099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 >> v1:172.21.15.167:6789/0 conn(0x7f1f580cd460 legacy=0x7f1f580cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5806cea0 con 0x7f1f5809a7a0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f1f44001680 con 0x7f1f5809a7a0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 >> v1:172.21.15.18:6789/0 conn(0x7f1f5809a7a0 legacy=0x7f1f580cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f40004810 0x7f1f40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f400051d0 0x7f1f4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580cbfc0 con 0x7f1f400051d0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4000c070 con 0x7f1f400039c0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.589+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4000c270 con 0x7f1f40004810 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5e400640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f400051d0 0x7f1f4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5d000640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f40004810 0x7f1f40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 -- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f40004810 msgr2=0x7f1f40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f40004810 0x7f1f40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 -- 172.21.15.18:0/3846940120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f400051d0 msgr2=0x7f1f4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f400051d0 0x7f1f4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 -- 172.21.15.18:0/3846940120 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40003530 con 0x7f1f400039c0 2024-04-25T10:12:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5e400640 1 -- 172.21.15.18:0/3846940120 reap_dead start 2024-04-25T10:12:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f5da00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f40003de0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009ae0 tx=0x7f1f4c01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18e8fd22ece27052 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0b2070 con 0x7f1f400039c0 2024-04-25T10:12:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.593+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c0a5660 con 0x7f1f400039c0 2024-04-25T10:12:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f57e00640 1 -- 172.21.15.18:0/3846940120 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c0096b0 con 0x7f1f400039c0 2024-04-25T10:12:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 msgr2=0x7f1f40003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f40003de0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009ae0 tx=0x7f1f4c01ca70 comp rx=0 tx=0).stop 2024-04-25T10:12:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- 172.21.15.18:0/3846940120 shutdown_connections 2024-04-25T10:12:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/3846940120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f40003de0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- 172.21.15.18:0/3846940120 >> 172.21.15.18:0/3846940120 conn(0x7f1f580b3050 msgr2=0x7f1f580b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:21.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- 172.21.15.18:0/3846940120 shutdown_connections 2024-04-25T10:12:21.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- 172.21.15.18:0/3846940120 wait complete. 2024-04-25T10:12:21.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 Processor -- start 2024-04-25T10:12:21.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- start start 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f58149700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 0x7f1f580b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f580cbc50 con 0x7f1f581f2cd0 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5806d460 con 0x7f1f400039c0 2024-04-25T10:12:21.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5ee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5815e0b0 con 0x7f1f580c5050 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56568/0 (socket says 172.21.15.18:56568) 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5e400640 1 -- 172.21.15.18:0/1225748920 learned_addr learned my addr 172.21.15.18:0/1225748920 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5da00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f58149700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5d000640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 0x7f1f580b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.597+0000 7f1f5e400640 1 -- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 msgr2=0x7f1f580b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5e400640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 0x7f1f580b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5e400640 1 -- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 msgr2=0x7f1f58149700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5e400640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f58149700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5e400640 1 -- 172.21.15.18:0/1225748920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f581f3690 con 0x7f1f581f2cd0 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5da00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f58149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:21.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5d000640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 0x7f1f580b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5e400640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1f580cd8f0 tx=0x7f1f5000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f5001a070 con 0x7f1f581f2cd0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50006d70 con 0x7f1f581f2cd0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f580c5550 con 0x7f1f581f2cd0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003bc0 con 0x7f1f581f2cd0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f580c5b10 con 0x7f1f581f2cd0 2024-04-25T10:12:21.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f580c5d10 con 0x7f1f581f2cd0 2024-04-25T10:12:21.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f50005110 con 0x7f1f581f2cd0 2024-04-25T10:12:21.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.601+0000 7f1f55600640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 0x7f1f38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.605+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f1f500847b0 con 0x7f1f581f2cd0 2024-04-25T10:12:21.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.605+0000 7f1f5da00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 0x7f1f38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.605+0000 7f1f5da00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 0x7f1f38069450 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0af000 tx=0x7f1f4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.609+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f580c5d10 con 0x7f1f581f2cd0 2024-04-25T10:12:21.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.769+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f5806dd30 con 0x7f1f581f2cd0 2024-04-25T10:12:21.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.769+0000 7f1f55600640 1 -- 172.21.15.18:0/1225748920 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17314 (secure 0 0 0) 0x7f1f50055470 con 0x7f1f581f2cd0 2024-04-25T10:12:21.777 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:21.778 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":97,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:11:42.885947+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6833/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:21.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 msgr2=0x7f1f38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 0x7f1f38069450 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c0af000 tx=0x7f1f4c008040 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 msgr2=0x7f1f581f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f1f580cd8f0 tx=0x7f1f5000fc00 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 shutdown_connections 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f581f2cd0 0x7f1f581f3150 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1f38066f90 0x7f1f38069450 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1f580c5050 0x7f1f580b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 --2- 172.21.15.18:0/1225748920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f400039c0 0x7f1f58149700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 >> 172.21.15.18:0/1225748920 conn(0x7f1f580b3050 msgr2=0x7f1f5806fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 shutdown_connections 2024-04-25T10:12:21.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.773+0000 7f1f5ee00640 1 -- 172.21.15.18:0/1225748920 wait complete. 2024-04-25T10:12:21.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:10:18.053140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:10:18.626398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:21.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 Processor -- start 2024-04-25T10:12:21.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 -- start start 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c6415dd90 0x7f0c64071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64072040 0x7f0c64161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c64072460 con 0x7f0c64161cc0 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c640b2dc0 con 0x7f0c6415dd90 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c69000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6406ac10 con 0x7f0c64072040 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c6415dd90 0x7f0c64071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c62800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0c64161cc0 0x7f0c640cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49412/0 (socket says 172.21.15.18:49412) 2024-04-25T10:12:21.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c62800640 1 -- 172.21.15.18:0/2957558337 learned_addr learned my addr 172.21.15.18:0/2957558337 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61400640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64072040 0x7f0c64161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61e00640 1 -- 172.21.15.18:0/2957558337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64072040 msgr2=0x7f0c64161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61e00640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64072040 0x7f0c64161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61e00640 1 -- 172.21.15.18:0/2957558337 >> v1:172.21.15.18:6789/0 conn(0x7f0c64161cc0 legacy=0x7f0c640cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c61e00640 1 -- 172.21.15.18:0/2957558337 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6406aeb0 con 0x7f0c6415dd90 2024-04-25T10:12:21.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.937+0000 7f0c60a00640 1 -- 172.21.15.18:0/2957558337 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838463306 0 0) 0x7f0c64072460 con 0x7f0c64161cc0 2024-04-25T10:12:21.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c61e00640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c64071b00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097c0 tx=0x7f0c5401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1abfbbb2d87937d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c60a00640 1 -- 172.21.15.18:0/2957558337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540b0070 con 0x7f0c6415dd90 2024-04-25T10:12:21.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c60a00640 1 -- 172.21.15.18:0/2957558337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c540ab600 con 0x7f0c6415dd90 2024-04-25T10:12:21.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c60a00640 1 -- 172.21.15.18:0/2957558337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540ab9d0 con 0x7f0c6415dd90 2024-04-25T10:12:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 -- 172.21.15.18:0/2957558337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 msgr2=0x7f0c64071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c64071b00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f0c540097c0 tx=0x7f0c5401c410 comp rx=0 tx=0).stop 2024-04-25T10:12:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 -- 172.21.15.18:0/2957558337 shutdown_connections 2024-04-25T10:12:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64072040 0x7f0c64161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 --2- 172.21.15.18:0/2957558337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c64071b00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 -- 172.21.15.18:0/2957558337 >> 172.21.15.18:0/2957558337 conn(0x7f0c640cfd90 msgr2=0x7f0c640d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 -- 172.21.15.18:0/2957558337 shutdown_connections 2024-04-25T10:12:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.941+0000 7f0c69000640 1 -- 172.21.15.18:0/2957558337 wait complete. 2024-04-25T10:12:21.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 Processor -- start 2024-04-25T10:12:21.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- start start 2024-04-25T10:12:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c64072040 0x7f0c640ce370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64161cc0 0x7f0c6415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6416aac0 con 0x7f0c6415dd90 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c64162500 con 0x7f0c64072040 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6416ac40 con 0x7f0c64161cc0 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56588/0 (socket says 172.21.15.18:56588) 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 -- 172.21.15.18:0/1318235258 learned_addr learned my addr 172.21.15.18:0/1318235258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61e00640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c64072040 0x7f0c640ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c62800640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64161cc0 0x7f0c6415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 -- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64161cc0 msgr2=0x7f0c6415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64161cc0 0x7f0c6415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 -- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c64072040 msgr2=0x7f0c640ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c64072040 0x7f0c640ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:21.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 -- 172.21.15.18:0/1318235258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c640ada00 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c61400640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d5f0 tx=0x7f0c5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500125f0 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50019070 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500129b0 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c640adce0 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c640ae2a0 con 0x7f0c6415dd90 2024-04-25T10:12:21.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.945+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c640745d0 con 0x7f0c6415dd90 2024-04-25T10:12:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.949+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c50012b50 con 0x7f0c6415dd90 2024-04-25T10:12:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.949+0000 7f0c5a000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 0x7f0c44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.949+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0c500856f0 con 0x7f0c6415dd90 2024-04-25T10:12:21.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.949+0000 7f0c61e00640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 0x7f0c44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:21.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.949+0000 7f0c61e00640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 0x7f0c44069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ad000 tx=0x7f0c540a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:21.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:21.953+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c500563b0 con 0x7f0c6415dd90 2024-04-25T10:12:22.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c64072700 con 0x7f0c6415dd90 2024-04-25T10:12:22.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c5a000640 1 -- 172.21.15.18:0/1318235258 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c50055cb0 con 0x7f0c6415dd90 2024-04-25T10:12:22.124 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:22.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 msgr2=0x7f0c44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 0x7f0c44069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0c540ad000 tx=0x7f0c540a6000 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 msgr2=0x7f0c641605c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000d5f0 tx=0x7f0c5000dab0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 shutdown_connections 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0c44066f60 0x7f0c44069420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0c64161cc0 0x7f0c6415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c6415dd90 0x7f0c641605c0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 --2- 172.21.15.18:0/1318235258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0c64072040 0x7f0c640ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 >> 172.21.15.18:0/1318235258 conn(0x7f0c640cfd90 msgr2=0x7f0c640afab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 shutdown_connections 2024-04-25T10:12:22.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.117+0000 7f0c69000640 1 -- 172.21.15.18:0/1318235258 wait complete. 2024-04-25T10:12:22.145 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:12:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.281+0000 7effb1600640 1 Processor -- start 2024-04-25T10:12:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.281+0000 7effb1600640 1 -- start start 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb1600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7effac06ce40 0x7effac09a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb1600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac15d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb1600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effac09aef0 con 0x7effac0cd6c0 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb1600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effac06f4e0 con 0x7effac06ce40 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb1600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac06f7c0 con 0x7effac06bf30 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7effac06ce40 0x7effac09a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7effac06ce40 0x7effac09a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56604/0 (socket says 172.21.15.18:56604) 2024-04-25T10:12:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 -- 172.21.15.18:0/563623525 learned_addr learned my addr 172.21.15.18:0/563623525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb0c00640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 -- 172.21.15.18:0/563623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 msgr2=0x7effac15d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac15d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 -- 172.21.15.18:0/563623525 >> v1:172.21.15.167:6789/0 conn(0x7effac0cd6c0 legacy=0x7effac06c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 -- 172.21.15.18:0/563623525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac06faa0 con 0x7effac06ce40 2024-04-25T10:12:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effb0c00640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.285+0000 7effa3e00640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac09a910 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7eff94009870 tx=0x7eff9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef59ddc2ac78695f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effab400640 1 -- 172.21.15.18:0/563623525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940b1070 con 0x7effac06ce40 2024-04-25T10:12:22.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effab400640 1 -- 172.21.15.18:0/563623525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940a8050 con 0x7effac06ce40 2024-04-25T10:12:22.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effab400640 1 -- 172.21.15.18:0/563623525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940ac860 con 0x7effac06ce40 2024-04-25T10:12:22.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- 172.21.15.18:0/563623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 msgr2=0x7effac09a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac09a910 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7eff94009870 tx=0x7eff9401c460 comp rx=0 tx=0).stop 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- 172.21.15.18:0/563623525 shutdown_connections 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac15d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- 172.21.15.18:0/563623525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac09a910 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- 172.21.15.18:0/563623525 >> 172.21.15.18:0/563623525 conn(0x7effac0b3090 msgr2=0x7effac0b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- 172.21.15.18:0/563623525 shutdown_connections 2024-04-25T10:12:22.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- 172.21.15.18:0/563623525 wait complete. 2024-04-25T10:12:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 Processor -- start 2024-04-25T10:12:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- start start 2024-04-25T10:12:22.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac0cd6c0 0x7effac0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cbd70 con 0x7effac06ce40 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effac0cbbf0 con 0x7effac0cd6c0 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effb1600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac0702a0 con 0x7effac06bf30 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effa3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effa3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56606/0 (socket says 172.21.15.18:56606) 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.289+0000 7effa3e00640 1 -- 172.21.15.18:0/2205651079 learned_addr learned my addr 172.21.15.18:0/2205651079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 -- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 msgr2=0x7effac149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effb0c00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac0cd6c0 0x7effac0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 -- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac0cd6c0 msgr2=0x7effac0caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac0cd6c0 0x7effac0caab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 -- 172.21.15.18:0/2205651079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0b4000 con 0x7effac06ce40 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa3e00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7eff9401cd00 tx=0x7eff94019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940bb070 con 0x7effac06ce40 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff940b5640 con 0x7effac06ce40 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0b42e0 con 0x7effac06ce40 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff940b1040 con 0x7effac06ce40 2024-04-25T10:12:22.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0b48a0 con 0x7effac06ce40 2024-04-25T10:12:22.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effac0745d0 con 0x7effac06ce40 2024-04-25T10:12:22.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff940be070 con 0x7effac06ce40 2024-04-25T10:12:22.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 0x7eff88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.293+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7eff9411e8a0 con 0x7effac06ce40 2024-04-25T10:12:22.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.297+0000 7effabe00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 0x7eff88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.297+0000 7effabe00640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 0x7eff88069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009670 tx=0x7eff9c006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.297+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7eff94016110 con 0x7effac06ce40 2024-04-25T10:12:22.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.469+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7effac0b7200 con 0x7effac06ce40 2024-04-25T10:12:22.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.469+0000 7effa8c00640 1 -- 172.21.15.18:0/2205651079 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff940ef560 con 0x7effac06ce40 2024-04-25T10:12:22.478 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 msgr2=0x7eff88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 0x7eff88069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7eff9c009670 tx=0x7eff9c006bd0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 msgr2=0x7effac0af5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7eff9401cd00 tx=0x7eff94019200 comp rx=0 tx=0).stop 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 shutdown_connections 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7effac0cd6c0 0x7effac0caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effac06ce40 0x7effac0af5e0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7eff88066f60 0x7eff88069420 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 --2- 172.21.15.18:0/2205651079 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7effac06bf30 0x7effac149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 >> 172.21.15.18:0/2205651079 conn(0x7effac0b3090 msgr2=0x7effac06c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 shutdown_connections 2024-04-25T10:12:22.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.473+0000 7effb1600640 1 -- 172.21.15.18:0/2205651079 wait complete. 2024-04-25T10:12:22.499 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:12:22.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 Processor -- start 2024-04-25T10:12:22.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 -- start start 2024-04-25T10:12:22.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c9c159320 0x7f8c9c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8c9c06e4a0 0x7f8c9c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c9c15fc00 con 0x7f8c9c15f440 2024-04-25T10:12:22.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06d640 con 0x7f8c9c159320 2024-04-25T10:12:22.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8ca1a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c9c06ee10 con 0x7f8c9c06e4a0 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9aa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c9c159320 0x7f8c9c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c92000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c9c15f440 0x7f8c9c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49414/0 (socket says 172.21.15.18:49414) 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c92000640 1 -- 172.21.15.18:0/1265281996 learned_addr learned my addr 172.21.15.18:0/1265281996 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9b400640 1 --2- 172.21.15.18:0/1265281996 >> v2:172.21.15.167:3300/0 conn(0x7f8c9c06e4a0 0x7f8c9c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9aa00640 1 -- 172.21.15.18:0/1265281996 >> v2:172.21.15.167:3300/0 conn(0x7f8c9c06e4a0 msgr2=0x7f8c9c06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9aa00640 1 --2- 172.21.15.18:0/1265281996 >> v2:172.21.15.167:3300/0 conn(0x7f8c9c06e4a0 0x7f8c9c06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9aa00640 1 -- 172.21.15.18:0/1265281996 >> v1:172.21.15.18:6789/0 conn(0x7f8c9c15f440 legacy=0x7f8c9c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.637+0000 7f8c9aa00640 1 -- 172.21.15.18:0/1265281996 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c15fee0 con 0x7f8c9c159320 2024-04-25T10:12:22.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8c9aa00640 1 --2- 172.21.15.18:0/1265281996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c15c9b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c072630 tx=0x7f8c8c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a120f1ba6f3ac03b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8c9a000640 1 -- 172.21.15.18:0/1265281996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0b1070 con 0x7f8c9c159320 2024-04-25T10:12:22.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8c9a000640 1 -- 172.21.15.18:0/1265281996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0ac620 con 0x7f8c9c159320 2024-04-25T10:12:22.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8c9a000640 1 -- 172.21.15.18:0/1265281996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ac9f0 con 0x7f8c9c159320 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1265281996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 msgr2=0x7f8c9c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1265281996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c15c9b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c072630 tx=0x7f8c8c01c3c0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1265281996 shutdown_connections 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1265281996 >> v2:172.21.15.167:3300/0 conn(0x7f8c9c06e4a0 0x7f8c9c06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1265281996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c15c9b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1265281996 >> 172.21.15.18:0/1265281996 conn(0x7f8c9c067080 msgr2=0x7f8c9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1265281996 shutdown_connections 2024-04-25T10:12:22.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1265281996 wait complete. 2024-04-25T10:12:22.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 Processor -- start 2024-04-25T10:12:22.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.641+0000 7f8ca1a00640 1 -- start start 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 0x7f8c9c13a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c15f440 0x7f8c9c1371c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c15f820 con 0x7f8c9c159320 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c159700 con 0x7f8c9c06e4a0 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9c15f9a0 con 0x7f8c9c15f440 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c9aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 0x7f8c9c13a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56624/0 (socket says 172.21.15.18:56624) 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 -- 172.21.15.18:0/1635030076 learned_addr learned my addr 172.21.15.18:0/1635030076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c9aa00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 0x7f8c9c13a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:35882/0 (socket says 172.21.15.18:35882) 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c9b400640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c15f440 0x7f8c9c1371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 -- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c15f440 msgr2=0x7f8c9c1371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c15f440 0x7f8c9c1371c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 -- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 msgr2=0x7f8c9c13a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 0x7f8c9c13a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 -- 172.21.15.18:0/1635030076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c137700 con 0x7f8c9c159320 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c92000640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c420 tx=0x7f8c8400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84017070 con 0x7f8c9c159320 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84005cf0 con 0x7f8c9c159320 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c1f76c0 con 0x7f8c9c159320 2024-04-25T10:12:22.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c840072f0 con 0x7f8c9c159320 2024-04-25T10:12:22.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9c1f6e20 con 0x7f8c9c159320 2024-04-25T10:12:22.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.645+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9c0745d0 con 0x7f8c9c159320 2024-04-25T10:12:22.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.649+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8c8401a070 con 0x7f8c9c159320 2024-04-25T10:12:22.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.649+0000 7f8c93400640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 0x7f8c78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.649+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f8c840846a0 con 0x7f8c9c159320 2024-04-25T10:12:22.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.649+0000 7f8c9aa00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 0x7f8c78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.649+0000 7f8c9aa00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 0x7f8c78069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0ae000 tx=0x7f8c8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.653+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c9c137700 con 0x7f8c9c159320 2024-04-25T10:12:22.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.813+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8c9c0cc640 con 0x7f8c9c159320 2024-04-25T10:12:22.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8c93400640 1 -- 172.21.15.18:0/1635030076 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8c84054d10 con 0x7f8c9c159320 2024-04-25T10:12:22.823 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 msgr2=0x7f8c78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 0x7f8c78069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0ae000 tx=0x7f8c8c008040 comp rx=0 tx=0).stop 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 msgr2=0x7f8c9c1f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400c420 tx=0x7f8c8400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 shutdown_connections 2024-04-25T10:12:22.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c78066f60 0x7f8c78069420 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8c9c15f440 0x7f8c9c1371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c9c159320 0x7f8c9c1f6790 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 --2- 172.21.15.18:0/1635030076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c9c06e4a0 0x7f8c9c13a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 >> 172.21.15.18:0/1635030076 conn(0x7f8c9c067080 msgr2=0x7f8c9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 shutdown_connections 2024-04-25T10:12:22.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.817+0000 7f8ca1a00640 1 -- 172.21.15.18:0/1635030076 wait complete. 2024-04-25T10:12:22.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:12:22.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.977+0000 7fcf3d600640 1 Processor -- start 2024-04-25T10:12:22.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.977+0000 7fcf3d600640 1 -- start start 2024-04-25T10:12:22.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf3d600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf3815acd0 0x7fcf3815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf3d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf380b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf3d600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3815bc40 con 0x7fcf38144120 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf3d600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3815e490 con 0x7fcf3815acd0 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf3d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3815b150 con 0x7fcf3815ee60 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf3815acd0 0x7fcf3815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcf3815acd0 0x7fcf3815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56638/0 (socket says 172.21.15.18:56638) 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 -- 172.21.15.18:0/3087561 learned_addr learned my addr 172.21.15.18:0/3087561 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf37400640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf380b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 -- 172.21.15.18:0/3087561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 msgr2=0x7fcf380b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf380b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 -- 172.21.15.18:0/3087561 >> v1:172.21.15.167:6789/0 conn(0x7fcf38144120 legacy=0x7fcf380ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 -- 172.21.15.18:0/3087561 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3815b3a0 con 0x7fcf3815acd0 2024-04-25T10:12:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf2e000640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815acd0 0x7fcf3815e920 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181bad6621bbed83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf36000640 1 -- 172.21.15.18:0/3087561 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200b1070 con 0x7fcf3815acd0 2024-04-25T10:12:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf36000640 1 -- 172.21.15.18:0/3087561 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200a8050 con 0x7fcf3815acd0 2024-04-25T10:12:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.981+0000 7fcf36000640 1 -- 172.21.15.18:0/3087561 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200ac860 con 0x7fcf3815acd0 2024-04-25T10:12:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- 172.21.15.18:0/3087561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815acd0 msgr2=0x7fcf3815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815acd0 0x7fcf3815e920 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- 172.21.15.18:0/3087561 shutdown_connections 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf380b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- 172.21.15.18:0/3087561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815acd0 0x7fcf3815e920 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- 172.21.15.18:0/3087561 >> 172.21.15.18:0/3087561 conn(0x7fcf38067080 msgr2=0x7fcf3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- 172.21.15.18:0/3087561 shutdown_connections 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- 172.21.15.18:0/3087561 wait complete. 2024-04-25T10:12:22.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 Processor -- start 2024-04-25T10:12:22.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- start start 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 0x7fcf380b08a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf3813e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3806d450 con 0x7fcf38144120 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3806d2d0 con 0x7fcf3815acd0 2024-04-25T10:12:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf3d600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3806d5d0 con 0x7fcf3815ee60 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56654/0 (socket says 172.21.15.18:56654) 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 -- 172.21.15.18:0/1506100362 learned_addr learned my addr 172.21.15.18:0/1506100362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf2e000640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 0x7fcf380b08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf37400640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf3813e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 -- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 msgr2=0x7fcf3813e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf3813e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 -- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 msgr2=0x7fcf380b08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 0x7fcf380b08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf36a00640 1 -- 172.21.15.18:0/1506100362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf381f9ee0 con 0x7fcf38144120 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.985+0000 7fcf2e000640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 0x7fcf380b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf36a00640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c420 tx=0x7fcf2800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf280052d0 con 0x7fcf38144120 2024-04-25T10:12:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf28005470 con 0x7fcf38144120 2024-04-25T10:12:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf381fa180 con 0x7fcf38144120 2024-04-25T10:12:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf28007260 con 0x7fcf38144120 2024-04-25T10:12:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf381fa740 con 0x7fcf38144120 2024-04-25T10:12:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf380745d0 con 0x7fcf38144120 2024-04-25T10:12:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf28007400 con 0x7fcf38144120 2024-04-25T10:12:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 0x7fcf14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fcf280848b0 con 0x7fcf38144120 2024-04-25T10:12:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.989+0000 7fcf2e000640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 0x7fcf14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.993+0000 7fcf2e000640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 0x7fcf14069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ae000 tx=0x7fcf20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:22.993+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf28055570 con 0x7fcf38144120 2024-04-25T10:12:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.165+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcf381fa980 con 0x7fcf38144120 2024-04-25T10:12:23.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.165+0000 7fcf2f400640 1 -- 172.21.15.18:0/1506100362 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v97) v1 ==== 80+0+244 (secure 0 0 0) 0x7fcf28054e70 con 0x7fcf38144120 2024-04-25T10:12:23.175 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6835/4209604816 2024-04-26T10:11:42.885924+0000 2024-04-25T10:12:23.175 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6833/4209604816 2024-04-26T10:11:42.885924+0000 2024-04-25T10:12:23.175 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6835/2607538595 2024-04-26T10:10:30.461064+0000 2024-04-25T10:12:23.175 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.18:6833/2607538595 2024-04-26T10:10:30.461064+0000 2024-04-25T10:12:23.175 INFO:teuthology.orchestra.run.smithi018.stderr:listed 4 entries 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 msgr2=0x7fcf14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 0x7fcf14069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ae000 tx=0x7fcf20008040 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 msgr2=0x7fcf380afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800c420 tx=0x7fcf2800c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 shutdown_connections 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf14066f60 0x7fcf14069420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf3815ee60 0x7fcf3813e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf3815acd0 0x7fcf380b08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 --2- 172.21.15.18:0/1506100362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf38144120 0x7fcf380afb90 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 >> 172.21.15.18:0/1506100362 conn(0x7fcf38067080 msgr2=0x7fcf380b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 shutdown_connections 2024-04-25T10:12:23.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.169+0000 7fcf3d600640 1 -- 172.21.15.18:0/1506100362 wait complete. 2024-04-25T10:12:23.196 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:12:23.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:23.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:23.222 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:12:23.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:23.222 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:12:23.275 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:12:23.275 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:23.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:12:23.285 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:23.285 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:23.327 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:12:23.328 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:12:23.328 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:23.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:12:23.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:23.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.505+0000 7f0b48600640 1 Processor -- start 2024-04-25T10:12:23.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.505+0000 7f0b48600640 1 -- start start 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b48600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b400cef30 0x7f0b4006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b48600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4015ac60 con 0x7f0b40144140 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b48600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b400cf3e0 con 0x7f0b4006e900 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b48600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4006ed50 con 0x7f0b400cef30 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b40144140 0x7f0b400ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49422/0 (socket says 172.21.15.18:49422) 2024-04-25T10:12:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45c00640 1 -- 172.21.15.18:0/2099706089 learned_addr learned my addr 172.21.15.18:0/2099706089 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45200640 1 --2- 172.21.15.18:0/2099706089 >> v2:172.21.15.167:3300/0 conn(0x7f0b400cef30 0x7f0b4006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 377528641 0 0) 0x7f0b4015ac60 con 0x7f0b40144140 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003530 con 0x7f0b40144140 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530939892 0 0) 0x7f0b400cf3e0 con 0x7f0b4006e900 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b4015ac60 con 0x7f0b4006e900 2024-04-25T10:12:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45200640 1 -- 172.21.15.18:0/2099706089 >> v1:172.21.15.167:6789/0 conn(0x7f0b4006e900 legacy=0x7f0b400b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45200640 1 -- 172.21.15.18:0/2099706089 >> v1:172.21.15.18:6789/0 conn(0x7f0b40144140 legacy=0x7f0b400ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2568740014 0 0) 0x7f0b28003530 con 0x7f0b40144140 2024-04-25T10:12:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.509+0000 7f0b45200640 1 -- 172.21.15.18:0/2099706089 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4015af20 con 0x7f0b400cef30 2024-04-25T10:12:23.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b45200640 1 --2- 172.21.15.18:0/2099706089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4006e3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0097c0 tx=0x7f0b2c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f2015b22a745b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0b1070 con 0x7f0b400cef30 2024-04-25T10:12:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c0ac3f0 con 0x7f0b400cef30 2024-04-25T10:12:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b3fe00640 1 -- 172.21.15.18:0/2099706089 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0ac7c0 con 0x7f0b400cef30 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 -- 172.21.15.18:0/2099706089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 msgr2=0x7f0b4006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 --2- 172.21.15.18:0/2099706089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4006e3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c0097c0 tx=0x7f0b2c01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 -- 172.21.15.18:0/2099706089 shutdown_connections 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 --2- 172.21.15.18:0/2099706089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4006e3c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 -- 172.21.15.18:0/2099706089 >> 172.21.15.18:0/2099706089 conn(0x7f0b40066fa0 msgr2=0x7f0b4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 -- 172.21.15.18:0/2099706089 shutdown_connections 2024-04-25T10:12:23.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 -- 172.21.15.18:0/2099706089 wait complete. 2024-04-25T10:12:23.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.513+0000 7f0b48600640 1 Processor -- start 2024-04-25T10:12:23.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- start start 2024-04-25T10:12:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4006e900 0x7f0b4013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4015ba00 con 0x7f0b40144140 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b40144520 con 0x7f0b400cef30 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4015bb80 con 0x7f0b4006e900 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56664/0 (socket says 172.21.15.18:56664) 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 -- 172.21.15.18:0/3349297712 learned_addr learned my addr 172.21.15.18:0/3349297712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b45c00640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4006e900 0x7f0b4013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b45200640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 -- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4006e900 msgr2=0x7f0b4013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4006e900 0x7f0b4013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 -- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 msgr2=0x7f0b4015bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4015bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 -- 172.21.15.18:0/3349297712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b40139d80 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b46600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c7c0 tx=0x7f0b3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38003b80 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38003d20 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3800aa50 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b4013a060 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4013a620 con 0x7f0b40144140 2024-04-25T10:12:23.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.517+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b400745d0 con 0x7f0b40144140 2024-04-25T10:12:23.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.521+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b3800abf0 con 0x7f0b40144140 2024-04-25T10:12:23.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.521+0000 7f0b3d600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 0x7f0b20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.521+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0b38085290 con 0x7f0b40144140 2024-04-25T10:12:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.521+0000 7f0b45c00640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 0x7f0b20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.521+0000 7f0b45c00640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 0x7f0b20069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005890 tx=0x7f0b34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.525+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b38055f50 con 0x7f0b40144140 2024-04-25T10:12:23.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b4006c250 con 0x7f0b40144140 2024-04-25T10:12:23.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b3d600640 1 -- 172.21.15.18:0/3349297712 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f0b38055850 con 0x7f0b40144140 2024-04-25T10:12:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:23.729 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:12:23.729 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 msgr2=0x7f0b20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 0x7f0b20069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0b34005890 tx=0x7f0b34009040 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 msgr2=0x7f0b40137870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.721+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800c7c0 tx=0x7f0b3800cc80 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 shutdown_connections 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b40144140 0x7f0b40137870 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b400cef30 0x7f0b4015bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b20066f60 0x7f0b20069420 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 --2- 172.21.15.18:0/3349297712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b4006e900 0x7f0b4013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 >> 172.21.15.18:0/3349297712 conn(0x7f0b40066fa0 msgr2=0x7f0b400b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 shutdown_connections 2024-04-25T10:12:23.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.725+0000 7f0b48600640 1 -- 172.21.15.18:0/3349297712 wait complete. 2024-04-25T10:12:23.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 Processor -- start 2024-04-25T10:12:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 -- start start 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f61a815da10 0x7f61a80afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a815ddf0 con 0x7f61a80b4210 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a806b480 con 0x7f61a80d11b0 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61acc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a80d06d0 con 0x7f61a815da10 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a6800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f61a80b4210 0x7f61a80b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49438/0 (socket says 172.21.15.18:49438) 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a6800640 1 -- 172.21.15.18:0/1176405958 learned_addr learned my addr 172.21.15.18:0/1176405958 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5e00640 1 --2- 172.21.15.18:0/1176405958 >> v2:172.21.15.167:3300/0 conn(0x7f61a815da10 0x7f61a80afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500931966 0 0) 0x7f61a815ddf0 con 0x7f61a80b4210 2024-04-25T10:12:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f618c003530 con 0x7f61a80b4210 2024-04-25T10:12:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2394958228 0 0) 0x7f61a806b480 con 0x7f61a80d11b0 2024-04-25T10:12:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a815ddf0 con 0x7f61a80d11b0 2024-04-25T10:12:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599242602 0 0) 0x7f618c003530 con 0x7f61a80b4210 2024-04-25T10:12:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5e00640 1 -- 172.21.15.18:0/1176405958 >> v1:172.21.15.167:6789/0 conn(0x7f61a80d11b0 legacy=0x7f61a806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5e00640 1 -- 172.21.15.18:0/1176405958 >> v1:172.21.15.18:6789/0 conn(0x7f61a80b4210 legacy=0x7f61a80b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.885+0000 7f61a5e00640 1 -- 172.21.15.18:0/1176405958 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a80d09b0 con 0x7f61a815da10 2024-04-25T10:12:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61a5e00640 1 --2- 172.21.15.18:0/1176405958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a815da10 0x7f61a80afe20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f61980097c0 tx=0x7f619801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a7b9e7a29d644cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61980b0070 con 0x7f61a815da10 2024-04-25T10:12:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61980a4e50 con 0x7f61a815da10 2024-04-25T10:12:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61a5400640 1 -- 172.21.15.18:0/1176405958 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0001a00 con 0x7f61a815da10 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 -- 172.21.15.18:0/1176405958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a815da10 msgr2=0x7f61a80afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 --2- 172.21.15.18:0/1176405958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a815da10 0x7f61a80afe20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f61980097c0 tx=0x7f619801c330 comp rx=0 tx=0).stop 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 -- 172.21.15.18:0/1176405958 shutdown_connections 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 --2- 172.21.15.18:0/1176405958 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a815da10 0x7f61a80afe20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 -- 172.21.15.18:0/1176405958 >> 172.21.15.18:0/1176405958 conn(0x7f61a80b2400 msgr2=0x7f61a80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 -- 172.21.15.18:0/1176405958 shutdown_connections 2024-04-25T10:12:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.889+0000 7f61acc00640 1 -- 172.21.15.18:0/1176405958 wait complete. 2024-04-25T10:12:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 Processor -- start 2024-04-25T10:12:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- start start 2024-04-25T10:12:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 0x7f61a81479b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61a815da10 0x7f61a814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a816b900 con 0x7f61a80d11b0 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a816b780 con 0x7f61a80b4210 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a816ba80 con 0x7f61a815da10 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56680/0 (socket says 172.21.15.18:56680) 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 -- 172.21.15.18:0/2370558975 learned_addr learned my addr 172.21.15.18:0/2370558975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61a5e00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 0x7f61a81479b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61a6800640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61a815da10 0x7f61a814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 -- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61a815da10 msgr2=0x7f61a814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61a815da10 0x7f61a814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 -- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 msgr2=0x7f61a81479b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 0x7f61a81479b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 -- 172.21.15.18:0/2370558975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8147ef0 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61a5e00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 0x7f61a81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619d400640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f619000c4c0 tx=0x7f619000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61900052d0 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6190005470 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6190012870 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a8150a70 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a8151030 con 0x7f61a80d11b0 2024-04-25T10:12:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.893+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a80745d0 con 0x7f61a80d11b0 2024-04-25T10:12:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.897+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6190012a10 con 0x7f61a80d11b0 2024-04-25T10:12:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.897+0000 7f619ea00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 0x7f6184069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.897+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6190084f80 con 0x7f61a80d11b0 2024-04-25T10:12:23.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.897+0000 7f61a5e00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 0x7f6184069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:23.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.897+0000 7f61a5e00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 0x7f6184069450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61980ad000 tx=0x7f61980a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:23.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:23.901+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6190055cd0 con 0x7f61a80d11b0 2024-04-25T10:12:24.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.061+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61a8073930 con 0x7f61a80d11b0 2024-04-25T10:12:24.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.061+0000 7f619ea00640 1 -- 172.21.15.18:0/2370558975 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17314 (secure 0 0 0) 0x7f61900555d0 con 0x7f61a80d11b0 2024-04-25T10:12:24.070 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:24.070 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":97,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:11:42.885947+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6833/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 msgr2=0x7f6184069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 0x7f6184069450 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f61980ad000 tx=0x7f61980a6000 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 msgr2=0x7f61a8150070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f619000c4c0 tx=0x7f619000c980 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 shutdown_connections 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6184066f90 0x7f6184069450 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61a815da10 0x7f61a814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61a80d11b0 0x7f61a8150070 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 --2- 172.21.15.18:0/2370558975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a80b4210 0x7f61a81479b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 >> 172.21.15.18:0/2370558975 conn(0x7f61a80b2400 msgr2=0x7f61a806fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 shutdown_connections 2024-04-25T10:12:24.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.065+0000 7f61acc00640 1 -- 172.21.15.18:0/2370558975 wait complete. 2024-04-25T10:12:24.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:10:18.053140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:10:18.626398+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:24.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:24.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.229+0000 7fe953800640 1 Processor -- start 2024-04-25T10:12:24.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe953800640 1 -- start start 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe953800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe94c159320 0x7fe94c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe953800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c15fc00 con 0x7fe94c06e4a0 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe953800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94c15fee0 con 0x7fe94c15f440 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe953800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe94c06d640 con 0x7fe94c159320 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe94c06e4a0 0x7fe94c071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49448/0 (socket says 172.21.15.18:49448) 2024-04-25T10:12:24.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 -- 172.21.15.18:0/745673339 learned_addr learned my addr 172.21.15.18:0/745673339 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe950e00640 1 --2- 172.21.15.18:0/745673339 >> v2:172.21.15.167:3300/0 conn(0x7fe94c159320 0x7fe94c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213200083 0 0) 0x7fe94c15fc00 con 0x7fe94c06e4a0 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe930003530 con 0x7fe94c06e4a0 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2309356721 0 0) 0x7fe930003530 con 0x7fe94c06e4a0 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 >> v2:172.21.15.167:3300/0 conn(0x7fe94c159320 msgr2=0x7fe94c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 --2- 172.21.15.18:0/745673339 >> v2:172.21.15.167:3300/0 conn(0x7fe94c159320 0x7fe94c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 >> v1:172.21.15.167:6789/0 conn(0x7fe94c15f440 legacy=0x7fe94c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c1601c0 con 0x7fe94c06e4a0 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fe944001a00 con 0x7fe94c06e4a0 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 >> v1:172.21.15.18:6789/0 conn(0x7fe94c06e4a0 legacy=0x7fe94c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9300039c0 0x7fe930003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe930004810 0x7fe930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 0x7fe93000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c06d640 con 0x7fe930005220 2024-04-25T10:12:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93000c150 con 0x7fe930004810 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93000c350 con 0x7fe9300039c0 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 0x7fe93000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe943e00640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe930004810 0x7fe930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe950e00640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9300039c0 0x7fe930003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 -- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9300039c0 msgr2=0x7fe930003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe9300039c0 0x7fe930003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 -- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe930004810 msgr2=0x7fe930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe930004810 0x7fe930004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.233+0000 7fe951800640 1 -- 172.21.15.18:0/745673339 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe930003530 con 0x7fe930005220 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe951800640 1 -- 172.21.15.18:0/745673339 reap_dead start 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe951800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 0x7fe93000b9d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fe94400a840 tx=0x7fe94401fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb652dd4d1b6c084 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94400a460 con 0x7fe930005220 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9440aa710 con 0x7fe930005220 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe94be00640 1 -- 172.21.15.18:0/745673339 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9440aab00 con 0x7fe930005220 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 -- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 msgr2=0x7fe93000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 0x7fe93000b9d0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fe94400a840 tx=0x7fe94401fac0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 -- 172.21.15.18:0/745673339 shutdown_connections 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 --2- 172.21.15.18:0/745673339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe930005220 0x7fe93000b9d0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 -- 172.21.15.18:0/745673339 >> 172.21.15.18:0/745673339 conn(0x7fe94c067080 msgr2=0x7fe94c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 -- 172.21.15.18:0/745673339 shutdown_connections 2024-04-25T10:12:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.237+0000 7fe953800640 1 -- 172.21.15.18:0/745673339 wait complete. 2024-04-25T10:12:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 Processor -- start 2024-04-25T10:12:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- start start 2024-04-25T10:12:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930005220 0x7fe94c1f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe94c0b26d0 0x7fe94c0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c15f8a0 con 0x7fe94c143a20 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c159700 con 0x7fe94c0b26d0 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94c15fa20 con 0x7fe930005220 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56694/0 (socket says 172.21.15.18:56694) 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 -- 172.21.15.18:0/1695040259 learned_addr learned my addr 172.21.15.18:0/1695040259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 -- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930005220 msgr2=0x7fe94c1f4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930005220 0x7fe94c1f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 -- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe94c0b26d0 msgr2=0x7fe94c0c51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe94c0b26d0 0x7fe94c0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 -- 172.21.15.18:0/1695040259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0c4ab0 con 0x7fe94c143a20 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe943e00640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe93400f820 tx=0x7fe93400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934001cf0 con 0x7fe94c143a20 2024-04-25T10:12:24.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934018070 con 0x7fe94c143a20 2024-04-25T10:12:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe94c0b0510 con 0x7fe94c143a20 2024-04-25T10:12:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93400d730 con 0x7fe94c143a20 2024-04-25T10:12:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.241+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe94c0b0ad0 con 0x7fe94c143a20 2024-04-25T10:12:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94c0745d0 con 0x7fe94c143a20 2024-04-25T10:12:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe93400d8d0 con 0x7fe94c143a20 2024-04-25T10:12:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe949600640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 0x7fe928069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fe934085110 con 0x7fe94c143a20 2024-04-25T10:12:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe950e00640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 0x7fe928069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.245+0000 7fe950e00640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 0x7fe928069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0b4420 tx=0x7fe93c009340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.249+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe934055e60 con 0x7fe94c143a20 2024-04-25T10:12:24.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.409+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe94c144fb0 con 0x7fe94c143a20 2024-04-25T10:12:24.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.409+0000 7fe949600640 1 -- 172.21.15.18:0/1695040259 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe934055760 con 0x7fe94c143a20 2024-04-25T10:12:24.419 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:24.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 msgr2=0x7fe928069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 0x7fe928069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0b4420 tx=0x7fe93c009340 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 msgr2=0x7fe94c0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fe93400f820 tx=0x7fe93400fce0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 shutdown_connections 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe94c0b26d0 0x7fe94c0c51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe94c143a20 0x7fe94c0c4570 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe928066f60 0x7fe928069420 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 --2- 172.21.15.18:0/1695040259 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe930005220 0x7fe94c1f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 >> 172.21.15.18:0/1695040259 conn(0x7fe94c067080 msgr2=0x7fe94c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 shutdown_connections 2024-04-25T10:12:24.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.413+0000 7fe953800640 1 -- 172.21.15.18:0/1695040259 wait complete. 2024-04-25T10:12:24.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:12:24.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 Processor -- start 2024-04-25T10:12:24.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 -- start start 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c4072210 0x7fc9c406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc9c415af40 0x7fc9c40cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c415e9a0 con 0x7fc9c4150f40 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c406f530 con 0x7fc9c4072210 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c9400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c415dbe0 con 0x7fc9c415af40 2024-04-25T10:12:24.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c4072210 0x7fc9c406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9c4072210 0x7fc9c406ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56696/0 (socket says 172.21.15.18:56696) 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 -- 172.21.15.18:0/138221028 learned_addr learned my addr 172.21.15.18:0/138221028 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9c3200640 1 --2- 172.21.15.18:0/138221028 >> v2:172.21.15.167:3300/0 conn(0x7fc9c415af40 0x7fc9c40cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 -- 172.21.15.18:0/138221028 >> v2:172.21.15.167:3300/0 conn(0x7fc9c415af40 msgr2=0x7fc9c40cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 --2- 172.21.15.18:0/138221028 >> v2:172.21.15.167:3300/0 conn(0x7fc9c415af40 0x7fc9c40cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 -- 172.21.15.18:0/138221028 >> v1:172.21.15.167:6789/0 conn(0x7fc9c4150f40 legacy=0x7fc9c4071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.577+0000 7fc9bbe00640 1 -- 172.21.15.18:0/138221028 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c415dec0 con 0x7fc9c4072210 2024-04-25T10:12:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9bbe00640 1 --2- 172.21.15.18:0/138221028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c406ef50 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc9c406eb00 tx=0x7fc9ac01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d99691b8f24234c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c1e00640 1 -- 172.21.15.18:0/138221028 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0b0070 con 0x7fc9c4072210 2024-04-25T10:12:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c1e00640 1 -- 172.21.15.18:0/138221028 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9ac0ab600 con 0x7fc9c4072210 2024-04-25T10:12:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c1e00640 1 -- 172.21.15.18:0/138221028 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9ac0ab9d0 con 0x7fc9c4072210 2024-04-25T10:12:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 -- 172.21.15.18:0/138221028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 msgr2=0x7fc9c406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 --2- 172.21.15.18:0/138221028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c406ef50 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fc9c406eb00 tx=0x7fc9ac01c400 comp rx=0 tx=0).stop 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 -- 172.21.15.18:0/138221028 shutdown_connections 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 --2- 172.21.15.18:0/138221028 >> v2:172.21.15.167:3300/0 conn(0x7fc9c415af40 0x7fc9c40cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 --2- 172.21.15.18:0/138221028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c406ef50 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 -- 172.21.15.18:0/138221028 >> 172.21.15.18:0/138221028 conn(0x7fc9c4067080 msgr2=0x7fc9c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 -- 172.21.15.18:0/138221028 shutdown_connections 2024-04-25T10:12:24.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.581+0000 7fc9c9400640 1 -- 172.21.15.18:0/138221028 wait complete. 2024-04-25T10:12:24.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 Processor -- start 2024-04-25T10:12:24.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- start start 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c4150f40 0x7fc9c41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c415af40 0x7fc9c40ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40ce380 con 0x7fc9c4072210 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40ce200 con 0x7fc9c415af40 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c40ce500 con 0x7fc9c4150f40 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56704/0 (socket says 172.21.15.18:56704) 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 -- 172.21.15.18:0/1677375353 learned_addr learned my addr 172.21.15.18:0/1677375353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c3200640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c415af40 0x7fc9c40ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9bbe00640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c4150f40 0x7fc9c41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 -- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c4150f40 msgr2=0x7fc9c41499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c4150f40 0x7fc9c41499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 -- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c415af40 msgr2=0x7fc9c40ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c415af40 0x7fc9c40ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 -- 172.21.15.18:0/1677375353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c40af370 con 0x7fc9c4072210 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c2800640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c420 tx=0x7fc9b400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40052d0 con 0x7fc9c4072210 2024-04-25T10:12:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b4005470 con 0x7fc9c4072210 2024-04-25T10:12:24.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c40af650 con 0x7fc9c4072210 2024-04-25T10:12:24.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4007260 con 0x7fc9c4072210 2024-04-25T10:12:24.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c40af930 con 0x7fc9c4072210 2024-04-25T10:12:24.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.585+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c40745d0 con 0x7fc9c4072210 2024-04-25T10:12:24.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.589+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9b4007400 con 0x7fc9c4072210 2024-04-25T10:12:24.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.589+0000 7fc9baa00640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 0x7fc9a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.589+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fc9b4084970 con 0x7fc9c4072210 2024-04-25T10:12:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.589+0000 7fc9bbe00640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 0x7fc9a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.589+0000 7fc9bbe00640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 0x7fc9a0069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ad000 tx=0x7fc9ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.593+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9b4055630 con 0x7fc9c4072210 2024-04-25T10:12:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.757+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc9c4163150 con 0x7fc9c4072210 2024-04-25T10:12:24.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.757+0000 7fc9baa00640 1 -- 172.21.15.18:0/1677375353 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9b4054f30 con 0x7fc9c4072210 2024-04-25T10:12:24.765 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:12:24.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 msgr2=0x7fc9a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 0x7fc9a0069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0ad000 tx=0x7fc9ac008040 comp rx=0 tx=0).stop 2024-04-25T10:12:24.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 msgr2=0x7fc9c414cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc9b400c420 tx=0x7fc9b400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 shutdown_connections 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc9c415af40 0x7fc9c40ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc9a0066f60 0x7fc9a0069420 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc9c4150f40 0x7fc9c41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 --2- 172.21.15.18:0/1677375353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9c4072210 0x7fc9c414cd50 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 >> 172.21.15.18:0/1677375353 conn(0x7fc9c4067080 msgr2=0x7fc9c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 shutdown_connections 2024-04-25T10:12:24.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.761+0000 7fc9c9400640 1 -- 172.21.15.18:0/1677375353 wait complete. 2024-04-25T10:12:24.788 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:12:24.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 Processor -- start 2024-04-25T10:12:24.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 -- start start 2024-04-25T10:12:24.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 0x7fc5680cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 0x7fc568099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5680d02a0 con 0x7fc5680cf3c0 2024-04-25T10:12:24.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680cc350 con 0x7fc56815bcf0 2024-04-25T10:12:24.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5680cc630 con 0x7fc56815b910 2024-04-25T10:12:24.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc5680cf3c0 0x7fc5680cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49464/0 (socket says 172.21.15.18:49464) 2024-04-25T10:12:24.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567400640 1 -- 172.21.15.18:0/4213280889 learned_addr learned my addr 172.21.15.18:0/4213280889 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:24.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567e00640 1 --2- 172.21.15.18:0/4213280889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 0x7fc5680cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56d000640 1 --2- 172.21.15.18:0/4213280889 >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 0x7fc568099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc566a00640 1 -- 172.21.15.18:0/4213280889 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321253661 0 0) 0x7fc5680d02a0 con 0x7fc5680cf3c0 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc566a00640 1 -- 172.21.15.18:0/4213280889 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54c003530 con 0x7fc5680cf3c0 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567e00640 1 -- 172.21.15.18:0/4213280889 >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 msgr2=0x7fc568099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567e00640 1 --2- 172.21.15.18:0/4213280889 >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 0x7fc568099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567e00640 1 -- 172.21.15.18:0/4213280889 >> v1:172.21.15.18:6789/0 conn(0x7fc5680cf3c0 legacy=0x7fc5680cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc567e00640 1 -- 172.21.15.18:0/4213280889 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680cc910 con 0x7fc56815b910 2024-04-25T10:12:24.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.925+0000 7fc56d000640 1 --2- 172.21.15.18:0/4213280889 >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 0x7fc568099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:24.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc567e00640 1 --2- 172.21.15.18:0/4213280889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 0x7fc5680cf9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5580097c0 tx=0x7fc55801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1db14ff851593fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc566a00640 1 -- 172.21.15.18:0/4213280889 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5580b2070 con 0x7fc56815b910 2024-04-25T10:12:24.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc566a00640 1 -- 172.21.15.18:0/4213280889 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5580ad680 con 0x7fc56815b910 2024-04-25T10:12:24.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc566a00640 1 -- 172.21.15.18:0/4213280889 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5580ada50 con 0x7fc56815b910 2024-04-25T10:12:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 -- 172.21.15.18:0/4213280889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 msgr2=0x7fc5680cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 --2- 172.21.15.18:0/4213280889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 0x7fc5680cf9a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc5580097c0 tx=0x7fc55801c470 comp rx=0 tx=0).stop 2024-04-25T10:12:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 -- 172.21.15.18:0/4213280889 shutdown_connections 2024-04-25T10:12:24.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 --2- 172.21.15.18:0/4213280889 >> v2:172.21.15.167:3300/0 conn(0x7fc56815bcf0 0x7fc568099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 --2- 172.21.15.18:0/4213280889 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc56815b910 0x7fc5680cf9a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 -- 172.21.15.18:0/4213280889 >> 172.21.15.18:0/4213280889 conn(0x7fc5680b3200 msgr2=0x7fc5680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 -- 172.21.15.18:0/4213280889 shutdown_connections 2024-04-25T10:12:24.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.929+0000 7fc56f000640 1 -- 172.21.15.18:0/4213280889 wait complete. 2024-04-25T10:12:24.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 Processor -- start 2024-04-25T10:12:24.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- start start 2024-04-25T10:12:24.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5680cf3c0 0x7fc5680701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56815bcf0 0x7fc568156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc568168b20 con 0x7fc56815b910 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681689a0 con 0x7fc56815bcf0 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568168ca0 con 0x7fc5680cf3c0 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56714/0 (socket says 172.21.15.18:56714) 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 -- 172.21.15.18:0/3309993581 learned_addr learned my addr 172.21.15.18:0/3309993581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:24.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567e00640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5680cf3c0 0x7fc5680701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56d000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56815bcf0 0x7fc568156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 -- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5680cf3c0 msgr2=0x7fc5680701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5680cf3c0 0x7fc5680701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 -- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56815bcf0 msgr2=0x7fc568156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56815bcf0 0x7fc568156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 -- 172.21.15.18:0/3309993581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5680b44d0 con 0x7fc56815b910 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc567400640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c420 tx=0x7fc55400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554017070 con 0x7fc56815b910 2024-04-25T10:12:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554005d10 con 0x7fc56815b910 2024-04-25T10:12:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554007310 con 0x7fc56815b910 2024-04-25T10:12:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5680b47b0 con 0x7fc56815b910 2024-04-25T10:12:24.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.933+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5680b4d70 con 0x7fc56815b910 2024-04-25T10:12:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5680745d0 con 0x7fc56815b910 2024-04-25T10:12:24.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc55401a070 con 0x7fc56815b910 2024-04-25T10:12:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc55fe00640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 0x7fc548069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fc554084730 con 0x7fc56815b910 2024-04-25T10:12:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc567e00640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 0x7fc548069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:24.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.937+0000 7fc567e00640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 0x7fc548069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5580af000 tx=0x7fc5580a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:24.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:24.941+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc554055540 con 0x7fc56815b910 2024-04-25T10:12:25.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.101+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5680cdcd0 con 0x7fc56815b910 2024-04-25T10:12:25.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.101+0000 7fc55fe00640 1 -- 172.21.15.18:0/3309993581 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v97) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc554054e40 con 0x7fc56815b910 2024-04-25T10:12:25.110 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:12:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 msgr2=0x7fc548069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 0x7fc548069420 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fc5580af000 tx=0x7fc5580a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:25.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 msgr2=0x7fc568070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fc55400c420 tx=0x7fc55400c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 shutdown_connections 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc56815bcf0 0x7fc568156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc56815b910 0x7fc568070720 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc548066f60 0x7fc548069420 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 --2- 172.21.15.18:0/3309993581 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc5680cf3c0 0x7fc5680701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 >> 172.21.15.18:0/3309993581 conn(0x7fc5680b3200 msgr2=0x7fc5680cce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:25.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 shutdown_connections 2024-04-25T10:12:25.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.105+0000 7fc56f000640 1 -- 172.21.15.18:0/3309993581 wait complete. 2024-04-25T10:12:25.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:25.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 Processor -- start 2024-04-25T10:12:25.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 -- start start 2024-04-25T10:12:25.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 0x7fbdb806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdb815def0 con 0x7fbdb815b2f0 2024-04-25T10:12:25.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdb815e1b0 con 0x7fbdb80b3950 2024-04-25T10:12:25.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.265+0000 7fbdc0800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb815e490 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbe800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 0x7fbdb806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbe800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 0x7fbdb806b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:36026/0 (socket says 172.21.15.18:36026) 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:59916/0 (socket says 172.21.15.18:59916) 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbe800640 1 -- 172.21.15.18:0/2653988689 learned_addr learned my addr 172.21.15.18:0/2653988689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 -- 172.21.15.18:0/2653988689 >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 msgr2=0x7fbdb806b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 --2- 172.21.15.18:0/2653988689 >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 0x7fbdb806b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 -- 172.21.15.18:0/2653988689 >> v1:172.21.15.167:6789/0 conn(0x7fbdb815b2f0 legacy=0x7fbdb80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 -- 172.21.15.18:0/2653988689 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb815e770 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbd400640 1 --2- 172.21.15.18:0/2653988689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097f0 tx=0x7fbda801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1db4c8be18fbe2b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbca00640 1 -- 172.21.15.18:0/2653988689 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb815b8e0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbca00640 1 -- 172.21.15.18:0/2653988689 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda80af070 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.269+0000 7fbdbca00640 1 -- 172.21.15.18:0/2653988689 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda80aa810 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- 172.21.15.18:0/2653988689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 msgr2=0x7fbdb806ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- 172.21.15.18:0/2653988689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbda80097f0 tx=0x7fbda801c470 comp rx=0 tx=0).stop 2024-04-25T10:12:25.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- 172.21.15.18:0/2653988689 shutdown_connections 2024-04-25T10:12:25.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- 172.21.15.18:0/2653988689 >> v2:172.21.15.167:3300/0 conn(0x7fbdb80b3950 0x7fbdb806b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- 172.21.15.18:0/2653988689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b2dc0 0x7fbdb806ac10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- 172.21.15.18:0/2653988689 >> 172.21.15.18:0/2653988689 conn(0x7fbdb80b23b0 msgr2=0x7fbdb80cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- 172.21.15.18:0/2653988689 shutdown_connections 2024-04-25T10:12:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- 172.21.15.18:0/2653988689 wait complete. 2024-04-25T10:12:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 Processor -- start 2024-04-25T10:12:25.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- start start 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b3950 0x7fbdb80cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdb815b2f0 0x7fbdb8146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb816a880 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb81616f0 con 0x7fbdb815b2f0 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdc0800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdb816aa00 con 0x7fbdb80b3950 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56728/0 (socket says 172.21.15.18:56728) 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 -- 172.21.15.18:0/1927936983 learned_addr learned my addr 172.21.15.18:0/1927936983 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbe800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdb815b2f0 0x7fbdb8146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbd400640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b3950 0x7fbdb80cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 -- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b3950 msgr2=0x7fbdb80cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b3950 0x7fbdb80cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 -- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdb815b2f0 msgr2=0x7fbdb8146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdb815b2f0 0x7fbdb8146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.273+0000 7fbdbde00640 1 -- 172.21.15.18:0/1927936983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb815f600 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdbde00640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c370 tx=0x7fbdac00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac0052d0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac005470 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdac007260 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdb815f8e0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdb815fea0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdb80745d0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbdac007400 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 0x7fbd9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.277+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbdac0846a0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.281+0000 7fbdbd400640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 0x7fbd9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.281+0000 7fbdbd400640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 0x7fbd9c069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbda80ae000 tx=0x7fbda80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.281+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbdac054da0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdb80d0ab0 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdb2000640 1 -- 172.21.15.18:0/1927936983 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fbdac058e40 con 0x7fbdb80b2dc0 2024-04-25T10:12:25.489 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:25.489 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:12:25.489 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 msgr2=0x7fbd9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 0x7fbd9c069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbda80ae000 tx=0x7fbda80a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 msgr2=0x7fbdb815f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fbdac00c370 tx=0x7fbdac00c830 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 shutdown_connections 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdb815b2f0 0x7fbdb8146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbd9c066f60 0x7fbd9c069420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdb80b3950 0x7fbdb80cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 --2- 172.21.15.18:0/1927936983 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdb80b2dc0 0x7fbdb815f020 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 >> 172.21.15.18:0/1927936983 conn(0x7fbdb80b23b0 msgr2=0x7fbdb80b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 shutdown_connections 2024-04-25T10:12:25.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.481+0000 7fbdc0800640 1 -- 172.21.15.18:0/1927936983 wait complete. 2024-04-25T10:12:25.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:25.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 Processor -- start 2024-04-25T10:12:25.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 -- start start 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14581653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145815ac60 con 0x7f14580cef30 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14580cf3e0 con 0x7f1458144140 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f145e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145815af20 con 0x7f145806ead0 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f144ea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f14580cef30 0x7f145806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49470/0 (socket says 172.21.15.18:49470) 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f144ea00640 1 -- 172.21.15.18:0/1104512745 learned_addr learned my addr 172.21.15.18:0/1104512745 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:25.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f1457e00640 1 --2- 172.21.15.18:0/1104512745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14581653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.645+0000 7f1456a00640 1 -- 172.21.15.18:0/1104512745 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847812200 0 0) 0x7f145815ac60 con 0x7f14580cef30 2024-04-25T10:12:25.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1456a00640 1 -- 172.21.15.18:0/1104512745 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f143c005740 con 0x7f14580cef30 2024-04-25T10:12:25.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1457e00640 1 -- 172.21.15.18:0/1104512745 >> v1:172.21.15.167:6789/0 conn(0x7f1458144140 legacy=0x7f14580ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1457e00640 1 -- 172.21.15.18:0/1104512745 >> v1:172.21.15.18:6789/0 conn(0x7f14580cef30 legacy=0x7f145806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1457e00640 1 -- 172.21.15.18:0/1104512745 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145815b200 con 0x7f145806ead0 2024-04-25T10:12:25.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1457e00640 1 --2- 172.21.15.18:0/1104512745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14581653d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1450009dc0 tx=0x7f145001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5c92dc6de96861f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1456a00640 1 -- 172.21.15.18:0/1104512745 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500b2070 con 0x7f145806ead0 2024-04-25T10:12:25.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1456a00640 1 -- 172.21.15.18:0/1104512745 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14500a5750 con 0x7f145806ead0 2024-04-25T10:12:25.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f1456a00640 1 -- 172.21.15.18:0/1104512745 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14500a5b20 con 0x7f145806ead0 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f145e000640 1 -- 172.21.15.18:0/1104512745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 msgr2=0x7f14581653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f145e000640 1 --2- 172.21.15.18:0/1104512745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14581653d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1450009dc0 tx=0x7f145001c990 comp rx=0 tx=0).stop 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.649+0000 7f145e000640 1 -- 172.21.15.18:0/1104512745 shutdown_connections 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 --2- 172.21.15.18:0/1104512745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14581653d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- 172.21.15.18:0/1104512745 >> 172.21.15.18:0/1104512745 conn(0x7f1458066fa0 msgr2=0x7f145806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- 172.21.15.18:0/1104512745 shutdown_connections 2024-04-25T10:12:25.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- 172.21.15.18:0/1104512745 wait complete. 2024-04-25T10:12:25.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 Processor -- start 2024-04-25T10:12:25.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- start start 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14580b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1458144140 0x7f1458138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145815bb80 con 0x7f14580cef30 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f145815ba00 con 0x7f1458144140 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145806dac0 con 0x7f145806ead0 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56740/0 (socket says 172.21.15.18:56740) 2024-04-25T10:12:25.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 -- 172.21.15.18:0/2095452419 learned_addr learned my addr 172.21.15.18:0/2095452419 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f1457400640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14580b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f1457e00640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1458144140 0x7f1458138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 -- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 msgr2=0x7f14580b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14580b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 -- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1458144140 msgr2=0x7f1458138320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1458144140 0x7f1458138320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 -- 172.21.15.18:0/2095452419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145815eb60 con 0x7f14580cef30 2024-04-25T10:12:25.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144ea00640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f144000c500 tx=0x7f144000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1440017070 con 0x7f14580cef30 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440005cf0 con 0x7f14580cef30 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400072f0 con 0x7f14580cef30 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.653+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f145813dee0 con 0x7f14580cef30 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f145813e4a0 con 0x7f14580cef30 2024-04-25T10:12:25.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14580745d0 con 0x7f14580cef30 2024-04-25T10:12:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f144001a070 con 0x7f14580cef30 2024-04-25T10:12:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f144fe00640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 0x7f1434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f14400845a0 con 0x7f14580cef30 2024-04-25T10:12:25.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f1457400640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 0x7f1434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.657+0000 7f1457400640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 0x7f1434069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f14581358e0 tx=0x7f1448009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:25.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.661+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1440054d20 con 0x7f14580cef30 2024-04-25T10:12:25.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.825+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14580cd8e0 con 0x7f14580cef30 2024-04-25T10:12:25.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.825+0000 7f144fe00640 1 -- 172.21.15.18:0/2095452419 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17314 (secure 0 0 0) 0x7f1440058dc0 con 0x7f14580cef30 2024-04-25T10:12:25.833 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:25.833 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":97,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:11:42.885947+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6833/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:25.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 msgr2=0x7f1434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 0x7f1434069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f14581358e0 tx=0x7f1448009040 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 msgr2=0x7f1458134970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f144000c500 tx=0x7f144000c9c0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 shutdown_connections 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1458144140 0x7f1458138320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14580cef30 0x7f1458134970 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1434066f60 0x7f1434069420 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 --2- 172.21.15.18:0/2095452419 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f145806ead0 0x7f14580b4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 >> 172.21.15.18:0/2095452419 conn(0x7f1458066fa0 msgr2=0x7f14580b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 shutdown_connections 2024-04-25T10:12:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.829+0000 7f145e000640 1 -- 172.21.15.18:0/2095452419 wait complete. 2024-04-25T10:12:25.855 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:12:25.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 Processor -- start 2024-04-25T10:12:25.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 -- start start 2024-04-25T10:12:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdff0145270 0x7fdff015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fdff00cd4d0 0x7fdff00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00cc4e0 con 0x7fdff00b1750 2024-04-25T10:12:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff0145650 con 0x7fdff0145270 2024-04-25T10:12:25.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdff4a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00ce040 con 0x7fdff00cd4d0 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfede00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdff0145270 0x7fdff015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfee800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdff00b1750 0x7fdff00b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49482/0 (socket says 172.21.15.18:49482) 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfee800640 1 -- 172.21.15.18:0/3325087217 learned_addr learned my addr 172.21.15.18:0/3325087217 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfed400640 1 --2- 172.21.15.18:0/3325087217 >> v2:172.21.15.167:3300/0 conn(0x7fdff00cd4d0 0x7fdff00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfede00640 1 -- 172.21.15.18:0/3325087217 >> v2:172.21.15.167:3300/0 conn(0x7fdff00cd4d0 msgr2=0x7fdff00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfede00640 1 --2- 172.21.15.18:0/3325087217 >> v2:172.21.15.167:3300/0 conn(0x7fdff00cd4d0 0x7fdff00cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfede00640 1 -- 172.21.15.18:0/3325087217 >> v1:172.21.15.18:6789/0 conn(0x7fdff00b1750 legacy=0x7fdff00b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:25.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfede00640 1 -- 172.21.15.18:0/3325087217 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00ce320 con 0x7fdff0145270 2024-04-25T10:12:25.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.989+0000 7fdfeca00640 1 -- 172.21.15.18:0/3325087217 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012142888 0 0) 0x7fdff00cc4e0 con 0x7fdff00b1750 2024-04-25T10:12:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdfede00640 1 --2- 172.21.15.18:0/3325087217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff015fe50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b24b0 tx=0x7fdfe001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bf9416a02a0de6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdfeca00640 1 -- 172.21.15.18:0/3325087217 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00b0070 con 0x7fdff0145270 2024-04-25T10:12:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdfeca00640 1 -- 172.21.15.18:0/3325087217 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe00ab600 con 0x7fdff0145270 2024-04-25T10:12:26.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdfeca00640 1 -- 172.21.15.18:0/3325087217 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe00ab9d0 con 0x7fdff0145270 2024-04-25T10:12:26.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- 172.21.15.18:0/3325087217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 msgr2=0x7fdff015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3325087217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff015fe50 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fdff00b24b0 tx=0x7fdfe001c480 comp rx=0 tx=0).stop 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- 172.21.15.18:0/3325087217 shutdown_connections 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3325087217 >> v2:172.21.15.167:3300/0 conn(0x7fdff00cd4d0 0x7fdff00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3325087217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff015fe50 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- 172.21.15.18:0/3325087217 >> 172.21.15.18:0/3325087217 conn(0x7fdff0066fa0 msgr2=0x7fdff006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- 172.21.15.18:0/3325087217 shutdown_connections 2024-04-25T10:12:26.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- 172.21.15.18:0/3325087217 wait complete. 2024-04-25T10:12:26.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 Processor -- start 2024-04-25T10:12:26.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.993+0000 7fdff4a00640 1 -- start start 2024-04-25T10:12:26.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdff00b1750 0x7fdff015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdff00cd4d0 0x7fdff013c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff015c710 con 0x7fdff0145270 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff015c590 con 0x7fdff00cd4d0 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff015c890 con 0x7fdff00b1750 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56750/0 (socket says 172.21.15.18:56750) 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 -- 172.21.15.18:0/3995624179 learned_addr learned my addr 172.21.15.18:0/3995624179 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfede00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdff00b1750 0x7fdff015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfed400640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdff00cd4d0 0x7fdff013c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 -- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdff00b1750 msgr2=0x7fdff015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdff00b1750 0x7fdff015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 -- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdff00cd4d0 msgr2=0x7fdff013c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdff00cd4d0 0x7fdff013c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 -- 172.21.15.18:0/3995624179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff013f6c0 con 0x7fdff0145270 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfee800640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c7a0 tx=0x7fdfe800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8018070 con 0x7fdff0145270 2024-04-25T10:12:26.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe800a640 con 0x7fdff0145270 2024-04-25T10:12:26.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe800aab0 con 0x7fdff0145270 2024-04-25T10:12:26.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff013f9a0 con 0x7fdff0145270 2024-04-25T10:12:26.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff0142030 con 0x7fdff0145270 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:25.997+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff00745d0 con 0x7fdff0145270 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.001+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdfe800ac50 con 0x7fdff0145270 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.001+0000 7fdfe6000640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 0x7fdfd0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.001+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fdfe8084850 con 0x7fdff0145270 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.001+0000 7fdfede00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 0x7fdfd0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.001+0000 7fdfede00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 0x7fdfd0069450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00ad000 tx=0x7fdfe00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.005+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdfe8054ec0 con 0x7fdff0145270 2024-04-25T10:12:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdff006b8e0 con 0x7fdff0145270 2024-04-25T10:12:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdfe6000640 1 -- 172.21.15.18:0/3995624179 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fdfe8058f60 con 0x7fdff0145270 2024-04-25T10:12:26.213 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:26.213 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:12:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 msgr2=0x7fdfd0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 0x7fdfd0069450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdfe00ad000 tx=0x7fdfe00a6000 comp rx=0 tx=0).stop 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 msgr2=0x7fdff013cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.205+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800c7a0 tx=0x7fdfe800cc60 comp rx=0 tx=0).stop 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 shutdown_connections 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdff0145270 0x7fdff013cb30 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdff00cd4d0 0x7fdff013c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdfd0066f90 0x7fdfd0069450 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 --2- 172.21.15.18:0/3995624179 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdff00b1750 0x7fdff015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 >> 172.21.15.18:0/3995624179 conn(0x7fdff0066fa0 msgr2=0x7fdff00b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 shutdown_connections 2024-04-25T10:12:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.209+0000 7fdff4a00640 1 -- 172.21.15.18:0/3995624179 wait complete. 2024-04-25T10:12:26.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 Processor -- start 2024-04-25T10:12:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 -- start start 2024-04-25T10:12:26.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff66c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff66c0b1e60 0x7ff66c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c0cc4e0 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66c145650 con 0x7ff66c0b1e60 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff672a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0ce040 con 0x7ff66c145270 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff663400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff66c0cd4d0 0x7ff66c0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49490/0 (socket says 172.21.15.18:49490) 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff663400640 1 -- 172.21.15.18:0/4177997868 learned_addr learned my addr 172.21.15.18:0/4177997868 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff670a00640 1 --2- 172.21.15.18:0/4177997868 >> v2:172.21.15.167:3300/0 conn(0x7ff66c0b1e60 0x7ff66c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66be00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff66c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480666313 0 0) 0x7ff66c0cc4e0 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650003530 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2379312230 0 0) 0x7ff650003530 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 msgr2=0x7ff66c15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff66c15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 >> v2:172.21.15.167:3300/0 conn(0x7ff66c0b1e60 msgr2=0x7ff66c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 --2- 172.21.15.18:0/4177997868 >> v2:172.21.15.167:3300/0 conn(0x7ff66c0b1e60 0x7ff66c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c0ce320 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff654001680 con 0x7ff66c0cd4d0 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 >> v1:172.21.15.18:6789/0 conn(0x7ff66c0cd4d0 legacy=0x7ff66c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6500039c0 0x7ff650003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c145650 con 0x7ff6500039c0 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0ce040 con 0x7ff650004d50 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65000b9d0 con 0x7ff66c145270 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.369+0000 7ff66be00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6500039c0 0x7ff650003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff663400640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff670a00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 -- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 msgr2=0x7ff650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:26.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c145270 0x7ff650004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 -- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff650004d50 msgr2=0x7ff6500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 -- 172.21.15.18:0/4177997868 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650003530 con 0x7ff6500039c0 2024-04-25T10:12:26.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff670a00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff650004d50 0x7ff6500051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66be00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6500039c0 0x7ff650003de0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009ae0 tx=0x7ff65c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3974dc3968aacf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0b2070 con 0x7ff6500039c0 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c0a5550 con 0x7ff6500039c0 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff66b400640 1 -- 172.21.15.18:0/4177997868 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0096b0 con 0x7ff6500039c0 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff672a00640 1 -- 172.21.15.18:0/4177997868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6500039c0 msgr2=0x7ff650003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff672a00640 1 --2- 172.21.15.18:0/4177997868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6500039c0 0x7ff650003de0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009ae0 tx=0x7ff65c01ca70 comp rx=0 tx=0).stop 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.373+0000 7ff670a00640 1 -- 172.21.15.18:0/4177997868 reap_dead start 2024-04-25T10:12:26.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- 172.21.15.18:0/4177997868 shutdown_connections 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- 172.21.15.18:0/4177997868 >> 172.21.15.18:0/4177997868 conn(0x7ff66c066fa0 msgr2=0x7ff66c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- 172.21.15.18:0/4177997868 shutdown_connections 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- 172.21.15.18:0/4177997868 wait complete. 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 Processor -- start 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- start start 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6500039c0 0x7ff66c13c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 0x7ff66c0a9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15c590 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15f930 con 0x7ff6500039c0 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15c710 con 0x7ff66c0a9210 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56782/0 (socket says 172.21.15.18:56782) 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 -- 172.21.15.18:0/3113832252 learned_addr learned my addr 172.21.15.18:0/3113832252 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff66be00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6500039c0 0x7ff66c13c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff670a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 0x7ff66c0a9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 -- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 msgr2=0x7ff66c0a9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 0x7ff66c0a9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 -- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6500039c0 msgr2=0x7ff66c13c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6500039c0 0x7ff66c13c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 -- 172.21.15.18:0/3113832252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c13e900 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff670a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 0x7ff66c0a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff663400640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff65400e8e0 tx=0x7ff65400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654019070 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65400c870 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65400cc40 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.377+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c13ebe0 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c13f1a0 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c13f510 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff65401c070 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff668c00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ff654084a90 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff66be00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.381+0000 7ff66be00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 0x7ff648069420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0af000 tx=0x7ff65c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.385+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff66c13f510 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.581+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff66c0745d0 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.581+0000 7ff668c00640 1 -- 172.21.15.18:0/3113832252 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff654055190 con 0x7ff66c0ab5e0 2024-04-25T10:12:26.589 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:26.590 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:10:19.638807+0000","modified":"2024-04-25T10:11:45.900024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":97,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8004},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8004":{"gid":8004,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2720545627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2720545627},{"type":"v1","addr":"172.21.15.18:6835","nonce":2720545627}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T10:12:26.590 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 msgr2=0x7ff648069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 0x7ff648069420 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff65c0af000 tx=0x7ff65c0046d0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 msgr2=0x7ff66c0aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7ff65400e8e0 tx=0x7ff65400eda0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 shutdown_connections 2024-04-25T10:12:26.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff648066f60 0x7ff648069420 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff66c0a9210 0x7ff66c0a9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff66c0ab5e0 0x7ff66c0aba60 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 --2- 172.21.15.18:0/3113832252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6500039c0 0x7ff66c13c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 >> 172.21.15.18:0/3113832252 conn(0x7ff66c066fa0 msgr2=0x7ff66c0b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 shutdown_connections 2024-04-25T10:12:26.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.585+0000 7ff672a00640 1 -- 172.21.15.18:0/3113832252 wait complete. 2024-04-25T10:12:26.610 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:26.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 Processor -- start 2024-04-25T10:12:26.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 -- start start 2024-04-25T10:12:26.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fec2809a170 0x7fec280cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2806d740 con 0x7fec2815dcd0 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2806cea0 con 0x7fec2809a7a0 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec2d800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec280cbfc0 con 0x7fec2809a170 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fec2815dcd0 0x7fec28099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49502/0 (socket says 172.21.15.18:49502) 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27e00640 1 -- 172.21.15.18:0/1374395554 learned_addr learned my addr 172.21.15.18:0/1374395554 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27400640 1 --2- 172.21.15.18:0/1374395554 >> v2:172.21.15.167:3300/0 conn(0x7fec2809a170 0x7fec280cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec26a00640 1 -- 172.21.15.18:0/1374395554 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763139247 0 0) 0x7fec2806d740 con 0x7fec2815dcd0 2024-04-25T10:12:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec26a00640 1 -- 172.21.15.18:0/1374395554 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec0c003530 con 0x7fec2815dcd0 2024-04-25T10:12:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27400640 1 -- 172.21.15.18:0/1374395554 >> v1:172.21.15.167:6789/0 conn(0x7fec2809a7a0 legacy=0x7fec280cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27400640 1 -- 172.21.15.18:0/1374395554 >> v1:172.21.15.18:6789/0 conn(0x7fec2815dcd0 legacy=0x7fec28099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.745+0000 7fec27400640 1 -- 172.21.15.18:0/1374395554 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2806d180 con 0x7fec2809a170 2024-04-25T10:12:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec27400640 1 --2- 172.21.15.18:0/1374395554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a170 0x7fec280cc450 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fec140097c0 tx=0x7fec280cd8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2faa7eb5061ff383 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec26a00640 1 -- 172.21.15.18:0/1374395554 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140a7070 con 0x7fec2809a170 2024-04-25T10:12:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec26a00640 1 -- 172.21.15.18:0/1374395554 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec140b0070 con 0x7fec2809a170 2024-04-25T10:12:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec26a00640 1 -- 172.21.15.18:0/1374395554 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec140ab890 con 0x7fec2809a170 2024-04-25T10:12:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 -- 172.21.15.18:0/1374395554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a170 msgr2=0x7fec280cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 --2- 172.21.15.18:0/1374395554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a170 0x7fec280cc450 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fec140097c0 tx=0x7fec280cd8b0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 -- 172.21.15.18:0/1374395554 shutdown_connections 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 --2- 172.21.15.18:0/1374395554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a170 0x7fec280cc450 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 -- 172.21.15.18:0/1374395554 >> 172.21.15.18:0/1374395554 conn(0x7fec280b3050 msgr2=0x7fec280b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 -- 172.21.15.18:0/1374395554 shutdown_connections 2024-04-25T10:12:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 -- 172.21.15.18:0/1374395554 wait complete. 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.749+0000 7fec2d800640 1 Processor -- start 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- start start 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2809a170 0x7fec281581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a7a0 0x7fec28154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2816ba30 con 0x7fec2815dcd0 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2816b8b0 con 0x7fec2809a7a0 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2816bbb0 con 0x7fec2809a170 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56786/0 (socket says 172.21.15.18:56786) 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 -- 172.21.15.18:0/1820073926 learned_addr learned my addr 172.21.15.18:0/1820073926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec27e00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2809a170 0x7fec281581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec27400640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a7a0 0x7fec28154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 -- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2809a170 msgr2=0x7fec281581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2809a170 0x7fec281581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 -- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a7a0 msgr2=0x7fec28154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a7a0 0x7fec28154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 -- 172.21.15.18:0/1820073926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec280cfb70 con 0x7fec2815dcd0 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2ce00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c770 tx=0x7fec2000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec20003b80 con 0x7fec2815dcd0 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20003d20 con 0x7fec2815dcd0 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec280d10f0 con 0x7fec2815dcd0 2024-04-25T10:12:26.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2000aa90 con 0x7fec2815dcd0 2024-04-25T10:12:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec28156620 con 0x7fec2815dcd0 2024-04-25T10:12:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.753+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2804efa0 con 0x7fec2815dcd0 2024-04-25T10:12:26.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.757+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fec2000ac30 con 0x7fec2815dcd0 2024-04-25T10:12:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.757+0000 7fec1fe00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 0x7fec08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.757+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fec20085020 con 0x7fec2815dcd0 2024-04-25T10:12:26.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.757+0000 7fec27e00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 0x7fec08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:26.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.757+0000 7fec27e00640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 0x7fec08069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fec180011f0 tx=0x7fec18007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:26.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.761+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fec200557c0 con 0x7fec2815dcd0 2024-04-25T10:12:26.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.925+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec28099a60 con 0x7fec2815dcd0 2024-04-25T10:12:26.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec1fe00640 1 -- 172.21.15.18:0/1820073926 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+17314 (secure 0 0 0) 0x7fec20059860 con 0x7fec2815dcd0 2024-04-25T10:12:26.936 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:26.936 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":97,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:11:42.885947+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:10:18.053140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T10:10:18.626398+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.1e","mappings":[{"from":1,"to":2}]},{"pgid":"14.21","mappings":[{"from":1,"to":7}]},{"pgid":"14.2c","mappings":[{"from":1,"to":5}]},{"pgid":"14.2d","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6833/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 msgr2=0x7fec08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 0x7fec08069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fec180011f0 tx=0x7fec18007d40 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 msgr2=0x7fec280b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fec2000c770 tx=0x7fec2000cc30 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 shutdown_connections 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec2815dcd0 0x7fec280b64d0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fec2809a7a0 0x7fec28154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fec08066f60 0x7fec08069420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 --2- 172.21.15.18:0/1820073926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fec2809a170 0x7fec281581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 >> 172.21.15.18:0/1820073926 conn(0x7fec280b3050 msgr2=0x7fec280cf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 shutdown_connections 2024-04-25T10:12:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:26.929+0000 7fec2d800640 1 -- 172.21.15.18:0/1820073926 wait complete. 2024-04-25T10:12:26.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:12:27.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.089+0000 7f1497a00640 1 Processor -- start 2024-04-25T10:12:27.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.089+0000 7f1497a00640 1 -- start start 2024-04-25T10:12:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1497a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1490159320 0x7f149015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1497a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149015fc00 con 0x7f149006e4a0 2024-04-25T10:12:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1497a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149015fee0 con 0x7f149015f440 2024-04-25T10:12:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1497a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149006d640 con 0x7f1490159320 2024-04-25T10:12:27.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f149006e4a0 0x7f1490071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49516/0 (socket says 172.21.15.18:49516) 2024-04-25T10:12:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495a00640 1 -- 172.21.15.18:0/2415761255 learned_addr learned my addr 172.21.15.18:0/2415761255 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495000640 1 --2- 172.21.15.18:0/2415761255 >> v2:172.21.15.167:3300/0 conn(0x7f1490159320 0x7f149015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f148fe00640 1 -- 172.21.15.18:0/2415761255 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267250412 0 0) 0x7f149015fc00 con 0x7f149006e4a0 2024-04-25T10:12:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f148fe00640 1 -- 172.21.15.18:0/2415761255 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474003530 con 0x7f149006e4a0 2024-04-25T10:12:27.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495000640 1 -- 172.21.15.18:0/2415761255 >> v1:172.21.15.167:6789/0 conn(0x7f149015f440 legacy=0x7f149006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495000640 1 -- 172.21.15.18:0/2415761255 >> v1:172.21.15.18:6789/0 conn(0x7f149006e4a0 legacy=0x7f1490071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.093+0000 7f1495000640 1 -- 172.21.15.18:0/2415761255 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14901601c0 con 0x7f1490159320 2024-04-25T10:12:27.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1495000640 1 --2- 172.21.15.18:0/2415761255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1490159320 0x7f149015c9b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f149006d7c0 tx=0x7f148001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c2097b2cf0ede6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f148fe00640 1 -- 172.21.15.18:0/2415761255 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800b2070 con 0x7f1490159320 2024-04-25T10:12:27.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f148fe00640 1 -- 172.21.15.18:0/2415761255 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800ad680 con 0x7f1490159320 2024-04-25T10:12:27.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f148fe00640 1 -- 172.21.15.18:0/2415761255 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800ada50 con 0x7f1490159320 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 -- 172.21.15.18:0/2415761255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1490159320 msgr2=0x7f149015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 --2- 172.21.15.18:0/2415761255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1490159320 0x7f149015c9b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f149006d7c0 tx=0x7f148001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 -- 172.21.15.18:0/2415761255 shutdown_connections 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 --2- 172.21.15.18:0/2415761255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1490159320 0x7f149015c9b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 -- 172.21.15.18:0/2415761255 >> 172.21.15.18:0/2415761255 conn(0x7f1490067080 msgr2=0x7f149006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 -- 172.21.15.18:0/2415761255 shutdown_connections 2024-04-25T10:12:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 -- 172.21.15.18:0/2415761255 wait complete. 2024-04-25T10:12:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.097+0000 7f1497a00640 1 Processor -- start 2024-04-25T10:12:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- start start 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f149006e4a0 0x7f1490157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1490159320 0x7f1490155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149015f9a0 con 0x7f149015f440 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149015f820 con 0x7f149006e4a0 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1490071980 con 0x7f1490159320 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56794/0 (socket says 172.21.15.18:56794) 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 -- 172.21.15.18:0/4073606603 learned_addr learned my addr 172.21.15.18:0/4073606603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:27.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495000640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f149006e4a0 0x7f1490157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1487e00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1490159320 0x7f1490155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 -- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1490159320 msgr2=0x7f1490155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1490159320 0x7f1490155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 -- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f149006e4a0 msgr2=0x7f1490157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f149006e4a0 0x7f1490157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 -- 172.21.15.18:0/4073606603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14901561b0 con 0x7f149015f440 2024-04-25T10:12:27.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1495a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f148800cb40 tx=0x7f148800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488017070 con 0x7f149015f440 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800aca0 con 0x7f149015f440 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1490156450 con 0x7f149015f440 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488012620 con 0x7f149015f440 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1490156a10 con 0x7f149015f440 2024-04-25T10:12:27.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.101+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14900745d0 con 0x7f149015f440 2024-04-25T10:12:27.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.105+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f148801a070 con 0x7f149015f440 2024-04-25T10:12:27.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.105+0000 7f148d600640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 0x7f146c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.105+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f14880850e0 con 0x7f149015f440 2024-04-25T10:12:27.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.105+0000 7f1495000640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 0x7f146c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.105+0000 7f1495000640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 0x7f146c069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f14800af000 tx=0x7f14800a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.109+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1488055750 con 0x7f149015f440 2024-04-25T10:12:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.305+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1490157500 con 0x7f149015f440 2024-04-25T10:12:27.314 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:12:27.305+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:12:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.309+0000 7f148d600640 1 -- 172.21.15.18:0/4073606603 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f14880597f0 con 0x7f149015f440 2024-04-25T10:12:27.316 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 msgr2=0x7f146c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 0x7f146c069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f14800af000 tx=0x7f14800a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 msgr2=0x7f1490155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f148800cb40 tx=0x7f148800a060 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 shutdown_connections 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f149015f440 0x7f1490155050 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f146c066f90 0x7f146c069450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1490159320 0x7f1490155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 --2- 172.21.15.18:0/4073606603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f149006e4a0 0x7f1490157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 >> 172.21.15.18:0/4073606603 conn(0x7f1490067080 msgr2=0x7f1490071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 shutdown_connections 2024-04-25T10:12:27.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.313+0000 7f1497a00640 1 -- 172.21.15.18:0/4073606603 wait complete. 2024-04-25T10:12:27.326 INFO:tasks.ceph.mds.c.smithi018.stderr: -1950> 2024-04-25T10:11:49.745+0000 7f301a000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x562fa4986100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T10:12:27.340 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:12:27.372 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:12:27.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 Processor -- start 2024-04-25T10:12:27.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 -- start start 2024-04-25T10:12:27.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdf3015acd0 0x7fdf3015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3015bc40 con 0x7fdf30144120 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf3015b3a0 con 0x7fdf3015ee60 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf36a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf3015e490 con 0x7fdf3015acd0 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf2fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdf30144120 0x7fdf300ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49536/0 (socket says 172.21.15.18:49536) 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf2fe00640 1 -- 172.21.15.18:0/783018926 learned_addr learned my addr 172.21.15.18:0/783018926 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf27400640 1 --2- 172.21.15.18:0/783018926 >> v2:172.21.15.18:3300/0 conn(0x7fdf3015acd0 0x7fdf3015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf2f400640 1 -- 172.21.15.18:0/783018926 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471082564 0 0) 0x7fdf3015bc40 con 0x7fdf30144120 2024-04-25T10:12:27.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf2f400640 1 -- 172.21.15.18:0/783018926 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf14005740 con 0x7fdf30144120 2024-04-25T10:12:27.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf27400640 1 -- 172.21.15.18:0/783018926 >> v1:172.21.15.167:6789/0 conn(0x7fdf3015ee60 legacy=0x7fdf300b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:27.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf27400640 1 -- 172.21.15.18:0/783018926 >> v1:172.21.15.18:6789/0 conn(0x7fdf30144120 legacy=0x7fdf300ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.481+0000 7fdf27400640 1 -- 172.21.15.18:0/783018926 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3015b680 con 0x7fdf3015acd0 2024-04-25T10:12:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf27400640 1 --2- 172.21.15.18:0/783018926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf3015acd0 0x7fdf3015e920 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f161340d83bfbe22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf2f400640 1 -- 172.21.15.18:0/783018926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180b2070 con 0x7fdf3015acd0 2024-04-25T10:12:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf2f400640 1 -- 172.21.15.18:0/783018926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf180a5760 con 0x7fdf3015acd0 2024-04-25T10:12:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf2f400640 1 -- 172.21.15.18:0/783018926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf180a5b10 con 0x7fdf3015acd0 2024-04-25T10:12:27.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 -- 172.21.15.18:0/783018926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf3015acd0 msgr2=0x7fdf3015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 --2- 172.21.15.18:0/783018926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf3015acd0 0x7fdf3015e920 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009d90 tx=0x7fdf1801c8a0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 -- 172.21.15.18:0/783018926 shutdown_connections 2024-04-25T10:12:27.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 --2- 172.21.15.18:0/783018926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf3015acd0 0x7fdf3015e920 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 -- 172.21.15.18:0/783018926 >> 172.21.15.18:0/783018926 conn(0x7fdf30067080 msgr2=0x7fdf3006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:27.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 -- 172.21.15.18:0/783018926 shutdown_connections 2024-04-25T10:12:27.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.485+0000 7fdf36a00640 1 -- 172.21.15.18:0/783018926 wait complete. 2024-04-25T10:12:27.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 Processor -- start 2024-04-25T10:12:27.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- start start 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 0x7fdf301f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 0x7fdf30142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3006de70 con 0x7fdf30144120 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3006dcf0 con 0x7fdf3015acd0 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3006dff0 con 0x7fdf3015ee60 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56844/0 (socket says 172.21.15.18:56844) 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 -- 172.21.15.18:0/1236524586 learned_addr learned my addr 172.21.15.18:0/1236524586 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:27.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf27400640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 0x7fdf301f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 -- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 msgr2=0x7fdf30142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf34a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 0x7fdf30142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 0x7fdf30142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 -- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 msgr2=0x7fdf301f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 0x7fdf301f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 -- 172.21.15.18:0/1236524586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300b0f10 con 0x7fdf30144120 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf27400640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 0x7fdf301f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf34a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 0x7fdf30142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2fe00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c450 tx=0x7fdf2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20017070 con 0x7fdf30144120 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20005cf0 con 0x7fdf30144120 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20007290 con 0x7fdf30144120 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf300acb20 con 0x7fdf30144120 2024-04-25T10:12:27.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3015a310 con 0x7fdf30144120 2024-04-25T10:12:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.489+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf300745d0 con 0x7fdf30144120 2024-04-25T10:12:27.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.493+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdf2001a070 con 0x7fdf30144120 2024-04-25T10:12:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.493+0000 7fdf2cc00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 0x7fdf0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.493+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6475+0+0 (secure 0 0 0) 0x7fdf200846f0 con 0x7fdf30144120 2024-04-25T10:12:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.493+0000 7fdf27400640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 0x7fdf0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:27.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.493+0000 7fdf27400640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 0x7fdf0c069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdf180af000 tx=0x7fdf180a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:27.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.497+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdf200553f0 con 0x7fdf30144120 2024-04-25T10:12:27.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:27.693+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdf3013f970 con 0x7fdf30144120 2024-04-25T10:12:28.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.309+0000 7fdf2cc00640 1 -- 172.21.15.18:0/1236524586 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdf20054cf0 con 0x7fdf30144120 2024-04-25T10:12:28.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 msgr2=0x7fdf0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 0x7fdf0c069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fdf180af000 tx=0x7fdf180a7070 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 msgr2=0x7fdf30159580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fdf2000c450 tx=0x7fdf2000c910 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 shutdown_connections 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdf0c066f60 0x7fdf0c069420 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdf3015ee60 0x7fdf30142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdf3015acd0 0x7fdf301f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 --2- 172.21.15.18:0/1236524586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf30144120 0x7fdf30159580 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 >> 172.21.15.18:0/1236524586 conn(0x7fdf30067080 msgr2=0x7fdf300b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 shutdown_connections 2024-04-25T10:12:28.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.313+0000 7fdf36a00640 1 -- 172.21.15.18:0/1236524586 wait complete. 2024-04-25T10:12:28.343 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:12:28.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 Processor -- start 2024-04-25T10:12:28.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 -- start start 2024-04-25T10:12:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 0x7f31f40b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f415de90 con 0x7f31f415dab0 2024-04-25T10:12:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f4071a70 con 0x7f31f40713c0 2024-04-25T10:12:28.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.529+0000 7f31f9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f40b57a0 con 0x7f31f40b0c00 2024-04-25T10:12:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31ea000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 0x7f31f40b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f2a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f31f415dab0 0x7f31f4070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42518/0 (socket says 172.21.15.18:42518) 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f2a00640 1 -- 172.21.15.18:0/1397023930 learned_addr learned my addr 172.21.15.18:0/1397023930 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f2000640 1 -- 172.21.15.18:0/1397023930 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172920723 0 0) 0x7f31f415de90 con 0x7f31f415dab0 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f2000640 1 -- 172.21.15.18:0/1397023930 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31d8003530 con 0x7f31f415dab0 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 -- 172.21.15.18:0/1397023930 >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 msgr2=0x7f31f40b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 --2- 172.21.15.18:0/1397023930 >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 0x7f31f40b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 -- 172.21.15.18:0/1397023930 >> v1:172.21.15.167:6789/0 conn(0x7f31f415dab0 legacy=0x7f31f4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 -- 172.21.15.18:0/1397023930 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f406bec0 con 0x7f31f40b0c00 2024-04-25T10:12:28.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31ea000640 1 --2- 172.21.15.18:0/1397023930 >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 0x7f31f40b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:28.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.533+0000 7f31f3400640 1 --2- 172.21.15.18:0/1397023930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f406c9a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097c0 tx=0x7f31ec01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8b0640c4663271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f2000640 1 -- 172.21.15.18:0/1397023930 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0a7070 con 0x7f31f40b0c00 2024-04-25T10:12:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f2000640 1 -- 172.21.15.18:0/1397023930 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0b0070 con 0x7f31f40b0c00 2024-04-25T10:12:28.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f2000640 1 -- 172.21.15.18:0/1397023930 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0ab890 con 0x7f31f40b0c00 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- 172.21.15.18:0/1397023930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 msgr2=0x7f31f406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- 172.21.15.18:0/1397023930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f406c9a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097c0 tx=0x7f31ec01c470 comp rx=0 tx=0).stop 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- 172.21.15.18:0/1397023930 shutdown_connections 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- 172.21.15.18:0/1397023930 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f406c9a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- 172.21.15.18:0/1397023930 >> v2:172.21.15.167:3300/0 conn(0x7f31f40713c0 0x7f31f40b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- 172.21.15.18:0/1397023930 >> 172.21.15.18:0/1397023930 conn(0x7f31f406f510 msgr2=0x7f31f406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- 172.21.15.18:0/1397023930 shutdown_connections 2024-04-25T10:12:28.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- 172.21.15.18:0/1397023930 wait complete. 2024-04-25T10:12:28.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 Processor -- start 2024-04-25T10:12:28.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- start start 2024-04-25T10:12:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31f40713c0 0x7f31f40d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f414fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f406da80 con 0x7f31f415dab0 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f406d900 con 0x7f31f40713c0 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f406dc00 con 0x7f31f40b0c00 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56850/0 (socket says 172.21.15.18:56850) 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31ea000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f414fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f3400640 1 -- 172.21.15.18:0/4169068169 learned_addr learned my addr 172.21.15.18:0/4169068169 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.537+0000 7f31f2a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31f40713c0 0x7f31f40d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 -- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 msgr2=0x7f31f414fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f414fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 -- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31f40713c0 msgr2=0x7f31f40d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31f40713c0 0x7f31f40d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:28.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 -- 172.21.15.18:0/4169068169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4155380 con 0x7f31f415dab0 2024-04-25T10:12:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f3400640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097c0 tx=0x7f31ec01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:28.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0bf410 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec0bf5b0 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f4151340 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0bf980 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f4151900 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f40745d0 con 0x7f31f415dab0 2024-04-25T10:12:28.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31ec0bd020 con 0x7f31f415dab0 2024-04-25T10:12:28.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 0x7f31d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:28.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6475+0+0 (secure 0 0 0) 0x7f31ec11fb00 con 0x7f31f415dab0 2024-04-25T10:12:28.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.541+0000 7f31f2a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 0x7f31d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:28.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.545+0000 7f31f2a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 0x7f31d0069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f31e4005c10 tx=0x7f31e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:28.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.545+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31ec016090 con 0x7f31f415dab0 2024-04-25T10:12:28.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:28.709+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f31f41686d0 con 0x7f31f415dab0 2024-04-25T10:12:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.317+0000 7f31eb400640 1 -- 172.21.15.18:0/4169068169 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v99) v1 ==== 181+0+0 (secure 0 0 0) 0x7f31ec11fe20 con 0x7f31f415dab0 2024-04-25T10:12:29.324 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 msgr2=0x7f31d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 0x7f31d0069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f31e4005c10 tx=0x7f31e4009040 comp rx=0 tx=0).stop 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 msgr2=0x7f31f415fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f31ec0097c0 tx=0x7f31ec01acb0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 shutdown_connections 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31f415dab0 0x7f31f415fee0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f31d0066f60 0x7f31d0069420 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f31f40b0c00 0x7f31f414fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 --2- 172.21.15.18:0/4169068169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31f40713c0 0x7f31f40d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 >> 172.21.15.18:0/4169068169 conn(0x7f31f406f510 msgr2=0x7f31f415cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:29.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 shutdown_connections 2024-04-25T10:12:29.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.321+0000 7f31f9a00640 1 -- 172.21.15.18:0/4169068169 wait complete. 2024-04-25T10:12:29.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:12:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 Processor -- start 2024-04-25T10:12:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 -- start start 2024-04-25T10:12:29.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 0x7fd0f40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f40cf490 con 0x7fd0f406e3c0 2024-04-25T10:12:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f40719b0 con 0x7fd0f4144080 2024-04-25T10:12:29.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0fa000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40cf1b0 con 0x7fd0f4071e40 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0eaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 0x7fd0f40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0f3400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0f3e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd0f406e3c0 0x7fd0f40b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42530/0 (socket says 172.21.15.18:42530) 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0f3e00640 1 -- 172.21.15.18:0/3118638514 learned_addr learned my addr 172.21.15.18:0/3118638514 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.489+0000 7fd0f3400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:36174/0 (socket says 172.21.15.18:36174) 2024-04-25T10:12:29.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0eaa00640 1 -- 172.21.15.18:0/3118638514 >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 msgr2=0x7fd0f40ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0eaa00640 1 --2- 172.21.15.18:0/3118638514 >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0eaa00640 1 -- 172.21.15.18:0/3118638514 >> v1:172.21.15.167:6789/0 conn(0x7fd0f406e3c0 legacy=0x7fd0f40b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0eaa00640 1 -- 172.21.15.18:0/3118638514 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4071360 con 0x7fd0f4071e40 2024-04-25T10:12:29.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0f3400640 1 --2- 172.21.15.18:0/3118638514 >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0eaa00640 1 --2- 172.21.15.18:0/3118638514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 0x7fd0f40ceba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7c80fbc800b84a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0f2a00640 1 -- 172.21.15.18:0/3118638514 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0ab650 con 0x7fd0f4071e40 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0f2a00640 1 -- 172.21.15.18:0/3118638514 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0b0070 con 0x7fd0f4071e40 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.493+0000 7fd0f2a00640 1 -- 172.21.15.18:0/3118638514 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0aba10 con 0x7fd0f4071e40 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- 172.21.15.18:0/3118638514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 msgr2=0x7fd0f40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- 172.21.15.18:0/3118638514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 0x7fd0f40ceba0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc0097c0 tx=0x7fd0dc01c470 comp rx=0 tx=0).stop 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- 172.21.15.18:0/3118638514 shutdown_connections 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- 172.21.15.18:0/3118638514 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4071e40 0x7fd0f40ceba0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- 172.21.15.18:0/3118638514 >> v2:172.21.15.167:3300/0 conn(0x7fd0f4144080 0x7fd0f40ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- 172.21.15.18:0/3118638514 >> 172.21.15.18:0/3118638514 conn(0x7fd0f406ac10 msgr2=0x7fd0f406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- 172.21.15.18:0/3118638514 shutdown_connections 2024-04-25T10:12:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- 172.21.15.18:0/3118638514 wait complete. 2024-04-25T10:12:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 Processor -- start 2024-04-25T10:12:29.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- start start 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f406e3c0 0x7fd0f4167e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4144080 0x7fd0f40b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40b4ad0 con 0x7fd0f4071e40 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40b4950 con 0x7fd0f406e3c0 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0fa000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4165590 con 0x7fd0f4144080 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56858/0 (socket says 172.21.15.18:56858) 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 -- 172.21.15.18:0/4062120778 learned_addr learned my addr 172.21.15.18:0/4062120778 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:29.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0f3e00640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4144080 0x7fd0f40b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0f3400640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f406e3c0 0x7fd0f4167e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 -- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4144080 msgr2=0x7fd0f40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4144080 0x7fd0f40b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 -- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f406e3c0 msgr2=0x7fd0f4167e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f406e3c0 0x7fd0f4167e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 -- 172.21.15.18:0/4062120778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4164c00 con 0x7fd0f4071e40 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.497+0000 7fd0eaa00640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc01a0a0 tx=0x7fd0dc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0bf610 con 0x7fd0f4071e40 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0dc0bf7d0 con 0x7fd0f4071e40 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4164ee0 con 0x7fd0f4071e40 2024-04-25T10:12:29.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc0bfbc0 con 0x7fd0f4071e40 2024-04-25T10:12:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f41f6ab0 con 0x7fd0f4071e40 2024-04-25T10:12:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40745d0 con 0x7fd0f4071e40 2024-04-25T10:12:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0dc0bd020 con 0x7fd0f4071e40 2024-04-25T10:12:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 0x7fd0d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6037+0+0 (secure 0 0 0) 0x7fd0dc11f8d0 con 0x7fd0f4071e40 2024-04-25T10:12:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.501+0000 7fd0f3400640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 0x7fd0d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:29.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.505+0000 7fd0f3400640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 0x7fd0d0069420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4167840 tx=0x7fd0e400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:29.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.505+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd0dc016090 con 0x7fd0f4071e40 2024-04-25T10:12:29.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:29.669+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd0f40b4580 con 0x7fd0f4071e40 2024-04-25T10:12:30.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.321+0000 7fd0ebe00640 1 -- 172.21.15.18:0/4062120778 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v100) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0dc0f0790 con 0x7fd0f4071e40 2024-04-25T10:12:30.330 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:12:30.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 msgr2=0x7fd0d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 0x7fd0d0069420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4167840 tx=0x7fd0e400b040 comp rx=0 tx=0).stop 2024-04-25T10:12:30.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 msgr2=0x7fd0f415d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd0dc01a0a0 tx=0x7fd0dc01acb0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 shutdown_connections 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d0066f60 0x7fd0d0069420 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f4144080 0x7fd0f40b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f4071e40 0x7fd0f415d330 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 --2- 172.21.15.18:0/4062120778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f406e3c0 0x7fd0f4167e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 >> 172.21.15.18:0/4062120778 conn(0x7fd0f406ac10 msgr2=0x7fd0f40cc240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 shutdown_connections 2024-04-25T10:12:30.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.325+0000 7fd0fa000640 1 -- 172.21.15.18:0/4062120778 wait complete. 2024-04-25T10:12:30.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:12:30.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 Processor -- start 2024-04-25T10:12:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 -- start start 2024-04-25T10:12:30.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94b406ce40 0x7f94b415d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b409aef0 con 0x7f94b406bf30 2024-04-25T10:12:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b406f4e0 con 0x7f94b406ce40 2024-04-25T10:12:30.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94bb200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b406f7c0 con 0x7f94b40cd6c0 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94ba800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f94b406ce40 0x7f94b415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94b9e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:60076/0 (socket says 172.21.15.18:60076) 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.497+0000 7f94b9e00640 1 -- 172.21.15.18:0/2184477625 learned_addr learned my addr 172.21.15.18:0/2184477625 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b9e00640 1 -- 172.21.15.18:0/2184477625 >> v2:172.21.15.167:3300/0 conn(0x7f94b406ce40 msgr2=0x7f94b415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2184477625 >> v2:172.21.15.167:3300/0 conn(0x7f94b406ce40 0x7f94b415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b9e00640 1 -- 172.21.15.18:0/2184477625 >> v1:172.21.15.167:6789/0 conn(0x7f94b406bf30 legacy=0x7f94b406c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b9e00640 1 -- 172.21.15.18:0/2184477625 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b406faa0 con 0x7f94b40cd6c0 2024-04-25T10:12:30.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2184477625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009870 tx=0x7f94a801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ba10a7504e794df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b8a00640 1 -- 172.21.15.18:0/2184477625 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80ab660 con 0x7f94b40cd6c0 2024-04-25T10:12:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b8a00640 1 -- 172.21.15.18:0/2184477625 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a80b0070 con 0x7f94b40cd6c0 2024-04-25T10:12:30.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94b8a00640 1 -- 172.21.15.18:0/2184477625 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80aba20 con 0x7f94b40cd6c0 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94bb200640 1 -- 172.21.15.18:0/2184477625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 msgr2=0x7f94b409a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.501+0000 7f94bb200640 1 --2- 172.21.15.18:0/2184477625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009870 tx=0x7f94a801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- 172.21.15.18:0/2184477625 shutdown_connections 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 --2- 172.21.15.18:0/2184477625 >> v2:172.21.15.167:3300/0 conn(0x7f94b406ce40 0x7f94b415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 --2- 172.21.15.18:0/2184477625 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b40cd6c0 0x7f94b409a910 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- 172.21.15.18:0/2184477625 >> 172.21.15.18:0/2184477625 conn(0x7f94b40b3090 msgr2=0x7f94b40b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- 172.21.15.18:0/2184477625 shutdown_connections 2024-04-25T10:12:30.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- 172.21.15.18:0/2184477625 wait complete. 2024-04-25T10:12:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 Processor -- start 2024-04-25T10:12:30.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- start start 2024-04-25T10:12:30.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 0x7f94b4155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 0x7f94b40c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40cbd70 con 0x7f94b40cd6c0 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40cbbf0 con 0x7f94b406bf30 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b40702a0 con 0x7f94b406ce40 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56860/0 (socket says 172.21.15.18:56860) 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 -- 172.21.15.18:0/2908353058 learned_addr learned my addr 172.21.15.18:0/2908353058 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94b9400640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 0x7f94b40c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 -- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 msgr2=0x7f94b40c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 0x7f94b4155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 0x7f94b40c91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 -- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 msgr2=0x7f94b4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 0x7f94b4155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 -- 172.21.15.18:0/2908353058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40c8710 con 0x7f94b40cd6c0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 0x7f94b4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94b9400640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 0x7f94b40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ba800640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f94b000efc0 tx=0x7f94b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0018020 con 0x7f94b40cd6c0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0014480 con 0x7f94b40cd6c0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b0014870 con 0x7f94b40cd6c0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.505+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b415f8a0 con 0x7f94b40cd6c0 2024-04-25T10:12:30.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b415fb80 con 0x7f94b40cd6c0 2024-04-25T10:12:30.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b40745d0 con 0x7f94b40cd6c0 2024-04-25T10:12:30.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94b001b020 con 0x7f94b40cd6c0 2024-04-25T10:12:30.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94ae000640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 0x7f9498069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f94b0085e60 con 0x7f94b40cd6c0 2024-04-25T10:12:30.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.509+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 0x7f9498069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.513+0000 7f94b9e00640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 0x7f9498069420 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f94a80af000 tx=0x7f94a80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.513+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94b0022030 con 0x7f94b40cd6c0 2024-04-25T10:12:30.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.685+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f94b40d05b0 con 0x7f94b40cd6c0 2024-04-25T10:12:30.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94ae000640 1 -- 172.21.15.18:0/2908353058 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f94b0010040 con 0x7f94b40cd6c0 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 msgr2=0x7f9498069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 0x7f9498069420 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f94a80af000 tx=0x7f94a80a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 msgr2=0x7f94b415f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f94b000efc0 tx=0x7f94b000c490 comp rx=0 tx=0).stop 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 shutdown_connections 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f94b40cd6c0 0x7f94b415f130 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9498066f60 0x7f9498069420 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f94b406ce40 0x7f94b40c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 --2- 172.21.15.18:0/2908353058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94b406bf30 0x7f94b4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 >> 172.21.15.18:0/2908353058 conn(0x7f94b40b3090 msgr2=0x7f94b40ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:30.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 shutdown_connections 2024-04-25T10:12:30.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.689+0000 7f94bb200640 1 -- 172.21.15.18:0/2908353058 wait complete. 2024-04-25T10:12:30.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T10:12:30.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.849+0000 7ff3e3c00640 1 Processor -- start 2024-04-25T10:12:30.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.849+0000 7ff3e3c00640 1 -- start start 2024-04-25T10:12:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e3c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e3c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff3dc0cff30 0x7ff3dc0d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e3c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc06c650 con 0x7ff3dc099a60 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e3c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc06c930 con 0x7ff3dc0cff30 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e3c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc06cc10 con 0x7ff3dc15ee00 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff3dc099a60 0x7ff3dc099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49548/0 (socket says 172.21.15.18:49548) 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1200640 1 -- 172.21.15.18:0/91401915 learned_addr learned my addr 172.21.15.18:0/91401915 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:30.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1c00640 1 --2- 172.21.15.18:0/91401915 >> v2:172.21.15.18:3300/0 conn(0x7ff3dc0cff30 0x7ff3dc0d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3d3e00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3dbe00640 1 -- 172.21.15.18:0/91401915 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930890224 0 0) 0x7ff3dc06c650 con 0x7ff3dc099a60 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3dbe00640 1 -- 172.21.15.18:0/91401915 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c0003530 con 0x7ff3dc099a60 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1c00640 1 -- 172.21.15.18:0/91401915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 msgr2=0x7ff3dc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1c00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1c00640 1 -- 172.21.15.18:0/91401915 >> v1:172.21.15.18:6789/0 conn(0x7ff3dc099a60 legacy=0x7ff3dc099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.853+0000 7ff3e1c00640 1 -- 172.21.15.18:0/91401915 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc06cef0 con 0x7ff3dc0cff30 2024-04-25T10:12:30.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e1c00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc0d03e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009d90 tx=0x7ff3d401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc542c5b030b3844 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3dbe00640 1 -- 172.21.15.18:0/91401915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40b2070 con 0x7ff3dc0cff30 2024-04-25T10:12:30.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3dbe00640 1 -- 172.21.15.18:0/91401915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d40a5830 con 0x7ff3dc0cff30 2024-04-25T10:12:30.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3dbe00640 1 -- 172.21.15.18:0/91401915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d40a5c00 con 0x7ff3dc0cff30 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- 172.21.15.18:0/91401915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc0cff30 msgr2=0x7ff3dc0d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc0d03e0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009d90 tx=0x7ff3d401c970 comp rx=0 tx=0).stop 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- 172.21.15.18:0/91401915 shutdown_connections 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc0d03e0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/91401915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- 172.21.15.18:0/91401915 >> 172.21.15.18:0/91401915 conn(0x7ff3dc0d17a0 msgr2=0x7ff3dc0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:30.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- 172.21.15.18:0/91401915 shutdown_connections 2024-04-25T10:12:30.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- 172.21.15.18:0/91401915 wait complete. 2024-04-25T10:12:30.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 Processor -- start 2024-04-25T10:12:30.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 -- start start 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.857+0000 7ff3e3c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc1525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc16ab80 con 0x7ff3dc099a60 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc16aa00 con 0x7ff3dc0cff30 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc16ad00 con 0x7ff3dc15ee00 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56878/0 (socket says 172.21.15.18:56878) 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 -- 172.21.15.18:0/1454303241 learned_addr learned my addr 172.21.15.18:0/1454303241 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc1525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3d3e00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 -- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 msgr2=0x7ff3dc1525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc1525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 -- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3dc0cff30 msgr2=0x7ff3dc15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc15c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 -- 172.21.15.18:0/1454303241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0c8fc0 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e1200640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3c0 tx=0x7ff3cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc017070 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3cc005cf0 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0072f0 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc0c8ce0 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc0cb3e0 con 0x7ff3dc099a60 2024-04-25T10:12:30.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc0745d0 con 0x7ff3dc099a60 2024-04-25T10:12:30.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.861+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff3cc01a070 con 0x7ff3dc099a60 2024-04-25T10:12:30.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.865+0000 7ff3d9600640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 0x7ff3b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:30.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.865+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff3cc084350 con 0x7ff3dc099a60 2024-04-25T10:12:30.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.865+0000 7ff3d3e00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 0x7ff3b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:30.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.865+0000 7ff3d3e00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 0x7ff3b8069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0cd6c0 tx=0x7ff3c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:30.869+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff3cc055400 con 0x7ff3dc099a60 2024-04-25T10:12:31.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.085+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7ff3dc0b4380 con 0x7ff3dc099a60 2024-04-25T10:12:31.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3d9600640 1 -- 172.21.15.18:0/1454303241 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v409) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff3cc054d00 con 0x7ff3dc099a60 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 msgr2=0x7ff3b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 0x7ff3b8069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0cd6c0 tx=0x7ff3c4008040 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 msgr2=0x7ff3dc150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c3c0 tx=0x7ff3cc00c880 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 shutdown_connections 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff3b8066f60 0x7ff3b8069420 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff3dc15ee00 0x7ff3dc1525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff3dc0cff30 0x7ff3dc15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 --2- 172.21.15.18:0/1454303241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3dc099a60 0x7ff3dc150470 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 >> 172.21.15.18:0/1454303241 conn(0x7ff3dc0d17a0 msgr2=0x7ff3dc070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 shutdown_connections 2024-04-25T10:12:31.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.325+0000 7ff3e3c00640 1 -- 172.21.15.18:0/1454303241 wait complete. 2024-04-25T10:12:31.354 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T10:12:31.354 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:12:31.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:31.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 Processor -- start 2024-04-25T10:12:31.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 -- start start 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f112815b860 0x7f112815bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112806ac10 0x7f112806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f112815c180 con 0x7f1128072c70 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f112815f4e0 con 0x7f112815b860 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f112ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112815c430 con 0x7f112806ac10 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f1125e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f112815b860 0x7f112815bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f1125e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f112815b860 0x7f112815bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56884/0 (socket says 172.21.15.18:56884) 2024-04-25T10:12:31.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.489+0000 7f1125e00640 1 -- 172.21.15.18:0/3687494103 learned_addr learned my addr 172.21.15.18:0/3687494103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1126800640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112806ac10 0x7f112806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125e00640 1 -- 172.21.15.18:0/3687494103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112806ac10 msgr2=0x7f112806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125e00640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112806ac10 0x7f112806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125e00640 1 -- 172.21.15.18:0/3687494103 >> v1:172.21.15.18:6789/0 conn(0x7f1128072c70 legacy=0x7f11280cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125e00640 1 -- 172.21.15.18:0/3687494103 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112815c710 con 0x7f112815b860 2024-04-25T10:12:31.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125400640 1 -- 172.21.15.18:0/3687494103 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587480096 0 0) 0x7f112815c180 con 0x7f1128072c70 2024-04-25T10:12:31.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125e00640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112815b860 0x7f112815bc40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f1118009870 tx=0x7f111801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc44d725a601714b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125400640 1 -- 172.21.15.18:0/3687494103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180a7070 con 0x7f112815b860 2024-04-25T10:12:31.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125400640 1 -- 172.21.15.18:0/3687494103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11180b0070 con 0x7f112815b860 2024-04-25T10:12:31.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f1125400640 1 -- 172.21.15.18:0/3687494103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180ab890 con 0x7f112815b860 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f112ca00640 1 -- 172.21.15.18:0/3687494103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112815b860 msgr2=0x7f112815bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.493+0000 7f112ca00640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112815b860 0x7f112815bc40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f1118009870 tx=0x7f111801c560 comp rx=0 tx=0).stop 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- 172.21.15.18:0/3687494103 shutdown_connections 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112806ac10 0x7f112806b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 --2- 172.21.15.18:0/3687494103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112815b860 0x7f112815bc40 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- 172.21.15.18:0/3687494103 >> 172.21.15.18:0/3687494103 conn(0x7f11280b2400 msgr2=0x7f11280b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- 172.21.15.18:0/3687494103 shutdown_connections 2024-04-25T10:12:31.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- 172.21.15.18:0/3687494103 wait complete. 2024-04-25T10:12:31.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 Processor -- start 2024-04-25T10:12:31.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- start start 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 0x7f11280b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112815b860 0x7f11280b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1128073230 con 0x7f112806ac10 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11280730b0 con 0x7f1128072c70 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f112ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1128168750 con 0x7f112815b860 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56886/0 (socket says 172.21.15.18:56886) 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 -- 172.21.15.18:0/3698688786 learned_addr learned my addr 172.21.15.18:0/3698688786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1126800640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112815b860 0x7f11280b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f111d400640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 0x7f11280b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 -- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112815b860 msgr2=0x7f11280b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112815b860 0x7f11280b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 -- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 msgr2=0x7f11280b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 0x7f11280b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 -- 172.21.15.18:0/3698688786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128153e20 con 0x7f112806ac10 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f111d400640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 0x7f11280b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.497+0000 7f1125e00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f111801a190 tx=0x7f111801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180ba070 con 0x7f112806ac10 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11180abc60 con 0x7f112806ac10 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1118004220 con 0x7f112806ac10 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1128154100 con 0x7f112806ac10 2024-04-25T10:12:31.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11281546c0 con 0x7f112806ac10 2024-04-25T10:12:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1128152800 con 0x7f112806ac10 2024-04-25T10:12:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1118003620 con 0x7f112806ac10 2024-04-25T10:12:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 0x7f1104069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f111811f260 con 0x7f112806ac10 2024-04-25T10:12:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.501+0000 7f111d400640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 0x7f1104069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.505+0000 7f111d400640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 0x7f1104069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f11281f9ec0 tx=0x7f1110009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.505+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1128152800 con 0x7f112806ac10 2024-04-25T10:12:31.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.673+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11280745d0 con 0x7f112806ac10 2024-04-25T10:12:31.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.673+0000 7f111ea00640 1 -- 172.21.15.18:0/3698688786 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+13531 (secure 0 0 0) 0x7f111811b4f0 con 0x7f112806ac10 2024-04-25T10:12:31.682 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:31.682 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":100,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:30.321446+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2720545627":"2024-04-26T10:12:27.311116+0000","172.21.15.18:6833/2720545627":"2024-04-26T10:12:27.311116+0000","172.21.15.18:6835/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6833/4209604816":"2024-04-26T10:11:42.885924+0000","172.21.15.18:6835/2607538595":"2024-04-26T10:10:30.461064+0000","172.21.15.18:6833/2607538595":"2024-04-26T10:10:30.461064+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 msgr2=0x7f1104069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 0x7f1104069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f11281f9ec0 tx=0x7f1110009040 comp rx=0 tx=0).stop 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 msgr2=0x7f1128144f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f111801a190 tx=0x7f111801ada0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 shutdown_connections 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1104066f60 0x7f1104069420 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f112815b860 0x7f11280b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1128072c70 0x7f11280b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 --2- 172.21.15.18:0/3698688786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f112806ac10 0x7f1128144f80 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 >> 172.21.15.18:0/3698688786 conn(0x7f11280b2400 msgr2=0x7f11280d05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 shutdown_connections 2024-04-25T10:12:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.677+0000 7f112ca00640 1 -- 172.21.15.18:0/3698688786 wait complete. 2024-04-25T10:12:31.704 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:31.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:31.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 Processor -- start 2024-04-25T10:12:31.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 -- start start 2024-04-25T10:12:31.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1398144120 0x7f139815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f139815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139815bc40 con 0x7f139815ee60 2024-04-25T10:12:31.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139815e490 con 0x7f1398144120 2024-04-25T10:12:31.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f13a0200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139815b3a0 con 0x7f13980ccbf0 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1398144120 0x7f139815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f139815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139e200640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f139815ee60 0x7f13980b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:38830/0 (socket says 172.21.15.18:38830) 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1398144120 0x7f139815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:49776/0 (socket says 172.21.15.18:49776) 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139e200640 1 -- 172.21.15.18:0/428983180 learned_addr learned my addr 172.21.15.18:0/428983180 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:31.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 -- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 msgr2=0x7f139815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:31.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 --2- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f139815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 -- 172.21.15.18:0/428983180 >> v1:172.21.15.167:6789/0 conn(0x7f139815ee60 legacy=0x7f13980b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.841+0000 7f139d800640 1 -- 172.21.15.18:0/428983180 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139815b680 con 0x7f1398144120 2024-04-25T10:12:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f139d800640 1 --2- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f139815acd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f138c0097c0 tx=0x7f138c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83886730523db656 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f1397e00640 1 -- 172.21.15.18:0/428983180 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0b0070 con 0x7f1398144120 2024-04-25T10:12:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f1397e00640 1 -- 172.21.15.18:0/428983180 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0ab600 con 0x7f1398144120 2024-04-25T10:12:31.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f1397e00640 1 -- 172.21.15.18:0/428983180 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0ab9d0 con 0x7f1398144120 2024-04-25T10:12:31.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 -- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 msgr2=0x7f139815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 --2- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f139815acd0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f138c0097c0 tx=0x7f138c01c410 comp rx=0 tx=0).stop 2024-04-25T10:12:31.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 -- 172.21.15.18:0/428983180 shutdown_connections 2024-04-25T10:12:31.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 --2- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f139815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 --2- 172.21.15.18:0/428983180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f139815acd0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 -- 172.21.15.18:0/428983180 >> 172.21.15.18:0/428983180 conn(0x7f1398067080 msgr2=0x7f139806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 -- 172.21.15.18:0/428983180 shutdown_connections 2024-04-25T10:12:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.845+0000 7f13a0200640 1 -- 172.21.15.18:0/428983180 wait complete. 2024-04-25T10:12:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 Processor -- start 2024-04-25T10:12:31.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- start start 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f1398143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f13981593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13981675c0 con 0x7f139815ee60 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398167440 con 0x7f1398144120 2024-04-25T10:12:31.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1398167740 con 0x7f13980ccbf0 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50522/0 (socket says 172.21.15.18:50522) 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 -- 172.21.15.18:0/872990772 learned_addr learned my addr 172.21.15.18:0/872990772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139ce00640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f13981593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139d800640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f1398143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 -- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 msgr2=0x7f1398143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f1398143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 -- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 msgr2=0x7f13981593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f13981593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 -- 172.21.15.18:0/872990772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1398159900 con 0x7f139815ee60 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f139e200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f139000ca80 tx=0x7f139000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390017070 con 0x7f139815ee60 2024-04-25T10:12:31.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f139000ac30 con 0x7f139815ee60 2024-04-25T10:12:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1398142250 con 0x7f139815ee60 2024-04-25T10:12:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1390012600 con 0x7f139815ee60 2024-04-25T10:12:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139815a310 con 0x7f139815ee60 2024-04-25T10:12:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.849+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13980745d0 con 0x7f139815ee60 2024-04-25T10:12:31.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.853+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f139001a070 con 0x7f139815ee60 2024-04-25T10:12:31.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.853+0000 7f1395600640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 0x7f1378069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:31.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.853+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f1390084bf0 con 0x7f139815ee60 2024-04-25T10:12:31.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.853+0000 7f139d800640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 0x7f1378069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:31.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.853+0000 7f139d800640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 0x7f1378069420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ad000 tx=0x7f138c0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:31.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:31.857+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f139000ae20 con 0x7f139815ee60 2024-04-25T10:12:32.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.017+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f13980ae870 con 0x7f139815ee60 2024-04-25T10:12:32.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.017+0000 7f1395600640 1 -- 172.21.15.18:0/872990772 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13900555d0 con 0x7f139815ee60 2024-04-25T10:12:32.026 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 msgr2=0x7f1378069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 0x7f1378069420 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f138c0ad000 tx=0x7f138c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 msgr2=0x7f139813e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f139000ca80 tx=0x7f139000cf40 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 shutdown_connections 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f139815ee60 0x7f139813e350 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1398144120 0x7f13981593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1378066f60 0x7f1378069420 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 --2- 172.21.15.18:0/872990772 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f13980ccbf0 0x7f1398143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 >> 172.21.15.18:0/872990772 conn(0x7f1398067080 msgr2=0x7f13980b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 shutdown_connections 2024-04-25T10:12:32.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.021+0000 7f13a0200640 1 -- 172.21.15.18:0/872990772 wait complete. 2024-04-25T10:12:32.047 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T10:12:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 Processor -- start 2024-04-25T10:12:32.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 -- start start 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d0144140 0x7fa9d00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d015ac60 con 0x7fa9d00ced60 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00cf3e0 con 0x7fa9d0144140 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015af20 con 0x7fa9d006ead0 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d4e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d0144140 0x7fa9d00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9c7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa9d00ced60 0x7fa9d006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33422/0 (socket says 172.21.15.18:33422) 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9d4e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d0144140 0x7fa9d00ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50532/0 (socket says 172.21.15.18:50532) 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.181+0000 7fa9c7e00640 1 -- 172.21.15.18:0/3315085088 learned_addr learned my addr 172.21.15.18:0/3315085088 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d4e00640 1 -- 172.21.15.18:0/3315085088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 msgr2=0x7fa9d00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d5800640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d4e00640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d00b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d4e00640 1 -- 172.21.15.18:0/3315085088 >> v1:172.21.15.18:6789/0 conn(0x7fa9d00ced60 legacy=0x7fa9d006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9cfe00640 1 -- 172.21.15.18:0/3315085088 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246714195 0 0) 0x7fa9d015ac60 con 0x7fa9d00ced60 2024-04-25T10:12:32.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d4e00640 1 -- 172.21.15.18:0/3315085088 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d015b200 con 0x7fa9d0144140 2024-04-25T10:12:32.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d5800640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:32.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d4e00640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d00ce820 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00097c0 tx=0x7fa9c001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6a1d57efb1e6c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:32.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9cfe00640 1 -- 172.21.15.18:0/3315085088 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00b1070 con 0x7fa9d0144140 2024-04-25T10:12:32.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9cfe00640 1 -- 172.21.15.18:0/3315085088 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c00ac440 con 0x7fa9d0144140 2024-04-25T10:12:32.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9cfe00640 1 -- 172.21.15.18:0/3315085088 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c00ac810 con 0x7fa9d0144140 2024-04-25T10:12:32.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 -- 172.21.15.18:0/3315085088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 msgr2=0x7fa9d00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d00ce820 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00097c0 tx=0x7fa9c001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 -- 172.21.15.18:0/3315085088 shutdown_connections 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 --2- 172.21.15.18:0/3315085088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d00ce820 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.185+0000 7fa9d7800640 1 -- 172.21.15.18:0/3315085088 >> 172.21.15.18:0/3315085088 conn(0x7fa9d0066fa0 msgr2=0x7fa9d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- 172.21.15.18:0/3315085088 shutdown_connections 2024-04-25T10:12:32.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- 172.21.15.18:0/3315085088 wait complete. 2024-04-25T10:12:32.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 Processor -- start 2024-04-25T10:12:32.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- start start 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d01356f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d00ced60 0x7fa9d01350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015bb80 con 0x7fa9d0144140 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d015ba00 con 0x7fa9d00ced60 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d01673e0 con 0x7fa9d006ead0 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50540/0 (socket says 172.21.15.18:50540) 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 -- 172.21.15.18:0/1120419926 learned_addr learned my addr 172.21.15.18:0/1120419926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d4e00640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d01356f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9c7e00640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d00ced60 0x7fa9d01350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 -- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 msgr2=0x7fa9d01356f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d01356f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 -- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d00ced60 msgr2=0x7fa9d01350e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d00ced60 0x7fa9d01350e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 -- 172.21.15.18:0/1120419926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0136810 con 0x7fa9d0144140 2024-04-25T10:12:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9d5800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800ce70 tx=0x7fa9c800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8003ba0 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8003d60 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.189+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800d880 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d0138950 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0138f10 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d00745d0 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9c800da20 con 0x7fa9d0144140 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9cd600640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 0x7fa9ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:32.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fa9c80858c0 con 0x7fa9d0144140 2024-04-25T10:12:32.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9d4e00640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 0x7fa9ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:32.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.193+0000 7fa9d4e00640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 0x7fa9ac069420 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00ae000 tx=0x7fa9c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.197+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa9d0136810 con 0x7fa9d0144140 2024-04-25T10:12:32.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:32.417+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7fa9d015a5e0 con 0x7fa9d0144140 2024-04-25T10:12:33.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.333+0000 7fa9cd600640 1 -- 172.21.15.18:0/1120419926 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v411) v1 ==== 149+0+0 (secure 0 0 0) 0x7fa9c8056330 con 0x7fa9d0144140 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 msgr2=0x7fa9ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 0x7fa9ac069420 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00ae000 tx=0x7fa9c0008040 comp rx=0 tx=0).stop 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 msgr2=0x7fa9d01362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800ce70 tx=0x7fa9c800a710 comp rx=0 tx=0).stop 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 shutdown_connections 2024-04-25T10:12:33.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d0144140 0x7fa9d01362d0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9d00ced60 0x7fa9d01350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9ac066f60 0x7fa9ac069420 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 --2- 172.21.15.18:0/1120419926 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa9d006ead0 0x7fa9d01356f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 >> 172.21.15.18:0/1120419926 conn(0x7fa9d0066fa0 msgr2=0x7fa9d00b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 shutdown_connections 2024-04-25T10:12:33.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.337+0000 7fa9d7800640 1 -- 172.21.15.18:0/1120419926 wait complete. 2024-04-25T10:12:33.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:12:33.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 Processor -- start 2024-04-25T10:12:33.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 -- start start 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 0x7fab340b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab340b1fb0 0x7fab3415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab340cfce0 con 0x7fab340b2410 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab340d0580 con 0x7fab340b1fb0 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab39400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cffc0 con 0x7fab3415f3d0 2024-04-25T10:12:33.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab340b1fb0 0x7fab3415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab340b1fb0 0x7fab3415f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50546/0 (socket says 172.21.15.18:50546) 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 -- 172.21.15.18:0/433927611 learned_addr learned my addr 172.21.15.18:0/433927611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab33e00640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 0x7fab340b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 -- 172.21.15.18:0/433927611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 msgr2=0x7fab340b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 0x7fab340b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 -- 172.21.15.18:0/433927611 >> v1:172.21.15.18:6789/0 conn(0x7fab340b2410 legacy=0x7fab3415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab2b400640 1 -- 172.21.15.18:0/433927611 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340d02a0 con 0x7fab340b1fb0 2024-04-25T10:12:33.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.509+0000 7fab33e00640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 0x7fab340b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:33.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab2b400640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab3415f7b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009870 tx=0x7fab1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d5d8ae7db3af0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:33.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab33400640 1 -- 172.21.15.18:0/433927611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0b1070 con 0x7fab340b1fb0 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab33400640 1 -- 172.21.15.18:0/433927611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0ac620 con 0x7fab340b1fb0 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab33400640 1 -- 172.21.15.18:0/433927611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0ac9f0 con 0x7fab340b1fb0 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- 172.21.15.18:0/433927611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 msgr2=0x7fab3415f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab3415f7b0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009870 tx=0x7fab1c01c4d0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- 172.21.15.18:0/433927611 shutdown_connections 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab3415f7b0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 --2- 172.21.15.18:0/433927611 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab3415f3d0 0x7fab340b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- 172.21.15.18:0/433927611 >> 172.21.15.18:0/433927611 conn(0x7fab340d15d0 msgr2=0x7fab340d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- 172.21.15.18:0/433927611 shutdown_connections 2024-04-25T10:12:33.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- 172.21.15.18:0/433927611 wait complete. 2024-04-25T10:12:33.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 Processor -- start 2024-04-25T10:12:33.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.513+0000 7fab39400640 1 -- start start 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab340b2410 0x7fab340c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 0x7fab340b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cd140 con 0x7fab340b1fb0 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cc0e0 con 0x7fab3415f3d0 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340cd2c0 con 0x7fab340b2410 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50556/0 (socket says 172.21.15.18:50556) 2024-04-25T10:12:33.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 -- 172.21.15.18:0/3309163725 learned_addr learned my addr 172.21.15.18:0/3309163725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:33.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab2b400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab340b2410 0x7fab340c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab38a00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 0x7fab340b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 -- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab340b2410 msgr2=0x7fab340c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab340b2410 0x7fab340c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 -- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 msgr2=0x7fab340b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 0x7fab340b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 -- 172.21.15.18:0/3309163725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab340c8be0 con 0x7fab340b1fb0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab38a00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 0x7fab340b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab33e00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fab2400cf60 tx=0x7fab2400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2401a070 con 0x7fab340b1fb0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2400d840 con 0x7fab340b1fb0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3406bec0 con 0x7fab340b1fb0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400dc10 con 0x7fab340b1fb0 2024-04-25T10:12:33.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab340b4e50 con 0x7fab340b1fb0 2024-04-25T10:12:33.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab340745d0 con 0x7fab340b1fb0 2024-04-25T10:12:33.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.517+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab2401d070 con 0x7fab340b1fb0 2024-04-25T10:12:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.521+0000 7fab30c00640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 0x7fab10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.521+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fab24085680 con 0x7fab340b1fb0 2024-04-25T10:12:33.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.521+0000 7fab2b400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 0x7fab10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:33.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.521+0000 7fab2b400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 0x7fab10069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0ae000 tx=0x7fab1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:33.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.525+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab24056190 con 0x7fab340b1fb0 2024-04-25T10:12:33.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.689+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fab340cf760 con 0x7fab340b1fb0 2024-04-25T10:12:33.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab30c00640 1 -- 172.21.15.18:0/3309163725 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab2405a230 con 0x7fab340b1fb0 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 msgr2=0x7fab10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 0x7fab10069420 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0ae000 tx=0x7fab1c008040 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 msgr2=0x7fab34155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fab2400cf60 tx=0x7fab2400cf90 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 shutdown_connections 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab3415f3d0 0x7fab340b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab10066f60 0x7fab10069420 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fab340b2410 0x7fab340c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 --2- 172.21.15.18:0/3309163725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab340b1fb0 0x7fab34155cc0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:33.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 >> 172.21.15.18:0/3309163725 conn(0x7fab340d15d0 msgr2=0x7fab340ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:33.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 shutdown_connections 2024-04-25T10:12:33.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:33.693+0000 7fab39400640 1 -- 172.21.15.18:0/3309163725 wait complete. 2024-04-25T10:12:33.721 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:12:33.721 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:12:33.805 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:12:33.904 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:12:33.905 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:33.905 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:33.913 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:12:33.914 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:12:33.914 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:33.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:12:33.923 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:33.923 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:33.962 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:12:33.963 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:12:33.963 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:33.974 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:12:33.974 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:12:33.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 Processor -- start 2024-04-25T10:12:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 -- start start 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dbc15b140 0x7f4dbc15e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 0x7f4dbc0cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 0x7f4dbc0b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc0ce700 con 0x7f4dbc15b140 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc15eda0 con 0x7f4dbc0ce2b0 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbbe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0b10e0 con 0x7f4dbc15b520 2024-04-25T10:12:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dbc15b140 0x7f4dbc15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dbc15b140 0x7f4dbc15e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50562/0 (socket says 172.21.15.18:50562) 2024-04-25T10:12:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 -- 172.21.15.18:0/3470140004 learned_addr learned my addr 172.21.15.18:0/3470140004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dba000640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 0x7f4dbc0cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbb400640 1 --2- 172.21.15.18:0/3470140004 >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 0x7f4dbc0b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 -- 172.21.15.18:0/3470140004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 msgr2=0x7f4dbc0cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 0x7f4dbc0cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 -- 172.21.15.18:0/3470140004 >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 msgr2=0x7f4dbc0b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3470140004 >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 0x7f4dbc0b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbaa00640 1 -- 172.21.15.18:0/3470140004 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc099e00 con 0x7f4dbc15b140 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dba000640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 0x7f4dbc0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.141+0000 7f4dbb400640 1 --2- 172.21.15.18:0/3470140004 >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 0x7f4dbc0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:34.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b140 0x7f4dbc15e860 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc15b9b0 tx=0x7f4dac01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26941f74f312a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4db9600640 1 -- 172.21.15.18:0/3470140004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0aa410 con 0x7f4dbc15b140 2024-04-25T10:12:34.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4db9600640 1 -- 172.21.15.18:0/3470140004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac0af070 con 0x7f4dbc15b140 2024-04-25T10:12:34.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4db9600640 1 -- 172.21.15.18:0/3470140004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0aa7d0 con 0x7f4dbc15b140 2024-04-25T10:12:34.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3470140004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b140 msgr2=0x7f4dbc15e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b140 0x7f4dbc15e860 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc15b9b0 tx=0x7f4dac01c4f0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3470140004 shutdown_connections 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3470140004 >> v2:172.21.15.167:3300/0 conn(0x7f4dbc0ce2b0 0x7f4dbc0b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc15b520 0x7f4dbc0cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3470140004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b140 0x7f4dbc15e860 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3470140004 >> 172.21.15.18:0/3470140004 conn(0x7f4dbc0d14f0 msgr2=0x7f4dbc0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3470140004 shutdown_connections 2024-04-25T10:12:34.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3470140004 wait complete. 2024-04-25T10:12:34.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 Processor -- start 2024-04-25T10:12:34.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.145+0000 7f4dbbe00640 1 -- start start 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc0ce2b0 0x7f4dbc14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 0x7f4dbc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc099a60 con 0x7f4dbc15b520 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc09a980 con 0x7f4dbc15b140 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc099be0 con 0x7f4dbc0ce2b0 2024-04-25T10:12:34.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50564/0 (socket says 172.21.15.18:50564) 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 -- 172.21.15.18:0/3258759035 learned_addr learned my addr 172.21.15.18:0/3258759035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc0ce2b0 0x7f4dbc14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dba000640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 0x7f4dbc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 -- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc0ce2b0 msgr2=0x7f4dbc14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc0ce2b0 0x7f4dbc14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 -- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 msgr2=0x7f4dbc0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 0x7f4dbc0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 -- 172.21.15.18:0/3258759035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0b02b0 con 0x7f4dbc15b520 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dba000640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 0x7f4dbc0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbb400640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4db400cd80 tx=0x7f4db400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400f680 con 0x7f4dbc15b520 2024-04-25T10:12:34.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db400f840 con 0x7f4dbc15b520 2024-04-25T10:12:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc0c5060 con 0x7f4dbc15b520 2024-04-25T10:12:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db400fc30 con 0x7f4dbc15b520 2024-04-25T10:12:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc0c5620 con 0x7f4dbc15b520 2024-04-25T10:12:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc04efa0 con 0x7f4dbc15b520 2024-04-25T10:12:34.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.149+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4db40213f0 con 0x7f4dbc15b520 2024-04-25T10:12:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.153+0000 7f4db2a00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 0x7f4d9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.153+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f4db4085cd0 con 0x7f4dbc15b520 2024-04-25T10:12:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.153+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 0x7f4d9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.153+0000 7f4dbaa00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 0x7f4d9c069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0ae000 tx=0x7f4dac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.157+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4dbc0b02b0 con 0x7f4dbc15b520 2024-04-25T10:12:34.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dbc06c660 con 0x7f4dbc15b520 2024-04-25T10:12:34.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4db2a00640 1 -- 172.21.15.18:0/3258759035 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f4db4014030 con 0x7f4dbc15b520 2024-04-25T10:12:34.360 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:34.360 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7030,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3793826389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3793826389},{"type":"v1","addr":"172.21.15.167:6836","nonce":3793826389}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/774757074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":774757074},{"type":"v1","addr":"172.21.15.167:6837","nonce":774757074}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":7500,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1725162787","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1725162787},{"type":"v1","addr":"172.21.15.18:6834","nonce":1725162787}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57},{"gid":8280,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2079540965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2079540965},{"type":"v1","addr":"172.21.15.18:6835","nonce":2079540965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":78}],"filesystems":[]} 2024-04-25T10:12:34.360 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 78 2024-04-25T10:12:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 msgr2=0x7f4d9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 0x7f4d9c069420 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0ae000 tx=0x7f4dac0a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:34.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 msgr2=0x7f4dbc0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f4db400cd80 tx=0x7f4db400a650 comp rx=0 tx=0).stop 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 shutdown_connections 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dbc15b520 0x7f4dbc0b6350 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4dbc15b140 0x7f4dbc0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4d9c066f60 0x7f4d9c069420 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 --2- 172.21.15.18:0/3258759035 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4dbc0ce2b0 0x7f4dbc14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 >> 172.21.15.18:0/3258759035 conn(0x7f4dbc0d14f0 msgr2=0x7f4dbc0d07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 shutdown_connections 2024-04-25T10:12:34.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.353+0000 7f4dbbe00640 1 -- 172.21.15.18:0/3258759035 wait complete. 2024-04-25T10:12:34.381 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:12:34.381 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:12:34.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:12:34.382 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:12:34.382 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:12:34.382 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:12:34.382 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:12:34.382 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:12:34.382 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:12:34.383 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:12:34.383 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:12:34.383 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:12:34.383 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:12:34.383 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:12:34.383 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:12:34.383 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:12:34.395 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:12:34.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:12:34.396 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:12:34.396 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:12:34.399 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:12:34.399 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:12:34.400 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:12:34.400 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:12:34.445 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:12:34.446 DEBUG:teuthology.parallel:result is None 2024-04-25T10:12:34.447 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:12:34.447 DEBUG:teuthology.parallel:result is None 2024-04-25T10:12:34.449 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:12:34.449 DEBUG:teuthology.parallel:result is None 2024-04-25T10:12:34.450 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:12:34.450 DEBUG:teuthology.parallel:result is None 2024-04-25T10:12:34.450 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:12:34.533 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:12:34.533 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:12:34.538 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:12:34.538 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:12:34.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 Processor -- start 2024-04-25T10:12:34.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 -- start start 2024-04-25T10:12:34.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa60815dc60 0x7fa6080d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60809a170 0x7fa6080cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60815e040 con 0x7fa60806bf30 2024-04-25T10:12:34.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080cff80 con 0x7fa60815dc60 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa60ce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080d0260 con 0x7fa60809a170 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa60815dc60 0x7fa6080d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa5fd400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa60806bf30 0x7fa608099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33450/0 (socket says 172.21.15.18:33450) 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa5fd400640 1 -- 172.21.15.18:0/3670748665 learned_addr learned my addr 172.21.15.18:0/3670748665 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa60815dc60 0x7fa6080d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50596/0 (socket says 172.21.15.18:50596) 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa606800640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60809a170 0x7fa6080cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 -- 172.21.15.18:0/3670748665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60809a170 msgr2=0x7fa6080cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60809a170 0x7fa6080cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 -- 172.21.15.18:0/3670748665 >> v1:172.21.15.18:6789/0 conn(0x7fa60806bf30 legacy=0x7fa608099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.589+0000 7fa605e00640 1 -- 172.21.15.18:0/3670748665 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080d0540 con 0x7fa60815dc60 2024-04-25T10:12:34.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa605e00640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60815dc60 0x7fa6080d1020 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097c0 tx=0x7fa5f801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8518242ed3809501 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa605400640 1 -- 172.21.15.18:0/3670748665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80b1070 con 0x7fa60815dc60 2024-04-25T10:12:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa605400640 1 -- 172.21.15.18:0/3670748665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80a8050 con 0x7fa60815dc60 2024-04-25T10:12:34.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa605400640 1 -- 172.21.15.18:0/3670748665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f80ac860 con 0x7fa60815dc60 2024-04-25T10:12:34.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-25T10:12:34.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 -- 172.21.15.18:0/3670748665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60815dc60 msgr2=0x7fa6080d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60815dc60 0x7fa6080d1020 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80097c0 tx=0x7fa5f801c3e0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 -- 172.21.15.18:0/3670748665 shutdown_connections 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60809a170 0x7fa6080cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 --2- 172.21.15.18:0/3670748665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60815dc60 0x7fa6080d1020 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 -- 172.21.15.18:0/3670748665 >> 172.21.15.18:0/3670748665 conn(0x7fa6080b3200 msgr2=0x7fa6080b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 -- 172.21.15.18:0/3670748665 shutdown_connections 2024-04-25T10:12:34.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.593+0000 7fa60ce00640 1 -- 172.21.15.18:0/3670748665 wait complete. 2024-04-25T10:12:34.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 Processor -- start 2024-04-25T10:12:34.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- start start 2024-04-25T10:12:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60806bf30 0x7fa6080c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 0x7fa6080b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080cc6f0 con 0x7fa60809a170 2024-04-25T10:12:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080cc570 con 0x7fa60806bf30 2024-04-25T10:12:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080cc870 con 0x7fa60815dc60 2024-04-25T10:12:34.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50600/0 (socket says 172.21.15.18:50600) 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 -- 172.21.15.18:0/2964028353 learned_addr learned my addr 172.21.15.18:0/2964028353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa605e00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60806bf30 0x7fa6080c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa606800640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 0x7fa6080b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 -- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 msgr2=0x7fa6080b62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 0x7fa6080b62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 -- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60806bf30 msgr2=0x7fa6080c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:34.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60806bf30 0x7fa6080c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 -- 172.21.15.18:0/2964028353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080b6960 con 0x7fa60809a170 2024-04-25T10:12:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa606800640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 0x7fa6080b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fd400640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c420 tx=0x7fa5f000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa60809a170 2024-04-25T10:12:34.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0005cf0 con 0x7fa60809a170 2024-04-25T10:12:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6080b4e20 con 0x7fa60809a170 2024-04-25T10:12:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f00072f0 con 0x7fa60809a170 2024-04-25T10:12:34.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.597+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6080b53e0 con 0x7fa60809a170 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6080745d0 con 0x7fa60809a170 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5f001a070 con 0x7fa60809a170 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa5fea00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fa5f00843d0 con 0x7fa60809a170 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa605e00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:34.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.601+0000 7fa605e00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ae000 tx=0x7fa5f80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:34.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.605+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa5f0055400 con 0x7fa60809a170 2024-04-25T10:12:34.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:34.777+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa6080c8550 con 0x7fa60809a170 2024-04-25T10:12:35.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.348+0000 7fa5fea00640 1 -- 172.21.15.18:0/2964028353 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v102) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa5f0054d00 con 0x7fa60809a170 2024-04-25T10:12:35.356 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.348+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 msgr2=0x7fa5e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.348+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5f80ae000 tx=0x7fa5f80a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.348+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 msgr2=0x7fa6080b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.348+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000c420 tx=0x7fa5f000c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 shutdown_connections 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815dc60 0x7fa6080b62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa60809a170 0x7fa6080b5900 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 --2- 172.21.15.18:0/2964028353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60806bf30 0x7fa6080c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 >> 172.21.15.18:0/2964028353 conn(0x7fa6080b3200 msgr2=0x7fa60806c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 shutdown_connections 2024-04-25T10:12:35.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.352+0000 7fa60ce00640 1 -- 172.21.15.18:0/2964028353 wait complete. 2024-04-25T10:12:35.382 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:12:35.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 Processor -- start 2024-04-25T10:12:35.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 -- start start 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec415b5a0 0x7f3ec40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ec415b980 0x7f3ec40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec40ce7f0 con 0x7f3ec4071970 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec40cfcd0 con 0x7f3ec415b980 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3eca600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec40cead0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ebbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ec415b980 0x7f3ec40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ec3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3ec4071970 0x7f3ec415f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33464/0 (socket says 172.21.15.18:33464) 2024-04-25T10:12:35.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ec3e00640 1 -- 172.21.15.18:0/4222860196 learned_addr learned my addr 172.21.15.18:0/4222860196 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ec3400640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec415b5a0 0x7f3ec40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4222860196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec415b5a0 msgr2=0x7f3ec40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ebbe00640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec415b5a0 0x7f3ec40cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4222860196 >> v1:172.21.15.18:6789/0 conn(0x7f3ec4071970 legacy=0x7f3ec415f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ec2a00640 1 -- 172.21.15.18:0/4222860196 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678411533 0 0) 0x7f3ec40ce7f0 con 0x7f3ec4071970 2024-04-25T10:12:35.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.516+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4222860196 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40cf960 con 0x7f3ec415b980 2024-04-25T10:12:35.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3ebbe00640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b980 0x7f3ec40cbd30 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c82587cb0fcb5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3ec2a00640 1 -- 172.21.15.18:0/4222860196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0aa620 con 0x7f3ec415b980 2024-04-25T10:12:35.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3ec2a00640 1 -- 172.21.15.18:0/4222860196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0af070 con 0x7f3ec415b980 2024-04-25T10:12:35.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3ec2a00640 1 -- 172.21.15.18:0/4222860196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0aa9e0 con 0x7f3ec415b980 2024-04-25T10:12:35.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 -- 172.21.15.18:0/4222860196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b980 msgr2=0x7f3ec40cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b980 0x7f3ec40cbd30 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 -- 172.21.15.18:0/4222860196 shutdown_connections 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b980 0x7f3ec40cbd30 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 --2- 172.21.15.18:0/4222860196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec415b5a0 0x7f3ec40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 -- 172.21.15.18:0/4222860196 >> 172.21.15.18:0/4222860196 conn(0x7f3ec40b3390 msgr2=0x7f3ec40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 -- 172.21.15.18:0/4222860196 shutdown_connections 2024-04-25T10:12:35.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.520+0000 7f3eca600640 1 -- 172.21.15.18:0/4222860196 wait complete. 2024-04-25T10:12:35.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 Processor -- start 2024-04-25T10:12:35.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- start start 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 0x7f3ec415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 0x7f3ec40c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4168ad0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4168950 con 0x7f3ec415b980 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4168c50 con 0x7f3ec4071970 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50608/0 (socket says 172.21.15.18:50608) 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4066208777 learned_addr learned my addr 172.21.15.18:0/4066208777 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:35.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ec3e00640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 0x7f3ec40c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ec3400640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 0x7f3ec415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 msgr2=0x7f3ec415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 0x7f3ec415e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 msgr2=0x7f3ec40c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 0x7f3ec40c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 -- 172.21.15.18:0/4066208777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec40c8270 con 0x7f3ec415b5a0 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ec3400640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 0x7f3ec415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ec3e00640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 0x7f3ec40c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:35.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebbe00640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0aadf0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac004020 con 0x7f3ec415b5a0 2024-04-25T10:12:35.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec40c84f0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac004410 con 0x7f3ec415b5a0 2024-04-25T10:12:35.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.524+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec414f2c0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec40745d0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3eac003620 con 0x7f3ec415b5a0 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3ebb400640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3eac11f470 con 0x7f3ec415b5a0 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3ec3400640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.528+0000 7f3ec3400640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 0x7f3ea0069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009840 tx=0x7f3eb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.532+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ec40c8270 con 0x7f3ec415b5a0 2024-04-25T10:12:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.748+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3ec40ceeb0 con 0x7f3ec415b5a0 2024-04-25T10:12:35.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.748+0000 7f3ebb400640 1 -- 172.21.15.18:0/4066208777 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3ec40cc680 con 0x7f3ec415b5a0 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:12:35.757 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:12:35.759 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.762 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.763 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:12:35.764 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.765 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.766 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.768 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:12:35.770 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:12:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 msgr2=0x7f3ea0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 0x7f3ea0069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009840 tx=0x7f3eb4008040 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 msgr2=0x7f3ec40c7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0097c0 tx=0x7f3eac01ace0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 shutdown_connections 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ec415b980 0x7f3ec40c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ec415b5a0 0x7f3ec40c7d30 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3ea0066f60 0x7f3ea0069420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 --2- 172.21.15.18:0/4066208777 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ec4071970 0x7f3ec415e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 >> 172.21.15.18:0/4066208777 conn(0x7f3ec40b3390 msgr2=0x7f3ec4153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 shutdown_connections 2024-04-25T10:12:35.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.752+0000 7f3eca600640 1 -- 172.21.15.18:0/4066208777 wait complete. 2024-04-25T10:12:35.778 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:35.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 Processor -- start 2024-04-25T10:12:35.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 -- start start 2024-04-25T10:12:35.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2864144140 0x7f28640ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f286406ead0 0x7f28640b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f286415ac60 con 0x7f28640ced60 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640cf3e0 con 0x7f286406ead0 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f286b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286415af20 con 0x7f2864144140 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f286406ead0 0x7f28640b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f286406ead0 0x7f28640b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50612/0 (socket says 172.21.15.18:50612) 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 -- 172.21.15.18:0/1556287880 learned_addr learned my addr 172.21.15.18:0/1556287880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f285be00640 1 --1- 172.21.15.18:0/1556287880 >> v1:172.21.15.18:6789/0 conn(0x7f28640ced60 0x7f286406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33466/0 (socket says 172.21.15.18:33466) 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2863e00640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2864144140 0x7f28640ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 -- 172.21.15.18:0/1556287880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2864144140 msgr2=0x7f28640ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2864144140 0x7f28640ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.912+0000 7f2869200640 1 -- 172.21.15.18:0/1556287880 >> v1:172.21.15.18:6789/0 conn(0x7f28640ced60 legacy=0x7f286406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f2869200640 1 -- 172.21.15.18:0/1556287880 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286415b200 con 0x7f286406ead0 2024-04-25T10:12:35.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f2869200640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28640b0760 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f285c009e50 tx=0x7f285c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a9aecdc382b707 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f2863400640 1 -- 172.21.15.18:0/1556287880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0a9440 con 0x7f286406ead0 2024-04-25T10:12:35.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f2863400640 1 -- 172.21.15.18:0/1556287880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0ae070 con 0x7f286406ead0 2024-04-25T10:12:35.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f2863400640 1 -- 172.21.15.18:0/1556287880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0a9800 con 0x7f286406ead0 2024-04-25T10:12:35.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 -- 172.21.15.18:0/1556287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 msgr2=0x7f28640b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28640b0760 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f285c009e50 tx=0x7f285c01ca30 comp rx=0 tx=0).stop 2024-04-25T10:12:35.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 -- 172.21.15.18:0/1556287880 shutdown_connections 2024-04-25T10:12:35.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28640b0760 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 --2- 172.21.15.18:0/1556287880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2864144140 0x7f28640ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 -- 172.21.15.18:0/1556287880 >> 172.21.15.18:0/1556287880 conn(0x7f2864066fa0 msgr2=0x7f286406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:35.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 -- 172.21.15.18:0/1556287880 shutdown_connections 2024-04-25T10:12:35.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.916+0000 7f286b200640 1 -- 172.21.15.18:0/1556287880 wait complete. 2024-04-25T10:12:35.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 Processor -- start 2024-04-25T10:12:35.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- start start 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28640ced60 0x7f2864141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2864144140 0x7f28640c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286415bb80 con 0x7f286406ead0 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f286415ba00 con 0x7f2864144140 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f286406d2b0 con 0x7f28640ced60 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50628/0 (socket says 172.21.15.18:50628) 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 -- 172.21.15.18:0/2119352048 learned_addr learned my addr 172.21.15.18:0/2119352048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f285be00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28640ced60 0x7f2864141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2869200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2864144140 0x7f28640c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 -- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28640ced60 msgr2=0x7f2864141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28640ced60 0x7f2864141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 -- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2864144140 msgr2=0x7f28640c69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2864144140 0x7f28640c69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 -- 172.21.15.18:0/2119352048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640c74f0 con 0x7f286406ead0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2863e00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f285400d5f0 tx=0x7f285400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540125f0 con 0x7f286406ead0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854019070 con 0x7f286406ead0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28540129b0 con 0x7f286406ead0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640c77d0 con 0x7f286406ead0 2024-04-25T10:12:35.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.920+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28640c7ff0 con 0x7f286406ead0 2024-04-25T10:12:35.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28640745d0 con 0x7f286406ead0 2024-04-25T10:12:35.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2854012b50 con 0x7f286406ead0 2024-04-25T10:12:35.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f2860c00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 0x7f2840069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:35.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f28540852c0 con 0x7f286406ead0 2024-04-25T10:12:35.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f285be00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 0x7f2840069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:35.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.924+0000 7f285be00640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 0x7f2840069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f28640cb810 tx=0x7f284c007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:35.928+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2854056480 con 0x7f286406ead0 2024-04-25T10:12:36.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286415e040 con 0x7f286406ead0 2024-04-25T10:12:36.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f2860c00640 1 -- 172.21.15.18:0/2119352048 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) v1 ==== 74+0+13142 (secure 0 0 0) 0x7f2854055d80 con 0x7f286406ead0 2024-04-25T10:12:36.100 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:36.100 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":104,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:35.359688+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":91,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:36.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 msgr2=0x7f2840069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 0x7f2840069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f28640cb810 tx=0x7f284c007cd0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 msgr2=0x7f28641f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f285400d5f0 tx=0x7f285400dab0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 shutdown_connections 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2864144140 0x7f28640c69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2840066f60 0x7f2840069420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28640ced60 0x7f2864141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 --2- 172.21.15.18:0/2119352048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f286406ead0 0x7f28641f6d50 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 >> 172.21.15.18:0/2119352048 conn(0x7f2864066fa0 msgr2=0x7f286415bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 shutdown_connections 2024-04-25T10:12:36.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.092+0000 7f286b200640 1 -- 172.21.15.18:0/2119352048 wait complete. 2024-04-25T10:12:36.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:36.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:36.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.256+0000 7fa607200640 1 Processor -- start 2024-04-25T10:12:36.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.256+0000 7fa607200640 1 -- start start 2024-04-25T10:12:36.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa607200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa60815f3b0 0x7fa60815f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa607200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6080cc050 0x7fa6080cc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa607200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60809ade0 con 0x7fa60815b9e0 2024-04-25T10:12:36.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa607200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608099a60 con 0x7fa6080cc050 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa607200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa608099d40 con 0x7fa60815f3b0 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6080cc050 0x7fa6080cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6080cc050 0x7fa6080cc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50642/0 (socket says 172.21.15.18:50642) 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 -- 172.21.15.18:0/2817255344 learned_addr learned my addr 172.21.15.18:0/2817255344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa5fd400640 1 --2- 172.21.15.18:0/2817255344 >> v2:172.21.15.167:3300/0 conn(0x7fa60815f3b0 0x7fa60815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 -- 172.21.15.18:0/2817255344 >> v2:172.21.15.167:3300/0 conn(0x7fa60815f3b0 msgr2=0x7fa60815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 --2- 172.21.15.18:0/2817255344 >> v2:172.21.15.167:3300/0 conn(0x7fa60815f3b0 0x7fa60815f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 -- 172.21.15.18:0/2817255344 >> v1:172.21.15.167:6789/0 conn(0x7fa60815b9e0 legacy=0x7fa6080cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 -- 172.21.15.18:0/2817255344 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60809a020 con 0x7fa6080cc050 2024-04-25T10:12:36.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.260+0000 7fa606800640 1 --2- 172.21.15.18:0/2817255344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080cc430 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa60809b150 tx=0x7fa60001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07d9bd7eb11a8ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605400640 1 -- 172.21.15.18:0/2817255344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a57a0 con 0x7fa6080cc050 2024-04-25T10:12:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605400640 1 -- 172.21.15.18:0/2817255344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000a5940 con 0x7fa6080cc050 2024-04-25T10:12:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605400640 1 -- 172.21.15.18:0/2817255344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a5d10 con 0x7fa6080cc050 2024-04-25T10:12:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- 172.21.15.18:0/2817255344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 msgr2=0x7fa6080cc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- 172.21.15.18:0/2817255344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080cc430 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fa60809b150 tx=0x7fa60001c9f0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- 172.21.15.18:0/2817255344 shutdown_connections 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- 172.21.15.18:0/2817255344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080cc430 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- 172.21.15.18:0/2817255344 >> v2:172.21.15.167:3300/0 conn(0x7fa60815f3b0 0x7fa60815f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- 172.21.15.18:0/2817255344 >> 172.21.15.18:0/2817255344 conn(0x7fa6080b3030 msgr2=0x7fa6080b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- 172.21.15.18:0/2817255344 shutdown_connections 2024-04-25T10:12:36.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- 172.21.15.18:0/2817255344 wait complete. 2024-04-25T10:12:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 Processor -- start 2024-04-25T10:12:36.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- start start 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60815b9e0 0x7fa60815c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815f3b0 0x7fa608159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080d03d0 con 0x7fa6080cc050 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080d0250 con 0x7fa60815b9e0 2024-04-25T10:12:36.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa607200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081686f0 con 0x7fa60815f3b0 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50650/0 (socket says 172.21.15.18:50650) 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa605e00640 1 -- 172.21.15.18:0/1378648440 learned_addr learned my addr 172.21.15.18:0/1378648440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa5fd400640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60815b9e0 0x7fa60815c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.264+0000 7fa606800640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815f3b0 0x7fa608159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 -- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815f3b0 msgr2=0x7fa608159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815f3b0 0x7fa608159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 -- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60815b9e0 msgr2=0x7fa60815c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60815b9e0 0x7fa60815c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 -- 172.21.15.18:0/1378648440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080b6180 con 0x7fa6080cc050 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa605e00640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c3c0 tx=0x7fa5f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8017070 con 0x7fa6080cc050 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f80052f0 con 0x7fa6080cc050 2024-04-25T10:12:36.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f8003840 con 0x7fa6080cc050 2024-04-25T10:12:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6080b6f80 con 0x7fa6080cc050 2024-04-25T10:12:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6080b58e0 con 0x7fa6080cc050 2024-04-25T10:12:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6080c8870 con 0x7fa6080cc050 2024-04-25T10:12:36.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa5f801a070 con 0x7fa6080cc050 2024-04-25T10:12:36.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.268+0000 7fa5fea00640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.272+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa5f8084090 con 0x7fa6080cc050 2024-04-25T10:12:36.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.272+0000 7fa5fd400640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.272+0000 7fa5fd400640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa60806c770 tx=0x7fa5f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.276+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa60809ade0 con 0x7fa6080cc050 2024-04-25T10:12:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.436+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6080745d0 con 0x7fa6080cc050 2024-04-25T10:12:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.436+0000 7fa5fea00640 1 -- 172.21.15.18:0/1378648440 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v104) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5f8054c00 con 0x7fa6080cc050 2024-04-25T10:12:36.445 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 msgr2=0x7fa5e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa60806c770 tx=0x7fa5f0009190 comp rx=0 tx=0).stop 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 msgr2=0x7fa6080b6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fa5f800c3c0 tx=0x7fa5f800c880 comp rx=0 tx=0).stop 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 shutdown_connections 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa5e4066f60 0x7fa5e4069420 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa60815f3b0 0x7fa608159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa60815b9e0 0x7fa60815c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 --2- 172.21.15.18:0/1378648440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6080cc050 0x7fa6080b6a40 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 >> 172.21.15.18:0/1378648440 conn(0x7fa6080b3030 msgr2=0x7fa60806fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 shutdown_connections 2024-04-25T10:12:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.440+0000 7fa607200640 1 -- 172.21.15.18:0/1378648440 wait complete. 2024-04-25T10:12:36.466 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:12:36.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 Processor -- start 2024-04-25T10:12:36.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 -- start start 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8b240ce480 0x7f8b240b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b240b10e0 con 0x7f8b2415b520 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b24099e00 con 0x7f8b2415b140 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b28c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2409a0e0 con 0x7f8b240ce480 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8b2415b520 0x7f8b240cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33472/0 (socket says 172.21.15.18:33472) 2024-04-25T10:12:36.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22a00640 1 -- 172.21.15.18:0/4231295969 learned_addr learned my addr 172.21.15.18:0/4231295969 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:36.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 --2- 172.21.15.18:0/4231295969 >> v2:172.21.15.167:3300/0 conn(0x7f8b240ce480 0x7f8b240b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104604808 0 0) 0x7f8b240b10e0 con 0x7f8b2415b520 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b08003530 con 0x7f8b2415b520 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2981560198 0 0) 0x7f8b08003530 con 0x7f8b2415b520 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 >> v2:172.21.15.167:3300/0 conn(0x7f8b240ce480 msgr2=0x7f8b240b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 --2- 172.21.15.18:0/4231295969 >> v2:172.21.15.167:3300/0 conn(0x7f8b240ce480 0x7f8b240b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 >> v1:172.21.15.167:6789/0 conn(0x7f8b2415b140 legacy=0x7f8b2415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2409a3c0 con 0x7f8b2415b520 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f8b100016a0 con 0x7f8b2415b520 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 >> v1:172.21.15.18:6789/0 conn(0x7f8b2415b520 legacy=0x7f8b240cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b080039c0 0x7f8b08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b08004810 0x7f8b08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 0x7f8b0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409a0e0 con 0x7f8b080051d0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0800c170 con 0x7f8b08004810 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0800c370 con 0x7f8b080039c0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 0x7f8b0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23400640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b080039c0 0x7f8b08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b22a00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b08004810 0x7f8b08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 -- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b080039c0 msgr2=0x7f8b08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b080039c0 0x7f8b08003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 -- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b08004810 msgr2=0x7f8b08004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b08004810 0x7f8b08004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23e00640 1 -- 172.21.15.18:0/4231295969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08003530 con 0x7f8b080051d0 2024-04-25T10:12:36.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.600+0000 7f8b23400640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b080039c0 0x7f8b08003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:36.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b23e00640 1 -- 172.21.15.18:0/4231295969 reap_dead start 2024-04-25T10:12:36.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b23e00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 0x7f8b0800b9d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009fc0 tx=0x7f8b1c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d13db2df0f1be9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c009c10 con 0x7f8b080051d0 2024-04-25T10:12:36.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0a5c00 con 0x7f8b080051d0 2024-04-25T10:12:36.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b22000640 1 -- 172.21.15.18:0/4231295969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0039a0 con 0x7f8b080051d0 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 -- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 msgr2=0x7f8b0800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 0x7f8b0800b9d0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c009fc0 tx=0x7f8b1c01ccc0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 -- 172.21.15.18:0/4231295969 shutdown_connections 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 --2- 172.21.15.18:0/4231295969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b080051d0 0x7f8b0800b9d0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 -- 172.21.15.18:0/4231295969 >> 172.21.15.18:0/4231295969 conn(0x7f8b240d14f0 msgr2=0x7f8b240d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 -- 172.21.15.18:0/4231295969 shutdown_connections 2024-04-25T10:12:36.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.604+0000 7f8b28c00640 1 -- 172.21.15.18:0/4231295969 wait complete. 2024-04-25T10:12:36.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 Processor -- start 2024-04-25T10:12:36.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- start start 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b080051d0 0x7f8b240c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b2414a9d0 0x7f8b24149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24099a60 con 0x7f8b24147000 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2409a980 con 0x7f8b080051d0 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b24099be0 con 0x7f8b2414a9d0 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50680/0 (socket says 172.21.15.18:50680) 2024-04-25T10:12:36.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 -- 172.21.15.18:0/3633487279 learned_addr learned my addr 172.21.15.18:0/3633487279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23400640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b080051d0 0x7f8b240c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b22a00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b2414a9d0 0x7f8b24149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 -- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b2414a9d0 msgr2=0x7f8b24149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b2414a9d0 0x7f8b24149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 -- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b080051d0 msgr2=0x7f8b240c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b080051d0 0x7f8b240c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 -- 172.21.15.18:0/3633487279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2415ec90 con 0x7f8b24147000 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b23e00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0aeab0 tx=0x7f8b1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c009c10 con 0x7f8b24147000 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c0bd070 con 0x7f8b24147000 2024-04-25T10:12:36.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b241479c0 con 0x7f8b24147000 2024-04-25T10:12:36.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0039a0 con 0x7f8b24147000 2024-04-25T10:12:36.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.608+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b24160da0 con 0x7f8b24147000 2024-04-25T10:12:36.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b24160b90 con 0x7f8b24147000 2024-04-25T10:12:36.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b1c003b40 con 0x7f8b24147000 2024-04-25T10:12:36.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b1b400640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 0x7f8b04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8b1c120670 con 0x7f8b24147000 2024-04-25T10:12:36.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b23400640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 0x7f8b04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.612+0000 7f8b23400640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 0x7f8b04069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8b14001660 tx=0x7f8b14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.616+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b1c0c7020 con 0x7f8b24147000 2024-04-25T10:12:36.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8b2404efa0 con 0x7f8b24147000 2024-04-25T10:12:36.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b1b400640 1 -- 172.21.15.18:0/3633487279 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v104) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8b2415ec90 con 0x7f8b24147000 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:36.788 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:12:36.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 msgr2=0x7f8b04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 0x7f8b04069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8b14001660 tx=0x7f8b14009040 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 msgr2=0x7f8b24147480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0aeab0 tx=0x7f8b1c009750 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 shutdown_connections 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b24147000 0x7f8b24147480 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04066f60 0x7f8b04069420 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b2414a9d0 0x7f8b24149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 --2- 172.21.15.18:0/3633487279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b080051d0 0x7f8b240c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 >> 172.21.15.18:0/3633487279 conn(0x7f8b240d14f0 msgr2=0x7f8b2406f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 shutdown_connections 2024-04-25T10:12:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.780+0000 7f8b28c00640 1 -- 172.21.15.18:0/3633487279 wait complete. 2024-04-25T10:12:36.809 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:12:36.809 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:12:36.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.944+0000 7fdda5200640 1 Processor -- start 2024-04-25T10:12:36.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.944+0000 7fdda5200640 1 -- start start 2024-04-25T10:12:36.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdda5200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdda00713c0 0x7fdda00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdda5200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda015de90 con 0x7fdda015dab0 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdda5200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda0071a70 con 0x7fdda00b0c00 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdda5200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda00b57a0 con 0x7fdda00713c0 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd95400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdda00713c0 0x7fdda00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd9de00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdda015dab0 0x7fdda0070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33484/0 (socket says 172.21.15.18:33484) 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd9de00640 1 -- 172.21.15.18:0/1291961202 learned_addr learned my addr 172.21.15.18:0/1291961202 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:36.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd95400640 1 -- 172.21.15.18:0/1291961202 >> v1:172.21.15.167:6789/0 conn(0x7fdda00b0c00 legacy=0x7fdda006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd95400640 1 -- 172.21.15.18:0/1291961202 >> v1:172.21.15.18:6789/0 conn(0x7fdda015dab0 legacy=0x7fdda0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd9d400640 1 -- 172.21.15.18:0/1291961202 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188626466 0 0) 0x7fdda015de90 con 0x7fdda015dab0 2024-04-25T10:12:36.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.948+0000 7fdd95400640 1 -- 172.21.15.18:0/1291961202 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda006bec0 con 0x7fdda00713c0 2024-04-25T10:12:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdd95400640 1 --2- 172.21.15.18:0/1291961202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00b5110 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fdd880097c0 tx=0x7fdd8801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57d3fc56dd93688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdd9d400640 1 -- 172.21.15.18:0/1291961202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880a7070 con 0x7fdda00713c0 2024-04-25T10:12:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdd9d400640 1 -- 172.21.15.18:0/1291961202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd880b0070 con 0x7fdda00713c0 2024-04-25T10:12:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdd9d400640 1 -- 172.21.15.18:0/1291961202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd880ab890 con 0x7fdda00713c0 2024-04-25T10:12:36.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- 172.21.15.18:0/1291961202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 msgr2=0x7fdda00b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 --2- 172.21.15.18:0/1291961202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00b5110 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fdd880097c0 tx=0x7fdd8801c470 comp rx=0 tx=0).stop 2024-04-25T10:12:36.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- 172.21.15.18:0/1291961202 shutdown_connections 2024-04-25T10:12:36.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 --2- 172.21.15.18:0/1291961202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00b5110 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- 172.21.15.18:0/1291961202 >> 172.21.15.18:0/1291961202 conn(0x7fdda006f510 msgr2=0x7fdda006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:36.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- 172.21.15.18:0/1291961202 shutdown_connections 2024-04-25T10:12:36.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- 172.21.15.18:0/1291961202 wait complete. 2024-04-25T10:12:36.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 Processor -- start 2024-04-25T10:12:36.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.952+0000 7fdda5200640 1 -- start start 2024-04-25T10:12:36.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 0x7fdda0142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda015dab0 0x7fdda015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda006dc50 con 0x7fdda00713c0 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda006dad0 con 0x7fdda015dab0 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda016b940 con 0x7fdda00b0c00 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50692/0 (socket says 172.21.15.18:50692) 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 -- 172.21.15.18:0/3221750549 learned_addr learned my addr 172.21.15.18:0/3221750549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9e800640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda015dab0 0x7fdda015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd95400640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 0x7fdda0142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 -- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 msgr2=0x7fdda0142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 0x7fdda0142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 -- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda015dab0 msgr2=0x7fdda015eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:36.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda015dab0 0x7fdda015eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 -- 172.21.15.18:0/3221750549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0142860 con 0x7fdda00713c0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd95400640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 0x7fdda0142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd9de00640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c410 tx=0x7fdd9000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd900074e0 con 0x7fdda00713c0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd900047f0 con 0x7fdda00713c0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd90007680 con 0x7fdda00713c0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda015f1e0 con 0x7fdda00713c0 2024-04-25T10:12:36.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda015e1c0 con 0x7fdda00713c0 2024-04-25T10:12:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda00745d0 con 0x7fdda00713c0 2024-04-25T10:12:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.956+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd90011070 con 0x7fdda00713c0 2024-04-25T10:12:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.960+0000 7fdd96a00640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 0x7fdd7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.960+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fdd90084b90 con 0x7fdda00713c0 2024-04-25T10:12:36.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.960+0000 7fdd95400640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 0x7fdd7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:36.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.960+0000 7fdd95400640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 0x7fdd7c069420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd880af000 tx=0x7fdd88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:36.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:36.964+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd90055cc0 con 0x7fdda00713c0 2024-04-25T10:12:37.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.128+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdda01578f0 con 0x7fdda00713c0 2024-04-25T10:12:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.360+0000 7fdd96a00640 1 -- 172.21.15.18:0/3221750549 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v105) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdd900555c0 con 0x7fdda00713c0 2024-04-25T10:12:37.368 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:12:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 msgr2=0x7fdd7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 0x7fdd7c069420 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdd880af000 tx=0x7fdd88008040 comp rx=0 tx=0).stop 2024-04-25T10:12:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 msgr2=0x7fdda00caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fdd9000c410 tx=0x7fdd9000c8d0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 shutdown_connections 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdda015dab0 0x7fdda015eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdd7c066f60 0x7fdd7c069420 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdda00b0c00 0x7fdda0142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 --2- 172.21.15.18:0/3221750549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdda00713c0 0x7fdda00caa80 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 >> 172.21.15.18:0/3221750549 conn(0x7fdda006f510 msgr2=0x7fdda015b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 shutdown_connections 2024-04-25T10:12:37.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.364+0000 7fdda5200640 1 -- 172.21.15.18:0/3221750549 wait complete. 2024-04-25T10:12:37.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:12:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 Processor -- start 2024-04-25T10:12:37.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 -- start start 2024-04-25T10:12:37.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f3ad015c9b0 0x7f3ad006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ad006e010 0x7f3ad006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ad015fc00 con 0x7f3ad0159320 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad006d640 con 0x7f3ad006e010 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ad5a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ad015fee0 con 0x7f3ad015c9b0 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ad006e010 0x7f3ad006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3ad006e010 0x7f3ad006e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50706/0 (socket says 172.21.15.18:50706) 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 -- 172.21.15.18:0/4201909136 learned_addr learned my addr 172.21.15.18:0/4201909136 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3ac6000640 1 --2- 172.21.15.18:0/4201909136 >> v2:172.21.15.167:3300/0 conn(0x7f3ad015c9b0 0x7f3ad006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 -- 172.21.15.18:0/4201909136 >> v2:172.21.15.167:3300/0 conn(0x7f3ad015c9b0 msgr2=0x7f3ad006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 --2- 172.21.15.18:0/4201909136 >> v2:172.21.15.167:3300/0 conn(0x7f3ad015c9b0 0x7f3ad006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 -- 172.21.15.18:0/4201909136 >> v1:172.21.15.167:6789/0 conn(0x7f3ad0159320 legacy=0x7f3ad015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.536+0000 7f3acf400640 1 -- 172.21.15.18:0/4201909136 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad01601c0 con 0x7f3ad006e010 2024-04-25T10:12:37.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3acf400640 1 --2- 172.21.15.18:0/4201909136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad006e010 0x7f3ad006e4a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00b4b50 tx=0x7f3ac801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7188182775e0039 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:37.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ace000640 1 -- 172.21.15.18:0/4201909136 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80a56c0 con 0x7f3ad006e010 2024-04-25T10:12:37.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ace000640 1 -- 172.21.15.18:0/4201909136 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac80a5860 con 0x7f3ad006e010 2024-04-25T10:12:37.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ace000640 1 -- 172.21.15.18:0/4201909136 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac80a5c30 con 0x7f3ad006e010 2024-04-25T10:12:37.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 -- 172.21.15.18:0/4201909136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad006e010 msgr2=0x7f3ad006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/4201909136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad006e010 0x7f3ad006e4a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00b4b50 tx=0x7f3ac801c9f0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 -- 172.21.15.18:0/4201909136 shutdown_connections 2024-04-25T10:12:37.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/4201909136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad006e010 0x7f3ad006e4a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/4201909136 >> v2:172.21.15.167:3300/0 conn(0x7f3ad015c9b0 0x7f3ad006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 -- 172.21.15.18:0/4201909136 >> 172.21.15.18:0/4201909136 conn(0x7f3ad0067080 msgr2=0x7f3ad006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:37.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 -- 172.21.15.18:0/4201909136 shutdown_connections 2024-04-25T10:12:37.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.540+0000 7f3ad5a00640 1 -- 172.21.15.18:0/4201909136 wait complete. 2024-04-25T10:12:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 Processor -- start 2024-04-25T10:12:37.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- start start 2024-04-25T10:12:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad006e010 0x7f3ad015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ad015c9b0 0x7f3ad0153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0168920 con 0x7f3ad0159320 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad01687a0 con 0x7f3ad006e010 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad0168aa0 con 0x7f3ad015c9b0 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50718/0 (socket says 172.21.15.18:50718) 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 -- 172.21.15.18:0/3973849773 learned_addr learned my addr 172.21.15.18:0/3973849773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3acf400640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ad015c9b0 0x7f3ad0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3acea00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad006e010 0x7f3ad015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 -- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ad015c9b0 msgr2=0x7f3ad0153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ad015c9b0 0x7f3ad0153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 -- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad006e010 msgr2=0x7f3ad015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad006e010 0x7f3ad015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:37.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 -- 172.21.15.18:0/3973849773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad006e530 con 0x7f3ad0159320 2024-04-25T10:12:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac6000640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e960 tx=0x7f3ab800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8017070 con 0x7f3ad0159320 2024-04-25T10:12:37.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800ca00 con 0x7f3ad0159320 2024-04-25T10:12:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad0157280 con 0x7f3ad0159320 2024-04-25T10:12:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800cdb0 con 0x7f3ad0159320 2024-04-25T10:12:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad015d840 con 0x7f3ad0159320 2024-04-25T10:12:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.544+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad00745d0 con 0x7f3ad0159320 2024-04-25T10:12:37.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.548+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ab801a070 con 0x7f3ad0159320 2024-04-25T10:12:37.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.548+0000 7f3ac7400640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 0x7f3aac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:37.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.548+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f3ab8085780 con 0x7f3ad0159320 2024-04-25T10:12:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.548+0000 7f3acea00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 0x7f3aac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:37.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.548+0000 7f3acea00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 0x7f3aac069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0001810 tx=0x7f3ac0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:37.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.552+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3ad0157280 con 0x7f3ad0159320 2024-04-25T10:12:37.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:37.716+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3ad006ac80 con 0x7f3ad0159320 2024-04-25T10:12:38.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.368+0000 7f3ac7400640 1 -- 172.21.15.18:0/3973849773 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v106) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3ab8056170 con 0x7f3ad0159320 2024-04-25T10:12:38.376 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.368+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 msgr2=0x7f3aac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.368+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 0x7f3aac069420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0001810 tx=0x7f3ac0009040 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.368+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 msgr2=0x7f3ad0157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.368+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800e960 tx=0x7f3ab800ee20 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 shutdown_connections 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3aac066f60 0x7f3aac069420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3ad015c9b0 0x7f3ad0153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ad0159320 0x7f3ad0157e70 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 --2- 172.21.15.18:0/3973849773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ad006e010 0x7f3ad015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 >> 172.21.15.18:0/3973849773 conn(0x7f3ad0067080 msgr2=0x7f3ad00cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:38.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 shutdown_connections 2024-04-25T10:12:38.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.372+0000 7f3ad5a00640 1 -- 172.21.15.18:0/3973849773 wait complete. 2024-04-25T10:12:38.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:12:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.548+0000 7fa3e5600640 1 Processor -- start 2024-04-25T10:12:38.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.548+0000 7fa3e5600640 1 -- start start 2024-04-25T10:12:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3e5600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3e0159320 0x7fa3e015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3e5600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e015fc00 con 0x7fa3e006e4a0 2024-04-25T10:12:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3e5600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e015fee0 con 0x7fa3e015f440 2024-04-25T10:12:38.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3e5600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e006d640 con 0x7fa3e0159320 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3e0159320 0x7fa3e015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3e0159320 0x7fa3e015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50722/0 (socket says 172.21.15.18:50722) 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 -- 172.21.15.18:0/3059938316 learned_addr learned my addr 172.21.15.18:0/3059938316 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3df400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa3e006e4a0 0x7fa3e0071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33490/0 (socket says 172.21.15.18:33490) 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 -- 172.21.15.18:0/3059938316 >> v1:172.21.15.167:6789/0 conn(0x7fa3e015f440 legacy=0x7fa3e006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:38.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 -- 172.21.15.18:0/3059938316 >> v1:172.21.15.18:6789/0 conn(0x7fa3e006e4a0 legacy=0x7fa3e0071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3de000640 1 -- 172.21.15.18:0/3059938316 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059054837 0 0) 0x7fa3e015fc00 con 0x7fa3e006e4a0 2024-04-25T10:12:38.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.552+0000 7fa3dea00640 1 -- 172.21.15.18:0/3059938316 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e01601c0 con 0x7fa3e0159320 2024-04-25T10:12:38.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3dea00640 1 --2- 172.21.15.18:0/3059938316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e015c9b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa3e006d7c0 tx=0x7fa3d001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933f14bc57dad692 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:38.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3de000640 1 -- 172.21.15.18:0/3059938316 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00a5770 con 0x7fa3e0159320 2024-04-25T10:12:38.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3de000640 1 -- 172.21.15.18:0/3059938316 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d00a5910 con 0x7fa3e0159320 2024-04-25T10:12:38.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3de000640 1 -- 172.21.15.18:0/3059938316 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00a5ce0 con 0x7fa3e0159320 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- 172.21.15.18:0/3059938316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 msgr2=0x7fa3e015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3059938316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e015c9b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fa3e006d7c0 tx=0x7fa3d001c910 comp rx=0 tx=0).stop 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- 172.21.15.18:0/3059938316 shutdown_connections 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3059938316 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e015c9b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- 172.21.15.18:0/3059938316 >> 172.21.15.18:0/3059938316 conn(0x7fa3e0067080 msgr2=0x7fa3e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- 172.21.15.18:0/3059938316 shutdown_connections 2024-04-25T10:12:38.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- 172.21.15.18:0/3059938316 wait complete. 2024-04-25T10:12:38.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 Processor -- start 2024-04-25T10:12:38.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- start start 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 0x7fa3e012eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 0x7fa3e01437b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0071980 con 0x7fa3e0159320 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0159700 con 0x7fa3e006e4a0 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3e5600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0071b00 con 0x7fa3e015f440 2024-04-25T10:12:38.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.556+0000 7fa3d6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50724/0 (socket says 172.21.15.18:50724) 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 -- 172.21.15.18:0/3440385146 learned_addr learned my addr 172.21.15.18:0/3440385146 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3df400640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 0x7fa3e01437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 -- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 msgr2=0x7fa3e01437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 0x7fa3e01437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3dea00640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 0x7fa3e012eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 -- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 msgr2=0x7fa3e012eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 0x7fa3e012eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 -- 172.21.15.18:0/3440385146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e013dc90 con 0x7fa3e0159320 2024-04-25T10:12:38.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3df400640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 0x7fa3e01437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3dea00640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 0x7fa3e012eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d6000640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c450 tx=0x7fa3c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8012830 con 0x7fa3e0159320 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8017070 con 0x7fa3e0159320 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8012c30 con 0x7fa3e0159320 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e013df70 con 0x7fa3e0159320 2024-04-25T10:12:38.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e013e800 con 0x7fa3e0159320 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e00745d0 con 0x7fa3e0159320 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.560+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa3c801c460 con 0x7fa3e0159320 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.564+0000 7fa3d7400640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 0x7fa3bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.564+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fa3c8085ab0 con 0x7fa3e0159320 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.564+0000 7fa3dea00640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 0x7fa3bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:38.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.564+0000 7fa3dea00640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 0x7fa3bc069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00ae000 tx=0x7fa3d00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:38.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.564+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa3c8056970 con 0x7fa3e0159320 2024-04-25T10:12:38.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:38.760+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa3e00acd00 con 0x7fa3e0159320 2024-04-25T10:12:39.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.368+0000 7fa3d7400640 1 -- 172.21.15.18:0/3440385146 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa3c8056270 con 0x7fa3e0159320 2024-04-25T10:12:39.378 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T10:12:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 msgr2=0x7fa3bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 0x7fa3bc069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00ae000 tx=0x7fa3d00a7070 comp rx=0 tx=0).stop 2024-04-25T10:12:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 msgr2=0x7fa3e00af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c450 tx=0x7fa3c800c910 comp rx=0 tx=0).stop 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 shutdown_connections 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa3bc066f60 0x7fa3bc069420 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa3e015f440 0x7fa3e01437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3e0159320 0x7fa3e00af270 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 --2- 172.21.15.18:0/3440385146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa3e006e4a0 0x7fa3e012eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 >> 172.21.15.18:0/3440385146 conn(0x7fa3e0067080 msgr2=0x7fa3e006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:39.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 shutdown_connections 2024-04-25T10:12:39.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.372+0000 7fa3e5600640 1 -- 172.21.15.18:0/3440385146 wait complete. 2024-04-25T10:12:39.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 Processor -- start 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 -- start start 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7b4161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc7b40713c0 0x7fc7b4143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b406d090 con 0x7fc7b4071800 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b4162390 con 0x7fc7b40713c0 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7bb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4161af0 con 0x7fc7b4070fe0 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b9800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc7b4071800 0x7fc7b415e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33506/0 (socket says 172.21.15.18:33506) 2024-04-25T10:12:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b9800640 1 -- 172.21.15.18:0/2475717836 learned_addr learned my addr 172.21.15.18:0/2475717836 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40713c0 0x7fc7b4143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b8e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7b4161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2176633255 0 0) 0x7fc7ac0014a0 con 0x7fc7b4071800 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc798003530 con 0x7fc7b4071800 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1212432398 0 0) 0x7fc798003530 con 0x7fc7b4071800 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 msgr2=0x7fc7b4161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7b4161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40713c0 msgr2=0x7fc7b4143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 --2- 172.21.15.18:0/2475717836 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40713c0 0x7fc7b4143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b4161dd0 con 0x7fc7b4071800 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fc7ac001bd0 con 0x7fc7b4071800 2024-04-25T10:12:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> v2:172.21.15.167:3300/0 conn(0x7fc7b40713c0 0x7fc7b4143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 >> v1:172.21.15.18:6789/0 conn(0x7fc7b4071800 legacy=0x7fc7b415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7980039c0 0x7fc798003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc798004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4162390 con 0x7fc798004810 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b4161af0 con 0x7fc7980039c0 2024-04-25T10:12:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.560+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79800b9d0 con 0x7fc7b4070fe0 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc798004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b8e00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7980039c0 0x7fc798003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b9800640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 -- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 msgr2=0x7fc7980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b4070fe0 0x7fc7980051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 -- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7980039c0 msgr2=0x7fc798003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7980039c0 0x7fc798003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 -- 172.21.15.18:0/2475717836 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798003530 con 0x7fc798004810 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7abe00640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc798004c90 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009cb0 tx=0x7fc79c01cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f170f4be9800a2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c0b2070 con 0x7fc798004810 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79c0a5870 con 0x7fc798004810 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b3e00640 1 -- 172.21.15.18:0/2475717836 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79c009880 con 0x7fc798004810 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7bb800640 1 -- 172.21.15.18:0/2475717836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 msgr2=0x7fc798004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7bb800640 1 --2- 172.21.15.18:0/2475717836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc798004c90 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009cb0 tx=0x7fc79c01cc90 comp rx=0 tx=0).stop 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.564+0000 7fc7b9800640 1 -- 172.21.15.18:0/2475717836 reap_dead start 2024-04-25T10:12:39.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- 172.21.15.18:0/2475717836 shutdown_connections 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- 172.21.15.18:0/2475717836 >> 172.21.15.18:0/2475717836 conn(0x7fc7b40b3390 msgr2=0x7fc7b40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- 172.21.15.18:0/2475717836 shutdown_connections 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- 172.21.15.18:0/2475717836 wait complete. 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 Processor -- start 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- start start 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b413fe70 0x7fc7b413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b40cc7e0 0x7fc7b40ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b415ec60 con 0x7fc798004810 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b415e030 con 0x7fc7b40cc7e0 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7bb800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b415ede0 con 0x7fc7b413fe70 2024-04-25T10:12:39.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50732/0 (socket says 172.21.15.18:50732) 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 -- 172.21.15.18:0/4011401673 learned_addr learned my addr 172.21.15.18:0/4011401673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7abe00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b413fe70 0x7fc7b413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b9800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b40cc7e0 0x7fc7b40ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 -- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b413fe70 msgr2=0x7fc7b413f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b413fe70 0x7fc7b413f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 -- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b40cc7e0 msgr2=0x7fc7b40ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b40cc7e0 0x7fc7b40ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 -- 172.21.15.18:0/4011401673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b41406e0 con 0x7fc798004810 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.568+0000 7fc7b8e00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4011960 tx=0x7fc7a4011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a400faf0 con 0x7fc798004810 2024-04-25T10:12:39.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a400fc90 con 0x7fc798004810 2024-04-25T10:12:39.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b4144590 con 0x7fc798004810 2024-04-25T10:12:39.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4014440 con 0x7fc798004810 2024-04-25T10:12:39.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b4144b50 con 0x7fc798004810 2024-04-25T10:12:39.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40745d0 con 0x7fc798004810 2024-04-25T10:12:39.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7a4012040 con 0x7fc798004810 2024-04-25T10:12:39.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 0x7fc790069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc7a4085530 con 0x7fc798004810 2024-04-25T10:12:39.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.572+0000 7fc7abe00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 0x7fc790069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.576+0000 7fc7abe00640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 0x7fc790069450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0af000 tx=0x7fc79c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.576+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7a4019030 con 0x7fc798004810 2024-04-25T10:12:39.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.744+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7b40cef80 con 0x7fc798004810 2024-04-25T10:12:39.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.744+0000 7fc7b1600640 1 -- 172.21.15.18:0/4011401673 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16873 (secure 0 0 0) 0x7fc7a4055df0 con 0x7fc798004810 2024-04-25T10:12:39.753 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:39.753 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":107,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:38.767755+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 msgr2=0x7fc790069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 0x7fc790069450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0af000 tx=0x7fc79c0046d0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 msgr2=0x7fc7b4143e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4011960 tx=0x7fc7a4011e20 comp rx=0 tx=0).stop 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 shutdown_connections 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7b40cc7e0 0x7fc7b40ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc790066f90 0x7fc790069450 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7b413fe70 0x7fc7b413f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 --2- 172.21.15.18:0/4011401673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc798004810 0x7fc7b4143e70 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 >> 172.21.15.18:0/4011401673 conn(0x7fc7b40b3390 msgr2=0x7fc7b40d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:39.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 shutdown_connections 2024-04-25T10:12:39.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.748+0000 7fc7bb800640 1 -- 172.21.15.18:0/4011401673 wait complete. 2024-04-25T10:12:39.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 Processor -- start 2024-04-25T10:12:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 -- start start 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f836c0d11b0 0x7f836c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f836c0b4210 0x7f836c0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f836c0b4b60 con 0x7f836c15da10 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c15ddf0 con 0x7f836c0b4210 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.908+0000 7f8373c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f836c06b480 con 0x7f836c0d11b0 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f836c0b4210 0x7f836c0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f836c0b4210 0x7f836c0b4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50748/0 (socket says 172.21.15.18:50748) 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 -- 172.21.15.18:0/3354283921 learned_addr learned my addr 172.21.15.18:0/3354283921 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8363e00640 1 --2- 172.21.15.18:0/3354283921 >> v2:172.21.15.167:3300/0 conn(0x7f836c0d11b0 0x7f836c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 -- 172.21.15.18:0/3354283921 >> v2:172.21.15.167:3300/0 conn(0x7f836c0d11b0 msgr2=0x7f836c0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 --2- 172.21.15.18:0/3354283921 >> v2:172.21.15.167:3300/0 conn(0x7f836c0d11b0 0x7f836c0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 -- 172.21.15.18:0/3354283921 >> v1:172.21.15.167:6789/0 conn(0x7f836c15da10 legacy=0x7f836c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:39.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 -- 172.21.15.18:0/3354283921 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0d06d0 con 0x7f836c0b4210 2024-04-25T10:12:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f8371c00640 1 --2- 172.21.15.18:0/3354283921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c0b4210 0x7f836c0b4620 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f836c071d40 tx=0x7f836401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7828f4bbb14cdee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f836be00640 1 -- 172.21.15.18:0/3354283921 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640a5710 con 0x7f836c0b4210 2024-04-25T10:12:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f836be00640 1 -- 172.21.15.18:0/3354283921 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640a58b0 con 0x7f836c0b4210 2024-04-25T10:12:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.912+0000 7f836be00640 1 -- 172.21.15.18:0/3354283921 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640a5c80 con 0x7f836c0b4210 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- 172.21.15.18:0/3354283921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c0b4210 msgr2=0x7f836c0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- 172.21.15.18:0/3354283921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c0b4210 0x7f836c0b4620 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f836c071d40 tx=0x7f836401c960 comp rx=0 tx=0).stop 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- 172.21.15.18:0/3354283921 shutdown_connections 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- 172.21.15.18:0/3354283921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c0b4210 0x7f836c0b4620 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- 172.21.15.18:0/3354283921 >> v2:172.21.15.167:3300/0 conn(0x7f836c0d11b0 0x7f836c0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- 172.21.15.18:0/3354283921 >> 172.21.15.18:0/3354283921 conn(0x7f836c0b2400 msgr2=0x7f836c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- 172.21.15.18:0/3354283921 shutdown_connections 2024-04-25T10:12:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- 172.21.15.18:0/3354283921 wait complete. 2024-04-25T10:12:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 Processor -- start 2024-04-25T10:12:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- start start 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c0b4210 0x7f836c15a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0d11b0 0x7f836c15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c1621d0 con 0x7f836c15da10 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f836c162050 con 0x7f836c0d11b0 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8373c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f836c162350 con 0x7f836c0b4210 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50754/0 (socket says 172.21.15.18:50754) 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 -- 172.21.15.18:0/702640435 learned_addr learned my addr 172.21.15.18:0/702640435 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:39.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371200640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c0b4210 0x7f836c15a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8363e00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0d11b0 0x7f836c15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 -- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c0b4210 msgr2=0x7f836c15a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c0b4210 0x7f836c15a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 -- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0d11b0 msgr2=0x7f836c15f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0d11b0 0x7f836c15f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.916+0000 7f8371c00640 1 -- 172.21.15.18:0/702640435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c15fa30 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8371c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8364019570 tx=0x7f8364019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364009510 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83640be070 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f836c15fcb0 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83640b88b0 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f836c160270 con 0x7f836c15da10 2024-04-25T10:12:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f836c0745d0 con 0x7f836c15da10 2024-04-25T10:12:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83640b8a50 con 0x7f836c15da10 2024-04-25T10:12:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8364120530 con 0x7f836c15da10 2024-04-25T10:12:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.920+0000 7f8371200640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:39.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.924+0000 7f8371200640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 0x7f8348069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f835c001770 tx=0x7f835c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:39.924+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f836c15fa30 con 0x7f836c15da10 2024-04-25T10:12:40.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.088+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f836c0b2150 con 0x7f836c15da10 2024-04-25T10:12:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.088+0000 7f8369600640 1 -- 172.21.15.18:0/702640435 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16873 (secure 0 0 0) 0x7f83640165e0 con 0x7f836c15da10 2024-04-25T10:12:40.098 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:40.098 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":107,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:38.767755+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 msgr2=0x7f8348069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 0x7f8348069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f835c001770 tx=0x7f835c009040 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 msgr2=0x7f836c146e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8364019570 tx=0x7f8364019700 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 shutdown_connections 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f836c15da10 0x7f836c146e30 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f836c0d11b0 0x7f836c15f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8348066f60 0x7f8348069420 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 --2- 172.21.15.18:0/702640435 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f836c0b4210 0x7f836c15a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 >> 172.21.15.18:0/702640435 conn(0x7f836c0b2400 msgr2=0x7f836c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 shutdown_connections 2024-04-25T10:12:40.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.092+0000 7f8373c00640 1 -- 172.21.15.18:0/702640435 wait complete. 2024-04-25T10:12:40.121 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:12:40.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 Processor -- start 2024-04-25T10:12:40.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 -- start start 2024-04-25T10:12:40.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f616809a170 0x7f61680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616815e040 con 0x7f616815dc60 2024-04-25T10:12:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680cff80 con 0x7f616806bf30 2024-04-25T10:12:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f616e400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680d0260 con 0x7f616809a170 2024-04-25T10:12:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f6167400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f616815dc60 0x7f6168099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33508/0 (socket says 172.21.15.18:33508) 2024-04-25T10:12:40.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f6167400640 1 -- 172.21.15.18:0/3862697835 learned_addr learned my addr 172.21.15.18:0/3862697835 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f615ea00640 1 --2- 172.21.15.18:0/3862697835 >> v2:172.21.15.167:3300/0 conn(0x7f616809a170 0x7f61680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554888289 0 0) 0x7f616815e040 con 0x7f616815dc60 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f614c003530 con 0x7f616815dc60 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.256+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3299531874 0 0) 0x7f614c003530 con 0x7f616815dc60 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 >> v2:172.21.15.167:3300/0 conn(0x7f616809a170 msgr2=0x7f61680d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 --2- 172.21.15.18:0/3862697835 >> v2:172.21.15.167:3300/0 conn(0x7f616809a170 0x7f61680d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 >> v1:172.21.15.167:6789/0 conn(0x7f616806bf30 legacy=0x7f61680cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680d0540 con 0x7f616815dc60 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f6158001680 con 0x7f616815dc60 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 >> v1:172.21.15.18:6789/0 conn(0x7f616815dc60 legacy=0x7f6168099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f614c003a10 0x7f614c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 0x7f614c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c0052f0 0x7f614c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680d0260 con 0x7f614c004810 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c1f0 con 0x7f614c0052f0 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c00c3f0 con 0x7f614c003a10 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 0x7f614c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6167400640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f614c003a10 0x7f614c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6167e00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c0052f0 0x7f614c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 -- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f614c003a10 msgr2=0x7f614c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f614c003a10 0x7f614c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 -- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c0052f0 msgr2=0x7f614c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c0052f0 0x7f614c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 -- 172.21.15.18:0/3862697835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c003530 con 0x7f614c004810 2024-04-25T10:12:40.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6167e00640 1 -- 172.21.15.18:0/3862697835 reap_dead start 2024-04-25T10:12:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f615ea00640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 0x7f614c004c90 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6150009ae0 tx=0x7f615001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cee76190367e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500b2070 con 0x7f614c004810 2024-04-25T10:12:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500a5520 con 0x7f614c004810 2024-04-25T10:12:40.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.260+0000 7f6166a00640 1 -- 172.21.15.18:0/3862697835 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500096b0 con 0x7f614c004810 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 msgr2=0x7f614c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 0x7f614c004c90 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6150009ae0 tx=0x7f615001ca40 comp rx=0 tx=0).stop 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- 172.21.15.18:0/3862697835 shutdown_connections 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 --2- 172.21.15.18:0/3862697835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f614c004810 0x7f614c004c90 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- 172.21.15.18:0/3862697835 >> 172.21.15.18:0/3862697835 conn(0x7f61680b3200 msgr2=0x7f61680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- 172.21.15.18:0/3862697835 shutdown_connections 2024-04-25T10:12:40.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- 172.21.15.18:0/3862697835 wait complete. 2024-04-25T10:12:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 Processor -- start 2024-04-25T10:12:40.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- start start 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c004810 0x7f616809ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61680c8d20 0x7f61680c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616806cfa0 con 0x7f6168153070 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680cc570 con 0x7f614c004810 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f616e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6168154010 con 0x7f61680c8d20 2024-04-25T10:12:40.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f615ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f6167400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c004810 0x7f616809ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f615ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50776/0 (socket says 172.21.15.18:50776) 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f615ea00640 1 -- 172.21.15.18:0/3963339463 learned_addr learned my addr 172.21.15.18:0/3963339463 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f6167e00640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61680c8d20 0x7f61680c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.264+0000 7f615ea00640 1 -- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61680c8d20 msgr2=0x7f61680c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615ea00640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61680c8d20 0x7f61680c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615ea00640 1 -- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c004810 msgr2=0x7f616809ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615ea00640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c004810 0x7f616809ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615ea00640 1 -- 172.21.15.18:0/3963339463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616809f340 con 0x7f6168153070 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615ea00640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f615001c870 tx=0x7f61500197e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500b2040 con 0x7f6168153070 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500a5df0 con 0x7f6168153070 2024-04-25T10:12:40.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680caad0 con 0x7f6168153070 2024-04-25T10:12:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500096b0 con 0x7f6168153070 2024-04-25T10:12:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61681534f0 con 0x7f6168153070 2024-04-25T10:12:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680745d0 con 0x7f6168153070 2024-04-25T10:12:40.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f61500bf020 con 0x7f6168153070 2024-04-25T10:12:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 0x7f6144069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f615011ed10 con 0x7f6168153070 2024-04-25T10:12:40.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.268+0000 7f6167400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 0x7f6144069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:40.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.272+0000 7f6167400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 0x7f6144069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f616806a4c0 tx=0x7f6158007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:40.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.272+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6150124020 con 0x7f6168153070 2024-04-25T10:12:40.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:40.476+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f616815e040 con 0x7f6168153070 2024-04-25T10:12:41.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-25T10:12:41.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-25T10:12:41.360 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:12:41.357+0000 7f532a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:12:41.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.388+0000 7f615fe00640 1 -- 172.21.15.18:0/3963339463 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7f61500c6020 con 0x7f6168153070 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 msgr2=0x7f6144069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 0x7f6144069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f616806a4c0 tx=0x7f6158007040 comp rx=0 tx=0).stop 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 msgr2=0x7f61680c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f615001c870 tx=0x7f61500197e0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 shutdown_connections 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6144066f90 0x7f6144069450 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f61680c8d20 0x7f61680c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6168153070 0x7f61680c87e0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 --2- 172.21.15.18:0/3963339463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f614c004810 0x7f616809ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 >> 172.21.15.18:0/3963339463 conn(0x7f61680b3200 msgr2=0x7f61680b4610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 shutdown_connections 2024-04-25T10:12:41.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.392+0000 7f616e400640 1 -- 172.21.15.18:0/3963339463 wait complete. 2024-04-25T10:12:41.423 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:12:41.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:12:41.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 Processor -- start 2024-04-25T10:12:41.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 -- start start 2024-04-25T10:12:41.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b4015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b400b3090 0x7f8b400b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4015bc40 con 0x7f8b400ccbf0 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4015e490 con 0x7f8b400b3090 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b45a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4015b3a0 con 0x7f8b40144120 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b400b3090 0x7f8b400b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8b400ccbf0 0x7f8b4015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43210/0 (socket says 172.21.15.18:43210) 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3e000640 1 -- 172.21.15.18:0/2632663380 learned_addr learned my addr 172.21.15.18:0/2632663380 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8b400b3090 0x7f8b400b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33708/0 (socket says 172.21.15.18:33708) 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3ea00640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b4015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 -- 172.21.15.18:0/2632663380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 msgr2=0x7f8b4015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b4015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 -- 172.21.15.18:0/2632663380 >> v1:172.21.15.18:6789/0 conn(0x7f8b400ccbf0 legacy=0x7f8b4015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3f400640 1 -- 172.21.15.18:0/2632663380 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4015b680 con 0x7f8b400b3090 2024-04-25T10:12:41.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.564+0000 7f8b3ea00640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b4015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b3f400640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400b3090 0x7f8b400b34f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009d90 tx=0x7f8b3801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c658abb4b60f25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b3d600640 1 -- 172.21.15.18:0/2632663380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380b2070 con 0x7f8b400b3090 2024-04-25T10:12:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b3d600640 1 -- 172.21.15.18:0/2632663380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b380a57b0 con 0x7f8b400b3090 2024-04-25T10:12:41.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b3d600640 1 -- 172.21.15.18:0/2632663380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b380a5b80 con 0x7f8b400b3090 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- 172.21.15.18:0/2632663380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400b3090 msgr2=0x7f8b400b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400b3090 0x7f8b400b34f0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f8b38009d90 tx=0x7f8b3801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- 172.21.15.18:0/2632663380 shutdown_connections 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400b3090 0x7f8b400b34f0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 --2- 172.21.15.18:0/2632663380 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b4015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- 172.21.15.18:0/2632663380 >> 172.21.15.18:0/2632663380 conn(0x7f8b40067080 msgr2=0x7f8b4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:41.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- 172.21.15.18:0/2632663380 shutdown_connections 2024-04-25T10:12:41.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- 172.21.15.18:0/2632663380 wait complete. 2024-04-25T10:12:41.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 Processor -- start 2024-04-25T10:12:41.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.568+0000 7f8b45a00640 1 -- start start 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b400b3090 0x7f8b400b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b40141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b401675c0 con 0x7f8b400ccbf0 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b40167440 con 0x7f8b400b3090 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b40167740 con 0x7f8b40144120 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33710/0 (socket says 172.21.15.18:33710) 2024-04-25T10:12:41.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 -- 172.21.15.18:0/4151621481 learned_addr learned my addr 172.21.15.18:0/4151621481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3f400640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b40141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3ea00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b400b3090 0x7f8b400b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 -- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 msgr2=0x7f8b40141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b40141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 -- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b400b3090 msgr2=0x7f8b400b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b400b3090 0x7f8b400b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 -- 172.21.15.18:0/4151621481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b400ae280 con 0x7f8b400ccbf0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3f400640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b40141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b3e000640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c450 tx=0x7f8b2c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c017070 con 0x7f8b400ccbf0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b2c005cf0 con 0x7f8b400ccbf0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2c007290 con 0x7f8b400ccbf0 2024-04-25T10:12:41.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b400ae560 con 0x7f8b400ccbf0 2024-04-25T10:12:41.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b400b0240 con 0x7f8b400ccbf0 2024-04-25T10:12:41.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.572+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b400745d0 con 0x7f8b400ccbf0 2024-04-25T10:12:41.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.576+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b2c01a070 con 0x7f8b400ccbf0 2024-04-25T10:12:41.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.576+0000 7f8b36a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 0x7f8b20069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:41.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.576+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b2c084490 con 0x7f8b400ccbf0 2024-04-25T10:12:41.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.576+0000 7f8b3ea00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 0x7f8b20069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:41.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.576+0000 7f8b3ea00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 0x7f8b20069450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000ba10 tx=0x7f8b30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:41.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.580+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b2c055310 con 0x7f8b400ccbf0 2024-04-25T10:12:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:41.776+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b4006c250 con 0x7f8b400ccbf0 2024-04-25T10:12:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.400+0000 7f8b36a00640 1 -- 172.21.15.18:0/4151621481 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b2c054c10 con 0x7f8b400ccbf0 2024-04-25T10:12:42.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 msgr2=0x7f8b20069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 0x7f8b20069450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f8b3000ba10 tx=0x7f8b30008040 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 msgr2=0x7f8b4013bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8b2c00c450 tx=0x7f8b2c00c910 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 shutdown_connections 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b20066f90 0x7f8b20069450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8b40144120 0x7f8b40141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8b400ccbf0 0x7f8b4013bef0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 --2- 172.21.15.18:0/4151621481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b400b3090 0x7f8b400b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 >> 172.21.15.18:0/4151621481 conn(0x7f8b40067080 msgr2=0x7f8b40141170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 shutdown_connections 2024-04-25T10:12:42.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.404+0000 7f8b45a00640 1 -- 172.21.15.18:0/4151621481 wait complete. 2024-04-25T10:12:42.435 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:12:42.436 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.572+0000 7fb19f600640 1 Processor -- start 2024-04-25T10:12:42.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.572+0000 7fb19f600640 1 -- start start 2024-04-25T10:12:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19f600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb19815da10 0x7fb1980afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19f600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 0x7fb1980b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19f600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1980b4b60 con 0x7fb1980d11b0 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19f600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19815ddf0 con 0x7fb19815da10 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19f600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19806b480 con 0x7fb1980b4210 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb19815da10 0x7fb1980afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb19815da10 0x7fb1980afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33726/0 (socket says 172.21.15.18:33726) 2024-04-25T10:12:42.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 -- 172.21.15.18:0/202700845 learned_addr learned my addr 172.21.15.18:0/202700845 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19d600640 1 --2- 172.21.15.18:0/202700845 >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 0x7fb1980b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 -- 172.21.15.18:0/202700845 >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 msgr2=0x7fb1980b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 --2- 172.21.15.18:0/202700845 >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 0x7fb1980b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 -- 172.21.15.18:0/202700845 >> v1:172.21.15.167:6789/0 conn(0x7fb1980d11b0 legacy=0x7fb19806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19cc00640 1 -- 172.21.15.18:0/202700845 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1980d06d0 con 0x7fb19815da10 2024-04-25T10:12:42.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.576+0000 7fb19d600640 1 --2- 172.21.15.18:0/202700845 >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 0x7fb1980b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:42.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19cc00640 1 --2- 172.21.15.18:0/202700845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb19815da10 0x7fb1980afe20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb1980afaf0 tx=0x7fb18801c270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f79dc68f503d34a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb197e00640 1 -- 172.21.15.18:0/202700845 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880b0070 con 0x7fb19815da10 2024-04-25T10:12:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb197e00640 1 -- 172.21.15.18:0/202700845 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880ab600 con 0x7fb19815da10 2024-04-25T10:12:42.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb197e00640 1 -- 172.21.15.18:0/202700845 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880ab9d0 con 0x7fb19815da10 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- 172.21.15.18:0/202700845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb19815da10 msgr2=0x7fb1980afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 --2- 172.21.15.18:0/202700845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb19815da10 0x7fb1980afe20 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb1980afaf0 tx=0x7fb18801c270 comp rx=0 tx=0).stop 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- 172.21.15.18:0/202700845 shutdown_connections 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 --2- 172.21.15.18:0/202700845 >> v2:172.21.15.167:3300/0 conn(0x7fb1980b4210 0x7fb1980b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 --2- 172.21.15.18:0/202700845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb19815da10 0x7fb1980afe20 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- 172.21.15.18:0/202700845 >> 172.21.15.18:0/202700845 conn(0x7fb1980b2400 msgr2=0x7fb1980b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:42.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- 172.21.15.18:0/202700845 shutdown_connections 2024-04-25T10:12:42.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- 172.21.15.18:0/202700845 wait complete. 2024-04-25T10:12:42.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 Processor -- start 2024-04-25T10:12:42.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.580+0000 7fb19f600640 1 -- start start 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1980d11b0 0x7fb19815f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19815da10 0x7fb19815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198162190 con 0x7fb1980b4210 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb198162010 con 0x7fb1980d11b0 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb198162310 con 0x7fb19815da10 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33742/0 (socket says 172.21.15.18:33742) 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 -- 172.21.15.18:0/1014817681 learned_addr learned my addr 172.21.15.18:0/1014817681 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19d600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19815da10 0x7fb19815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb18fe00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1980d11b0 0x7fb19815f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 -- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19815da10 msgr2=0x7fb19815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19815da10 0x7fb19815fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 -- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1980d11b0 msgr2=0x7fb19815f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1980d11b0 0x7fb19815f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 -- 172.21.15.18:0/1014817681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198150e40 con 0x7fb1980b4210 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19cc00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb1880ae040 tx=0x7fb188019010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880b0040 con 0x7fb1980b4210 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880b9070 con 0x7fb1980b4210 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198152880 con 0x7fb1980b4210 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880b48a0 con 0x7fb1980b4210 2024-04-25T10:12:42.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1981524a0 con 0x7fb1980b4210 2024-04-25T10:12:42.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1980745d0 con 0x7fb1980b4210 2024-04-25T10:12:42.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.584+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1880ab4c0 con 0x7fb1980b4210 2024-04-25T10:12:42.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.588+0000 7fb195600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 0x7fb174069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.588+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb18811f0a0 con 0x7fb1980b4210 2024-04-25T10:12:42.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.588+0000 7fb18fe00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 0x7fb174069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.588+0000 7fb18fe00640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 0x7fb174069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb1980b1680 tx=0x7fb180008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.592+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb1980b4b60 con 0x7fb1980b4210 2024-04-25T10:12:42.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.788+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb198072860 con 0x7fb1980b4210 2024-04-25T10:12:42.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb195600640 1 -- 172.21.15.18:0/1014817681 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fb1880efe80 con 0x7fb1980b4210 2024-04-25T10:12:42.799 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:42.799 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:12:41.782127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":36905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36905":{"gid":36905,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/81610203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":81610203},{"type":"v1","addr":"172.21.15.167:6837","nonce":81610203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:12:42.799 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 msgr2=0x7fb174069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 0x7fb174069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb1980b1680 tx=0x7fb180008040 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 msgr2=0x7fb1980cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb1880ae040 tx=0x7fb188019010 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 shutdown_connections 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f60 0x7fb174069420 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19815da10 0x7fb19815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1980d11b0 0x7fb19815f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 --2- 172.21.15.18:0/1014817681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980b4210 0x7fb1980cd3f0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 >> 172.21.15.18:0/1014817681 conn(0x7fb1980b2400 msgr2=0x7fb1980b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 shutdown_connections 2024-04-25T10:12:42.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.792+0000 7fb19f600640 1 -- 172.21.15.18:0/1014817681 wait complete. 2024-04-25T10:12:42.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 Processor -- start 2024-04-25T10:12:42.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 -- start start 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de406e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de415e0a0 con 0x7f5de406e760 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de415e380 con 0x7f5de40cc730 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5de8e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de40cf220 con 0x7f5de4143c60 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5ddaa00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5de406e760 0x7f5de40cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43218/0 (socket says 172.21.15.18:43218) 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.952+0000 7f5ddaa00640 1 -- 172.21.15.18:0/1352419513 learned_addr learned my addr 172.21.15.18:0/1352419513 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de3400640 1 --2- 172.21.15.18:0/1352419513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de406e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747272182 0 0) 0x7f5de415e0a0 con 0x7f5de406e760 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dc8003530 con 0x7f5de406e760 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090464323 0 0) 0x7f5de415e380 con 0x7f5de40cc730 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5de415e0a0 con 0x7f5de40cc730 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de3400640 1 -- 172.21.15.18:0/1352419513 >> v1:172.21.15.167:6789/0 conn(0x7f5de40cc730 legacy=0x7f5de40b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de3400640 1 -- 172.21.15.18:0/1352419513 >> v1:172.21.15.18:6789/0 conn(0x7f5de406e760 legacy=0x7f5de40cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de3400640 1 -- 172.21.15.18:0/1352419513 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de415e660 con 0x7f5de4143c60 2024-04-25T10:12:42.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.956+0000 7f5de3400640 1 --2- 172.21.15.18:0/1352419513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de406e220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009dc0 tx=0x7f5dd401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6500c7109818ac1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40b2070 con 0x7f5de4143c60 2024-04-25T10:12:42.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd40a5850 con 0x7f5de4143c60 2024-04-25T10:12:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de2a00640 1 -- 172.21.15.18:0/1352419513 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40a5c20 con 0x7f5de4143c60 2024-04-25T10:12:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- 172.21.15.18:0/1352419513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 msgr2=0x7f5de406e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 --2- 172.21.15.18:0/1352419513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de406e220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009dc0 tx=0x7f5dd401c990 comp rx=0 tx=0).stop 2024-04-25T10:12:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- 172.21.15.18:0/1352419513 shutdown_connections 2024-04-25T10:12:42.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 --2- 172.21.15.18:0/1352419513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de406e220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- 172.21.15.18:0/1352419513 >> 172.21.15.18:0/1352419513 conn(0x7f5de4066fa0 msgr2=0x7f5de406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- 172.21.15.18:0/1352419513 shutdown_connections 2024-04-25T10:12:42.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- 172.21.15.18:0/1352419513 wait complete. 2024-04-25T10:12:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 Processor -- start 2024-04-25T10:12:42.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- start start 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5de40cc730 0x7f5de41597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4168530 con 0x7f5de406e760 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41683b0 con 0x7f5de40cc730 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de8e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41686b0 con 0x7f5de4143c60 2024-04-25T10:12:42.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33758/0 (socket says 172.21.15.18:33758) 2024-04-25T10:12:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de3400640 1 -- 172.21.15.18:0/659624755 learned_addr learned my addr 172.21.15.18:0/659624755 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5ddaa00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5de40cc730 0x7f5de41597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.960+0000 7f5de3e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 -- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 msgr2=0x7f5de4159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de4159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 -- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5de40cc730 msgr2=0x7f5de41597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5de40cc730 0x7f5de41597e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 -- 172.21.15.18:0/659624755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de40b0060 con 0x7f5de406e760 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de3400640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40b0040 tx=0x7f5dd4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40b2040 con 0x7f5de406e760 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd40bf070 con 0x7f5de406e760 2024-04-25T10:12:42.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40b8690 con 0x7f5de406e760 2024-04-25T10:12:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de40b0340 con 0x7f5de406e760 2024-04-25T10:12:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de40b0900 con 0x7f5de406e760 2024-04-25T10:12:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de404efa0 con 0x7f5de406e760 2024-04-25T10:12:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5dd40b8830 con 0x7f5de406e760 2024-04-25T10:12:42.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 0x7f5dc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.964+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5dd411fff0 con 0x7f5de406e760 2024-04-25T10:12:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.968+0000 7f5ddaa00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 0x7f5dc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:42.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.968+0000 7f5ddaa00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 0x7f5dc0069420 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5de413bd60 tx=0x7f5dcc007d80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:42.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:42.968+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5dd4016580 con 0x7f5de406e760 2024-04-25T10:12:43.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de40b25f0 con 0x7f5de406e760 2024-04-25T10:12:43.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5ddbe00640 1 -- 172.21.15.18:0/659624755 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16860 (secure 0 0 0) 0x7f5dd40f07c0 con 0x7f5de406e760 2024-04-25T10:12:43.141 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:43.141 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":108,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:40.385081+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 msgr2=0x7f5dc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 0x7f5dc0069420 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5de413bd60 tx=0x7f5dcc007d80 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 msgr2=0x7f5de4138ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f5dd40b0040 tx=0x7f5dd4019730 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 shutdown_connections 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5dc0066f60 0x7f5dc0069420 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5de4143c60 0x7f5de4159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5de40cc730 0x7f5de41597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 --2- 172.21.15.18:0/659624755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5de406e760 0x7f5de4138ab0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 >> 172.21.15.18:0/659624755 conn(0x7f5de4066fa0 msgr2=0x7f5de40ae840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.132+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 shutdown_connections 2024-04-25T10:12:43.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.136+0000 7f5de8e00640 1 -- 172.21.15.18:0/659624755 wait complete. 2024-04-25T10:12:43.163 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:12:43.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:12:43.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 Processor -- start 2024-04-25T10:12:43.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 -- start start 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f39e0072c70 0x7f39e00cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e015c430 con 0x7f39e015b860 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e015c710 con 0x7f39e00cd540 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39e4c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e015f4e0 con 0x7f39e0072c70 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dde00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f39e015b860 0x7f39e015bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43228/0 (socket says 172.21.15.18:43228) 2024-04-25T10:12:43.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dde00640 1 -- 172.21.15.18:0/1892411703 learned_addr learned my addr 172.21.15.18:0/1892411703 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39d7e00640 1 --2- 172.21.15.18:0/1892411703 >> v2:172.21.15.167:3300/0 conn(0x7f39e0072c70 0x7f39e00cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4044135730 0 0) 0x7f39e015c430 con 0x7f39e015b860 2024-04-25T10:12:43.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39c4003530 con 0x7f39e015b860 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229327421 0 0) 0x7f39c4003530 con 0x7f39e015b860 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 >> v2:172.21.15.167:3300/0 conn(0x7f39e0072c70 msgr2=0x7f39e00cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 --2- 172.21.15.18:0/1892411703 >> v2:172.21.15.167:3300/0 conn(0x7f39e0072c70 0x7f39e00cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 >> v1:172.21.15.167:6789/0 conn(0x7f39e00cd540 legacy=0x7f39e006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e015c9f0 con 0x7f39e015b860 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f39d0001680 con 0x7f39e015b860 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 >> v1:172.21.15.18:6789/0 conn(0x7f39e015b860 legacy=0x7f39e015bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39c4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c4004810 0x7f39c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40051d0 0x7f39c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015f4e0 con 0x7f39c4003a10 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c400c0d0 con 0x7f39c40051d0 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c400c2d0 con 0x7f39c4004810 2024-04-25T10:12:43.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.296+0000 7f39dde00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39c4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39d7e00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c4004810 0x7f39c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39de800640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40051d0 0x7f39c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 -- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c4004810 msgr2=0x7f39c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39c4004810 0x7f39c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 -- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40051d0 msgr2=0x7f39c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39c40051d0 0x7f39c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 -- 172.21.15.18:0/1892411703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c4003530 con 0x7f39c4003a10 2024-04-25T10:12:43.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39de800640 1 -- 172.21.15.18:0/1892411703 reap_dead start 2024-04-25T10:12:43.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dde00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39c4003e30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c110 tx=0x7f39d001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f09811175e0396 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0007c30 con 0x7f39c4003a10 2024-04-25T10:12:43.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00a9020 con 0x7f39c4003a10 2024-04-25T10:12:43.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39dd400640 1 -- 172.21.15.18:0/1892411703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0005ae0 con 0x7f39c4003a10 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39e4c00640 1 -- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 msgr2=0x7f39c4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.300+0000 7f39e4c00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39c4003e30 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f39d000c110 tx=0x7f39d001cba0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- 172.21.15.18:0/1892411703 shutdown_connections 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 --2- 172.21.15.18:0/1892411703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39c4003e30 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- 172.21.15.18:0/1892411703 >> 172.21.15.18:0/1892411703 conn(0x7f39e00b2400 msgr2=0x7f39e00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- 172.21.15.18:0/1892411703 shutdown_connections 2024-04-25T10:12:43.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- 172.21.15.18:0/1892411703 wait complete. 2024-04-25T10:12:43.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 Processor -- start 2024-04-25T10:12:43.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- start start 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 0x7f39e0152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e0153cc0 0x7f39e0154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015c050 con 0x7f39c4003a10 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e0073260 con 0x7f39e0153cc0 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39e4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e015c1d0 con 0x7f39e014f970 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33768/0 (socket says 172.21.15.18:33768) 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 -- 172.21.15.18:0/2656193953 learned_addr learned my addr 172.21.15.18:0/2656193953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39de800640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e0153cc0 0x7f39e0154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39d7e00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 0x7f39e0152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 -- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 msgr2=0x7f39e0152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 0x7f39e0152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 -- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e0153cc0 msgr2=0x7f39e0154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e0153cc0 0x7f39e0154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 -- 172.21.15.18:0/2656193953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e01f5c30 con 0x7f39c4003a10 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39d7e00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 0x7f39e0152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:43.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39dde00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f39d001c610 tx=0x7f39c4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.304+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0005e60 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d00b2070 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d0001b70 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e0151af0 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e0152070 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e00745d0 con 0x7f39c4003a10 2024-04-25T10:12:43.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39d0007310 con 0x7f39c4003a10 2024-04-25T10:12:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d6000640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 0x7f39bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f39d011e450 con 0x7f39c4003a10 2024-04-25T10:12:43.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d7e00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 0x7f39bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.308+0000 7f39d7e00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 0x7f39bc069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39e0068170 tx=0x7f39c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.312+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39e01f5c30 con 0x7f39c4003a10 2024-04-25T10:12:43.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.472+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39e015d2e0 con 0x7f39bc066f60 2024-04-25T10:12:43.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.480+0000 7f39d6000640 1 -- 172.21.15.18:0/2656193953 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+243424 (secure 0 0 0) 0x7f39e015d2e0 con 0x7f39bc066f60 2024-04-25T10:12:43.492 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:43.494 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:12:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 msgr2=0x7f39bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 0x7f39bc069420 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f39e0068170 tx=0x7f39c8008040 comp rx=0 tx=0).stop 2024-04-25T10:12:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 msgr2=0x7f39e01f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f39d001c610 tx=0x7f39c4005840 comp rx=0 tx=0).stop 2024-04-25T10:12:43.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 shutdown_connections 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39e0153cc0 0x7f39e0154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f39bc066f60 0x7f39bc069420 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f39e014f970 0x7f39e0152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 --2- 172.21.15.18:0/2656193953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39c4003a10 0x7f39e01f56f0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 >> 172.21.15.18:0/2656193953 conn(0x7f39e00b2400 msgr2=0x7f39e006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 shutdown_connections 2024-04-25T10:12:43.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.484+0000 7f39e4c00640 1 -- 172.21.15.18:0/2656193953 wait complete. 2024-04-25T10:12:43.513 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-25T10:12:41.532011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":122,"acting":122,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260688,"kb_used_data":11224,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714032,"statfs":{"total":773094113280,"available":772827168768,"internally_reserved":0,"allocated":11493376,"data_stored":5951076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.163129"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.386724+0000","last_change":"2024-04-25T10:12:38.386724+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.386724+0000","last_undegraded":"2024-04-25T10:12:38.386724+0000","last_fullsized":"2024-04-25T10:12:38.386724+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.382114+0000","last_change":"2024-04-25T10:12:38.382114+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.382114+0000","last_undegraded":"2024-04-25T10:12:38.382114+0000","last_fullsized":"2024-04-25T10:12:38.382114+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.386531+0000","last_change":"2024-04-25T10:12:38.386531+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.386531+0000","last_undegraded":"2024-04-25T10:12:38.386531+0000","last_fullsized":"2024-04-25T10:12:38.386531+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.384653+0000","last_change":"2024-04-25T10:12:38.384653+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.384653+0000","last_undegraded":"2024-04-25T10:12:38.384653+0000","last_fullsized":"2024-04-25T10:12:38.384653+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.389527+0000","last_change":"2024-04-25T10:12:38.389527+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.389527+0000","last_undegraded":"2024-04-25T10:12:38.389527+0000","last_fullsized":"2024-04-25T10:12:38.389527+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.383384+0000","last_change":"2024-04-25T10:12:38.383384+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.383384+0000","last_undegraded":"2024-04-25T10:12:38.383384+0000","last_fullsized":"2024-04-25T10:12:38.383384+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.388924+0000","last_change":"2024-04-25T10:12:38.388924+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.388924+0000","last_undegraded":"2024-04-25T10:12:38.388924+0000","last_fullsized":"2024-04-25T10:12:38.388924+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.388030+0000","last_change":"2024-04-25T10:12:38.388030+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.388030+0000","last_undegraded":"2024-04-25T10:12:38.388030+0000","last_fullsized":"2024-04-25T10:12:38.388030+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.387663+0000","last_change":"2024-04-25T10:12:38.387663+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.387663+0000","last_undegraded":"2024-04-25T10:12:38.387663+0000","last_fullsized":"2024-04-25T10:12:38.387663+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.384715+0000","last_change":"2024-04-25T10:12:38.384715+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.384715+0000","last_undegraded":"2024-04-25T10:12:38.384715+0000","last_fullsized":"2024-04-25T10:12:38.384715+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.382945+0000","last_change":"2024-04-25T10:12:38.382945+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.382945+0000","last_undegraded":"2024-04-25T10:12:38.382945+0000","last_fullsized":"2024-04-25T10:12:38.382945+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.383254+0000","last_change":"2024-04-25T10:12:38.383254+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.383254+0000","last_undegraded":"2024-04-25T10:12:38.383254+0000","last_fullsized":"2024-04-25T10:12:38.383254+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.384748+0000","last_change":"2024-04-25T10:12:38.384748+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.384748+0000","last_undegraded":"2024-04-25T10:12:38.384748+0000","last_fullsized":"2024-04-25T10:12:38.384748+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.389097+0000","last_change":"2024-04-25T10:12:38.389097+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.389097+0000","last_undegraded":"2024-04-25T10:12:38.389097+0000","last_fullsized":"2024-04-25T10:12:38.389097+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.382816+0000","last_change":"2024-04-25T10:12:38.382816+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.382816+0000","last_undegraded":"2024-04-25T10:12:38.382816+0000","last_fullsized":"2024-04-25T10:12:38.382816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.382432+0000","last_change":"2024-04-25T10:12:38.382432+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.382432+0000","last_undegraded":"2024-04-25T10:12:38.382432+0000","last_fullsized":"2024-04-25T10:12:38.382432+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.385233+0000","last_change":"2024-04-25T10:12:38.385233+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.385233+0000","last_undegraded":"2024-04-25T10:12:38.385233+0000","last_fullsized":"2024-04-25T10:12:38.385233+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.375616+0000","last_change":"2024-04-25T10:12:37.375616+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.375616+0000","last_undegraded":"2024-04-25T10:12:37.375616+0000","last_fullsized":"2024-04-25T10:12:37.375616+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380193+0000","last_change":"2024-04-25T10:12:37.380193+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380193+0000","last_undegraded":"2024-04-25T10:12:37.380193+0000","last_fullsized":"2024-04-25T10:12:37.380193+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.381940+0000","last_change":"2024-04-25T10:12:38.381940+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.381940+0000","last_undegraded":"2024-04-25T10:12:38.381940+0000","last_fullsized":"2024-04-25T10:12:38.381940+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.403537+0000","last_change":"2024-04-25T10:12:38.399847+0000","last_active":"2024-04-25T10:12:38.403537+0000","last_peered":"2024-04-25T10:12:38.403537+0000","last_clean":"2024-04-25T10:12:38.403537+0000","last_became_active":"2024-04-25T10:12:38.399544+0000","last_became_peered":"2024-04-25T10:12:38.399544+0000","last_unstale":"2024-04-25T10:12:38.403537+0000","last_undegraded":"2024-04-25T10:12:38.403537+0000","last_fullsized":"2024-04-25T10:12:38.403537+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:52.854531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.388525+0000","last_change":"2024-04-25T10:12:38.388525+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.388525+0000","last_undegraded":"2024-04-25T10:12:38.388525+0000","last_fullsized":"2024-04-25T10:12:38.388525+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.377965+0000","last_change":"2024-04-25T10:12:37.377965+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.377965+0000","last_undegraded":"2024-04-25T10:12:37.377965+0000","last_fullsized":"2024-04-25T10:12:37.377965+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.404932+0000","last_change":"2024-04-25T10:12:38.400961+0000","last_active":"2024-04-25T10:12:38.404932+0000","last_peered":"2024-04-25T10:12:38.404932+0000","last_clean":"2024-04-25T10:12:38.404932+0000","last_became_active":"2024-04-25T10:12:38.400549+0000","last_became_peered":"2024-04-25T10:12:38.400549+0000","last_unstale":"2024-04-25T10:12:38.404932+0000","last_undegraded":"2024-04-25T10:12:38.404932+0000","last_fullsized":"2024-04-25T10:12:38.404932+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:41.408548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.406294+0000","last_change":"2024-04-25T10:12:38.403485+0000","last_active":"2024-04-25T10:12:38.406294+0000","last_peered":"2024-04-25T10:12:38.406294+0000","last_clean":"2024-04-25T10:12:38.406294+0000","last_became_active":"2024-04-25T10:12:38.402700+0000","last_became_peered":"2024-04-25T10:12:38.402700+0000","last_unstale":"2024-04-25T10:12:38.406294+0000","last_undegraded":"2024-04-25T10:12:38.406294+0000","last_fullsized":"2024-04-25T10:12:38.406294+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.922958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.384290+0000","last_change":"2024-04-25T10:12:38.384290+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.384290+0000","last_undegraded":"2024-04-25T10:12:38.384290+0000","last_fullsized":"2024-04-25T10:12:38.384290+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.403653+0000","last_change":"2024-04-25T10:12:38.400034+0000","last_active":"2024-04-25T10:12:38.403653+0000","last_peered":"2024-04-25T10:12:38.403653+0000","last_clean":"2024-04-25T10:12:38.403653+0000","last_became_active":"2024-04-25T10:12:38.399664+0000","last_became_peered":"2024-04-25T10:12:38.399664+0000","last_unstale":"2024-04-25T10:12:38.403653+0000","last_undegraded":"2024-04-25T10:12:38.403653+0000","last_fullsized":"2024-04-25T10:12:38.403653+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:54.922958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.375650+0000","last_change":"2024-04-25T10:12:37.375650+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.375650+0000","last_undegraded":"2024-04-25T10:12:37.375650+0000","last_fullsized":"2024-04-25T10:12:37.375650+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.402194+0000","last_change":"2024-04-25T10:12:38.397995+0000","last_active":"2024-04-25T10:12:38.402194+0000","last_peered":"2024-04-25T10:12:38.402194+0000","last_clean":"2024-04-25T10:12:38.402194+0000","last_became_active":"2024-04-25T10:12:38.397710+0000","last_became_peered":"2024-04-25T10:12:38.397710+0000","last_unstale":"2024-04-25T10:12:38.402194+0000","last_undegraded":"2024-04-25T10:12:38.402194+0000","last_fullsized":"2024-04-25T10:12:38.402194+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:49.288490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.369712+0000","last_change":"2024-04-25T10:12:37.369712+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.369712+0000","last_undegraded":"2024-04-25T10:12:37.369712+0000","last_fullsized":"2024-04-25T10:12:37.369712+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.405150+0000","last_change":"2024-04-25T10:12:38.400070+0000","last_active":"2024-04-25T10:12:38.405150+0000","last_peered":"2024-04-25T10:12:38.405150+0000","last_clean":"2024-04-25T10:12:38.405150+0000","last_became_active":"2024-04-25T10:12:38.398594+0000","last_became_peered":"2024-04-25T10:12:38.398594+0000","last_unstale":"2024-04-25T10:12:38.405150+0000","last_undegraded":"2024-04-25T10:12:38.405150+0000","last_fullsized":"2024-04-25T10:12:38.405150+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:32.374122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.400244+0000","last_change":"2024-04-25T10:12:38.396480+0000","last_active":"2024-04-25T10:12:38.400244+0000","last_peered":"2024-04-25T10:12:38.400244+0000","last_clean":"2024-04-25T10:12:38.400244+0000","last_became_active":"2024-04-25T10:12:38.396223+0000","last_became_peered":"2024-04-25T10:12:38.396223+0000","last_unstale":"2024-04-25T10:12:38.400244+0000","last_undegraded":"2024-04-25T10:12:38.400244+0000","last_fullsized":"2024-04-25T10:12:38.400244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:28.835286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.390899+0000","last_change":"2024-04-25T10:12:38.390899+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.390899+0000","last_undegraded":"2024-04-25T10:12:38.390899+0000","last_fullsized":"2024-04-25T10:12:38.390899+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.377490+0000","last_change":"2024-04-25T10:12:37.377490+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.377490+0000","last_undegraded":"2024-04-25T10:12:37.377490+0000","last_fullsized":"2024-04-25T10:12:37.377490+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.383685+0000","last_change":"2024-04-25T10:12:38.383685+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.383685+0000","last_undegraded":"2024-04-25T10:12:38.383685+0000","last_fullsized":"2024-04-25T10:12:38.383685+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.375576+0000","last_change":"2024-04-25T10:12:37.375576+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.375576+0000","last_undegraded":"2024-04-25T10:12:37.375576+0000","last_fullsized":"2024-04-25T10:12:37.375576+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380075+0000","last_change":"2024-04-25T10:12:37.380075+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380075+0000","last_undegraded":"2024-04-25T10:12:37.380075+0000","last_fullsized":"2024-04-25T10:12:37.380075+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.402099+0000","last_change":"2024-04-25T10:12:38.397450+0000","last_active":"2024-04-25T10:12:38.402099+0000","last_peered":"2024-04-25T10:12:38.402099+0000","last_clean":"2024-04-25T10:12:38.402099+0000","last_became_active":"2024-04-25T10:12:38.397157+0000","last_became_peered":"2024-04-25T10:12:38.397157+0000","last_unstale":"2024-04-25T10:12:38.402099+0000","last_undegraded":"2024-04-25T10:12:38.402099+0000","last_fullsized":"2024-04-25T10:12:38.402099+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:10.607775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.400283+0000","last_change":"2024-04-25T10:12:38.397162+0000","last_active":"2024-04-25T10:12:38.400283+0000","last_peered":"2024-04-25T10:12:38.400283+0000","last_clean":"2024-04-25T10:12:38.400283+0000","last_became_active":"2024-04-25T10:12:38.394029+0000","last_became_peered":"2024-04-25T10:12:38.394029+0000","last_unstale":"2024-04-25T10:12:38.400283+0000","last_undegraded":"2024-04-25T10:12:38.400283+0000","last_fullsized":"2024-04-25T10:12:38.400283+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:35.882999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.381578+0000","last_change":"2024-04-25T10:12:38.381578+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.381578+0000","last_undegraded":"2024-04-25T10:12:38.381578+0000","last_fullsized":"2024-04-25T10:12:38.381578+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.406245+0000","last_change":"2024-04-25T10:12:38.403808+0000","last_active":"2024-04-25T10:12:38.406245+0000","last_peered":"2024-04-25T10:12:38.406245+0000","last_clean":"2024-04-25T10:12:38.406245+0000","last_became_active":"2024-04-25T10:12:38.403459+0000","last_became_peered":"2024-04-25T10:12:38.403459+0000","last_unstale":"2024-04-25T10:12:38.406245+0000","last_undegraded":"2024-04-25T10:12:38.406245+0000","last_fullsized":"2024-04-25T10:12:38.406245+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:10.653542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.403375+0000","last_change":"2024-04-25T10:12:38.400543+0000","last_active":"2024-04-25T10:12:38.403375+0000","last_peered":"2024-04-25T10:12:38.403375+0000","last_clean":"2024-04-25T10:12:38.403375+0000","last_became_active":"2024-04-25T10:12:38.400272+0000","last_became_peered":"2024-04-25T10:12:38.400272+0000","last_unstale":"2024-04-25T10:12:38.403375+0000","last_undegraded":"2024-04-25T10:12:38.403375+0000","last_fullsized":"2024-04-25T10:12:38.403375+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:49.288490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380112+0000","last_change":"2024-04-25T10:12:37.380112+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380112+0000","last_undegraded":"2024-04-25T10:12:37.380112+0000","last_fullsized":"2024-04-25T10:12:37.380112+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380529+0000","last_change":"2024-04-25T10:12:37.380529+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380529+0000","last_undegraded":"2024-04-25T10:12:37.380529+0000","last_fullsized":"2024-04-25T10:12:37.380529+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.404401+0000","last_change":"2024-04-25T10:12:38.399540+0000","last_active":"2024-04-25T10:12:38.404401+0000","last_peered":"2024-04-25T10:12:38.404401+0000","last_clean":"2024-04-25T10:12:38.404401+0000","last_became_active":"2024-04-25T10:12:38.398365+0000","last_became_peered":"2024-04-25T10:12:38.398365+0000","last_unstale":"2024-04-25T10:12:38.404401+0000","last_undegraded":"2024-04-25T10:12:38.404401+0000","last_fullsized":"2024-04-25T10:12:38.404401+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:35.227553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380827+0000","last_change":"2024-04-25T10:12:37.380827+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380827+0000","last_undegraded":"2024-04-25T10:12:37.380827+0000","last_fullsized":"2024-04-25T10:12:37.380827+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.377494+0000","last_change":"2024-04-25T10:12:37.377494+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.377494+0000","last_undegraded":"2024-04-25T10:12:37.377494+0000","last_fullsized":"2024-04-25T10:12:37.377494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.381984+0000","last_change":"2024-04-25T10:12:38.381984+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.381984+0000","last_undegraded":"2024-04-25T10:12:38.381984+0000","last_fullsized":"2024-04-25T10:12:38.381984+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.368570+0000","last_change":"2024-04-25T10:12:37.368570+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.368570+0000","last_undegraded":"2024-04-25T10:12:37.368570+0000","last_fullsized":"2024-04-25T10:12:37.368570+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.402051+0000","last_change":"2024-04-25T10:12:38.397163+0000","last_active":"2024-04-25T10:12:38.402051+0000","last_peered":"2024-04-25T10:12:38.402051+0000","last_clean":"2024-04-25T10:12:38.402051+0000","last_became_active":"2024-04-25T10:12:38.396864+0000","last_became_peered":"2024-04-25T10:12:38.396864+0000","last_unstale":"2024-04-25T10:12:38.402051+0000","last_undegraded":"2024-04-25T10:12:38.402051+0000","last_fullsized":"2024-04-25T10:12:38.402051+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:49.504570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.389023+0000","last_change":"2024-04-25T10:12:38.389023+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.389023+0000","last_undegraded":"2024-04-25T10:12:38.389023+0000","last_fullsized":"2024-04-25T10:12:38.389023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.377461+0000","last_change":"2024-04-25T10:12:37.377461+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.377461+0000","last_undegraded":"2024-04-25T10:12:37.377461+0000","last_fullsized":"2024-04-25T10:12:37.377461+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.400835+0000","last_change":"2024-04-25T10:12:38.395801+0000","last_active":"2024-04-25T10:12:38.400835+0000","last_peered":"2024-04-25T10:12:38.400835+0000","last_clean":"2024-04-25T10:12:38.400835+0000","last_became_active":"2024-04-25T10:12:38.395520+0000","last_became_peered":"2024-04-25T10:12:38.395520+0000","last_unstale":"2024-04-25T10:12:38.400835+0000","last_undegraded":"2024-04-25T10:12:38.400835+0000","last_fullsized":"2024-04-25T10:12:38.400835+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:20.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T10:12:38.366220+0000","last_change":"2024-04-25T10:12:38.366220+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.366220+0000","last_undegraded":"2024-04-25T10:12:38.366220+0000","last_fullsized":"2024-04-25T10:12:38.366220+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380077+0000","last_change":"2024-04-25T10:12:37.380077+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380077+0000","last_undegraded":"2024-04-25T10:12:37.380077+0000","last_fullsized":"2024-04-25T10:12:37.380077+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.388006+0000","last_change":"2024-04-25T10:12:38.388006+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.388006+0000","last_undegraded":"2024-04-25T10:12:38.388006+0000","last_fullsized":"2024-04-25T10:12:38.388006+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.399682+0000","last_change":"2024-04-25T10:12:38.394921+0000","last_active":"2024-04-25T10:12:38.399682+0000","last_peered":"2024-04-25T10:12:38.399682+0000","last_clean":"2024-04-25T10:12:38.399682+0000","last_became_active":"2024-04-25T10:12:38.394633+0000","last_became_peered":"2024-04-25T10:12:38.394633+0000","last_unstale":"2024-04-25T10:12:38.399682+0000","last_undegraded":"2024-04-25T10:12:38.399682+0000","last_fullsized":"2024-04-25T10:12:38.399682+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:22:37.569643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.389213+0000","last_change":"2024-04-25T10:12:38.389213+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.389213+0000","last_undegraded":"2024-04-25T10:12:38.389213+0000","last_fullsized":"2024-04-25T10:12:38.389213+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380025+0000","last_change":"2024-04-25T10:12:37.380025+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380025+0000","last_undegraded":"2024-04-25T10:12:37.380025+0000","last_fullsized":"2024-04-25T10:12:37.380025+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":106,"state":"creating+peering","last_fresh":"2024-04-25T10:12:38.388171+0000","last_change":"2024-04-25T10:12:38.388171+0000","last_active":"2024-04-25T10:12:38.366220+0000","last_peered":"2024-04-25T10:12:38.366220+0000","last_clean":"2024-04-25T10:12:38.366220+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:38.388171+0000","last_undegraded":"2024-04-25T10:12:38.388171+0000","last_fullsized":"2024-04-25T10:12:38.388171+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":105,"state":"creating+peering","last_fresh":"2024-04-25T10:12:37.380604+0000","last_change":"2024-04-25T10:12:37.380604+0000","last_active":"2024-04-25T10:12:37.363297+0000","last_peered":"2024-04-25T10:12:37.363297+0000","last_clean":"2024-04-25T10:12:37.363297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:12:37.380604+0000","last_undegraded":"2024-04-25T10:12:37.380604+0000","last_fullsized":"2024-04-25T10:12:37.380604+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":328,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T10:12:38.390464+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:12:38.390464+0000","last_peered":"2024-04-25T10:12:38.390464+0000","last_clean":"2024-04-25T10:12:38.390464+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:12:38.390464+0000","last_undegraded":"2024-04-25T10:12:38.390464+0000","last_fullsized":"2024-04-25T10:12:38.390464+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":4},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509551,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33024,"kb_used_data":1844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338816,"statfs":{"total":96636764160,"available":96602947584,"internally_reserved":0,"allocated":1888256,"data_stored":1189765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509552,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":599397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509550,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1294336,"data_stored":599397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509549,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1294336,"data_stored":599397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542255,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":593188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542253,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":593188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542255,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":593188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542253,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1875968,"data_stored":1183556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:12:43.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:12:43.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.684+0000 7fe250c00640 1 Processor -- start 2024-04-25T10:12:43.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.684+0000 7fe250c00640 1 -- start start 2024-04-25T10:12:43.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe250c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe24c06edc0 0x7fe24c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe250c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c06d6f0 con 0x7fe24c071690 2024-04-25T10:12:43.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe250c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c06d9d0 con 0x7fe24c0b22d0 2024-04-25T10:12:43.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe250c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c06dcb0 con 0x7fe24c06edc0 2024-04-25T10:12:43.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe24c071690 0x7fe24c071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43244/0 (socket says 172.21.15.18:43244) 2024-04-25T10:12:43.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249e00640 1 -- 172.21.15.18:0/886039715 learned_addr learned my addr 172.21.15.18:0/886039715 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe24a800640 1 --2- 172.21.15.18:0/886039715 >> v2:172.21.15.167:3300/0 conn(0x7fe24c06edc0 0x7fe24c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199966529 0 0) 0x7fe24c06d6f0 con 0x7fe24c071690 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe230003530 con 0x7fe24c071690 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578215601 0 0) 0x7fe24c06d9d0 con 0x7fe24c0b22d0 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe24c06d6f0 con 0x7fe24c0b22d0 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3885026462 0 0) 0x7fe230003530 con 0x7fe24c071690 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 >> v2:172.21.15.167:3300/0 conn(0x7fe24c06edc0 msgr2=0x7fe24c06e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 --2- 172.21.15.18:0/886039715 >> v2:172.21.15.167:3300/0 conn(0x7fe24c06edc0 0x7fe24c06e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 >> v1:172.21.15.167:6789/0 conn(0x7fe24c0b22d0 legacy=0x7fe24c0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c06df90 con 0x7fe24c071690 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fe23c001a00 con 0x7fe24c071690 2024-04-25T10:12:43.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 >> v1:172.21.15.18:6789/0 conn(0x7fe24c071690 legacy=0x7fe24c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe230003b50 0x7fe230003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 0x7fe230004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2300051d0 0x7fe23000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c06dcb0 con 0x7fe230004810 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000c050 con 0x7fe2300051d0 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000c250 con 0x7fe230003b50 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 0x7fe230004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe24a800640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2300051d0 0x7fe23000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe249e00640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe230003b50 0x7fe230003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 -- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe230003b50 msgr2=0x7fe230003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe230003b50 0x7fe230003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 -- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2300051d0 msgr2=0x7fe23000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2300051d0 0x7fe23000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe241400640 1 -- 172.21.15.18:0/886039715 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230003530 con 0x7fe230004810 2024-04-25T10:12:43.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.688+0000 7fe24a800640 1 -- 172.21.15.18:0/886039715 reap_dead start 2024-04-25T10:12:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe241400640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 0x7fe230004c90 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe2340018d0 tx=0x7fe23401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ff5057a9ea9dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234001520 con 0x7fe230004810 2024-04-25T10:12:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340052f0 con 0x7fe230004810 2024-04-25T10:12:43.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe249400640 1 -- 172.21.15.18:0/886039715 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340a88f0 con 0x7fe230004810 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 -- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 msgr2=0x7fe230004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 0x7fe230004c90 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fe2340018d0 tx=0x7fe23401ec90 comp rx=0 tx=0).stop 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 -- 172.21.15.18:0/886039715 shutdown_connections 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 --2- 172.21.15.18:0/886039715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe230004810 0x7fe230004c90 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 -- 172.21.15.18:0/886039715 >> 172.21.15.18:0/886039715 conn(0x7fe24c0b17b0 msgr2=0x7fe24c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 -- 172.21.15.18:0/886039715 shutdown_connections 2024-04-25T10:12:43.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.692+0000 7fe250c00640 1 -- 172.21.15.18:0/886039715 wait complete. 2024-04-25T10:12:43.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 Processor -- start 2024-04-25T10:12:43.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- start start 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe230004810 0x7fe24c1439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 0x7fe24c152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c072760 con 0x7fe24c153c90 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15de10 con 0x7fe230004810 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0728e0 con 0x7fe24c151dc0 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33798/0 (socket says 172.21.15.18:33798) 2024-04-25T10:12:43.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 -- 172.21.15.18:0/1758702722 learned_addr learned my addr 172.21.15.18:0/1758702722 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:43.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe249e00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe230004810 0x7fe24c1439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe24a800640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 0x7fe24c152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 -- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 msgr2=0x7fe24c152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 0x7fe24c152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 -- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe230004810 msgr2=0x7fe24c1439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe230004810 0x7fe24c1439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 -- 172.21.15.18:0/1758702722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c154420 con 0x7fe24c153c90 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe24a800640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 0x7fe24c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe241400640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe234005040 tx=0x7fe230005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340be070 con 0x7fe24c153c90 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340054a0 con 0x7fe24c153c90 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234001500 con 0x7fe24c153c90 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c154700 con 0x7fe24c153c90 2024-04-25T10:12:43.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c154cc0 con 0x7fe24c153c90 2024-04-25T10:12:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.696+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c0745d0 con 0x7fe24c153c90 2024-04-25T10:12:43.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.700+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2340c1070 con 0x7fe24c153c90 2024-04-25T10:12:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.700+0000 7fe242a00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 0x7fe228069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.700+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe2341218c0 con 0x7fe24c153c90 2024-04-25T10:12:43.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.700+0000 7fe249e00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 0x7fe228069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:43.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.700+0000 7fe249e00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 0x7fe228069450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000f90 tx=0x7fe23c006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:43.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.704+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2340189a0 con 0x7fe24c153c90 2024-04-25T10:12:43.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.860+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe24c140ec0 con 0x7fe228066f90 2024-04-25T10:12:43.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.868+0000 7fe242a00640 1 -- 172.21.15.18:0/1758702722 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252486 (secure 0 0 0) 0x7fe24c140ec0 con 0x7fe228066f90 2024-04-25T10:12:43.879 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:43.881 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 msgr2=0x7fe228069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 0x7fe228069450 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fe23c000f90 tx=0x7fe23c006040 comp rx=0 tx=0).stop 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 msgr2=0x7fe24c1f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fe234005040 tx=0x7fe230005840 comp rx=0 tx=0).stop 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 shutdown_connections 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe228066f90 0x7fe228069450 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe24c151dc0 0x7fe24c152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe24c153c90 0x7fe24c1f2bd0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 --2- 172.21.15.18:0/1758702722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe230004810 0x7fe24c1439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 >> 172.21.15.18:0/1758702722 conn(0x7fe24c0b17b0 msgr2=0x7fe24c15b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 shutdown_connections 2024-04-25T10:12:43.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:43.872+0000 7fe250c00640 1 -- 172.21.15.18:0/1758702722 wait complete. 2024-04-25T10:12:43.900 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":372,"stamp":"2024-04-25T10:12:43.532565+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261084,"kb_used_data":11624,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713636,"statfs":{"total":773094113280,"available":772826763264,"internally_reserved":0,"allocated":11902976,"data_stored":6144940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001532"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393008+0000","last_change":"2024-04-25T10:12:39.396519+0000","last_active":"2024-04-25T10:12:40.393008+0000","last_peered":"2024-04-25T10:12:40.393008+0000","last_clean":"2024-04-25T10:12:40.393008+0000","last_became_active":"2024-04-25T10:12:39.396229+0000","last_became_peered":"2024-04-25T10:12:39.396229+0000","last_unstale":"2024-04-25T10:12:40.393008+0000","last_undegraded":"2024-04-25T10:12:40.393008+0000","last_fullsized":"2024-04-25T10:12:40.393008+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:53.210908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400809+0000","last_change":"2024-04-25T10:12:39.402624+0000","last_active":"2024-04-25T10:12:40.400809+0000","last_peered":"2024-04-25T10:12:40.400809+0000","last_clean":"2024-04-25T10:12:40.400809+0000","last_became_active":"2024-04-25T10:12:39.400862+0000","last_became_peered":"2024-04-25T10:12:39.400862+0000","last_unstale":"2024-04-25T10:12:40.400809+0000","last_undegraded":"2024-04-25T10:12:40.400809+0000","last_fullsized":"2024-04-25T10:12:40.400809+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:44.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393061+0000","last_change":"2024-04-25T10:12:39.402342+0000","last_active":"2024-04-25T10:12:40.393061+0000","last_peered":"2024-04-25T10:12:40.393061+0000","last_clean":"2024-04-25T10:12:40.393061+0000","last_became_active":"2024-04-25T10:12:39.402054+0000","last_became_peered":"2024-04-25T10:12:39.402054+0000","last_unstale":"2024-04-25T10:12:40.393061+0000","last_undegraded":"2024-04-25T10:12:40.393061+0000","last_fullsized":"2024-04-25T10:12:40.393061+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:04.262182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999450+0000","last_change":"2024-04-25T10:12:39.399050+0000","last_active":"2024-04-25T10:12:40.999450+0000","last_peered":"2024-04-25T10:12:40.999450+0000","last_clean":"2024-04-25T10:12:40.999450+0000","last_became_active":"2024-04-25T10:12:39.397534+0000","last_became_peered":"2024-04-25T10:12:39.397534+0000","last_unstale":"2024-04-25T10:12:40.999450+0000","last_undegraded":"2024-04-25T10:12:40.999450+0000","last_fullsized":"2024-04-25T10:12:40.999450+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:22.686986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998734+0000","last_change":"2024-04-25T10:12:39.404212+0000","last_active":"2024-04-25T10:12:40.998734+0000","last_peered":"2024-04-25T10:12:40.998734+0000","last_clean":"2024-04-25T10:12:40.998734+0000","last_became_active":"2024-04-25T10:12:39.403921+0000","last_became_peered":"2024-04-25T10:12:39.403921+0000","last_unstale":"2024-04-25T10:12:40.998734+0000","last_undegraded":"2024-04-25T10:12:40.998734+0000","last_fullsized":"2024-04-25T10:12:40.998734+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:55.156212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400372+0000","last_change":"2024-04-25T10:12:39.395152+0000","last_active":"2024-04-25T10:12:40.400372+0000","last_peered":"2024-04-25T10:12:40.400372+0000","last_clean":"2024-04-25T10:12:40.400372+0000","last_became_active":"2024-04-25T10:12:39.394896+0000","last_became_peered":"2024-04-25T10:12:39.394896+0000","last_unstale":"2024-04-25T10:12:40.400372+0000","last_undegraded":"2024-04-25T10:12:40.400372+0000","last_fullsized":"2024-04-25T10:12:40.400372+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:38.627488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400133+0000","last_change":"2024-04-25T10:12:39.394508+0000","last_active":"2024-04-25T10:12:40.400133+0000","last_peered":"2024-04-25T10:12:40.400133+0000","last_clean":"2024-04-25T10:12:40.400133+0000","last_became_active":"2024-04-25T10:12:39.394200+0000","last_became_peered":"2024-04-25T10:12:39.394200+0000","last_unstale":"2024-04-25T10:12:40.400133+0000","last_undegraded":"2024-04-25T10:12:40.400133+0000","last_fullsized":"2024-04-25T10:12:40.400133+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:55.156212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497753+0000","last_change":"2024-04-25T10:12:39.408471+0000","last_active":"2024-04-25T10:12:40.497753+0000","last_peered":"2024-04-25T10:12:40.497753+0000","last_clean":"2024-04-25T10:12:40.497753+0000","last_became_active":"2024-04-25T10:12:39.407755+0000","last_became_peered":"2024-04-25T10:12:39.407755+0000","last_unstale":"2024-04-25T10:12:40.497753+0000","last_undegraded":"2024-04-25T10:12:40.497753+0000","last_fullsized":"2024-04-25T10:12:40.497753+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:24:20.612976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.401023+0000","last_change":"2024-04-25T10:12:39.393996+0000","last_active":"2024-04-25T10:12:40.401023+0000","last_peered":"2024-04-25T10:12:40.401023+0000","last_clean":"2024-04-25T10:12:40.401023+0000","last_became_active":"2024-04-25T10:12:39.393677+0000","last_became_peered":"2024-04-25T10:12:39.393677+0000","last_unstale":"2024-04-25T10:12:40.401023+0000","last_undegraded":"2024-04-25T10:12:40.401023+0000","last_fullsized":"2024-04-25T10:12:40.401023+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:10.025032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999051+0000","last_change":"2024-04-25T10:12:39.406607+0000","last_active":"2024-04-25T10:12:40.999051+0000","last_peered":"2024-04-25T10:12:40.999051+0000","last_clean":"2024-04-25T10:12:40.999051+0000","last_became_active":"2024-04-25T10:12:39.406344+0000","last_became_peered":"2024-04-25T10:12:39.406344+0000","last_unstale":"2024-04-25T10:12:40.999051+0000","last_undegraded":"2024-04-25T10:12:40.999051+0000","last_fullsized":"2024-04-25T10:12:40.999051+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:16.269752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002520+0000","last_change":"2024-04-25T10:12:39.415978+0000","last_active":"2024-04-25T10:12:41.002520+0000","last_peered":"2024-04-25T10:12:41.002520+0000","last_clean":"2024-04-25T10:12:41.002520+0000","last_became_active":"2024-04-25T10:12:39.414191+0000","last_became_peered":"2024-04-25T10:12:39.414191+0000","last_unstale":"2024-04-25T10:12:41.002520+0000","last_undegraded":"2024-04-25T10:12:41.002520+0000","last_fullsized":"2024-04-25T10:12:41.002520+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:04.860431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399615+0000","last_change":"2024-04-25T10:12:39.394512+0000","last_active":"2024-04-25T10:12:40.399615+0000","last_peered":"2024-04-25T10:12:40.399615+0000","last_clean":"2024-04-25T10:12:40.399615+0000","last_became_active":"2024-04-25T10:12:39.394197+0000","last_became_peered":"2024-04-25T10:12:39.394197+0000","last_unstale":"2024-04-25T10:12:40.399615+0000","last_undegraded":"2024-04-25T10:12:40.399615+0000","last_fullsized":"2024-04-25T10:12:40.399615+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:10.025032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999306+0000","last_change":"2024-04-25T10:12:39.407399+0000","last_active":"2024-04-25T10:12:40.999306+0000","last_peered":"2024-04-25T10:12:40.999306+0000","last_clean":"2024-04-25T10:12:40.999306+0000","last_became_active":"2024-04-25T10:12:39.407138+0000","last_became_peered":"2024-04-25T10:12:39.407138+0000","last_unstale":"2024-04-25T10:12:40.999306+0000","last_undegraded":"2024-04-25T10:12:40.999306+0000","last_fullsized":"2024-04-25T10:12:40.999306+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.756346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001572+0000","last_change":"2024-04-25T10:12:39.406383+0000","last_active":"2024-04-25T10:12:41.001572+0000","last_peered":"2024-04-25T10:12:41.001572+0000","last_clean":"2024-04-25T10:12:41.001572+0000","last_became_active":"2024-04-25T10:12:39.406081+0000","last_became_peered":"2024-04-25T10:12:39.406081+0000","last_unstale":"2024-04-25T10:12:41.001572+0000","last_undegraded":"2024-04-25T10:12:41.001572+0000","last_fullsized":"2024-04-25T10:12:41.001572+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:04.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001575+0000","last_change":"2024-04-25T10:12:39.406444+0000","last_active":"2024-04-25T10:12:41.001575+0000","last_peered":"2024-04-25T10:12:41.001575+0000","last_clean":"2024-04-25T10:12:41.001575+0000","last_became_active":"2024-04-25T10:12:39.406104+0000","last_became_peered":"2024-04-25T10:12:39.406104+0000","last_unstale":"2024-04-25T10:12:41.001575+0000","last_undegraded":"2024-04-25T10:12:41.001575+0000","last_fullsized":"2024-04-25T10:12:41.001575+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:24.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001661+0000","last_change":"2024-04-25T10:12:39.412037+0000","last_active":"2024-04-25T10:12:41.001661+0000","last_peered":"2024-04-25T10:12:41.001661+0000","last_clean":"2024-04-25T10:12:41.001661+0000","last_became_active":"2024-04-25T10:12:39.411738+0000","last_became_peered":"2024-04-25T10:12:39.411738+0000","last_unstale":"2024-04-25T10:12:41.001661+0000","last_undegraded":"2024-04-25T10:12:41.001661+0000","last_fullsized":"2024-04-25T10:12:41.001661+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:10.025032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393048+0000","last_change":"2024-04-25T10:12:39.413733+0000","last_active":"2024-04-25T10:12:40.393048+0000","last_peered":"2024-04-25T10:12:40.393048+0000","last_clean":"2024-04-25T10:12:40.393048+0000","last_became_active":"2024-04-25T10:12:39.412944+0000","last_became_peered":"2024-04-25T10:12:39.412944+0000","last_unstale":"2024-04-25T10:12:40.393048+0000","last_undegraded":"2024-04-25T10:12:40.393048+0000","last_fullsized":"2024-04-25T10:12:40.393048+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:18.366622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400953+0000","last_change":"2024-04-25T10:12:39.395998+0000","last_active":"2024-04-25T10:12:40.400953+0000","last_peered":"2024-04-25T10:12:40.400953+0000","last_clean":"2024-04-25T10:12:40.400953+0000","last_became_active":"2024-04-25T10:12:39.395709+0000","last_became_peered":"2024-04-25T10:12:39.395709+0000","last_unstale":"2024-04-25T10:12:40.400953+0000","last_undegraded":"2024-04-25T10:12:40.400953+0000","last_fullsized":"2024-04-25T10:12:40.400953+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:04.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393237+0000","last_change":"2024-04-25T10:12:39.408884+0000","last_active":"2024-04-25T10:12:40.393237+0000","last_peered":"2024-04-25T10:12:40.393237+0000","last_clean":"2024-04-25T10:12:40.393237+0000","last_became_active":"2024-04-25T10:12:39.408148+0000","last_became_peered":"2024-04-25T10:12:39.408148+0000","last_unstale":"2024-04-25T10:12:40.393237+0000","last_undegraded":"2024-04-25T10:12:40.393237+0000","last_fullsized":"2024-04-25T10:12:40.393237+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:38:38.417114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399698+0000","last_change":"2024-04-25T10:12:39.399346+0000","last_active":"2024-04-25T10:12:40.399698+0000","last_peered":"2024-04-25T10:12:40.399698+0000","last_clean":"2024-04-25T10:12:40.399698+0000","last_became_active":"2024-04-25T10:12:39.399065+0000","last_became_peered":"2024-04-25T10:12:39.399065+0000","last_unstale":"2024-04-25T10:12:40.399698+0000","last_undegraded":"2024-04-25T10:12:40.399698+0000","last_fullsized":"2024-04-25T10:12:40.399698+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:16.302525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497885+0000","last_change":"2024-04-25T10:12:39.409838+0000","last_active":"2024-04-25T10:12:40.497885+0000","last_peered":"2024-04-25T10:12:40.497885+0000","last_clean":"2024-04-25T10:12:40.497885+0000","last_became_active":"2024-04-25T10:12:39.409287+0000","last_became_peered":"2024-04-25T10:12:39.409287+0000","last_unstale":"2024-04-25T10:12:40.497885+0000","last_undegraded":"2024-04-25T10:12:40.497885+0000","last_fullsized":"2024-04-25T10:12:40.497885+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:14.702030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999068+0000","last_change":"2024-04-25T10:12:39.401690+0000","last_active":"2024-04-25T10:12:40.999068+0000","last_peered":"2024-04-25T10:12:40.999068+0000","last_clean":"2024-04-25T10:12:40.999068+0000","last_became_active":"2024-04-25T10:12:39.401445+0000","last_became_peered":"2024-04-25T10:12:39.401445+0000","last_unstale":"2024-04-25T10:12:40.999068+0000","last_undegraded":"2024-04-25T10:12:40.999068+0000","last_fullsized":"2024-04-25T10:12:40.999068+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:44.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392893+0000","last_change":"2024-04-25T10:12:39.398290+0000","last_active":"2024-04-25T10:12:40.392893+0000","last_peered":"2024-04-25T10:12:40.392893+0000","last_clean":"2024-04-25T10:12:40.392893+0000","last_became_active":"2024-04-25T10:12:39.397985+0000","last_became_peered":"2024-04-25T10:12:39.397985+0000","last_unstale":"2024-04-25T10:12:40.392893+0000","last_undegraded":"2024-04-25T10:12:40.392893+0000","last_fullsized":"2024-04-25T10:12:40.392893+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:34.083707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998730+0000","last_change":"2024-04-25T10:12:39.395002+0000","last_active":"2024-04-25T10:12:40.998730+0000","last_peered":"2024-04-25T10:12:40.998730+0000","last_clean":"2024-04-25T10:12:40.998730+0000","last_became_active":"2024-04-25T10:12:39.390536+0000","last_became_peered":"2024-04-25T10:12:39.390536+0000","last_unstale":"2024-04-25T10:12:40.998730+0000","last_undegraded":"2024-04-25T10:12:40.998730+0000","last_fullsized":"2024-04-25T10:12:40.998730+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:55.982381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399642+0000","last_change":"2024-04-25T10:12:39.414364+0000","last_active":"2024-04-25T10:12:40.399642+0000","last_peered":"2024-04-25T10:12:40.399642+0000","last_clean":"2024-04-25T10:12:40.399642+0000","last_became_active":"2024-04-25T10:12:39.414086+0000","last_became_peered":"2024-04-25T10:12:39.414086+0000","last_unstale":"2024-04-25T10:12:40.399642+0000","last_undegraded":"2024-04-25T10:12:40.399642+0000","last_fullsized":"2024-04-25T10:12:40.399642+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.206169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399846+0000","last_change":"2024-04-25T10:12:39.405085+0000","last_active":"2024-04-25T10:12:40.399846+0000","last_peered":"2024-04-25T10:12:40.399846+0000","last_clean":"2024-04-25T10:12:40.399846+0000","last_became_active":"2024-04-25T10:12:39.404808+0000","last_became_peered":"2024-04-25T10:12:39.404808+0000","last_unstale":"2024-04-25T10:12:40.399846+0000","last_undegraded":"2024-04-25T10:12:40.399846+0000","last_fullsized":"2024-04-25T10:12:40.399846+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:08.544714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002343+0000","last_change":"2024-04-25T10:12:39.410962+0000","last_active":"2024-04-25T10:12:41.002343+0000","last_peered":"2024-04-25T10:12:41.002343+0000","last_clean":"2024-04-25T10:12:41.002343+0000","last_became_active":"2024-04-25T10:12:39.408658+0000","last_became_peered":"2024-04-25T10:12:39.408658+0000","last_unstale":"2024-04-25T10:12:41.002343+0000","last_undegraded":"2024-04-25T10:12:41.002343+0000","last_fullsized":"2024-04-25T10:12:41.002343+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:16.269752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400647+0000","last_change":"2024-04-25T10:12:39.406384+0000","last_active":"2024-04-25T10:12:40.400647+0000","last_peered":"2024-04-25T10:12:40.400647+0000","last_clean":"2024-04-25T10:12:40.400647+0000","last_became_active":"2024-04-25T10:12:39.405620+0000","last_became_peered":"2024-04-25T10:12:39.405620+0000","last_unstale":"2024-04-25T10:12:40.400647+0000","last_undegraded":"2024-04-25T10:12:40.400647+0000","last_fullsized":"2024-04-25T10:12:40.400647+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:47:16.269752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497920+0000","last_change":"2024-04-25T10:12:39.409584+0000","last_active":"2024-04-25T10:12:40.497920+0000","last_peered":"2024-04-25T10:12:40.497920+0000","last_clean":"2024-04-25T10:12:40.497920+0000","last_became_active":"2024-04-25T10:12:39.408948+0000","last_became_peered":"2024-04-25T10:12:39.408948+0000","last_unstale":"2024-04-25T10:12:40.497920+0000","last_undegraded":"2024-04-25T10:12:40.497920+0000","last_fullsized":"2024-04-25T10:12:40.497920+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:34.457911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399290+0000","last_change":"2024-04-25T10:12:39.408076+0000","last_active":"2024-04-25T10:12:40.399290+0000","last_peered":"2024-04-25T10:12:40.399290+0000","last_clean":"2024-04-25T10:12:40.399290+0000","last_became_active":"2024-04-25T10:12:39.407764+0000","last_became_peered":"2024-04-25T10:12:39.407764+0000","last_unstale":"2024-04-25T10:12:40.399290+0000","last_undegraded":"2024-04-25T10:12:40.399290+0000","last_fullsized":"2024-04-25T10:12:40.399290+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:04.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400326+0000","last_change":"2024-04-25T10:12:39.391988+0000","last_active":"2024-04-25T10:12:40.400326+0000","last_peered":"2024-04-25T10:12:40.400326+0000","last_clean":"2024-04-25T10:12:40.400326+0000","last_became_active":"2024-04-25T10:12:39.391253+0000","last_became_peered":"2024-04-25T10:12:39.391253+0000","last_unstale":"2024-04-25T10:12:40.400326+0000","last_undegraded":"2024-04-25T10:12:40.400326+0000","last_fullsized":"2024-04-25T10:12:40.400326+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:55.982381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497841+0000","last_change":"2024-04-25T10:12:39.408148+0000","last_active":"2024-04-25T10:12:40.497841+0000","last_peered":"2024-04-25T10:12:40.497841+0000","last_clean":"2024-04-25T10:12:40.497841+0000","last_became_active":"2024-04-25T10:12:39.407313+0000","last_became_peered":"2024-04-25T10:12:39.407313+0000","last_unstale":"2024-04-25T10:12:40.497841+0000","last_undegraded":"2024-04-25T10:12:40.497841+0000","last_fullsized":"2024-04-25T10:12:40.497841+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:21:19.725672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392804+0000","last_change":"2024-04-25T10:12:39.409991+0000","last_active":"2024-04-25T10:12:40.392804+0000","last_peered":"2024-04-25T10:12:40.392804+0000","last_clean":"2024-04-25T10:12:40.392804+0000","last_became_active":"2024-04-25T10:12:39.407952+0000","last_became_peered":"2024-04-25T10:12:39.407952+0000","last_unstale":"2024-04-25T10:12:40.392804+0000","last_undegraded":"2024-04-25T10:12:40.392804+0000","last_fullsized":"2024-04-25T10:12:40.392804+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:26.370959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"107'4","reported_seq":18,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999617+0000","last_change":"2024-04-25T10:12:38.397399+0000","last_active":"2024-04-25T10:12:40.999617+0000","last_peered":"2024-04-25T10:12:40.999617+0000","last_clean":"2024-04-25T10:12:40.999617+0000","last_became_active":"2024-04-25T10:12:38.397168+0000","last_became_peered":"2024-04-25T10:12:38.397168+0000","last_unstale":"2024-04-25T10:12:40.999617+0000","last_undegraded":"2024-04-25T10:12:40.999617+0000","last_fullsized":"2024-04-25T10:12:40.999617+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:32.587292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497775+0000","last_change":"2024-04-25T10:12:39.409319+0000","last_active":"2024-04-25T10:12:40.497775+0000","last_peered":"2024-04-25T10:12:40.497775+0000","last_clean":"2024-04-25T10:12:40.497775+0000","last_became_active":"2024-04-25T10:12:39.409013+0000","last_became_peered":"2024-04-25T10:12:39.409013+0000","last_unstale":"2024-04-25T10:12:40.497775+0000","last_undegraded":"2024-04-25T10:12:40.497775+0000","last_fullsized":"2024-04-25T10:12:40.497775+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:05:23.939145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498176+0000","last_change":"2024-04-25T10:12:38.392410+0000","last_active":"2024-04-25T10:12:40.498176+0000","last_peered":"2024-04-25T10:12:40.498176+0000","last_clean":"2024-04-25T10:12:40.498176+0000","last_became_active":"2024-04-25T10:12:38.392093+0000","last_became_peered":"2024-04-25T10:12:38.392093+0000","last_unstale":"2024-04-25T10:12:40.498176+0000","last_undegraded":"2024-04-25T10:12:40.498176+0000","last_fullsized":"2024-04-25T10:12:40.498176+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:48.839572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399465+0000","last_change":"2024-04-25T10:12:39.395040+0000","last_active":"2024-04-25T10:12:40.399465+0000","last_peered":"2024-04-25T10:12:40.399465+0000","last_clean":"2024-04-25T10:12:40.399465+0000","last_became_active":"2024-04-25T10:12:39.394773+0000","last_became_peered":"2024-04-25T10:12:39.394773+0000","last_unstale":"2024-04-25T10:12:40.399465+0000","last_undegraded":"2024-04-25T10:12:40.399465+0000","last_fullsized":"2024-04-25T10:12:40.399465+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:24.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399383+0000","last_change":"2024-04-25T10:12:38.399847+0000","last_active":"2024-04-25T10:12:40.399383+0000","last_peered":"2024-04-25T10:12:40.399383+0000","last_clean":"2024-04-25T10:12:40.399383+0000","last_became_active":"2024-04-25T10:12:38.399544+0000","last_became_peered":"2024-04-25T10:12:38.399544+0000","last_unstale":"2024-04-25T10:12:40.399383+0000","last_undegraded":"2024-04-25T10:12:40.399383+0000","last_fullsized":"2024-04-25T10:12:40.399383+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:32.374122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002656+0000","last_change":"2024-04-25T10:12:39.405394+0000","last_active":"2024-04-25T10:12:41.002656+0000","last_peered":"2024-04-25T10:12:41.002656+0000","last_clean":"2024-04-25T10:12:41.002656+0000","last_became_active":"2024-04-25T10:12:39.405095+0000","last_became_peered":"2024-04-25T10:12:39.405095+0000","last_unstale":"2024-04-25T10:12:41.002656+0000","last_undegraded":"2024-04-25T10:12:41.002656+0000","last_fullsized":"2024-04-25T10:12:41.002656+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:24.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998926+0000","last_change":"2024-04-25T10:12:38.398850+0000","last_active":"2024-04-25T10:12:40.998926+0000","last_peered":"2024-04-25T10:12:40.998926+0000","last_clean":"2024-04-25T10:12:40.998926+0000","last_became_active":"2024-04-25T10:12:38.398160+0000","last_became_peered":"2024-04-25T10:12:38.398160+0000","last_unstale":"2024-04-25T10:12:40.998926+0000","last_undegraded":"2024-04-25T10:12:40.998926+0000","last_fullsized":"2024-04-25T10:12:40.998926+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:20.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999567+0000","last_change":"2024-04-25T10:12:39.390848+0000","last_active":"2024-04-25T10:12:40.999567+0000","last_peered":"2024-04-25T10:12:40.999567+0000","last_clean":"2024-04-25T10:12:40.999567+0000","last_became_active":"2024-04-25T10:12:39.390561+0000","last_became_peered":"2024-04-25T10:12:39.390561+0000","last_unstale":"2024-04-25T10:12:40.999567+0000","last_undegraded":"2024-04-25T10:12:40.999567+0000","last_fullsized":"2024-04-25T10:12:40.999567+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:29.668847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001859+0000","last_change":"2024-04-25T10:12:38.400961+0000","last_active":"2024-04-25T10:12:41.001859+0000","last_peered":"2024-04-25T10:12:41.001859+0000","last_clean":"2024-04-25T10:12:41.001859+0000","last_became_active":"2024-04-25T10:12:38.400549+0000","last_became_peered":"2024-04-25T10:12:38.400549+0000","last_unstale":"2024-04-25T10:12:41.001859+0000","last_undegraded":"2024-04-25T10:12:41.001859+0000","last_fullsized":"2024-04-25T10:12:41.001859+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:24:54.153290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393300+0000","last_change":"2024-04-25T10:12:39.409103+0000","last_active":"2024-04-25T10:12:40.393300+0000","last_peered":"2024-04-25T10:12:40.393300+0000","last_clean":"2024-04-25T10:12:40.393300+0000","last_became_active":"2024-04-25T10:12:39.408560+0000","last_became_peered":"2024-04-25T10:12:39.408560+0000","last_unstale":"2024-04-25T10:12:40.393300+0000","last_undegraded":"2024-04-25T10:12:40.393300+0000","last_fullsized":"2024-04-25T10:12:40.393300+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:54:18.204997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002178+0000","last_change":"2024-04-25T10:12:38.403485+0000","last_active":"2024-04-25T10:12:41.002178+0000","last_peered":"2024-04-25T10:12:41.002178+0000","last_clean":"2024-04-25T10:12:41.002178+0000","last_became_active":"2024-04-25T10:12:38.402700+0000","last_became_peered":"2024-04-25T10:12:38.402700+0000","last_unstale":"2024-04-25T10:12:41.002178+0000","last_undegraded":"2024-04-25T10:12:41.002178+0000","last_fullsized":"2024-04-25T10:12:41.002178+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:52.854531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.401008+0000","last_change":"2024-04-25T10:12:39.412853+0000","last_active":"2024-04-25T10:12:40.401008+0000","last_peered":"2024-04-25T10:12:40.401008+0000","last_clean":"2024-04-25T10:12:40.401008+0000","last_became_active":"2024-04-25T10:12:39.412581+0000","last_became_peered":"2024-04-25T10:12:39.412581+0000","last_unstale":"2024-04-25T10:12:40.401008+0000","last_undegraded":"2024-04-25T10:12:40.401008+0000","last_fullsized":"2024-04-25T10:12:40.401008+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:54:24.830556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399251+0000","last_change":"2024-04-25T10:12:38.400034+0000","last_active":"2024-04-25T10:12:40.399251+0000","last_peered":"2024-04-25T10:12:40.399251+0000","last_clean":"2024-04-25T10:12:40.399251+0000","last_became_active":"2024-04-25T10:12:38.399664+0000","last_became_peered":"2024-04-25T10:12:38.399664+0000","last_unstale":"2024-04-25T10:12:40.399251+0000","last_undegraded":"2024-04-25T10:12:40.399251+0000","last_fullsized":"2024-04-25T10:12:40.399251+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:52:57.079807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999678+0000","last_change":"2024-04-25T10:12:39.388573+0000","last_active":"2024-04-25T10:12:40.999678+0000","last_peered":"2024-04-25T10:12:40.999678+0000","last_clean":"2024-04-25T10:12:40.999678+0000","last_became_active":"2024-04-25T10:12:39.388302+0000","last_became_peered":"2024-04-25T10:12:39.388302+0000","last_unstale":"2024-04-25T10:12:40.999678+0000","last_undegraded":"2024-04-25T10:12:40.999678+0000","last_fullsized":"2024-04-25T10:12:40.999678+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:09:24.615410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998828+0000","last_change":"2024-04-25T10:12:38.395349+0000","last_active":"2024-04-25T10:12:40.998828+0000","last_peered":"2024-04-25T10:12:40.998828+0000","last_clean":"2024-04-25T10:12:40.998828+0000","last_became_active":"2024-04-25T10:12:38.395029+0000","last_became_peered":"2024-04-25T10:12:38.395029+0000","last_unstale":"2024-04-25T10:12:40.998828+0000","last_undegraded":"2024-04-25T10:12:40.998828+0000","last_fullsized":"2024-04-25T10:12:40.998828+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:44.521300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392683+0000","last_change":"2024-04-25T10:12:39.410184+0000","last_active":"2024-04-25T10:12:40.392683+0000","last_peered":"2024-04-25T10:12:40.392683+0000","last_clean":"2024-04-25T10:12:40.392683+0000","last_became_active":"2024-04-25T10:12:39.409582+0000","last_became_peered":"2024-04-25T10:12:39.409582+0000","last_unstale":"2024-04-25T10:12:40.392683+0000","last_undegraded":"2024-04-25T10:12:40.392683+0000","last_fullsized":"2024-04-25T10:12:40.392683+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:02.424915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399511+0000","last_change":"2024-04-25T10:12:38.397995+0000","last_active":"2024-04-25T10:12:40.399511+0000","last_peered":"2024-04-25T10:12:40.399511+0000","last_clean":"2024-04-25T10:12:40.399511+0000","last_became_active":"2024-04-25T10:12:38.397710+0000","last_became_peered":"2024-04-25T10:12:38.397710+0000","last_unstale":"2024-04-25T10:12:40.399511+0000","last_undegraded":"2024-04-25T10:12:40.399511+0000","last_fullsized":"2024-04-25T10:12:40.399511+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:36.282430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998677+0000","last_change":"2024-04-25T10:12:39.414915+0000","last_active":"2024-04-25T10:12:40.998677+0000","last_peered":"2024-04-25T10:12:40.998677+0000","last_clean":"2024-04-25T10:12:40.998677+0000","last_became_active":"2024-04-25T10:12:39.412631+0000","last_became_peered":"2024-04-25T10:12:39.412631+0000","last_unstale":"2024-04-25T10:12:40.998677+0000","last_undegraded":"2024-04-25T10:12:40.998677+0000","last_fullsized":"2024-04-25T10:12:40.998677+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:50:11.656465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392657+0000","last_change":"2024-04-25T10:12:38.393091+0000","last_active":"2024-04-25T10:12:40.392657+0000","last_peered":"2024-04-25T10:12:40.392657+0000","last_clean":"2024-04-25T10:12:40.392657+0000","last_became_active":"2024-04-25T10:12:38.392645+0000","last_became_peered":"2024-04-25T10:12:38.392645+0000","last_unstale":"2024-04-25T10:12:40.392657+0000","last_undegraded":"2024-04-25T10:12:40.392657+0000","last_fullsized":"2024-04-25T10:12:40.392657+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:23.946603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497994+0000","last_change":"2024-04-25T10:12:39.407382+0000","last_active":"2024-04-25T10:12:40.497994+0000","last_peered":"2024-04-25T10:12:40.497994+0000","last_clean":"2024-04-25T10:12:40.497994+0000","last_became_active":"2024-04-25T10:12:39.405942+0000","last_became_peered":"2024-04-25T10:12:39.405942+0000","last_unstale":"2024-04-25T10:12:40.497994+0000","last_undegraded":"2024-04-25T10:12:40.497994+0000","last_fullsized":"2024-04-25T10:12:40.497994+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:22.694961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"107'3","reported_seq":17,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001779+0000","last_change":"2024-04-25T10:12:38.400070+0000","last_active":"2024-04-25T10:12:41.001779+0000","last_peered":"2024-04-25T10:12:41.001779+0000","last_clean":"2024-04-25T10:12:41.001779+0000","last_became_active":"2024-04-25T10:12:38.398594+0000","last_became_peered":"2024-04-25T10:12:38.398594+0000","last_unstale":"2024-04-25T10:12:41.001779+0000","last_undegraded":"2024-04-25T10:12:41.001779+0000","last_fullsized":"2024-04-25T10:12:41.001779+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:54.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998975+0000","last_change":"2024-04-25T10:12:39.415495+0000","last_active":"2024-04-25T10:12:40.998975+0000","last_peered":"2024-04-25T10:12:40.998975+0000","last_clean":"2024-04-25T10:12:40.998975+0000","last_became_active":"2024-04-25T10:12:39.415191+0000","last_became_peered":"2024-04-25T10:12:39.415191+0000","last_unstale":"2024-04-25T10:12:40.998975+0000","last_undegraded":"2024-04-25T10:12:40.998975+0000","last_fullsized":"2024-04-25T10:12:40.998975+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:38.627488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"107'6","reported_seq":20,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400779+0000","last_change":"2024-04-25T10:12:38.396480+0000","last_active":"2024-04-25T10:12:40.400779+0000","last_peered":"2024-04-25T10:12:40.400779+0000","last_clean":"2024-04-25T10:12:40.400779+0000","last_became_active":"2024-04-25T10:12:38.396223+0000","last_became_peered":"2024-04-25T10:12:38.396223+0000","last_unstale":"2024-04-25T10:12:40.400779+0000","last_undegraded":"2024-04-25T10:12:40.400779+0000","last_fullsized":"2024-04-25T10:12:40.400779+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:41.339736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002323+0000","last_change":"2024-04-25T10:12:39.417350+0000","last_active":"2024-04-25T10:12:41.002323+0000","last_peered":"2024-04-25T10:12:41.002323+0000","last_clean":"2024-04-25T10:12:41.002323+0000","last_became_active":"2024-04-25T10:12:39.416982+0000","last_became_peered":"2024-04-25T10:12:39.416982+0000","last_unstale":"2024-04-25T10:12:41.002323+0000","last_undegraded":"2024-04-25T10:12:41.002323+0000","last_fullsized":"2024-04-25T10:12:41.002323+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:17:38.627488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998938+0000","last_change":"2024-04-25T10:12:38.392477+0000","last_active":"2024-04-25T10:12:40.998938+0000","last_peered":"2024-04-25T10:12:40.998938+0000","last_clean":"2024-04-25T10:12:40.998938+0000","last_became_active":"2024-04-25T10:12:38.392206+0000","last_became_peered":"2024-04-25T10:12:38.392206+0000","last_unstale":"2024-04-25T10:12:40.998938+0000","last_undegraded":"2024-04-25T10:12:40.998938+0000","last_fullsized":"2024-04-25T10:12:40.998938+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:35.171988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400816+0000","last_change":"2024-04-25T10:12:39.397270+0000","last_active":"2024-04-25T10:12:40.400816+0000","last_peered":"2024-04-25T10:12:40.400816+0000","last_clean":"2024-04-25T10:12:40.400816+0000","last_became_active":"2024-04-25T10:12:39.397021+0000","last_became_peered":"2024-04-25T10:12:39.397021+0000","last_unstale":"2024-04-25T10:12:40.400816+0000","last_undegraded":"2024-04-25T10:12:40.400816+0000","last_fullsized":"2024-04-25T10:12:40.400816+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:04.860431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999301+0000","last_change":"2024-04-25T10:12:38.398340+0000","last_active":"2024-04-25T10:12:40.999301+0000","last_peered":"2024-04-25T10:12:40.999301+0000","last_clean":"2024-04-25T10:12:40.999301+0000","last_became_active":"2024-04-25T10:12:38.398082+0000","last_became_peered":"2024-04-25T10:12:38.398082+0000","last_unstale":"2024-04-25T10:12:40.999301+0000","last_undegraded":"2024-04-25T10:12:40.999301+0000","last_fullsized":"2024-04-25T10:12:40.999301+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:53.916554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498152+0000","last_change":"2024-04-25T10:12:39.410033+0000","last_active":"2024-04-25T10:12:40.498152+0000","last_peered":"2024-04-25T10:12:40.498152+0000","last_clean":"2024-04-25T10:12:40.498152+0000","last_became_active":"2024-04-25T10:12:39.407790+0000","last_became_peered":"2024-04-25T10:12:39.407790+0000","last_unstale":"2024-04-25T10:12:40.498152+0000","last_undegraded":"2024-04-25T10:12:40.498152+0000","last_fullsized":"2024-04-25T10:12:40.498152+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:51.937129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497769+0000","last_change":"2024-04-25T10:12:38.399760+0000","last_active":"2024-04-25T10:12:40.497769+0000","last_peered":"2024-04-25T10:12:40.497769+0000","last_clean":"2024-04-25T10:12:40.497769+0000","last_became_active":"2024-04-25T10:12:38.399483+0000","last_became_peered":"2024-04-25T10:12:38.399483+0000","last_unstale":"2024-04-25T10:12:40.497769+0000","last_undegraded":"2024-04-25T10:12:40.497769+0000","last_fullsized":"2024-04-25T10:12:40.497769+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:59.055425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393154+0000","last_change":"2024-04-25T10:12:39.413500+0000","last_active":"2024-04-25T10:12:40.393154+0000","last_peered":"2024-04-25T10:12:40.393154+0000","last_clean":"2024-04-25T10:12:40.393154+0000","last_became_active":"2024-04-25T10:12:39.412763+0000","last_became_peered":"2024-04-25T10:12:39.412763+0000","last_unstale":"2024-04-25T10:12:40.393154+0000","last_undegraded":"2024-04-25T10:12:40.393154+0000","last_fullsized":"2024-04-25T10:12:40.393154+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:32.192150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"107'8","reported_seq":22,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399068+0000","last_change":"2024-04-25T10:12:38.397450+0000","last_active":"2024-04-25T10:12:40.399068+0000","last_peered":"2024-04-25T10:12:40.399068+0000","last_clean":"2024-04-25T10:12:40.399068+0000","last_became_active":"2024-04-25T10:12:38.397157+0000","last_became_peered":"2024-04-25T10:12:38.397157+0000","last_unstale":"2024-04-25T10:12:40.399068+0000","last_undegraded":"2024-04-25T10:12:40.399068+0000","last_fullsized":"2024-04-25T10:12:40.399068+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:02:11.197185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497871+0000","last_change":"2024-04-25T10:12:39.406437+0000","last_active":"2024-04-25T10:12:40.497871+0000","last_peered":"2024-04-25T10:12:40.497871+0000","last_clean":"2024-04-25T10:12:40.497871+0000","last_became_active":"2024-04-25T10:12:39.406196+0000","last_became_peered":"2024-04-25T10:12:39.406196+0000","last_unstale":"2024-04-25T10:12:40.497871+0000","last_undegraded":"2024-04-25T10:12:40.497871+0000","last_fullsized":"2024-04-25T10:12:40.497871+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:18:42.591496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.401035+0000","last_change":"2024-04-25T10:12:38.397162+0000","last_active":"2024-04-25T10:12:40.401035+0000","last_peered":"2024-04-25T10:12:40.401035+0000","last_clean":"2024-04-25T10:12:40.401035+0000","last_became_active":"2024-04-25T10:12:38.394029+0000","last_became_peered":"2024-04-25T10:12:38.394029+0000","last_unstale":"2024-04-25T10:12:40.401035+0000","last_undegraded":"2024-04-25T10:12:40.401035+0000","last_fullsized":"2024-04-25T10:12:40.401035+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:59:44.394922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400353+0000","last_change":"2024-04-25T10:12:39.393059+0000","last_active":"2024-04-25T10:12:40.400353+0000","last_peered":"2024-04-25T10:12:40.400353+0000","last_clean":"2024-04-25T10:12:40.400353+0000","last_became_active":"2024-04-25T10:12:39.392799+0000","last_became_peered":"2024-04-25T10:12:39.392799+0000","last_unstale":"2024-04-25T10:12:40.400353+0000","last_undegraded":"2024-04-25T10:12:40.400353+0000","last_fullsized":"2024-04-25T10:12:40.400353+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:59.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001910+0000","last_change":"2024-04-25T10:12:38.403808+0000","last_active":"2024-04-25T10:12:41.001910+0000","last_peered":"2024-04-25T10:12:41.001910+0000","last_clean":"2024-04-25T10:12:41.001910+0000","last_became_active":"2024-04-25T10:12:38.403459+0000","last_became_peered":"2024-04-25T10:12:38.403459+0000","last_unstale":"2024-04-25T10:12:41.001910+0000","last_undegraded":"2024-04-25T10:12:41.001910+0000","last_fullsized":"2024-04-25T10:12:41.001910+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:58.331570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.998870+0000","last_change":"2024-04-25T10:12:39.396866+0000","last_active":"2024-04-25T10:12:40.998870+0000","last_peered":"2024-04-25T10:12:40.998870+0000","last_clean":"2024-04-25T10:12:40.998870+0000","last_became_active":"2024-04-25T10:12:39.396580+0000","last_became_peered":"2024-04-25T10:12:39.396580+0000","last_unstale":"2024-04-25T10:12:40.998870+0000","last_undegraded":"2024-04-25T10:12:40.998870+0000","last_fullsized":"2024-04-25T10:12:40.998870+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:59.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002292+0000","last_change":"2024-04-25T10:12:38.400543+0000","last_active":"2024-04-25T10:12:41.002292+0000","last_peered":"2024-04-25T10:12:41.002292+0000","last_clean":"2024-04-25T10:12:41.002292+0000","last_became_active":"2024-04-25T10:12:38.400272+0000","last_became_peered":"2024-04-25T10:12:38.400272+0000","last_unstale":"2024-04-25T10:12:41.002292+0000","last_undegraded":"2024-04-25T10:12:41.002292+0000","last_fullsized":"2024-04-25T10:12:41.002292+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:36.282430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392826+0000","last_change":"2024-04-25T10:12:39.392843+0000","last_active":"2024-04-25T10:12:40.392826+0000","last_peered":"2024-04-25T10:12:40.392826+0000","last_clean":"2024-04-25T10:12:40.392826+0000","last_became_active":"2024-04-25T10:12:39.392591+0000","last_became_peered":"2024-04-25T10:12:39.392591+0000","last_unstale":"2024-04-25T10:12:40.392826+0000","last_undegraded":"2024-04-25T10:12:40.392826+0000","last_fullsized":"2024-04-25T10:12:40.392826+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:40.430317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497943+0000","last_change":"2024-04-25T10:12:38.396265+0000","last_active":"2024-04-25T10:12:40.497943+0000","last_peered":"2024-04-25T10:12:40.497943+0000","last_clean":"2024-04-25T10:12:40.497943+0000","last_became_active":"2024-04-25T10:12:38.395891+0000","last_became_peered":"2024-04-25T10:12:38.395891+0000","last_unstale":"2024-04-25T10:12:40.497943+0000","last_undegraded":"2024-04-25T10:12:40.497943+0000","last_fullsized":"2024-04-25T10:12:40.497943+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:17:20.124965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.393212+0000","last_change":"2024-04-25T10:12:39.392571+0000","last_active":"2024-04-25T10:12:40.393212+0000","last_peered":"2024-04-25T10:12:40.393212+0000","last_clean":"2024-04-25T10:12:40.393212+0000","last_became_active":"2024-04-25T10:12:39.392226+0000","last_became_peered":"2024-04-25T10:12:39.392226+0000","last_unstale":"2024-04-25T10:12:40.393212+0000","last_undegraded":"2024-04-25T10:12:40.393212+0000","last_fullsized":"2024-04-25T10:12:40.393212+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:20:54.167183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497677+0000","last_change":"2024-04-25T10:12:38.400701+0000","last_active":"2024-04-25T10:12:40.497677+0000","last_peered":"2024-04-25T10:12:40.497677+0000","last_clean":"2024-04-25T10:12:40.497677+0000","last_became_active":"2024-04-25T10:12:38.400443+0000","last_became_peered":"2024-04-25T10:12:38.400443+0000","last_unstale":"2024-04-25T10:12:40.497677+0000","last_undegraded":"2024-04-25T10:12:40.497677+0000","last_fullsized":"2024-04-25T10:12:40.497677+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:39:05.805996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999515+0000","last_change":"2024-04-25T10:12:39.391444+0000","last_active":"2024-04-25T10:12:40.999515+0000","last_peered":"2024-04-25T10:12:40.999515+0000","last_clean":"2024-04-25T10:12:40.999515+0000","last_became_active":"2024-04-25T10:12:39.391194+0000","last_became_peered":"2024-04-25T10:12:39.391194+0000","last_unstale":"2024-04-25T10:12:40.999515+0000","last_undegraded":"2024-04-25T10:12:40.999515+0000","last_fullsized":"2024-04-25T10:12:40.999515+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:15.787796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400443+0000","last_change":"2024-04-25T10:12:38.399540+0000","last_active":"2024-04-25T10:12:40.400443+0000","last_peered":"2024-04-25T10:12:40.400443+0000","last_clean":"2024-04-25T10:12:40.400443+0000","last_became_active":"2024-04-25T10:12:38.398365+0000","last_became_peered":"2024-04-25T10:12:38.398365+0000","last_unstale":"2024-04-25T10:12:40.400443+0000","last_undegraded":"2024-04-25T10:12:40.400443+0000","last_fullsized":"2024-04-25T10:12:40.400443+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:14.916705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498291+0000","last_change":"2024-04-25T10:12:39.411666+0000","last_active":"2024-04-25T10:12:40.498291+0000","last_peered":"2024-04-25T10:12:40.498291+0000","last_clean":"2024-04-25T10:12:40.498291+0000","last_became_active":"2024-04-25T10:12:39.411348+0000","last_became_peered":"2024-04-25T10:12:39.411348+0000","last_unstale":"2024-04-25T10:12:40.498291+0000","last_undegraded":"2024-04-25T10:12:40.498291+0000","last_fullsized":"2024-04-25T10:12:40.498291+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:26.044268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497884+0000","last_change":"2024-04-25T10:12:38.396995+0000","last_active":"2024-04-25T10:12:40.497884+0000","last_peered":"2024-04-25T10:12:40.497884+0000","last_clean":"2024-04-25T10:12:40.497884+0000","last_became_active":"2024-04-25T10:12:38.396718+0000","last_became_peered":"2024-04-25T10:12:38.396718+0000","last_unstale":"2024-04-25T10:12:40.497884+0000","last_undegraded":"2024-04-25T10:12:40.497884+0000","last_fullsized":"2024-04-25T10:12:40.497884+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:40:44.079779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392643+0000","last_change":"2024-04-25T10:12:39.391330+0000","last_active":"2024-04-25T10:12:40.392643+0000","last_peered":"2024-04-25T10:12:40.392643+0000","last_clean":"2024-04-25T10:12:40.392643+0000","last_became_active":"2024-04-25T10:12:39.391066+0000","last_became_peered":"2024-04-25T10:12:39.391066+0000","last_unstale":"2024-04-25T10:12:40.392643+0000","last_undegraded":"2024-04-25T10:12:40.392643+0000","last_fullsized":"2024-04-25T10:12:40.392643+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:54:53.966001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999707+0000","last_change":"2024-04-25T10:12:38.398677+0000","last_active":"2024-04-25T10:12:40.999707+0000","last_peered":"2024-04-25T10:12:40.999707+0000","last_clean":"2024-04-25T10:12:40.999707+0000","last_became_active":"2024-04-25T10:12:38.398411+0000","last_became_peered":"2024-04-25T10:12:38.398411+0000","last_unstale":"2024-04-25T10:12:40.999707+0000","last_undegraded":"2024-04-25T10:12:40.999707+0000","last_fullsized":"2024-04-25T10:12:40.999707+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:49.288490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399245+0000","last_change":"2024-04-25T10:12:39.394737+0000","last_active":"2024-04-25T10:12:40.399245+0000","last_peered":"2024-04-25T10:12:40.399245+0000","last_clean":"2024-04-25T10:12:40.399245+0000","last_became_active":"2024-04-25T10:12:39.394460+0000","last_became_peered":"2024-04-25T10:12:39.394460+0000","last_unstale":"2024-04-25T10:12:40.399245+0000","last_undegraded":"2024-04-25T10:12:40.399245+0000","last_fullsized":"2024-04-25T10:12:40.399245+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:04.860431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"107'1","reported_seq":15,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.392752+0000","last_change":"2024-04-25T10:12:38.398783+0000","last_active":"2024-04-25T10:12:40.392752+0000","last_peered":"2024-04-25T10:12:40.392752+0000","last_clean":"2024-04-25T10:12:40.392752+0000","last_became_active":"2024-04-25T10:12:38.398493+0000","last_became_peered":"2024-04-25T10:12:38.398493+0000","last_unstale":"2024-04-25T10:12:40.392752+0000","last_undegraded":"2024-04-25T10:12:40.392752+0000","last_fullsized":"2024-04-25T10:12:40.392752+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:47:39.452998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999656+0000","last_change":"2024-04-25T10:12:39.392661+0000","last_active":"2024-04-25T10:12:40.999656+0000","last_peered":"2024-04-25T10:12:40.999656+0000","last_clean":"2024-04-25T10:12:40.999656+0000","last_became_active":"2024-04-25T10:12:39.392398+0000","last_became_peered":"2024-04-25T10:12:39.392398+0000","last_unstale":"2024-04-25T10:12:40.999656+0000","last_undegraded":"2024-04-25T10:12:40.999656+0000","last_fullsized":"2024-04-25T10:12:40.999656+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:34.871109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400653+0000","last_change":"2024-04-25T10:12:38.397163+0000","last_active":"2024-04-25T10:12:40.400653+0000","last_peered":"2024-04-25T10:12:40.400653+0000","last_clean":"2024-04-25T10:12:40.400653+0000","last_became_active":"2024-04-25T10:12:38.396864+0000","last_became_peered":"2024-04-25T10:12:38.396864+0000","last_unstale":"2024-04-25T10:12:40.400653+0000","last_undegraded":"2024-04-25T10:12:40.400653+0000","last_fullsized":"2024-04-25T10:12:40.400653+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:31:20.374116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002458+0000","last_change":"2024-04-25T10:12:39.409563+0000","last_active":"2024-04-25T10:12:41.002458+0000","last_peered":"2024-04-25T10:12:41.002458+0000","last_clean":"2024-04-25T10:12:41.002458+0000","last_became_active":"2024-04-25T10:12:39.409232+0000","last_became_peered":"2024-04-25T10:12:39.409232+0000","last_unstale":"2024-04-25T10:12:41.002458+0000","last_undegraded":"2024-04-25T10:12:41.002458+0000","last_fullsized":"2024-04-25T10:12:41.002458+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:33:44.486762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.999083+0000","last_change":"2024-04-25T10:12:38.398906+0000","last_active":"2024-04-25T10:12:40.999083+0000","last_peered":"2024-04-25T10:12:40.999083+0000","last_clean":"2024-04-25T10:12:40.999083+0000","last_became_active":"2024-04-25T10:12:38.398598+0000","last_became_peered":"2024-04-25T10:12:38.398598+0000","last_unstale":"2024-04-25T10:12:40.999083+0000","last_undegraded":"2024-04-25T10:12:40.999083+0000","last_fullsized":"2024-04-25T10:12:40.999083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:10.607775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498102+0000","last_change":"2024-04-25T10:12:39.408618+0000","last_active":"2024-04-25T10:12:40.498102+0000","last_peered":"2024-04-25T10:12:40.498102+0000","last_clean":"2024-04-25T10:12:40.498102+0000","last_became_active":"2024-04-25T10:12:39.407191+0000","last_became_peered":"2024-04-25T10:12:39.407191+0000","last_unstale":"2024-04-25T10:12:40.498102+0000","last_undegraded":"2024-04-25T10:12:40.498102+0000","last_fullsized":"2024-04-25T10:12:40.498102+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:00:37.822577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.399476+0000","last_change":"2024-04-25T10:12:38.395801+0000","last_active":"2024-04-25T10:12:40.399476+0000","last_peered":"2024-04-25T10:12:40.399476+0000","last_clean":"2024-04-25T10:12:40.399476+0000","last_became_active":"2024-04-25T10:12:38.395520+0000","last_became_peered":"2024-04-25T10:12:38.395520+0000","last_unstale":"2024-04-25T10:12:40.399476+0000","last_undegraded":"2024-04-25T10:12:40.399476+0000","last_fullsized":"2024-04-25T10:12:40.399476+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:45:34.861395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498108+0000","last_change":"2024-04-25T10:12:39.416978+0000","last_active":"2024-04-25T10:12:40.498108+0000","last_peered":"2024-04-25T10:12:40.498108+0000","last_clean":"2024-04-25T10:12:40.498108+0000","last_became_active":"2024-04-25T10:12:39.416429+0000","last_became_peered":"2024-04-25T10:12:39.416429+0000","last_unstale":"2024-04-25T10:12:40.498108+0000","last_undegraded":"2024-04-25T10:12:40.498108+0000","last_fullsized":"2024-04-25T10:12:40.498108+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:00.145387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497796+0000","last_change":"2024-04-25T10:12:38.402051+0000","last_active":"2024-04-25T10:12:40.497796+0000","last_peered":"2024-04-25T10:12:40.497796+0000","last_clean":"2024-04-25T10:12:40.497796+0000","last_became_active":"2024-04-25T10:12:38.397760+0000","last_became_peered":"2024-04-25T10:12:38.397760+0000","last_unstale":"2024-04-25T10:12:40.497796+0000","last_undegraded":"2024-04-25T10:12:40.497796+0000","last_fullsized":"2024-04-25T10:12:40.497796+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:32.554802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001995+0000","last_change":"2024-04-25T10:12:39.406350+0000","last_active":"2024-04-25T10:12:41.001995+0000","last_peered":"2024-04-25T10:12:41.001995+0000","last_clean":"2024-04-25T10:12:41.001995+0000","last_became_active":"2024-04-25T10:12:39.406014+0000","last_became_peered":"2024-04-25T10:12:39.406014+0000","last_unstale":"2024-04-25T10:12:41.001995+0000","last_undegraded":"2024-04-25T10:12:41.001995+0000","last_fullsized":"2024-04-25T10:12:41.001995+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:05.206169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.400567+0000","last_change":"2024-04-25T10:12:38.394921+0000","last_active":"2024-04-25T10:12:40.400567+0000","last_peered":"2024-04-25T10:12:40.400567+0000","last_clean":"2024-04-25T10:12:40.400567+0000","last_became_active":"2024-04-25T10:12:38.394633+0000","last_became_peered":"2024-04-25T10:12:38.394633+0000","last_unstale":"2024-04-25T10:12:40.400567+0000","last_undegraded":"2024-04-25T10:12:40.400567+0000","last_fullsized":"2024-04-25T10:12:40.400567+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:35.171988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002622+0000","last_change":"2024-04-25T10:12:39.418632+0000","last_active":"2024-04-25T10:12:41.002622+0000","last_peered":"2024-04-25T10:12:41.002622+0000","last_clean":"2024-04-25T10:12:41.002622+0000","last_became_active":"2024-04-25T10:12:39.418355+0000","last_became_peered":"2024-04-25T10:12:39.418355+0000","last_unstale":"2024-04-25T10:12:41.002622+0000","last_undegraded":"2024-04-25T10:12:41.002622+0000","last_fullsized":"2024-04-25T10:12:41.002622+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:08:04.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":14,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.497905+0000","last_change":"2024-04-25T10:12:38.397610+0000","last_active":"2024-04-25T10:12:40.497905+0000","last_peered":"2024-04-25T10:12:40.497905+0000","last_clean":"2024-04-25T10:12:40.497905+0000","last_became_active":"2024-04-25T10:12:38.397309+0000","last_became_peered":"2024-04-25T10:12:38.397309+0000","last_unstale":"2024-04-25T10:12:40.497905+0000","last_undegraded":"2024-04-25T10:12:40.497905+0000","last_fullsized":"2024-04-25T10:12:40.497905+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:34.837538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.002003+0000","last_change":"2024-04-25T10:12:39.409372+0000","last_active":"2024-04-25T10:12:41.002003+0000","last_peered":"2024-04-25T10:12:41.002003+0000","last_clean":"2024-04-25T10:12:41.002003+0000","last_became_active":"2024-04-25T10:12:39.408985+0000","last_became_peered":"2024-04-25T10:12:39.408985+0000","last_unstale":"2024-04-25T10:12:41.002003+0000","last_undegraded":"2024-04-25T10:12:41.002003+0000","last_fullsized":"2024-04-25T10:12:41.002003+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":106,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:38.366220+0000","last_clean_scrub_stamp":"2024-04-25T10:12:38.366220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:59.334493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"107'2","reported_seq":16,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:40.498056+0000","last_change":"2024-04-25T10:12:38.402569+0000","last_active":"2024-04-25T10:12:40.498056+0000","last_peered":"2024-04-25T10:12:40.498056+0000","last_clean":"2024-04-25T10:12:40.498056+0000","last_became_active":"2024-04-25T10:12:38.401726+0000","last_became_peered":"2024-04-25T10:12:38.401726+0000","last_unstale":"2024-04-25T10:12:40.498056+0000","last_undegraded":"2024-04-25T10:12:40.498056+0000","last_fullsized":"2024-04-25T10:12:40.498056+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:12:37.363297+0000","last_clean_scrub_stamp":"2024-04-25T10:12:37.363297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:16.294955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":332,"reported_epoch":108,"state":"active+clean","last_fresh":"2024-04-25T10:12:41.001395+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:12:41.001395+0000","last_peered":"2024-04-25T10:12:41.001395+0000","last_clean":"2024-04-25T10:12:41.001395+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:12:41.001395+0000","last_undegraded":"2024-04-25T10:12:41.001395+0000","last_fullsized":"2024-04-25T10:12:41.001395+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509552,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33068,"kb_used_data":1888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338772,"statfs":{"total":96636764160,"available":96602902528,"internally_reserved":0,"allocated":1933312,"data_stored":1210451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509553,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1351680,"data_stored":622139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509551,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1331200,"data_stored":619923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509550,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32492,"kb_used_data":1308,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339348,"statfs":{"total":96636764160,"available":96603492352,"internally_reserved":0,"allocated":1339392,"data_stored":620015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542256,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":620505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542254,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1335296,"data_stored":619957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542256,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32488,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339352,"statfs":{"total":96636764160,"available":96603496448,"internally_reserved":0,"allocated":1335296,"data_stored":619957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33076,"kb_used_data":1896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338764,"statfs":{"total":96636764160,"available":96602894336,"internally_reserved":0,"allocated":1941504,"data_stored":1211993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:12:43.904 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:12:43.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:12:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.080+0000 7efe67600640 1 Processor -- start 2024-04-25T10:12:44.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.080+0000 7efe67600640 1 -- start start 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.080+0000 7efe67600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 0x7efe6015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.080+0000 7efe67600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe6006e4a0 0x7efe6006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.080+0000 7efe67600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6015fc00 con 0x7efe6015f440 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe67600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe6006d640 con 0x7efe6006e4a0 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe67600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015fee0 con 0x7efe60159320 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe6006e4a0 0x7efe6006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efe6006e4a0 0x7efe6006e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33800/0 (socket says 172.21.15.18:33800) 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 -- 172.21.15.18:0/4011968098 learned_addr learned my addr 172.21.15.18:0/4011968098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe64c00640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 0x7efe6015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 -- 172.21.15.18:0/4011968098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 msgr2=0x7efe6015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:44.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 0x7efe6015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 -- 172.21.15.18:0/4011968098 >> v1:172.21.15.167:6789/0 conn(0x7efe6015f440 legacy=0x7efe6006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 -- 172.21.15.18:0/4011968098 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe601601c0 con 0x7efe6006e4a0 2024-04-25T10:12:44.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe64c00640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 0x7efe6015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:44.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe65600640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe6006e930 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7efe58009e50 tx=0x7efe5801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30ef90a2bc783df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe5fe00640 1 -- 172.21.15.18:0/4011968098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580a56f0 con 0x7efe6006e4a0 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe5fe00640 1 -- 172.21.15.18:0/4011968098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580a5890 con 0x7efe6006e4a0 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.084+0000 7efe5fe00640 1 -- 172.21.15.18:0/4011968098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580a5c60 con 0x7efe6006e4a0 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- 172.21.15.18:0/4011968098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 msgr2=0x7efe6006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe6006e930 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7efe58009e50 tx=0x7efe5801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- 172.21.15.18:0/4011968098 shutdown_connections 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe6006e930 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- 172.21.15.18:0/4011968098 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe60159320 0x7efe6015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- 172.21.15.18:0/4011968098 >> 172.21.15.18:0/4011968098 conn(0x7efe60067080 msgr2=0x7efe6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:44.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- 172.21.15.18:0/4011968098 shutdown_connections 2024-04-25T10:12:44.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- 172.21.15.18:0/4011968098 wait complete. 2024-04-25T10:12:44.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 Processor -- start 2024-04-25T10:12:44.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- start start 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 0x7efe600afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6015f440 0x7efe600b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015f9a0 con 0x7efe6006e4a0 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6015f820 con 0x7efe60159320 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe67600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe60168590 con 0x7efe6015f440 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33806/0 (socket says 172.21.15.18:33806) 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 -- 172.21.15.18:0/602674248 learned_addr learned my addr 172.21.15.18:0/602674248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe65600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6015f440 0x7efe600b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe57e00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 0x7efe600afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 -- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6015f440 msgr2=0x7efe600b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6015f440 0x7efe600b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 -- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 msgr2=0x7efe600afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 0x7efe600afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe64c00640 1 -- 172.21.15.18:0/602674248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6013f600 con 0x7efe6006e4a0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.088+0000 7efe57e00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 0x7efe600afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe64c00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e810 tx=0x7efe5000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50017070 con 0x7efe6006e4a0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5000c8d0 con 0x7efe6006e4a0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5000f040 con 0x7efe6006e4a0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe6013f8e0 con 0x7efe6006e4a0 2024-04-25T10:12:44.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe6013fea0 con 0x7efe6006e4a0 2024-04-25T10:12:44.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe600745d0 con 0x7efe6006e4a0 2024-04-25T10:12:44.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe5001a070 con 0x7efe6006e4a0 2024-04-25T10:12:44.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 0x7efe3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe50084d50 con 0x7efe6006e4a0 2024-04-25T10:12:44.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.092+0000 7efe57e00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 0x7efe3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.096+0000 7efe57e00640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 0x7efe3c069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efe600b4390 tx=0x7efe48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.096+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe500554e0 con 0x7efe6006e4a0 2024-04-25T10:12:44.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.316+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7efe6006c250 con 0x7efe6006e4a0 2024-04-25T10:12:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.316+0000 7efe5d600640 1 -- 172.21.15.18:0/602674248 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7efe50059580 con 0x7efe6006e4a0 2024-04-25T10:12:44.326 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:12:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:12:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:12:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:12:44.327 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:12:44.327 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:12:44.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 msgr2=0x7efe3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 0x7efe3c069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efe600b4390 tx=0x7efe48009040 comp rx=0 tx=0).stop 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 msgr2=0x7efe60158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7efe5000e810 tx=0x7efe5000ecd0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 shutdown_connections 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efe3c066f60 0x7efe3c069420 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efe6015f440 0x7efe600b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60159320 0x7efe600afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 --2- 172.21.15.18:0/602674248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe6006e4a0 0x7efe60158170 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 >> 172.21.15.18:0/602674248 conn(0x7efe60067080 msgr2=0x7efe600cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 shutdown_connections 2024-04-25T10:12:44.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.320+0000 7efe67600640 1 -- 172.21.15.18:0/602674248 wait complete. 2024-04-25T10:12:44.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 Processor -- start 2024-04-25T10:12:44.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 -- start start 2024-04-25T10:12:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa8000cd4d0 0x7fa8000cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000cc4e0 con 0x7fa8000b1750 2024-04-25T10:12:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800145650 con 0x7fa8000cd4d0 2024-04-25T10:12:44.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa804c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000ce040 con 0x7fa800145270 2024-04-25T10:12:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa7fde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa7fde00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:34948/0 (socket says 172.21.15.18:34948) 2024-04-25T10:12:44.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa7fde00640 1 -- 172.21.15.18:0/85871258 learned_addr learned my addr 172.21.15.18:0/85871258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.484+0000 7fa7f7e00640 1 --2- 172.21.15.18:0/85871258 >> v2:172.21.15.167:3300/0 conn(0x7fa8000cd4d0 0x7fa8000cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fde00640 1 -- 172.21.15.18:0/85871258 >> v2:172.21.15.167:3300/0 conn(0x7fa8000cd4d0 msgr2=0x7fa8000cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fde00640 1 --2- 172.21.15.18:0/85871258 >> v2:172.21.15.167:3300/0 conn(0x7fa8000cd4d0 0x7fa8000cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fde00640 1 -- 172.21.15.18:0/85871258 >> v1:172.21.15.167:6789/0 conn(0x7fa8000b1750 legacy=0x7fa80015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fde00640 1 -- 172.21.15.18:0/85871258 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000ce320 con 0x7fa800145270 2024-04-25T10:12:44.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fd400640 1 -- 172.21.15.18:0/85871258 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094466726 0 0) 0x7fa8000cc4e0 con 0x7fa8000b1750 2024-04-25T10:12:44.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fde00640 1 --2- 172.21.15.18:0/85871258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d4a9ab2c4c899e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fd400640 1 -- 172.21.15.18:0/85871258 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00ab650 con 0x7fa800145270 2024-04-25T10:12:44.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fd400640 1 -- 172.21.15.18:0/85871258 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f00b0070 con 0x7fa800145270 2024-04-25T10:12:44.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa7fd400640 1 -- 172.21.15.18:0/85871258 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00aba10 con 0x7fa800145270 2024-04-25T10:12:44.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa804c00640 1 -- 172.21.15.18:0/85871258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 msgr2=0x7fa80015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.488+0000 7fa804c00640 1 --2- 172.21.15.18:0/85871258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009870 tx=0x7fa7f001c560 comp rx=0 tx=0).stop 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- 172.21.15.18:0/85871258 shutdown_connections 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 --2- 172.21.15.18:0/85871258 >> v2:172.21.15.167:3300/0 conn(0x7fa8000cd4d0 0x7fa8000cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 --2- 172.21.15.18:0/85871258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa800145270 0x7fa80015fe50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- 172.21.15.18:0/85871258 >> 172.21.15.18:0/85871258 conn(0x7fa800066fa0 msgr2=0x7fa80006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- 172.21.15.18:0/85871258 shutdown_connections 2024-04-25T10:12:44.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- 172.21.15.18:0/85871258 wait complete. 2024-04-25T10:12:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 Processor -- start 2024-04-25T10:12:44.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- start start 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 0x7fa8000af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8000cd4d0 0x7fa8000b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b1f70 con 0x7fa800145270 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800168710 con 0x7fa8000b1750 2024-04-25T10:12:44.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8000b15a0 con 0x7fa8000cd4d0 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33814/0 (socket says 172.21.15.18:33814) 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 -- 172.21.15.18:0/2222110632 learned_addr learned my addr 172.21.15.18:0/2222110632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7f7e00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8000cd4d0 0x7fa8000b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fde00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 0x7fa8000af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 -- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8000cd4d0 msgr2=0x7fa8000b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8000cd4d0 0x7fa8000b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 -- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 msgr2=0x7fa8000af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 0x7fa8000af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 -- 172.21.15.18:0/2222110632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000b0550 con 0x7fa800145270 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fde00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 0x7fa8000af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7fe800640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c780 tx=0x7fa7f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8003db0 con 0x7fa800145270 2024-04-25T10:12:44.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f800ce30 con 0x7fa800145270 2024-04-25T10:12:44.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f8005290 con 0x7fa800145270 2024-04-25T10:12:44.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.492+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8001649b0 con 0x7fa800145270 2024-04-25T10:12:44.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8000aff90 con 0x7fa800145270 2024-04-25T10:12:44.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8000745d0 con 0x7fa800145270 2024-04-25T10:12:44.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa7f8005430 con 0x7fa800145270 2024-04-25T10:12:44.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa7f6000640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 0x7fa7dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:44.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa7f8085080 con 0x7fa800145270 2024-04-25T10:12:44.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.496+0000 7fa7fde00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 0x7fa7dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:44.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.500+0000 7fa7fde00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 0x7fa7dc069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00af000 tx=0x7fa7f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:44.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.500+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa7f8055ef0 con 0x7fa800145270 2024-04-25T10:12:44.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.696+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa80006b8e0 con 0x7fa800145270 2024-04-25T10:12:44.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.696+0000 7fa7f6000640 1 -- 172.21.15.18:0/2222110632 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fa7f80557f0 con 0x7fa800145270 2024-04-25T10:12:44.705 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:44.705 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:12:41.782127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":36905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36905":{"gid":36905,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/81610203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":81610203},{"type":"v1","addr":"172.21.15.167:6837","nonce":81610203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:12:44.706 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 msgr2=0x7fa7dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 0x7fa7dc069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00af000 tx=0x7fa7f0008040 comp rx=0 tx=0).stop 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 msgr2=0x7fa8001401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa7f800c780 tx=0x7fa7f800cc40 comp rx=0 tx=0).stop 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 shutdown_connections 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa800145270 0x7fa8001401a0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa7dc066f60 0x7fa7dc069420 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa8000cd4d0 0x7fa8000b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 --2- 172.21.15.18:0/2222110632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa8000b1750 0x7fa8000af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 >> 172.21.15.18:0/2222110632 conn(0x7fa800066fa0 msgr2=0x7fa8000b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 shutdown_connections 2024-04-25T10:12:44.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:44.700+0000 7fa804c00640 1 -- 172.21.15.18:0/2222110632 wait complete. 2024-04-25T10:12:45.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:12:38.768098+0000', 'modified': '2024-04-25T10:12:41.782127+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 36905}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_36905': {'gid': 36905, 'name': 'd', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/81610203', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 81610203}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 81610203}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:12:45.129 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:12:45.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:12:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 Processor -- start 2024-04-25T10:12:45.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 -- start start 2024-04-25T10:12:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f12c415f440 0x7f12c406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c415fc00 con 0x7f12c406e010 2024-04-25T10:12:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12c406d640 con 0x7f12c415f440 2024-04-25T10:12:45.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12cb000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c415fee0 con 0x7f12c4159320 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:34974/0 (socket says 172.21.15.18:34974) 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c9000640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f12c406e010 0x7f12c406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:51438/0 (socket says 172.21.15.18:51438) 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3e00640 1 -- 172.21.15.18:0/2294645376 learned_addr learned my addr 172.21.15.18:0/2294645376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3400640 1 --2- 172.21.15.18:0/2294645376 >> v2:172.21.15.167:3300/0 conn(0x7f12c415f440 0x7f12c406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3400640 1 -- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 msgr2=0x7f12c415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3400640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3400640 1 -- 172.21.15.18:0/2294645376 >> v1:172.21.15.167:6789/0 conn(0x7f12c406e010 legacy=0x7f12c406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c2a00640 1 -- 172.21.15.18:0/2294645376 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485808354 0 0) 0x7f12c415fc00 con 0x7f12c406e010 2024-04-25T10:12:45.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3400640 1 -- 172.21.15.18:0/2294645376 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c41601c0 con 0x7f12c415f440 2024-04-25T10:12:45.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.268+0000 7f12c3e00640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12c3400640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c406dad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097c0 tx=0x7f12b001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbd5412c6c11922 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12c2a00640 1 -- 172.21.15.18:0/2294645376 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00ab600 con 0x7f12c415f440 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12c2a00640 1 -- 172.21.15.18:0/2294645376 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00b0070 con 0x7f12c415f440 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12c2a00640 1 -- 172.21.15.18:0/2294645376 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00ab9c0 con 0x7f12c415f440 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 -- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 msgr2=0x7f12c406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c406dad0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f12b00097c0 tx=0x7f12b001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 -- 172.21.15.18:0/2294645376 shutdown_connections 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c406dad0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 --2- 172.21.15.18:0/2294645376 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c4159320 0x7f12c415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 -- 172.21.15.18:0/2294645376 >> 172.21.15.18:0/2294645376 conn(0x7f12c4067080 msgr2=0x7f12c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 -- 172.21.15.18:0/2294645376 shutdown_connections 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.272+0000 7f12cb000640 1 -- 172.21.15.18:0/2294645376 wait complete. 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 Processor -- start 2024-04-25T10:12:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- start start 2024-04-25T10:12:45.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c406e010 0x7f12c4158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4071c00 con 0x7f12c4159320 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4071a80 con 0x7f12c415f440 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c406ebb0 con 0x7f12c406e010 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33820/0 (socket says 172.21.15.18:33820) 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 -- 172.21.15.18:0/2313588623 learned_addr learned my addr 172.21.15.18:0/2313588623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3e00640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c406e010 0x7f12c4158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c9000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 -- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c406e010 msgr2=0x7f12c4158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c406e010 0x7f12c4158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 -- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 msgr2=0x7f12c415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 -- 172.21.15.18:0/2313588623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4158740 con 0x7f12c4159320 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c9000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12c3400640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ad040 tx=0x7f12b001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12bbe00640 1 -- 172.21.15.18:0/2313588623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0004020 con 0x7f12c4159320 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12bbe00640 1 -- 172.21.15.18:0/2313588623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00041c0 con 0x7f12c4159320 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12bbe00640 1 -- 172.21.15.18:0/2313588623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0003620 con 0x7f12c4159320 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c412ef00 con 0x7f12c4159320 2024-04-25T10:12:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.276+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c40af930 con 0x7f12c4159320 2024-04-25T10:12:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12bbe00640 1 -- 172.21.15.18:0/2313588623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f12b00aa070 con 0x7f12c4159320 2024-04-25T10:12:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12bbe00640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 0x7f12a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12bbe00640 1 -- 172.21.15.18:0/2313588623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f12b011f450 con 0x7f12c4159320 2024-04-25T10:12:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 Processor -- start 2024-04-25T10:12:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3e00640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 0x7f12a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 -- start start 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3e00640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 0x7f12a4069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f12b4006cb0 tx=0x7f12b4009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa4fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa06310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a8ed5f0 con 0x56240aa50240 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a854da0 con 0x56240aa4f920 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240a7dd150 con 0x56240aa05f30 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33834/0 (socket says 172.21.15.18:33834) 2024-04-25T10:12:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 -- 172.21.15.18:0/252444158 learned_addr learned my addr 172.21.15.18:0/252444158 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 -- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 msgr2=0x56240aa06310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa06310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 -- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 msgr2=0x56240aa4fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa4fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 -- 172.21.15.18:0/252444158 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240a7f6ca0 con 0x56240aa50240 2024-04-25T10:12:45.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.280+0000 7f12c3400640 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ec040 tx=0x7f12b0009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a4f12a4919f1d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12b8c00640 1 -- 172.21.15.18:0/252444158 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00f0e60 con 0x56240aa50240 2024-04-25T10:12:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12b8c00640 1 -- 172.21.15.18:0/252444158 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00b0070 con 0x56240aa50240 2024-04-25T10:12:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12b8c00640 1 -- 172.21.15.18:0/252444158 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00c4050 con 0x56240aa50240 2024-04-25T10:12:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- 172.21.15.18:0/252444158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 msgr2=0x56240aa059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ec040 tx=0x7f12b0009190 comp rx=0 tx=0).stop 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- 172.21.15.18:0/252444158 shutdown_connections 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa06310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa059f0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/252444158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa4fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- 172.21.15.18:0/252444158 >> 172.21.15.18:0/252444158 conn(0x56240aa0c2a0 msgr2=0x56240aa042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- 172.21.15.18:0/252444158 shutdown_connections 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- 172.21.15.18:0/252444158 wait complete. 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- start start 2024-04-25T10:12:45.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 Processor -- start 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa56c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa571c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a80f990 con 0x56240aa50240 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a850e40 con 0x56240aa4f920 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240a7e0900 con 0x56240aa05f30 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ce4f6000 10 client.0 _ll_register_callbacks cb 0x56240a9081c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33836/0 (socket says 172.21.15.18:33836) 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 -- 172.21.15.18:0/1114489655 learned_addr learned my addr 172.21.15.18:0/1114489655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c3400640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa56c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 -- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 msgr2=0x56240aa56c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa56c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 -- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 msgr2=0x56240aa571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 -- 172.21.15.18:0/1114489655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240a80d630 con 0x56240aa50240 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa56c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12c9000640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f12bc001470 tx=0x7f12bc001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41df4177c90a5d35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ad600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.284+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc019060 con 0x56240aa50240 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12b00b0070 con 0x56240aa50240 2024-04-25T10:12:45.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f12bc0114f0 con 0x56240aa50240 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12bc01f050 con 0x56240aa50240 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 10 client.8502 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x56240a7dd3a0 con 0x56240aa50240 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00b0070 con 0x56240aa50240 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12bc022020 con 0x56240aa50240 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 10 client.8502 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 10 client.8502 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 20 client.8502 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa0a4b0 0x56240aa0a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 4 client.8502 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56240a7f0a50 con 0x56240aa0a4b0 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa0a4b0 0x56240aa0a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa0a4b0 0x56240aa0a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=256c92e2e08d06a8 server_cookie=ff8b322618ec182 in_seq=0 out_seq=0 2024-04-25T10:12:45.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 10 client.8502 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 1 -- 172.21.15.18:0/1114489655 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56240a7f0a50 con 0x56240aa0a4b0 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 10 client.8502 handle_command_reply: tid=0 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 client.8502 shutdown 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 msgr2=0x56240aa09aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f12bc001470 tx=0x7f12bc001930 comp rx=0 tx=0).stop 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 shutdown_connections 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa0a4b0 0x56240aa0a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa50240 0x56240aa09aa0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa4f920 0x56240aa571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1114489655 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa56c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ad600640 0 client.8502 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:45.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 >> 172.21.15.18:0/1114489655 conn(0x56240aa0c2a0 msgr2=0x56240aa049e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 shutdown_connections 2024-04-25T10:12:45.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1114489655 wait complete. 2024-04-25T10:12:45.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.288+0000 7f12ce4f6000 20 client.8502 trim_cache size 0 max 16384 2024-04-25T10:12:45.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.304+0000 7f12ce4f6000 1 Processor -- start 2024-04-25T10:12:45.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.304+0000 7f12ce4f6000 1 -- start start 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 0x56240aa3bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 0x56240aa59880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c42020f0 con 0x56240aa4f920 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40b12d0 con 0x56240aa05f30 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4201af0 con 0x56240aa50240 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33852/0 (socket says 172.21.15.18:33852) 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 -- 172.21.15.18:0/1250888745 learned_addr learned my addr 172.21.15.18:0/1250888745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c9000640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 0x56240aa59880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 -- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 msgr2=0x56240aa59880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 0x56240aa3bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 0x56240aa59880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 -- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 msgr2=0x56240aa3bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 0x56240aa3bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 -- 172.21.15.18:0/1250888745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56240aa50070 con 0x56240aa4f920 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c9000640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 0x56240aa59880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3e00640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 0x56240aa3bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12c3400640 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ec040 tx=0x7f12b00b0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ca16a39801f3c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12afe00640 1 -- 172.21.15.18:0/1250888745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0107040 con 0x56240aa4f920 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12afe00640 1 -- 172.21.15.18:0/1250888745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00edee0 con 0x56240aa4f920 2024-04-25T10:12:45.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12afe00640 1 -- 172.21.15.18:0/1250888745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b011f0b0 con 0x56240aa4f920 2024-04-25T10:12:45.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1250888745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 msgr2=0x56240aa3c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ec040 tx=0x7f12b00b0000 comp rx=0 tx=0).stop 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1250888745 shutdown_connections 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa50240 0x56240aa59880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa3c0d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/1250888745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa05f30 0x56240aa3bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1250888745 >> 172.21.15.18:0/1250888745 conn(0x56240aa0c2a0 msgr2=0x56240aa3b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1250888745 shutdown_connections 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- 172.21.15.18:0/1250888745 wait complete. 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- start start 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 Processor -- start 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa50240 0x56240aa6b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a8593d0 con 0x56240aa4f920 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56240a910d50 con 0x56240aa50240 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x56240a7ef980 con 0x56240aa05f30 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.308+0000 7f12ce4f6000 10 client.0 _ll_register_callbacks cb 0x7f12b0006c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33866/0 (socket says 172.21.15.18:33866) 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 -- 172.21.15.18:0/801004049 learned_addr learned my addr 172.21.15.18:0/801004049 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3e00640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c9000640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa50240 0x56240aa6b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 -- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 msgr2=0x56240aa5c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa5c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 -- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa50240 msgr2=0x56240aa6b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa50240 0x56240aa6b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 -- 172.21.15.18:0/801004049 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56240a8d6600 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3400640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f12b001aa90 tx=0x7f12b0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b97c6c1e4a97b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b00c4070 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f12b00f4ba0 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12b00edee0 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12b0107070 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 10 client.8508 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x56240a7e99b0 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00edee0 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12b011db70 con 0x56240aa4f920 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 10 client.8508 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:45.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 10 client.8508 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 20 client.8508 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa6bdb0 0x56240aab0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 4 client.8508 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56240a8622e0 con 0x56240aa6bdb0 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3e00640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa6bdb0 0x56240aab0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 10 client.8508 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:45.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12c3e00640 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa6bdb0 0x56240aab0140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a0fec100e8cee4 server_cookie=5c41ce23d78367a3 in_seq=0 out_seq=0 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 1 -- 172.21.15.18:0/801004049 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56240a8622e0 con 0x56240aa6bdb0 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 10 client.8508 handle_command_reply: tid=0 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 client.8508 shutdown 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 msgr2=0x56240aa6b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f12b001aa90 tx=0x7f12b0019180 comp rx=0 tx=0).stop 2024-04-25T10:12:45.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 shutdown_connections 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x56240aa6bdb0 0x56240aab0140 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56240aa50240 0x56240aa6b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56240aa4f920 0x56240aa6b330 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ad600640 0 client.8508 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 --2- 172.21.15.18:0/801004049 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56240aa05f30 0x56240aa5c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 >> 172.21.15.18:0/801004049 conn(0x56240aa0c2a0 msgr2=0x56240aa3bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 shutdown_connections 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 1 -- 172.21.15.18:0/801004049 wait complete. 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12ce4f6000 20 client.8508 trim_cache size 0 max 16384 2024-04-25T10:12:45.326 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 36905, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.941851056, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 84, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 108, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 108, 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 10.779340272000001 2024-04-25T10:12:45.327 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 msgr2=0x7f12a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 0x7f12a4069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f12b4006cb0 tx=0x7f12b4009240 comp rx=0 tx=0).stop 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 msgr2=0x7f12c412e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f12b00ad040 tx=0x7f12b001ac20 comp rx=0 tx=0).stop 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 shutdown_connections 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f12c415f440 0x7f12c415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c4159320 0x7f12c412e4b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f12a4066f60 0x7f12a4069420 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 --2- 172.21.15.18:0/2313588623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f12c406e010 0x7f12c4158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.312+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 >> 172.21.15.18:0/2313588623 conn(0x7f12c4067080 msgr2=0x7f12c406efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.316+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 shutdown_connections 2024-04-25T10:12:45.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.316+0000 7f12cb000640 1 -- 172.21.15.18:0/2313588623 wait complete. 2024-04-25T10:12:45.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:12:45.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.472+0000 7fc649a00640 1 Processor -- start 2024-04-25T10:12:45.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 -- start start 2024-04-25T10:12:45.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc64415fe50 0x7fc6440b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6440b1c90 0x7fc64415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6440cc4e0 con 0x7fc644145270 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc644145650 con 0x7fc64415fe50 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc649a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6441602b0 con 0x7fc6440b1c90 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc64415fe50 0x7fc6440b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc64415fe50 0x7fc6440b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33882/0 (socket says 172.21.15.18:33882) 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 -- 172.21.15.18:0/3880111582 learned_addr learned my addr 172.21.15.18:0/3880111582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc643400640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6440b1c90 0x7fc64415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 -- 172.21.15.18:0/3880111582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6440b1c90 msgr2=0x7fc64415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6440b1c90 0x7fc64415bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 -- 172.21.15.18:0/3880111582 >> v1:172.21.15.167:6789/0 conn(0x7fc644145270 legacy=0x7fc6440cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:45.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.476+0000 7fc63a000640 1 -- 172.21.15.18:0/3880111582 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6440ce040 con 0x7fc64415fe50 2024-04-25T10:12:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc63a000640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc64415fe50 0x7fc6440b1750 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc634009870 tx=0x7fc63401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a3c59c1b769af3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc642000640 1 -- 172.21.15.18:0/3880111582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340b1070 con 0x7fc64415fe50 2024-04-25T10:12:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc642000640 1 -- 172.21.15.18:0/3880111582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6340ac630 con 0x7fc64415fe50 2024-04-25T10:12:45.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc642000640 1 -- 172.21.15.18:0/3880111582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340a8050 con 0x7fc64415fe50 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- 172.21.15.18:0/3880111582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc64415fe50 msgr2=0x7fc6440b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc64415fe50 0x7fc6440b1750 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fc634009870 tx=0x7fc63401c520 comp rx=0 tx=0).stop 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- 172.21.15.18:0/3880111582 shutdown_connections 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc6440b1c90 0x7fc64415bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 --2- 172.21.15.18:0/3880111582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc64415fe50 0x7fc6440b1750 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- 172.21.15.18:0/3880111582 >> 172.21.15.18:0/3880111582 conn(0x7fc644066fa0 msgr2=0x7fc64406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- 172.21.15.18:0/3880111582 shutdown_connections 2024-04-25T10:12:45.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- 172.21.15.18:0/3880111582 wait complete. 2024-04-25T10:12:45.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 Processor -- start 2024-04-25T10:12:45.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.480+0000 7fc649a00640 1 -- start start 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 0x7fc64413b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64415fe50 0x7fc64415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440cdbe0 con 0x7fc644145270 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64415f930 con 0x7fc6440b1c90 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6440cdd60 con 0x7fc64415fe50 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33884/0 (socket says 172.21.15.18:33884) 2024-04-25T10:12:45.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 -- 172.21.15.18:0/101723726 learned_addr learned my addr 172.21.15.18:0/101723726 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc643400640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64415fe50 0x7fc64415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc642a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 0x7fc64413b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 -- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64415fe50 msgr2=0x7fc64415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64415fe50 0x7fc64415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 -- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 msgr2=0x7fc64413b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 0x7fc64413b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 -- 172.21.15.18:0/101723726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64415df00 con 0x7fc644145270 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc642a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 0x7fc64413b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63a000640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fc6340af040 tx=0x7fc6340192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340bc070 con 0x7fc644145270 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6340ab5e0 con 0x7fc644145270 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64415e1e0 con 0x7fc644145270 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6340b1070 con 0x7fc644145270 2024-04-25T10:12:45.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6440b28a0 con 0x7fc644145270 2024-04-25T10:12:45.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6440745d0 con 0x7fc644145270 2024-04-25T10:12:45.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.484+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc6340bf070 con 0x7fc644145270 2024-04-25T10:12:45.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.488+0000 7fc63b400640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 0x7fc620069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:45.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.488+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc63411ec80 con 0x7fc644145270 2024-04-25T10:12:45.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.488+0000 7fc642a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 0x7fc620069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:45.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.488+0000 7fc642a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 0x7fc620069420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc6440cdbb0 tx=0x7fc62c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:45.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.492+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc634016110 con 0x7fc644145270 2024-04-25T10:12:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc64406b8e0 con 0x7fc644145270 2024-04-25T10:12:45.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc63b400640 1 -- 172.21.15.18:0/101723726 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc6340ef4a0 con 0x7fc644145270 2024-04-25T10:12:45.700 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 msgr2=0x7fc620069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 0x7fc620069420 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fc6440cdbb0 tx=0x7fc62c009040 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 msgr2=0x7fc6441592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fc6340af040 tx=0x7fc6340192c0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 shutdown_connections 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc620066f60 0x7fc620069420 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc64415fe50 0x7fc64415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc644145270 0x7fc6441592b0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 --2- 172.21.15.18:0/101723726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6440b1c90 0x7fc64413b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 >> 172.21.15.18:0/101723726 conn(0x7fc644066fa0 msgr2=0x7fc6440738f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 shutdown_connections 2024-04-25T10:12:45.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:45.692+0000 7fc649a00640 1 -- 172.21.15.18:0/101723726 wait complete. 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:12:45.720 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:12:45.721 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:12:45.721 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:45.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.721 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.731 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:12:45.732 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:12:45.732 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41939sec preferred_lft 41939sec 2024-04-25T10:12:45.732 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:12:45.733 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:12:45.734 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:12:45.735 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:12:45.735 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:45.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.735 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:12:45.792 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:12:45.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.794 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:12:45.847 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:12:45.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.848 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:12:45.848 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:12:45.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:12:45.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:12:45.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:12:45.849 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:12:45.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.940 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:12:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:12:45.950 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:12:45.950 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:45.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:45.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:12:46.014 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:12:46.014 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:46.070 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:46.071 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:12:46.071 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:46.122 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:12:46.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:46.122 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:46.211 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:46.211 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:12:46.224 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:46.224 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:12:46.224 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:12:46.224 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:12:46.224 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:12:46.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:12:46.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:46.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:46.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:46.249 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:12:46.313 INFO:teuthology.orchestra.run.smithi018.stdout:client36986 2024-04-25T10:12:46.313 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:46.314 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:46.363 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:46.363 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:46.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:46.415 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:12:46.558 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records in 2024-04-25T10:12:46.558 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records out 2024-04-25T10:12:46.558 INFO:teuthology.orchestra.run.smithi018.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0849489 s, 74.1 MB/s 2024-04-25T10:12:46.559 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:46.559 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:46.568 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:46.568 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:46.618 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 Processor -- start 2024-04-25T10:12:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 -- start start 2024-04-25T10:12:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 0x7f6d4c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0cd6c0 con 0x7f6d4c0cdb70 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b3fe0 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d51600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0cce20 con 0x7f6d4c15efa0 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33888/0 (socket says 172.21.15.18:33888) 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 -- 172.21.15.18:0/2060711555 learned_addr learned my addr 172.21.15.18:0/2060711555 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d4be00640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 0x7f6d4c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 -- 172.21.15.18:0/2060711555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 msgr2=0x7f6d4c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 0x7f6d4c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 -- 172.21.15.18:0/2060711555 >> v1:172.21.15.167:6789/0 conn(0x7f6d4c0cdb70 legacy=0x7f6d4c0cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d50c00640 1 -- 172.21.15.18:0/2060711555 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0cd100 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.796+0000 7f6d4be00640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 0x7f6d4c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:46.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d50c00640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009e50 tx=0x7f6d4401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbae7d3e8ac53a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d4aa00640 1 -- 172.21.15.18:0/2060711555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440a5700 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d4aa00640 1 -- 172.21.15.18:0/2060711555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d440a58a0 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d4aa00640 1 -- 172.21.15.18:0/2060711555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440a5c70 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- 172.21.15.18:0/2060711555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c0b21b0 msgr2=0x7f6d4c099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009e50 tx=0x7f6d4401ca30 comp rx=0 tx=0).stop 2024-04-25T10:12:46.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- 172.21.15.18:0/2060711555 shutdown_connections 2024-04-25T10:12:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c099fa0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 --2- 172.21.15.18:0/2060711555 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c15efa0 0x7f6d4c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- 172.21.15.18:0/2060711555 >> 172.21.15.18:0/2060711555 conn(0x7f6d4c0b3050 msgr2=0x7f6d4c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- 172.21.15.18:0/2060711555 shutdown_connections 2024-04-25T10:12:46.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- 172.21.15.18:0/2060711555 wait complete. 2024-04-25T10:12:46.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 Processor -- start 2024-04-25T10:12:46.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.800+0000 7f6d51600640 1 -- start start 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c1658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 0x7f6d4c0c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c168820 con 0x7f6d4c15efa0 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1686a0 con 0x7f6d4c0b21b0 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1689a0 con 0x7f6d4c0cdb70 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33894/0 (socket says 172.21.15.18:33894) 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 -- 172.21.15.18:0/1907670774 learned_addr learned my addr 172.21.15.18:0/1907670774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d4be00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c1658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d4b400640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 0x7f6d4c0c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 -- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 msgr2=0x7f6d4c0c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 0x7f6d4c0c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 -- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c0b21b0 msgr2=0x7f6d4c1658f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c1658f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 -- 172.21.15.18:0/1907670774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0cf9a0 con 0x7f6d4c15efa0 2024-04-25T10:12:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d4b400640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 0x7f6d4c0c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:46.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d50c00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6d440af040 tx=0x7f6d440197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44009510 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d440be070 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440b88b0 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d4c157b50 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c158110 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c04efa0 con 0x7f6d4c15efa0 2024-04-25T10:12:46.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.804+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d440b8a50 con 0x7f6d4c15efa0 2024-04-25T10:12:46.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.808+0000 7f6d43e00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 0x7f6d2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:46.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.808+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d44120360 con 0x7f6d4c15efa0 2024-04-25T10:12:46.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.808+0000 7f6d4be00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 0x7f6d2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:46.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.808+0000 7f6d4be00640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 0x7f6d2c069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009950 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:46.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.812+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d44016620 con 0x7f6d4c15efa0 2024-04-25T10:12:46.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.972+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d4c1598d0 con 0x7f6d4c15efa0 2024-04-25T10:12:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.972+0000 7f6d43e00640 1 -- 172.21.15.18:0/1907670774 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16860 (secure 0 0 0) 0x7f6d440f1260 con 0x7f6d4c15efa0 2024-04-25T10:12:46.982 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:46.982 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":108,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:40.385081+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 msgr2=0x7f6d2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 0x7f6d2c069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009950 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 msgr2=0x7f6d4c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6d440af040 tx=0x7f6d440197d0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 shutdown_connections 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c15efa0 0x7f6d4c06d570 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6d2c066f60 0x7f6d2c069420 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6d4c0cdb70 0x7f6d4c0c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 --2- 172.21.15.18:0/1907670774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d4c0b21b0 0x7f6d4c1658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 >> 172.21.15.18:0/1907670774 conn(0x7f6d4c0b3050 msgr2=0x7f6d4c0ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 shutdown_connections 2024-04-25T10:12:46.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:46.976+0000 7f6d51600640 1 -- 172.21.15.18:0/1907670774 wait complete. 2024-04-25T10:12:47.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:12:37.178779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:12:37.765414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:47.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 Processor -- start 2024-04-25T10:12:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 -- start start 2024-04-25T10:12:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f611815dd90 0x7f6118071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6118072040 0x7f6118161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6118072460 con 0x7f6118161cc0 2024-04-25T10:12:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61180b2dc0 con 0x7f611815dd90 2024-04-25T10:12:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611f800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f611806ac10 con 0x7f6118072040 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611ce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f611815dd90 0x7f6118071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611ce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f611815dd90 0x7f6118071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33896/0 (socket says 172.21.15.18:33896) 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f611ce00640 1 -- 172.21.15.18:0/988568020 learned_addr learned my addr 172.21.15.18:0/988568020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.140+0000 7f610fe00640 1 --2- 172.21.15.18:0/988568020 >> v2:172.21.15.167:3300/0 conn(0x7f6118072040 0x7f6118161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611ce00640 1 -- 172.21.15.18:0/988568020 >> v2:172.21.15.167:3300/0 conn(0x7f6118072040 msgr2=0x7f6118161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611ce00640 1 --2- 172.21.15.18:0/988568020 >> v2:172.21.15.167:3300/0 conn(0x7f6118072040 0x7f6118161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611ce00640 1 -- 172.21.15.18:0/988568020 >> v1:172.21.15.167:6789/0 conn(0x7f6118161cc0 legacy=0x7f61180cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611ce00640 1 -- 172.21.15.18:0/988568020 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611806aeb0 con 0x7f611815dd90 2024-04-25T10:12:47.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611ce00640 1 --2- 172.21.15.18:0/988568020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611815dd90 0x7f6118071b00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f61180d0cc0 tx=0x7f610801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8b51f7373b2b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f6117e00640 1 -- 172.21.15.18:0/988568020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080b2070 con 0x7f611815dd90 2024-04-25T10:12:47.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f6117e00640 1 -- 172.21.15.18:0/988568020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080a9070 con 0x7f611815dd90 2024-04-25T10:12:47.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f6117e00640 1 -- 172.21.15.18:0/988568020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080ad880 con 0x7f611815dd90 2024-04-25T10:12:47.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 -- 172.21.15.18:0/988568020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611815dd90 msgr2=0x7f6118071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 --2- 172.21.15.18:0/988568020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611815dd90 0x7f6118071b00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f61180d0cc0 tx=0x7f610801c490 comp rx=0 tx=0).stop 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 -- 172.21.15.18:0/988568020 shutdown_connections 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 --2- 172.21.15.18:0/988568020 >> v2:172.21.15.167:3300/0 conn(0x7f6118072040 0x7f6118161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 --2- 172.21.15.18:0/988568020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611815dd90 0x7f6118071b00 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.144+0000 7f611f800640 1 -- 172.21.15.18:0/988568020 >> 172.21.15.18:0/988568020 conn(0x7f61180cfd90 msgr2=0x7f61180d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- 172.21.15.18:0/988568020 shutdown_connections 2024-04-25T10:12:47.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- 172.21.15.18:0/988568020 wait complete. 2024-04-25T10:12:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 Processor -- start 2024-04-25T10:12:47.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- start start 2024-04-25T10:12:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 0x7f61181551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6118161cc0 0x7f61180b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f611816aac0 con 0x7f6118072040 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61181624e0 con 0x7f611815dd90 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f611816ac40 con 0x7f6118161cc0 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33904/0 (socket says 172.21.15.18:33904) 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 -- 172.21.15.18:0/2141019913 learned_addr learned my addr 172.21.15.18:0/2141019913 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f610fe00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 0x7f61181551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611d800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6118161cc0 0x7f61180b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 -- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6118161cc0 msgr2=0x7f61180b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6118161cc0 0x7f61180b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 -- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 msgr2=0x7f61181551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 0x7f61181551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 -- 172.21.15.18:0/2141019913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180b45e0 con 0x7f6118072040 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f610fe00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 0x7f61181551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:47.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611ce00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f61080190a0 tx=0x7f6108019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080bb070 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61080adce0 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6118150fc0 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.148+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61080b2040 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6118151580 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61180745d0 con 0x7f6118072040 2024-04-25T10:12:47.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f61080be070 con 0x7f6118072040 2024-04-25T10:12:47.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f6115600640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 0x7f60f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f610811e1f0 con 0x7f6118072040 2024-04-25T10:12:47.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f610fe00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 0x7f60f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.152+0000 7f610fe00640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 0x7f60f4069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f611815bfb0 tx=0x7f6100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.156+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6108016110 con 0x7f6118072040 2024-04-25T10:12:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.320+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6118155880 con 0x7f6118072040 2024-04-25T10:12:47.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.320+0000 7f6115600640 1 -- 172.21.15.18:0/2141019913 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61080eefd0 con 0x7f6118072040 2024-04-25T10:12:47.329 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 msgr2=0x7f60f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 0x7f60f4069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f611815bfb0 tx=0x7f6100008040 comp rx=0 tx=0).stop 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 msgr2=0x7f61180b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f61080190a0 tx=0x7f6108019230 comp rx=0 tx=0).stop 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 shutdown_connections 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f60f4066f60 0x7f60f4069420 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6118161cc0 0x7f61180b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f611815dd90 0x7f61181551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 --2- 172.21.15.18:0/2141019913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6118072040 0x7f61180b4000 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 >> 172.21.15.18:0/2141019913 conn(0x7f61180cfd90 msgr2=0x7f61180ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:47.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 shutdown_connections 2024-04-25T10:12:47.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.324+0000 7f611f800640 1 -- 172.21.15.18:0/2141019913 wait complete. 2024-04-25T10:12:47.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:12:47.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.488+0000 7fb23e400640 1 Processor -- start 2024-04-25T10:12:47.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.488+0000 7fb23e400640 1 -- start start 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb23e400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb238159320 0x7fb23815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb23e400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb23815f440 0x7fb23806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb23e400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb23815fc00 con 0x7fb23806e010 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb23e400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23806d640 con 0x7fb238159320 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb23e400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23815fee0 con 0x7fb23815f440 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb238159320 0x7fb23815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb238159320 0x7fb23815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33906/0 (socket says 172.21.15.18:33906) 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb23806e010 0x7fb23806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43258/0 (socket says 172.21.15.18:43258) 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 -- 172.21.15.18:0/443869526 learned_addr learned my addr 172.21.15.18:0/443869526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb22ea00640 1 --2- 172.21.15.18:0/443869526 >> v2:172.21.15.167:3300/0 conn(0x7fb23815f440 0x7fb23806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 -- 172.21.15.18:0/443869526 >> v2:172.21.15.167:3300/0 conn(0x7fb23815f440 msgr2=0x7fb23806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 --2- 172.21.15.18:0/443869526 >> v2:172.21.15.167:3300/0 conn(0x7fb23815f440 0x7fb23806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 -- 172.21.15.18:0/443869526 >> v1:172.21.15.18:6789/0 conn(0x7fb23806e010 legacy=0x7fb23806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.492+0000 7fb237400640 1 -- 172.21.15.18:0/443869526 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2381601c0 con 0x7fb238159320 2024-04-25T10:12:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb237400640 1 --2- 172.21.15.18:0/443869526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb23815c9b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb2380b4b50 tx=0x7fb22801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f2326b85d0e6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb236a00640 1 -- 172.21.15.18:0/443869526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280a5810 con 0x7fb238159320 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb236a00640 1 -- 172.21.15.18:0/443869526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2280a59b0 con 0x7fb238159320 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb236a00640 1 -- 172.21.15.18:0/443869526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2280a5d80 con 0x7fb238159320 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- 172.21.15.18:0/443869526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 msgr2=0x7fb23815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 --2- 172.21.15.18:0/443869526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb23815c9b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fb2380b4b50 tx=0x7fb22801c930 comp rx=0 tx=0).stop 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- 172.21.15.18:0/443869526 shutdown_connections 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 --2- 172.21.15.18:0/443869526 >> v2:172.21.15.167:3300/0 conn(0x7fb23815f440 0x7fb23806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 --2- 172.21.15.18:0/443869526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb23815c9b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- 172.21.15.18:0/443869526 >> 172.21.15.18:0/443869526 conn(0x7fb238067080 msgr2=0x7fb23806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- 172.21.15.18:0/443869526 shutdown_connections 2024-04-25T10:12:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- 172.21.15.18:0/443869526 wait complete. 2024-04-25T10:12:47.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 Processor -- start 2024-04-25T10:12:47.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.496+0000 7fb23e400640 1 -- start start 2024-04-25T10:12:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb23806e010 0x7fb2380b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb23815f440 0x7fb238144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23815f9a0 con 0x7fb238159320 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb23815f820 con 0x7fb23806e010 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb23806ebb0 con 0x7fb23815f440 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33916/0 (socket says 172.21.15.18:33916) 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 -- 172.21.15.18:0/3017942048 learned_addr learned my addr 172.21.15.18:0/3017942048 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb237400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb23806e010 0x7fb2380b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb237e00640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb23815f440 0x7fb238144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 -- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb23815f440 msgr2=0x7fb238144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb23815f440 0x7fb238144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 -- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb23806e010 msgr2=0x7fb2380b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb23806e010 0x7fb2380b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 -- 172.21.15.18:0/3017942048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238144bf0 con 0x7fb238159320 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22ea00640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb22000d5f0 tx=0x7fb22000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200125f0 con 0x7fb238159320 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb220019070 con 0x7fb238159320 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2200129b0 con 0x7fb238159320 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb238144ed0 con 0x7fb238159320 2024-04-25T10:12:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2380b3c80 con 0x7fb238159320 2024-04-25T10:12:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2380b4720 con 0x7fb238159320 2024-04-25T10:12:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.500+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb220012b50 con 0x7fb238159320 2024-04-25T10:12:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.504+0000 7fb22fe00640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 0x7fb214069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.504+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb2200855e0 con 0x7fb238159320 2024-04-25T10:12:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.504+0000 7fb237400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 0x7fb214069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.504+0000 7fb237400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 0x7fb214069450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ae000 tx=0x7fb2280a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.508+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb220056330 con 0x7fb238159320 2024-04-25T10:12:47.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.664+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2380745d0 con 0x7fb238159320 2024-04-25T10:12:47.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb22fe00640 1 -- 172.21.15.18:0/3017942048 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb220055c30 con 0x7fb238159320 2024-04-25T10:12:47.675 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 msgr2=0x7fb214069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 0x7fb214069450 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fb2280ae000 tx=0x7fb2280a7070 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 msgr2=0x7fb238143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fb22000d5f0 tx=0x7fb22000dab0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 shutdown_connections 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb214066f90 0x7fb214069450 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb23815f440 0x7fb238144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb238159320 0x7fb238143d40 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 --2- 172.21.15.18:0/3017942048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb23806e010 0x7fb2380b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 >> 172.21.15.18:0/3017942048 conn(0x7fb238067080 msgr2=0x7fb2380cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:47.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 shutdown_connections 2024-04-25T10:12:47.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.668+0000 7fb23e400640 1 -- 172.21.15.18:0/3017942048 wait complete. 2024-04-25T10:12:47.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:12:47.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 Processor -- start 2024-04-25T10:12:47.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 -- start start 2024-04-25T10:12:47.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c48071270 0x7f1c48071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4806db20 con 0x7f1c4815e770 2024-04-25T10:12:47.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c4806de00 con 0x7f1c48071270 2024-04-25T10:12:47.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4806e0e0 con 0x7f1c4815eb50 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:35074/0 (socket says 172.21.15.18:35074) 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4da00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c48071270 0x7f1c48071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 -- 172.21.15.18:0/2574268147 learned_addr learned my addr 172.21.15.18:0/2574268147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c4d000640 1 --1- 172.21.15.18:0/2574268147 >> v1:172.21.15.167:6789/0 conn(0x7f1c4815e770 0x7f1c4806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:51488/0 (socket says 172.21.15.18:51488) 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 -- 172.21.15.18:0/2574268147 >> v2:172.21.15.167:3300/0 conn(0x7f1c48071270 msgr2=0x7f1c48071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 --2- 172.21.15.18:0/2574268147 >> v2:172.21.15.167:3300/0 conn(0x7f1c48071270 0x7f1c48071700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 -- 172.21.15.18:0/2574268147 >> v1:172.21.15.167:6789/0 conn(0x7f1c4815e770 legacy=0x7f1c4806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.832+0000 7f1c3fe00640 1 -- 172.21.15.18:0/2574268147 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480ae040 con 0x7f1c4815eb50 2024-04-25T10:12:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c3fe00640 1 --2- 172.21.15.18:0/2574268147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49113606eda08492 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c47e00640 1 -- 172.21.15.18:0/2574268147 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300b1070 con 0x7f1c4815eb50 2024-04-25T10:12:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c47e00640 1 -- 172.21.15.18:0/2574268147 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c300a8050 con 0x7f1c4815eb50 2024-04-25T10:12:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c47e00640 1 -- 172.21.15.18:0/2574268147 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c300ac860 con 0x7f1c4815eb50 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 -- 172.21.15.18:0/2574268147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 msgr2=0x7f1c4815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/2574268147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1c30009870 tx=0x7f1c3001c4d0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 -- 172.21.15.18:0/2574268147 shutdown_connections 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/2574268147 >> v2:172.21.15.167:3300/0 conn(0x7f1c48071270 0x7f1c48071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/2574268147 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c4815eb50 0x7f1c4815f230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 -- 172.21.15.18:0/2574268147 >> 172.21.15.18:0/2574268147 conn(0x7f1c48067080 msgr2=0x7f1c4806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 -- 172.21.15.18:0/2574268147 shutdown_connections 2024-04-25T10:12:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.836+0000 7f1c4fa00640 1 -- 172.21.15.18:0/2574268147 wait complete. 2024-04-25T10:12:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 Processor -- start 2024-04-25T10:12:47.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 -- start start 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c48071270 0x7f1c4815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c4815e770 0x7f1c4813d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480aeef0 con 0x7f1c4815eb50 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480aed70 con 0x7f1c4815e770 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480af070 con 0x7f1c48071270 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33932/0 (socket says 172.21.15.18:33932) 2024-04-25T10:12:47.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 -- 172.21.15.18:0/207692219 learned_addr learned my addr 172.21.15.18:0/207692219 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:47.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c3fe00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c4815e770 0x7f1c4813d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4d000640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c48071270 0x7f1c4815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 -- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c48071270 msgr2=0x7f1c4815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c48071270 0x7f1c4815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 -- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c4815e770 msgr2=0x7f1c4813d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c4815e770 0x7f1c4813d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 -- 172.21.15.18:0/207692219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4813e270 con 0x7f1c4815eb50 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4da00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000e7f0 tx=0x7f1c4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40017070 con 0x7f1c4815eb50 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4000c940 con 0x7f1c4815eb50 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.840+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c48156720 con 0x7f1c4815eb50 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000eea0 con 0x7f1c4815eb50 2024-04-25T10:12:47.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c48156f60 con 0x7f1c4815eb50 2024-04-25T10:12:47.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c480745d0 con 0x7f1c4815eb50 2024-04-25T10:12:47.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1c4001a070 con 0x7f1c4815eb50 2024-04-25T10:12:47.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c45600640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 0x7f1c24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:47.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1c40085090 con 0x7f1c4815eb50 2024-04-25T10:12:47.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.844+0000 7f1c4d000640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 0x7f1c24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:47.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.848+0000 7f1c4d000640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 0x7f1c24069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1c380012f0 tx=0x7f1c38001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:47.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:47.848+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1c48156720 con 0x7f1c4815eb50 2024-04-25T10:12:48.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.012+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c4806e8d0 con 0x7f1c4815eb50 2024-04-25T10:12:48.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c45600640 1 -- 172.21.15.18:0/207692219 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c40055820 con 0x7f1c4815eb50 2024-04-25T10:12:48.023 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 msgr2=0x7f1c24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 0x7f1c24069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f1c380012f0 tx=0x7f1c38001640 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 msgr2=0x7f1c4813dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000e7f0 tx=0x7f1c4000ecb0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 shutdown_connections 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c4815eb50 0x7f1c4813dd30 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c4815e770 0x7f1c4813d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1c24066f60 0x7f1c24069420 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 --2- 172.21.15.18:0/207692219 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c48071270 0x7f1c4815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 >> 172.21.15.18:0/207692219 conn(0x7f1c48067080 msgr2=0x7f1c4815d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 shutdown_connections 2024-04-25T10:12:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.016+0000 7f1c4fa00640 1 -- 172.21.15.18:0/207692219 wait complete. 2024-04-25T10:12:48.044 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:12:48.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 Processor -- start 2024-04-25T10:12:48.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 -- start start 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97b015b9c0 0x7f97b006fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b00705e0 con 0x7f97b00700c0 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97b00708c0 con 0x7f97b00d0190 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97af200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97b0070ba0 con 0x7f97b015b9c0 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97b015b9c0 0x7f97b006fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97b015b9c0 0x7f97b006fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33948/0 (socket says 172.21.15.18:33948) 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 -- 172.21.15.18:0/1984140854 learned_addr learned my addr 172.21.15.18:0/1984140854 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:48.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ad400640 1 --1- 172.21.15.18:0/1984140854 >> v1:172.21.15.18:6789/0 conn(0x7f97b00700c0 0x7f97b00cfa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43272/0 (socket says 172.21.15.18:43272) 2024-04-25T10:12:48.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 -- 172.21.15.18:0/1984140854 >> v1:172.21.15.167:6789/0 conn(0x7f97b00d0190 legacy=0x7f97b00cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:48.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 -- 172.21.15.18:0/1984140854 >> v1:172.21.15.18:6789/0 conn(0x7f97b00700c0 legacy=0x7f97b00cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97ade00640 1 -- 172.21.15.18:0/1984140854 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b0070e80 con 0x7f97b015b9c0 2024-04-25T10:12:48.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.180+0000 7f97aca00640 1 -- 172.21.15.18:0/1984140854 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120518880 0 0) 0x7f97b00705e0 con 0x7f97b00700c0 2024-04-25T10:12:48.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97ade00640 1 --2- 172.21.15.18:0/1984140854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b006fb80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009870 tx=0x7f97a001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4583d7d28f8e6840 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97aca00640 1 -- 172.21.15.18:0/1984140854 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00b2070 con 0x7f97b015b9c0 2024-04-25T10:12:48.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97aca00640 1 -- 172.21.15.18:0/1984140854 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a00a9070 con 0x7f97b015b9c0 2024-04-25T10:12:48.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97aca00640 1 -- 172.21.15.18:0/1984140854 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a00ad880 con 0x7f97b015b9c0 2024-04-25T10:12:48.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- 172.21.15.18:0/1984140854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 msgr2=0x7f97b006fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 --2- 172.21.15.18:0/1984140854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b006fb80 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009870 tx=0x7f97a001c560 comp rx=0 tx=0).stop 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- 172.21.15.18:0/1984140854 shutdown_connections 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 --2- 172.21.15.18:0/1984140854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b006fb80 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- 172.21.15.18:0/1984140854 >> 172.21.15.18:0/1984140854 conn(0x7f97b00d1630 msgr2=0x7f97b00d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- 172.21.15.18:0/1984140854 shutdown_connections 2024-04-25T10:12:48.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- 172.21.15.18:0/1984140854 wait complete. 2024-04-25T10:12:48.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 Processor -- start 2024-04-25T10:12:48.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.184+0000 7f97af200640 1 -- start start 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 0x7f97b0151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 0x7f97b0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00cd380 con 0x7f97b015b9c0 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b00cd200 con 0x7f97b00d0190 2024-04-25T10:12:48.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97b0169760 con 0x7f97b00700c0 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33956/0 (socket says 172.21.15.18:33956) 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 -- 172.21.15.18:0/3674226767 learned_addr learned my addr 172.21.15.18:0/3674226767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ad400640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 0x7f97b0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 -- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 msgr2=0x7f97b0151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ade00640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 0x7f97b0151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 0x7f97b0151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 -- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 msgr2=0x7f97b0151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 0x7f97b0151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 -- 172.21.15.18:0/3674226767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00b2c20 con 0x7f97b015b9c0 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ad400640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 0x7f97b0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ade00640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 0x7f97b0151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:48.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97ae800640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c730 tx=0x7f97a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a8003b80 con 0x7f97b015b9c0 2024-04-25T10:12:48.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a8003d20 con 0x7f97b015b9c0 2024-04-25T10:12:48.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b0164a40 con 0x7f97b015b9c0 2024-04-25T10:12:48.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a800aa30 con 0x7f97b015b9c0 2024-04-25T10:12:48.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b00b2ee0 con 0x7f97b015b9c0 2024-04-25T10:12:48.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97b00b30e0 con 0x7f97b015b9c0 2024-04-25T10:12:48.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.188+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97a800abd0 con 0x7f97b015b9c0 2024-04-25T10:12:48.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.192+0000 7f97a6000640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 0x7f9790069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.192+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f97a8084ff0 con 0x7f97b015b9c0 2024-04-25T10:12:48.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.192+0000 7f97ade00640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 0x7f9790069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.192+0000 7f97ade00640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 0x7f9790069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f97a00af000 tx=0x7f97a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.196+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97b00b30e0 con 0x7f97b015b9c0 2024-04-25T10:12:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f97b00745d0 con 0x7f97b015b9c0 2024-04-25T10:12:48.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97a6000640 1 -- 172.21.15.18:0/3674226767 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v108) v1 ==== 80+0+0 (secure 0 0 0) 0x7f97a8055ec0 con 0x7f97b015b9c0 2024-04-25T10:12:48.379 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 msgr2=0x7f9790069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 0x7f9790069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f97a00af000 tx=0x7f97a0008040 comp rx=0 tx=0).stop 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 msgr2=0x7f97b00b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f97a800c730 tx=0x7f97a800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 shutdown_connections 2024-04-25T10:12:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97b015b9c0 0x7f97b00b3400 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f97b00d0190 0x7f97b0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9790066f60 0x7f9790069420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 --2- 172.21.15.18:0/3674226767 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f97b00700c0 0x7f97b0151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 >> 172.21.15.18:0/3674226767 conn(0x7f97b00d1630 msgr2=0x7f97b0159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 shutdown_connections 2024-04-25T10:12:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.372+0000 7f97af200640 1 -- 172.21.15.18:0/3674226767 wait complete. 2024-04-25T10:12:48.400 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:12:48.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:48.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:48.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:12:48.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:48.430 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:12:48.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:48.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.660+0000 7f1a31a00640 1 Processor -- start 2024-04-25T10:12:48.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.660+0000 7f1a31a00640 1 -- start start 2024-04-25T10:12:48.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a31a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 0x7f1a2c0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a31a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c15ddf0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a31a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c06b480 con 0x7f1a2c0d11b0 2024-04-25T10:12:48.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a31a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0d06d0 con 0x7f1a2c15da10 2024-04-25T10:12:48.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1a2c0b4210 0x7f1a2c1615b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43286/0 (socket says 172.21.15.18:43286) 2024-04-25T10:12:48.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2b400640 1 -- 172.21.15.18:0/2893948258 learned_addr learned my addr 172.21.15.18:0/2893948258 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/2893948258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 0x7f1a2c0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667636070 0 0) 0x7f1a2c15ddf0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10003530 con 0x7f1a2c0b4210 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416385342 0 0) 0x7f1a2c06b480 con 0x7f1a2c0d11b0 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a2c15ddf0 con 0x7f1a2c0d11b0 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2aa00640 1 -- 172.21.15.18:0/2893948258 >> v1:172.21.15.167:6789/0 conn(0x7f1a2c0d11b0 legacy=0x7f1a2c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2aa00640 1 -- 172.21.15.18:0/2893948258 >> v1:172.21.15.18:6789/0 conn(0x7f1a2c0b4210 legacy=0x7f1a2c1615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.664+0000 7f1a2aa00640 1 -- 172.21.15.18:0/2893948258 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0d09b0 con 0x7f1a2c15da10 2024-04-25T10:12:48.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/2893948258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 0x7f1a2c0afe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec57fc4f5791f29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b0070 con 0x7f1a2c15da10 2024-04-25T10:12:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0ab600 con 0x7f1a2c15da10 2024-04-25T10:12:48.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a2a000640 1 -- 172.21.15.18:0/2893948258 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0ab9d0 con 0x7f1a2c15da10 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- 172.21.15.18:0/2893948258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 msgr2=0x7f1a2c0afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 --2- 172.21.15.18:0/2893948258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 0x7f1a2c0afe20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c01c450 comp rx=0 tx=0).stop 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- 172.21.15.18:0/2893948258 shutdown_connections 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 --2- 172.21.15.18:0/2893948258 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c15da10 0x7f1a2c0afe20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- 172.21.15.18:0/2893948258 >> 172.21.15.18:0/2893948258 conn(0x7f1a2c0b2400 msgr2=0x7f1a2c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- 172.21.15.18:0/2893948258 shutdown_connections 2024-04-25T10:12:48.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- 172.21.15.18:0/2893948258 wait complete. 2024-04-25T10:12:48.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 Processor -- start 2024-04-25T10:12:48.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- start start 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0d11b0 0x7f1a2c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15da10 0x7f1a2c139c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c16bcf0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c16bb70 con 0x7f1a2c15da10 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.668+0000 7f1a31a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c16be70 con 0x7f1a2c0d11b0 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33960/0 (socket says 172.21.15.18:33960) 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 -- 172.21.15.18:0/3356270134 learned_addr learned my addr 172.21.15.18:0/3356270134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:48.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2b400640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15da10 0x7f1a2c139c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a22000640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0d11b0 0x7f1a2c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 -- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0d11b0 msgr2=0x7f1a2c15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0d11b0 0x7f1a2c15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 -- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15da10 msgr2=0x7f1a2c139c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15da10 0x7f1a2c139c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 -- 172.21.15.18:0/3356270134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c1519b0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a2aa00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b9020 con 0x7f1a2c0b4210 2024-04-25T10:12:48.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1c0b5480 con 0x7f1a2c0b4210 2024-04-25T10:12:48.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0b0040 con 0x7f1a2c0b4210 2024-04-25T10:12:48.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0c9b20 con 0x7f1a2c0b4210 2024-04-25T10:12:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c0ca0e0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0745d0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.672+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a1c0bc020 con 0x7f1a2c0b4210 2024-04-25T10:12:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.676+0000 7f1a23400640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 0x7f1a08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.676+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a1c11f190 con 0x7f1a2c0b4210 2024-04-25T10:12:48.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.676+0000 7f1a22000640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 0x7f1a08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:48.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.676+0000 7f1a22000640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 0x7f1a08069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1a14007fd0 tx=0x7f1a14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:48.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.676+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a1c0160d0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a2c154da0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a23400640 1 -- 172.21.15.18:0/3356270134 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4943 (secure 0 0 0) 0x7f1a1c0f00a0 con 0x7f1a2c0b4210 2024-04-25T10:12:48.883 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:48.883 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:12:41.782127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":36905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36905":{"gid":36905,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/81610203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":81610203},{"type":"v1","addr":"172.21.15.167:6837","nonce":81610203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:12:48.884 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 msgr2=0x7f1a08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 0x7f1a08069420 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f1a14007fd0 tx=0x7f1a14009040 comp rx=0 tx=0).stop 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 msgr2=0x7f1a2c0ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0097f0 tx=0x7f1a1c0191f0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 shutdown_connections 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1a2c15da10 0x7f1a2c139c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1a08066f60 0x7f1a08069420 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1a2c0d11b0 0x7f1a2c15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 --2- 172.21.15.18:0/3356270134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a2c0b4210 0x7f1a2c0ca8e0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:48.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 >> 172.21.15.18:0/3356270134 conn(0x7f1a2c0b2400 msgr2=0x7f1a2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:48.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 shutdown_connections 2024-04-25T10:12:48.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:48.876+0000 7f1a31a00640 1 -- 172.21.15.18:0/3356270134 wait complete. 2024-04-25T10:12:48.904 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T10:12:49.075 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:12:49.076 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:12:49.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:49.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.208+0000 7fc4e5a00640 1 Processor -- start 2024-04-25T10:12:49.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.208+0000 7fc4e5a00640 1 -- start start 2024-04-25T10:12:49.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4e5a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4e0144140 0x7fc4e00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4e5a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 0x7fc4e006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4e5a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e015ac60 con 0x7fc4e006e900 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4e5a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e006ed30 con 0x7fc4e0144140 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4e5a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00cf3e0 con 0x7fc4e00ced60 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc4e0144140 0x7fc4e00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4df400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4e006e900 0x7fc4e015e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43302/0 (socket says 172.21.15.18:43302) 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4df400640 1 -- 172.21.15.18:0/2941941627 learned_addr learned my addr 172.21.15.18:0/2941941627 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4d6000640 1 --2- 172.21.15.18:0/2941941627 >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 0x7fc4e006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 -- 172.21.15.18:0/2941941627 >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 msgr2=0x7fc4e006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 --2- 172.21.15.18:0/2941941627 >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 0x7fc4e006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 -- 172.21.15.18:0/2941941627 >> v1:172.21.15.18:6789/0 conn(0x7fc4e006e900 legacy=0x7fc4e015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 -- 172.21.15.18:0/2941941627 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e015af20 con 0x7fc4e0144140 2024-04-25T10:12:49.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4d6000640 1 --2- 172.21.15.18:0/2941941627 >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 0x7fc4e006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:49.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.212+0000 7fc4dea00640 1 --2- 172.21.15.18:0/2941941627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e0144140 0x7fc4e00ce820 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc4e006efb0 tx=0x7fc4d001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9c2751eb45b926 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4de000640 1 -- 172.21.15.18:0/2941941627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00b0070 con 0x7fc4e0144140 2024-04-25T10:12:49.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4de000640 1 -- 172.21.15.18:0/2941941627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ab600 con 0x7fc4e0144140 2024-04-25T10:12:49.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4de000640 1 -- 172.21.15.18:0/2941941627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00ab9d0 con 0x7fc4e0144140 2024-04-25T10:12:49.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- 172.21.15.18:0/2941941627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e0144140 msgr2=0x7fc4e00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/2941941627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e0144140 0x7fc4e00ce820 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7fc4e006efb0 tx=0x7fc4d001c480 comp rx=0 tx=0).stop 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- 172.21.15.18:0/2941941627 shutdown_connections 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/2941941627 >> v2:172.21.15.167:3300/0 conn(0x7fc4e00ced60 0x7fc4e006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/2941941627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e0144140 0x7fc4e00ce820 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- 172.21.15.18:0/2941941627 >> 172.21.15.18:0/2941941627 conn(0x7fc4e0066fa0 msgr2=0x7fc4e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- 172.21.15.18:0/2941941627 shutdown_connections 2024-04-25T10:12:49.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- 172.21.15.18:0/2941941627 wait complete. 2024-04-25T10:12:49.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 Processor -- start 2024-04-25T10:12:49.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- start start 2024-04-25T10:12:49.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e00ced60 0x7fc4e012cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0144140 0x7fc4e013e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0144520 con 0x7fc4e006e900 2024-04-25T10:12:49.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cf170 con 0x7fc4e0144140 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4e5a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015ba00 con 0x7fc4e00ced60 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4dea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33976/0 (socket says 172.21.15.18:33976) 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4dea00640 1 -- 172.21.15.18:0/1463508598 learned_addr learned my addr 172.21.15.18:0/1463508598 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.216+0000 7fc4df400640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0144140 0x7fc4e013e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4d6000640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e00ced60 0x7fc4e012cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 -- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e00ced60 msgr2=0x7fc4e012cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e00ced60 0x7fc4e012cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 -- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0144140 msgr2=0x7fc4e013e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0144140 0x7fc4e013e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 -- 172.21.15.18:0/1463508598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e012b9c0 con 0x7fc4e006e900 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4dea00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00ae040 tx=0x7fc4d0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00b0040 con 0x7fc4e006e900 2024-04-25T10:12:49.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d00ba070 con 0x7fc4e006e900 2024-04-25T10:12:49.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00b4630 con 0x7fc4e006e900 2024-04-25T10:12:49.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e012bca0 con 0x7fc4e006e900 2024-04-25T10:12:49.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e012c260 con 0x7fc4e006e900 2024-04-25T10:12:49.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00745d0 con 0x7fc4e006e900 2024-04-25T10:12:49.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.220+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4d00b47d0 con 0x7fc4e006e900 2024-04-25T10:12:49.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.224+0000 7fc4d7400640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 0x7fc4bc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.224+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc4d011ef40 con 0x7fc4e006e900 2024-04-25T10:12:49.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.224+0000 7fc4d6000640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 0x7fc4bc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.224+0000 7fc4d6000640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 0x7fc4bc069450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc4e01646d0 tx=0x7fc4c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.228+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4d0016070 con 0x7fc4e006e900 2024-04-25T10:12:49.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4e0154e30 con 0x7fc4e006e900 2024-04-25T10:12:49.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4d7400640 1 -- 172.21.15.18:0/1463508598 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fc4d00efd20 con 0x7fc4e006e900 2024-04-25T10:12:49.432 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:49.432 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:12:41.782127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":36905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36905":{"gid":36905,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/81610203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":81610203},{"type":"v1","addr":"172.21.15.167:6837","nonce":81610203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:12:49.432 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-04-25T10:12:49.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 msgr2=0x7fc4bc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 0x7fc4bc069450 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc4e01646d0 tx=0x7fc4c8008040 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 msgr2=0x7fc4e012cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fc4d00ae040 tx=0x7fc4d0019220 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 shutdown_connections 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc4e0144140 0x7fc4e013e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc4bc066f90 0x7fc4bc069450 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc4e00ced60 0x7fc4e012cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 --2- 172.21.15.18:0/1463508598 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4e006e900 0x7fc4e012cab0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.424+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 >> 172.21.15.18:0/1463508598 conn(0x7fc4e0066fa0 msgr2=0x7fc4e006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.428+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 shutdown_connections 2024-04-25T10:12:49.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.428+0000 7fc4e5a00640 1 -- 172.21.15.18:0/1463508598 wait complete. 2024-04-25T10:12:49.455 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T10:12:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 Processor -- start 2024-04-25T10:12:49.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 -- start start 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 0x558b191830e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 0x558b19183620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b19218370 con 0x558b19173d50 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b190e69f0 con 0x558b1918b170 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b256f0080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b192184f0 con 0x558b19217570 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b22a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b22a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33988/0 (socket says 172.21.15.18:33988) 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.492+0000 7f8b22a00640 1 -- 172.21.15.18:0/3919986916 learned_addr learned my addr 172.21.15.18:0/3919986916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 0x558b19183620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22000640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 0x558b191830e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 -- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 msgr2=0x558b19183620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 0x558b19183620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 -- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 msgr2=0x558b191830e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 0x558b191830e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 -- 172.21.15.18:0/3919986916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b19213770 con 0x558b19173d50 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 0x558b19183620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22000640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 0x558b191830e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad040 tx=0x7f8b14003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711713c27fc9f9f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b20c00640 1 -- 172.21.15.18:0/3919986916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b140af070 con 0x558b19173d50 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b20c00640 1 -- 172.21.15.18:0/3919986916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b140ba070 con 0x558b19173d50 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b20c00640 1 -- 172.21.15.18:0/3919986916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b140aad10 con 0x558b19173d50 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- 172.21.15.18:0/3919986916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 msgr2=0x558b19215480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad040 tx=0x7f8b14003030 comp rx=0 tx=0).stop 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- 172.21.15.18:0/3919986916 shutdown_connections 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b19217570 0x558b19183620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b1918b170 0x558b191830e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- 172.21.15.18:0/3919986916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19173d50 0x558b19215480 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- 172.21.15.18:0/3919986916 >> 172.21.15.18:0/3919986916 conn(0x558b19140440 msgr2=0x558b191723b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- 172.21.15.18:0/3919986916 shutdown_connections 2024-04-25T10:12:49.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- 172.21.15.18:0/3919986916 wait complete. 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 Processor -- start 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- start start 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b19173d50 0x558b19185ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b1918b170 0x558b191896d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 0x558b1920f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b19213cb0 con 0x558b19217570 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558b19213a10 con 0x558b19173d50 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b256f0080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558b192a8e00 con 0x558b1918b170 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 0x558b1920f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 0x558b1920f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33990/0 (socket says 172.21.15.18:33990) 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 -- 172.21.15.18:0/2380359849 learned_addr learned my addr 172.21.15.18:0/2380359849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22000640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b1918b170 0x558b191896d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b22a00640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b19173d50 0x558b19185ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 -- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b1918b170 msgr2=0x558b191896d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558b1918b170 0x558b191896d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 -- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b19173d50 msgr2=0x558b19185ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b19173d50 0x558b19185ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.496+0000 7f8b23400640 1 -- 172.21.15.18:0/2380359849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558b191861e0 con 0x558b19217570 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b23400640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 0x558b1920f980 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c270 tx=0x7f8b1c00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 -- 172.21.15.18:0/2380359849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017020 con 0x558b19217570 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 -- 172.21.15.18:0/2380359849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1c013670 con 0x558b19217570 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 -- 172.21.15.18:0/2380359849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c013a60 con 0x558b19217570 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558b19186480 con 0x558b19217570 2024-04-25T10:12:49.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558b192a9570 con 0x558b19217570 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 -- 172.21.15.18:0/2380359849 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b1c01a020 con 0x558b19217570 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04065970 0x7f8b04067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b1b400640 1 -- 172.21.15.18:0/2380359849 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b1c083fc0 con 0x558b19217570 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b256f0080 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558b19189c10 0x558b19187e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b22a00640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04065970 0x7f8b04067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e108) v9 -- 0x558b19188390 con 0x558b19189c10 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.500+0000 7f8b22000640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558b19189c10 0x558b19187e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b22a00640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04065970 0x7f8b04067e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad040 tx=0x7f8b140a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b22000640 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558b19189c10 0x558b19187e50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b22000640 1 -- 172.21.15.18:0/2380359849 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f8b1000d040 con 0x558b19189c10 2024-04-25T10:12:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558b19189c10 msgr2=0x558b19187e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558b19189c10 0x558b19187e50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04065970 msgr2=0x7f8b04067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8b04065970 0x7f8b04067e30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad040 tx=0x7f8b140a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 msgr2=0x558b1920f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 --2- 172.21.15.18:0/2380359849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558b19217570 0x558b1920f980 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00c270 tx=0x7f8b1c00c730 comp rx=0 tx=0).stop 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b23400640 1 -- 172.21.15.18:0/2380359849 reap_dead start 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 shutdown_connections 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 >> 172.21.15.18:0/2380359849 conn(0x558b19140440 msgr2=0x558b19215690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 shutdown_connections 2024-04-25T10:12:49.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.504+0000 7f8b256f0080 1 -- 172.21.15.18:0/2380359849 wait complete. 2024-04-25T10:12:49.515 INFO:teuthology.orchestra.run.smithi018.stdout:����� 2024-04-25T10:12:49.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:12:49.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.692+0000 7f5220e00640 1 Processor -- start 2024-04-25T10:12:49.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.692+0000 7f5220e00640 1 -- start start 2024-04-25T10:12:49.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5220e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f521c145270 0x7f521c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5220e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0cc4e0 con 0x7f521c0b1e60 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5220e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f521c0ce040 con 0x7f521c0cd4d0 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5220e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521c145650 con 0x7f521c145270 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5219e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f521c145270 0x7f521c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f521a800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f521c0b1e60 0x7f521c15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43314/0 (socket says 172.21.15.18:43314) 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5219e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f521c145270 0x7f521c15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34006/0 (socket says 172.21.15.18:34006) 2024-04-25T10:12:49.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f521a800640 1 -- 172.21.15.18:0/512177210 learned_addr learned my addr 172.21.15.18:0/512177210 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:49.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5219e00640 1 -- 172.21.15.18:0/512177210 >> v1:172.21.15.167:6789/0 conn(0x7f521c0cd4d0 legacy=0x7f521c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5219e00640 1 -- 172.21.15.18:0/512177210 >> v1:172.21.15.18:6789/0 conn(0x7f521c0b1e60 legacy=0x7f521c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.696+0000 7f5219e00640 1 -- 172.21.15.18:0/512177210 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c0ce320 con 0x7f521c145270 2024-04-25T10:12:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5219e00640 1 --2- 172.21.15.18:0/512177210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c145270 0x7f521c15fe50 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097c0 tx=0x7f520c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fda5f7ef4000739 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5219400640 1 -- 172.21.15.18:0/512177210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0a7070 con 0x7f521c145270 2024-04-25T10:12:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5219400640 1 -- 172.21.15.18:0/512177210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520c0b0070 con 0x7f521c145270 2024-04-25T10:12:49.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5219400640 1 -- 172.21.15.18:0/512177210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c0ab890 con 0x7f521c145270 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- 172.21.15.18:0/512177210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c145270 msgr2=0x7f521c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 --2- 172.21.15.18:0/512177210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c145270 0x7f521c15fe50 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f520c0097c0 tx=0x7f520c01c470 comp rx=0 tx=0).stop 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- 172.21.15.18:0/512177210 shutdown_connections 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 --2- 172.21.15.18:0/512177210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c145270 0x7f521c15fe50 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- 172.21.15.18:0/512177210 >> 172.21.15.18:0/512177210 conn(0x7f521c066fa0 msgr2=0x7f521c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- 172.21.15.18:0/512177210 shutdown_connections 2024-04-25T10:12:49.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- 172.21.15.18:0/512177210 wait complete. 2024-04-25T10:12:49.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 Processor -- start 2024-04-25T10:12:49.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.700+0000 7f5220e00640 1 -- start start 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f521c0b1e60 0x7f521c143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521c145270 0x7f521c0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c169720 con 0x7f521c0cd4d0 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521c0cdcc0 con 0x7f521c0b1e60 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f521c1698a0 con 0x7f521c145270 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34012/0 (socket says 172.21.15.18:34012) 2024-04-25T10:12:49.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 -- 172.21.15.18:0/2158170781 learned_addr learned my addr 172.21.15.18:0/2158170781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f521a800640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521c145270 0x7f521c0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5219e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f521c0b1e60 0x7f521c143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 -- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521c145270 msgr2=0x7f521c0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521c145270 0x7f521c0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 -- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f521c0b1e60 msgr2=0x7f521c143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f521c0b1e60 0x7f521c143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 -- 172.21.15.18:0/2158170781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521c1428d0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5211400640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f520400c500 tx=0x7f520400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204016020 con 0x7f521c0cd4d0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204005220 con 0x7f521c0cd4d0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204007030 con 0x7f521c0cd4d0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521c142b50 con 0x7f521c0cd4d0 2024-04-25T10:12:49.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521c143110 con 0x7f521c0cd4d0 2024-04-25T10:12:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c0745d0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.704+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52040071f0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.708+0000 7f5212a00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 0x7f51f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.708+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5204084ba0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.708+0000 7f5219e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 0x7f51f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:49.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.708+0000 7f5219e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 0x7f51f8069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f520c0af000 tx=0x7f520c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:49.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.712+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5204020020 con 0x7f521c0cd4d0 2024-04-25T10:12:49.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f521c13cfc0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5212a00640 1 -- 172.21.15.18:0/2158170781 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f521c1428d0 con 0x7f521c0cd4d0 2024-04-25T10:12:49.916 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 msgr2=0x7f51f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 0x7f51f8069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f520c0af000 tx=0x7f520c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 msgr2=0x7f521c0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f520400c500 tx=0x7f520400c9c0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 shutdown_connections 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51f8066f60 0x7f51f8069420 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f521c145270 0x7f521c0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f521c0cd4d0 0x7f521c0ae2c0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 --2- 172.21.15.18:0/2158170781 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f521c0b1e60 0x7f521c143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 >> 172.21.15.18:0/2158170781 conn(0x7f521c066fa0 msgr2=0x7f521c0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:49.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 shutdown_connections 2024-04-25T10:12:49.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:49.908+0000 7f5220e00640 1 -- 172.21.15.18:0/2158170781 wait complete. 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:12:49.937 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:49.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:49.938 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:12:49.947 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41935sec preferred_lft 41935sec 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.948 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:12:49.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:12:49.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:49.950 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:12:50.012 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:12:50.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.015 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:12:50.067 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:12:50.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.068 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:12:50.068 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:12:50.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:12:50.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:12:50.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:12:50.069 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:12:50.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.160 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:12:50.169 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:12:50.169 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:12:50.170 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:50.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:12:50.234 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:12:50.234 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:50.286 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:12:50.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:12:50.287 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:50.342 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:12:50.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:50.442 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:50.442 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:12:50.454 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:12:50.455 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:12:50.455 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:12:50.455 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:12:50.455 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:12:50.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:12:50.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:50.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.478 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:12:50.538 INFO:teuthology.orchestra.run.smithi018.stdout:client7948 2024-04-25T10:12:50.538 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:50.538 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:50.594 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:50.594 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:50.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.651 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:12:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records in 2024-04-25T10:12:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records out 2024-04-25T10:12:50.778 INFO:teuthology.orchestra.run.smithi018.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0727743 s, 86.5 MB/s 2024-04-25T10:12:50.779 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:50.779 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:50.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.788 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T10:12:50.913 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records in 2024-04-25T10:12:50.913 INFO:teuthology.orchestra.run.smithi018.stderr:6+0 records out 2024-04-25T10:12:50.913 INFO:teuthology.orchestra.run.smithi018.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0729603 s, 86.2 MB/s 2024-04-25T10:12:50.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:50.914 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:12:50.926 INFO:teuthology.orchestra.run.smithi018.stdout:./ 2024-04-25T10:12:50.926 INFO:teuthology.orchestra.run.smithi018.stdout:./file2_sixmegs 2024-04-25T10:12:50.926 INFO:teuthology.orchestra.run.smithi018.stdout:./file3_sixmegs 2024-04-25T10:12:50.926 INFO:teuthology.orchestra.run.smithi018.stdout:./file1_sixmegs 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:12:50.927 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:12:51.036 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:12:51.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T10:12:51.045 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:12:51.151 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:12:51.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:12:51.160 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:12:51.160 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:12:51.160 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:12:51.160 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:12:51.160 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T10:12:51.161 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:12:51.268 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627778 2024-04-25T10:12:51.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T10:12:51.277 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:12:51.383 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:12:51.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:12:51.392 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:51.392 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:51.443 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:51.443 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:51.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:12:51.509 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:12:51.542 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:12:51.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 Processor -- start 2024-04-25T10:12:51.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 -- start start 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faa1c15b5a0 0x7faa1c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 0x7faa1c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0ce7f0 con 0x7faa1c15b980 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0cfcd0 con 0x7faa1c15b5a0 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa21200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0cead0 con 0x7faa1c0cc440 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa13e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa1c15b980 0x7faa1c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38148/0 (socket says 172.21.15.18:38148) 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa13e00640 1 -- 172.21.15.18:0/2268647194 learned_addr learned my addr 172.21.15.18:0/2268647194 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa19e00640 1 --2- 172.21.15.18:0/2268647194 >> v2:172.21.15.167:3300/0 conn(0x7faa1c15b5a0 0x7faa1c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa1a800640 1 --2- 172.21.15.18:0/2268647194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 0x7faa1c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa19400640 1 -- 172.21.15.18:0/2268647194 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607627266 0 0) 0x7faa1c0ce7f0 con 0x7faa1c15b980 2024-04-25T10:12:51.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa19400640 1 -- 172.21.15.18:0/2268647194 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa00003530 con 0x7faa1c15b980 2024-04-25T10:12:51.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa1a800640 1 -- 172.21.15.18:0/2268647194 >> v2:172.21.15.167:3300/0 conn(0x7faa1c15b5a0 msgr2=0x7faa1c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:51.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa1a800640 1 --2- 172.21.15.18:0/2268647194 >> v2:172.21.15.167:3300/0 conn(0x7faa1c15b5a0 0x7faa1c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa1a800640 1 -- 172.21.15.18:0/2268647194 >> v1:172.21.15.18:6789/0 conn(0x7faa1c15b980 legacy=0x7faa1c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.672+0000 7faa1a800640 1 -- 172.21.15.18:0/2268647194 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0cf960 con 0x7faa1c0cc440 2024-04-25T10:12:51.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa1a800640 1 --2- 172.21.15.18:0/2268647194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 0x7faa1c0d0160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9569213ffc69c14d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:51.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa19400640 1 -- 172.21.15.18:0/2268647194 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140b2070 con 0x7faa1c0cc440 2024-04-25T10:12:51.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa19400640 1 -- 172.21.15.18:0/2268647194 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa140a5a50 con 0x7faa1c0cc440 2024-04-25T10:12:51.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa19400640 1 -- 172.21.15.18:0/2268647194 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa140a5e20 con 0x7faa1c0cc440 2024-04-25T10:12:51.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 -- 172.21.15.18:0/2268647194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 msgr2=0x7faa1c0d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 --2- 172.21.15.18:0/2268647194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 0x7faa1c0d0160 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faa14009d90 tx=0x7faa1401c970 comp rx=0 tx=0).stop 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 -- 172.21.15.18:0/2268647194 shutdown_connections 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 --2- 172.21.15.18:0/2268647194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c0cc440 0x7faa1c0d0160 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 --2- 172.21.15.18:0/2268647194 >> v2:172.21.15.167:3300/0 conn(0x7faa1c15b5a0 0x7faa1c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 -- 172.21.15.18:0/2268647194 >> 172.21.15.18:0/2268647194 conn(0x7faa1c0b3390 msgr2=0x7faa1c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 -- 172.21.15.18:0/2268647194 shutdown_connections 2024-04-25T10:12:51.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.676+0000 7faa21200640 1 -- 172.21.15.18:0/2268647194 wait complete. 2024-04-25T10:12:51.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 Processor -- start 2024-04-25T10:12:51.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- start start 2024-04-25T10:12:51.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 0x7faa1c0cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 0x7faa1c14dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0d1280 con 0x7faa1c0cc440 2024-04-25T10:12:51.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0d1100 con 0x7faa1c15b980 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0d1400 con 0x7faa1c15b5a0 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33984/0 (socket says 172.21.15.18:33984) 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 -- 172.21.15.18:0/3082919195 learned_addr learned my addr 172.21.15.18:0/3082919195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa13e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 0x7faa1c0cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa1a800640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 0x7faa1c14dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 -- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 msgr2=0x7faa1c0cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 0x7faa1c0cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 -- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 msgr2=0x7faa1c14dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 0x7faa1c14dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 -- 172.21.15.18:0/3082919195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c151350 con 0x7faa1c0cc440 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa13e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 0x7faa1c0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:51.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa1a800640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 0x7faa1c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa19e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e870 tx=0x7faa0c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c017070 con 0x7faa1c0cc440 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c00c940 con 0x7faa1c0cc440 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00ccf0 con 0x7faa1c0cc440 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c151070 con 0x7faa1c0cc440 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.680+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c1536a0 con 0x7faa1c0cc440 2024-04-25T10:12:51.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c0745d0 con 0x7faa1c0cc440 2024-04-25T10:12:51.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa0c01a070 con 0x7faa1c0cc440 2024-04-25T10:12:51.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa12000640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 0x7fa9f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:51.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faa0c0850c0 con 0x7faa1c0cc440 2024-04-25T10:12:51.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa13e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 0x7fa9f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:51.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.684+0000 7faa13e00640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 0x7fa9f8069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0b08d0 tx=0x7faa04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:51.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.688+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa0c055f20 con 0x7faa1c0cc440 2024-04-25T10:12:51.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.852+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa1c0cc960 con 0x7faa1c0cc440 2024-04-25T10:12:51.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.852+0000 7faa12000640 1 -- 172.21.15.18:0/3082919195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+16860 (secure 0 0 0) 0x7faa0c055820 con 0x7faa1c0cc440 2024-04-25T10:12:51.862 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:51.863 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":108,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:12:40.385081+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:12:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 msgr2=0x7fa9f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 0x7fa9f8069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0b08d0 tx=0x7faa04009040 comp rx=0 tx=0).stop 2024-04-25T10:12:51.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 msgr2=0x7faa1c1516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00e870 tx=0x7faa0c00ec70 comp rx=0 tx=0).stop 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 shutdown_connections 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa1c15b980 0x7faa1c14dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa9f8066f60 0x7fa9f8069420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa1c15b5a0 0x7faa1c0cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 --2- 172.21.15.18:0/3082919195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa1c0cc440 0x7faa1c1516c0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 >> 172.21.15.18:0/3082919195 conn(0x7faa1c0b3390 msgr2=0x7faa1c0b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 shutdown_connections 2024-04-25T10:12:51.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:51.856+0000 7faa21200640 1 -- 172.21.15.18:0/3082919195 wait complete. 2024-04-25T10:12:51.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:12:37.178779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:12:37.765414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:12:51.884 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:12:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.020+0000 7fef96c00640 1 Processor -- start 2024-04-25T10:12:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.020+0000 7fef96c00640 1 -- start start 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef96c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef9006cb10 0x7fef900cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef96c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef90099dd0 con 0x7fef9006c730 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef96c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9009a0b0 con 0x7fef900cfcc0 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef96c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9009a9e0 con 0x7fef9006cb10 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef95800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fef9006c730 0x7fef9015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38150/0 (socket says 172.21.15.18:38150) 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef95800640 1 -- 172.21.15.18:0/1774011338 learned_addr learned my addr 172.21.15.18:0/1774011338 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:52.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef94e00640 1 --2- 172.21.15.18:0/1774011338 >> v2:172.21.15.18:3300/0 conn(0x7fef9006cb10 0x7fef900cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef94e00640 1 -- 172.21.15.18:0/1774011338 >> v1:172.21.15.167:6789/0 conn(0x7fef900cfcc0 legacy=0x7fef900d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:52.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef94e00640 1 -- 172.21.15.18:0/1774011338 >> v1:172.21.15.18:6789/0 conn(0x7fef9006c730 legacy=0x7fef9015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef94e00640 1 -- 172.21.15.18:0/1774011338 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9009a390 con 0x7fef9006cb10 2024-04-25T10:12:52.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.024+0000 7fef8fe00640 1 -- 172.21.15.18:0/1774011338 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182831318 0 0) 0x7fef90099dd0 con 0x7fef9006c730 2024-04-25T10:12:52.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef94e00640 1 --2- 172.21.15.18:0/1774011338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900cf780 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0097c0 tx=0x7fef7c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa65aac8e7cc0c15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef8fe00640 1 -- 172.21.15.18:0/1774011338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0b1070 con 0x7fef9006cb10 2024-04-25T10:12:52.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef8fe00640 1 -- 172.21.15.18:0/1774011338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c0ac640 con 0x7fef9006cb10 2024-04-25T10:12:52.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef8fe00640 1 -- 172.21.15.18:0/1774011338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0aca10 con 0x7fef9006cb10 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- 172.21.15.18:0/1774011338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 msgr2=0x7fef900cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 --2- 172.21.15.18:0/1774011338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900cf780 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0097c0 tx=0x7fef7c01c460 comp rx=0 tx=0).stop 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- 172.21.15.18:0/1774011338 shutdown_connections 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 --2- 172.21.15.18:0/1774011338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900cf780 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- 172.21.15.18:0/1774011338 >> 172.21.15.18:0/1774011338 conn(0x7fef900b3030 msgr2=0x7fef900b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- 172.21.15.18:0/1774011338 shutdown_connections 2024-04-25T10:12:52.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- 172.21.15.18:0/1774011338 wait complete. 2024-04-25T10:12:52.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 Processor -- start 2024-04-25T10:12:52.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 -- start start 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.028+0000 7fef96c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 0x7fef9015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 0x7fef900aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b08a0 con 0x7fef9006cb10 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b0720 con 0x7fef9006c730 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9006cf50 con 0x7fef900cfcc0 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34000/0 (socket says 172.21.15.18:34000) 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 -- 172.21.15.18:0/1909587218 learned_addr learned my addr 172.21.15.18:0/1909587218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef95800640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 0x7fef9015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96200640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 0x7fef900aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 -- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 msgr2=0x7fef900aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 0x7fef900aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 -- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 msgr2=0x7fef9015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 0x7fef9015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 -- 172.21.15.18:0/1909587218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90160f40 con 0x7fef9006cb10 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef95800640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 0x7fef9015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96200640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 0x7fef900aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef94e00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0af040 tx=0x7fef7c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0b1040 con 0x7fef9006cb10 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c004030 con 0x7fef9006cb10 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0043e0 con 0x7fef9006cb10 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef9014e640 con 0x7fef9006cb10 2024-04-25T10:12:52.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90160c30 con 0x7fef9006cb10 2024-04-25T10:12:52.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef900745d0 con 0x7fef9006cb10 2024-04-25T10:12:52.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.032+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fef7c003620 con 0x7fef9006cb10 2024-04-25T10:12:52.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.036+0000 7fef8d600640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 0x7fef70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.036+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fef7c11fb50 con 0x7fef9006cb10 2024-04-25T10:12:52.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.036+0000 7fef95800640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 0x7fef70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.036+0000 7fef95800640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 0x7fef70069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fef84007fd0 tx=0x7fef84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.040+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fef7c016050 con 0x7fef9006cb10 2024-04-25T10:12:52.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.200+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fef9006c510 con 0x7fef9006cb10 2024-04-25T10:12:52.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef8d600640 1 -- 172.21.15.18:0/1909587218 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7fef7c0f0ae0 con 0x7fef9006cb10 2024-04-25T10:12:52.211 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 msgr2=0x7fef70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 0x7fef70069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fef84007fd0 tx=0x7fef84009040 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 msgr2=0x7fef900aea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0af040 tx=0x7fef7c01aca0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 shutdown_connections 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fef70066f60 0x7fef70069420 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fef900cfcc0 0x7fef900aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef9006cb10 0x7fef900aea80 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 --2- 172.21.15.18:0/1909587218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef9006c730 0x7fef9015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 >> 172.21.15.18:0/1909587218 conn(0x7fef900b3030 msgr2=0x7fef900d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 shutdown_connections 2024-04-25T10:12:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.204+0000 7fef96c00640 1 -- 172.21.15.18:0/1909587218 wait complete. 2024-04-25T10:12:52.233 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:12:52.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.368+0000 7fd510400640 1 Processor -- start 2024-04-25T10:12:52.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.368+0000 7fd510400640 1 -- start start 2024-04-25T10:12:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd510400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd510400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 0x7fd5080b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd510400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50815bc40 con 0x7fd5080ccbf0 2024-04-25T10:12:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd510400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd50815e490 con 0x7fd508144120 2024-04-25T10:12:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd510400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50815b3a0 con 0x7fd5080b3090 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50da00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 0x7fd5080b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50da00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:39644/0 (socket says 172.21.15.18:39644) 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50da00640 1 -- 172.21.15.18:0/2907198015 learned_addr learned my addr 172.21.15.18:0/2907198015 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50d000640 1 --1- 172.21.15.18:0/2907198015 >> v1:172.21.15.167:6789/0 conn(0x7fd5080ccbf0 0x7fd50815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:43624/0 (socket says 172.21.15.18:43624) 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50e400640 1 -- 172.21.15.18:0/2907198015 >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 msgr2=0x7fd50815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50e400640 1 --2- 172.21.15.18:0/2907198015 >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50e400640 1 -- 172.21.15.18:0/2907198015 >> v1:172.21.15.167:6789/0 conn(0x7fd5080ccbf0 legacy=0x7fd50815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50e400640 1 -- 172.21.15.18:0/2907198015 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50815b680 con 0x7fd5080b3090 2024-04-25T10:12:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd507e00640 1 -- 172.21.15.18:0/2907198015 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405951093 0 0) 0x7fd50815bc40 con 0x7fd5080ccbf0 2024-04-25T10:12:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.372+0000 7fd50da00640 1 --2- 172.21.15.18:0/2907198015 >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd50e400640 1 --2- 172.21.15.18:0/2907198015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 0x7fd5080b3520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d90 tx=0x7fd50001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e386731f11c9df7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd507e00640 1 -- 172.21.15.18:0/2907198015 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000b2070 con 0x7fd5080b3090 2024-04-25T10:12:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd507e00640 1 -- 172.21.15.18:0/2907198015 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5000a57f0 con 0x7fd5080b3090 2024-04-25T10:12:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd507e00640 1 -- 172.21.15.18:0/2907198015 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5000a5bc0 con 0x7fd5080b3090 2024-04-25T10:12:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- 172.21.15.18:0/2907198015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 msgr2=0x7fd5080b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- 172.21.15.18:0/2907198015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 0x7fd5080b3520 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d90 tx=0x7fd50001c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- 172.21.15.18:0/2907198015 shutdown_connections 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- 172.21.15.18:0/2907198015 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080b3090 0x7fd5080b3520 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- 172.21.15.18:0/2907198015 >> v2:172.21.15.167:3300/0 conn(0x7fd508144120 0x7fd50815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- 172.21.15.18:0/2907198015 >> 172.21.15.18:0/2907198015 conn(0x7fd508067080 msgr2=0x7fd50806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- 172.21.15.18:0/2907198015 shutdown_connections 2024-04-25T10:12:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- 172.21.15.18:0/2907198015 wait complete. 2024-04-25T10:12:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 Processor -- start 2024-04-25T10:12:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- start start 2024-04-25T10:12:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080ccbf0 0x7fd50815d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd508144120 0x7fd508162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50806dc60 con 0x7fd5080b3090 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50806dae0 con 0x7fd508144120 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.376+0000 7fd510400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50806dde0 con 0x7fd5080ccbf0 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34002/0 (socket says 172.21.15.18:34002) 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 -- 172.21.15.18:0/3215164194 learned_addr learned my addr 172.21.15.18:0/3215164194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50d000640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080ccbf0 0x7fd50815d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50e400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd508144120 0x7fd508162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 -- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080ccbf0 msgr2=0x7fd50815d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080ccbf0 0x7fd50815d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 -- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd508144120 msgr2=0x7fd508162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd508144120 0x7fd508162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 -- 172.21.15.18:0/3215164194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5081f6d10 con 0x7fd5080b3090 2024-04-25T10:12:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd50da00640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00eb40 tx=0x7fd4fc00d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc010440 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0105e0 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc010990 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5081f6ff0 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5081f7890 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5080745d0 con 0x7fd5080b3090 2024-04-25T10:12:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4fc010b30 con 0x7fd5080b3090 2024-04-25T10:12:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 0x7fd4e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.380+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd4fc085a80 con 0x7fd5080b3090 2024-04-25T10:12:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.384+0000 7fd50d000640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 0x7fd4e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.384+0000 7fd50d000640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 0x7fd4e8069420 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5080aeb20 tx=0x7fd4f4007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.384+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4fc087e20 con 0x7fd5080b3090 2024-04-25T10:12:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.548+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5080b2170 con 0x7fd5080b3090 2024-04-25T10:12:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd505600640 1 -- 172.21.15.18:0/3215164194 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v108) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4fc010e20 con 0x7fd5080b3090 2024-04-25T10:12:52.559 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 msgr2=0x7fd4e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 0x7fd4e8069420 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5080aeb20 tx=0x7fd4f4007d60 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 msgr2=0x7fd5081f6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00eb40 tx=0x7fd4fc00d350 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 shutdown_connections 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd508144120 0x7fd508162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd4e8066f60 0x7fd4e8069420 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd5080ccbf0 0x7fd50815d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 --2- 172.21.15.18:0/3215164194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5080b3090 0x7fd5081f6730 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 >> 172.21.15.18:0/3215164194 conn(0x7fd508067080 msgr2=0x7fd508071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 shutdown_connections 2024-04-25T10:12:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.552+0000 7fd510400640 1 -- 172.21.15.18:0/3215164194 wait complete. 2024-04-25T10:12:52.580 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:12:52.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 Processor -- start 2024-04-25T10:12:52.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 -- start start 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 0x7f66f006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f015fc00 con 0x7f66f0159320 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f015fee0 con 0x7f66f006e010 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f7600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f006d640 con 0x7f66f015c9b0 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f4c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f66f0159320 0x7f66f015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38158/0 (socket says 172.21.15.18:38158) 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66f4c00640 1 -- 172.21.15.18:0/1935282552 learned_addr learned my addr 172.21.15.18:0/1935282552 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66efe00640 1 --2- 172.21.15.18:0/1935282552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 0x7f66f006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439788816 0 0) 0x7f66f015fc00 con 0x7f66f0159320 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d8003530 con 0x7f66f0159320 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752674591 0 0) 0x7f66f015fee0 con 0x7f66f006e010 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f015fc00 con 0x7f66f006e010 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141901471 0 0) 0x7f66d8003530 con 0x7f66f0159320 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66efe00640 1 -- 172.21.15.18:0/1935282552 >> v1:172.21.15.167:6789/0 conn(0x7f66f006e010 legacy=0x7f66f006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66efe00640 1 -- 172.21.15.18:0/1935282552 >> v1:172.21.15.18:6789/0 conn(0x7f66f0159320 legacy=0x7f66f015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.716+0000 7f66efe00640 1 -- 172.21.15.18:0/1935282552 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f01601c0 con 0x7f66f015c9b0 2024-04-25T10:12:52.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66efe00640 1 --2- 172.21.15.18:0/1935282552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 0x7f66f006dad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097f0 tx=0x7f66dc01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a65af9e2a433c0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc0b0070 con 0x7f66f015c9b0 2024-04-25T10:12:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc0ab400 con 0x7f66f015c9b0 2024-04-25T10:12:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66ef400640 1 -- 172.21.15.18:0/1935282552 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4001680 con 0x7f66f015c9b0 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 -- 172.21.15.18:0/1935282552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 msgr2=0x7f66f006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 --2- 172.21.15.18:0/1935282552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 0x7f66f006dad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0097f0 tx=0x7f66dc01c400 comp rx=0 tx=0).stop 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 -- 172.21.15.18:0/1935282552 shutdown_connections 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 --2- 172.21.15.18:0/1935282552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f015c9b0 0x7f66f006dad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 -- 172.21.15.18:0/1935282552 >> 172.21.15.18:0/1935282552 conn(0x7f66f0067080 msgr2=0x7f66f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 -- 172.21.15.18:0/1935282552 shutdown_connections 2024-04-25T10:12:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.720+0000 7f66f7600640 1 -- 172.21.15.18:0/1935282552 wait complete. 2024-04-25T10:12:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 Processor -- start 2024-04-25T10:12:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- start start 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f006e010 0x7f66f00af4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f0159320 0x7f66f01579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f006ed30 con 0x7f66f015c9b0 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f006ebb0 con 0x7f66f006e010 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f01695a0 con 0x7f66f0159320 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34016/0 (socket says 172.21.15.18:34016) 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f006e010 0x7f66f00af4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 -- 172.21.15.18:0/3717671087 learned_addr learned my addr 172.21.15.18:0/3717671087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66efe00640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f0159320 0x7f66f01579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 -- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f0159320 msgr2=0x7f66f01579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f0159320 0x7f66f01579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 -- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f006e010 msgr2=0x7f66f00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f006e010 0x7f66f00af4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 -- 172.21.15.18:0/3717671087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00b2100 con 0x7f66f015c9b0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f5600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c730 tx=0x7f66e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8003b80 con 0x7f66f015c9b0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8003d20 con 0x7f66f015c9b0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8005310 con 0x7f66f015c9b0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0157f10 con 0x7f66f015c9b0 2024-04-25T10:12:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.724+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f013d210 con 0x7f66f015c9b0 2024-04-25T10:12:52.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f00745d0 con 0x7f66f015c9b0 2024-04-25T10:12:52.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66e80056c0 con 0x7f66f015c9b0 2024-04-25T10:12:52.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66ecc00640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 0x7f66d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:52.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66e8085160 con 0x7f66f015c9b0 2024-04-25T10:12:52.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66f4c00640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 0x7f66d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:52.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.728+0000 7f66f4c00640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 0x7f66d0069420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f66e40011f0 tx=0x7f66e4001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:52.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.732+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66f00b2100 con 0x7f66f015c9b0 2024-04-25T10:12:52.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.892+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66f00736e0 con 0x7f66f015c9b0 2024-04-25T10:12:52.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.892+0000 7f66ecc00640 1 -- 172.21.15.18:0/3717671087 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v108) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66e8055980 con 0x7f66f015c9b0 2024-04-25T10:12:52.902 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 msgr2=0x7f66d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 0x7f66d0069420 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f66e40011f0 tx=0x7f66e4001700 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 msgr2=0x7f66f013dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c730 tx=0x7f66e800cbf0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 shutdown_connections 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f66f015c9b0 0x7f66f013dd50 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f66d0066f60 0x7f66d0069420 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66f0159320 0x7f66f01579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 --2- 172.21.15.18:0/3717671087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66f006e010 0x7f66f00af4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 >> 172.21.15.18:0/3717671087 conn(0x7f66f0067080 msgr2=0x7f66f006e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 shutdown_connections 2024-04-25T10:12:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:52.896+0000 7f66f7600640 1 -- 172.21.15.18:0/3717671087 wait complete. 2024-04-25T10:12:52.923 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:12:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 Processor -- start 2024-04-25T10:12:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 -- start start 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0268144120 0x7f026815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f02680ccbf0 0x7f026815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f026815ee60 0x7f02680b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026815e490 con 0x7f026815ee60 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026815bc40 con 0x7f02680ccbf0 2024-04-25T10:12:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026815b3a0 con 0x7f0268144120 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.056+0000 7f026d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f026815ee60 0x7f02680b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f026815ee60 0x7f02680b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34020/0 (socket says 172.21.15.18:34020) 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 -- 172.21.15.18:0/3980809361 learned_addr learned my addr 172.21.15.18:0/3980809361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026ca00640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0268144120 0x7f026815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f0267e00640 1 --2- 172.21.15.18:0/3980809361 >> v2:172.21.15.167:3300/0 conn(0x7f02680ccbf0 0x7f026815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 -- 172.21.15.18:0/3980809361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0268144120 msgr2=0x7f026815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0268144120 0x7f026815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 -- 172.21.15.18:0/3980809361 >> v2:172.21.15.167:3300/0 conn(0x7f02680ccbf0 msgr2=0x7f026815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 --2- 172.21.15.18:0/3980809361 >> v2:172.21.15.167:3300/0 conn(0x7f02680ccbf0 0x7f026815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 -- 172.21.15.18:0/3980809361 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026815b680 con 0x7f026815ee60 2024-04-25T10:12:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f026d400640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f026815ee60 0x7f02680b3090 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f026806f780 tx=0x7f026001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424160bc1b6774e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f0267400640 1 -- 172.21.15.18:0/3980809361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600a55e0 con 0x7f026815ee60 2024-04-25T10:12:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f0267400640 1 -- 172.21.15.18:0/3980809361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02600a5780 con 0x7f026815ee60 2024-04-25T10:12:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.060+0000 7f0267400640 1 -- 172.21.15.18:0/3980809361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02600a5b50 con 0x7f026815ee60 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- 172.21.15.18:0/3980809361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f026815ee60 msgr2=0x7f02680b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f026815ee60 0x7f02680b3090 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f026806f780 tx=0x7f026001c960 comp rx=0 tx=0).stop 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- 172.21.15.18:0/3980809361 shutdown_connections 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f026815ee60 0x7f02680b3090 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- 172.21.15.18:0/3980809361 >> v2:172.21.15.167:3300/0 conn(0x7f02680ccbf0 0x7f026815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- 172.21.15.18:0/3980809361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0268144120 0x7f026815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- 172.21.15.18:0/3980809361 >> 172.21.15.18:0/3980809361 conn(0x7f0268067080 msgr2=0x7f026806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- 172.21.15.18:0/3980809361 shutdown_connections 2024-04-25T10:12:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- 172.21.15.18:0/3980809361 wait complete. 2024-04-25T10:12:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 Processor -- start 2024-04-25T10:12:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- start start 2024-04-25T10:12:53.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02680ccbf0 0x7f026815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f026815ee60 0x7f0268162280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268071600 con 0x7f0268144120 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268071480 con 0x7f02680ccbf0 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026f400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0268071780 con 0x7f026815ee60 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34028/0 (socket says 172.21.15.18:34028) 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 -- 172.21.15.18:0/1606630180 learned_addr learned my addr 172.21.15.18:0/1606630180 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026d400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f026815ee60 0x7f0268162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f026ca00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02680ccbf0 0x7f026815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 -- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f026815ee60 msgr2=0x7f0268162280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f026815ee60 0x7f0268162280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 -- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02680ccbf0 msgr2=0x7f026815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02680ccbf0 0x7f026815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.064+0000 7f0267e00640 1 -- 172.21.15.18:0/1606630180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026815f5a0 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0267e00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f025400e8b0 tx=0x7f025400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254017070 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025400c940 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400cd10 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026815a7a0 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026815faf0 con 0x7f0268144120 2024-04-25T10:12:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02680745d0 con 0x7f0268144120 2024-04-25T10:12:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f025401a070 con 0x7f0268144120 2024-04-25T10:12:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 0x7f0248069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f02540850d0 con 0x7f0268144120 2024-04-25T10:12:53.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.068+0000 7f026ca00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 0x7f0248069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.072+0000 7f026ca00640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 0x7f0248069450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f025c009b60 tx=0x7f025c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.072+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f02540558f0 con 0x7f0268144120 2024-04-25T10:12:53.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f026806ae60 con 0x7f0268144120 2024-04-25T10:12:53.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f0264c00640 1 -- 172.21.15.18:0/1606630180 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v108) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0254059990 con 0x7f0268144120 2024-04-25T10:12:53.256 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:12:53.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 msgr2=0x7f0248069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 0x7f0248069450 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f025c009b60 tx=0x7f025c009190 comp rx=0 tx=0).stop 2024-04-25T10:12:53.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 msgr2=0x7f0268161d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f025400e8b0 tx=0x7f025400ed70 comp rx=0 tx=0).stop 2024-04-25T10:12:53.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 shutdown_connections 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0248066f90 0x7f0248069450 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f026815ee60 0x7f0268162280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0268144120 0x7f0268161d40 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 --2- 172.21.15.18:0/1606630180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02680ccbf0 0x7f026815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 >> 172.21.15.18:0/1606630180 conn(0x7f0268067080 msgr2=0x7f02680b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 shutdown_connections 2024-04-25T10:12:53.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.248+0000 7f026f400640 1 -- 172.21.15.18:0/1606630180 wait complete. 2024-04-25T10:12:53.278 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:12:53.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:53.278 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:12:53.348 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:12:53.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:53.349 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:12:53.364 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:12:53.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 Processor -- start 2024-04-25T10:12:53.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 -- start start 2024-04-25T10:12:53.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb198144140 0x7fb1980ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb1980b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb19815ac60 con 0x7fb1980ced60 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1980cf3e0 con 0x7fb198144140 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb19e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19815af20 con 0x7fb19806ead0 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb18ea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb1980ced60 0x7fb19806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38168/0 (socket says 172.21.15.18:38168) 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb18ea00640 1 -- 172.21.15.18:0/2791208289 learned_addr learned my addr 172.21.15.18:0/2791208289 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197400640 1 --2- 172.21.15.18:0/2791208289 >> v2:172.21.15.167:3300/0 conn(0x7fb198144140 0x7fb1980ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197e00640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb1980b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb196a00640 1 -- 172.21.15.18:0/2791208289 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836034308 0 0) 0x7fb19815ac60 con 0x7fb1980ced60 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb196a00640 1 -- 172.21.15.18:0/2791208289 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb17c003530 con 0x7fb1980ced60 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197400640 1 -- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 msgr2=0x7fb1980b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197400640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb1980b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197400640 1 -- 172.21.15.18:0/2791208289 >> v1:172.21.15.18:6789/0 conn(0x7fb1980ced60 legacy=0x7fb19806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.540+0000 7fb197400640 1 -- 172.21.15.18:0/2791208289 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19815b200 con 0x7fb198144140 2024-04-25T10:12:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb197400640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1980ce820 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d90 tx=0x7fb18801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cce2e414d4500fb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb196a00640 1 -- 172.21.15.18:0/2791208289 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880aa610 con 0x7fb198144140 2024-04-25T10:12:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb196a00640 1 -- 172.21.15.18:0/2791208289 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1880af070 con 0x7fb198144140 2024-04-25T10:12:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb196a00640 1 -- 172.21.15.18:0/2791208289 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1880aa9d0 con 0x7fb198144140 2024-04-25T10:12:53.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 -- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 msgr2=0x7fb1980ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1980ce820 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb188009d90 tx=0x7fb18801c970 comp rx=0 tx=0).stop 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 -- 172.21.15.18:0/2791208289 shutdown_connections 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb1980b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 --2- 172.21.15.18:0/2791208289 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1980ce820 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 -- 172.21.15.18:0/2791208289 >> 172.21.15.18:0/2791208289 conn(0x7fb198066fa0 msgr2=0x7fb19806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 -- 172.21.15.18:0/2791208289 shutdown_connections 2024-04-25T10:12:53.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.544+0000 7fb19e600640 1 -- 172.21.15.18:0/2791208289 wait complete. 2024-04-25T10:12:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 Processor -- start 2024-04-25T10:12:53.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- start start 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb19813ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1981402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19815bb80 con 0x7fb1980ced60 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19815ba00 con 0x7fb198144140 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1981673e0 con 0x7fb19806ead0 2024-04-25T10:12:53.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34034/0 (socket says 172.21.15.18:34034) 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 -- 172.21.15.18:0/550778988 learned_addr learned my addr 172.21.15.18:0/550778988 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb197400640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb19813ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb197e00640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1981402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 -- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 msgr2=0x7fb19813ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb19813ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 -- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 msgr2=0x7fb1981402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1981402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 -- 172.21.15.18:0/550778988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb198152050 con 0x7fb1980ced60 2024-04-25T10:12:53.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18ea00640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c480 tx=0x7fb18000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180017070 con 0x7fb1980ced60 2024-04-25T10:12:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb180005cf0 con 0x7fb1980ced60 2024-04-25T10:12:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb180007290 con 0x7fb1980ced60 2024-04-25T10:12:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb198152330 con 0x7fb1980ced60 2024-04-25T10:12:53.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1981528f0 con 0x7fb1980ced60 2024-04-25T10:12:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.548+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19813c4f0 con 0x7fb1980ced60 2024-04-25T10:12:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.552+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb18001a070 con 0x7fb1980ced60 2024-04-25T10:12:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.552+0000 7fb18fe00640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 0x7fb174069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:53.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.552+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb180084590 con 0x7fb1980ced60 2024-04-25T10:12:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.552+0000 7fb197400640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 0x7fb174069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:53.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.552+0000 7fb197400640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 0x7fb174069450 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb1880ae000 tx=0x7fb1880a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:53.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.556+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb19813c4f0 con 0x7fb1980ced60 2024-04-25T10:12:53.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.748+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb19806e050 con 0x7fb1980ced60 2024-04-25T10:12:53.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb18fe00640 1 -- 172.21.15.18:0/550778988 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4943 (secure 0 0 0) 0x7fb180054db0 con 0x7fb1980ced60 2024-04-25T10:12:53.759 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:53.759 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:12:41.782127+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":36905},"failed":[],"damaged":[],"stopped":[],"info":{"gid_36905":{"gid":36905,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/81610203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":81610203},{"type":"v1","addr":"172.21.15.167:6837","nonce":81610203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:12:53.759 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 msgr2=0x7fb174069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 0x7fb174069450 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb1880ae000 tx=0x7fb1880a7000 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 msgr2=0x7fb1980b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c480 tx=0x7fb18000c940 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 shutdown_connections 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb198144140 0x7fb1981402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1980ced60 0x7fb1980b4590 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb174066f90 0x7fb174069450 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 --2- 172.21.15.18:0/550778988 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb19806ead0 0x7fb19813ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 >> 172.21.15.18:0/550778988 conn(0x7fb198066fa0 msgr2=0x7fb198159730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:53.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 shutdown_connections 2024-04-25T10:12:53.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:53.752+0000 7fb19e600640 1 -- 172.21.15.18:0/550778988 wait complete. 2024-04-25T10:12:53.780 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-25T10:12:53.947 INFO:teuthology.orchestra.run.smithi167.stdout:{"message":"","return_code":0} 2024-04-25T10:12:53.947 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T10:12:53.947 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:12:53.947 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:12:53.957 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:12:53.957 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:12:53.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:53.957 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:12:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T10:12:54.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:12:54.011 DEBUG:teuthology.orchestra.run.smithi018:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T10:12:54.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:54.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T10:12:54.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 Processor -- start 2024-04-25T10:12:54.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 -- start start 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fccfc0713c0 0x7fccfc0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc15de90 con 0x7fccfc15dab0 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccfc071a70 con 0x7fccfc0b0c00 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd03c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccfc0b57a0 con 0x7fccfc0713c0 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd01200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fccfc15dab0 0x7fccfc070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38180/0 (socket says 172.21.15.18:38180) 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.196+0000 7fcd01200640 1 -- 172.21.15.18:0/1882566151 learned_addr learned my addr 172.21.15.18:0/1882566151 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:54.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfbe00640 1 --2- 172.21.15.18:0/1882566151 >> v2:172.21.15.18:3300/0 conn(0x7fccfc0713c0 0x7fccfc0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfbe00640 1 -- 172.21.15.18:0/1882566151 >> v1:172.21.15.167:6789/0 conn(0x7fccfc0b0c00 legacy=0x7fccfc06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfbe00640 1 -- 172.21.15.18:0/1882566151 >> v1:172.21.15.18:6789/0 conn(0x7fccfc15dab0 legacy=0x7fccfc070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfb400640 1 -- 172.21.15.18:0/1882566151 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911878326 0 0) 0x7fccfc071a70 con 0x7fccfc0b0c00 2024-04-25T10:12:54.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfbe00640 1 -- 172.21.15.18:0/1882566151 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc06bec0 con 0x7fccfc0713c0 2024-04-25T10:12:54.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfbe00640 1 --2- 172.21.15.18:0/1882566151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0b5110 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcce80097c0 tx=0x7fcce801c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7933c63e8b1102 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfb400640 1 -- 172.21.15.18:0/1882566151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80b0070 con 0x7fccfc0713c0 2024-04-25T10:12:54.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfb400640 1 -- 172.21.15.18:0/1882566151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce80ab600 con 0x7fccfc0713c0 2024-04-25T10:12:54.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.200+0000 7fccfb400640 1 -- 172.21.15.18:0/1882566151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80ab9d0 con 0x7fccfc0713c0 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- 172.21.15.18:0/1882566151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 msgr2=0x7fccfc0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 --2- 172.21.15.18:0/1882566151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0b5110 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fcce80097c0 tx=0x7fcce801c300 comp rx=0 tx=0).stop 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- 172.21.15.18:0/1882566151 shutdown_connections 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 --2- 172.21.15.18:0/1882566151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0b5110 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- 172.21.15.18:0/1882566151 >> 172.21.15.18:0/1882566151 conn(0x7fccfc06f510 msgr2=0x7fccfc06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- 172.21.15.18:0/1882566151 shutdown_connections 2024-04-25T10:12:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- 172.21.15.18:0/1882566151 wait complete. 2024-04-25T10:12:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 Processor -- start 2024-04-25T10:12:54.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- start start 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 0x7fccfc142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 0x7fccfc0cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06dc50 con 0x7fccfc0713c0 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc06dad0 con 0x7fccfc0b0c00 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd03c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc16b940 con 0x7fccfc15dab0 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34044/0 (socket says 172.21.15.18:34044) 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 -- 172.21.15.18:0/3224111831 learned_addr learned my addr 172.21.15.18:0/3224111831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 0x7fccfc0cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 -- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 msgr2=0x7fccfc0cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fccfbe00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 0x7fccfc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 0x7fccfc0cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 -- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 msgr2=0x7fccfc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 0x7fccfc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01200640 1 -- 172.21.15.18:0/3224111831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccfc15aec0 con 0x7fccfc0713c0 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fccfbe00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 0x7fccfc142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.204+0000 7fcd01c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 0x7fccfc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fcd01200640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c7b0 tx=0x7fccf000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fccf8c00640 1 -- 172.21.15.18:0/3224111831 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0018070 con 0x7fccfc0713c0 2024-04-25T10:12:54.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fccf8c00640 1 -- 172.21.15.18:0/3224111831 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00072d0 con 0x7fccfc0713c0 2024-04-25T10:12:54.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fccf8c00640 1 -- 172.21.15.18:0/3224111831 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00047f0 con 0x7fccfc0713c0 2024-04-25T10:12:54.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccfc1426b0 con 0x7fccfc0713c0 2024-04-25T10:12:54.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.208+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccfc151910 con 0x7fccfc0713c0 2024-04-25T10:12:54.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 Processor -- start 2024-04-25T10:12:54.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccf8c00640 1 -- 172.21.15.18:0/3224111831 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fccf0004990 con 0x7fccfc0713c0 2024-04-25T10:12:54.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 -- start start 2024-04-25T10:12:54.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccf8c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 0x7fccdc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccf8c00640 1 -- 172.21.15.18:0/3224111831 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fccf0084570 con 0x7fccfc0713c0 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 0x7fccdc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075fb7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562075e53f40 con 0x562075f6d290 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562075dbb070 con 0x562075fb6c90 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562075d431a0 con 0x562075fb75b0 2024-04-25T10:12:54.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075fb7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:45348/0 (socket says 172.21.15.18:45348) 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 -- 172.21.15.18:0/488181531 learned_addr learned my addr 172.21.15.18:0/488181531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 -- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 msgr2=0x562075fb7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075fb7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 -- 172.21.15.18:0/488181531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 msgr2=0x562075f6d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fccfbe00640 1 -- 172.21.15.18:0/488181531 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562075d41510 con 0x562075fb75b0 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01200640 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075fb7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01c00640 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:54.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.212+0000 7fcd01c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 0x7fccdc069450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0d0b40 tx=0x7fccf4014760 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcce8018f10 tx=0x7fcce80a6000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1aefbb9e767b537 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcced600640 1 -- 172.21.15.18:0/488181531 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80b0040 con 0x562075fb75b0 2024-04-25T10:12:54.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcced600640 1 -- 172.21.15.18:0/488181531 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce80ab690 con 0x562075fb75b0 2024-04-25T10:12:54.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcced600640 1 -- 172.21.15.18:0/488181531 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80aba60 con 0x562075fb75b0 2024-04-25T10:12:54.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 msgr2=0x562075f6cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcce8018f10 tx=0x7fcce80a6000 comp rx=0 tx=0).stop 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- 172.21.15.18:0/488181531 shutdown_connections 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f6cd50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- 172.21.15.18:0/488181531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075fb7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- 172.21.15.18:0/488181531 >> 172.21.15.18:0/488181531 conn(0x562075f69240 msgr2=0x562075f6b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- 172.21.15.18:0/488181531 shutdown_connections 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- 172.21.15.18:0/488181531 wait complete. 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- start start 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 Processor -- start 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f77e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f788b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562075d756c0 con 0x562075f6d290 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562075db7110 con 0x562075fb6c90 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562075dba380 con 0x562075fb75b0 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd070a0000 10 client.0 _ll_register_callbacks cb 0x562075f58570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f77e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fcd01c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f788b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:39706/0 (socket says 172.21.15.18:39706) 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 -- 172.21.15.18:0/2348801682 learned_addr learned my addr 172.21.15.18:0/2348801682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 -- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 msgr2=0x562075f788b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.216+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f788b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fccfbe00640 1 -- 172.21.15.18:0/2348801682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 msgr2=0x562075f77e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f77e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fccfbe00640 1 -- 172.21.15.18:0/2348801682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562075d433b0 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd01200640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f77e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcce8097dd0 tx=0x7fcce801ab40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6870436622f260db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80c4070 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcce80ab840 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcce80ab690 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcce80cf050 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 10 client.7990 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x562075e3ce00 con 0x562075fb6c90 2024-04-25T10:12:54.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce80ab690 con 0x562075fb6c90 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fcce80d2020 con 0x562075fb6c90 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 10 client.7990 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 10 client.7990 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 20 client.7990 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562075f79120 0x562075fc8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 4 client.7990 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562075d56d60 con 0x562075f79120 2024-04-25T10:12:54.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd01200640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562075f79120 0x562075fc8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd01200640 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562075f79120 0x562075fc8410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8b794bab62f27a9 server_cookie=2acf6b7083f04f3b in_seq=0 out_seq=0 2024-04-25T10:12:54.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 10 client.7990 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 1 -- 172.21.15.18:0/2348801682 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562075d56d60 con 0x562075f79120 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 10 client.7990 handle_command_reply: tid=0 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 client.7990 shutdown 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 msgr2=0x562075f78370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcce8097dd0 tx=0x7fcce801ab40 comp rx=0 tx=0).stop 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 shutdown_connections 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562075f79120 0x562075fc8410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb75b0 0x562075f788b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb6c90 0x562075f78370 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2348801682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f77e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcce2000640 0 client.7990 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.220+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 >> 172.21.15.18:0/2348801682 conn(0x562075f69240 msgr2=0x562075f6bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 shutdown_connections 2024-04-25T10:12:54.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7fcd070a0000 1 -- 172.21.15.18:0/2348801682 wait complete. 2024-04-25T10:12:54.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7fcd070a0000 20 client.7990 trim_cache size 0 max 16384 2024-04-25T10:12:54.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 Processor -- start 2024-04-25T10:12:54.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 -- start start 2024-04-25T10:12:54.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f449406b320 0x7f44940ca410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449406ec90 con 0x7f449415d9f0 2024-04-25T10:12:54.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449406ef70 con 0x7f449406e2d0 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f449a400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940d0fd0 con 0x7f449406b320 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f4499000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f449415d9f0 0x7f449406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38186/0 (socket says 172.21.15.18:38186) 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f4499000640 1 -- 172.21.15.18:0/2721324411 learned_addr learned my addr 172.21.15.18:0/2721324411 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.224+0000 7f4493e00640 1 --2- 172.21.15.18:0/2721324411 >> v2:172.21.15.18:3300/0 conn(0x7f449406b320 0x7f44940ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668108402 0 0) 0x7f449406ec90 con 0x7f449415d9f0 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c003530 con 0x7f449415d9f0 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130412989 0 0) 0x7f449406ef70 con 0x7f449406e2d0 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493e00640 1 -- 172.21.15.18:0/2721324411 >> v1:172.21.15.167:6789/0 conn(0x7f449406e2d0 legacy=0x7f44940ce310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493e00640 1 -- 172.21.15.18:0/2721324411 >> v1:172.21.15.18:6789/0 conn(0x7f449415d9f0 legacy=0x7f449406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493e00640 1 -- 172.21.15.18:0/2721324411 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940d0c60 con 0x7f449406b320 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493e00640 1 --2- 172.21.15.18:0/2721324411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ca410 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0240bfedc91b694 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800b1070 con 0x7f449406b320 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44800ac630 con 0x7f449406b320 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.228+0000 7f4493400640 1 -- 172.21.15.18:0/2721324411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44800a8050 con 0x7f449406b320 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- 172.21.15.18:0/2721324411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 msgr2=0x7f44940ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 --2- 172.21.15.18:0/2721324411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ca410 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f44800097c0 tx=0x7f448001c440 comp rx=0 tx=0).stop 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- 172.21.15.18:0/2721324411 shutdown_connections 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 --2- 172.21.15.18:0/2721324411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ca410 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- 172.21.15.18:0/2721324411 >> 172.21.15.18:0/2721324411 conn(0x7f4494099a60 msgr2=0x7f44940d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- 172.21.15.18:0/2721324411 shutdown_connections 2024-04-25T10:12:54.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- 172.21.15.18:0/2721324411 wait complete. 2024-04-25T10:12:54.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 Processor -- start 2024-04-25T10:12:54.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- start start 2024-04-25T10:12:54.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406e2d0 0x7f44940aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f449415d9f0 0x7f4494134f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406f3d0 con 0x7f449406b320 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406f250 con 0x7f449415d9f0 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f449a400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940cf230 con 0x7f449406e2d0 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34078/0 (socket says 172.21.15.18:34078) 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 -- 172.21.15.18:0/3897276535 learned_addr learned my addr 172.21.15.18:0/3897276535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499a00640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f449415d9f0 0x7f4494134f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4493e00640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406e2d0 0x7f44940aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 -- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406e2d0 msgr2=0x7f44940aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f449406e2d0 0x7f44940aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 -- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f449415d9f0 msgr2=0x7f4494134f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f449415d9f0 0x7f4494134f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.232+0000 7f4499000640 1 -- 172.21.15.18:0/3897276535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449414bd20 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4499000640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f449406b320 0x7f44940ae5c0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f448800c3f0 tx=0x7f448800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488017070 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488005cf0 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f449a400640 1 -- 172.21.15.18:0/3897276535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449414c000 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44880072f0 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f449a400640 1 -- 172.21.15.18:0/3897276535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449414ba10 con 0x7f449406b320 2024-04-25T10:12:54.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f449a400640 1 -- 172.21.15.18:0/3897276535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f449404ef30 con 0x7f449406b320 2024-04-25T10:12:54.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f448801a070 con 0x7f449406b320 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4474066f60 0x7f4474069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4488084cd0 con 0x7f449406b320 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7f4488021070 con 0x7f449406b320 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f4493e00640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4474066f60 0x7f4474069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.236+0000 7f449a400640 1 -- 172.21.15.18:0/3897276535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f44940b6370 con 0x7f449406b320 2024-04-25T10:12:54.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.240+0000 7f4493e00640 1 --2- 172.21.15.18:0/3897276535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4474066f60 0x7f4474069420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f44800ae000 tx=0x7f4480008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.240+0000 7fcd070a0000 1 Processor -- start 2024-04-25T10:12:54.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.240+0000 7fcd070a0000 1 -- start start 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075f6cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fc8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc202ea0 con 0x562075f6d290 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc202230 con 0x562075fb75b0 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc15e9f0 con 0x562075fb6c90 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34090/0 (socket says 172.21.15.18:34090) 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 -- 172.21.15.18:0/2456276239 learned_addr learned my addr 172.21.15.18:0/2456276239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075f6cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 -- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 msgr2=0x562075f6cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01c00640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fc8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075f6cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 -- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 msgr2=0x562075fc8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fc8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 -- 172.21.15.18:0/2456276239 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562075e12c50 con 0x562075f6d290 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075f6cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01c00640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fc8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd01200640 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fccf0051720 tx=0x7fccf0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7e9f563e24b6f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fccecc00640 1 -- 172.21.15.18:0/2456276239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf005b0c0 con 0x562075f6d290 2024-04-25T10:12:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fccecc00640 1 -- 172.21.15.18:0/2456276239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0004c80 con 0x562075f6d290 2024-04-25T10:12:54.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fccecc00640 1 -- 172.21.15.18:0/2456276239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00842b0 con 0x562075f6d290 2024-04-25T10:12:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- 172.21.15.18:0/2456276239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 msgr2=0x562075f6c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fccf0051720 tx=0x7fccf0009040 comp rx=0 tx=0).stop 2024-04-25T10:12:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- 172.21.15.18:0/2456276239 shutdown_connections 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fc8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075f6cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2456276239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075f6c640 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- 172.21.15.18:0/2456276239 >> 172.21.15.18:0/2456276239 conn(0x562075f69240 msgr2=0x562075f71d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- 172.21.15.18:0/2456276239 shutdown_connections 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- 172.21.15.18:0/2456276239 wait complete. 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 -- start start 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.244+0000 7fcd070a0000 1 Processor -- start 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075fd2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fd3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562075f76200 con 0x562075f6d290 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccfc15eff0 con 0x562075fb75b0 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562075db7110 con 0x562075fb6c90 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 10 client.0 _ll_register_callbacks cb 0x7fcce80ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34096/0 (socket says 172.21.15.18:34096) 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 -- 172.21.15.18:0/2237923119 learned_addr learned my addr 172.21.15.18:0/2237923119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075fd2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01c00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fd3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 -- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 msgr2=0x562075fd2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075fd2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 -- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 msgr2=0x562075fd3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fd3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 -- 172.21.15.18:0/2237923119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562075d83120 con 0x562075f6d290 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075fd2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01c00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fd3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd01200640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fccf000cfd0 tx=0x7fccf00827d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb9734b139e172a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00842b0 con 0x562075f6d290 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fccf001dc30 con 0x562075f6d290 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fccf0004c80 con 0x562075f6d290 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fccf0054da0 con 0x562075f6d290 2024-04-25T10:12:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 10 client.8646 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x562075d62170 con 0x562075f6d290 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf0004c80 con 0x562075f6d290 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fccf00541f0 con 0x562075f6d290 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 10 client.8646 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 10 client.8646 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 20 client.8646 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562076016f70 0x562076017380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 4 client.8646 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x562075dc85b0 con 0x562076016f70 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562076016f70 0x562076017380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fccfbe00640 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562076016f70 0x562076017380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e310e9a4ca767219 server_cookie=10ab03fdd47a742c in_seq=0 out_seq=0 2024-04-25T10:12:54.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 10 client.8646 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 1 -- 172.21.15.18:0/2237923119 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562075dc85b0 con 0x562076016f70 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcce2000640 10 client.8646 handle_command_reply: tid=0 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.248+0000 7fcd070a0000 1 client.8646 shutdown 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 msgr2=0x562075fca440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fccf000cfd0 tx=0x7fccf00827d0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 shutdown_connections 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x562076016f70 0x562076017380 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562075fb75b0 0x562075fd3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562075fb6c90 0x562075fd2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 --2- 172.21.15.18:0/2237923119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562075f6d290 0x562075fca440 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcce2000640 0 client.8646 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 >> 172.21.15.18:0/2237923119 conn(0x562075f69240 msgr2=0x562075f72430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 shutdown_connections 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 1 -- 172.21.15.18:0/2237923119 wait complete. 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd070a0000 20 client.8646 trim_cache size 0 max 16384 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "84bc2a4d-44df-4123-8486-7a879441ee36", 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:12:54.264 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 msgr2=0x7fccdc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 0x7fccdc069450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0d0b40 tx=0x7fccf4014760 comp rx=0 tx=0).stop 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 msgr2=0x7fccfc0cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fccf000c7b0 tx=0x7fccf000cc70 comp rx=0 tx=0).stop 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 shutdown_connections 2024-04-25T10:12:54.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fccdc066f90 0x7fccdc069450 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccfc15dab0 0x7fccfc0cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccfc0b0c00 0x7fccfc142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 --2- 172.21.15.18:0/3224111831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccfc0713c0 0x7fccfc0cd4e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 >> 172.21.15.18:0/3224111831 conn(0x7fccfc06f510 msgr2=0x7fccfc15b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 shutdown_connections 2024-04-25T10:12:54.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.252+0000 7fcd03c00640 1 -- 172.21.15.18:0/3224111831 wait complete. 2024-04-25T10:12:54.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:12:54.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:12:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 Processor -- start 2024-04-25T10:12:54.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 -- start start 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f266415acd0 0x7f266415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 0x7f26640b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266415bc40 con 0x7f2664144120 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266415e490 con 0x7f266415acd0 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2669000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266415b150 con 0x7f266415ee60 2024-04-25T10:12:54.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2661e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2664144120 0x7f26640ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38190/0 (socket says 172.21.15.18:38190) 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2661e00640 1 -- 172.21.15.18:0/2430078918 learned_addr learned my addr 172.21.15.18:0/2430078918 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2662800640 1 --2- 172.21.15.18:0/2430078918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 0x7f26640b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f265be00640 1 --2- 172.21.15.18:0/2430078918 >> v2:172.21.15.167:3300/0 conn(0x7f266415acd0 0x7f266415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2661400640 1 -- 172.21.15.18:0/2430078918 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731628054 0 0) 0x7f266415bc40 con 0x7f2664144120 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2661400640 1 -- 172.21.15.18:0/2430078918 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2648003530 con 0x7f2664144120 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2662800640 1 -- 172.21.15.18:0/2430078918 >> v2:172.21.15.167:3300/0 conn(0x7f266415acd0 msgr2=0x7f266415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2662800640 1 --2- 172.21.15.18:0/2430078918 >> v2:172.21.15.167:3300/0 conn(0x7f266415acd0 0x7f266415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2662800640 1 -- 172.21.15.18:0/2430078918 >> v1:172.21.15.18:6789/0 conn(0x7f2664144120 legacy=0x7f26640ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.416+0000 7f2662800640 1 -- 172.21.15.18:0/2430078918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266415b3a0 con 0x7f266415ee60 2024-04-25T10:12:54.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2662800640 1 --2- 172.21.15.18:0/2430078918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 0x7f26640b3090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f265c009d90 tx=0x7f265c01c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=350a05d175e09cc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2661400640 1 -- 172.21.15.18:0/2430078918 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0b2070 con 0x7f266415ee60 2024-04-25T10:12:54.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2661400640 1 -- 172.21.15.18:0/2430078918 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0a57a0 con 0x7f266415ee60 2024-04-25T10:12:54.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2661400640 1 -- 172.21.15.18:0/2430078918 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0a5b70 con 0x7f266415ee60 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 -- 172.21.15.18:0/2430078918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 msgr2=0x7f26640b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 --2- 172.21.15.18:0/2430078918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 0x7f26640b3090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f265c009d90 tx=0x7f265c01c8e0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 -- 172.21.15.18:0/2430078918 shutdown_connections 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 --2- 172.21.15.18:0/2430078918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f266415ee60 0x7f26640b3090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 --2- 172.21.15.18:0/2430078918 >> v2:172.21.15.167:3300/0 conn(0x7f266415acd0 0x7f266415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 -- 172.21.15.18:0/2430078918 >> 172.21.15.18:0/2430078918 conn(0x7f2664067080 msgr2=0x7f266406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 -- 172.21.15.18:0/2430078918 shutdown_connections 2024-04-25T10:12:54.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.420+0000 7f2669000640 1 -- 172.21.15.18:0/2430078918 wait complete. 2024-04-25T10:12:54.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 Processor -- start 2024-04-25T10:12:54.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- start start 2024-04-25T10:12:54.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 0x7f2664159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415ee60 0x7f266415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26641677d0 con 0x7f266415acd0 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664167650 con 0x7f266415ee60 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2664167950 con 0x7f2664144120 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34110/0 (socket says 172.21.15.18:34110) 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 -- 172.21.15.18:0/1133724833 learned_addr learned my addr 172.21.15.18:0/1133724833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2661e00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 0x7f2664159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2662800640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415ee60 0x7f266415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 -- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 msgr2=0x7f2664159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 0x7f2664159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 -- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415ee60 msgr2=0x7f266415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415ee60 0x7f266415d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 -- 172.21.15.18:0/1133724833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266415c480 con 0x7f266415acd0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2661e00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 0x7f2664159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265be00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e930 tx=0x7f264c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265a000640 1 -- 172.21.15.18:0/1133724833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c017070 con 0x7f266415acd0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265a000640 1 -- 172.21.15.18:0/1133724833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264c00ca00 con 0x7f266415acd0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f265a000640 1 -- 172.21.15.18:0/1133724833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264c00cdb0 con 0x7f266415acd0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266415c760 con 0x7f266415acd0 2024-04-25T10:12:54.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.424+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266415cd20 con 0x7f266415acd0 2024-04-25T10:12:54.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f265a000640 1 -- 172.21.15.18:0/1133724833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f264c01a070 con 0x7f266415acd0 2024-04-25T10:12:54.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f265a000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f265a000640 1 -- 172.21.15.18:0/1133724833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f264c0855b0 con 0x7f266415acd0 2024-04-25T10:12:54.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 Processor -- start 2024-04-25T10:12:54.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2661e00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 -- start start 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2661e00640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 0x7f2640069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2654005890 tx=0x7f2654009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fee0750 0x55746fe95f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fe96890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746fcdeff0 con 0x55746fedfe30 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746fc67150 con 0x55746fee0750 2024-04-25T10:12:54.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55746fcdb090 con 0x55746fe964b0 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2661e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2661e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34112/0 (socket says 172.21.15.18:34112) 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2661e00640 1 -- 172.21.15.18:0/1510009447 learned_addr learned my addr 172.21.15.18:0/1510009447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f265be00640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fee0750 0x55746fe95f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.428+0000 7f2662800640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fe96890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 -- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 msgr2=0x55746fe96890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fe96890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 -- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fee0750 msgr2=0x55746fe95f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fee0750 0x55746fe95f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 -- 172.21.15.18:0/1510009447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55746fe750d0 con 0x55746fedfe30 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2662800640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fe96890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:12:54.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f265400ff70 tx=0x7f2654000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22da3af3bf404bef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2652a00640 1 -- 172.21.15.18:0/1510009447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654025070 con 0x55746fedfe30 2024-04-25T10:12:54.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2652a00640 1 -- 172.21.15.18:0/1510009447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540135c0 con 0x55746fedfe30 2024-04-25T10:12:54.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2652a00640 1 -- 172.21.15.18:0/1510009447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654013990 con 0x55746fedfe30 2024-04-25T10:12:54.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- 172.21.15.18:0/1510009447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 msgr2=0x55746fee0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7f265400ff70 tx=0x7f2654000ee0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- 172.21.15.18:0/1510009447 shutdown_connections 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fe96890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fee0750 0x55746fe95f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- 172.21.15.18:0/1510009447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fedfe30 0x55746fee0210 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- 172.21.15.18:0/1510009447 >> 172.21.15.18:0/1510009447 conn(0x55746fe8e020 msgr2=0x55746fe90440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- 172.21.15.18:0/1510009447 shutdown_connections 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- 172.21.15.18:0/1510009447 wait complete. 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- start start 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 Processor -- start 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fe9c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fee0750 0x55746fe9c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746fce3620 con 0x55746fe964b0 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746fc99690 con 0x55746fedfe30 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55746fc67a40 con 0x55746fee0750 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f266c513000 10 client.0 _ll_register_callbacks cb 0x55746fe7ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34128/0 (socket says 172.21.15.18:34128) 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2661e00640 1 -- 172.21.15.18:0/968865130 learned_addr learned my addr 172.21.15.18:0/968865130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f2662800640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fee0750 0x55746fe9c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.432+0000 7f265be00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fe9c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 -- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fee0750 msgr2=0x55746fe9c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fee0750 0x55746fe9c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 -- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 msgr2=0x55746fe9c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fe9c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 -- 172.21.15.18:0/968865130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55746fd8c1c0 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2661e00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2654023040 tx=0x7f26540010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380edeb4d043bc1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654030060 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f26540049f0 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26540135c0 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2654036050 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 10 client.8658 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55746fd88170 con 0x55746fe964b0 2024-04-25T10:12:54.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26540135c0 con 0x55746fe964b0 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2654039020 con 0x55746fe964b0 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 10 client.8658 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 10 client.8658 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 20 client.8658 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fe9d640 0x55746fef20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 4 client.8658 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55746fc7ac60 con 0x55746fe9d640 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f265be00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fe9d640 0x55746fef20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f265be00640 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fe9d640 0x55746fef20f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf4e7d9e96fbd073 server_cookie=df2b0eb40afc1315 in_seq=0 out_seq=0 2024-04-25T10:12:54.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 10 client.8658 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 1 -- 172.21.15.18:0/968865130 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55746fc7ac60 con 0x55746fe9d640 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 10 client.8658 handle_command_reply: tid=0 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 client.8658 shutdown 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 msgr2=0x55746fedf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f2654023040 tx=0x7f26540010b0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 shutdown_connections 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fe9d640 0x55746fef20f0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fee0750 0x55746fe9c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fe9c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 --2- 172.21.15.18:0/968865130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fe964b0 0x55746fedf7e0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f2647400640 0 client.8658 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 >> 172.21.15.18:0/968865130 conn(0x55746fe8e020 msgr2=0x55746fe97120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 shutdown_connections 2024-04-25T10:12:54.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.436+0000 7f266c513000 1 -- 172.21.15.18:0/968865130 wait complete. 2024-04-25T10:12:54.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.440+0000 7f266c513000 20 client.8658 trim_cache size 0 max 16384 2024-04-25T10:12:54.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.452+0000 7f266c513000 1 Processor -- start 2024-04-25T10:12:54.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.452+0000 7f266c513000 1 -- start start 2024-04-25T10:12:54.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746febeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26641ff210 con 0x55746fee0750 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664160e30 con 0x55746fedfe30 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266413cfe0 con 0x55746fe964b0 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34136/0 (socket says 172.21.15.18:34136) 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 -- 172.21.15.18:0/442321748 learned_addr learned my addr 172.21.15.18:0/442321748 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2661e00640 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746febeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f265be00640 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 -- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 msgr2=0x55746febeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746febeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 -- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 msgr2=0x55746fef4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 -- 172.21.15.18:0/442321748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55746fd25de0 con 0x55746fee0750 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2662800640 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f265c01a510 tx=0x7f265c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e677a30e57090a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2652000640 1 -- 172.21.15.18:0/442321748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0c7070 con 0x55746fee0750 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2652000640 1 -- 172.21.15.18:0/442321748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0a5660 con 0x55746fee0750 2024-04-25T10:12:54.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f2652000640 1 -- 172.21.15.18:0/442321748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0b2040 con 0x55746fee0750 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- 172.21.15.18:0/442321748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 msgr2=0x55746fef4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f265c01a510 tx=0x7f265c004ac0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- 172.21.15.18:0/442321748 shutdown_connections 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef4650 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- 172.21.15.18:0/442321748 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746febeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- 172.21.15.18:0/442321748 >> 172.21.15.18:0/442321748 conn(0x55746fe8e020 msgr2=0x55746feecb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- 172.21.15.18:0/442321748 shutdown_connections 2024-04-25T10:12:54.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- 172.21.15.18:0/442321748 wait complete. 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- start start 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 Processor -- start 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fef4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55746fc79e00 con 0x55746fee0750 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2664160830 con 0x55746fedfe30 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55746fcde300 con 0x55746fe964b0 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.456+0000 7f266c513000 10 client.0 _ll_register_callbacks cb 0x55746fe5d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2662800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fef4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f265be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2662800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34142/0 (socket says 172.21.15.18:34142) 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2662800640 1 -- 172.21.15.18:0/2337624226 learned_addr learned my addr 172.21.15.18:0/2337624226 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 -- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 msgr2=0x55746fef20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 -- 172.21.15.18:0/2337624226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 msgr2=0x55746fef2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 -- 172.21.15.18:0/2337624226 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55746fc808e0 con 0x55746fe964b0 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2662800640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:12:54.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2661e00640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fef4650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2654001610 tx=0x7f2654000bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c33e2b0d401d166 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:12:54.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3301/0 2024-04-25T10:12:54.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2654025040 con 0x55746fe964b0 2024-04-25T10:12:54.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mon.2 v2:172.21.15.167:3301/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2654004ee0 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f265c0a5660 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2654046050 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 10 client.37079 fetch_fsmap learned FSMap version 84 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x55746fd388f0 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mon.2 v2:172.21.15.167:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f265c0a5660 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mon.2 v2:172.21.15.167:3301/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2654049020 con 0x55746fe964b0 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 10 client.37079 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 10 client.37079 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 20 client.37079 populate_metadata read hostname 'smithi018' 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fef2ff0 0x55746fef3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:12:54.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 4 client.37079 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55746fcec530 con 0x55746fef2ff0 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f265be00640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fef2ff0 0x55746fef3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f265be00640 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fef2ff0 0x55746fef3400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66a0fe400ca5f004 server_cookie=989f25308e0af99d in_seq=0 out_seq=0 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 10 client.37079 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 1 -- 172.21.15.18:0/2337624226 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55746fcec530 con 0x55746fef2ff0 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 10 client.37079 handle_command_reply: tid=0 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 client.37079 shutdown 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 msgr2=0x55746fef4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fef4650 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2654001610 tx=0x7f2654000bd0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 shutdown_connections 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x55746fef2ff0 0x55746fef3400 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55746fee0750 0x55746fef2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55746fedfe30 0x55746fef20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 --2- 172.21.15.18:0/2337624226 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55746fe964b0 0x55746fef4650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 >> 172.21.15.18:0/2337624226 conn(0x55746fe8e020 msgr2=0x55746feed420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2647400640 0 client.37079 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 shutdown_connections 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 1 -- 172.21.15.18:0/2337624226 wait complete. 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f266c513000 20 client.37079 trim_cache size 0 max 16384 2024-04-25T10:12:54.476 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "84bc2a4d-44df-4123-8486-7a879441ee36": { 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "84bc2a4d-44df-4123-8486-7a879441ee36", 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:12:54.477 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 msgr2=0x7f2640069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.460+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 0x7f2640069420 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2654005890 tx=0x7f2654009040 comp rx=0 tx=0).stop 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 msgr2=0x7f26641615f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f264c00e930 tx=0x7f264c00edf0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 shutdown_connections 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f266415ee60 0x7f266415d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f266415acd0 0x7f26641615f0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2640066f60 0x7f2640069420 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 --2- 172.21.15.18:0/1133724833 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2664144120 0x7f2664159560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:12:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 >> 172.21.15.18:0/1133724833 conn(0x7f2664067080 msgr2=0x7f26640b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:12:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 shutdown_connections 2024-04-25T10:12:54.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:54.464+0000 7f2669000640 1 -- 172.21.15.18:0/1133724833 wait complete. 2024-04-25T10:12:54.488 INFO:tasks.cephfs.filesystem:scrub status for tag:84bc2a4d-44df-4123-8486-7a879441ee36 - {'path': '/', 'tag': '84bc2a4d-44df-4123-8486-7a879441ee36', 'options': 'recursive,repair'} 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:55.448+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-25T10:12:54.258018+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7f4488053500 con 0x7f449406b320 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: cluster: 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: id: a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: health: HEALTH_OK 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: services: 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T10:12:55.456 INFO:teuthology.orchestra.run.smithi018.stdout: mgr: x(active, since 9m), standbys: y 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: data: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: volumes: 1/1 healthy 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: pools: 3 pools, 97 pgs 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: objects: 26 objects, 6.6 MiB 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: usage: 267 MiB used, 720 GiB / 720 GiB avail 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: pgs: 97 active+clean 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: io: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: client: 554 KiB/s wr, 0 op/s rd, 4 op/s wr 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:12:55.457 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:12:54.258018+0000 mds.d [INF] scrub queued for path: / 2024-04-25T10:12:55.458 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:12:54.258021+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:12:55.458 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:12:54.258025+0000 mds.d [INF] scrub summary: active paths [/] 2024-04-25T10:12:55.458 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:12:54.259552+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:12:56.461 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:12:54.545434+0000 mds.d [INF] scrub summary: idle 2024-04-25T10:12:56.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:12:56.452+0000 7f4490c00640 1 -- 172.21.15.18:0/3897276535 <== mon.0 v2:172.21.15.18:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-25T10:12:54.545434+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f4488084fa0 con 0x7f449406b320 2024-04-25T10:13:21.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:13:21.593 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:13:24.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:13:24.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:13:24.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.636+0000 7f59cdc00640 1 Processor -- start 2024-04-25T10:13:24.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.636+0000 7f59cdc00640 1 -- start start 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cdc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f59c806cb10 0x7f59c80cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cdc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f59c80cfcc0 0x7f59c80d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cdc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c8099dd0 con 0x7f59c806c730 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cdc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c809a9e0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cdc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c809ae70 con 0x7f59c806cb10 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59c7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f59c806c730 0x7f59c815ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37206/0 (socket says 172.21.15.18:37206) 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59c7e00640 1 -- 172.21.15.18:0/1979017641 learned_addr learned my addr 172.21.15.18:0/1979017641 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cd200640 1 --2- 172.21.15.18:0/1979017641 >> v2:172.21.15.18:3300/0 conn(0x7f59c80cfcc0 0x7f59c80d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59bf400640 1 --2- 172.21.15.18:0/1979017641 >> v2:172.21.15.167:3300/0 conn(0x7f59c806cb10 0x7f59c80cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cd200640 1 -- 172.21.15.18:0/1979017641 >> v2:172.21.15.167:3300/0 conn(0x7f59c806cb10 msgr2=0x7f59c80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cd200640 1 --2- 172.21.15.18:0/1979017641 >> v2:172.21.15.167:3300/0 conn(0x7f59c806cb10 0x7f59c80cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cd200640 1 -- 172.21.15.18:0/1979017641 >> v1:172.21.15.18:6789/0 conn(0x7f59c806c730 legacy=0x7f59c815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.640+0000 7f59cd200640 1 -- 172.21.15.18:0/1979017641 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c809a0b0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cd200640 1 --2- 172.21.15.18:0/1979017641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80d0130 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f59c806dd50 tx=0x7f59c001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9691386f55ddc4b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59c7400640 1 -- 172.21.15.18:0/1979017641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00b2070 con 0x7f59c80cfcc0 2024-04-25T10:13:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59c7400640 1 -- 172.21.15.18:0/1979017641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c00a58d0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59c7400640 1 -- 172.21.15.18:0/1979017641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00a5ca0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- 172.21.15.18:0/1979017641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 msgr2=0x7f59c80d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 --2- 172.21.15.18:0/1979017641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80d0130 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f59c806dd50 tx=0x7f59c001c900 comp rx=0 tx=0).stop 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- 172.21.15.18:0/1979017641 shutdown_connections 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 --2- 172.21.15.18:0/1979017641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80d0130 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 --2- 172.21.15.18:0/1979017641 >> v2:172.21.15.167:3300/0 conn(0x7f59c806cb10 0x7f59c80cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- 172.21.15.18:0/1979017641 >> 172.21.15.18:0/1979017641 conn(0x7f59c80b3030 msgr2=0x7f59c80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- 172.21.15.18:0/1979017641 shutdown_connections 2024-04-25T10:13:24.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- 172.21.15.18:0/1979017641 wait complete. 2024-04-25T10:13:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 Processor -- start 2024-04-25T10:13:24.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.644+0000 7f59cdc00640 1 -- start start 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 0x7f59c814e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806cb10 0x7f59c814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b0720 con 0x7f59c80cfcc0 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8099a60 con 0x7f59c806c730 2024-04-25T10:13:24.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b08a0 con 0x7f59c806cb10 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41504/0 (socket says 172.21.15.18:41504) 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 -- 172.21.15.18:0/2079241652 learned_addr learned my addr 172.21.15.18:0/2079241652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 0x7f59c814e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59bf400640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806cb10 0x7f59c814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 -- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806cb10 msgr2=0x7f59c814ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806cb10 0x7f59c814ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 -- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 msgr2=0x7f59c814e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 0x7f59c814e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 -- 172.21.15.18:0/2079241652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c815d2d0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 0x7f59c814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cd200640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f59c00b0040 tx=0x7f59c00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c4c00640 1 -- 172.21.15.18:0/2079241652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00b2050 con 0x7f59c80cfcc0 2024-04-25T10:13:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c4c00640 1 -- 172.21.15.18:0/2079241652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c00be070 con 0x7f59c80cfcc0 2024-04-25T10:13:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c4c00640 1 -- 172.21.15.18:0/2079241652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00ad850 con 0x7f59c80cfcc0 2024-04-25T10:13:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c815cd10 con 0x7f59c80cfcc0 2024-04-25T10:13:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c80b46a0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.648+0000 7f59c4c00640 1 -- 172.21.15.18:0/2079241652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59c00ad9f0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c4c00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 0x7f59a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c4c00640 1 -- 172.21.15.18:0/2079241652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59c01202b0 con 0x7f59c80cfcc0 2024-04-25T10:13:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 Processor -- start 2024-04-25T10:13:24.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 0x7f59a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- start start 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 0x7f59a4069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f70 tx=0x7f59b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d177b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d178480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9cfc4ff0 con 0x557f9d1c19d0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9cf4d150 con 0x557f9d1780a0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f9cfc1090 con 0x557f9d1c22f0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41516/0 (socket says 172.21.15.18:41516) 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 -- 172.21.15.18:0/1093986928 learned_addr learned my addr 172.21.15.18:0/1093986928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59bf400640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d177b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59cd200640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d178480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 -- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 msgr2=0x557f9d177b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d177b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 -- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 msgr2=0x557f9d178480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d178480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 -- 172.21.15.18:0/1093986928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f9d15b0d0 con 0x557f9d1c19d0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59bf400640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d177b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f59b80058f0 tx=0x7f59b8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe1bbb7424f4a3f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59bcc00640 1 -- 172.21.15.18:0/1093986928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e7e0 con 0x557f9d1c19d0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59bcc00640 1 -- 172.21.15.18:0/1093986928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800e980 con 0x557f9d1c19d0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59bcc00640 1 -- 172.21.15.18:0/1093986928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800ed30 con 0x557f9d1c19d0 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- 172.21.15.18:0/1093986928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 msgr2=0x557f9d1c1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f59b80058f0 tx=0x7f59b8011000 comp rx=0 tx=0).stop 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- 172.21.15.18:0/1093986928 shutdown_connections 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d178480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d177b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1093986928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c1db0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- 172.21.15.18:0/1093986928 >> 172.21.15.18:0/1093986928 conn(0x557f9d174020 msgr2=0x557f9d176440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- 172.21.15.18:0/1093986928 shutdown_connections 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.652+0000 7f59d25ca000 1 -- 172.21.15.18:0/1093986928 wait complete. 2024-04-25T10:13:24.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- start start 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 Processor -- start 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d1a6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1c22f0 0x557f9d1a7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9cf89250 con 0x557f9d1780a0 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9cf7f690 con 0x557f9d1c22f0 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f9cf4da40 con 0x557f9d1c19d0 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 10 client.0 _ll_register_callbacks cb 0x557f9d162e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:24.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41526/0 (socket says 172.21.15.18:41526) 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 -- 172.21.15.18:0/1974304907 learned_addr learned my addr 172.21.15.18:0/1974304907 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59bf400640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d1a6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59cd200640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1c22f0 0x557f9d1a7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 -- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 msgr2=0x557f9d1a6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d1a6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 -- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1c22f0 msgr2=0x557f9d1a7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1c22f0 0x557f9d1a7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 -- 172.21.15.18:0/1974304907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f9d0721c0 con 0x557f9d1780a0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59c7e00640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x557f9cf813d0 tx=0x7f59b8000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bea07195373cec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800e7e0 con 0x557f9d1780a0 2024-04-25T10:13:24.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59b8021660 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59b800e980 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59b8032050 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 10 client.8679 fetch_fsmap learned FSMap version 84 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x557f9d06e170 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800e980 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f59b8035020 con 0x557f9d1780a0 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 10 client.8679 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 10 client.8679 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 20 client.8679 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d1c80 0x557f9d1d4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 4 client.8679 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.656+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f9cf60c60 con 0x557f9d1d1c80 2024-04-25T10:13:24.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59bf400640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d1c80 0x557f9d1d4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59bf400640 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d1c80 0x557f9d1d4070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c70cc487124540b0 server_cookie=d763d694d9adb37f in_seq=0 out_seq=0 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59b5600640 10 client.8679 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59b5600640 1 -- 172.21.15.18:0/1974304907 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557f9cf60c60 con 0x557f9d1d1c80 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59b5600640 10 client.8679 handle_command_reply: tid=0 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 client.8679 shutdown 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 msgr2=0x557f9d1a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x557f9cf813d0 tx=0x7f59b8000bd0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 shutdown_connections 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d1c80 0x557f9d1d4070 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1c22f0 0x557f9d1a7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d1a6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 --2- 172.21.15.18:0/1974304907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1780a0 0x557f9d1a67f0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59b5600640 0 client.8679 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 >> 172.21.15.18:0/1974304907 conn(0x557f9d174020 msgr2=0x557f9d176ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 shutdown_connections 2024-04-25T10:13:24.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 1 -- 172.21.15.18:0/1974304907 wait complete. 2024-04-25T10:13:24.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.660+0000 7f59d25ca000 20 client.8679 trim_cache size 0 max 16384 2024-04-25T10:13:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 Processor -- start 2024-04-25T10:13:24.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 -- start start 2024-04-25T10:13:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d177630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d1c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8203290 con 0x557f9d1c19d0 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b5aa0 con 0x557f9d1780a0 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b4ea0 con 0x557f9d1c22f0 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41536/0 (socket says 172.21.15.18:41536) 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 -- 172.21.15.18:0/162635083 learned_addr learned my addr 172.21.15.18:0/162635083 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59cd200640 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d1c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59c7e00640 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d177630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 -- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 msgr2=0x557f9d1c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d1c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 -- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 msgr2=0x557f9d177630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d177630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 -- 172.21.15.18:0/162635083 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f9d00bde0 con 0x557f9d1c19d0 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.676+0000 7f59bf400640 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f59b0006c10 tx=0x7f59b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f83639297ef0933c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b7e00640 1 -- 172.21.15.18:0/162635083 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b001f350 con 0x557f9d1c19d0 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b7e00640 1 -- 172.21.15.18:0/162635083 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b001f4f0 con 0x557f9d1c19d0 2024-04-25T10:13:24.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b7e00640 1 -- 172.21.15.18:0/162635083 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b001f8c0 con 0x557f9d1c19d0 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/162635083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 msgr2=0x557f9d1c0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f59b0006c10 tx=0x7f59b0008040 comp rx=0 tx=0).stop 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/162635083 shutdown_connections 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c22f0 0x557f9d1c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c19d0 0x557f9d1c0780 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- 172.21.15.18:0/162635083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d177630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/162635083 >> 172.21.15.18:0/162635083 conn(0x557f9d174020 msgr2=0x557f9d1c0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/162635083 shutdown_connections 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/162635083 wait complete. 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- start start 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 Processor -- start 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d222520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d222a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9cf5fe00 con 0x557f9d1c22f0 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80b54a0 con 0x557f9d1780a0 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f9cfc4300 con 0x557f9d1c19d0 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 10 client.0 _ll_register_callbacks cb 0x557f9d143040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41546/0 (socket says 172.21.15.18:41546) 2024-04-25T10:13:24.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 -- 172.21.15.18:0/2040613623 learned_addr learned my addr 172.21.15.18:0/2040613623 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59bf400640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d222a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d222520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 -- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 msgr2=0x557f9d222a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d222a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 -- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 msgr2=0x557f9d222520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d222520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 -- 172.21.15.18:0/2040613623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f9cf668e0 con 0x557f9d1c22f0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d222520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59cd200640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f59c001a530 tx=0x7f59c0120170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c936cd7134fb948c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c00f1240 con 0x557f9d1c22f0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f59c00b6db0 con 0x557f9d1c22f0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f59b001f4f0 con 0x557f9d1c22f0 2024-04-25T10:13:24.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59c0100050 con 0x557f9d1c22f0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 10 client.8685 fetch_fsmap learned FSMap version 84 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x557f9d01e8f0 con 0x557f9d1c22f0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b001f4f0 con 0x557f9d1c22f0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.680+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 84) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f59c0103020 con 0x557f9d1c22f0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 10 client.8685 fetch_fsmap finished waiting for FSMap version 84 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 10 client.8685 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 20 client.8685 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d4cb0 0x557f9d1d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 4 client.8685 mds_command: new command op to 36905 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 --> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557f9cfd2530 con 0x557f9d1d4cb0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d4cb0 0x557f9d1d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59c7e00640 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d4cb0 0x557f9d1d5090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afb739e30d98a60c server_cookie=32a65515419f4ff8 in_seq=0 out_seq=0 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59b5600640 10 client.8685 ms_handle_connect on v2:172.21.15.167:6835/81610203 2024-04-25T10:13:24.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59b5600640 1 -- 172.21.15.18:0/2040613623 <== mds.0 v2:172.21.15.167:6835/81610203 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557f9cfd2530 con 0x557f9d1d4cb0 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59b5600640 10 client.8685 handle_command_reply: tid=0 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 client.8685 shutdown 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 msgr2=0x557f9d1d4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f59c001a530 tx=0x7f59c0120170 comp rx=0 tx=0).stop 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 shutdown_connections 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:6835/81610203,v1:172.21.15.167:6837/81610203] conn(0x557f9d1d4cb0 0x557f9d1d5090 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557f9d1c22f0 0x557f9d1d4380 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x557f9d1c19d0 0x557f9d222a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 --2- 172.21.15.18:0/2040613623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557f9d1780a0 0x557f9d222520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 >> 172.21.15.18:0/2040613623 conn(0x557f9d174020 msgr2=0x557f9d1c0900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59b5600640 0 client.8685 ms_handle_reset on v2:172.21.15.167:6835/81610203 2024-04-25T10:13:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 shutdown_connections 2024-04-25T10:13:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 1 -- 172.21.15.18:0/2040613623 wait complete. 2024-04-25T10:13:24.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59d25ca000 20 client.8685 trim_cache size 0 max 16384 2024-04-25T10:13:24.698 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:13:24.698 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:13:24.699 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:13:24.699 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:13:24.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 msgr2=0x7f59a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 0x7f59a4069450 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000f70 tx=0x7f59b8009040 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 msgr2=0x7f59c80b2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f59c00b0040 tx=0x7f59c00196a0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 shutdown_connections 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f59c80cfcc0 0x7f59c80b2740 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f59a4066f90 0x7f59a4069450 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f59c806cb10 0x7f59c814ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 --2- 172.21.15.18:0/2079241652 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59c806c730 0x7f59c814e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 >> 172.21.15.18:0/2079241652 conn(0x7f59c80b3030 msgr2=0x7f59c80736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 shutdown_connections 2024-04-25T10:13:24.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.684+0000 7f59cdc00640 1 -- 172.21.15.18:0/2079241652 wait complete. 2024-04-25T10:13:24.713 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:13:24.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:13:24.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.948+0000 7ff2eee00640 1 Processor -- start 2024-04-25T10:13:24.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.948+0000 7ff2eee00640 1 -- start start 2024-04-25T10:13:24.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2eee00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff2e80cf3b0 0x7ff2e8168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2eee00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e806ac10 con 0x7ff2e8072210 2024-04-25T10:13:24.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2eee00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e806aeb0 con 0x7ff2e815dd90 2024-04-25T10:13:24.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2eee00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80b2dc0 con 0x7ff2e80cf3b0 2024-04-25T10:13:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2dfe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff2e8072210 0x7ff2e80cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37214/0 (socket says 172.21.15.18:37214) 2024-04-25T10:13:24.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2dfe00640 1 -- 172.21.15.18:0/2143828072 learned_addr learned my addr 172.21.15.18:0/2143828072 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986786432 0 0) 0x7ff2e806ac10 con 0x7ff2e8072210 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2cc003530 con 0x7ff2e8072210 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 --2- 172.21.15.18:0/2143828072 >> v2:172.21.15.167:3300/0 conn(0x7ff2e80cf3b0 0x7ff2e8168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 39118753 0 0) 0x7ff2cc003530 con 0x7ff2e8072210 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 >> v2:172.21.15.167:3300/0 conn(0x7ff2e80cf3b0 msgr2=0x7ff2e8168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 --2- 172.21.15.18:0/2143828072 >> v2:172.21.15.167:3300/0 conn(0x7ff2e80cf3b0 0x7ff2e8168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 >> v1:172.21.15.167:6789/0 conn(0x7ff2e815dd90 legacy=0x7ff2e8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e806b190 con 0x7ff2e8072210 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff2d0001680 con 0x7ff2e8072210 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 >> v1:172.21.15.18:6789/0 conn(0x7ff2e8072210 legacy=0x7ff2e80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2cc0039c0 0x7ff2cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2cc004810 0x7ff2cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc00c140 con 0x7ff2cc0051d0 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc00c2f0 con 0x7ff2cc004810 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc00c4f0 con 0x7ff2cc0039c0 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2dfe00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2cc004810 0x7ff2cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2e7e00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2cc0039c0 0x7ff2cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 -- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2cc0039c0 msgr2=0x7ff2cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2cc0039c0 0x7ff2cc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 -- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2cc004810 msgr2=0x7ff2cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2cc004810 0x7ff2cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.952+0000 7ff2ece00640 1 -- 172.21.15.18:0/2143828072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc003530 con 0x7ff2cc0051d0 2024-04-25T10:13:24.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2ece00640 1 -- 172.21.15.18:0/2143828072 reap_dead start 2024-04-25T10:13:24.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2ece00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2cc00b9d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fc0 tx=0x7ff2e001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6eccfa9eec22d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0009c10 con 0x7ff2cc0051d0 2024-04-25T10:13:24.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00a5c00 con 0x7ff2cc0051d0 2024-04-25T10:13:24.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2e7400640 1 -- 172.21.15.18:0/2143828072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00039a0 con 0x7ff2cc0051d0 2024-04-25T10:13:24.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 msgr2=0x7ff2cc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2cc00b9d0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fc0 tx=0x7ff2e001ccc0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- 172.21.15.18:0/2143828072 shutdown_connections 2024-04-25T10:13:24.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 --2- 172.21.15.18:0/2143828072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2cc00b9d0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- 172.21.15.18:0/2143828072 >> 172.21.15.18:0/2143828072 conn(0x7ff2e80cfd90 msgr2=0x7ff2e80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- 172.21.15.18:0/2143828072 shutdown_connections 2024-04-25T10:13:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- 172.21.15.18:0/2143828072 wait complete. 2024-04-25T10:13:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 Processor -- start 2024-04-25T10:13:24.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.956+0000 7ff2eee00640 1 -- start start 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 0x7ff2e80b05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 0x7ff2e815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80cf7c0 con 0x7ff2cc0051d0 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e806b750 con 0x7ff2e815af80 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80cf940 con 0x7ff2e80b0170 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41566/0 (socket says 172.21.15.18:41566) 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 -- 172.21.15.18:0/3260446405 learned_addr learned my addr 172.21.15.18:0/3260446405 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2dfe00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 0x7ff2e80b05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2ece00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 0x7ff2e815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 -- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 msgr2=0x7ff2e80b05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 0x7ff2e80b05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 -- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 msgr2=0x7ff2e815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 0x7ff2e815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 -- 172.21.15.18:0/3260446405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e814fdd0 con 0x7ff2cc0051d0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2dfe00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 0x7ff2e80b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2ece00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 0x7ff2e815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e7e00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800e4b0 tx=0x7ff2d800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80052e0 con 0x7ff2cc0051d0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8018070 con 0x7ff2cc0051d0 2024-04-25T10:13:24.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8005480 con 0x7ff2cc0051d0 2024-04-25T10:13:24.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e815bb90 con 0x7ff2cc0051d0 2024-04-25T10:13:24.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e815c150 con 0x7ff2cc0051d0 2024-04-25T10:13:24.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e806f150 con 0x7ff2cc0051d0 2024-04-25T10:13:24.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.960+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2d8003840 con 0x7ff2cc0051d0 2024-04-25T10:13:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.964+0000 7ff2e4c00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 0x7ff2c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.964+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff2d8084ee0 con 0x7ff2cc0051d0 2024-04-25T10:13:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.964+0000 7ff2dfe00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 0x7ff2c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:24.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.964+0000 7ff2dfe00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 0x7ff2c4069420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0001d60 tx=0x7ff2d0001c70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:24.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:24.968+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2d8055cc0 con 0x7ff2cc0051d0 2024-04-25T10:13:25.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.160+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff2e80745d0 con 0x7ff2cc0051d0 2024-04-25T10:13:25.170 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:13:25.164+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:13:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.164+0000 7ff2e4c00640 1 -- 172.21.15.18:0/3260446405 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff2d80555c0 con 0x7ff2cc0051d0 2024-04-25T10:13:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 msgr2=0x7ff2c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 0x7ff2c4069420 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0001d60 tx=0x7ff2d0001c70 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 msgr2=0x7ff2e814f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800e4b0 tx=0x7ff2d800e970 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 shutdown_connections 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e815af80 0x7ff2e815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2c4066f60 0x7ff2c4069420 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff2e80b0170 0x7ff2e80b05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 --2- 172.21.15.18:0/3260446405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2cc0051d0 0x7ff2e814f890 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 >> 172.21.15.18:0/3260446405 conn(0x7ff2e80cfd90 msgr2=0x7ff2e80cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 shutdown_connections 2024-04-25T10:13:25.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.168+0000 7ff2eee00640 1 -- 172.21.15.18:0/3260446405 wait complete. 2024-04-25T10:13:25.189 INFO:tasks.ceph.mds.d.smithi167.stderr: -6987> 2024-04-25T10:12:41.357+0000 7f532a800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:13:25.195 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T10:13:25.240 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:13:25.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- start start 2024-04-25T10:13:25.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 Processor -- start 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565118349800 0x565118502580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565118349400 0x565118502b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565119118600 con 0x565118349000 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565119118480 con 0x565118349400 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565119118300 con 0x565118349800 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41568/0 (socket says 172.21.15.18:41568) 2024-04-25T10:13:25.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 -- 172.21.15.18:0/802136880 learned_addr learned my addr 172.21.15.18:0/802136880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca64e00640 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565118349400 0x565118502b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca65800640 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565118349800 0x565118502580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 -- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565118349800 msgr2=0x565118502580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565118349800 0x565118502580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 -- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565118349400 msgr2=0x565118502b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565118349400 0x565118502b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 -- 172.21.15.18:0/802136880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651183eab40 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca66200640 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x5651191a9350 tx=0x56511840cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf6e58e16d967c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca62600640 1 -- 172.21.15.18:0/802136880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837e4e0 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca62600640 1 -- 172.21.15.18:0/802136880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565118393340 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca62600640 1 -- 172.21.15.18:0/802136880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837eb60 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651183ead20 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5651183eaf00 con 0x565118349000 2024-04-25T10:13:25.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 4 waiting for MDS map... 2024-04-25T10:13:25.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca62600640 1 -- 172.21.15.18:0/802136880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x565119266600 con 0x565118349000 2024-04-25T10:13:25.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca62600640 1 -- 172.21.15.18:0/802136880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 85) v1 ==== 2723+0+0 (secure 0 0 0) 0x56511839f180 con 0x565118349000 2024-04-25T10:13:25.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 4 Got MDS map 85 2024-04-25T10:13:25.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 10 main: JournalTool::main 2024-04-25T10:13:25.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:13:25.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 Processor -- start 2024-04-25T10:13:25.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.236+0000 7fca67716400 1 -- start start 2024-04-25T10:13:25.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 0x565118503600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119111400 0x565118504100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565119118180 con 0x565119111400 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651183a8480 con 0x565119111000 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651183a8900 con 0x565119110c00 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca65800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 0x565118503600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca65800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:47250/0 (socket says 172.21.15.18:47250) 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca65800640 1 -- 172.21.15.18:0/4083039408 learned_addr learned my addr 172.21.15.18:0/4083039408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119111400 0x565118504100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 -- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 msgr2=0x565118503b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 -- 172.21.15.18:0/4083039408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119111400 msgr2=0x565118504100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119111400 0x565118504100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 -- 172.21.15.18:0/4083039408 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651183ead20 con 0x565119110c00 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca65800640 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca64e00640 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 0x565118503600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5651191a8930 tx=0x565118420300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bb48809a3ce3807 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca5fe00640 1 -- 172.21.15.18:0/4083039408 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837e9c0 con 0x565119110c00 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca5fe00640 1 -- 172.21.15.18:0/4083039408 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565118392540 con 0x565119110c00 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca5fe00640 1 -- 172.21.15.18:0/4083039408 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837e4e0 con 0x565119110c00 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 msgr2=0x565118503600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 0x565118503600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x5651191a8930 tx=0x565118420300 comp rx=0 tx=0).stop 2024-04-25T10:13:25.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- 172.21.15.18:0/4083039408 shutdown_connections 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119111400 0x565118504100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111000 0x565118503b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 --2- 172.21.15.18:0/4083039408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119110c00 0x565118503600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- 172.21.15.18:0/4083039408 >> 172.21.15.18:0/4083039408 conn(0x565118348c00 msgr2=0x565118375000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- 172.21.15.18:0/4083039408 shutdown_connections 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- 172.21.15.18:0/4083039408 wait complete. 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 Processor -- start 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.240+0000 7fca67716400 1 -- start start 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119111000 0x565118504c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111400 0x565118504680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565119119800 con 0x565119110c00 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565119119680 con 0x565119111400 2024-04-25T10:13:25.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565119119500 con 0x565119111000 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41592/0 (socket says 172.21.15.18:41592) 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 learned_addr learned my addr 172.21.15.18:0/750747116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca65800640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119111000 0x565118504c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119111000 msgr2=0x565118504c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119111000 0x565118504c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111400 msgr2=0x565118504680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565119111400 0x565118504680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651183eba40 con 0x565119110c00 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca65800640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565119111000 0x565118504c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca64e00640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x56511926cab0 tx=0x565118420360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 -- 172.21.15.18:0/750747116 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837eb60 con 0x565119110c00 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 -- 172.21.15.18:0/750747116 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565118392c40 con 0x565119110c00 2024-04-25T10:13:25.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 -- 172.21.15.18:0/750747116 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56511837e000 con 0x565119110c00 2024-04-25T10:13:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5651183ebc20 con 0x565119110c00 2024-04-25T10:13:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651183ea1e0 con 0x565119110c00 2024-04-25T10:13:25.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 4 main: JournalTool: resolving pool 15 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 -- 172.21.15.18:0/750747116 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x565118674c00 con 0x565119110c00 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x565118766000 0x565118505700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca5e000640 1 -- 172.21.15.18:0/750747116 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x5651192d0600 con 0x565119110c00 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 4 main: Executing for rank 0 2024-04-25T10:13:25.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 4 Filtering by inode '1099511627777' 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x565119111800 0x565118504100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x565119111c00 con 0x565119111800 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.244+0000 7fca65800640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x565118766000 0x565118505700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca64e00640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x565119111800 0x565118504100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca65800640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x565118766000 0x565118505700 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56511926c8a0 tx=0x565119273f20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca64e00640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x565119111800 0x565118504100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5651184c4000 con 0x565119111800 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 4 Pointer 400.00000000 is readable 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x565118767000 con 0x565119111800 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5651184c4000 con 0x565119111800 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Starting journal scan from offset 0x407953 2024-04-25T10:13:25.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x565118767400 con 0x565119111800 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca64e00640 1 -- 172.21.15.18:0/750747116 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x5651184c4000 con 0x565119111800 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Parsing data, 0x37c bytes available 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Attempting decode at 0x407953 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Consumed 0x37c bytes 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 10 Valid entry at 0x407953 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x565118767800 0x565118503b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x565118767c00 con 0x565118767800 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca66200640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x565118767800 0x565118503b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.248+0000 7fca66200640 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x565118767800 0x565118503b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca66200640 1 -- 172.21.15.18:0/750747116 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5651184c4500 con 0x565118767800 2024-04-25T10:13:25.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 Reached end of journal objects 2024-04-25T10:13:25.261 INFO:teuthology.orchestra.run.smithi018.stdout:Events by type: 2024-04-25T10:13:25.261 INFO:teuthology.orchestra.run.smithi018.stdout:Errors: 0 2024-04-25T10:13:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T10:13:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 Events scanned, 0 gaps 2024-04-25T10:13:25.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 Found 1 valid events 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 Selected 0 events events for processing 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 4 0 events 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x565119111800 msgr2=0x565118504100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x565119111800 0x565118504100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x565118767800 msgr2=0x565118503b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x565118767800 0x565118503b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x565118766000 msgr2=0x565118505700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x565118766000 0x565118505700 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x56511926c8a0 tx=0x565119273f20 comp rx=0 tx=0).stop 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 msgr2=0x565118505180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x56511926cab0 tx=0x565118420360 comp rx=0 tx=0).stop 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca65800640 1 -- 172.21.15.18:0/750747116 reap_dead start 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 shutdown_connections 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/750747116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565119110c00 0x565118505180 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 >> 172.21.15.18:0/750747116 conn(0x565118348c00 msgr2=0x565118375000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 shutdown_connections 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/750747116 wait complete. 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 msgr2=0x565118503080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x5651191a9350 tx=0x56511840cde0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 shutdown_connections 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565118349000 0x565118503080 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565118349400 0x565118502b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 --2- 172.21.15.18:0/802136880 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565118349800 0x565118502580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 >> 172.21.15.18:0/802136880 conn(0x565118349c00 msgr2=0x565118375800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 shutdown_connections 2024-04-25T10:13:25.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.252+0000 7fca67716400 1 -- 172.21.15.18:0/802136880 wait complete. 2024-04-25T10:13:25.265 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.069995, result: Events by type: Errors: 0 2024-04-25T10:13:25.266 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T10:13:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 -- start start 2024-04-25T10:13:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 Processor -- start 2024-04-25T10:13:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0f789400 0x558d0f942b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d0f789000 0x558d0f943080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d10558600 con 0x558d0f789800 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d10558480 con 0x558d0f789400 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d10558300 con 0x558d0f789000 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41594/0 (socket says 172.21.15.18:41594) 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 -- 172.21.15.18:0/3244131552 learned_addr learned my addr 172.21.15.18:0/3244131552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbe600640 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0f789400 0x558d0f942b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d0f789000 0x558d0f943080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 -- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d0f789000 msgr2=0x558d0f943080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d0f789000 0x558d0f943080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 -- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0f789400 msgr2=0x558d0f942b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0f789400 0x558d0f942b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.348+0000 7f2dbf000640 1 -- 172.21.15.18:0/3244131552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d0f82ab40 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x558d105e89c0 tx=0x558d0f860000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783ace6f58a47e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbbe00640 1 -- 172.21.15.18:0/3244131552 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7be9c0 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbbe00640 1 -- 172.21.15.18:0/3244131552 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d0f7d2c40 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbbe00640 1 -- 172.21.15.18:0/3244131552 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7be4e0 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d0f82ad20 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558d0f82af00 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 4 waiting for MDS map... 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbbe00640 1 -- 172.21.15.18:0/3244131552 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x558d106b6200 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbbe00640 1 -- 172.21.15.18:0/3244131552 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 85) v1 ==== 2723+0+0 (secure 0 0 0) 0x558d0f7df180 con 0x558d0f789800 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 4 Got MDS map 85 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 10 main: JournalTool::main 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:13:25.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 Processor -- start 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- start start 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f943600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 0x558d0f944100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d10558180 con 0x558d1055bc00 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0f7e8480 con 0x558d10708000 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d0f7e8900 con 0x558d1055b800 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41598/0 (socket says 172.21.15.18:41598) 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 -- 172.21.15.18:0/553950626 learned_addr learned my addr 172.21.15.18:0/553950626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f943600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbe600640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 0x558d0f944100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 -- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 msgr2=0x558d0f943600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f943600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 -- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 msgr2=0x558d0f944100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 0x558d0f944100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 -- 172.21.15.18:0/553950626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d0f82a1e0 con 0x558d1055bc00 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbe600640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 0x558d0f944100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dbf000640 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x558d10700750 tx=0x558d0f860300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aabdaa75691022cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2db9600640 1 -- 172.21.15.18:0/553950626 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7beb60 con 0x558d1055bc00 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2db9600640 1 -- 172.21.15.18:0/553950626 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d0f7d2a80 con 0x558d1055bc00 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2db9600640 1 -- 172.21.15.18:0/553950626 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7be340 con 0x558d1055bc00 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/553950626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 msgr2=0x558d0f943b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.352+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x558d10700750 tx=0x558d0f860300 comp rx=0 tx=0).stop 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/553950626 shutdown_connections 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d10708000 0x558d0f944100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1055bc00 0x558d0f943b80 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/553950626 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f943600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/553950626 >> 172.21.15.18:0/553950626 conn(0x558d0f788c00 msgr2=0x558d0f7b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/553950626 shutdown_connections 2024-04-25T10:13:25.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/553950626 wait complete. 2024-04-25T10:13:25.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 Processor -- start 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- start start 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d1055bc00 0x558d0f945180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f944c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d10559380 con 0x558d10709800 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d10559200 con 0x558d1055bc00 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d10559500 con 0x558d1055b800 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41606/0 (socket says 172.21.15.18:41606) 2024-04-25T10:13:25.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 -- 172.21.15.18:0/1466338631 learned_addr learned my addr 172.21.15.18:0/1466338631 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbf000640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f944c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d1055bc00 0x558d0f945180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 msgr2=0x558d0f944c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d1055b800 0x558d0f944c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d1055bc00 msgr2=0x558d0f945180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d1055bc00 0x558d0f945180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d0f82ba40 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dbe600640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x558d107014a0 tx=0x558d106c4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2db7800640 1 -- 172.21.15.18:0/1466338631 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7beb60 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2db7800640 1 -- 172.21.15.18:0/1466338631 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d0f7d3340 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d0f82bc20 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2db7800640 1 -- 172.21.15.18:0/1466338631 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d0f7be340 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d0fad2000 con 0x558d10709800 2024-04-25T10:13:25.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.356+0000 7f2dc0f3d400 4 main: JournalTool: resolving pool 15 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2db7800640 1 -- 172.21.15.18:0/1466338631 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x558d10702c00 con 0x558d10709800 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2db7800640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x558d0fac2c00 0x558d0f945700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2db7800640 1 -- 172.21.15.18:0/1466338631 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x558d0fac4a00 con 0x558d10709800 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 main: Executing for rank 0 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 Filtering by inode '1099511627778' 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x558d10709400 0x558d0f944100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x558d10709000 con 0x558d10709400 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x558d0fac2c00 0x558d0f945700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbf000640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x558d10709400 0x558d0f944100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbf000640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x558d10709400 0x558d0f944100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x558d0fac2c00 0x558d0f945700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x558d0f896810 tx=0x558d0fbbc000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbf000640 1 -- 172.21.15.18:0/1466338631 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x558d0f904000 con 0x558d10709400 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 Pointer 400.00000000 is readable 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x558d10708c00 con 0x558d10709400 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbf000640 1 -- 172.21.15.18:0/1466338631 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x558d0f904000 con 0x558d10709400 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Starting journal scan from offset 0x407953 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x558d10708800 con 0x558d10709400 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbf000640 1 -- 172.21.15.18:0/1466338631 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x558d0f904000 con 0x558d10709400 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Parsing data, 0x37c bytes available 2024-04-25T10:13:25.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Attempting decode at 0x407953 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Consumed 0x37c bytes 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 10 Valid entry at 0x407953 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x558d10708400 0x558d0f943b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x558d10708000 con 0x558d10708400 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.360+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x558d10708400 0x558d0f943b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dbfa00640 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x558d10708400 0x558d0f943b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dbfa00640 1 -- 172.21.15.18:0/1466338631 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558d0f904500 con 0x558d10708400 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 Reached end of journal objects 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 Events scanned, 0 gaps 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 Found 1 valid events 2024-04-25T10:13:25.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 Selected 0 events events for processing 2024-04-25T10:13:25.376 INFO:teuthology.orchestra.run.smithi018.stdout:Events by type: 2024-04-25T10:13:25.376 INFO:teuthology.orchestra.run.smithi018.stdout:Errors: 0 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 4 0 events 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x558d10709400 msgr2=0x558d0f944100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x558d10709400 0x558d0f944100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x558d10708400 msgr2=0x558d0f943b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x558d10708400 0x558d0f943b80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x558d0fac2c00 msgr2=0x558d0f945700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x558d0fac2c00 0x558d0f945700 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x558d0f896810 tx=0x558d0fbbc000 comp rx=0 tx=0).stop 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 msgr2=0x558d0f944680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dbe600640 1 -- 172.21.15.18:0/1466338631 reap_dead start 2024-04-25T10:13:25.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x558d107014a0 tx=0x558d106c4c00 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 shutdown_connections 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/1466338631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d10709800 0x558d0f944680 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 >> 172.21.15.18:0/1466338631 conn(0x558d0f788c00 msgr2=0x558d0f7b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 shutdown_connections 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/1466338631 wait complete. 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 msgr2=0x558d0f942580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x558d105e89c0 tx=0x558d0f860000 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 shutdown_connections 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558d0f789000 0x558d0f943080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558d0f789400 0x558d0f942b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 --2- 172.21.15.18:0/3244131552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d0f789800 0x558d0f942580 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 >> 172.21.15.18:0/3244131552 conn(0x558d0f789c00 msgr2=0x558d0f7b5800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 shutdown_connections 2024-04-25T10:13:25.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.364+0000 7f2dc0f3d400 1 -- 172.21.15.18:0/3244131552 wait complete. 2024-04-25T10:13:25.380 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.114131, result: Events by type: Errors: 0 2024-04-25T10:13:25.380 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T10:13:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 Processor -- start 2024-04-25T10:13:25.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- start start 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f5bdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f5c1570 0x558e4f51c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4f5c2370 con 0x558e4f535170 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4f4909f0 con 0x558e4f51dd50 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e4f5c24f0 con 0x558e4f5c1570 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41612/0 (socket says 172.21.15.18:41612) 2024-04-25T10:13:25.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 -- 172.21.15.18:0/393934606 learned_addr learned my addr 172.21.15.18:0/393934606 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3834400640 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f5bdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3834e00640 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f5c1570 0x558e4f51c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 -- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f5c1570 msgr2=0x558e4f51c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f5c1570 0x558e4f51c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 -- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 msgr2=0x558e4f5bdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f5bdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 -- 172.21.15.18:0/393934606 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e4f52d580 con 0x558e4f535170 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3833a00640 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f382000b350 tx=0x7f382000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa6e68dbc3955df5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3832600640 1 -- 172.21.15.18:0/393934606 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000d5d0 con 0x558e4f535170 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3832600640 1 -- 172.21.15.18:0/393934606 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820008070 con 0x558e4f535170 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3832600640 1 -- 172.21.15.18:0/393934606 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382000d970 con 0x558e4f535170 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- 172.21.15.18:0/393934606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 msgr2=0x558e4f51c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f382000b350 tx=0x7f382000b810 comp rx=0 tx=0).stop 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- 172.21.15.18:0/393934606 shutdown_connections 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f5c1570 0x558e4f51c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f535170 0x558e4f51c3b0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 --2- 172.21.15.18:0/393934606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f5bdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- 172.21.15.18:0/393934606 >> 172.21.15.18:0/393934606 conn(0x558e4f4ea440 msgr2=0x558e4f4e86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- 172.21.15.18:0/393934606 shutdown_connections 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.420+0000 7f3837238080 1 -- 172.21.15.18:0/393934606 wait complete. 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 Processor -- start 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- start start 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f51c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f535170 0x558e4f537170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 0x558e4f5bab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4f652e00 con 0x558e4f5c1570 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e4f5be1a0 con 0x558e4f51dd50 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e4f6530a0 con 0x558e4f535170 2024-04-25T10:13:25.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 0x558e4f5bab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 0x558e4f5bab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41624/0 (socket says 172.21.15.18:41624) 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 -- 172.21.15.18:0/1290994615 learned_addr learned my addr 172.21.15.18:0/1290994615 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3833a00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f535170 0x558e4f537170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834400640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f51c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 -- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f535170 msgr2=0x558e4f537170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558e4f535170 0x558e4f537170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 -- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 msgr2=0x558e4f51c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e4f51dd50 0x558e4f51c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 -- 172.21.15.18:0/1290994615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e4f5171b0 con 0x558e4f5c1570 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3834e00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 0x558e4f5bab00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f382c010910 tx=0x7f382c010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3831200640 1 -- 172.21.15.18:0/1290994615 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c018070 con 0x558e4f5c1570 2024-04-25T10:13:25.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3831200640 1 -- 172.21.15.18:0/1290994615 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c00e9b0 con 0x558e4f5c1570 2024-04-25T10:13:25.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3831200640 1 -- 172.21.15.18:0/1290994615 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c00ed80 con 0x558e4f5c1570 2024-04-25T10:13:25.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e4f517450 con 0x558e4f5c1570 2024-04-25T10:13:25.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.424+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e4f530280 con 0x558e4f5c1570 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3831200640 1 -- 172.21.15.18:0/1290994615 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f382c01b070 con 0x558e4f5c1570 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3831200640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3814065970 0x7f3814067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3831200640 1 -- 172.21.15.18:0/1290994615 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f382c084600 con 0x558e4f5c1570 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3834400640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3814065970 0x7f3814067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3837238080 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558e4f5376b0 0x558e4f52f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e109) v9 -- 0x558e4f51ca10 con 0x558e4f5376b0 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3833a00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558e4f5376b0 0x558e4f52f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3834400640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3814065970 0x7f3814067e30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f38240ac000 tx=0x7f38240a5000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.428+0000 7f3833a00640 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558e4f5376b0 0x558e4f52f360 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3833a00640 1 -- 172.21.15.18:0/1290994615 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v109'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f382000d910 con 0x558e4f5376b0 2024-04-25T10:13:25.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558e4f5376b0 msgr2=0x558e4f52f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x558e4f5376b0 0x558e4f52f360 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3814065970 msgr2=0x7f3814067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3814065970 0x7f3814067e30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f38240ac000 tx=0x7f38240a5000 comp rx=0 tx=0).stop 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 msgr2=0x558e4f5bab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 --2- 172.21.15.18:0/1290994615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558e4f5c1570 0x558e4f5bab00 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f382c010910 tx=0x7f382c010d10 comp rx=0 tx=0).stop 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3834e00640 1 -- 172.21.15.18:0/1290994615 reap_dead start 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 shutdown_connections 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 >> 172.21.15.18:0/1290994615 conn(0x558e4f4ea440 msgr2=0x558e4f655a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 shutdown_connections 2024-04-25T10:13:25.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.432+0000 7f3837238080 1 -- 172.21.15.18:0/1290994615 wait complete. 2024-04-25T10:13:25.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:13:25.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.624+0000 7f5d73e00640 1 Processor -- start 2024-04-25T10:13:25.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.624+0000 7f5d73e00640 1 -- start start 2024-04-25T10:13:25.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5d74099a60 0x7f5d7406c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d74099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7409a380 con 0x7f5d741614d0 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7406ca00 con 0x7f5d74099a60 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7406cce0 con 0x7f5d7415ddb0 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5d741614d0 0x7f5d74161960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37254/0 (socket says 172.21.15.18:37254) 2024-04-25T10:13:25.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d73400640 1 -- 172.21.15.18:0/3680484337 learned_addr learned my addr 172.21.15.18:0/3680484337 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d72a00640 1 --2- 172.21.15.18:0/3680484337 >> v2:172.21.15.167:3300/0 conn(0x7f5d74099a60 0x7f5d7406c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d6be00640 1 --2- 172.21.15.18:0/3680484337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d74099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d72000640 1 -- 172.21.15.18:0/3680484337 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142085396 0 0) 0x7f5d7409a380 con 0x7f5d741614d0 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d72000640 1 -- 172.21.15.18:0/3680484337 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d58003530 con 0x7f5d741614d0 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d6be00640 1 -- 172.21.15.18:0/3680484337 >> v2:172.21.15.167:3300/0 conn(0x7f5d74099a60 msgr2=0x7f5d7406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d6be00640 1 --2- 172.21.15.18:0/3680484337 >> v2:172.21.15.167:3300/0 conn(0x7f5d74099a60 0x7f5d7406c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d6be00640 1 -- 172.21.15.18:0/3680484337 >> v1:172.21.15.18:6789/0 conn(0x7f5d741614d0 legacy=0x7f5d74161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.628+0000 7f5d6be00640 1 -- 172.21.15.18:0/3680484337 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7406cfc0 con 0x7f5d7415ddb0 2024-04-25T10:13:25.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d6be00640 1 --2- 172.21.15.18:0/3680484337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d74099e40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097c0 tx=0x7f5d5c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd4458e12f40eb9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d72000640 1 -- 172.21.15.18:0/3680484337 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0a7070 con 0x7f5d7415ddb0 2024-04-25T10:13:25.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d72000640 1 -- 172.21.15.18:0/3680484337 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5c0b0070 con 0x7f5d7415ddb0 2024-04-25T10:13:25.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d72000640 1 -- 172.21.15.18:0/3680484337 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5c0ab870 con 0x7f5d7415ddb0 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- 172.21.15.18:0/3680484337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 msgr2=0x7f5d74099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 --2- 172.21.15.18:0/3680484337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d74099e40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0097c0 tx=0x7f5d5c01c470 comp rx=0 tx=0).stop 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- 172.21.15.18:0/3680484337 shutdown_connections 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 --2- 172.21.15.18:0/3680484337 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d74099e40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 --2- 172.21.15.18:0/3680484337 >> v2:172.21.15.167:3300/0 conn(0x7f5d74099a60 0x7f5d7406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- 172.21.15.18:0/3680484337 >> 172.21.15.18:0/3680484337 conn(0x7f5d740d15d0 msgr2=0x7f5d740d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- 172.21.15.18:0/3680484337 shutdown_connections 2024-04-25T10:13:25.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- 172.21.15.18:0/3680484337 wait complete. 2024-04-25T10:13:25.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 Processor -- start 2024-04-25T10:13:25.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.632+0000 7f5d73e00640 1 -- start start 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d740b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d741614d0 0x7f5d740b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7409abe0 con 0x7f5d74099a60 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7409aa60 con 0x7f5d741614d0 2024-04-25T10:13:25.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7416b020 con 0x7f5d7415ddb0 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41628/0 (socket says 172.21.15.18:41628) 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 -- 172.21.15.18:0/7346543 learned_addr learned my addr 172.21.15.18:0/7346543 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d6be00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d740b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73400640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d741614d0 0x7f5d740b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 -- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 msgr2=0x7f5d740b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d740b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 -- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d741614d0 msgr2=0x7f5d740b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d741614d0 0x7f5d740b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 -- 172.21.15.18:0/7346543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74153c70 con 0x7f5d74099a60 2024-04-25T10:13:25.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d72a00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e8a0 tx=0x7f5d6400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d64017070 con 0x7f5d74099a60 2024-04-25T10:13:25.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6400c940 con 0x7f5d74099a60 2024-04-25T10:13:25.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6400ccf0 con 0x7f5d74099a60 2024-04-25T10:13:25.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d74156450 con 0x7f5d74099a60 2024-04-25T10:13:25.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.636+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d740b6e70 con 0x7f5d74099a60 2024-04-25T10:13:25.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d74068670 con 0x7f5d74099a60 2024-04-25T10:13:25.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5d6401a070 con 0x7f5d74099a60 2024-04-25T10:13:25.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d6aa00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 0x7f5d50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:25.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5d64085070 con 0x7f5d74099a60 2024-04-25T10:13:25.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d6be00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 0x7f5d50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:25.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.640+0000 7f5d6be00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 0x7f5d50069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0af000 tx=0x7f5d5c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:25.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.644+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d64055840 con 0x7f5d74099a60 2024-04-25T10:13:25.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:25.840+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f5d740745d0 con 0x7f5d74099a60 2024-04-25T10:13:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.172+0000 7f5d6aa00640 1 -- 172.21.15.18:0/7346543 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v86) v1 ==== 162+0+0 (secure 0 0 0) 0x7f5d640598e0 con 0x7f5d74099a60 2024-04-25T10:13:26.181 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 msgr2=0x7f5d50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 0x7f5d50069420 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c0af000 tx=0x7f5d5c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 msgr2=0x7f5d74153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400e8a0 tx=0x7f5d6400eca0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 shutdown_connections 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d741614d0 0x7f5d740b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d50066f60 0x7f5d50069420 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d7415ddb0 0x7f5d740b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 --2- 172.21.15.18:0/7346543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d74099a60 0x7f5d74153730 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 >> 172.21.15.18:0/7346543 conn(0x7f5d740d15d0 msgr2=0x7f5d740b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 shutdown_connections 2024-04-25T10:13:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.176+0000 7f5d73e00640 1 -- 172.21.15.18:0/7346543 wait complete. 2024-04-25T10:13:26.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:13:26.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 Processor -- start 2024-04-25T10:13:26.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 -- start start 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 0x7fcc6c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc6c15ac60 con 0x7fcc6c144140 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c06ed50 con 0x7fcc6c0cef30 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.340+0000 7fcc72400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc6c0cf3e0 con 0x7fcc6c06e900 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41636/0 (socket says 172.21.15.18:41636) 2024-04-25T10:13:26.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 -- 172.21.15.18:0/368419539 learned_addr learned my addr 172.21.15.18:0/368419539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc6be00640 1 --2- 172.21.15.18:0/368419539 >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 0x7fcc6c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 -- 172.21.15.18:0/368419539 >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 msgr2=0x7fcc6c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 --2- 172.21.15.18:0/368419539 >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 0x7fcc6c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 -- 172.21.15.18:0/368419539 >> v1:172.21.15.167:6789/0 conn(0x7fcc6c144140 legacy=0x7fcc6c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 -- 172.21.15.18:0/368419539 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c15af20 con 0x7fcc6c0cef30 2024-04-25T10:13:26.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc6be00640 1 --2- 172.21.15.18:0/368419539 >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 0x7fcc6c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:26.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc63e00640 1 --2- 172.21.15.18:0/368419539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cddd0 tx=0x7fcc5401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be4e09c1718fa6d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:26.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc6aa00640 1 -- 172.21.15.18:0/368419539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540b0070 con 0x7fcc6c0cef30 2024-04-25T10:13:26.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc6aa00640 1 -- 172.21.15.18:0/368419539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540ab600 con 0x7fcc6c0cef30 2024-04-25T10:13:26.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.344+0000 7fcc6aa00640 1 -- 172.21.15.18:0/368419539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540ab9d0 con 0x7fcc6c0cef30 2024-04-25T10:13:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- 172.21.15.18:0/368419539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cef30 msgr2=0x7fcc6c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- 172.21.15.18:0/368419539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cddd0 tx=0x7fcc5401c4e0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- 172.21.15.18:0/368419539 shutdown_connections 2024-04-25T10:13:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- 172.21.15.18:0/368419539 >> v2:172.21.15.167:3300/0 conn(0x7fcc6c06e900 0x7fcc6c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- 172.21.15.18:0/368419539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cef30 0x7fcc6c06e3c0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- 172.21.15.18:0/368419539 >> 172.21.15.18:0/368419539 conn(0x7fcc6c066fa0 msgr2=0x7fcc6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:26.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- 172.21.15.18:0/368419539 shutdown_connections 2024-04-25T10:13:26.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- 172.21.15.18:0/368419539 wait complete. 2024-04-25T10:13:26.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 Processor -- start 2024-04-25T10:13:26.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- start start 2024-04-25T10:13:26.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc6c06e900 0x7fcc6c1410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc6c0cef30 0x7fcc6c139190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c15ba00 con 0x7fcc6c144140 2024-04-25T10:13:26.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c144520 con 0x7fcc6c06e900 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc72400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6c15bb80 con 0x7fcc6c0cef30 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41640/0 (socket says 172.21.15.18:41640) 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 -- 172.21.15.18:0/4156258499 learned_addr learned my addr 172.21.15.18:0/4156258499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6b400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc6c06e900 0x7fcc6c1410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc63e00640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc6c0cef30 0x7fcc6c139190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 -- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc6c0cef30 msgr2=0x7fcc6c139190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc6c0cef30 0x7fcc6c139190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 -- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc6c06e900 msgr2=0x7fcc6c1410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc6c06e900 0x7fcc6c1410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.348+0000 7fcc6be00640 1 -- 172.21.15.18:0/4156258499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c06e0f0 con 0x7fcc6c144140 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc6be00640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400cf20 tx=0x7fcc6400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6401a070 con 0x7fcc6c144140 2024-04-25T10:13:26.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6400d840 con 0x7fcc6c144140 2024-04-25T10:13:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c06de80 con 0x7fcc6c144140 2024-04-25T10:13:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400dc30 con 0x7fcc6c144140 2024-04-25T10:13:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6c141690 con 0x7fcc6c144140 2024-04-25T10:13:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6c0745d0 con 0x7fcc6c144140 2024-04-25T10:13:26.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc6401d070 con 0x7fcc6c144140 2024-04-25T10:13:26.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 0x7fcc48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:26.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcc64085a20 con 0x7fcc6c144140 2024-04-25T10:13:26.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.352+0000 7fcc6b400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 0x7fcc48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:26.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.356+0000 7fcc6b400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 0x7fcc48069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cd080 tx=0x7fcc5c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:26.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.356+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc640561f0 con 0x7fcc6c144140 2024-04-25T10:13:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc6c0b07e0 con 0x7fcc6c144140 2024-04-25T10:13:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc63400640 1 -- 172.21.15.18:0/4156258499 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fcc6405c030 con 0x7fcc6c144140 2024-04-25T10:13:26.564 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:26.564 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:13:26.180230+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37103":{"gid":37103,"name":"d","rank":0,"incarnation":87,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6837/2124918123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2124918123},{"type":"v1","addr":"172.21.15.167:6837","nonce":2124918123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:13:26.564 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 87 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 msgr2=0x7fcc48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 0x7fcc48069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c0cd080 tx=0x7fcc5c009060 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 msgr2=0x7fcc6c13c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400cf20 tx=0x7fcc6400a7d0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 shutdown_connections 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c144140 0x7fcc6c13c900 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc48066f60 0x7fcc48069420 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcc6c0cef30 0x7fcc6c139190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 --2- 172.21.15.18:0/4156258499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcc6c06e900 0x7fcc6c1410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:26.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 >> 172.21.15.18:0/4156258499 conn(0x7fcc6c066fa0 msgr2=0x7fcc6c0b3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 shutdown_connections 2024-04-25T10:13:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:26.556+0000 7fcc72400640 1 -- 172.21.15.18:0/4156258499 wait complete. 2024-04-25T10:13:26.988 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:12:38.768098+0000', 'modified': '2024-04-25T10:13:26.180230+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 109, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37103': {'gid': 37103, 'name': 'd', 'rank': 0, 'incarnation': 87, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/2124918123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 2124918123}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2124918123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:13:26.988 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37103:up:replay 2024-04-25T10:13:27.990 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:13:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 Processor -- start 2024-04-25T10:13:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 -- start start 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f17740ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 0x7f17740d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177415e4c0 con 0x7f17740b4a10 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177415e270 con 0x7f17740b5830 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f177b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177415f0d0 con 0x7f177415a6c0 2024-04-25T10:13:28.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f17740ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1779000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 0x7f17740d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f17740b4a10 0x7f17740b5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:35684/0 (socket says 172.21.15.18:35684) 2024-04-25T10:13:28.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773400640 1 -- 172.21.15.18:0/2873855908 learned_addr learned my addr 172.21.15.18:0/2873855908 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:13:28.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1772a00640 1 -- 172.21.15.18:0/2873855908 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838151497 0 0) 0x7f177415e4c0 con 0x7f17740b4a10 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1772a00640 1 -- 172.21.15.18:0/2873855908 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1758003530 con 0x7f17740b4a10 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773e00640 1 -- 172.21.15.18:0/2873855908 >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 msgr2=0x7f17740d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773e00640 1 --2- 172.21.15.18:0/2873855908 >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 0x7f17740d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773e00640 1 -- 172.21.15.18:0/2873855908 >> v1:172.21.15.167:6789/0 conn(0x7f17740b4a10 legacy=0x7f17740b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1773e00640 1 -- 172.21.15.18:0/2873855908 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177415e7a0 con 0x7f177415a6c0 2024-04-25T10:13:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.136+0000 7f1779000640 1 --2- 172.21.15.18:0/2873855908 >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 0x7f17740d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:13:28.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f1773e00640 1 --2- 172.21.15.18:0/2873855908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f17740ce550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17640097c0 tx=0x7f176401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5725816ae21289eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:28.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f1772a00640 1 -- 172.21.15.18:0/2873855908 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640b0070 con 0x7f177415a6c0 2024-04-25T10:13:28.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f1772a00640 1 -- 172.21.15.18:0/2873855908 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640ab600 con 0x7f177415a6c0 2024-04-25T10:13:28.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f1772a00640 1 -- 172.21.15.18:0/2873855908 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640ab9d0 con 0x7f177415a6c0 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 -- 172.21.15.18:0/2873855908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 msgr2=0x7f17740ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 --2- 172.21.15.18:0/2873855908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f17740ce550 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f17640097c0 tx=0x7f176401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 -- 172.21.15.18:0/2873855908 shutdown_connections 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 --2- 172.21.15.18:0/2873855908 >> v2:172.21.15.167:3300/0 conn(0x7f17740b5830 0x7f17740d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 --2- 172.21.15.18:0/2873855908 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f17740ce550 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 -- 172.21.15.18:0/2873855908 >> 172.21.15.18:0/2873855908 conn(0x7f17740b2400 msgr2=0x7f17740b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 -- 172.21.15.18:0/2873855908 shutdown_connections 2024-04-25T10:13:28.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.140+0000 7f177b000640 1 -- 172.21.15.18:0/2873855908 wait complete. 2024-04-25T10:13:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 Processor -- start 2024-04-25T10:13:28.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- start start 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17740b4a10 0x7f177414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f177413f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740b4240 con 0x7f17740b5830 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740b40c0 con 0x7f17740b4a10 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740b43c0 con 0x7f177415a6c0 2024-04-25T10:13:28.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17740b4a10 0x7f177414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41642/0 (socket says 172.21.15.18:41642) 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 -- 172.21.15.18:0/3710777148 learned_addr learned my addr 172.21.15.18:0/3710777148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1779000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f177413f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 -- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 msgr2=0x7f177413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f177413f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 -- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17740b4a10 msgr2=0x7f177414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17740b4a10 0x7f177414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 -- 172.21.15.18:0/3710777148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177414d6e0 con 0x7f17740b5830 2024-04-25T10:13:28.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f1773400640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f176000c450 tx=0x7f176000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760017070 con 0x7f17740b5830 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177414d9c0 con 0x7f17740b5830 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1760005d10 con 0x7f17740b5830 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760007310 con 0x7f17740b5830 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1774164cc0 con 0x7f17740b5830 2024-04-25T10:13:28.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.144+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17740745d0 con 0x7f17740b5830 2024-04-25T10:13:28.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.148+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f176001a070 con 0x7f17740b5830 2024-04-25T10:13:28.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.148+0000 7f176be00640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 0x7f1754069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:28.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.148+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1760084610 con 0x7f17740b5830 2024-04-25T10:13:28.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.148+0000 7f1773e00640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 0x7f1754069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:28.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.148+0000 7f1773e00640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 0x7f1754069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f17640ad000 tx=0x7f17640a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:28.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.152+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1760054e20 con 0x7f17740b5830 2024-04-25T10:13:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.348+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1774070080 con 0x7f17740b5830 2024-04-25T10:13:28.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f176be00640 1 -- 172.21.15.18:0/3710777148 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f1760058ec0 con 0x7f17740b5830 2024-04-25T10:13:28.359 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:28.359 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":89,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:13:27.192382+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37103":{"gid":37103,"name":"d","rank":0,"incarnation":87,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.167:6837/2124918123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2124918123},{"type":"v1","addr":"172.21.15.167:6837","nonce":2124918123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:13:28.359 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 89 2024-04-25T10:13:28.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 msgr2=0x7f1754069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 0x7f1754069420 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f17640ad000 tx=0x7f17640a6000 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 msgr2=0x7f177414e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f176000c450 tx=0x7f176000c850 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 shutdown_connections 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1754066f60 0x7f1754069420 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f177415a6c0 0x7f177413f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17740b5830 0x7f177414e4a0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 --2- 172.21.15.18:0/3710777148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17740b4a10 0x7f177414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 >> 172.21.15.18:0/3710777148 conn(0x7f17740b2400 msgr2=0x7f17740cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 shutdown_connections 2024-04-25T10:13:28.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:28.352+0000 7f177b000640 1 -- 172.21.15.18:0/3710777148 wait complete. 2024-04-25T10:13:28.783 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 89, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:12:38.768098+0000', 'modified': '2024-04-25T10:13:27.192382+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 109, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37103': {'gid': 37103, 'name': 'd', 'rank': 0, 'incarnation': 87, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.167:6837/2124918123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 2124918123}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2124918123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:13:28.783 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37103:up:rejoin 2024-04-25T10:13:29.784 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:13:29.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 Processor -- start 2024-04-25T10:13:29.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 -- start start 2024-04-25T10:13:29.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4298145270 0x7f429815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980cd4d0 0x7f42980cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 0x7f42980b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42980b20e0 con 0x7f4298145270 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4298145650 con 0x7f42980b1750 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980cc4e0 con 0x7f42980cd4d0 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4298145270 0x7f429815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4298145270 0x7f429815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41656/0 (socket says 172.21.15.18:41656) 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 -- 172.21.15.18:0/1416906457 learned_addr learned my addr 172.21.15.18:0/1416906457 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:29.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f428fe00640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980cd4d0 0x7f42980cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429d000640 1 --2- 172.21.15.18:0/1416906457 >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 0x7f42980b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 -- 172.21.15.18:0/1416906457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980cd4d0 msgr2=0x7f42980cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980cd4d0 0x7f42980cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 -- 172.21.15.18:0/1416906457 >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 msgr2=0x7f42980b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 --2- 172.21.15.18:0/1416906457 >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 0x7f42980b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f4297e00640 1 -- 172.21.15.18:0/1416906457 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980ce040 con 0x7f4298145270 2024-04-25T10:13:29.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.932+0000 7f429d000640 1 --2- 172.21.15.18:0/1416906457 >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 0x7f42980b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:29.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f4297e00640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4298145270 0x7f429815fe50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f429806b5f0 tx=0x7f428801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b7d7f3bca90d0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:29.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f4297400640 1 -- 172.21.15.18:0/1416906457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880b1070 con 0x7f4298145270 2024-04-25T10:13:29.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f4297400640 1 -- 172.21.15.18:0/1416906457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42880ac630 con 0x7f4298145270 2024-04-25T10:13:29.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f4297400640 1 -- 172.21.15.18:0/1416906457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42880a8050 con 0x7f4298145270 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 -- 172.21.15.18:0/1416906457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4298145270 msgr2=0x7f429815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4298145270 0x7f429815fe50 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f429806b5f0 tx=0x7f428801c520 comp rx=0 tx=0).stop 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 -- 172.21.15.18:0/1416906457 shutdown_connections 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 --2- 172.21.15.18:0/1416906457 >> v2:172.21.15.167:3300/0 conn(0x7f42980b1750 0x7f42980b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980cd4d0 0x7f42980cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 --2- 172.21.15.18:0/1416906457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4298145270 0x7f429815fe50 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 -- 172.21.15.18:0/1416906457 >> 172.21.15.18:0/1416906457 conn(0x7f4298066fa0 msgr2=0x7f429806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 -- 172.21.15.18:0/1416906457 shutdown_connections 2024-04-25T10:13:29.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.936+0000 7f429f000640 1 -- 172.21.15.18:0/1416906457 wait complete. 2024-04-25T10:13:29.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 Processor -- start 2024-04-25T10:13:29.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- start start 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980b1750 0x7f4298149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 0x7f42980b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429815c590 con 0x7f42980cd4d0 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429815f930 con 0x7f4298145270 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429815c710 con 0x7f42980b1750 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41666/0 (socket says 172.21.15.18:41666) 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 -- 172.21.15.18:0/3543454210 learned_addr learned my addr 172.21.15.18:0/3543454210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f4297e00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980b1750 0x7f4298149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429d000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 0x7f42980b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 -- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980b1750 msgr2=0x7f4298149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980b1750 0x7f4298149880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 -- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 msgr2=0x7f42980b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 0x7f42980b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 -- 172.21.15.18:0/3543454210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429814a0f0 con 0x7f42980cd4d0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429d000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 0x7f42980b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f428fe00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f428000d830 tx=0x7f428000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428000b6c0 con 0x7f42980cd4d0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280019070 con 0x7f42980cd4d0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429814a3d0 con 0x7f42980cd4d0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428000ba60 con 0x7f42980cd4d0 2024-04-25T10:13:29.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429814a990 con 0x7f42980cd4d0 2024-04-25T10:13:29.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.940+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42980745d0 con 0x7f42980cd4d0 2024-04-25T10:13:29.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.944+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f428001e460 con 0x7f42980cd4d0 2024-04-25T10:13:29.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.944+0000 7f4294c00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 0x7f4274069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:29.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.944+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4280085870 con 0x7f42980cd4d0 2024-04-25T10:13:29.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.944+0000 7f4297e00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 0x7f4274069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:29.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.944+0000 7f4297e00640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 0x7f4274069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f42880ae000 tx=0x7f4288009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:29.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:29.948+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4280056690 con 0x7f42980cd4d0 2024-04-25T10:13:30.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42980aefa0 con 0x7f42980cd4d0 2024-04-25T10:13:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f4294c00640 1 -- 172.21.15.18:0/3543454210 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f4280055f90 con 0x7f42980cd4d0 2024-04-25T10:13:30.152 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.152 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":90,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:13:28.198547+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":109,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37103":{"gid":37103,"name":"d","rank":0,"incarnation":87,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/2124918123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2124918123},{"type":"v1","addr":"172.21.15.167:6837","nonce":2124918123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:13:30.152 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 90 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 msgr2=0x7f4274069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 0x7f4274069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f42880ae000 tx=0x7f4288009040 comp rx=0 tx=0).stop 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 msgr2=0x7f42980ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f428000d830 tx=0x7f428000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 shutdown_connections 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4298145270 0x7f42980b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980cd4d0 0x7f42980ad5b0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4274066f60 0x7f4274069420 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 --2- 172.21.15.18:0/3543454210 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f42980b1750 0x7f4298149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 >> 172.21.15.18:0/3543454210 conn(0x7f4298066fa0 msgr2=0x7f42980b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 shutdown_connections 2024-04-25T10:13:30.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.144+0000 7f429f000640 1 -- 172.21.15.18:0/3543454210 wait complete. 2024-04-25T10:13:30.576 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:12:38.768098+0000', 'modified': '2024-04-25T10:13:28.198547+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 109, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37103': {'gid': 37103, 'name': 'd', 'rank': 0, 'incarnation': 87, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6837/2124918123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 2124918123}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2124918123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:13:30.577 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:13:30.577 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:13:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 Processor -- start 2024-04-25T10:13:30.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 -- start start 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f291815dc60 0x7f29180d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f29180cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291815e040 con 0x7f2918099a60 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29180cff80 con 0x7f291815dc60 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f291e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180d0260 con 0x7f291806bf30 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2918099a60 0x7f29180cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37256/0 (socket says 172.21.15.18:37256) 2024-04-25T10:13:30.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917e00640 1 -- 172.21.15.18:0/3637790204 learned_addr learned my addr 172.21.15.18:0/3637790204 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:13:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f29180cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917400640 1 --2- 172.21.15.18:0/3637790204 >> v2:172.21.15.167:3300/0 conn(0x7f291815dc60 0x7f29180d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142411850 0 0) 0x7f291815e040 con 0x7f2918099a60 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28fc003530 con 0x7f2918099a60 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3819835057 0 0) 0x7f28fc003530 con 0x7f2918099a60 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 msgr2=0x7f29180cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f29180cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 >> v2:172.21.15.167:3300/0 conn(0x7f291815dc60 msgr2=0x7f29180d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 --2- 172.21.15.18:0/3637790204 >> v2:172.21.15.167:3300/0 conn(0x7f291815dc60 0x7f29180d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180d0540 con 0x7f2918099a60 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f2910001680 con 0x7f2918099a60 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917400640 1 --2- 172.21.15.18:0/3637790204 >> v2:172.21.15.167:3300/0 conn(0x7f291815dc60 0x7f29180d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 >> v1:172.21.15.18:6789/0 conn(0x7f2918099a60 legacy=0x7f29180cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0039c0 0x7f28fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28fc004810 0x7f28fc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f28fc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29180cff80 con 0x7f28fc004810 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29180d0260 con 0x7f28fc0039c0 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc00bad0 con 0x7f291806bf30 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28fc004810 0x7f28fc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917400640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0039c0 0x7f28fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917e00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f28fc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 -- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 msgr2=0x7f28fc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f28fc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 -- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0039c0 msgr2=0x7f28fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28fc0039c0 0x7f28fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f290ea00640 1 -- 172.21.15.18:0/3637790204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc003530 con 0x7f28fc004810 2024-04-25T10:13:30.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.716+0000 7f2917e00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f291806bf30 0x7f28fc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:30.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f290ea00640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28fc004810 0x7f28fc004c90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2900009fc0 tx=0x7f290001cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180f94a66d9285f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000b2070 con 0x7f28fc004810 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000a5be0 con 0x7f28fc004810 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f2916a00640 1 -- 172.21.15.18:0/3637790204 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900009c10 con 0x7f28fc004810 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 -- 172.21.15.18:0/3637790204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28fc004810 msgr2=0x7f28fc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 --2- 172.21.15.18:0/3637790204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28fc004810 0x7f28fc004c90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2900009fc0 tx=0x7f290001cbf0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f2917e00640 1 -- 172.21.15.18:0/3637790204 reap_dead start 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 -- 172.21.15.18:0/3637790204 shutdown_connections 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 -- 172.21.15.18:0/3637790204 >> 172.21.15.18:0/3637790204 conn(0x7f29180b3200 msgr2=0x7f29180b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 -- 172.21.15.18:0/3637790204 shutdown_connections 2024-04-25T10:13:30.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.720+0000 7f291e000640 1 -- 172.21.15.18:0/3637790204 wait complete. 2024-04-25T10:13:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 Processor -- start 2024-04-25T10:13:30.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- start start 2024-04-25T10:13:30.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc004810 0x7f29181558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29180b60b0 0x7f29180b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291806cfa0 con 0x7f29180cd160 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291809a280 con 0x7f29180b60b0 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180cdb00 con 0x7f28fc004810 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41684/0 (socket says 172.21.15.18:41684) 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 -- 172.21.15.18:0/3993669130 learned_addr learned my addr 172.21.15.18:0/3993669130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f2917400640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc004810 0x7f29181558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f2917e00640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29180b60b0 0x7f29180b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 -- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc004810 msgr2=0x7f29181558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc004810 0x7f29181558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 -- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29180b60b0 msgr2=0x7f29180b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29180b60b0 0x7f29180b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 -- 172.21.15.18:0/3993669130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180b6a30 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290ea00640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f29000b0040 tx=0x7f2900009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290fe00640 1 -- 172.21.15.18:0/3993669130 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000b2040 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290fe00640 1 -- 172.21.15.18:0/3993669130 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000a59e0 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29180cac70 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f290fe00640 1 -- 172.21.15.18:0/3993669130 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000adbe0 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.724+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29180cb230 con 0x7f29180cd160 2024-04-25T10:13:30.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f290fe00640 1 -- 172.21.15.18:0/3993669130 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29000bf030 con 0x7f29180cd160 2024-04-25T10:13:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f290fe00640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 0x7f28f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f290fe00640 1 -- 172.21.15.18:0/3993669130 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f290011f480 con 0x7f29180cd160 2024-04-25T10:13:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 Processor -- start 2024-04-25T10:13:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 -- start start 2024-04-25T10:13:30.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2917400640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 0x7f28f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072a9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07260310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df071475f0 con 0x55df072aa240 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df070aeda0 con 0x55df0725ff30 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.728+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df07037150 con 0x55df072a9920 2024-04-25T10:13:30.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2917400640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 0x7f28f4069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f29080099d0 tx=0x7f2908008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41698/0 (socket says 172.21.15.18:41698) 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 -- 172.21.15.18:0/812138438 learned_addr learned my addr 172.21.15.18:0/812138438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2917400640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072a9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2917e00640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07260310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 -- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 msgr2=0x55df072a9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072a9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 -- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 msgr2=0x55df07260310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07260310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 -- 172.21.15.18:0/812138438 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df07050ca0 con 0x55df072aa240 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2917e00640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07260310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f290ea00640 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f29000ec000 tx=0x7f2900004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d017a1663e6f3f6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2907e00640 1 -- 172.21.15.18:0/812138438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000f3cf0 con 0x55df072aa240 2024-04-25T10:13:30.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2907e00640 1 -- 172.21.15.18:0/812138438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000f82b0 con 0x55df072aa240 2024-04-25T10:13:30.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2907e00640 1 -- 172.21.15.18:0/812138438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29000edc40 con 0x55df072aa240 2024-04-25T10:13:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- 172.21.15.18:0/812138438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 msgr2=0x55df0725f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f29000ec000 tx=0x7f2900004a50 comp rx=0 tx=0).stop 2024-04-25T10:13:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- 172.21.15.18:0/812138438 shutdown_connections 2024-04-25T10:13:30.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07260310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072aa240 0x55df0725f9f0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- 172.21.15.18:0/812138438 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072a9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- 172.21.15.18:0/812138438 >> 172.21.15.18:0/812138438 conn(0x55df072662a0 msgr2=0x55df0725e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- 172.21.15.18:0/812138438 shutdown_connections 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- 172.21.15.18:0/812138438 wait complete. 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- start start 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 Processor -- start 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df072a9920 0x55df072b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072aa240 0x55df07263aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df07069990 con 0x55df0725ff30 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df070aae40 con 0x55df072a9920 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df0703a900 con 0x55df072aa240 2024-04-25T10:13:30.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2921418000 10 client.0 _ll_register_callbacks cb 0x55df071621c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.732+0000 7f2917400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41708/0 (socket says 172.21.15.18:41708) 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 -- 172.21.15.18:0/1241952260 learned_addr learned my addr 172.21.15.18:0/1241952260 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917e00640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072aa240 0x55df07263aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f290ea00640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df072a9920 0x55df072b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 -- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072aa240 msgr2=0x55df07263aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072aa240 0x55df07263aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 -- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df072a9920 msgr2=0x55df072b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df072a9920 0x55df072b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 -- 172.21.15.18:0/1241952260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df07067630 con 0x55df0725ff30 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2917400640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f2908013fa0 tx=0x7f2908004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3fdc2d362255f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290800f040 con 0x55df0725ff30 2024-04-25T10:13:30.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f290802c600 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f29000f82b0 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2908034050 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 10 client.8760 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55df070373a0 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29000f82b0 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2908037020 con 0x55df0725ff30 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 10 client.8760 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 10 client.8760 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 20 client.8760 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072644b0 0x55df07264890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 4 client.8760 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df0704aa50 con 0x55df072644b0 2024-04-25T10:13:30.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f290ea00640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072644b0 0x55df07264890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f290ea00640 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072644b0 0x55df07264890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dadd6860906f4d4 server_cookie=d1d17defda039f16 in_seq=0 out_seq=0 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 10 client.8760 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 1 -- 172.21.15.18:0/1241952260 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df0704aa50 con 0x55df072644b0 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.736+0000 7f2904c00640 10 client.8760 handle_command_reply: tid=0 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 client.8760 shutdown 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 msgr2=0x55df072b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f2908013fa0 tx=0x7f2908004740 comp rx=0 tx=0).stop 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 shutdown_connections 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072644b0 0x55df07264890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072aa240 0x55df07263aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df072a9920 0x55df072b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 --2- 172.21.15.18:0/1241952260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df0725ff30 0x55df072b0c80 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 >> 172.21.15.18:0/1241952260 conn(0x55df072662a0 msgr2=0x55df0725e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2904c00640 0 client.8760 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 shutdown_connections 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 1 -- 172.21.15.18:0/1241952260 wait complete. 2024-04-25T10:13:30.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.740+0000 7f2921418000 20 client.8760 trim_cache size 0 max 16384 2024-04-25T10:13:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.752+0000 7f2921418000 1 Processor -- start 2024-04-25T10:13:30.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- start start 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072662a0 0x55df07263330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07263870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29182032b0 con 0x55df072a9920 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29180b5280 con 0x55df0725ff30 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2918202dd0 con 0x55df072662a0 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41716/0 (socket says 172.21.15.18:41716) 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 -- 172.21.15.18:0/3645483428 learned_addr learned my addr 172.21.15.18:0/3645483428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917400640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072662a0 0x55df07263330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f290ea00640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07263870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 -- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072662a0 msgr2=0x55df07263330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072662a0 0x55df07263330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 -- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 msgr2=0x55df07263870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07263870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 -- 172.21.15.18:0/3645483428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df072aa070 con 0x55df072a9920 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f290ea00640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07263870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2917e00640 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f291806dce0 tx=0x7f2910004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cd3a186010bb40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2907400640 1 -- 172.21.15.18:0/3645483428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291001a020 con 0x55df072a9920 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2907400640 1 -- 172.21.15.18:0/3645483428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910014a80 con 0x55df072a9920 2024-04-25T10:13:30.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2907400640 1 -- 172.21.15.18:0/3645483428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2910014e90 con 0x55df072a9920 2024-04-25T10:13:30.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- 172.21.15.18:0/3645483428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 msgr2=0x55df072b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f291806dce0 tx=0x7f2910004d30 comp rx=0 tx=0).stop 2024-04-25T10:13:30.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- 172.21.15.18:0/3645483428 shutdown_connections 2024-04-25T10:13:30.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072a9920 0x55df072b38b0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df07263870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 --2- 172.21.15.18:0/3645483428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072662a0 0x55df07263330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- 172.21.15.18:0/3645483428 >> 172.21.15.18:0/3645483428 conn(0x55df072b0e40 msgr2=0x55df07296170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- 172.21.15.18:0/3645483428 shutdown_connections 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- 172.21.15.18:0/3645483428 wait complete. 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 -- start start 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.756+0000 7f2921418000 1 Processor -- start 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df072b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072ef340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df070b33d0 con 0x55df072662a0 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df0716ad50 con 0x55df0725ff30 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df07049980 con 0x55df072a9920 2024-04-25T10:13:30.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 10 client.0 _ll_register_callbacks cb 0x7f29000ebe40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41722/0 (socket says 172.21.15.18:41722) 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 -- 172.21.15.18:0/1892699656 learned_addr learned my addr 172.21.15.18:0/1892699656 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2917400640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df072b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2917e00640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072ef340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 -- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 msgr2=0x55df072ef340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072ef340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 -- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 msgr2=0x55df072b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df072b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 -- 172.21.15.18:0/1892699656 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df07130600 con 0x55df072662a0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f290ea00640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2900098700 tx=0x7f2900000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc24bfda30d0196f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:30.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900119060 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f29000edea0 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2910014a80 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f29000f82b0 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 10 client.8766 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55df070439b0 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2910014a80 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f29000b5050 con 0x55df072662a0 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 10 client.8766 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 10 client.8766 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 20 client.8766 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072aa240 0x55df072ef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 4 client.8766 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55df070bc2e0 con 0x55df072aa240 2024-04-25T10:13:30.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2917400640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072aa240 0x55df072ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2917400640 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072aa240 0x55df072ef880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddedb73f4b7feafd server_cookie=e3e193f64def62fe in_seq=0 out_seq=0 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 10 client.8766 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 1 -- 172.21.15.18:0/1892699656 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55df070bc2e0 con 0x55df072aa240 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 10 client.8766 handle_command_reply: tid=0 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 client.8766 shutdown 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 msgr2=0x55df072eee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2900098700 tx=0x7f2900000f50 comp rx=0 tx=0).stop 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 shutdown_connections 2024-04-25T10:13:30.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55df072aa240 0x55df072ef880 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55df072a9920 0x55df072ef340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df072662a0 0x55df072eee00 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2904c00640 0 client.8766 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 --2- 172.21.15.18:0/1892699656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55df0725ff30 0x55df072b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 >> 172.21.15.18:0/1892699656 conn(0x55df072b0e40 msgr2=0x55df07262320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 shutdown_connections 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 1 -- 172.21.15.18:0/1892699656 wait complete. 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.760+0000 7f2921418000 20 client.8766 trim_cache size 0 max 16384 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:13:30.774 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 37103, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.5751613630000003, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 90, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 109, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 109, 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 5.5253914980000003 2024-04-25T10:13:30.775 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 msgr2=0x7f28f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 0x7f28f4069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f29080099d0 tx=0x7f2908008040 comp rx=0 tx=0).stop 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 msgr2=0x7f29180cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f29000b0040 tx=0x7f2900009750 comp rx=0 tx=0).stop 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 shutdown_connections 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29180b60b0 0x7f29180b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29180cd160 0x7f29180cd5c0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f28f4066f60 0x7f28f4069420 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 --2- 172.21.15.18:0/3993669130 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f28fc004810 0x7f29181558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 >> 172.21.15.18:0/3993669130 conn(0x7f29180b3200 msgr2=0x7f291806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 shutdown_connections 2024-04-25T10:13:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.764+0000 7f291e000640 1 -- 172.21.15.18:0/3993669130 wait complete. 2024-04-25T10:13:30.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T10:13:30.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:13:30.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T10:13:30.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 Processor -- start 2024-04-25T10:13:30.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 -- start start 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2900cfa80 0x7fe2900cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2900cc010 0x7fe2900cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2900d03e0 con 0x7fe29015b9c0 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900705e0 con 0x7fe2900cc010 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe294e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2900708c0 con 0x7fe2900cfa80 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2900cc010 0x7fe2900cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28ea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe2900cfa80 0x7fe2900cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2900cc010 0x7fe2900cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41734/0 (socket says 172.21.15.18:41734) 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 -- 172.21.15.18:0/1921808611 learned_addr learned my addr 172.21.15.18:0/1921808611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 -- 172.21.15.18:0/1921808611 >> v2:172.21.15.167:3300/0 conn(0x7fe2900cfa80 msgr2=0x7fe2900cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 --2- 172.21.15.18:0/1921808611 >> v2:172.21.15.167:3300/0 conn(0x7fe2900cfa80 0x7fe2900cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 -- 172.21.15.18:0/1921808611 >> v1:172.21.15.167:6789/0 conn(0x7fe29015b9c0 legacy=0x7fe29006fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.932+0000 7fe28fe00640 1 -- 172.21.15.18:0/1921808611 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290070ba0 con 0x7fe2900cc010 2024-04-25T10:13:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe28fe00640 1 --2- 172.21.15.18:0/1921808611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900cc440 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fe2900d2650 tx=0x7fe28801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78d71290fce0e08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe28e000640 1 -- 172.21.15.18:0/1921808611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880a56c0 con 0x7fe2900cc010 2024-04-25T10:13:30.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe28e000640 1 -- 172.21.15.18:0/1921808611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2880a5860 con 0x7fe2900cc010 2024-04-25T10:13:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe28e000640 1 -- 172.21.15.18:0/1921808611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880a5c30 con 0x7fe2900cc010 2024-04-25T10:13:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 -- 172.21.15.18:0/1921808611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 msgr2=0x7fe2900cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 --2- 172.21.15.18:0/1921808611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900cc440 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fe2900d2650 tx=0x7fe28801c9f0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 -- 172.21.15.18:0/1921808611 shutdown_connections 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 --2- 172.21.15.18:0/1921808611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900cc440 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 --2- 172.21.15.18:0/1921808611 >> v2:172.21.15.167:3300/0 conn(0x7fe2900cfa80 0x7fe2900cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 -- 172.21.15.18:0/1921808611 >> 172.21.15.18:0/1921808611 conn(0x7fe2900d1630 msgr2=0x7fe2900d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 -- 172.21.15.18:0/1921808611 shutdown_connections 2024-04-25T10:13:30.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.936+0000 7fe294e00640 1 -- 172.21.15.18:0/1921808611 wait complete. 2024-04-25T10:13:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 Processor -- start 2024-04-25T10:13:30.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- start start 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 0x7fe2900b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 0x7fe29006cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900cd310 con 0x7fe2900cc010 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2900cd190 con 0x7fe29015b9c0 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290168750 con 0x7fe2900cfa80 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41746/0 (socket says 172.21.15.18:41746) 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 -- 172.21.15.18:0/2578341104 learned_addr learned my addr 172.21.15.18:0/2578341104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28fe00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 0x7fe29006cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28ea00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 0x7fe2900b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 -- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 msgr2=0x7fe2900b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 0x7fe2900b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 -- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 msgr2=0x7fe29006cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 0x7fe29006cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 -- 172.21.15.18:0/2578341104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2900b6360 con 0x7fe2900cc010 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28fe00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 0x7fe29006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28ea00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 0x7fe2900b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe28f400640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c370 tx=0x7fe28000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe287400640 1 -- 172.21.15.18:0/2578341104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800052d0 con 0x7fe2900cc010 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe287400640 1 -- 172.21.15.18:0/2578341104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280005470 con 0x7fe2900cc010 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe287400640 1 -- 172.21.15.18:0/2578341104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280007260 con 0x7fe2900cc010 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2900b6640 con 0x7fe2900cc010 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.940+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2900b6c00 con 0x7fe2900cc010 2024-04-25T10:13:30.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe287400640 1 -- 172.21.15.18:0/2578341104 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe280007400 con 0x7fe2900cc010 2024-04-25T10:13:30.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe287400640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 0x7fe270069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe287400640 1 -- 172.21.15.18:0/2578341104 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe2800846f0 con 0x7fe2900cc010 2024-04-25T10:13:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 Processor -- start 2024-04-25T10:13:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 -- start start 2024-04-25T10:13:30.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 0x7fe270069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4eed1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ee87670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4ed6df40 con 0x563a4eed15b0 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4ecd5070 con 0x563a4ee87290 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a4ec5d1a0 con 0x563a4eed0c90 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 0x7fe270069420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe2900cc7e0 tx=0x7fe27c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4eed1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41758/0 (socket says 172.21.15.18:41758) 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 -- 172.21.15.18:0/2095476046 learned_addr learned my addr 172.21.15.18:0/2095476046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28fe00640 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ee87670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 -- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 msgr2=0x563a4ee87670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ee87670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 -- 172.21.15.18:0/2095476046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 msgr2=0x563a4ee86d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 -- 172.21.15.18:0/2095476046 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a4ec5b510 con 0x563a4eed0c90 2024-04-25T10:13:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28ea00640 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:13:30.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.944+0000 7fe28f400640 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4eed1070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe280054e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c11a2dc8b7022c05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe27be00640 1 -- 172.21.15.18:0/2095476046 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280082ab0 con 0x563a4eed0c90 2024-04-25T10:13:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe27be00640 1 -- 172.21.15.18:0/2095476046 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280052e20 con 0x563a4eed0c90 2024-04-25T10:13:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe27be00640 1 -- 172.21.15.18:0/2095476046 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28005b0c0 con 0x563a4eed0c90 2024-04-25T10:13:30.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 msgr2=0x563a4eed1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4eed1070 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe280054e40 comp rx=0 tx=0).stop 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- 172.21.15.18:0/2095476046 shutdown_connections 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ee87670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4ee86d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- 172.21.15.18:0/2095476046 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4eed1070 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- 172.21.15.18:0/2095476046 >> 172.21.15.18:0/2095476046 conn(0x563a4ee83240 msgr2=0x563a4ee85630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- 172.21.15.18:0/2095476046 shutdown_connections 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- 172.21.15.18:0/2095476046 wait complete. 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- start start 2024-04-25T10:13:30.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 Processor -- start 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4ee87290 0x563a4ee91e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4ee928b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4ec8f6c0 con 0x563a4eed0c90 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4ecd1110 con 0x563a4eed15b0 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a4ed8bf20 con 0x563a4ee87290 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe29985a000 10 client.0 _ll_register_callbacks cb 0x563a4ee72570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:30.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41760/0 (socket says 172.21.15.18:41760) 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 -- 172.21.15.18:0/668575568 learned_addr learned my addr 172.21.15.18:0/668575568 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28f400640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4ee87290 0x563a4ee91e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28fe00640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4ee928b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 -- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4ee87290 msgr2=0x563a4ee91e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4ee87290 0x563a4ee91e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 -- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 msgr2=0x563a4ee928b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4ee928b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28ea00640 1 -- 172.21.15.18:0/668575568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a4ec5d3b0 con 0x563a4eed0c90 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.948+0000 7fe28fe00640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4ee928b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe28ea00640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009820 tx=0x7fe27c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce795d2dc9ef63 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c026070 con 0x563a4eed0c90 2024-04-25T10:13:30.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe27c016db0 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe280052e20 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe27c031050 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 10 client.8778 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x563a4ed56e00 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280052e20 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe27c034020 con 0x563a4eed0c90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 10 client.8778 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 10 client.8778 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 20 client.8778 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4ee93150 0x563a4eee2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 4 client.8778 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a4ec70d60 con 0x563a4ee93150 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe28f400640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4ee93150 0x563a4eee2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe28f400640 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4ee93150 0x563a4eee2200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c73f9207a01d6989 server_cookie=fe9c1960fa1fd057 in_seq=0 out_seq=0 2024-04-25T10:13:30.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 10 client.8778 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 1 -- 172.21.15.18:0/668575568 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563a4ec70d60 con 0x563a4ee93150 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 10 client.8778 handle_command_reply: tid=0 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 client.8778 shutdown 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 msgr2=0x563a4ee92370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009820 tx=0x7fe27c0046d0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 shutdown_connections 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4ee93150 0x563a4eee2200 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4ee928b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed0c90 0x563a4ee92370 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 --2- 172.21.15.18:0/668575568 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4ee87290 0x563a4ee91e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe278c00640 0 client.8778 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 >> 172.21.15.18:0/668575568 conn(0x563a4ee83240 msgr2=0x563a4ee85ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 shutdown_connections 2024-04-25T10:13:30.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 1 -- 172.21.15.18:0/668575568 wait complete. 2024-04-25T10:13:30.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.952+0000 7fe29985a000 20 client.8778 trim_cache size 0 max 16384 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 Processor -- start 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 -- start start 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c15e000 0x7f942c06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f942c0b3700 0x7f942c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c0afb60 con 0x7f942c15e000 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f942c161b00 con 0x7f942c0b3700 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9434800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c161de0 con 0x7f942c15dc20 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9431400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c15e000 0x7f942c06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9431400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f942c15e000 0x7f942c06ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41770/0 (socket says 172.21.15.18:41770) 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.956+0000 7f9431400640 1 -- 172.21.15.18:0/3409651760 learned_addr learned my addr 172.21.15.18:0/3409651760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431e00640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9432800640 1 --2- 172.21.15.18:0/3409651760 >> v2:172.21.15.167:3300/0 conn(0x7f942c0b3700 0x7f942c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 -- 172.21.15.18:0/3409651760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 msgr2=0x7f942c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 -- 172.21.15.18:0/3409651760 >> v2:172.21.15.167:3300/0 conn(0x7f942c0b3700 msgr2=0x7f942c06b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 --2- 172.21.15.18:0/3409651760 >> v2:172.21.15.167:3300/0 conn(0x7f942c0b3700 0x7f942c06b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 -- 172.21.15.18:0/3409651760 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c1620c0 con 0x7f942c15e000 2024-04-25T10:13:30.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431e00640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9431400640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c15e000 0x7f942c06ac10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f942c072950 tx=0x7f941c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea0818cbcb263e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9430a00640 1 -- 172.21.15.18:0/3409651760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0b0070 con 0x7f942c15e000 2024-04-25T10:13:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9430a00640 1 -- 172.21.15.18:0/3409651760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0a4e50 con 0x7f942c15e000 2024-04-25T10:13:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.960+0000 7f9430a00640 1 -- 172.21.15.18:0/3409651760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c0ab820 con 0x7f942c15e000 2024-04-25T10:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- 172.21.15.18:0/3409651760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c15e000 msgr2=0x7f942c06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c15e000 0x7f942c06ac10 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f942c072950 tx=0x7f941c01c400 comp rx=0 tx=0).stop 2024-04-25T10:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- 172.21.15.18:0/3409651760 shutdown_connections 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- 172.21.15.18:0/3409651760 >> v2:172.21.15.167:3300/0 conn(0x7f942c0b3700 0x7f942c06b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c15e000 0x7f942c06ac10 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- 172.21.15.18:0/3409651760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- 172.21.15.18:0/3409651760 >> 172.21.15.18:0/3409651760 conn(0x7f942c06e3c0 msgr2=0x7f942c06e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- 172.21.15.18:0/3409651760 shutdown_connections 2024-04-25T10:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- 172.21.15.18:0/3409651760 wait complete. 2024-04-25T10:13:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 Processor -- start 2024-04-25T10:13:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- start start 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b3700 0x7f942c14e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f942c15e000 0x7f942c0ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c0704b0 con 0x7f942c0b3700 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942c070330 con 0x7f942c15e000 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9434800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942c070630 con 0x7f942c15dc20 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b3700 0x7f942c14e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b3700 0x7f942c14e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41786/0 (socket says 172.21.15.18:41786) 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 -- 172.21.15.18:0/2906795799 learned_addr learned my addr 172.21.15.18:0/2906795799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431400640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9432800640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f942c15e000 0x7f942c0ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 -- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 msgr2=0x7f942c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f942c15dc20 0x7f942c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 -- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f942c15e000 msgr2=0x7f942c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f942c15e000 0x7f942c0ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.964+0000 7f9431e00640 1 -- 172.21.15.18:0/2906795799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c14e970 con 0x7f942c0b3700 2024-04-25T10:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9431e00640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f942c0b3700 0x7f942c14e430 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f942000c7f0 tx=0x7f942000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9420007a30 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9420007bd0 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94200113f0 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9434800640 1 -- 172.21.15.18:0/2906795799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942c0cc460 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9434800640 1 -- 172.21.15.18:0/2906795799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f942c154ec0 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9434800640 1 -- 172.21.15.18:0/2906795799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f942c0745d0 con 0x7f942c0b3700 2024-04-25T10:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9420011590 con 0x7f942c0b3700 2024-04-25T10:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9410066f60 0x7f9410069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f9420085370 con 0x7f942c0b3700 2024-04-25T10:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+512 (secure 0 0 0) 0x7f9420015020 con 0x7f942c0b3700 2024-04-25T10:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9431400640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9410066f60 0x7f9410069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7fe29985a000 1 Processor -- start 2024-04-25T10:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7f9434800640 1 -- 172.21.15.18:0/2906795799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f942c072bb0 con 0x7f942c0b3700 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.968+0000 7fe29985a000 1 -- start start 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 7 ==== log(2 entries from seq 1207 at 2024-04-25T10:13:29.195153+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7f9420053be0 con 0x7f942c0b3700 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stdout: cluster: 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stdout: id: a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stdout: health: HEALTH_OK 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.979 INFO:teuthology.orchestra.run.smithi018.stdout: services: 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: mgr: x(active, since 9m), standbys: y 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: data: 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: volumes: 1/1 healthy 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: pools: 3 pools, 97 pgs 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: objects: 30 objects, 19 MiB 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: pgs: 97 active+clean 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: io: 2024-04-25T10:13:30.980 INFO:teuthology.orchestra.run.smithi018.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-25T10:13:30.981 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.981 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:13:30.981 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:29.195153+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T10:13:30.981 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:29.195179+0000 mon.a [INF] Cluster is now healthy 2024-04-25T10:13:30.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7f9431400640 1 --2- 172.21.15.18:0/2906795799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9410066f60 0x7f9410069420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f941c0ad000 tx=0x7f941c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ee86b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4eee2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290203320 con 0x563a4ee87290 2024-04-25T10:13:30.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290202550 con 0x563a4eed15b0 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe290156390 con 0x563a4eed0c90 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41800/0 (socket says 172.21.15.18:41800) 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 -- 172.21.15.18:0/4159107636 learned_addr learned my addr 172.21.15.18:0/4159107636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28ea00640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ee86b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28fe00640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4eee2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 -- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 msgr2=0x563a4ee86b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ee86b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 -- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 msgr2=0x563a4eee2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4eee2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 -- 172.21.15.18:0/4159107636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a4ed2cc50 con 0x563a4ee87290 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28fe00640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4eee2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe28f400640 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe28005b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f4523f16b74d76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe27b400640 1 -- 172.21.15.18:0/4159107636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280053080 con 0x563a4ee87290 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe27b400640 1 -- 172.21.15.18:0/4159107636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28005b0c0 con 0x563a4ee87290 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe27b400640 1 -- 172.21.15.18:0/4159107636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2800541d0 con 0x563a4ee87290 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- 172.21.15.18:0/4159107636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 msgr2=0x563a4ee86640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe280007fd0 tx=0x7fe28005b050 comp rx=0 tx=0).stop 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- 172.21.15.18:0/4159107636 shutdown_connections 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4eed15b0 0x563a4eee2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ee86b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 --2- 172.21.15.18:0/4159107636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4ee87290 0x563a4ee86640 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- 172.21.15.18:0/4159107636 >> 172.21.15.18:0/4159107636 conn(0x563a4ee83240 msgr2=0x563a4ee8bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- 172.21.15.18:0/4159107636 shutdown_connections 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- 172.21.15.18:0/4159107636 wait complete. 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 -- start start 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.972+0000 7fe29985a000 1 Processor -- start 2024-04-25T10:13:30.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ef312a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ef317e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a4ee90200 con 0x563a4eed15b0 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290156990 con 0x563a4ee87290 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x563a4ed8bf20 con 0x563a4eed0c90 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 10 client.0 _ll_register_callbacks cb 0x7fe280054b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ef312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41804/0 (socket says 172.21.15.18:41804) 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 -- 172.21.15.18:0/116749511 learned_addr learned my addr 172.21.15.18:0/116749511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28ea00640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ef317e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 -- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 msgr2=0x563a4ef317e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ef317e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 -- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 msgr2=0x563a4ef312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ef312a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 -- 172.21.15.18:0/116749511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a4ec9d120 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28fe00640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe2880af040 tx=0x7fe28801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba9e2d64e306811 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2880a58b0 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe2880c1ca0 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe28005b0c0 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2880c1ea0 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 10 client.8790 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x563a4ec7c170 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28005b0c0 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe288008040 con 0x563a4eed15b0 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 10 client.8790 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:30.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 10 client.8790 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 20 client.8790 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4eeeca30 0x563a4eeece40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 4 client.8790 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x563a4ece25b0 con 0x563a4eeeca30 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28f400640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4eeeca30 0x563a4eeece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe28f400640 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4eeeca30 0x563a4eeece40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ce296f3ecbf2fdf server_cookie=4c0a53ec43ef5ad0 in_seq=0 out_seq=0 2024-04-25T10:13:30.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.976+0000 7fe278c00640 10 client.8790 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.991 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:13:30.991 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T10:13:30.991 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:13:30.991 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe278c00640 1 -- 172.21.15.18:0/116749511 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563a4ece25b0 con 0x563a4eeeca30 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe278c00640 10 client.8790 handle_command_reply: tid=0 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 client.8790 shutdown 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 msgr2=0x563a4eeebc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe2880af040 tx=0x7fe28801b230 comp rx=0 tx=0).stop 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 shutdown_connections 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x563a4eeeca30 0x563a4eeece40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563a4eed15b0 0x563a4eeebc80 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x563a4eed0c90 0x563a4ef317e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 --2- 172.21.15.18:0/116749511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563a4ee87290 0x563a4ef312a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe278c00640 0 client.8790 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 >> 172.21.15.18:0/116749511 conn(0x563a4ee83240 msgr2=0x563a4ee8c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 shutdown_connections 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 1 -- 172.21.15.18:0/116749511 wait complete. 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe29985a000 20 client.8790 trim_cache size 0 max 16384 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0, 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_tag": "ae78ad31-c363-4824-aed0-66e37fb764ad", 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stdout: "mode": "asynchronous" 2024-04-25T10:13:30.993 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:13:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 msgr2=0x7fe270069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 0x7fe270069420 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe2900cc7e0 tx=0x7fe27c008040 comp rx=0 tx=0).stop 2024-04-25T10:13:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 msgr2=0x7fe2900b57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:30.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c370 tx=0x7fe28000c830 comp rx=0 tx=0).stop 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 shutdown_connections 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe29015b9c0 0x7fe29006cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe270066f60 0x7fe270069420 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe2900cfa80 0x7fe2900b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 --2- 172.21.15.18:0/2578341104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2900cc010 0x7fe2900b57a0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 >> 172.21.15.18:0/2578341104 conn(0x7fe2900d1630 msgr2=0x7fe2900d1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 shutdown_connections 2024-04-25T10:13:30.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:30.980+0000 7fe294e00640 1 -- 172.21.15.18:0/2578341104 wait complete. 2024-04-25T10:13:31.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:13:31.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:13:31.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 Processor -- start 2024-04-25T10:13:31.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 -- start start 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa98159320 0x7ffa9815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9815f440 0x7ffa9806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ffa9806e010 0x7ffa9806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9806d640 con 0x7ffa98159320 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9815fc00 con 0x7ffa9806e010 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815fee0 con 0x7ffa9815f440 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa98159320 0x7ffa9815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffa98159320 0x7ffa9815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41818/0 (socket says 172.21.15.18:41818) 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 -- 172.21.15.18:0/1464754105 learned_addr learned my addr 172.21.15.18:0/1464754105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa9d000640 1 --2- 172.21.15.18:0/1464754105 >> v2:172.21.15.167:3300/0 conn(0x7ffa9806e010 0x7ffa9806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9815f440 0x7ffa9806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 -- 172.21.15.18:0/1464754105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9815f440 msgr2=0x7ffa9806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9815f440 0x7ffa9806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 -- 172.21.15.18:0/1464754105 >> v2:172.21.15.167:3300/0 conn(0x7ffa9806e010 msgr2=0x7ffa9806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1464754105 >> v2:172.21.15.167:3300/0 conn(0x7ffa9806e010 0x7ffa9806e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.144+0000 7ffa97e00640 1 -- 172.21.15.18:0/1464754105 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa981601c0 con 0x7ffa98159320 2024-04-25T10:13:31.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa98159320 0x7ffa9815c9b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffa981604a0 tx=0x7ffa8801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a8f42c79cb07cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa97400640 1 -- 172.21.15.18:0/1464754105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880b0070 con 0x7ffa98159320 2024-04-25T10:13:31.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa97400640 1 -- 172.21.15.18:0/1464754105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880ab600 con 0x7ffa98159320 2024-04-25T10:13:31.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa97400640 1 -- 172.21.15.18:0/1464754105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880ab9d0 con 0x7ffa98159320 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 -- 172.21.15.18:0/1464754105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa98159320 msgr2=0x7ffa9815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa98159320 0x7ffa9815c9b0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffa981604a0 tx=0x7ffa8801c460 comp rx=0 tx=0).stop 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 -- 172.21.15.18:0/1464754105 shutdown_connections 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1464754105 >> v2:172.21.15.167:3300/0 conn(0x7ffa9806e010 0x7ffa9806e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9815f440 0x7ffa9806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1464754105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa98159320 0x7ffa9815c9b0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 -- 172.21.15.18:0/1464754105 >> 172.21.15.18:0/1464754105 conn(0x7ffa98067080 msgr2=0x7ffa9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 -- 172.21.15.18:0/1464754105 shutdown_connections 2024-04-25T10:13:31.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.148+0000 7ffa9f000640 1 -- 172.21.15.18:0/1464754105 wait complete. 2024-04-25T10:13:31.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 Processor -- start 2024-04-25T10:13:31.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- start start 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9806e010 0x7ffa981f7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 0x7ffa9813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980cc440 con 0x7ffa9815f440 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980cc2c0 con 0x7ffa98159320 2024-04-25T10:13:31.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980cc5c0 con 0x7ffa9806e010 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41834/0 (socket says 172.21.15.18:41834) 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 -- 172.21.15.18:0/1860897716 learned_addr learned my addr 172.21.15.18:0/1860897716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9806e010 0x7ffa981f7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 0x7ffa9813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 -- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9806e010 msgr2=0x7ffa981f7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9806e010 0x7ffa981f7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 -- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 msgr2=0x7ffa9813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 0x7ffa9813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 -- 172.21.15.18:0/1860897716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa981f84e0 con 0x7ffa9815f440 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 0x7ffa9813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9d000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000eea0 tx=0x7ffa9000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa94c00640 1 -- 172.21.15.18:0/1860897716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90018020 con 0x7ffa9815f440 2024-04-25T10:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa94c00640 1 -- 172.21.15.18:0/1860897716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90014400 con 0x7ffa9815f440 2024-04-25T10:13:31.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa94c00640 1 -- 172.21.15.18:0/1860897716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa900147f0 con 0x7ffa9815f440 2024-04-25T10:13:31.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa981f8810 con 0x7ffa9815f440 2024-04-25T10:13:31.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.152+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa980b0c20 con 0x7ffa9815f440 2024-04-25T10:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa94c00640 1 -- 172.21.15.18:0/1860897716 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa9001b020 con 0x7ffa9815f440 2024-04-25T10:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa94c00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 0x7ffa74069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 Processor -- start 2024-04-25T10:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa94c00640 1 -- 172.21.15.18:0/1860897716 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffa90085b20 con 0x7ffa9815f440 2024-04-25T10:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 -- start start 2024-04-25T10:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 0x7ffa74069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c561ff0 con 0x55eb3c7150a0 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c4ea150 con 0x55eb3c75f2f0 2024-04-25T10:13:31.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c55e090 con 0x55eb3c75e9d0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 0x7ffa74069450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffa880ad000 tx=0x7ffa88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41836/0 (socket says 172.21.15.18:41836) 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 -- 172.21.15.18:0/3264938861 learned_addr learned my addr 172.21.15.18:0/3264938861 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa97e00640 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 -- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 msgr2=0x55eb3c75edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 -- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 msgr2=0x55eb3c714b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.156+0000 7ffa9d000640 1 -- 172.21.15.18:0/3264938861 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb3c6f80d0 con 0x55eb3c7150a0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa9d000640 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ffa9005e420 tx=0x7ffa90056a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62bc7e67ff2d6f96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8cc00640 1 -- 172.21.15.18:0/3264938861 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90082070 con 0x55eb3c7150a0 2024-04-25T10:13:31.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8cc00640 1 -- 172.21.15.18:0/3264938861 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9005a160 con 0x55eb3c7150a0 2024-04-25T10:13:31.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8cc00640 1 -- 172.21.15.18:0/3264938861 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9005e950 con 0x55eb3c7150a0 2024-04-25T10:13:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- 172.21.15.18:0/3264938861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 msgr2=0x55eb3c715480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7ffa9005e420 tx=0x7ffa90056a80 comp rx=0 tx=0).stop 2024-04-25T10:13:31.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- 172.21.15.18:0/3264938861 shutdown_connections 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c715480 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- 172.21.15.18:0/3264938861 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- 172.21.15.18:0/3264938861 >> 172.21.15.18:0/3264938861 conn(0x55eb3c711020 msgr2=0x55eb3c713440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- 172.21.15.18:0/3264938861 shutdown_connections 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- 172.21.15.18:0/3264938861 wait complete. 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- start start 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 Processor -- start 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c7150a0 0x55eb3c747ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75f2f0 0x55eb3c748a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c526250 con 0x55eb3c75e9d0 2024-04-25T10:13:31.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c51c690 con 0x55eb3c7150a0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c4eaa40 con 0x55eb3c75f2f0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffaa2538000 10 client.0 _ll_register_callbacks cb 0x55eb3c6ffe90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41838/0 (socket says 172.21.15.18:41838) 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 -- 172.21.15.18:0/1602396121 learned_addr learned my addr 172.21.15.18:0/1602396121 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa9d000640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75f2f0 0x55eb3c748a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c7150a0 0x55eb3c747ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 -- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75f2f0 msgr2=0x55eb3c748a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75f2f0 0x55eb3c748a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 -- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c7150a0 msgr2=0x55eb3c747ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c7150a0 0x55eb3c747ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.160+0000 7ffa8fe00640 1 -- 172.21.15.18:0/1602396121 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb3c60f1c0 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ffa80012370 tx=0x7ffa80012830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6461dc2917f44e10 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80019070 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa9005a160 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffa80004240 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa80024050 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 10 client.8802 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55eb3c60b170 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9005a160 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffa80027020 con 0x55eb3c75e9d0 2024-04-25T10:13:31.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 10 client.8802 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 10 client.8802 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 20 client.8802 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c749340 0x55eb3c7751a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 4 client.8802 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb3c4fdc60 con 0x55eb3c749340 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c749340 0x55eb3c7751a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa97e00640 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c749340 0x55eb3c7751a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3356f7af57e31f31 server_cookie=b04ec665464e0be1 in_seq=0 out_seq=0 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 10 client.8802 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 1 -- 172.21.15.18:0/1602396121 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb3c4fdc60 con 0x55eb3c749340 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 10 client.8802 handle_command_reply: tid=0 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 client.8802 shutdown 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 msgr2=0x55eb3c748530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ffa80012370 tx=0x7ffa80012830 comp rx=0 tx=0).stop 2024-04-25T10:13:31.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 shutdown_connections 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c749340 0x55eb3c7751a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75f2f0 0x55eb3c748a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c748530 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffa85600640 0 client.8802 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 --2- 172.21.15.18:0/1602396121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c7150a0 0x55eb3c747ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 >> 172.21.15.18:0/1602396121 conn(0x55eb3c711020 msgr2=0x55eb3c713ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 shutdown_connections 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 1 -- 172.21.15.18:0/1602396121 wait complete. 2024-04-25T10:13:31.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.164+0000 7ffaa2538000 20 client.8802 trim_cache size 0 max 16384 2024-04-25T10:13:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 Processor -- start 2024-04-25T10:13:31.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 -- start start 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa981ff5e0 con 0x55eb3c7150a0 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980b3fb0 con 0x55eb3c75f2f0 2024-04-25T10:13:31.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9813ec10 con 0x55eb3c75e9d0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41844/0 (socket says 172.21.15.18:41844) 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 -- 172.21.15.18:0/920288263 learned_addr learned my addr 172.21.15.18:0/920288263 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa9d000640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 -- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 msgr2=0x55eb3c75dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 -- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 msgr2=0x55eb3c714420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa97e00640 1 -- 172.21.15.18:0/920288263 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb3c5a8de0 con 0x55eb3c7150a0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.180+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa97e00640 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ffa8801c4a0 tx=0x7ffa88004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e94e1cc4910e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa87e00640 1 -- 172.21.15.18:0/920288263 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880cb070 con 0x55eb3c7150a0 2024-04-25T10:13:31.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa87e00640 1 -- 172.21.15.18:0/920288263 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880c6480 con 0x55eb3c7150a0 2024-04-25T10:13:31.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa87e00640 1 -- 172.21.15.18:0/920288263 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa880b0040 con 0x55eb3c7150a0 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- 172.21.15.18:0/920288263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 msgr2=0x55eb3c75d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ffa8801c4a0 tx=0x7ffa88004740 comp rx=0 tx=0).stop 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- 172.21.15.18:0/920288263 shutdown_connections 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c714420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c75e9d0 0x55eb3c75dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- 172.21.15.18:0/920288263 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c7150a0 0x55eb3c75d7c0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- 172.21.15.18:0/920288263 >> 172.21.15.18:0/920288263 conn(0x55eb3c711020 msgr2=0x55eb3c741d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- 172.21.15.18:0/920288263 shutdown_connections 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- 172.21.15.18:0/920288263 wait complete. 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- start start 2024-04-25T10:13:31.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 Processor -- start 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c7150a0 0x55eb3c775380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c775e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c4fce00 con 0x55eb3c75e9d0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa980b39b0 con 0x55eb3c75f2f0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb3c561300 con 0x55eb3c7150a0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffaa2538000 10 client.0 _ll_register_callbacks cb 0x55eb3c6e0040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41860/0 (socket says 172.21.15.18:41860) 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 -- 172.21.15.18:0/4123961577 learned_addr learned my addr 172.21.15.18:0/4123961577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa9d000640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c775e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa97e00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c7150a0 0x55eb3c775380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 -- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c7150a0 msgr2=0x55eb3c775380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c7150a0 0x55eb3c775380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 -- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 msgr2=0x55eb3c775e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c775e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.184+0000 7ffa8fe00640 1 -- 172.21.15.18:0/4123961577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb3c5038e0 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa8fe00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ffa80003e00 tx=0x7ffa800046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5de4d97dbf73bf55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80019040 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ffa80004240 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa880c6480 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa80034050 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 10 client.8808 fetch_fsmap learned FSMap version 90 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x55eb3c5bb8f0 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa880c6480 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ffa80037020 con 0x55eb3c75e9d0 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 10 client.8808 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 10 client.8808 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:13:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 20 client.8808 populate_metadata read hostname 'smithi018' 2024-04-25T10:13:31.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c7c9080 0x55eb3c7cb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:13:31.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 4 client.8808 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:13:31.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eb3c56f530 con 0x55eb3c7c9080 2024-04-25T10:13:31.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa97e00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c7c9080 0x55eb3c7cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:13:31.198 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:13:31.188+0000 7f0881a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa97e00640 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c7c9080 0x55eb3c7cb470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515df28c18471a87 server_cookie=8ab7a4ed927d8efc in_seq=0 out_seq=0 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 10 client.8808 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 1 -- 172.21.15.18:0/4123961577 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55eb3c56f530 con 0x55eb3c7c9080 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 10 client.8808 handle_command_reply: tid=0 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 client.8808 shutdown 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 msgr2=0x55eb3c7758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ffa80003e00 tx=0x7ffa800046d0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 shutdown_connections 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x55eb3c7c9080 0x55eb3c7cb470 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb3c75f2f0 0x55eb3c775e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55eb3c75e9d0 0x55eb3c7758c0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 --2- 172.21.15.18:0/4123961577 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55eb3c7150a0 0x55eb3c775380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa85600640 0 client.8808 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 >> 172.21.15.18:0/4123961577 conn(0x55eb3c711020 msgr2=0x55eb3c75d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 shutdown_connections 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 1 -- 172.21.15.18:0/4123961577 wait complete. 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffaa2538000 20 client.8808 trim_cache size 0 max 16384 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": { 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout: "ae78ad31-c363-4824-aed0-66e37fb764ad": { 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout: "path": "/", 2024-04-25T10:13:31.201 INFO:teuthology.orchestra.run.smithi018.stdout: "tag": "ae78ad31-c363-4824-aed0-66e37fb764ad", 2024-04-25T10:13:31.202 INFO:teuthology.orchestra.run.smithi018.stdout: "options": "recursive,repair" 2024-04-25T10:13:31.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:13:31.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:13:31.202 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 msgr2=0x7ffa74069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 0x7ffa74069450 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ffa880ad000 tx=0x7ffa88008040 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 msgr2=0x7ffa980b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ffa9000eea0 tx=0x7ffa9000ef90 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 shutdown_connections 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffa9815f440 0x7ffa980b1400 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa98159320 0x7ffa9813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ffa74066f90 0x7ffa74069450 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 --2- 172.21.15.18:0/1860897716 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ffa9806e010 0x7ffa981f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:13:31.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 >> 172.21.15.18:0/1860897716 conn(0x7ffa98067080 msgr2=0x7ffa9815ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:13:31.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 shutdown_connections 2024-04-25T10:13:31.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:31.188+0000 7ffa9f000640 1 -- 172.21.15.18:0/1860897716 wait complete. 2024-04-25T10:13:31.216 INFO:tasks.cephfs.filesystem:scrub status for tag:ae78ad31-c363-4824-aed0-66e37fb764ad - {'path': '/', 'tag': 'ae78ad31-c363-4824-aed0-66e37fb764ad', 'options': 'recursive,repair'} 2024-04-25T10:13:32.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:32.212+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T10:13:30.986055+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7f9420053e40 con 0x7f942c0b3700 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.986055+0000 mds.d [INF] scrub queued for path: / 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.986059+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.986064+0000 mds.d [INF] scrub summary: active paths [/] 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.986753+0000 mds.d [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.986763+0000 mds.d [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.987099+0000 mds.d [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.987104+0000 mds.d [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T10:13:32.219 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:30.987780+0000 mds.d [INF] scrub summary: idle+waiting paths [/] 2024-04-25T10:13:37.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:37.220+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T10:13:35.247178+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f94200850e0 con 0x7f942c0b3700 2024-04-25T10:13:37.229 INFO:teuthology.orchestra.run.smithi018.stdout:2024-04-25T10:13:35.247178+0000 mds.d [INF] scrub summary: idle 2024-04-25T10:13:38.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:38.224+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 10 ==== log(2 entries from seq 1213 at 2024-04-25T10:13:37.525946+0000) v1 ==== 607+0+0 (secure 0 0 0) 0x7f9420083730 con 0x7f942c0b3700 2024-04-25T10:13:39.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:13:39.228+0000 7f9426000640 1 -- 172.21.15.18:0/2906795799 <== mon.0 v2:172.21.15.18:3300/0 11 ==== log(2 entries from seq 1215 at 2024-04-25T10:13:38.232333+0000) v1 ==== 611+0+0 (secure 0 0 0) 0x7f942005dd10 con 0x7f942c0b3700 2024-04-25T10:13:51.646 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:13:51.651 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:14:01.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:01.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T10:14:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 Processor -- start 2024-04-25T10:14:01.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 -- start start 2024-04-25T10:14:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 0x7f828015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f828006e4a0 0x7f828006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828015fc00 con 0x7f828015f440 2024-04-25T10:14:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828006d640 con 0x7f828006e4a0 2024-04-25T10:14:01.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8284a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828015fee0 con 0x7f8280159320 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8277e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f828015f440 0x7f828006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42288/0 (socket says 172.21.15.18:42288) 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f8277e00640 1 -- 172.21.15.18:0/1661487596 learned_addr learned my addr 172.21.15.18:0/1661487596 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827e800640 1 --2- 172.21.15.18:0/1661487596 >> v2:172.21.15.18:3300/0 conn(0x7f828006e4a0 0x7f828006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827de00640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 0x7f828015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827e800640 1 -- 172.21.15.18:0/1661487596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 msgr2=0x7f828015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827e800640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 0x7f828015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827e800640 1 -- 172.21.15.18:0/1661487596 >> v1:172.21.15.18:6789/0 conn(0x7f828015f440 legacy=0x7f828006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827e800640 1 -- 172.21.15.18:0/1661487596 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82801601c0 con 0x7f828006e4a0 2024-04-25T10:14:01.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.368+0000 7f827de00640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 0x7f828015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:01.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f827e800640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828006e930 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875f69fd74d3b22e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f827d400640 1 -- 172.21.15.18:0/1661487596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b2070 con 0x7f828006e4a0 2024-04-25T10:14:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f827d400640 1 -- 172.21.15.18:0/1661487596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780a5830 con 0x7f828006e4a0 2024-04-25T10:14:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f827d400640 1 -- 172.21.15.18:0/1661487596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780a5c00 con 0x7f828006e4a0 2024-04-25T10:14:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- 172.21.15.18:0/1661487596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 msgr2=0x7f828006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828006e930 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f8278009d90 tx=0x7f827801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- 172.21.15.18:0/1661487596 shutdown_connections 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828006e930 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 --2- 172.21.15.18:0/1661487596 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8280159320 0x7f828015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- 172.21.15.18:0/1661487596 >> 172.21.15.18:0/1661487596 conn(0x7f8280067080 msgr2=0x7f828006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- 172.21.15.18:0/1661487596 shutdown_connections 2024-04-25T10:14:01.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- 172.21.15.18:0/1661487596 wait complete. 2024-04-25T10:14:01.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 Processor -- start 2024-04-25T10:14:01.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.372+0000 7f8284a00640 1 -- start start 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 0x7f82801fa720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f828015f440 0x7f828013ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828015f9a0 con 0x7f828006e4a0 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828015f820 con 0x7f8280159320 2024-04-25T10:14:01.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280168590 con 0x7f828015f440 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52582/0 (socket says 172.21.15.18:52582) 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 -- 172.21.15.18:0/20173352 learned_addr learned my addr 172.21.15.18:0/20173352 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827e800640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f828015f440 0x7f828013ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8277e00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 0x7f82801fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 -- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f828015f440 msgr2=0x7f828013ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f828015f440 0x7f828013ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 -- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 msgr2=0x7f82801fa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 0x7f82801fa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 -- 172.21.15.18:0/20173352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280138c30 con 0x7f828006e4a0 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8277e00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 0x7f82801fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:01.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f827de00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f827000c7c0 tx=0x7f827000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8276000640 1 -- 172.21.15.18:0/20173352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270007a30 con 0x7f828006e4a0 2024-04-25T10:14:01.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8276000640 1 -- 172.21.15.18:0/20173352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8270007bd0 con 0x7f828006e4a0 2024-04-25T10:14:01.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8276000640 1 -- 172.21.15.18:0/20173352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82700113f0 con 0x7f828006e4a0 2024-04-25T10:14:01.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828015ec90 con 0x7f828006e4a0 2024-04-25T10:14:01.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.376+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828015ef70 con 0x7f828006e4a0 2024-04-25T10:14:01.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8276000640 1 -- 172.21.15.18:0/20173352 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8270011590 con 0x7f828006e4a0 2024-04-25T10:14:01.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8276000640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 0x7f825c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8276000640 1 -- 172.21.15.18:0/20173352 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8270085360 con 0x7f828006e4a0 2024-04-25T10:14:01.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8277e00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 0x7f825c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 Processor -- start 2024-04-25T10:14:01.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 -- start start 2024-04-25T10:14:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8277e00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 0x7f825c069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8280164fd0 tx=0x7f8268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae59d0 0x564768ae5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768a9bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647688e8ff0 con 0x564768a9c0a0 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x564768871150 con 0x564768ae59d0 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647688e5090 con 0x564768ae62f0 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52598/0 (socket says 172.21.15.18:52598) 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 -- 172.21.15.18:0/1461156811 learned_addr learned my addr 172.21.15.18:0/1461156811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827de00640 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae59d0 0x564768ae5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f8277e00640 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768a9bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 -- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 msgr2=0x564768a9bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768a9bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 -- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae59d0 msgr2=0x564768ae5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae59d0 0x564768ae5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 -- 172.21.15.18:0/1461156811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564768a7f0d0 con 0x564768a9c0a0 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f827e800640 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f827801af90 tx=0x7f8278004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c357399519b13cee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f826ea00640 1 -- 172.21.15.18:0/1461156811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b2040 con 0x564768a9c0a0 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f826ea00640 1 -- 172.21.15.18:0/1461156811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780b3040 con 0x564768a9c0a0 2024-04-25T10:14:01.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.380+0000 7f826ea00640 1 -- 172.21.15.18:0/1461156811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780a5ce0 con 0x564768a9c0a0 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/1461156811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 msgr2=0x564768a9c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f827801af90 tx=0x7f8278004ac0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/1461156811 shutdown_connections 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768a9c480 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768a9bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- 172.21.15.18:0/1461156811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae59d0 0x564768ae5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/1461156811 >> 172.21.15.18:0/1461156811 conn(0x564768a98020 msgr2=0x564768a9a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/1461156811 shutdown_connections 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/1461156811 wait complete. 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- start start 2024-04-25T10:14:01.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 Processor -- start 2024-04-25T10:14:01.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768aca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768acad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647688ad250 con 0x564768ae62f0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647688a3690 con 0x564768a9c0a0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x564768871a40 con 0x564768ae59d0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 10 client.0 _ll_register_callbacks cb 0x564768a86e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52614/0 (socket says 172.21.15.18:52614) 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 -- 172.21.15.18:0/3048332302 learned_addr learned my addr 172.21.15.18:0/3048332302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827de00640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768aca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8277e00640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768acad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 -- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 msgr2=0x564768acad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768acad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 -- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 msgr2=0x564768aca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768aca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 -- 172.21.15.18:0/3048332302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647689961c0 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f827e800640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f82780095c0 tx=0x7f827801b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf93aedcf32e7495 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8263400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780c5070 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8278003de0 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82780b3040 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82780cd050 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 10 client.8823 fetch_fsmap learned FSMap version 90 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.384+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x564768992170 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82780b3040 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f82780d0020 con 0x564768ae62f0 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 10 client.8823 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 10 client.8823 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 20 client.8823 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:01.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768af5c80 0x564768af8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 4 client.8823 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564768884c60 con 0x564768af5c80 2024-04-25T10:14:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f827de00640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768af5c80 0x564768af8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f827de00640 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768af5c80 0x564768af8070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3537eaa97f3f4b62 server_cookie=58327a2c531d776e in_seq=0 out_seq=0 2024-04-25T10:14:01.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 10 client.8823 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 1 -- 172.21.15.18:0/3048332302 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564768884c60 con 0x564768af5c80 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 10 client.8823 handle_command_reply: tid=0 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 client.8823 shutdown 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 msgr2=0x564768acb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f82780095c0 tx=0x7f827801b120 comp rx=0 tx=0).stop 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 shutdown_connections 2024-04-25T10:14:01.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768af5c80 0x564768af8070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae62f0 0x564768acb270 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768acad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 --2- 172.21.15.18:0/3048332302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768aca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8263400640 0 client.8823 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 >> 172.21.15.18:0/3048332302 conn(0x564768a98020 msgr2=0x564768a9aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 shutdown_connections 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 1 -- 172.21.15.18:0/3048332302 wait complete. 2024-04-25T10:14:01.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.388+0000 7f8287e0e000 20 client.8823 trim_cache size 0 max 16384 2024-04-25T10:14:01.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 Processor -- start 2024-04-25T10:14:01.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 -- start start 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768b42300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768b42d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280203670 con 0x564768ae59d0 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280202870 con 0x564768a9c0a0 2024-04-25T10:14:01.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828015da30 con 0x564768ae62f0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52618/0 (socket says 172.21.15.18:52618) 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 -- 172.21.15.18:0/2406367487 learned_addr learned my addr 172.21.15.18:0/2406367487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f827e800640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768b42d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f827de00640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768b42300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 -- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 msgr2=0x564768b42d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768b42d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 -- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 msgr2=0x564768b42300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768b42300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 -- 172.21.15.18:0/2406367487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56476892fde0 con 0x564768ae59d0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f827e800640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768b42d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f8277e00640 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f82680059e0 tx=0x7f8268012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2831574fddf19801 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f826e000640 1 -- 172.21.15.18:0/2406367487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8268028070 con 0x564768ae59d0 2024-04-25T10:14:01.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f826e000640 1 -- 172.21.15.18:0/2406367487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268007650 con 0x564768ae59d0 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.404+0000 7f826e000640 1 -- 172.21.15.18:0/2406367487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826800e7b0 con 0x564768ae59d0 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/2406367487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 msgr2=0x564768b42840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f82680059e0 tx=0x7f8268012000 comp rx=0 tx=0).stop 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/2406367487 shutdown_connections 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae62f0 0x564768b42d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768ae59d0 0x564768b42840 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- 172.21.15.18:0/2406367487 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768a9c0a0 0x564768b42300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/2406367487 >> 172.21.15.18:0/2406367487 conn(0x564768a98020 msgr2=0x564768af2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/2406367487 shutdown_connections 2024-04-25T10:14:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/2406367487 wait complete. 2024-04-25T10:14:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- start start 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 Processor -- start 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768af88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae62f0 0x564768af8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x564768883e00 con 0x564768a9c0a0 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280202270 con 0x564768ae62f0 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5647688e8300 con 0x564768ae59d0 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 10 client.0 _ll_register_callbacks cb 0x564768a67040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52630/0 (socket says 172.21.15.18:52630) 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 -- 172.21.15.18:0/445814 learned_addr learned my addr 172.21.15.18:0/445814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 -- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 msgr2=0x564768af88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768af88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 -- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae62f0 msgr2=0x564768af8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae62f0 0x564768af8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 -- 172.21.15.18:0/445814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56476888a8e0 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f827de00640 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270083530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632a9b1b77b1966a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8263400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827001e040 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f82700836e0 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8268007650 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=90) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8270053df0 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 10 client.8829 fetch_fsmap learned FSMap version 90 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.408+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=90,monmap=2+}) v3 -- 0x5647689428f0 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8268007650 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 90) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8270052160 con 0x564768a9c0a0 2024-04-25T10:14:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 10 client.8829 fetch_fsmap finished waiting for FSMap version 90 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 10 client.8829 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.d 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 20 client.8829 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768b4bf50 0x564768b4e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 4 client.8829 mds_command: new command op to 37103 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 --> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5647688f6530 con 0x564768b4bf50 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8277e00640 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768b4bf50 0x564768b4e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8277e00640 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768b4bf50 0x564768b4e340 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7167478721767e97 server_cookie=76c2ba4e79a1c841 in_seq=0 out_seq=0 2024-04-25T10:14:01.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 10 client.8829 ms_handle_connect on v2:172.21.15.167:6835/2124918123 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 1 -- 172.21.15.18:0/445814 <== mds.0 v2:172.21.15.167:6835/2124918123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5647688f6530 con 0x564768b4bf50 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 10 client.8829 handle_command_reply: tid=0 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 client.8829 shutdown 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 msgr2=0x564768af8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8270006fd0 tx=0x7f8270083530 comp rx=0 tx=0).stop 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 shutdown_connections 2024-04-25T10:14:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:6835/2124918123,v1:172.21.15.167:6837/2124918123] conn(0x564768b4bf50 0x564768b4e340 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564768ae62f0 0x564768af8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x564768ae59d0 0x564768af88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8263400640 0 client.8829 ms_handle_reset on v2:172.21.15.167:6835/2124918123 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 --2- 172.21.15.18:0/445814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564768a9c0a0 0x564768af8380 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 >> 172.21.15.18:0/445814 conn(0x564768a98020 msgr2=0x564768ae40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 shutdown_connections 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 1 -- 172.21.15.18:0/445814 wait complete. 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8287e0e000 20 client.8829 trim_cache size 0 max 16384 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stdout: "status": "no active scrubs running", 2024-04-25T10:14:01.423 INFO:teuthology.orchestra.run.smithi018.stdout: "scrubs": {} 2024-04-25T10:14:01.424 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 msgr2=0x7f825c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 0x7f825c069420 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f8280164fd0 tx=0x7f8268009040 comp rx=0 tx=0).stop 2024-04-25T10:14:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 msgr2=0x7f828015e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f827000c7c0 tx=0x7f827000cc80 comp rx=0 tx=0).stop 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 shutdown_connections 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f825c066f60 0x7f825c069420 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f828015f440 0x7f828013ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8280159320 0x7f82801fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 --2- 172.21.15.18:0/20173352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f828006e4a0 0x7f828015e0b0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 >> 172.21.15.18:0/20173352 conn(0x7f8280067080 msgr2=0x7f828006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 shutdown_connections 2024-04-25T10:14:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.412+0000 7f8284a00640 1 -- 172.21.15.18:0/20173352 wait complete. 2024-04-25T10:14:01.440 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T10:14:01.541 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:14:01.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 Processor -- start 2024-04-25T10:14:01.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 -- start start 2024-04-25T10:14:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6490144120 0x7f649015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f64900ccbf0 0x7f649015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 0x7f64900b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649015e490 con 0x7f64900ccbf0 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f649015bc40 con 0x7f649015ee60 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6498000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f649015b3a0 con 0x7f6490144120 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f64900ccbf0 0x7f649015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f64900ccbf0 0x7f649015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46664/0 (socket says 172.21.15.18:46664) 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 -- 172.21.15.18:0/2093891773 learned_addr learned my addr 172.21.15.18:0/2093891773 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6495600640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6490144120 0x7f649015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6496000640 1 --2- 172.21.15.18:0/2093891773 >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 0x7f64900b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 -- 172.21.15.18:0/2093891773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6490144120 msgr2=0x7f649015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6490144120 0x7f649015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 -- 172.21.15.18:0/2093891773 >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 msgr2=0x7f64900b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.676+0000 7f6494c00640 1 --2- 172.21.15.18:0/2093891773 >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 0x7f64900b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6494c00640 1 -- 172.21.15.18:0/2093891773 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649015b680 con 0x7f64900ccbf0 2024-04-25T10:14:01.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6496000640 1 --2- 172.21.15.18:0/2093891773 >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 0x7f64900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:01.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6494c00640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64900ccbf0 0x7f649015e920 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f64900b2fe0 tx=0x7f647c01eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa746cf15969ce58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f648fe00640 1 -- 172.21.15.18:0/2093891773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0b4070 con 0x7f64900ccbf0 2024-04-25T10:14:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f648fe00640 1 -- 172.21.15.18:0/2093891773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c0a79f0 con 0x7f64900ccbf0 2024-04-25T10:14:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f648fe00640 1 -- 172.21.15.18:0/2093891773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0a7dc0 con 0x7f64900ccbf0 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 -- 172.21.15.18:0/2093891773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64900ccbf0 msgr2=0x7f649015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64900ccbf0 0x7f649015e920 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f64900b2fe0 tx=0x7f647c01eb60 comp rx=0 tx=0).stop 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 -- 172.21.15.18:0/2093891773 shutdown_connections 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 --2- 172.21.15.18:0/2093891773 >> v2:172.21.15.167:3300/0 conn(0x7f649015ee60 0x7f64900b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64900ccbf0 0x7f649015e920 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 --2- 172.21.15.18:0/2093891773 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6490144120 0x7f649015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 -- 172.21.15.18:0/2093891773 >> 172.21.15.18:0/2093891773 conn(0x7f6490067080 msgr2=0x7f649006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 -- 172.21.15.18:0/2093891773 shutdown_connections 2024-04-25T10:14:01.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.680+0000 7f6498000640 1 -- 172.21.15.18:0/2093891773 wait complete. 2024-04-25T10:14:01.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 Processor -- start 2024-04-25T10:14:01.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- start start 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900ccbf0 0x7f64901431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f649015ee60 0x7f6490141f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490071e50 con 0x7f6490144120 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490071cd0 con 0x7f649015ee60 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6490071fd0 con 0x7f64900ccbf0 2024-04-25T10:14:01.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46668/0 (socket says 172.21.15.18:46668) 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 -- 172.21.15.18:0/955876204 learned_addr learned my addr 172.21.15.18:0/955876204 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6495600640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900ccbf0 0x7f64901431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6496000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f649015ee60 0x7f6490141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 -- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900ccbf0 msgr2=0x7f64901431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900ccbf0 0x7f64901431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 -- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f649015ee60 msgr2=0x7f6490141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f649015ee60 0x7f6490141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 -- 172.21.15.18:0/955876204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649013b490 con 0x7f6490144120 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6494c00640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f647c00b2c0 tx=0x7f647c01b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0b4070 con 0x7f6490144120 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c0b6070 con 0x7f6490144120 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c0afd30 con 0x7f6490144120 2024-04-25T10:14:01.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64901640b0 con 0x7f6490144120 2024-04-25T10:14:01.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.684+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490140b70 con 0x7f6490144120 2024-04-25T10:14:01.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64900745d0 con 0x7f6490144120 2024-04-25T10:14:01.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f647c0bb470 con 0x7f6490144120 2024-04-25T10:14:01.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f648d600640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 0x7f64700694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f647c11f5b0 con 0x7f6490144120 2024-04-25T10:14:01.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f6495600640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 0x7f64700694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.688+0000 7f6495600640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 0x7f64700694a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f648400b990 tx=0x7f6484008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.692+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f647c0187e0 con 0x7f6490144120 2024-04-25T10:14:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.884+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f64900cc310 con 0x7f6490144120 2024-04-25T10:14:01.893 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:14:01.888+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:14:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.888+0000 7f648d600640 1 -- 172.21.15.18:0/955876204 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v91) v1 ==== 161+0+0 (secure 0 0 0) 0x7f647c0efdc0 con 0x7f6490144120 2024-04-25T10:14:01.896 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:14:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 msgr2=0x7f64700694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 0x7f64700694a0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f648400b990 tx=0x7f6484008040 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 msgr2=0x7f6490141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f647c00b2c0 tx=0x7f647c01b900 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 shutdown_connections 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f649015ee60 0x7f6490141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6490144120 0x7f6490141a50 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6470066fe0 0x7f64700694a0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 --2- 172.21.15.18:0/955876204 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64900ccbf0 0x7f64901431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 >> 172.21.15.18:0/955876204 conn(0x7f6490067080 msgr2=0x7f64900cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 shutdown_connections 2024-04-25T10:14:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.892+0000 7f6498000640 1 -- 172.21.15.18:0/955876204 wait complete. 2024-04-25T10:14:01.906 INFO:tasks.ceph.mds.d.smithi167.stderr: -1182> 2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T10:14:01.906 INFO:tasks.ceph.mds.d.smithi167.stderr: -1179> 2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T10:14:01.906 INFO:tasks.ceph.mds.d.smithi167.stderr: -1145> 2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T10:14:01.907 INFO:tasks.ceph.mds.d.smithi167.stderr: -1142> 2024-04-25T10:13:30.984+0000 7f087ca00640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T10:14:01.907 INFO:tasks.ceph.mds.d.smithi167.stderr: -1044> 2024-04-25T10:13:31.188+0000 7f0881a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:14:01.918 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T10:14:01.949 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:14:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 -- start start 2024-04-25T10:14:01.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 Processor -- start 2024-04-25T10:14:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 0x5631ad45cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 0x5631ad45d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ae072780 con 0x5631ad2a3800 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ae072600 con 0x5631ad2a3000 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631ae072480 con 0x5631ad2a3400 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46680/0 (socket says 172.21.15.18:46680) 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 -- 172.21.15.18:0/823727778 learned_addr learned my addr 172.21.15.18:0/823727778 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d67200640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 0x5631ad45d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 -- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 msgr2=0x5631ad45cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d65e00640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 0x5631ad45cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 0x5631ad45cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 -- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 msgr2=0x5631ad45d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 0x5631ad45d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d66800640 1 -- 172.21.15.18:0/823727778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631ae05ab40 con 0x5631ad2a3800 2024-04-25T10:14:01.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d65e00640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 0x5631ad45cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:01.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.956+0000 7f7d67200640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 0x5631ad45d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:01.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d66800640 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x5631ae1071d0 tx=0x5631ad366de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d31e9991af71419a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d63600640 1 -- 172.21.15.18:0/823727778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d84e0 con 0x5631ad2a3800 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d63600640 1 -- 172.21.15.18:0/823727778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631ad2ece00 con 0x5631ad2a3800 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d63600640 1 -- 172.21.15.18:0/823727778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d8b60 con 0x5631ad2a3800 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631ae05ad20 con 0x5631ad2a3800 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5631ae05af00 con 0x5631ad2a3800 2024-04-25T10:14:01.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 4 waiting for MDS map... 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d63600640 1 -- 172.21.15.18:0/823727778 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x5631ae1aa600 con 0x5631ad2a3800 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d63600640 1 -- 172.21.15.18:0/823727778 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 91) v1 ==== 2723+0+0 (secure 0 0 0) 0x5631ad2f9180 con 0x5631ad2a3800 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 4 Got MDS map 91 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 10 main: main 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 4 main: connecting to RADOS... 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 Processor -- start 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- start start 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ae072300 con 0x5631ae1b7400 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ae072000 con 0x5631ae1b7000 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631ad302900 con 0x5631ae1b6c00 2024-04-25T10:14:01.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d67200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d67200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:33286/0 (socket says 172.21.15.18:33286) 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d66800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d67200640 1 -- 172.21.15.18:0/1112856724 learned_addr learned my addr 172.21.15.18:0/1112856724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 -- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 msgr2=0x5631ad45d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 -- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 msgr2=0x5631ad45db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 -- 172.21.15.18:0/1112856724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631ae05ad20 con 0x5631ae1b7400 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d67200640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d66800640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d65e00640 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e100 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x5631ae106900 tx=0x5631ae06c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a2c7478f0754b21 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d60e00640 1 -- 172.21.15.18:0/1112856724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d89c0 con 0x5631ae1b7400 2024-04-25T10:14:01.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d60e00640 1 -- 172.21.15.18:0/1112856724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631ad2ecc40 con 0x5631ae1b7400 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.960+0000 7f7d60e00640 1 -- 172.21.15.18:0/1112856724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d84e0 con 0x5631ae1b7400 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/1112856724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 msgr2=0x5631ad45e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e100 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x5631ae106900 tx=0x5631ae06c060 comp rx=0 tx=0).stop 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/1112856724 shutdown_connections 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e100 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- 172.21.15.18:0/1112856724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/1112856724 >> 172.21.15.18:0/1112856724 conn(0x5631ad2a2c00 msgr2=0x5631ad2d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/1112856724 shutdown_connections 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/1112856724 wait complete. 2024-04-25T10:14:01.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 Processor -- start 2024-04-25T10:14:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- start start 2024-04-25T10:14:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ae073500 con 0x5631ae1b7400 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631ad302480 con 0x5631ae1b7000 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5631ae073b00 con 0x5631ae1b6c00 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46694/0 (socket says 172.21.15.18:46694) 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 -- 172.21.15.18:0/2064370091 learned_addr learned my addr 172.21.15.18:0/2064370091 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d66800640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d67200640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 -- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 msgr2=0x5631ad45f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ae1b6c00 0x5631ad45f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 -- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 msgr2=0x5631ad45ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ae1b7000 0x5631ad45ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 -- 172.21.15.18:0/2064370091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631ae05bc20 con 0x5631ae1b7400 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d65e00640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e680 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x5631ae2202d0 tx=0x5631ae06c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d5f000640 1 -- 172.21.15.18:0/2064370091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d8b60 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d5f000640 1 -- 172.21.15.18:0/2064370091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5631ad2eca80 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5631ae05be00 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d5f000640 1 -- 172.21.15.18:0/2064370091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5631ad2d8000 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631ae05a1e0 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.964+0000 7f7d6870b400 4 main: resolving pool 15 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d5f000640 1 -- 172.21.15.18:0/2064370091 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x5631ae22ac00 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d5f000640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5631ad6c4000 0x5631ad45f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d5f000640 1 -- 172.21.15.18:0/2064370091 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x5631ae078600 con 0x5631ae1b7400 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d6870b400 4 main: creating IoCtx.. 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d6870b400 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5631ae1b7800 0x5631ad45e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e113) v9 -- 0x5631ae1b7c00 con 0x5631ae1b7800 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d67200640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5631ad6c4000 0x5631ad45f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d66800640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5631ae1b7800 0x5631ad45e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:01.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d66800640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5631ae1b7800 0x5631ad45e100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.968+0000 7f7d67200640 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5631ad6c4000 0x5631ad45f700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x5631ae220090 tx=0x5631ad6d0000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:01.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d66800640 1 -- 172.21.15.18:0/2064370091 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5631ad3ae000 con 0x5631ae1b7800 2024-04-25T10:14:01.979 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:01.979 INFO:teuthology.orchestra.run.smithi018.stdout: "0": { 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "data": { 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "version": 5, 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "inotable": { 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "projected_free": [ 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "start": 1099511627779, 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "len": 1099511627773 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "free": [ 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "start": 1099511627779, 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: "len": 1099511627773 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:01.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: "result": 0 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:01.981 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:01.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5631ae1b7800 msgr2=0x5631ad45e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x5631ae1b7800 0x5631ad45e100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5631ad6c4000 msgr2=0x5631ad45f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x5631ad6c4000 0x5631ad45f700 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x5631ae220090 tx=0x5631ad6d0000 comp rx=0 tx=0).stop 2024-04-25T10:14:01.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 msgr2=0x5631ad45e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/2064370091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ae1b7400 0x5631ad45e680 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x5631ae2202d0 tx=0x5631ae06c2a0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d65e00640 1 -- 172.21.15.18:0/2064370091 reap_dead start 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 shutdown_connections 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 >> 172.21.15.18:0/2064370091 conn(0x5631ad2a2c00 msgr2=0x5631ad2d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 shutdown_connections 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/2064370091 wait complete. 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 msgr2=0x5631ad45c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x5631ae1071d0 tx=0x5631ad366de0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 shutdown_connections 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631ad2a3000 0x5631ad45d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5631ad2a3400 0x5631ad45cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 --2- 172.21.15.18:0/823727778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5631ad2a3800 0x5631ad45c580 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 >> 172.21.15.18:0/823727778 conn(0x5631ad2a3c00 msgr2=0x5631ad2d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:01.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 shutdown_connections 2024-04-25T10:14:01.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:01.972+0000 7f7d6870b400 1 -- 172.21.15.18:0/823727778 wait complete. 2024-04-25T10:14:01.984 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.066061, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T10:14:01.985 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:14:01.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:02.121 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:02.208 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:14:02.208 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:02.208 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:02.217 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:02.217 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:02.217 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:02.229 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:02.229 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:02.229 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:02.265 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:02.266 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:02.266 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:02.285 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:02.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:02.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 Processor -- start 2024-04-25T10:14:02.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 -- start start 2024-04-25T10:14:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa00cef30 0x7feaa006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feaa006e900 0x7feaa00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa015ac60 con 0x7feaa0144140 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa006ed30 con 0x7feaa006e900 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7feaa5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa00cf3e0 con 0x7feaa00cef30 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9ea00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feaa0144140 0x7feaa00ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54894/0 (socket says 172.21.15.18:54894) 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9ea00640 1 -- 172.21.15.18:0/36225958 learned_addr learned my addr 172.21.15.18:0/36225958 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9f400640 1 --2- 172.21.15.18:0/36225958 >> v2:172.21.15.18:3300/0 conn(0x7feaa006e900 0x7feaa00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9e000640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa00cef30 0x7feaa006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9f400640 1 -- 172.21.15.18:0/36225958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa00cef30 msgr2=0x7feaa006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:02.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9f400640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa00cef30 0x7feaa006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9f400640 1 -- 172.21.15.18:0/36225958 >> v1:172.21.15.18:6789/0 conn(0x7feaa0144140 legacy=0x7feaa00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.444+0000 7fea9f400640 1 -- 172.21.15.18:0/36225958 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa015af20 con 0x7feaa006e900 2024-04-25T10:14:02.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7fea9f400640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa006e900 0x7feaa00b0760 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fea98009d90 tx=0x7fea9801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84b0e9c0e2fcd81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7fea9d600640 1 -- 172.21.15.18:0/36225958 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980ad070 con 0x7feaa006e900 2024-04-25T10:14:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7fea9d600640 1 -- 172.21.15.18:0/36225958 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea980a9660 con 0x7feaa006e900 2024-04-25T10:14:02.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7fea9d600640 1 -- 172.21.15.18:0/36225958 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea980a9a30 con 0x7feaa006e900 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- 172.21.15.18:0/36225958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa006e900 msgr2=0x7feaa00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa006e900 0x7feaa00b0760 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7fea98009d90 tx=0x7fea9801c970 comp rx=0 tx=0).stop 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- 172.21.15.18:0/36225958 shutdown_connections 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa006e900 0x7feaa00b0760 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 --2- 172.21.15.18:0/36225958 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa00cef30 0x7feaa006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- 172.21.15.18:0/36225958 >> 172.21.15.18:0/36225958 conn(0x7feaa0066fa0 msgr2=0x7feaa006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- 172.21.15.18:0/36225958 shutdown_connections 2024-04-25T10:14:02.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- 172.21.15.18:0/36225958 wait complete. 2024-04-25T10:14:02.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 Processor -- start 2024-04-25T10:14:02.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.448+0000 7feaa5c00640 1 -- start start 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 0x7feaa01395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 0x7feaa013e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa015ba00 con 0x7feaa00cef30 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0144520 con 0x7feaa0144140 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa015bb80 con 0x7feaa006e900 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46712/0 (socket says 172.21.15.18:46712) 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 -- 172.21.15.18:0/4055280489 learned_addr learned my addr 172.21.15.18:0/4055280489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9ea00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 0x7feaa01395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9f400640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 0x7feaa013e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 -- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 msgr2=0x7feaa01395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 0x7feaa01395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 -- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 msgr2=0x7feaa013e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 0x7feaa013e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 -- 172.21.15.18:0/4055280489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa0139310 con 0x7feaa00cef30 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9ea00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 0x7feaa01395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9f400640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 0x7feaa013e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea9e000640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00d800 tx=0x7fea8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00b6c0 con 0x7feaa00cef30 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8c019070 con 0x7feaa00cef30 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8c00baa0 con 0x7feaa00cef30 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa01f8630 con 0x7feaa00cef30 2024-04-25T10:14:02.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa01f8910 con 0x7feaa00cef30 2024-04-25T10:14:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.452+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa00745d0 con 0x7feaa00cef30 2024-04-25T10:14:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.456+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea8c00bc40 con 0x7feaa00cef30 2024-04-25T10:14:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.456+0000 7fea96a00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 0x7fea80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.456+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fea8c085740 con 0x7feaa00cef30 2024-04-25T10:14:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.456+0000 7fea9ea00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 0x7fea80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.456+0000 7fea9ea00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 0x7fea80069420 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7feaa013c4d0 tx=0x7fea90009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.460+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea8c0564d0 con 0x7feaa00cef30 2024-04-25T10:14:02.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feaa00cc6b0 con 0x7feaa00cef30 2024-04-25T10:14:02.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7fea96a00640 1 -- 172.21.15.18:0/4055280489 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4146 (secure 0 0 0) 0x7fea8c055dd0 con 0x7feaa00cef30 2024-04-25T10:14:02.667 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:02.668 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":91,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:14:01.891741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:14:02.668 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 91 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 msgr2=0x7fea80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 0x7fea80069420 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7feaa013c4d0 tx=0x7fea90009040 comp rx=0 tx=0).stop 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 msgr2=0x7feaa0138bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00d800 tx=0x7fea8c00dcc0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 shutdown_connections 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feaa0144140 0x7feaa013e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feaa00cef30 0x7feaa0138bd0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fea80066f60 0x7fea80069420 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 --2- 172.21.15.18:0/4055280489 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feaa006e900 0x7feaa01395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 >> 172.21.15.18:0/4055280489 conn(0x7feaa0066fa0 msgr2=0x7feaa006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 shutdown_connections 2024-04-25T10:14:02.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.660+0000 7feaa5c00640 1 -- 172.21.15.18:0/4055280489 wait complete. 2024-04-25T10:14:02.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:02.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 Processor -- start 2024-04-25T10:14:02.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 -- start start 2024-04-25T10:14:02.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca015b2f0 0x7f5ca00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ca006dad0 0x7f5ca00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca015def0 con 0x7f5ca00b2dc0 2024-04-25T10:14:02.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca015e1b0 con 0x7f5ca006dad0 2024-04-25T10:14:02.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5ca4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca015e490 con 0x7f5ca015b2f0 2024-04-25T10:14:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5c9e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ca006dad0 0x7f5ca00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5c9e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ca006dad0 0x7f5ca00b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46714/0 (socket says 172.21.15.18:46714) 2024-04-25T10:14:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5c9e800640 1 -- 172.21.15.18:0/3625005408 learned_addr learned my addr 172.21.15.18:0/3625005408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:02.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.824+0000 7f5c9de00640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca015b2f0 0x7f5ca00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9e800640 1 -- 172.21.15.18:0/3625005408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca015b2f0 msgr2=0x7f5ca00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:02.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9e800640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca015b2f0 0x7f5ca00b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9e800640 1 -- 172.21.15.18:0/3625005408 >> v1:172.21.15.167:6789/0 conn(0x7f5ca00b2dc0 legacy=0x7f5ca006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9e800640 1 -- 172.21.15.18:0/3625005408 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca015e770 con 0x7f5ca006dad0 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9e800640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00b3780 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009e80 tx=0x7f5c9801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3267b95da644a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9d400640 1 -- 172.21.15.18:0/3625005408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca015b8e0 con 0x7f5ca006dad0 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9d400640 1 -- 172.21.15.18:0/3625005408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c980a58d0 con 0x7f5ca006dad0 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5c9d400640 1 -- 172.21.15.18:0/3625005408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c980a5ca0 con 0x7f5ca006dad0 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5ca4c00640 1 -- 172.21.15.18:0/3625005408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 msgr2=0x7f5ca00b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00b3780 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009e80 tx=0x7f5c9801c9e0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5ca4c00640 1 -- 172.21.15.18:0/3625005408 shutdown_connections 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00b3780 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.828+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/3625005408 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca015b2f0 0x7f5ca00b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- 172.21.15.18:0/3625005408 >> 172.21.15.18:0/3625005408 conn(0x7f5ca00b23b0 msgr2=0x7f5ca00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- 172.21.15.18:0/3625005408 shutdown_connections 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- 172.21.15.18:0/3625005408 wait complete. 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 Processor -- start 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- start start 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca00b2dc0 0x7f5ca01569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ca015b2f0 0x7f5ca0156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca016a880 con 0x7f5ca006dad0 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca01616f0 con 0x7f5ca015b2f0 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca016aa00 con 0x7f5ca00b2dc0 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46724/0 (socket says 172.21.15.18:46724) 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 -- 172.21.15.18:0/2351414469 learned_addr learned my addr 172.21.15.18:0/2351414469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c95400640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca00b2dc0 0x7f5ca01569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9e800640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ca015b2f0 0x7f5ca0156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 -- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca00b2dc0 msgr2=0x7f5ca01569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca00b2dc0 0x7f5ca01569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 -- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ca015b2f0 msgr2=0x7f5ca0156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ca015b2f0 0x7f5ca0156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 -- 172.21.15.18:0/2351414469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca0155220 con 0x7f5ca006dad0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c9de00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e870 tx=0x7f5c9000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90017070 con 0x7f5ca006dad0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9000c940 con 0x7f5ca006dad0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca0155500 con 0x7f5ca006dad0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.832+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9000ccf0 con 0x7f5ca006dad0 2024-04-25T10:14:02.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca0155ac0 con 0x7f5ca006dad0 2024-04-25T10:14:02.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca00745d0 con 0x7f5ca006dad0 2024-04-25T10:14:02.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5c9001a070 con 0x7f5ca006dad0 2024-04-25T10:14:02.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5c96a00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 0x7f5c7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:02.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f5c900855d0 con 0x7f5ca006dad0 2024-04-25T10:14:02.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5c95400640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 0x7f5c7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.836+0000 7f5c95400640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 0x7f5c7c069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0168840 tx=0x7f5c88009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:02.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:02.840+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5c900562d0 con 0x7f5ca006dad0 2024-04-25T10:14:03.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ca00d0ab0 con 0x7f5ca006dad0 2024-04-25T10:14:03.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5c96a00640 1 -- 172.21.15.18:0/2351414469 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17216 (secure 0 0 0) 0x7f5c90055bd0 con 0x7f5ca006dad0 2024-04-25T10:14:03.012 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:03.012 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:01.891757+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6835/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6837/81610203":"2024-04-26T10:13:25.168169+0000","172.21.15.167:6835/81610203":"2024-04-26T10:13:25.168169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:03.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 msgr2=0x7f5c7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 0x7f5c7c069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0168840 tx=0x7f5c88009040 comp rx=0 tx=0).stop 2024-04-25T10:14:03.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 msgr2=0x7f5ca00ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000e870 tx=0x7f5c9000ec70 comp rx=0 tx=0).stop 2024-04-25T10:14:03.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 shutdown_connections 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5ca015b2f0 0x7f5ca0156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5c7c066f60 0x7f5c7c069420 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5ca00b2dc0 0x7f5ca01569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.004+0000 7f5ca4c00640 1 --2- 172.21.15.18:0/2351414469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ca006dad0 0x7f5ca00ad5c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.008+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 >> 172.21.15.18:0/2351414469 conn(0x7f5ca00b23b0 msgr2=0x7f5ca00b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.008+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 shutdown_connections 2024-04-25T10:14:03.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.008+0000 7f5ca4c00640 1 -- 172.21.15.18:0/2351414469 wait complete. 2024-04-25T10:14:03.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:12:37.178779+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:12:37.765414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '108', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:03.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.168+0000 7f6e08200640 1 Processor -- start 2024-04-25T10:14:03.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.168+0000 7f6e08200640 1 -- start start 2024-04-25T10:14:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e08200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e00144120 0x7f6e0015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e08200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0015bc40 con 0x7f6e000ccbf0 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e08200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0015b3a0 con 0x7f6e000b3090 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e08200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0015e490 con 0x7f6e00144120 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e00144120 0x7f6e0015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e04e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6e000ccbf0 0x7f6e0015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54898/0 (socket says 172.21.15.18:54898) 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e04e00640 1 -- 172.21.15.18:0/4222048110 learned_addr learned my addr 172.21.15.18:0/4222048110 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 --2- 172.21.15.18:0/4222048110 >> v2:172.21.15.18:3300/0 conn(0x7f6e00144120 0x7f6e0015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46736/0 (socket says 172.21.15.18:46736) 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 -- 172.21.15.18:0/4222048110 >> v1:172.21.15.167:6789/0 conn(0x7f6e000b3090 legacy=0x7f6e0006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 -- 172.21.15.18:0/4222048110 >> v1:172.21.15.18:6789/0 conn(0x7f6e000ccbf0 legacy=0x7f6e0015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 -- 172.21.15.18:0/4222048110 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0015b680 con 0x7f6e00144120 2024-04-25T10:14:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6e05800640 1 --2- 172.21.15.18:0/4222048110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e00144120 0x7f6e0015acd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009d90 tx=0x7f6df401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93eae75bf67ed61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.172+0000 7f6dffe00640 1 -- 172.21.15.18:0/4222048110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40b2070 con 0x7f6e00144120 2024-04-25T10:14:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6dffe00640 1 -- 172.21.15.18:0/4222048110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df40a5770 con 0x7f6e00144120 2024-04-25T10:14:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6dffe00640 1 -- 172.21.15.18:0/4222048110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df40a5b40 con 0x7f6e00144120 2024-04-25T10:14:03.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- 172.21.15.18:0/4222048110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e00144120 msgr2=0x7f6e0015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 --2- 172.21.15.18:0/4222048110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e00144120 0x7f6e0015acd0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f6df4009d90 tx=0x7f6df401c8a0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- 172.21.15.18:0/4222048110 shutdown_connections 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 --2- 172.21.15.18:0/4222048110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e00144120 0x7f6e0015acd0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- 172.21.15.18:0/4222048110 >> 172.21.15.18:0/4222048110 conn(0x7f6e00067080 msgr2=0x7f6e0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- 172.21.15.18:0/4222048110 shutdown_connections 2024-04-25T10:14:03.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- 172.21.15.18:0/4222048110 wait complete. 2024-04-25T10:14:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 Processor -- start 2024-04-25T10:14:03.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- start start 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 0x7f6e0015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e00144120 0x7f6e000b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0006ec70 con 0x7f6e000ccbf0 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0006eaf0 con 0x7f6e000b3090 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e08200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e000b3520 con 0x7f6e00144120 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e04e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46752/0 (socket says 172.21.15.18:46752) 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e04e00640 1 -- 172.21.15.18:0/456694876 learned_addr learned my addr 172.21.15.18:0/456694876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e05800640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 0x7f6e0015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.176+0000 7f6e06200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e00144120 0x7f6e000b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 -- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e00144120 msgr2=0x7f6e000b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e00144120 0x7f6e000b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 -- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 msgr2=0x7f6e0015a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 0x7f6e0015a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 -- 172.21.15.18:0/456694876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e00164d50 con 0x7f6e000ccbf0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e05800640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 0x7f6e0015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e04e00640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00c450 tx=0x7f6dec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec017070 con 0x7f6e000ccbf0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec005cf0 con 0x7f6e000ccbf0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec007290 con 0x7f6e000ccbf0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e00165030 con 0x7f6e000ccbf0 2024-04-25T10:14:03.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0013ed70 con 0x7f6e000ccbf0 2024-04-25T10:14:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e000745d0 con 0x7f6e000ccbf0 2024-04-25T10:14:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6dec01a070 con 0x7f6e000ccbf0 2024-04-25T10:14:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f6dec084590 con 0x7f6e000ccbf0 2024-04-25T10:14:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.180+0000 7f6e05800640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.184+0000 7f6e05800640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 0x7f6de0069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6df40af000 tx=0x7f6df40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.184+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6dec055330 con 0x7f6e000ccbf0 2024-04-25T10:14:03.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.348+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e0015af60 con 0x7f6e000ccbf0 2024-04-25T10:14:03.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.348+0000 7f6dfd600640 1 -- 172.21.15.18:0/456694876 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dec054c30 con 0x7f6e000ccbf0 2024-04-25T10:14:03.357 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:03.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 msgr2=0x7f6de0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 0x7f6de0069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6df40af000 tx=0x7f6df40a7070 comp rx=0 tx=0).stop 2024-04-25T10:14:03.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 msgr2=0x7f6e0013e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00c450 tx=0x7f6dec00c910 comp rx=0 tx=0).stop 2024-04-25T10:14:03.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 shutdown_connections 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6de0066f60 0x7f6de0069420 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6e00144120 0x7f6e000b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e000ccbf0 0x7f6e0013e830 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 --2- 172.21.15.18:0/456694876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6e000b3090 0x7f6e0015a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 >> 172.21.15.18:0/456694876 conn(0x7f6e00067080 msgr2=0x7f6e0006dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 shutdown_connections 2024-04-25T10:14:03.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.352+0000 7f6e08200640 1 -- 172.21.15.18:0/456694876 wait complete. 2024-04-25T10:14:03.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:14:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 Processor -- start 2024-04-25T10:14:03.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 -- start start 2024-04-25T10:14:03.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcd3815dc60 0x7fcd380d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3815e040 con 0x7fcd3806bf30 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380cff80 con 0x7fcd3809a170 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd3cc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380d0260 con 0x7fcd3815dc60 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd2d400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcd3806bf30 0x7fcd38099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54914/0 (socket says 172.21.15.18:54914) 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd2d400640 1 -- 172.21.15.18:0/3184336499 learned_addr learned my addr 172.21.15.18:0/3184336499 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:03.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35e00640 1 --2- 172.21.15.18:0/3184336499 >> v2:172.21.15.167:3300/0 conn(0x7fcd3815dc60 0x7fcd380d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299645902 0 0) 0x7fcd3815e040 con 0x7fcd3806bf30 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd1c003530 con 0x7fcd3806bf30 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35e00640 1 -- 172.21.15.18:0/3184336499 >> v1:172.21.15.167:6789/0 conn(0x7fcd3809a170 legacy=0x7fcd380cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35e00640 1 -- 172.21.15.18:0/3184336499 >> v1:172.21.15.18:6789/0 conn(0x7fcd3806bf30 legacy=0x7fcd38099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2160855160 0 0) 0x7fcd1c003530 con 0x7fcd3806bf30 2024-04-25T10:14:03.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.516+0000 7fcd35e00640 1 -- 172.21.15.18:0/3184336499 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380d0540 con 0x7fcd3815dc60 2024-04-25T10:14:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd35e00640 1 --2- 172.21.15.18:0/3184336499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3815dc60 0x7fcd380d1020 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2801c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ede7ebec72cc187 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280b2070 con 0x7fcd3815dc60 2024-04-25T10:14:03.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd280a5610 con 0x7fcd3815dc60 2024-04-25T10:14:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd35400640 1 -- 172.21.15.18:0/3184336499 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd20001680 con 0x7fcd3815dc60 2024-04-25T10:14:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 -- 172.21.15.18:0/3184336499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3815dc60 msgr2=0x7fcd380d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/3184336499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3815dc60 0x7fcd380d1020 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009d90 tx=0x7fcd2801c7d0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 -- 172.21.15.18:0/3184336499 shutdown_connections 2024-04-25T10:14:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/3184336499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3815dc60 0x7fcd380d1020 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 -- 172.21.15.18:0/3184336499 >> 172.21.15.18:0/3184336499 conn(0x7fcd380b3200 msgr2=0x7fcd380b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 -- 172.21.15.18:0/3184336499 shutdown_connections 2024-04-25T10:14:03.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.520+0000 7fcd3cc00640 1 -- 172.21.15.18:0/3184336499 wait complete. 2024-04-25T10:14:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 Processor -- start 2024-04-25T10:14:03.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- start start 2024-04-25T10:14:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3809a170 0x7fcd3815b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 0x7fcd3815bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3806cfa0 con 0x7fcd3806bf30 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380cc880 con 0x7fcd3809a170 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380c9640 con 0x7fcd3815dc60 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46764/0 (socket says 172.21.15.18:46764) 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 -- 172.21.15.18:0/2083530020 learned_addr learned my addr 172.21.15.18:0/2083530020 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd2d400640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3809a170 0x7fcd3815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd36800640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 0x7fcd3815bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 -- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 msgr2=0x7fcd3815bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 0x7fcd3815bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 -- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3809a170 msgr2=0x7fcd3815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3809a170 0x7fcd3815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 -- 172.21.15.18:0/2083530020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd381574b0 con 0x7fcd3806bf30 2024-04-25T10:14:03.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd36800640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 0x7fcd3815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd35e00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b0040 tx=0x7fcd28019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280bd020 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd280b3040 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd280b2050 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd38157790 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38157d50 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.524+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd38157f90 con 0x7fcd3806bf30 2024-04-25T10:14:03.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.528+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd280ad650 con 0x7fcd3806bf30 2024-04-25T10:14:03.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.528+0000 7fcd2ea00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 0x7fcd14069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.528+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fcd2811fce0 con 0x7fcd3806bf30 2024-04-25T10:14:03.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.528+0000 7fcd2d400640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 0x7fcd14069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.528+0000 7fcd2d400640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 0x7fcd14069450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd381699f0 tx=0x7fcd20005800 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.532+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd38157f90 con 0x7fcd3806bf30 2024-04-25T10:14:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.696+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd380745d0 con 0x7fcd3806bf30 2024-04-25T10:14:03.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.696+0000 7fcd2ea00640 1 -- 172.21.15.18:0/2083530020 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd280c7020 con 0x7fcd3806bf30 2024-04-25T10:14:03.704 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:14:03.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 msgr2=0x7fcd14069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 0x7fcd14069450 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd381699f0 tx=0x7fcd20005800 comp rx=0 tx=0).stop 2024-04-25T10:14:03.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 msgr2=0x7fcd38152ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b0040 tx=0x7fcd28019570 comp rx=0 tx=0).stop 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 shutdown_connections 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd14066f90 0x7fcd14069450 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd3815dc60 0x7fcd3815bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd3809a170 0x7fcd3815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 --2- 172.21.15.18:0/2083530020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd3806bf30 0x7fcd38152ab0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 >> 172.21.15.18:0/2083530020 conn(0x7fcd380b3200 msgr2=0x7fcd38155470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 shutdown_connections 2024-04-25T10:14:03.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.700+0000 7fcd3cc00640 1 -- 172.21.15.18:0/2083530020 wait complete. 2024-04-25T10:14:03.725 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:14:03.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.860+0000 7f311ae00640 1 Processor -- start 2024-04-25T10:14:03.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.860+0000 7f311ae00640 1 -- start start 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311ae00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f311406c730 0x7f311415ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f3114161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311ae00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311415ef90 con 0x7f3114161ad0 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311ae00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311409a9e0 con 0x7f311406c730 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311409ae70 con 0x7f311406cb10 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f311406c730 0x7f311415ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311a400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3114161ad0 0x7f31140cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54930/0 (socket says 172.21.15.18:54930) 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f311a400640 1 -- 172.21.15.18:0/2658569072 learned_addr learned my addr 172.21.15.18:0/2658569072 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119000640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f3114161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3113e00640 1 -- 172.21.15.18:0/2658569072 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031110273 0 0) 0x7f311415ef90 con 0x7f3114161ad0 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3113e00640 1 -- 172.21.15.18:0/2658569072 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30fc003530 con 0x7f3114161ad0 2024-04-25T10:14:03.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119a00640 1 -- 172.21.15.18:0/2658569072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 msgr2=0x7f3114161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:03.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119a00640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f3114161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119a00640 1 -- 172.21.15.18:0/2658569072 >> v1:172.21.15.18:6789/0 conn(0x7f3114161ad0 legacy=0x7f31140cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.864+0000 7f3119a00640 1 -- 172.21.15.18:0/2658569072 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114099dd0 con 0x7f311406c730 2024-04-25T10:14:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3119a00640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f311415ea50 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f31080097c0 tx=0x7f310801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e50683a48966def server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3113e00640 1 -- 172.21.15.18:0/2658569072 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a7070 con 0x7f311406c730 2024-04-25T10:14:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3113e00640 1 -- 172.21.15.18:0/2658569072 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080b0070 con 0x7f311406c730 2024-04-25T10:14:03.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3113e00640 1 -- 172.21.15.18:0/2658569072 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080ab890 con 0x7f311406c730 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- 172.21.15.18:0/2658569072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 msgr2=0x7f311415ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f311415ea50 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f31080097c0 tx=0x7f310801c470 comp rx=0 tx=0).stop 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- 172.21.15.18:0/2658569072 shutdown_connections 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f3114161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- 172.21.15.18:0/2658569072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f311415ea50 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- 172.21.15.18:0/2658569072 >> 172.21.15.18:0/2658569072 conn(0x7f31140b3030 msgr2=0x7f31140b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- 172.21.15.18:0/2658569072 shutdown_connections 2024-04-25T10:14:03.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- 172.21.15.18:0/2658569072 wait complete. 2024-04-25T10:14:03.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 Processor -- start 2024-04-25T10:14:03.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- start start 2024-04-25T10:14:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f31140b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114161ad0 0x7f31141608a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31141622f0 con 0x7f311406c730 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311415de20 con 0x7f3114161ad0 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f311ae00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3114099a60 con 0x7f311406cb10 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3119a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3119a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46778/0 (socket says 172.21.15.18:46778) 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3119a00640 1 -- 172.21.15.18:0/1964200110 learned_addr learned my addr 172.21.15.18:0/1964200110 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.868+0000 7f3119000640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f31140b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f311a400640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114161ad0 0x7f31141608a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 -- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 msgr2=0x7f31140b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f31140b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 -- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114161ad0 msgr2=0x7f31141608a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114161ad0 0x7f31141608a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:03.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 -- 172.21.15.18:0/1964200110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140b29c0 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119000640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f31140b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119a00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f31080ad040 tx=0x7f310801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080bf610 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31080bf7f0 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080bfbe0 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3114150850 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3114150e10 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31140745d0 con 0x7f311406c730 2024-04-25T10:14:03.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f31080bd020 con 0x7f311406c730 2024-04-25T10:14:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 0x7f30f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:03.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f310811f510 con 0x7f311406c730 2024-04-25T10:14:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.872+0000 7f3119000640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 0x7f30f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:03.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.876+0000 7f3119000640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 0x7f30f4069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f311414d280 tx=0x7f3100008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:03.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:03.876+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f31080c6030 con 0x7f311406c730 2024-04-25T10:14:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.036+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f311406c510 con 0x7f311406c730 2024-04-25T10:14:04.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.036+0000 7f3111600640 1 -- 172.21.15.18:0/1964200110 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3108016090 con 0x7f311406c730 2024-04-25T10:14:04.046 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 msgr2=0x7f30f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 0x7f30f4069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f311414d280 tx=0x7f3100008040 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 msgr2=0x7f3114150200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f31080ad040 tx=0x7f310801acb0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 shutdown_connections 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3114161ad0 0x7f31141608a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f30f4066f60 0x7f30f4069420 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f311406cb10 0x7f31140b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 --2- 172.21.15.18:0/1964200110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f311406c730 0x7f3114150200 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 >> 172.21.15.18:0/1964200110 conn(0x7f31140b3030 msgr2=0x7f3114070830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 shutdown_connections 2024-04-25T10:14:04.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.040+0000 7f311ae00640 1 -- 172.21.15.18:0/1964200110 wait complete. 2024-04-25T10:14:04.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 Processor -- start 2024-04-25T10:14:04.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 -- start start 2024-04-25T10:14:04.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6c38145270 0x7f6c3815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c380cd4d0 0x7f6c380cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c380b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c38145650 con 0x7f6c380cd4d0 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c380b20c0 con 0x7f6c38145270 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c3d400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380cc4e0 con 0x7f6c380b1750 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c2de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c380cd4d0 0x7f6c380cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c2de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c380cd4d0 0x7f6c380cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46794/0 (socket says 172.21.15.18:46794) 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c2de00640 1 -- 172.21.15.18:0/1804039449 learned_addr learned my addr 172.21.15.18:0/1804039449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c36800640 1 --2- 172.21.15.18:0/1804039449 >> v2:172.21.15.167:3300/0 conn(0x7f6c38145270 0x7f6c3815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.200+0000 7f6c37200640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c380b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 -- 172.21.15.18:0/1804039449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 msgr2=0x7f6c380b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c380b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 -- 172.21.15.18:0/1804039449 >> v2:172.21.15.167:3300/0 conn(0x7f6c38145270 msgr2=0x7f6c3815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:04.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 --2- 172.21.15.18:0/1804039449 >> v2:172.21.15.167:3300/0 conn(0x7f6c38145270 0x7f6c3815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 -- 172.21.15.18:0/1804039449 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380ce040 con 0x7f6c380cd4d0 2024-04-25T10:14:04.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c2de00640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c380cd4d0 0x7f6c380cd930 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f6c3806f3a0 tx=0x7f6c2001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517a83653ea84604 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c35e00640 1 -- 172.21.15.18:0/1804039449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200b1070 con 0x7f6c380cd4d0 2024-04-25T10:14:04.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c35e00640 1 -- 172.21.15.18:0/1804039449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c200ac630 con 0x7f6c380cd4d0 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c35e00640 1 -- 172.21.15.18:0/1804039449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200a8050 con 0x7f6c380cd4d0 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 -- 172.21.15.18:0/1804039449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c380cd4d0 msgr2=0x7f6c380cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c380cd4d0 0x7f6c380cd930 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f6c3806f3a0 tx=0x7f6c2001c520 comp rx=0 tx=0).stop 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 -- 172.21.15.18:0/1804039449 shutdown_connections 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c380b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 --2- 172.21.15.18:0/1804039449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c380cd4d0 0x7f6c380cd930 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 --2- 172.21.15.18:0/1804039449 >> v2:172.21.15.167:3300/0 conn(0x7f6c38145270 0x7f6c3815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 -- 172.21.15.18:0/1804039449 >> 172.21.15.18:0/1804039449 conn(0x7f6c38066fa0 msgr2=0x7f6c3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.204+0000 7f6c3d400640 1 -- 172.21.15.18:0/1804039449 shutdown_connections 2024-04-25T10:14:04.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 -- 172.21.15.18:0/1804039449 wait complete. 2024-04-25T10:14:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 Processor -- start 2024-04-25T10:14:04.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 -- start start 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c38133c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c380cd4d0 0x7f6c380ae0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3815c590 con 0x7f6c38145270 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3815f930 con 0x7f6c380cd4d0 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c3d400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3815c710 con 0x7f6c380b1750 2024-04-25T10:14:04.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46802/0 (socket says 172.21.15.18:46802) 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 -- 172.21.15.18:0/3442383161 learned_addr learned my addr 172.21.15.18:0/3442383161 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c36800640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c38133c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c2de00640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c380cd4d0 0x7f6c380ae0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 -- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 msgr2=0x7f6c38133c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c38133c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 -- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c380cd4d0 msgr2=0x7f6c380ae0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c380cd4d0 0x7f6c380ae0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 -- 172.21.15.18:0/3442383161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380ae5f0 con 0x7f6c38145270 2024-04-25T10:14:04.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c37200640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007e90 tx=0x7f6c3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.208+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30014420 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30019070 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c380cbdf0 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30014820 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c38131590 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c380745d0 con 0x7f6c38145270 2024-04-25T10:14:04.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c300149c0 con 0x7f6c38145270 2024-04-25T10:14:04.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c2f400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f6c30085b80 con 0x7f6c38145270 2024-04-25T10:14:04.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.212+0000 7f6c36800640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.216+0000 7f6c36800640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 0x7f6c14069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009a50 tx=0x7f6c28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.216+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c30056910 con 0x7f6c38145270 2024-04-25T10:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c380cdc50 con 0x7f6c38145270 2024-04-25T10:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c2f400640 1 -- 172.21.15.18:0/3442383161 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f6c30056210 con 0x7f6c38145270 2024-04-25T10:14:04.423 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:04.423 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8167,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2314876991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2314876991},{"type":"v1","addr":"172.21.15.167:6837","nonce":2314876991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:14:01.891741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 92 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 msgr2=0x7f6c14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 0x7f6c14069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009a50 tx=0x7f6c28008040 comp rx=0 tx=0).stop 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 msgr2=0x7f6c380cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f6c30007e90 tx=0x7f6c3000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 shutdown_connections 2024-04-25T10:14:04.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c38145270 0x7f6c380cb8b0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c380cd4d0 0x7f6c380ae0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 --2- 172.21.15.18:0/3442383161 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6c380b1750 0x7f6c38133c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 >> 172.21.15.18:0/3442383161 conn(0x7f6c38066fa0 msgr2=0x7f6c380cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 shutdown_connections 2024-04-25T10:14:04.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.416+0000 7f6c3d400640 1 -- 172.21.15.18:0/3442383161 wait complete. 2024-04-25T10:14:04.444 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:04.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.576+0000 7f7ad4600640 1 Processor -- start 2024-04-25T10:14:04.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.576+0000 7f7ad4600640 1 -- start start 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad4600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f7acc0ced60 0x7f7acc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad4600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7acc15ac60 con 0x7f7acc06e900 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad4600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7acc06ed70 con 0x7f7acc0ced60 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0cf3e0 con 0x7f7acc144140 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad2600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7acc06e900 0x7f7acc15e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54938/0 (socket says 172.21.15.18:54938) 2024-04-25T10:14:04.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad2600640 1 -- 172.21.15.18:0/2632191650 learned_addr learned my addr 172.21.15.18:0/2632191650 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:04.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/2632191650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1200640 1 --2- 172.21.15.18:0/2632191650 >> v2:172.21.15.167:3300/0 conn(0x7f7acc0ced60 0x7f7acc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3464416247 0 0) 0x7f7acc15ac60 con 0x7f7acc06e900 2024-04-25T10:14:04.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ab4003530 con 0x7f7acc06e900 2024-04-25T10:14:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1c00640 1 -- 172.21.15.18:0/2632191650 >> v2:172.21.15.167:3300/0 conn(0x7f7acc0ced60 msgr2=0x7f7acc06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3724869857 0 0) 0x7f7ab4003530 con 0x7f7acc06e900 2024-04-25T10:14:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/2632191650 >> v2:172.21.15.167:3300/0 conn(0x7f7acc0ced60 0x7f7acc06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1c00640 1 -- 172.21.15.18:0/2632191650 >> v1:172.21.15.18:6789/0 conn(0x7f7acc06e900 legacy=0x7f7acc15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.580+0000 7f7ad1c00640 1 -- 172.21.15.18:0/2632191650 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc15af20 con 0x7f7acc144140 2024-04-25T10:14:04.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/2632191650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc0ce820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097c0 tx=0x7f7ac001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e18c3691f277f40c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00b0070 con 0x7f7acc144140 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00ab400 con 0x7f7acc144140 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7acbe00640 1 -- 172.21.15.18:0/2632191650 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4001a00 con 0x7f7acc144140 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- 172.21.15.18:0/2632191650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 msgr2=0x7f7acc0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 --2- 172.21.15.18:0/2632191650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc0ce820 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00097c0 tx=0x7f7ac001c3c0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- 172.21.15.18:0/2632191650 shutdown_connections 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 --2- 172.21.15.18:0/2632191650 >> v2:172.21.15.167:3300/0 conn(0x7f7acc0ced60 0x7f7acc06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 --2- 172.21.15.18:0/2632191650 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc0ce820 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- 172.21.15.18:0/2632191650 >> 172.21.15.18:0/2632191650 conn(0x7f7acc066fa0 msgr2=0x7f7acc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- 172.21.15.18:0/2632191650 shutdown_connections 2024-04-25T10:14:04.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- 172.21.15.18:0/2632191650 wait complete. 2024-04-25T10:14:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 Processor -- start 2024-04-25T10:14:04.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.584+0000 7f7ad4600640 1 -- start start 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc06e900 0x7f7acc15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc13ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc144520 con 0x7f7acc0ced60 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc0cf140 con 0x7f7acc06e900 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7acc15ba00 con 0x7f7acc144140 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46814/0 (socket says 172.21.15.18:46814) 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 -- 172.21.15.18:0/820783418 learned_addr learned my addr 172.21.15.18:0/820783418 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc06e900 0x7f7acc15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad2600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc13ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 -- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 msgr2=0x7f7acc13ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc13ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 -- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc06e900 msgr2=0x7f7acc15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc06e900 0x7f7acc15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 -- 172.21.15.18:0/820783418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc1539a0 con 0x7f7acc0ced60 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad1200640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e930 tx=0x7f7ab800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8017070 con 0x7f7acc0ced60 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800ca00 con 0x7f7acc0ced60 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7acc153c80 con 0x7f7acc0ced60 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800cdb0 con 0x7f7acc0ced60 2024-04-25T10:14:04.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc154240 con 0x7f7acc0ced60 2024-04-25T10:14:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.588+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7acc0745d0 con 0x7f7acc0ced60 2024-04-25T10:14:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.592+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7ab801a070 con 0x7f7acc0ced60 2024-04-25T10:14:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.592+0000 7f7ac9600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 0x7f7aac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.592+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f7ab8085740 con 0x7f7acc0ced60 2024-04-25T10:14:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.592+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 0x7f7aac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.592+0000 7f7ad1c00640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 0x7f7aac069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00ad000 tx=0x7f7ac00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.596+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7ab8056500 con 0x7f7acc0ced60 2024-04-25T10:14:04.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7acc073bf0 con 0x7f7acc0ced60 2024-04-25T10:14:04.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ac9600640 1 -- 172.21.15.18:0/820783418 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17216 (secure 0 0 0) 0x7f7ab8055e00 con 0x7f7acc0ced60 2024-04-25T10:14:04.771 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:04.771 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:01.891757+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6835/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6837/81610203":"2024-04-26T10:13:25.168169+0000","172.21.15.167:6835/81610203":"2024-04-26T10:13:25.168169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:04.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 msgr2=0x7f7aac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 0x7f7aac069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f7ac00ad000 tx=0x7f7ac00a6000 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 msgr2=0x7f7acc13bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7ab800e930 tx=0x7f7ab800edf0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 shutdown_connections 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7aac066f60 0x7f7aac069420 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7acc144140 0x7f7acc13ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7acc0ced60 0x7f7acc13bc70 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 --2- 172.21.15.18:0/820783418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7acc06e900 0x7f7acc15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 >> 172.21.15.18:0/820783418 conn(0x7f7acc066fa0 msgr2=0x7f7acc0b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 shutdown_connections 2024-04-25T10:14:04.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.764+0000 7f7ad4600640 1 -- 172.21.15.18:0/820783418 wait complete. 2024-04-25T10:14:04.793 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:14:04.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:04.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 Processor -- start 2024-04-25T10:14:04.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 -- start start 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0344161510 0x7f0344143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03441435c0 0x7f034415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034406d090 con 0x7f0344070fe0 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0344071ad0 con 0x7f03441435c0 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0349a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0344162390 con 0x7f0344161510 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03441435c0 0x7f034415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03441435c0 0x7f034415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46818/0 (socket says 172.21.15.18:46818) 2024-04-25T10:14:04.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 -- 172.21.15.18:0/2282271811 learned_addr learned my addr 172.21.15.18:0/2282271811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f033a000640 1 --2- 172.21.15.18:0/2282271811 >> v2:172.21.15.167:3300/0 conn(0x7f0344161510 0x7f0344143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 -- 172.21.15.18:0/2282271811 >> v2:172.21.15.167:3300/0 conn(0x7f0344161510 msgr2=0x7f0344143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 --2- 172.21.15.18:0/2282271811 >> v2:172.21.15.167:3300/0 conn(0x7f0344161510 0x7f0344143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 -- 172.21.15.18:0/2282271811 >> v1:172.21.15.167:6789/0 conn(0x7f0344070fe0 legacy=0x7f03440713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.928+0000 7f0343400640 1 -- 172.21.15.18:0/2282271811 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0344161af0 con 0x7f03441435c0 2024-04-25T10:14:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0343400640 1 --2- 172.21.15.18:0/2282271811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03441435c0 0x7f034415e550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f034406cd30 tx=0x7f033c01c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa83c077d596ddca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0342000640 1 -- 172.21.15.18:0/2282271811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b0070 con 0x7f03441435c0 2024-04-25T10:14:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0342000640 1 -- 172.21.15.18:0/2282271811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0ab600 con 0x7f03441435c0 2024-04-25T10:14:04.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0342000640 1 -- 172.21.15.18:0/2282271811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0ab9d0 con 0x7f03441435c0 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 -- 172.21.15.18:0/2282271811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03441435c0 msgr2=0x7f034415e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 --2- 172.21.15.18:0/2282271811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03441435c0 0x7f034415e550 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f034406cd30 tx=0x7f033c01c2d0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 -- 172.21.15.18:0/2282271811 shutdown_connections 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 --2- 172.21.15.18:0/2282271811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03441435c0 0x7f034415e550 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 --2- 172.21.15.18:0/2282271811 >> v2:172.21.15.167:3300/0 conn(0x7f0344161510 0x7f0344143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 -- 172.21.15.18:0/2282271811 >> 172.21.15.18:0/2282271811 conn(0x7f03440b3390 msgr2=0x7f03440b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 -- 172.21.15.18:0/2282271811 shutdown_connections 2024-04-25T10:14:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.932+0000 7f0349a00640 1 -- 172.21.15.18:0/2282271811 wait complete. 2024-04-25T10:14:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 Processor -- start 2024-04-25T10:14:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- start start 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0344070fe0 0x7f034413d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03441435c0 0x7f0344141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b06c0 con 0x7f0344161510 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b0540 con 0x7f0344070fe0 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03440b0840 con 0x7f03441435c0 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46824/0 (socket says 172.21.15.18:46824) 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 -- 172.21.15.18:0/3238406432 learned_addr learned my addr 172.21.15.18:0/3238406432 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0342a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0344070fe0 0x7f034413d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f033a000640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03441435c0 0x7f0344141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 -- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03441435c0 msgr2=0x7f0344141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03441435c0 0x7f0344141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 -- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0344070fe0 msgr2=0x7f034413d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0344070fe0 0x7f034413d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 -- 172.21.15.18:0/3238406432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03441fa490 con 0x7f0344161510 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0343400640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f033c0ae040 tx=0x7f033c019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b0040 con 0x7f0344161510 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0b9070 con 0x7f0344161510 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b4640 con 0x7f0344161510 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03441fa700 con 0x7f0344161510 2024-04-25T10:14:04.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03441facc0 con 0x7f0344161510 2024-04-25T10:14:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.936+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03440745d0 con 0x7f0344161510 2024-04-25T10:14:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.940+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f033c0b47e0 con 0x7f0344161510 2024-04-25T10:14:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.940+0000 7f033b400640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 0x7f0320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.940+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f033c11ee60 con 0x7f0344161510 2024-04-25T10:14:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.940+0000 7f0342a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 0x7f0320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.940+0000 7f0342a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 0x7f0320069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:04.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:04.944+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f034406d090 con 0x7f0344161510 2024-04-25T10:14:05.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.140+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03440cef80 con 0x7f0344161510 2024-04-25T10:14:05.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.140+0000 7f033b400640 1 -- 172.21.15.18:0/3238406432 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f033c0ef5a0 con 0x7f0344161510 2024-04-25T10:14:05.148 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:05.148 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8167,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2314876991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2314876991},{"type":"v1","addr":"172.21.15.167:6837","nonce":2314876991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:14:01.891741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:14:05.149 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 92 2024-04-25T10:14:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 msgr2=0x7f0320069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 0x7f0320069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f0334007fd0 tx=0x7f0334007e40 comp rx=0 tx=0).stop 2024-04-25T10:14:05.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 msgr2=0x7f03441423d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f033c0ae040 tx=0x7f033c019070 comp rx=0 tx=0).stop 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 shutdown_connections 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0344161510 0x7f03441423d0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0320066f60 0x7f0320069420 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f03441435c0 0x7f0344141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 --2- 172.21.15.18:0/3238406432 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0344070fe0 0x7f034413d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 >> 172.21.15.18:0/3238406432 conn(0x7f03440b3390 msgr2=0x7f03440ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 shutdown_connections 2024-04-25T10:14:05.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.144+0000 7f0349a00640 1 -- 172.21.15.18:0/3238406432 wait complete. 2024-04-25T10:14:05.169 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 Processor -- start 2024-04-25T10:14:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 -- start start 2024-04-25T10:14:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b1815efa0 0x7f3b18099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b180cdb70 0x7f3b18099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180cd6c0 con 0x7f3b180b04b0 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180b3fe0 con 0x7f3b180cdb70 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b17200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180cce20 con 0x7f3b1815efa0 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b180cdb70 0x7f3b18099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b180cdb70 0x7f3b18099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46832/0 (socket says 172.21.15.18:46832) 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 -- 172.21.15.18:0/4002200167 learned_addr learned my addr 172.21.15.18:0/4002200167 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b15e00640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b1815efa0 0x7f3b18099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 -- 172.21.15.18:0/4002200167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b1815efa0 msgr2=0x7f3b18099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b1815efa0 0x7f3b18099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 -- 172.21.15.18:0/4002200167 >> v1:172.21.15.167:6789/0 conn(0x7f3b180b04b0 legacy=0x7f3b180cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.304+0000 7f3b0d400640 1 -- 172.21.15.18:0/4002200167 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180cd100 con 0x7f3b180cdb70 2024-04-25T10:14:05.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b0d400640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b18099fa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009e50 tx=0x7f3b0001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0109f540690409 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b15400640 1 -- 172.21.15.18:0/4002200167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000a5660 con 0x7f3b180cdb70 2024-04-25T10:14:05.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b15400640 1 -- 172.21.15.18:0/4002200167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b000a5800 con 0x7f3b180cdb70 2024-04-25T10:14:05.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b15400640 1 -- 172.21.15.18:0/4002200167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000a5bd0 con 0x7f3b180cdb70 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 -- 172.21.15.18:0/4002200167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 msgr2=0x7f3b18099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b18099fa0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009e50 tx=0x7f3b0001c9a0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 -- 172.21.15.18:0/4002200167 shutdown_connections 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b18099fa0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 --2- 172.21.15.18:0/4002200167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b1815efa0 0x7f3b18099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 -- 172.21.15.18:0/4002200167 >> 172.21.15.18:0/4002200167 conn(0x7f3b180b3050 msgr2=0x7f3b180b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 -- 172.21.15.18:0/4002200167 shutdown_connections 2024-04-25T10:14:05.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.308+0000 7f3b17200640 1 -- 172.21.15.18:0/4002200167 wait complete. 2024-04-25T10:14:05.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 Processor -- start 2024-04-25T10:14:05.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- start start 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b180b04b0 0x7f3b180cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b1815efa0 0x7f3b180b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b181686a0 con 0x7f3b180cdb70 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180b3dc0 con 0x7f3b1815efa0 2024-04-25T10:14:05.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b18168820 con 0x7f3b180b04b0 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46834/0 (socket says 172.21.15.18:46834) 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 -- 172.21.15.18:0/1305212483 learned_addr learned my addr 172.21.15.18:0/1305212483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b15e00640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b180b04b0 0x7f3b180cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b16800640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b1815efa0 0x7f3b180b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 -- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b180b04b0 msgr2=0x7f3b180cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b180b04b0 0x7f3b180cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 -- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b1815efa0 msgr2=0x7f3b180b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b1815efa0 0x7f3b180b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 -- 172.21.15.18:0/1305212483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180b58e0 con 0x7f3b180cdb70 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0d400640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3b000af040 tx=0x7f3b00019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b000bc020 con 0x7f3b180cdb70 2024-04-25T10:14:05.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b000b86b0 con 0x7f3b180cdb70 2024-04-25T10:14:05.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00009510 con 0x7f3b180cdb70 2024-04-25T10:14:05.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b180cb390 con 0x7f3b180cdb70 2024-04-25T10:14:05.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b180cb950 con 0x7f3b180cdb70 2024-04-25T10:14:05.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.312+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1804efa0 con 0x7f3b180cdb70 2024-04-25T10:14:05.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.316+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b000bf020 con 0x7f3b180cdb70 2024-04-25T10:14:05.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.316+0000 7f3b0ea00640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 0x7f3af4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.316+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f3b00120170 con 0x7f3b180cdb70 2024-04-25T10:14:05.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.316+0000 7f3b15e00640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 0x7f3af4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.316+0000 7f3b15e00640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 0x7f3af4069420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009af0 tx=0x7f3b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.320+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b000c6030 con 0x7f3b180cdb70 2024-04-25T10:14:05.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.516+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b180ae2d0 con 0x7f3b180cdb70 2024-04-25T10:14:05.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b0ea00640 1 -- 172.21.15.18:0/1305212483 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4940 (secure 0 0 0) 0x7f3b00016620 con 0x7f3b180cdb70 2024-04-25T10:14:05.526 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:05.526 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8167,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2314876991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2314876991},{"type":"v1","addr":"172.21.15.167:6837","nonce":2314876991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":91,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:12:38.768098+0000","modified":"2024-04-25T10:14:01.891741+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":113,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T10:14:05.527 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 92 2024-04-25T10:14:05.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 msgr2=0x7f3af4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 0x7f3af4069420 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f3b08009af0 tx=0x7f3b08008040 comp rx=0 tx=0).stop 2024-04-25T10:14:05.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 msgr2=0x7f3b1809b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3b000af040 tx=0x7f3b00019740 comp rx=0 tx=0).stop 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 shutdown_connections 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b1815efa0 0x7f3b180b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b180cdb70 0x7f3b1809b360 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3af4066f60 0x7f3af4069420 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 --2- 172.21.15.18:0/1305212483 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3b180b04b0 0x7f3b180cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 >> 172.21.15.18:0/1305212483 conn(0x7f3b180b3050 msgr2=0x7f3b180ce800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 shutdown_connections 2024-04-25T10:14:05.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.520+0000 7f3b17200640 1 -- 172.21.15.18:0/1305212483 wait complete. 2024-04-25T10:14:05.547 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 Processor -- start 2024-04-25T10:14:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 -- start start 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb43c0cc440 0x7fb43c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c0ce7f0 con 0x7fb43c15b980 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0cfcd0 con 0x7fb43c0cc440 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb443600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0cead0 con 0x7fb43c15b5a0 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb43c0cc440 0x7fb43c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb43c0cc440 0x7fb43c0d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46850/0 (socket says 172.21.15.18:46850) 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 -- 172.21.15.18:0/2548383509 learned_addr learned my addr 172.21.15.18:0/2548383509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb433e00640 1 --1- 172.21.15.18:0/2548383509 >> v1:172.21.15.18:6789/0 conn(0x7fb43c15b980 0x7fb43c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54944/0 (socket says 172.21.15.18:54944) 2024-04-25T10:14:05.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb440c00640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 -- 172.21.15.18:0/2548383509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 msgr2=0x7fb43c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 -- 172.21.15.18:0/2548383509 >> v1:172.21.15.18:6789/0 conn(0x7fb43c15b980 legacy=0x7fb43c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.680+0000 7fb441600640 1 -- 172.21.15.18:0/2548383509 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0cf960 con 0x7fb43c0cc440 2024-04-25T10:14:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb441600640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c0cc440 0x7fb43c0d0160 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb434009e50 tx=0x7fb43401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d32351ee1b2fa08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb43be00640 1 -- 172.21.15.18:0/2548383509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340a5920 con 0x7fb43c0cc440 2024-04-25T10:14:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb43be00640 1 -- 172.21.15.18:0/2548383509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4340a5ac0 con 0x7fb43c0cc440 2024-04-25T10:14:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb43be00640 1 -- 172.21.15.18:0/2548383509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340ad3f0 con 0x7fb43c0cc440 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 -- 172.21.15.18:0/2548383509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c0cc440 msgr2=0x7fb43c0d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c0cc440 0x7fb43c0d0160 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fb434009e50 tx=0x7fb43401ca30 comp rx=0 tx=0).stop 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 -- 172.21.15.18:0/2548383509 shutdown_connections 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c0cc440 0x7fb43c0d0160 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 --2- 172.21.15.18:0/2548383509 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 -- 172.21.15.18:0/2548383509 >> 172.21.15.18:0/2548383509 conn(0x7fb43c0b3390 msgr2=0x7fb43c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 -- 172.21.15.18:0/2548383509 shutdown_connections 2024-04-25T10:14:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.684+0000 7fb443600640 1 -- 172.21.15.18:0/2548383509 wait complete. 2024-04-25T10:14:05.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 Processor -- start 2024-04-25T10:14:05.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- start start 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb43c0cc440 0x7fb43c146400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c1f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0d1240 con 0x7fb43c15b980 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0d10c0 con 0x7fb43c0cc440 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0d13c0 con 0x7fb43c15b5a0 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46858/0 (socket says 172.21.15.18:46858) 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 -- 172.21.15.18:0/1848602085 learned_addr learned my addr 172.21.15.18:0/1848602085 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb433e00640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c1f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb440c00640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb43c0cc440 0x7fb43c146400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 -- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 msgr2=0x7fb43c1f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c1f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 -- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb43c0cc440 msgr2=0x7fb43c146400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb43c0cc440 0x7fb43c146400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 -- 172.21.15.18:0/1848602085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c1491a0 con 0x7fb43c15b980 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb441600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fb4340af040 tx=0x7fb4340197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340bc020 con 0x7fb43c15b980 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4340b8670 con 0x7fb43c15b980 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4340a5920 con 0x7fb43c15b980 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb43c146b70 con 0x7fb43c15b980 2024-04-25T10:14:05.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.688+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c147130 con 0x7fb43c15b980 2024-04-25T10:14:05.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c0745d0 con 0x7fb43c15b980 2024-04-25T10:14:05.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb4340bf020 con 0x7fb43c15b980 2024-04-25T10:14:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb439600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 0x7fb418069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fb4341205f0 con 0x7fb43c15b980 2024-04-25T10:14:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb440c00640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 0x7fb418069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.692+0000 7fb440c00640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 0x7fb418069450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b9d0 tx=0x7fb42c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:05.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.696+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb4340c6070 con 0x7fb43c15b980 2024-04-25T10:14:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.856+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb43c0cc960 con 0x7fb43c15b980 2024-04-25T10:14:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb439600640 1 -- 172.21.15.18:0/1848602085 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+17216 (secure 0 0 0) 0x7fb434016620 con 0x7fb43c15b980 2024-04-25T10:14:05.867 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:05.867 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:01.891757+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:12:37.178779+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T10:12:37.765414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"108","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.1","mappings":[{"from":1,"to":7}]},{"pgid":"16.2f","mappings":[{"from":5,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6835/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6837/81610203":"2024-04-26T10:13:25.168169+0000","172.21.15.167:6835/81610203":"2024-04-26T10:13:25.168169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 msgr2=0x7fb418069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 0x7fb418069450 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fb42c00b9d0 tx=0x7fb42c008040 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 msgr2=0x7fb43c0b2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fb4340af040 tx=0x7fb4340197d0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 shutdown_connections 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb43c15b980 0x7fb43c0b2350 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb418066f90 0x7fb418069450 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb43c15b5a0 0x7fb43c1f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 --2- 172.21.15.18:0/1848602085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb43c0cc440 0x7fb43c146400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 >> 172.21.15.18:0/1848602085 conn(0x7fb43c0b3390 msgr2=0x7fb43c0b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 shutdown_connections 2024-04-25T10:14:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:05.860+0000 7fb443600640 1 -- 172.21.15.18:0/1848602085 wait complete. 2024-04-25T10:14:05.889 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:14:06.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 Processor -- start 2024-04-25T10:14:06.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 -- start start 2024-04-25T10:14:06.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9b84161570 0x7f9b840b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b84162470 con 0x7f9b840b0ef0 2024-04-25T10:14:06.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8406c860 con 0x7f9b84162060 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b89000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8406d100 con 0x7f9b84161570 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b7be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9b840b0ef0 0x7f9b84161950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54946/0 (socket says 172.21.15.18:54946) 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b7be00640 1 -- 172.21.15.18:0/4028648566 learned_addr learned my addr 172.21.15.18:0/4028648566 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b83400640 1 --2- 172.21.15.18:0/4028648566 >> v2:172.21.15.167:3300/0 conn(0x7f9b84161570 0x7f9b840b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481170404 0 0) 0x7f9b84162470 con 0x7f9b840b0ef0 2024-04-25T10:14:06.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b68003530 con 0x7f9b840b0ef0 2024-04-25T10:14:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964049860 0 0) 0x7f9b8406c860 con 0x7f9b84162060 2024-04-25T10:14:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b84162470 con 0x7f9b84162060 2024-04-25T10:14:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182051377 0 0) 0x7f9b68003530 con 0x7f9b840b0ef0 2024-04-25T10:14:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 >> v2:172.21.15.167:3300/0 conn(0x7f9b84161570 msgr2=0x7f9b840b22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:06.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 --2- 172.21.15.18:0/4028648566 >> v2:172.21.15.167:3300/0 conn(0x7f9b84161570 0x7f9b840b22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 >> v1:172.21.15.167:6789/0 conn(0x7f9b84162060 legacy=0x7f9b840d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8406cb40 con 0x7f9b840b0ef0 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f9b6c001680 con 0x7f9b840b0ef0 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 >> v1:172.21.15.18:6789/0 conn(0x7f9b840b0ef0 legacy=0x7f9b84161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b68003b50 0x7f9b68003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 0x7f9b68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b680051d0 0x7f9b6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6800c020 con 0x7f9b68004810 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6800c1d0 con 0x7f9b680051d0 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6800c3d0 con 0x7f9b68003b50 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b7be00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 0x7f9b68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.024+0000 7f9b83400640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b68003b50 0x7f9b68003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b83e00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b680051d0 0x7f9b6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 -- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b68003b50 msgr2=0x7f9b68003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b68003b50 0x7f9b68003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 -- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b680051d0 msgr2=0x7f9b6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b680051d0 0x7f9b6800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 -- 172.21.15.18:0/4028648566 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68003530 con 0x7f9b68004810 2024-04-25T10:14:06.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b83e00640 1 -- 172.21.15.18:0/4028648566 reap_dead start 2024-04-25T10:14:06.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b7be00640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 0x7f9b68004c90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c190 tx=0x7f9b6c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e52f852790ec293 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c007cd0 con 0x7f9b68004810 2024-04-25T10:14:06.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c0a9020 con 0x7f9b68004810 2024-04-25T10:14:06.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b82a00640 1 -- 172.21.15.18:0/4028648566 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0a5b00 con 0x7f9b68004810 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b89000640 1 -- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 msgr2=0x7f9b68004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b89000640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 0x7f9b68004c90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00c190 tx=0x7f9b6c01cc00 comp rx=0 tx=0).stop 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b89000640 1 -- 172.21.15.18:0/4028648566 shutdown_connections 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b89000640 1 --2- 172.21.15.18:0/4028648566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b68004810 0x7f9b68004c90 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.028+0000 7f9b89000640 1 -- 172.21.15.18:0/4028648566 >> 172.21.15.18:0/4028648566 conn(0x7f9b840d1640 msgr2=0x7f9b840d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- 172.21.15.18:0/4028648566 shutdown_connections 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- 172.21.15.18:0/4028648566 wait complete. 2024-04-25T10:14:06.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 Processor -- start 2024-04-25T10:14:06.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- start start 2024-04-25T10:14:06.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 0x7f9b84151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b840b5c70 0x7f9b840b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840cf7b0 con 0x7f9b840c5170 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840cfb00 con 0x7f9b68004810 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b840b2b70 con 0x7f9b840b5c70 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46864/0 (socket says 172.21.15.18:46864) 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 -- 172.21.15.18:0/3555641755 learned_addr learned my addr 172.21.15.18:0/3555641755 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b83400640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 0x7f9b84151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b83e00640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b840b5c70 0x7f9b840b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 -- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b840b5c70 msgr2=0x7f9b840b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b840b5c70 0x7f9b840b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 -- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 msgr2=0x7f9b84151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 0x7f9b84151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 -- 172.21.15.18:0/3555641755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b840b69b0 con 0x7f9b840c5170 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b83400640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 0x7f9b84151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7be00640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0ab040 tx=0x7f9b68005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0049f0 con 0x7f9b840c5170 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c0b2070 con 0x7f9b840c5170 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c004db0 con 0x7f9b840c5170 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.032+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8414f6a0 con 0x7f9b840c5170 2024-04-25T10:14:06.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b841522d0 con 0x7f9b840c5170 2024-04-25T10:14:06.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b840745d0 con 0x7f9b840c5170 2024-04-25T10:14:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9b6c0ae430 con 0x7f9b840c5170 2024-04-25T10:14:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b7b400640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 0x7f9b60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f9b6c11eaf0 con 0x7f9b840c5170 2024-04-25T10:14:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b83400640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 0x7f9b60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.036+0000 7f9b83400640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 0x7f9b60069420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009b80 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.040+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9b6c016910 con 0x7f9b840c5170 2024-04-25T10:14:06.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.236+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9b840d0e80 con 0x7f9b840c5170 2024-04-25T10:14:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.304+0000 7f9b7b400640 1 -- 172.21.15.18:0/3555641755 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v93) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9b6c0ef7f0 con 0x7f9b840c5170 2024-04-25T10:14:06.312 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:14:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 msgr2=0x7f9b60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 0x7f9b60069420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f9b74009b80 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2024-04-25T10:14:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 msgr2=0x7f9b840c55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c0ab040 tx=0x7f9b68005840 comp rx=0 tx=0).stop 2024-04-25T10:14:06.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 shutdown_connections 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9b60066f60 0x7f9b60069420 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9b840b5c70 0x7f9b840b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9b840c5170 0x7f9b840c55f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 --2- 172.21.15.18:0/3555641755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b68004810 0x7f9b84151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 >> 172.21.15.18:0/3555641755 conn(0x7f9b840d1640 msgr2=0x7f9b840707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 shutdown_connections 2024-04-25T10:14:06.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.308+0000 7f9b89000640 1 -- 172.21.15.18:0/3555641755 wait complete. 2024-04-25T10:14:06.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:14:06.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 Processor -- start 2024-04-25T10:14:06.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 -- start start 2024-04-25T10:14:06.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f118c15acd0 0x7f118c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c15bc40 con 0x7f118c144120 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c15b3a0 con 0x7f118c15ee60 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1190c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c15e490 con 0x7f118c15acd0 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1189e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f118c144120 0x7f118c0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54950/0 (socket says 172.21.15.18:54950) 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1189e00640 1 -- 172.21.15.18:0/2119573678 learned_addr learned my addr 172.21.15.18:0/2119573678 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1181400640 1 --2- 172.21.15.18:0/2119573678 >> v2:172.21.15.18:3300/0 conn(0x7f118c15acd0 0x7f118c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1189400640 1 -- 172.21.15.18:0/2119573678 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590444507 0 0) 0x7f118c15bc40 con 0x7f118c144120 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1181400640 1 -- 172.21.15.18:0/2119573678 >> v1:172.21.15.167:6789/0 conn(0x7f118c15ee60 legacy=0x7f118c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1181400640 1 -- 172.21.15.18:0/2119573678 >> v1:172.21.15.18:6789/0 conn(0x7f118c144120 legacy=0x7f118c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.472+0000 7f1181400640 1 -- 172.21.15.18:0/2119573678 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c15b680 con 0x7f118c15acd0 2024-04-25T10:14:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1181400640 1 --2- 172.21.15.18:0/2119573678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15e920 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f11740097c0 tx=0x7f117401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cc067dec4e6975 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1189400640 1 -- 172.21.15.18:0/2119573678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740b0070 con 0x7f118c15acd0 2024-04-25T10:14:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1189400640 1 -- 172.21.15.18:0/2119573678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740ab600 con 0x7f118c15acd0 2024-04-25T10:14:06.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1189400640 1 -- 172.21.15.18:0/2119573678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740ab9d0 con 0x7f118c15acd0 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- 172.21.15.18:0/2119573678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 msgr2=0x7f118c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 --2- 172.21.15.18:0/2119573678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15e920 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f11740097c0 tx=0x7f117401c410 comp rx=0 tx=0).stop 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- 172.21.15.18:0/2119573678 shutdown_connections 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 --2- 172.21.15.18:0/2119573678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15e920 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- 172.21.15.18:0/2119573678 >> 172.21.15.18:0/2119573678 conn(0x7f118c067080 msgr2=0x7f118c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- 172.21.15.18:0/2119573678 shutdown_connections 2024-04-25T10:14:06.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- 172.21.15.18:0/2119573678 wait complete. 2024-04-25T10:14:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 Processor -- start 2024-04-25T10:14:06.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.476+0000 7f1190c00640 1 -- start start 2024-04-25T10:14:06.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f118c144120 0x7f118c13a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 0x7f118c1430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c168660 con 0x7f118c15acd0 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c15b150 con 0x7f118c15ee60 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c1687e0 con 0x7f118c144120 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46878/0 (socket says 172.21.15.18:46878) 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 -- 172.21.15.18:0/1205193954 learned_addr learned my addr 172.21.15.18:0/1205193954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:06.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1189e00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f118c144120 0x7f118c13a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f118a800640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 0x7f118c1430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 -- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f118c144120 msgr2=0x7f118c13a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f118c144120 0x7f118c13a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 -- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 msgr2=0x7f118c1430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 0x7f118c1430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 -- 172.21.15.18:0/1205193954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c0a8830 con 0x7f118c15acd0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f118a800640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 0x7f118c1430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1181400640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f11740ae040 tx=0x7f117401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740b0050 con 0x7f118c15acd0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11740bc070 con 0x7f118c15acd0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0a8b10 con 0x7f118c15acd0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11740b5a50 con 0x7f118c15acd0 2024-04-25T10:14:06.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c0a90d0 con 0x7f118c15acd0 2024-04-25T10:14:06.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c0745d0 con 0x7f118c15acd0 2024-04-25T10:14:06.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.480+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f11740ab4a0 con 0x7f118c15acd0 2024-04-25T10:14:06.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.484+0000 7f1182a00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:06.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.484+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f117411fba0 con 0x7f118c15acd0 2024-04-25T10:14:06.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.484+0000 7f1189e00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:06.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.484+0000 7f1189e00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 0x7f1168069420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f117c007fd0 tx=0x7f117c007ba0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:06.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.488+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1174016090 con 0x7f118c15acd0 2024-04-25T10:14:06.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:06.684+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f118c0cc310 con 0x7f118c15acd0 2024-04-25T10:14:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1182a00640 1 -- 172.21.15.18:0/1205193954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11740f08a0 con 0x7f118c15acd0 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 msgr2=0x7f1168069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 0x7f1168069420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f117c007fd0 tx=0x7f117c007ba0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 msgr2=0x7f118c15bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f11740ae040 tx=0x7f117401ac50 comp rx=0 tx=0).stop 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 shutdown_connections 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f118c15ee60 0x7f118c1430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f118c15acd0 0x7f118c15bba0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1168066f60 0x7f1168069420 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 --2- 172.21.15.18:0/1205193954 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f118c144120 0x7f118c13a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 >> 172.21.15.18:0/1205193954 conn(0x7f118c067080 msgr2=0x7f118c0b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 shutdown_connections 2024-04-25T10:14:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.312+0000 7f1190c00640 1 -- 172.21.15.18:0/1205193954 wait complete. 2024-04-25T10:14:07.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:14:07.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 Processor -- start 2024-04-25T10:14:07.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 -- start start 2024-04-25T10:14:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fceec0c60a0 0x7fceec1676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceec0c6dc0 con 0x7fceec0ce1c0 2024-04-25T10:14:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceec0d0430 con 0x7fceec0c60a0 2024-04-25T10:14:07.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fcef2200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec0c70a0 con 0x7fceec15dd00 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceebe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fceec0c60a0 0x7fceec1676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:33500/0 (socket says 172.21.15.18:33500) 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 -- 172.21.15.18:0/1786517701 learned_addr learned my addr 172.21.15.18:0/1786517701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 -- 172.21.15.18:0/1786517701 >> v2:172.21.15.167:3300/0 conn(0x7fceec0c60a0 msgr2=0x7fceec1676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:07.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 --2- 172.21.15.18:0/1786517701 >> v2:172.21.15.167:3300/0 conn(0x7fceec0c60a0 0x7fceec1676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 -- 172.21.15.18:0/1786517701 >> v1:172.21.15.167:6789/0 conn(0x7fceec0ce1c0 legacy=0x7fceec0c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.488+0000 7fceeb400640 1 -- 172.21.15.18:0/1786517701 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec0c7380 con 0x7fceec15dd00 2024-04-25T10:14:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fceeb400640 1 --2- 172.21.15.18:0/1786517701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d1c49c8e41b688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:07.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fceeaa00640 1 -- 172.21.15.18:0/1786517701 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0a7070 con 0x7fceec15dd00 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fceeaa00640 1 -- 172.21.15.18:0/1786517701 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0b0070 con 0x7fceec15dd00 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fceeaa00640 1 -- 172.21.15.18:0/1786517701 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0ab890 con 0x7fceec15dd00 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- 172.21.15.18:0/1786517701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 msgr2=0x7fceec0af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 --2- 172.21.15.18:0/1786517701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009870 tx=0x7fcedc01c560 comp rx=0 tx=0).stop 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- 172.21.15.18:0/1786517701 shutdown_connections 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 --2- 172.21.15.18:0/1786517701 >> v2:172.21.15.167:3300/0 conn(0x7fceec0c60a0 0x7fceec1676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 --2- 172.21.15.18:0/1786517701 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec15dd00 0x7fceec0af860 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- 172.21.15.18:0/1786517701 >> 172.21.15.18:0/1786517701 conn(0x7fceec0b2240 msgr2=0x7fceec0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- 172.21.15.18:0/1786517701 shutdown_connections 2024-04-25T10:14:07.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- 172.21.15.18:0/1786517701 wait complete. 2024-04-25T10:14:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 Processor -- start 2024-04-25T10:14:07.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.492+0000 7fcef2200640 1 -- start start 2024-04-25T10:14:07.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec0ce1c0 0x7fceec09d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 0x7fceec152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec16a7c0 con 0x7fceec0c60a0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceec16a640 con 0x7fceec0b14f0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceec16a940 con 0x7fceec0ce1c0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46890/0 (socket says 172.21.15.18:46890) 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 -- 172.21.15.18:0/1202643223 learned_addr learned my addr 172.21.15.18:0/1202643223 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceebe00640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 0x7fceec152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcee3e00640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec0ce1c0 0x7fceec09d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 -- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec0ce1c0 msgr2=0x7fceec09d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec0ce1c0 0x7fceec09d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 -- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 msgr2=0x7fceec152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 0x7fceec152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 -- 172.21.15.18:0/1202643223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec09df00 con 0x7fceec0c60a0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceebe00640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 0x7fceec152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fceeb400640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0ad040 tx=0x7fcedc019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0bf610 con 0x7fceec0c60a0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcedc0bf7d0 con 0x7fceec0c60a0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcedc0bfbc0 con 0x7fceec0c60a0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceec09e1a0 con 0x7fceec0c60a0 2024-04-25T10:14:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceec154b30 con 0x7fceec0c60a0 2024-04-25T10:14:07.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.496+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceec09e6c0 con 0x7fceec0c60a0 2024-04-25T10:14:07.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.500+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcedc0bd020 con 0x7fceec0c60a0 2024-04-25T10:14:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.500+0000 7fcee3400640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 0x7fcec8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.500+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fcedc11f9d0 con 0x7fceec0c60a0 2024-04-25T10:14:07.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.500+0000 7fcee3e00640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 0x7fcec8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:07.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.500+0000 7fcee3e00640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 0x7fcec8069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fceec0c6c10 tx=0x7fced4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:07.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.504+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fceec09e6c0 con 0x7fceec0c60a0 2024-04-25T10:14:07.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:07.668+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fceec0745d0 con 0x7fceec0c60a0 2024-04-25T10:14:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.316+0000 7fcee3400640 1 -- 172.21.15.18:0/1202643223 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v114) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcedc016150 con 0x7fceec0c60a0 2024-04-25T10:14:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 msgr2=0x7fcec8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 0x7fcec8069420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fceec0c6c10 tx=0x7fced4009040 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 msgr2=0x7fceec09b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0ad040 tx=0x7fcedc019300 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 shutdown_connections 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fceec0b14f0 0x7fceec152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcec8066f60 0x7fcec8069420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fceec0ce1c0 0x7fceec09d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 --2- 172.21.15.18:0/1202643223 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fceec0c60a0 0x7fceec09b5e0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 >> 172.21.15.18:0/1202643223 conn(0x7fceec0b2240 msgr2=0x7fceec0cefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 shutdown_connections 2024-04-25T10:14:08.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.320+0000 7fcef2200640 1 -- 172.21.15.18:0/1202643223 wait complete. 2024-04-25T10:14:08.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:14:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.492+0000 7f55cfc00640 1 Processor -- start 2024-04-25T10:14:08.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.492+0000 7f55cfc00640 1 -- start start 2024-04-25T10:14:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cfc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55c8071b70 0x7f55c8066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cfc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c806b990 con 0x7f55c8071f50 2024-04-25T10:14:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cfc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c806bc70 con 0x7f55c806f350 2024-04-25T10:14:08.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cfc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c806f730 con 0x7f55c8071b70 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55c8071b70 0x7f55c8066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55c8071b70 0x7f55c8066b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46902/0 (socket says 172.21.15.18:46902) 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55c7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f55c8071f50 0x7f55c80ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54956/0 (socket says 172.21.15.18:54956) 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 -- 172.21.15.18:0/686991656 learned_addr learned my addr 172.21.15.18:0/686991656 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 -- 172.21.15.18:0/686991656 >> v1:172.21.15.167:6789/0 conn(0x7f55c806f350 legacy=0x7f55c80cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 -- 172.21.15.18:0/686991656 >> v1:172.21.15.18:6789/0 conn(0x7f55c8071f50 legacy=0x7f55c80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55cd200640 1 -- 172.21.15.18:0/686991656 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c806bf50 con 0x7f55c8071b70 2024-04-25T10:14:08.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.496+0000 7f55c7400640 1 -- 172.21.15.18:0/686991656 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 202380656 0 0) 0x7f55c806b990 con 0x7f55c8071f50 2024-04-25T10:14:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cd200640 1 --2- 172.21.15.18:0/686991656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c8071b70 0x7f55c8066b50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009870 tx=0x7f55bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1596b9965eb17eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55c7400640 1 -- 172.21.15.18:0/686991656 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0b0070 con 0x7f55c8071b70 2024-04-25T10:14:08.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55c7400640 1 -- 172.21.15.18:0/686991656 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc0ab600 con 0x7f55c8071b70 2024-04-25T10:14:08.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55c7400640 1 -- 172.21.15.18:0/686991656 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0ab9d0 con 0x7f55c8071b70 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- 172.21.15.18:0/686991656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c8071b70 msgr2=0x7f55c8066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 --2- 172.21.15.18:0/686991656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c8071b70 0x7f55c8066b50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f55bc009870 tx=0x7f55bc01c520 comp rx=0 tx=0).stop 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- 172.21.15.18:0/686991656 shutdown_connections 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 --2- 172.21.15.18:0/686991656 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c8071b70 0x7f55c8066b50 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- 172.21.15.18:0/686991656 >> 172.21.15.18:0/686991656 conn(0x7f55c80cfd80 msgr2=0x7f55c80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- 172.21.15.18:0/686991656 shutdown_connections 2024-04-25T10:14:08.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- 172.21.15.18:0/686991656 wait complete. 2024-04-25T10:14:08.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 Processor -- start 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.500+0000 7f55cfc00640 1 -- start start 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55c8071b70 0x7f55c81604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55c8071f50 0x7f55c8160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c806b5e0 con 0x7f55c806f350 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80b4d00 con 0x7f55c8071b70 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8152fa0 con 0x7f55c8071f50 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:08.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46906/0 (socket says 172.21.15.18:46906) 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 -- 172.21.15.18:0/501630641 learned_addr learned my addr 172.21.15.18:0/501630641 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55c7e00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55c8071b70 0x7f55c81604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cdc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55c8071f50 0x7f55c8160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 -- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55c8071f50 msgr2=0x7f55c8160a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55c8071f50 0x7f55c8160a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 -- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55c8071b70 msgr2=0x7f55c81604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55c8071b70 0x7f55c81604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:08.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 -- 172.21.15.18:0/501630641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8152670 con 0x7f55c806f350 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cd200640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0ae040 tx=0x7f55bc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0b0040 con 0x7f55c806f350 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc004020 con 0x7f55c806f350 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc0043f0 con 0x7f55c806f350 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c8152950 con 0x7f55c806f350 2024-04-25T10:14:08.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8160f40 con 0x7f55c806f350 2024-04-25T10:14:08.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c80745d0 con 0x7f55c806f350 2024-04-25T10:14:08.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.504+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55bc0bf060 con 0x7f55c806f350 2024-04-25T10:14:08.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.508+0000 7f55c4c00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 0x7f55a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:08.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.508+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5893+0+0 (secure 0 0 0) 0x7f55bc11e8f0 con 0x7f55c806f350 2024-04-25T10:14:08.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.508+0000 7f55c7e00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 0x7f55a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:08.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.508+0000 7f55c7e00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 0x7f55a8069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f55c81fa3c0 tx=0x7f55b4007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:08.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.508+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f55bc016110 con 0x7f55c806f350 2024-04-25T10:14:08.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:08.680+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55c815d540 con 0x7f55c806f350 2024-04-25T10:14:09.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.320+0000 7f55c4c00640 1 -- 172.21.15.18:0/501630641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v115) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55bc0c03b0 con 0x7f55c806f350 2024-04-25T10:14:09.326 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:14:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 msgr2=0x7f55a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 0x7f55a8069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f55c81fa3c0 tx=0x7f55b4007b60 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 msgr2=0x7f55c80b2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f55bc0ae040 tx=0x7f55bc01ad60 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 shutdown_connections 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f55a8066f60 0x7f55a8069420 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55c8071f50 0x7f55c8160a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55c8071b70 0x7f55c81604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 --2- 172.21.15.18:0/501630641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55c806f350 0x7f55c80b2e20 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 >> 172.21.15.18:0/501630641 conn(0x7f55c80cfd80 msgr2=0x7f55c80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 shutdown_connections 2024-04-25T10:14:09.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.324+0000 7f55cfc00640 1 -- 172.21.15.18:0/501630641 wait complete. 2024-04-25T10:14:09.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:14:09.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.492+0000 7f0b30600640 1 Processor -- start 2024-04-25T10:14:09.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.492+0000 7f0b30600640 1 -- start start 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b30600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b28159320 0x7f0b2815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b30600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 0x7f0b2806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b30600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2815fc00 con 0x7f0b2815f440 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b30600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2806d640 con 0x7f0b28159320 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b30600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b2806ee10 con 0x7f0b2806e4a0 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b28159320 0x7f0b2815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2d200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0b2815f440 0x7f0b2806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54964/0 (socket says 172.21.15.18:54964) 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2d200640 1 -- 172.21.15.18:0/1595460821 learned_addr learned my addr 172.21.15.18:0/1595460821 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0b28159320 0x7f0b2815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46908/0 (socket says 172.21.15.18:46908) 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2e600640 1 --2- 172.21.15.18:0/1595460821 >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 0x7f0b2806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 -- 172.21.15.18:0/1595460821 >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 msgr2=0x7f0b2806e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/1595460821 >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 0x7f0b2806e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 -- 172.21.15.18:0/1595460821 >> v1:172.21.15.18:6789/0 conn(0x7f0b2815f440 legacy=0x7f0b2806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b27e00640 1 -- 172.21.15.18:0/1595460821 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312816225 0 0) 0x7f0b2815fc00 con 0x7f0b2815f440 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2dc00640 1 -- 172.21.15.18:0/1595460821 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2815fee0 con 0x7f0b28159320 2024-04-25T10:14:09.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.496+0000 7f0b2e600640 1 --2- 172.21.15.18:0/1595460821 >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 0x7f0b2806e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/1595460821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b2815c9b0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f0b28072630 tx=0x7f0b1c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7124d8d38f9ca3f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b27e00640 1 -- 172.21.15.18:0/1595460821 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0b1070 con 0x7f0b28159320 2024-04-25T10:14:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b27e00640 1 -- 172.21.15.18:0/1595460821 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c0ac620 con 0x7f0b28159320 2024-04-25T10:14:09.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b27e00640 1 -- 172.21.15.18:0/1595460821 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0ac9f0 con 0x7f0b28159320 2024-04-25T10:14:09.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- 172.21.15.18:0/1595460821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 msgr2=0x7f0b2815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- 172.21.15.18:0/1595460821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b2815c9b0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f0b28072630 tx=0x7f0b1c01c3c0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- 172.21.15.18:0/1595460821 shutdown_connections 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- 172.21.15.18:0/1595460821 >> v2:172.21.15.167:3300/0 conn(0x7f0b2806e4a0 0x7f0b2806e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- 172.21.15.18:0/1595460821 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b2815c9b0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- 172.21.15.18:0/1595460821 >> 172.21.15.18:0/1595460821 conn(0x7f0b28067080 msgr2=0x7f0b2806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- 172.21.15.18:0/1595460821 shutdown_connections 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- 172.21.15.18:0/1595460821 wait complete. 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 Processor -- start 2024-04-25T10:14:09.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- start start 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 0x7f0b281f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b2815f440 0x7f0b2813a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2815f860 con 0x7f0b28159320 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b28159700 con 0x7f0b2806e4a0 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.500+0000 7f0b30600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2815f9e0 con 0x7f0b2815f440 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46914/0 (socket says 172.21.15.18:46914) 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 -- 172.21.15.18:0/4081956971 learned_addr learned my addr 172.21.15.18:0/4081956971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 0x7f0b281f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2e600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b2815f440 0x7f0b2813a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 -- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b2815f440 msgr2=0x7f0b2813a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b2815f440 0x7f0b2813a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 -- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 msgr2=0x7f0b281f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 0x7f0b281f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 -- 172.21.15.18:0/4081956971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b28138cd0 con 0x7f0b28159320 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 0x7f0b281f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b2d200640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c520 tx=0x7f0b1400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b14018070 con 0x7f0b28159320 2024-04-25T10:14:09.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b140074e0 con 0x7f0b28159320 2024-04-25T10:14:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b140049f0 con 0x7f0b28159320 2024-04-25T10:14:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b28138fb0 con 0x7f0b28159320 2024-04-25T10:14:09.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2813f050 con 0x7f0b28159320 2024-04-25T10:14:09.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b280745d0 con 0x7f0b28159320 2024-04-25T10:14:09.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.504+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b14004b90 con 0x7f0b28159320 2024-04-25T10:14:09.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.508+0000 7f0b25600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 0x7f0b08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.508+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f0b140841e0 con 0x7f0b28159320 2024-04-25T10:14:09.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.508+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 0x7f0b08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.508+0000 7f0b2dc00640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 0x7f0b08069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ae000 tx=0x7f0b1c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.512+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b14054cb0 con 0x7f0b28159320 2024-04-25T10:14:09.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.672+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0b2815ed10 con 0x7f0b28159320 2024-04-25T10:14:09.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.676+0000 7f0b25600640 1 -- 172.21.15.18:0/4081956971 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0b14058d50 con 0x7f0b28159320 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 msgr2=0x7f0b08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 0x7f0b08069420 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c0ae000 tx=0x7f0b1c0a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 msgr2=0x7f0b28157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f0b1400c520 tx=0x7f0b1400c9e0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 shutdown_connections 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0b08066f60 0x7f0b08069420 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0b2815f440 0x7f0b2813a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0b28159320 0x7f0b28157960 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 --2- 172.21.15.18:0/4081956971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b2806e4a0 0x7f0b281f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 >> 172.21.15.18:0/4081956971 conn(0x7f0b28067080 msgr2=0x7f0b2815d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 shutdown_connections 2024-04-25T10:14:09.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.680+0000 7f0b30600640 1 -- 172.21.15.18:0/4081956971 wait complete. 2024-04-25T10:14:09.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T10:14:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 Processor -- start 2024-04-25T10:14:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 -- start start 2024-04-25T10:14:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5aac1450f0 0x7f5aac0b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac1454d0 con 0x7f5aac0b3900 2024-04-25T10:14:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac0b4a20 con 0x7f5aac1450f0 2024-04-25T10:14:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0b3e10 con 0x7f5aac06b320 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5aabe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f5aac1450f0 0x7f5aac0b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:33538/0 (socket says 172.21.15.18:33538) 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 -- 172.21.15.18:0/3011209214 learned_addr learned my addr 172.21.15.18:0/3011209214 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 -- 172.21.15.18:0/3011209214 >> v2:172.21.15.167:3300/0 conn(0x7f5aac1450f0 msgr2=0x7f5aac0b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 --2- 172.21.15.18:0/3011209214 >> v2:172.21.15.167:3300/0 conn(0x7f5aac1450f0 0x7f5aac0b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 -- 172.21.15.18:0/3011209214 >> v1:172.21.15.167:6789/0 conn(0x7f5aac0b3900 legacy=0x7f5aac06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.864+0000 7f5ab1000640 1 -- 172.21.15.18:0/3011209214 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac0b40f0 con 0x7f5aac06b320 2024-04-25T10:14:09.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1000640 1 --2- 172.21.15.18:0/3011209214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009870 tx=0x7f5aa401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b76bce1b2fcaa57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5aab400640 1 -- 172.21.15.18:0/3011209214 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40a95f0 con 0x7f5aac06b320 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5aab400640 1 -- 172.21.15.18:0/3011209214 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40a9790 con 0x7f5aac06b320 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5aab400640 1 -- 172.21.15.18:0/3011209214 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40a9b60 con 0x7f5aac06b320 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 -- 172.21.15.18:0/3011209214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 msgr2=0x7f5aac0b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/3011209214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5aa4009870 tx=0x7f5aa401c530 comp rx=0 tx=0).stop 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 -- 172.21.15.18:0/3011209214 shutdown_connections 2024-04-25T10:14:09.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/3011209214 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac06b320 0x7f5aac0b4eb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/3011209214 >> v2:172.21.15.167:3300/0 conn(0x7f5aac1450f0 0x7f5aac0b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 -- 172.21.15.18:0/3011209214 >> 172.21.15.18:0/3011209214 conn(0x7f5aac099a60 msgr2=0x7f5aac0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 -- 172.21.15.18:0/3011209214 shutdown_connections 2024-04-25T10:14:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.868+0000 7f5ab1a00640 1 -- 172.21.15.18:0/3011209214 wait complete. 2024-04-25T10:14:09.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 Processor -- start 2024-04-25T10:14:09.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- start start 2024-04-25T10:14:09.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aac06b320 0x7f5aac164170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac0b3900 0x7f5aac0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0b5d80 con 0x7f5aac1450f0 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0b5c00 con 0x7f5aac06b320 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0b5f00 con 0x7f5aac0b3900 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46916/0 (socket says 172.21.15.18:46916) 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 -- 172.21.15.18:0/63273933 learned_addr learned my addr 172.21.15.18:0/63273933 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5aa3400640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac0b3900 0x7f5aac0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5aabe00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aac06b320 0x7f5aac164170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 -- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac0b3900 msgr2=0x7f5aac0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac0b3900 0x7f5aac0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 -- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aac06b320 msgr2=0x7f5aac164170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aac06b320 0x7f5aac164170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 -- 172.21.15.18:0/63273933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac164750 con 0x7f5aac1450f0 2024-04-25T10:14:09.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1000640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f5aa401a160 tx=0x7f5aa401ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40bc650 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40bc7f0 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40bcba0 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac0cf130 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.872+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac0cf6f0 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac0cef40 con 0x7f5aac1450f0 2024-04-25T10:14:09.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5aa40c53f0 con 0x7f5aac1450f0 2024-04-25T10:14:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5aa8c00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 0x7f5a88069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f5aa411fa70 con 0x7f5aac1450f0 2024-04-25T10:14:09.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5aabe00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 0x7f5a88069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:09.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.876+0000 7f5aabe00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 0x7f5a88069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c011340 tx=0x7f5a9c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:09.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:09.880+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5aa40ad020 con 0x7f5aac1450f0 2024-04-25T10:14:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.100+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f5aac04efa0 con 0x7f5aac1450f0 2024-04-25T10:14:10.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.336+0000 7f5aa8c00640 1 -- 172.21.15.18:0/63273933 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v481) v1 ==== 146+0+0 (secure 0 0 0) 0x7f5aa4016150 con 0x7f5aac1450f0 2024-04-25T10:14:10.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 msgr2=0x7f5a88069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 0x7f5a88069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c011340 tx=0x7f5a9c00b040 comp rx=0 tx=0).stop 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 msgr2=0x7f5aac06f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f5aa401a160 tx=0x7f5aa401ad70 comp rx=0 tx=0).stop 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 shutdown_connections 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aac1450f0 0x7f5aac06f2b0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5a88066f90 0x7f5a88069450 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5aac0b3900 0x7f5aac0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 --2- 172.21.15.18:0/63273933 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5aac06b320 0x7f5aac164170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 >> 172.21.15.18:0/63273933 conn(0x7f5aac099a60 msgr2=0x7f5aac142de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:10.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 shutdown_connections 2024-04-25T10:14:10.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.340+0000 7f5ab1a00640 1 -- 172.21.15.18:0/63273933 wait complete. 2024-04-25T10:14:10.366 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T10:14:10.367 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T10:14:10.367 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:10.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.504+0000 7f75a4e00640 1 Processor -- start 2024-04-25T10:14:10.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.504+0000 7f75a4e00640 1 -- start start 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f75a4e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75a0145270 0x7f75a015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f75a4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 0x7f75a00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f75a4e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75a00cc4e0 con 0x7f75a00cd4d0 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f75a4e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a0145650 con 0x7f75a0145270 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f75a4e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a00ce040 con 0x7f75a00b1e60 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75a0145270 0x7f75a015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75a0145270 0x7f75a015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46920/0 (socket says 172.21.15.18:46920) 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 -- 172.21.15.18:0/2567836928 learned_addr learned my addr 172.21.15.18:0/2567836928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759e800640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 0x7f75a00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 -- 172.21.15.18:0/2567836928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 msgr2=0x7f75a00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 0x7f75a00cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 -- 172.21.15.18:0/2567836928 >> v1:172.21.15.167:6789/0 conn(0x7f75a00cd4d0 legacy=0x7f75a00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:10.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 -- 172.21.15.18:0/2567836928 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a00ce320 con 0x7f75a0145270 2024-04-25T10:14:10.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759e800640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 0x7f75a00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:10.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.508+0000 7f759de00640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a0145270 0x7f75a015fe50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f7590009870 tx=0x7f759001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0fed67b916df4f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759d400640 1 -- 172.21.15.18:0/2567836928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900b1070 con 0x7f75a0145270 2024-04-25T10:14:10.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759d400640 1 -- 172.21.15.18:0/2567836928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75900ac630 con 0x7f75a0145270 2024-04-25T10:14:10.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759d400640 1 -- 172.21.15.18:0/2567836928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900a8050 con 0x7f75a0145270 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- 172.21.15.18:0/2567836928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a0145270 msgr2=0x7f75a015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a0145270 0x7f75a015fe50 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f7590009870 tx=0x7f759001c520 comp rx=0 tx=0).stop 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- 172.21.15.18:0/2567836928 shutdown_connections 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a00b1e60 0x7f75a00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- 172.21.15.18:0/2567836928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a0145270 0x7f75a015fe50 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- 172.21.15.18:0/2567836928 >> 172.21.15.18:0/2567836928 conn(0x7f75a0066fa0 msgr2=0x7f75a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- 172.21.15.18:0/2567836928 shutdown_connections 2024-04-25T10:14:10.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- 172.21.15.18:0/2567836928 wait complete. 2024-04-25T10:14:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 Processor -- start 2024-04-25T10:14:10.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- start start 2024-04-25T10:14:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a00cd4d0 0x7f75a015adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a0145270 0x7f75a01412f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015c710 con 0x7f75a00b1e60 2024-04-25T10:14:10.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015c590 con 0x7f75a00cd4d0 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f75a4e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a015c890 con 0x7f75a0145270 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46930/0 (socket says 172.21.15.18:46930) 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759de00640 1 -- 172.21.15.18:0/1749197799 learned_addr learned my addr 172.21.15.18:0/1749197799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f7597e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a00cd4d0 0x7f75a015adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.512+0000 7f759e800640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a0145270 0x7f75a01412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 -- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a0145270 msgr2=0x7f75a01412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a0145270 0x7f75a01412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 -- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a00cd4d0 msgr2=0x7f75a015adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a00cd4d0 0x7f75a015adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 -- 172.21.15.18:0/1749197799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a013df80 con 0x7f75a00b1e60 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f759de00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f75900af040 tx=0x7f75900192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900bc070 con 0x7f75a00b1e60 2024-04-25T10:14:10.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75900ab800 con 0x7f75a00b1e60 2024-04-25T10:14:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75900b1070 con 0x7f75a00b1e60 2024-04-25T10:14:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a013e260 con 0x7f75a00b1e60 2024-04-25T10:14:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a00b12b0 con 0x7f75a00b1e60 2024-04-25T10:14:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a00745d0 con 0x7f75a00b1e60 2024-04-25T10:14:10.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75900bf070 con 0x7f75a00b1e60 2024-04-25T10:14:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 0x7f757c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f759011ec00 con 0x7f75a00b1e60 2024-04-25T10:14:10.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.516+0000 7f7597e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 0x7f757c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.520+0000 7f7597e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 0x7f757c069450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f75a015d250 tx=0x7f7588009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.524+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7590016110 con 0x7f75a00b1e60 2024-04-25T10:14:10.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.684+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75a01410d0 con 0x7f75a00b1e60 2024-04-25T10:14:10.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.684+0000 7f7596000640 1 -- 172.21.15.18:0/1749197799 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+13409 (secure 0 0 0) 0x7f75900efc00 con 0x7f75a00b1e60 2024-04-25T10:14:10.693 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:10.693 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":115,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:09.321220+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6835/2124918123":"2024-04-26T10:14:01.891726+0000","172.21.15.167:6837/81610203":"2024-04-26T10:13:25.168169+0000","172.21.15.167:6835/81610203":"2024-04-26T10:13:25.168169+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 msgr2=0x7f757c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 0x7f757c069450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f75a015d250 tx=0x7f7588009040 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 msgr2=0x7f75a00b0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f75900af040 tx=0x7f75900192c0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 shutdown_connections 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f757c066f90 0x7f757c069450 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f75a0145270 0x7f75a01412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f75a00cd4d0 0x7f75a015adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 --2- 172.21.15.18:0/1749197799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75a00b1e60 0x7f75a00b0d70 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 >> 172.21.15.18:0/1749197799 conn(0x7f75a0066fa0 msgr2=0x7f75a006e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 shutdown_connections 2024-04-25T10:14:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.688+0000 7f75a4e00640 1 -- 172.21.15.18:0/1749197799 wait complete. 2024-04-25T10:14:10.715 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:10.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 Processor -- start 2024-04-25T10:14:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 -- start start 2024-04-25T10:14:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccb015bc40 con 0x7fccb00ccbf0 2024-04-25T10:14:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccb015e490 con 0x7fccb0144120 2024-04-25T10:14:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccb6600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb015b3a0 con 0x7fccb00b3090 2024-04-25T10:14:10.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccaf400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:33590/0 (socket says 172.21.15.18:33590) 2024-04-25T10:14:10.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccaf400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:38052/0 (socket says 172.21.15.18:38052) 2024-04-25T10:14:10.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 -- 172.21.15.18:0/1417344213 learned_addr learned my addr 172.21.15.18:0/1417344213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 -- 172.21.15.18:0/1417344213 >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 msgr2=0x7fccb015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 --2- 172.21.15.18:0/1417344213 >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 -- 172.21.15.18:0/1417344213 >> v1:172.21.15.167:6789/0 conn(0x7fccb00ccbf0 legacy=0x7fccb015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccafe00640 1 -- 172.21.15.18:0/1417344213 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb015b680 con 0x7fccb00b3090 2024-04-25T10:14:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.852+0000 7fccaf400640 1 --2- 172.21.15.18:0/1417344213 >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccafe00640 1 --2- 172.21.15.18:0/1417344213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009e50 tx=0x7fcca801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95f2b4d18ab1de69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccaea00640 1 -- 172.21.15.18:0/1417344213 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80a5670 con 0x7fccb00b3090 2024-04-25T10:14:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccaea00640 1 -- 172.21.15.18:0/1417344213 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca80a5810 con 0x7fccb00b3090 2024-04-25T10:14:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccaea00640 1 -- 172.21.15.18:0/1417344213 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca80a5be0 con 0x7fccb00b3090 2024-04-25T10:14:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 -- 172.21.15.18:0/1417344213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 msgr2=0x7fccb00b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 --2- 172.21.15.18:0/1417344213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fcca8009e50 tx=0x7fcca801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 -- 172.21.15.18:0/1417344213 shutdown_connections 2024-04-25T10:14:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 --2- 172.21.15.18:0/1417344213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb00b3090 0x7fccb00b3520 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 --2- 172.21.15.18:0/1417344213 >> v2:172.21.15.167:3300/0 conn(0x7fccb0144120 0x7fccb015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 -- 172.21.15.18:0/1417344213 >> 172.21.15.18:0/1417344213 conn(0x7fccb0067080 msgr2=0x7fccb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 -- 172.21.15.18:0/1417344213 shutdown_connections 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.856+0000 7fccb6600640 1 -- 172.21.15.18:0/1417344213 wait complete. 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 Processor -- start 2024-04-25T10:14:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- start start 2024-04-25T10:14:10.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb00ccbf0 0x7fccb013a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb0144120 0x7fccb00b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0165dc0 con 0x7fccb00b3090 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0165c40 con 0x7fccb00ccbf0 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccb0165f40 con 0x7fccb0144120 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46944/0 (socket says 172.21.15.18:46944) 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 -- 172.21.15.18:0/2606873690 learned_addr learned my addr 172.21.15.18:0/2606873690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccafe00640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb0144120 0x7fccb00b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fcca6a00640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb00ccbf0 0x7fccb013a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 -- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb0144120 msgr2=0x7fccb00b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb0144120 0x7fccb00b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 -- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb00ccbf0 msgr2=0x7fccb013a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:10.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb00ccbf0 0x7fccb013a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:10.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 -- 172.21.15.18:0/2606873690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb015c6b0 con 0x7fccb00b3090 2024-04-25T10:14:10.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccaf400640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e9b0 tx=0x7fcca000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca0017070 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca000ca00 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca000cdd0 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb015c3d0 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb00affa0 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.860+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb00745d0 con 0x7fccb00b3090 2024-04-25T10:14:10.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.864+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcca001a070 con 0x7fccb00b3090 2024-04-25T10:14:10.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.864+0000 7fcca7e00640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 0x7fcc8c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:10.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.864+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fcca0085030 con 0x7fccb00b3090 2024-04-25T10:14:10.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.864+0000 7fcca6a00640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 0x7fcc8c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:10.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.864+0000 7fcca6a00640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 0x7fcc8c069450 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fccb013cbb0 tx=0x7fcc98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:10.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:10.868+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fccb015c6b0 con 0x7fccb00b3090 2024-04-25T10:14:11.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.028+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fccb013d820 con 0x7fccb00b3090 2024-04-25T10:14:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.028+0000 7fcca7e00640 1 -- 172.21.15.18:0/2606873690 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcca0055ba0 con 0x7fccb00b3090 2024-04-25T10:14:11.037 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 msgr2=0x7fcc8c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 0x7fcc8c069450 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fccb013cbb0 tx=0x7fcc98009040 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 msgr2=0x7fccb015a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fcca000e9b0 tx=0x7fcca000ee70 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 shutdown_connections 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcc8c066f90 0x7fcc8c069450 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fccb0144120 0x7fccb00b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fccb00ccbf0 0x7fccb013a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 --2- 172.21.15.18:0/2606873690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccb00b3090 0x7fccb015a1d0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 >> 172.21.15.18:0/2606873690 conn(0x7fccb0067080 msgr2=0x7fccb0139c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 shutdown_connections 2024-04-25T10:14:11.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.032+0000 7fccb6600640 1 -- 172.21.15.18:0/2606873690 wait complete. 2024-04-25T10:14:11.058 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T10:14:11.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 Processor -- start 2024-04-25T10:14:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 -- start start 2024-04-25T10:14:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f472c0cef30 0x7f472c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c15ac60 con 0x7f472c144140 2024-04-25T10:14:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472c0cf3e0 con 0x7f472c06e900 2024-04-25T10:14:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4731000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f472c06ed50 con 0x7f472c0cef30 2024-04-25T10:14:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f472c144140 0x7f472c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54972/0 (socket says 172.21.15.18:54972) 2024-04-25T10:14:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729e00640 1 -- 172.21.15.18:0/1225215939 learned_addr learned my addr 172.21.15.18:0/1225215939 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4723e00640 1 --2- 172.21.15.18:0/1225215939 >> v2:172.21.15.167:3300/0 conn(0x7f472c0cef30 0x7f472c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207704204 0 0) 0x7f472c15ac60 con 0x7f472c144140 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4710003530 con 0x7f472c144140 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393574898 0 0) 0x7f472c0cf3e0 con 0x7f472c06e900 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f472c15ac60 con 0x7f472c06e900 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746204074 0 0) 0x7f4710003530 con 0x7f472c144140 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4723e00640 1 -- 172.21.15.18:0/1225215939 >> v1:172.21.15.167:6789/0 conn(0x7f472c06e900 legacy=0x7f472c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4723e00640 1 -- 172.21.15.18:0/1225215939 >> v1:172.21.15.18:6789/0 conn(0x7f472c144140 legacy=0x7f472c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.192+0000 7f4723e00640 1 -- 172.21.15.18:0/1225215939 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c15af20 con 0x7f472c0cef30 2024-04-25T10:14:11.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4723e00640 1 --2- 172.21.15.18:0/1225215939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c06e3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f471401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fdf03d5b56eb4bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140b0070 con 0x7f472c0cef30 2024-04-25T10:14:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140ab400 con 0x7f472c0cef30 2024-04-25T10:14:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4729400640 1 -- 172.21.15.18:0/1225215939 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c001680 con 0x7f472c0cef30 2024-04-25T10:14:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 -- 172.21.15.18:0/1225215939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 msgr2=0x7f472c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 --2- 172.21.15.18:0/1225215939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c06e3c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f47140097c0 tx=0x7f471401c3c0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 -- 172.21.15.18:0/1225215939 shutdown_connections 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 --2- 172.21.15.18:0/1225215939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c06e3c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 -- 172.21.15.18:0/1225215939 >> 172.21.15.18:0/1225215939 conn(0x7f472c066fa0 msgr2=0x7f472c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 -- 172.21.15.18:0/1225215939 shutdown_connections 2024-04-25T10:14:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.196+0000 7f4731000640 1 -- 172.21.15.18:0/1225215939 wait complete. 2024-04-25T10:14:11.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 Processor -- start 2024-04-25T10:14:11.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- start start 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f472c06e900 0x7f472c1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c12fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c15ba00 con 0x7f472c144140 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472c144520 con 0x7f472c0cef30 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472c15bb80 con 0x7f472c06e900 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46960/0 (socket says 172.21.15.18:46960) 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 -- 172.21.15.18:0/4233767498 learned_addr learned my addr 172.21.15.18:0/4233767498 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4729e00640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f472c06e900 0x7f472c1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4723e00640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c12fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 -- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f472c06e900 msgr2=0x7f472c1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f472c06e900 0x7f472c1f6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 -- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 msgr2=0x7f472c12fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:11.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c12fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:11.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 -- 172.21.15.18:0/4233767498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c0b2d70 con 0x7f472c144140 2024-04-25T10:14:11.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f472a800640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f472400c790 tx=0x7f472400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724003b80 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4724003d20 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f472c0b3050 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472400aa50 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f472c0b3610 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.200+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472c0745d0 con 0x7f472c144140 2024-04-25T10:14:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.204+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f472400abf0 con 0x7f472c144140 2024-04-25T10:14:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.204+0000 7f4722000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 0x7f4708069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.204+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f4724084fe0 con 0x7f472c144140 2024-04-25T10:14:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.204+0000 7f4729e00640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 0x7f4708069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.204+0000 7f4729e00640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 0x7f4708069420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f471c0011f0 tx=0x7f471c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:11.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.208+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4724056010 con 0x7f472c144140 2024-04-25T10:14:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:11.432+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f472c15de90 con 0x7f472c144140 2024-04-25T10:14:12.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4722000640 1 -- 172.21.15.18:0/4233767498 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v483) v1 ==== 147+0+0 (secure 0 0 0) 0x7f4724055910 con 0x7f472c144140 2024-04-25T10:14:12.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 msgr2=0x7f4708069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 0x7f4708069420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f471c0011f0 tx=0x7f471c009040 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 msgr2=0x7f472c153fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f472400c790 tx=0x7f472400cc50 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 shutdown_connections 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c144140 0x7f472c153fb0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f472c0cef30 0x7f472c12fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4708066f60 0x7f4708069420 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 --2- 172.21.15.18:0/4233767498 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f472c06e900 0x7f472c1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 >> 172.21.15.18:0/4233767498 conn(0x7f472c066fa0 msgr2=0x7f472c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 shutdown_connections 2024-04-25T10:14:12.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.344+0000 7f4731000640 1 -- 172.21.15.18:0/4233767498 wait complete. 2024-04-25T10:14:12.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T10:14:12.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 Processor -- start 2024-04-25T10:14:12.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 -- start start 2024-04-25T10:14:12.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23815dc60 0x7fd2380d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23809a170 0x7fd2380cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23815e040 con 0x7fd23806bf30 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2380cff80 con 0x7fd23815dc60 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd23ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380d0260 con 0x7fd23809a170 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23815dc60 0x7fd2380d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd23815dc60 0x7fd2380d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33406/0 (socket says 172.21.15.18:33406) 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 -- 172.21.15.18:0/1193862778 learned_addr learned my addr 172.21.15.18:0/1193862778 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:12.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd236800640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23809a170 0x7fd2380cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 -- 172.21.15.18:0/1193862778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23809a170 msgr2=0x7fd2380cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:12.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23809a170 0x7fd2380cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 -- 172.21.15.18:0/1193862778 >> v1:172.21.15.167:6789/0 conn(0x7fd23806bf30 legacy=0x7fd238099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.520+0000 7fd235e00640 1 -- 172.21.15.18:0/1193862778 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380d0540 con 0x7fd23815dc60 2024-04-25T10:14:12.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd235e00640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd2380d1020 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd228009870 tx=0x7fd22801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e496a197285713e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:12.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd235400640 1 -- 172.21.15.18:0/1193862778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280aa600 con 0x7fd23815dc60 2024-04-25T10:14:12.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd235400640 1 -- 172.21.15.18:0/1193862778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2280af070 con 0x7fd23815dc60 2024-04-25T10:14:12.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd235400640 1 -- 172.21.15.18:0/1193862778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280aa9c0 con 0x7fd23815dc60 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 -- 172.21.15.18:0/1193862778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 msgr2=0x7fd2380d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd2380d1020 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd228009870 tx=0x7fd22801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 -- 172.21.15.18:0/1193862778 shutdown_connections 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23809a170 0x7fd2380cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 --2- 172.21.15.18:0/1193862778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd2380d1020 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 -- 172.21.15.18:0/1193862778 >> 172.21.15.18:0/1193862778 conn(0x7fd2380b3200 msgr2=0x7fd2380b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:12.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 -- 172.21.15.18:0/1193862778 shutdown_connections 2024-04-25T10:14:12.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 -- 172.21.15.18:0/1193862778 wait complete. 2024-04-25T10:14:12.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.524+0000 7fd23ca00640 1 Processor -- start 2024-04-25T10:14:12.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- start start 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 0x7fd2380c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 0x7fd238155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cc6f0 con 0x7fd23815dc60 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cc570 con 0x7fd23809a170 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cc870 con 0x7fd23806bf30 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33422/0 (socket says 172.21.15.18:33422) 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 -- 172.21.15.18:0/3159580246 learned_addr learned my addr 172.21.15.18:0/3159580246 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:12.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 -- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 msgr2=0x7fd2380c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd22fe00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 0x7fd238155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd235e00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 0x7fd2380c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 0x7fd2380c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 -- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 msgr2=0x7fd238155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 0x7fd238155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 -- 172.21.15.18:0/3159580246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380ca420 con 0x7fd23815dc60 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd22fe00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 0x7fd238155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd235e00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 0x7fd2380c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd236800640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd230007e60 tx=0x7fd23000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230014620 con 0x7fd23815dc60 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230019070 con 0x7fd23815dc60 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230014a00 con 0x7fd23815dc60 2024-04-25T10:14:12.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2380cabf0 con 0x7fd23815dc60 2024-04-25T10:14:12.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2380cb1b0 con 0x7fd23815dc60 2024-04-25T10:14:12.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.528+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2380745d0 con 0x7fd23815dc60 2024-04-25T10:14:12.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.532+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd230014ba0 con 0x7fd23815dc60 2024-04-25T10:14:12.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.532+0000 7fd22e000640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 0x7fd214069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:12.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.532+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fd2300857c0 con 0x7fd23815dc60 2024-04-25T10:14:12.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.532+0000 7fd235e00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 0x7fd214069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:12.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.532+0000 7fd235e00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 0x7fd214069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd2280ae000 tx=0x7fd228008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:12.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.536+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd230011260 con 0x7fd23815dc60 2024-04-25T10:14:12.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.700+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd23806d4d0 con 0x7fd23815dc60 2024-04-25T10:14:12.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd22e000640 1 -- 172.21.15.18:0/3159580246 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd2300568e0 con 0x7fd23815dc60 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 msgr2=0x7fd214069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 0x7fd214069420 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd2280ae000 tx=0x7fd228008040 comp rx=0 tx=0).stop 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 msgr2=0x7fd238155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd230007e60 tx=0x7fd23000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 shutdown_connections 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd23815dc60 0x7fd238155ac0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23809a170 0x7fd238155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd214066f60 0x7fd214069420 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 --2- 172.21.15.18:0/3159580246 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23806bf30 0x7fd2380c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 >> 172.21.15.18:0/3159580246 conn(0x7fd2380b3200 msgr2=0x7fd23815a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 shutdown_connections 2024-04-25T10:14:12.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:12.704+0000 7fd23ca00640 1 -- 172.21.15.18:0/3159580246 wait complete. 2024-04-25T10:14:12.732 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:14:12.732 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:12.792 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:12.836 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:14:12.836 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:12.836 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:12.845 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:12.845 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:12.845 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:12.889 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:12.889 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:12.889 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:12.901 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:12.901 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:12.901 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:12.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:12.941 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T10:14:12.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:13.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 Processor -- start 2024-04-25T10:14:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 -- start start 2024-04-25T10:14:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f591415b860 0x7f591415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f591406ac10 0x7f591406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f591415c180 con 0x7f5914072c70 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f591415f4e0 con 0x7f591406ac10 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f591a200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591415c430 con 0x7f591415b860 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f591406ac10 0x7f591406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f591406ac10 0x7f591406b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33434/0 (socket says 172.21.15.18:33434) 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 -- 172.21.15.18:0/1912651804 learned_addr learned my addr 172.21.15.18:0/1912651804 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913400640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f591415b860 0x7f591415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 -- 172.21.15.18:0/1912651804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f591415b860 msgr2=0x7f591415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f591415b860 0x7f591415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 -- 172.21.15.18:0/1912651804 >> v1:172.21.15.167:6789/0 conn(0x7f5914072c70 legacy=0x7f59140cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.080+0000 7f5913e00640 1 -- 172.21.15.18:0/1912651804 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f591415c710 con 0x7f591406ac10 2024-04-25T10:14:13.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f5913e00640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591406ac10 0x7f591406b0a0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f590c009e50 tx=0x7f590c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c138b8cbe0fec9f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f5912a00640 1 -- 172.21.15.18:0/1912651804 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a5780 con 0x7f591406ac10 2024-04-25T10:14:13.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f5912a00640 1 -- 172.21.15.18:0/1912651804 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c0a5920 con 0x7f591406ac10 2024-04-25T10:14:13.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f5912a00640 1 -- 172.21.15.18:0/1912651804 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0a5cf0 con 0x7f591406ac10 2024-04-25T10:14:13.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 -- 172.21.15.18:0/1912651804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591406ac10 msgr2=0x7f591406b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591406ac10 0x7f591406b0a0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f590c009e50 tx=0x7f590c01c9f0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 -- 172.21.15.18:0/1912651804 shutdown_connections 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591406ac10 0x7f591406b0a0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 --2- 172.21.15.18:0/1912651804 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f591415b860 0x7f591415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 -- 172.21.15.18:0/1912651804 >> 172.21.15.18:0/1912651804 conn(0x7f59140b2400 msgr2=0x7f59140b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 -- 172.21.15.18:0/1912651804 shutdown_connections 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.084+0000 7f591a200640 1 -- 172.21.15.18:0/1912651804 wait complete. 2024-04-25T10:14:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 Processor -- start 2024-04-25T10:14:13.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- start start 2024-04-25T10:14:13.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 0x7f59140b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 0x7f5914144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5914073270 con 0x7f591415b860 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59140730f0 con 0x7f591406ac10 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5914168750 con 0x7f5914072c70 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33442/0 (socket says 172.21.15.18:33442) 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 -- 172.21.15.18:0/64117499 learned_addr learned my addr 172.21.15.18:0/64117499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913400640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 0x7f59140b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f590be00640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 0x7f5914144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 -- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 msgr2=0x7f5914144e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 0x7f5914144e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 -- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 msgr2=0x7f59140b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 0x7f59140b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 -- 172.21.15.18:0/64117499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59140b3d70 con 0x7f591415b860 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913400640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 0x7f59140b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f590be00640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 0x7f5914144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f5913e00640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f590c0af040 tx=0x7f590c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0b8670 con 0x7f591415b860 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c0be070 con 0x7f591415b860 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59140b4050 con 0x7f591415b860 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0b8a50 con 0x7f591415b860 2024-04-25T10:14:13.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5914158460 con 0x7f591415b860 2024-04-25T10:14:13.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.088+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59140b4440 con 0x7f591415b860 2024-04-25T10:14:13.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.092+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f590c0b8bf0 con 0x7f591415b860 2024-04-25T10:14:13.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.092+0000 7f590b400640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 0x7f58f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.092+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f590c1202f0 con 0x7f591415b860 2024-04-25T10:14:13.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.092+0000 7f5913400640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 0x7f58f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.092+0000 7f5913400640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 0x7f58f0069420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f59040097a0 tx=0x7f5904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.096+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f590c0165e0 con 0x7f591415b860 2024-04-25T10:14:13.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59140b4220 con 0x7f591415b860 2024-04-25T10:14:13.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f590b400640 1 -- 172.21.15.18:0/64117499 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f590c0f14a0 con 0x7f591415b860 2024-04-25T10:14:13.299 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:13.299 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":94,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/3739238351","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3739238351},{"type":"v1","addr":"172.21.15.167:6836","nonce":3739238351}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80},{"gid":8167,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2314876991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2314876991},{"type":"v1","addr":"172.21.15.167:6837","nonce":2314876991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":92},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1519459365","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1519459365},{"type":"v1","addr":"172.21.15.18:6834","nonce":1519459365}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":79},{"gid":8364,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1174465315","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1174465315},{"type":"v1","addr":"172.21.15.18:6835","nonce":1174465315}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[]} 2024-04-25T10:14:13.299 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 94 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 msgr2=0x7f58f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 0x7f58f0069420 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f59040097a0 tx=0x7f5904008040 comp rx=0 tx=0).stop 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 msgr2=0x7f5914145370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f590c0af040 tx=0x7f590c019790 comp rx=0 tx=0).stop 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 shutdown_connections 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f591415b860 0x7f5914145370 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f58f0066f60 0x7f58f0069420 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5914072c70 0x7f5914144e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 --2- 172.21.15.18:0/64117499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f591406ac10 0x7f59140b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 >> 172.21.15.18:0/64117499 conn(0x7f59140b2400 msgr2=0x7f59140d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 shutdown_connections 2024-04-25T10:14:13.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.292+0000 7f591a200640 1 -- 172.21.15.18:0/64117499 wait complete. 2024-04-25T10:14:13.319 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T10:14:13.320 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T10:14:13.320 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:14:13.320 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:14:13.320 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T10:14:13.320 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T10:14:13.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:14:13.321 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:14:13.321 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T10:14:13.321 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T10:14:13.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:14:13.321 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:14:13.321 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T10:14:13.321 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T10:14:13.322 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:14:13.322 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:14:13.332 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:14:13.332 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T10:14:13.333 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:14:13.333 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T10:14:13.335 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:14:13.335 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T10:14:13.336 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:14:13.336 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T10:14:13.380 INFO:tasks.ceph.mds.a:Started 2024-04-25T10:14:13.380 DEBUG:teuthology.parallel:result is None 2024-04-25T10:14:13.382 INFO:tasks.ceph.mds.c:Started 2024-04-25T10:14:13.382 DEBUG:teuthology.parallel:result is None 2024-04-25T10:14:13.383 INFO:tasks.ceph.mds.b:Started 2024-04-25T10:14:13.383 DEBUG:teuthology.parallel:result is None 2024-04-25T10:14:13.385 INFO:tasks.ceph.mds.d:Started 2024-04-25T10:14:13.385 DEBUG:teuthology.parallel:result is None 2024-04-25T10:14:13.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T10:14:13.466 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-04-25T10:14:13.468 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-04-25T10:14:13.473 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:14:13.473 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:14:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 Processor -- start 2024-04-25T10:14:13.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 -- start start 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcbd815c9b0 0x7fcbd806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd815fc00 con 0x7fcbd8159320 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd815fee0 con 0x7fcbd806e010 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbe0400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd806d640 con 0x7fcbd815c9b0 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbdda00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcbd8159320 0x7fcbd815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56918/0 (socket says 172.21.15.18:56918) 2024-04-25T10:14:13.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.524+0000 7fcbdda00640 1 -- 172.21.15.18:0/3720302808 learned_addr learned my addr 172.21.15.18:0/3720302808 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbdd000640 1 --2- 172.21.15.18:0/3720302808 >> v2:172.21.15.167:3300/0 conn(0x7fcbd815c9b0 0x7fcbd806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2954959191 0 0) 0x7fcbd815fc00 con 0x7fcbd8159320 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc0003530 con 0x7fcbd8159320 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002391603 0 0) 0x7fcbd815fee0 con 0x7fcbd806e010 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbd815fc00 con 0x7fcbd806e010 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbdd000640 1 -- 172.21.15.18:0/3720302808 >> v1:172.21.15.167:6789/0 conn(0x7fcbd806e010 legacy=0x7fcbd806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbdd000640 1 -- 172.21.15.18:0/3720302808 >> v1:172.21.15.18:6789/0 conn(0x7fcbd8159320 legacy=0x7fcbd815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbdd000640 1 -- 172.21.15.18:0/3720302808 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd81601c0 con 0x7fcbd815c9b0 2024-04-25T10:14:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbdd000640 1 --2- 172.21.15.18:0/3720302808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd806dad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40097c0 tx=0x7fcbc401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e5a42a496332a7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40b1070 con 0x7fcbd815c9b0 2024-04-25T10:14:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40ac410 con 0x7fcbd815c9b0 2024-04-25T10:14:13.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.528+0000 7fcbd7e00640 1 -- 172.21.15.18:0/3720302808 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40ac7e0 con 0x7fcbd815c9b0 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- 172.21.15.18:0/3720302808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 msgr2=0x7fcbd806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3720302808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd806dad0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40097c0 tx=0x7fcbc401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- 172.21.15.18:0/3720302808 shutdown_connections 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3720302808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd806dad0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- 172.21.15.18:0/3720302808 >> 172.21.15.18:0/3720302808 conn(0x7fcbd8067080 msgr2=0x7fcbd806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- 172.21.15.18:0/3720302808 shutdown_connections 2024-04-25T10:14:13.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- 172.21.15.18:0/3720302808 wait complete. 2024-04-25T10:14:13.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 Processor -- start 2024-04-25T10:14:13.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- start start 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd8159320 0x7fcbd813a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd813e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd806ed30 con 0x7fcbd806e010 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd806ebb0 con 0x7fcbd815c9b0 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbe0400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd81695a0 con 0x7fcbd8159320 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33504/0 (socket says 172.21.15.18:33504) 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 -- 172.21.15.18:0/3931226535 learned_addr learned my addr 172.21.15.18:0/3931226535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdd000640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd8159320 0x7fcbd813a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbde400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 -- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd8159320 msgr2=0x7fcbd813a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd8159320 0x7fcbd813a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 -- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 msgr2=0x7fcbd813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 -- 172.21.15.18:0/3931226535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8141140 con 0x7fcbd806e010 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.532+0000 7fcbdda00640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c4d0 tx=0x7fcbcc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc017070 con 0x7fcbd806e010 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc005cf0 con 0x7fcbd806e010 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0072b0 con 0x7fcbd806e010 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd80ad760 con 0x7fcbd806e010 2024-04-25T10:14:13.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd8140e60 con 0x7fcbd806e010 2024-04-25T10:14:13.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd80745d0 con 0x7fcbd806e010 2024-04-25T10:14:13.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcbcc01a070 con 0x7fcbd806e010 2024-04-25T10:14:13.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 0x7fcbb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:13.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fcbcc084320 con 0x7fcbd806e010 2024-04-25T10:14:13.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.536+0000 7fcbdd000640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 0x7fcbb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:13.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.540+0000 7fcbdd000640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 0x7fcbb8069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40ae000 tx=0x7fcbc4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:13.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.540+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcbcc054d60 con 0x7fcbd806e010 2024-04-25T10:14:13.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:13.712+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fcbd8166b80 con 0x7fcbd806e010 2024-04-25T10:14:14.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.364+0000 7fcbd5600640 1 -- 172.21.15.18:0/3931226535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v117) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcbcc058e00 con 0x7fcbd806e010 2024-04-25T10:14:14.371 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-04-25T10:14:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 msgr2=0x7fcbb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 0x7fcbb8069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40ae000 tx=0x7fcbc4008040 comp rx=0 tx=0).stop 2024-04-25T10:14:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 msgr2=0x7fcbd813b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c4d0 tx=0x7fcbcc00c990 comp rx=0 tx=0).stop 2024-04-25T10:14:14.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 shutdown_connections 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd815c9b0 0x7fcbd813e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb8066f60 0x7fcbb8069420 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd8159320 0x7fcbd813a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 --2- 172.21.15.18:0/3931226535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd806e010 0x7fcbd813b960 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 >> 172.21.15.18:0/3931226535 conn(0x7fcbd8067080 msgr2=0x7fcbd80cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 shutdown_connections 2024-04-25T10:14:14.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.368+0000 7fcbe0400640 1 -- 172.21.15.18:0/3931226535 wait complete. 2024-04-25T10:14:14.400 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T10:14:14.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 Processor -- start 2024-04-25T10:14:14.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 -- start start 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 0x7fb3d40afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb3d40d11b0 0x7fb3d406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3d415ddf0 con 0x7fb3d40b4210 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3d406b480 con 0x7fb3d40d11b0 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3da600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d40d06d0 con 0x7fb3d415da10 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb3d40b4210 0x7fb3d406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56920/0 (socket says 172.21.15.18:56920) 2024-04-25T10:14:14.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3e00640 1 -- 172.21.15.18:0/2105556536 learned_addr learned my addr 172.21.15.18:0/2105556536 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2105556536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 0x7fb3d40afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3caa00640 1 --2- 172.21.15.18:0/2105556536 >> v2:172.21.15.167:3300/0 conn(0x7fb3d40d11b0 0x7fb3d406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d2a00640 1 -- 172.21.15.18:0/2105556536 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239393421 0 0) 0x7fb3d415ddf0 con 0x7fb3d40b4210 2024-04-25T10:14:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d2a00640 1 -- 172.21.15.18:0/2105556536 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3b8003530 con 0x7fb3d40b4210 2024-04-25T10:14:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3400640 1 -- 172.21.15.18:0/2105556536 >> v2:172.21.15.167:3300/0 conn(0x7fb3d40d11b0 msgr2=0x7fb3d406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2105556536 >> v2:172.21.15.167:3300/0 conn(0x7fb3d40d11b0 0x7fb3d406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3400640 1 -- 172.21.15.18:0/2105556536 >> v1:172.21.15.18:6789/0 conn(0x7fb3d40b4210 legacy=0x7fb3d406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.540+0000 7fb3d3400640 1 -- 172.21.15.18:0/2105556536 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40d09b0 con 0x7fb3d415da10 2024-04-25T10:14:14.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2105556536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 0x7fb3d40afe20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40097c0 tx=0x7fb3c401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2fe9f19e907c4d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3d2a00640 1 -- 172.21.15.18:0/2105556536 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40b0070 con 0x7fb3d415da10 2024-04-25T10:14:14.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3d2a00640 1 -- 172.21.15.18:0/2105556536 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c40ab600 con 0x7fb3d415da10 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3d2a00640 1 -- 172.21.15.18:0/2105556536 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c40ab9d0 con 0x7fb3d415da10 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 -- 172.21.15.18:0/2105556536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 msgr2=0x7fb3d40afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 --2- 172.21.15.18:0/2105556536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 0x7fb3d40afe20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40097c0 tx=0x7fb3c401c410 comp rx=0 tx=0).stop 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 -- 172.21.15.18:0/2105556536 shutdown_connections 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 --2- 172.21.15.18:0/2105556536 >> v2:172.21.15.167:3300/0 conn(0x7fb3d40d11b0 0x7fb3d406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 --2- 172.21.15.18:0/2105556536 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d415da10 0x7fb3d40afe20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 -- 172.21.15.18:0/2105556536 >> 172.21.15.18:0/2105556536 conn(0x7fb3d40b2400 msgr2=0x7fb3d40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 -- 172.21.15.18:0/2105556536 shutdown_connections 2024-04-25T10:14:14.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.544+0000 7fb3da600640 1 -- 172.21.15.18:0/2105556536 wait complete. 2024-04-25T10:14:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 Processor -- start 2024-04-25T10:14:14.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- start start 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d40b4210 0x7fb3d4147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3d415da10 0x7fb3d414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d416aad0 con 0x7fb3d40d11b0 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d416a950 con 0x7fb3d415da10 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3d416ac50 con 0x7fb3d40b4210 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33516/0 (socket says 172.21.15.18:33516) 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 -- 172.21.15.18:0/2589142798 learned_addr learned my addr 172.21.15.18:0/2589142798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d40b4210 0x7fb3d4147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3d3e00640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3d415da10 0x7fb3d414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 -- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d40b4210 msgr2=0x7fb3d4147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d40b4210 0x7fb3d4147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 -- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3d415da10 msgr2=0x7fb3d414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3d415da10 0x7fb3d414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 -- 172.21.15.18:0/2589142798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d414b2a0 con 0x7fb3d40d11b0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3caa00640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00e930 tx=0x7fb3bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc017070 con 0x7fb3d40d11b0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00c8e0 con 0x7fb3d40d11b0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00cc90 con 0x7fb3d40d11b0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3d414b580 con 0x7fb3d40d11b0 2024-04-25T10:14:14.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.548+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3d414bb40 con 0x7fb3d40d11b0 2024-04-25T10:14:14.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d4155180 con 0x7fb3d40d11b0 2024-04-25T10:14:14.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb3bc01a070 con 0x7fb3d40d11b0 2024-04-25T10:14:14.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3cbe00640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 0x7fb3b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb3bc0851b0 con 0x7fb3d40d11b0 2024-04-25T10:14:14.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 0x7fb3b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.552+0000 7fb3d3400640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 0x7fb3b0069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40ad000 tx=0x7fb3c40a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.556+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb3d4155180 con 0x7fb3d40d11b0 2024-04-25T10:14:14.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb3d4160e40 con 0x7fb3d40d11b0 2024-04-25T10:14:14.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3cbe00640 1 -- 172.21.15.18:0/2589142798 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb3bc055c90 con 0x7fb3d40d11b0 2024-04-25T10:14:14.783 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm71jGJBAANUk2xZg+50SbNFkIC3kJ2w==", 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmGfOBMRAALjDTc8gmsDtYl5AixO4fOA==", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmOU1ILBAAQ9EJtU2ZX9DwYHcaMVjq0g==", 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.785 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmJC8BORAARPk4At8sSnJgVNECFfVXWw==", 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.786 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBOKipm+cC0HRAAbcGbksjcE29LGFMeyEbUjA==", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBRKipmNvsGJxAAQEb70tVKp1U8Jjn290VphA==", 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.788 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBUKipm6XKaMBAAqYwn/xEIwQeTW4/s6igDDQ==", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBXKipmuzsUOhAA0gcoQMo1keVH4zml4PNuJA==", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBdKipm8OqGLxAAdy7asrBnvIcDKnnReUZEkA==", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBgKipmrWOLORAAWbZ4qKmHJL1QPIQazsCogw==", 2024-04-25T10:14:14.790 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBkKipm0TL6BRAAi2/6aWVceJ+mcL7TXj0EWA==", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBnKipmSrnJDxAAGzKT1CVnib5zMBRpRt+3qQ==", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA==", 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmxnjqChAASsUBOXDpbVXaE08aqu5M7g==", 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipmVqw4BxAAg815zXGYngkKRKpcOvJRfA==", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBNKipm4eIXERAAX/DSbS16CefFJT881Ad0ew==", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmVK5iCBAAxuDmVdz3XfUfkTrd16ooVg==", 2024-04-25T10:14:14.795 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipm/U2RIBAAlN76x1TJuPnrZihQlaK+JQ==", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQBMKipmIfiHHBAA5v4br8f+sBGYEiUVJJ1bsA==", 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-04-25T10:14:14.797 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:14.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 msgr2=0x7fb3b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 0x7fb3b0069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb3c40ad000 tx=0x7fb3c40a6000 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 msgr2=0x7fb3d414c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc00e930 tx=0x7fb3bc00edf0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 shutdown_connections 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb3d415da10 0x7fb3d414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3d40d11b0 0x7fb3d414c8d0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb3b0066f60 0x7fb3b0069420 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 --2- 172.21.15.18:0/2589142798 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3d40b4210 0x7fb3d4147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 >> 172.21.15.18:0/2589142798 conn(0x7fb3d40b2400 msgr2=0x7fb3d41532c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 shutdown_connections 2024-04-25T10:14:14.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.776+0000 7fb3da600640 1 -- 172.21.15.18:0/2589142798 wait complete. 2024-04-25T10:14:14.805 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.936+0000 7f0ee9a00640 1 Processor -- start 2024-04-25T10:14:14.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.936+0000 7f0ee9a00640 1 -- start start 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee9a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0ee406dad0 0x7f0ee40b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee9a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee415def0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee9a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee415e1b0 con 0x7f0ee406dad0 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee415e490 con 0x7f0ee415b2f0 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0edbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0ee40b2dc0 0x7f0ee406dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56932/0 (socket says 172.21.15.18:56932) 2024-04-25T10:14:14.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0edbe00640 1 -- 172.21.15.18:0/3040086827 learned_addr learned my addr 172.21.15.18:0/3040086827 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee2a00640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee3400640 1 --2- 172.21.15.18:0/3040086827 >> v2:172.21.15.167:3300/0 conn(0x7f0ee406dad0 0x7f0ee40b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736296925 0 0) 0x7f0ee415def0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ec8003530 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee3400640 1 -- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 msgr2=0x7f0ee40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee3400640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee3400640 1 -- 172.21.15.18:0/3040086827 >> v1:172.21.15.18:6789/0 conn(0x7f0ee40b2dc0 legacy=0x7f0ee406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3695168254 0 0) 0x7f0ec8003530 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.940+0000 7f0ee3400640 1 -- 172.21.15.18:0/3040086827 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee415e770 con 0x7f0ee406dad0 2024-04-25T10:14:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee3400640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee40b3780 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009dc0 tx=0x7f0edc01c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f310312d8be609c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0b2070 con 0x7f0ee406dad0 2024-04-25T10:14:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0a56a0 con 0x7f0ee406dad0 2024-04-25T10:14:14.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee2000640 1 -- 172.21.15.18:0/3040086827 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee415b8e0 con 0x7f0ee406dad0 2024-04-25T10:14:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 msgr2=0x7f0ee40b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee40b3780 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009dc0 tx=0x7f0edc01c840 comp rx=0 tx=0).stop 2024-04-25T10:14:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- 172.21.15.18:0/3040086827 shutdown_connections 2024-04-25T10:14:14.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee40b3780 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/3040086827 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- 172.21.15.18:0/3040086827 >> 172.21.15.18:0/3040086827 conn(0x7f0ee40b23b0 msgr2=0x7f0ee40cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:14.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- 172.21.15.18:0/3040086827 shutdown_connections 2024-04-25T10:14:14.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- 172.21.15.18:0/3040086827 wait complete. 2024-04-25T10:14:14.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 Processor -- start 2024-04-25T10:14:14.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.944+0000 7f0ee9a00640 1 -- start start 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee4147a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee416a880 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee41616f0 con 0x7f0ee406dad0 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee416aa00 con 0x7f0ee415b2f0 2024-04-25T10:14:14.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33526/0 (socket says 172.21.15.18:33526) 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 -- 172.21.15.18:0/845657488 learned_addr learned my addr 172.21.15.18:0/845657488 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee2a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee4147a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee3400640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 -- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 msgr2=0x7f0ee415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 -- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 msgr2=0x7f0ee4147a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee4147a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 -- 172.21.15.18:0/845657488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee40cbff0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee3400640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edbe00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00caf0 tx=0x7f0ecc001d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc005cf0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc007070 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc007460 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee40cc2d0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee40cc890 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee40745d0 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.948+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ecc007600 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.952+0000 7f0edaa00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 0x7f0ec0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:14.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.952+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0ecc084e00 con 0x7f0ee40b2dc0 2024-04-25T10:14:14.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.952+0000 7f0ee2a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 0x7f0ec0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:14.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.952+0000 7f0ee2a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 0x7f0ec0069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40aecf0 tx=0x7f0ed4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:14.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:14.956+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ecc055fb0 con 0x7f0ee40b2dc0 2024-04-25T10:14:15.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ee41579f0 con 0x7f0ee40b2dc0 2024-04-25T10:14:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0edaa00640 1 -- 172.21.15.18:0/845657488 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+13150 (secure 0 0 0) 0x7f0ecc0558b0 con 0x7f0ee40b2dc0 2024-04-25T10:14:15.127 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:15.127 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":119,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:14.379851+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 msgr2=0x7f0ec0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 0x7f0ec0069420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40aecf0 tx=0x7f0ed4009190 comp rx=0 tx=0).stop 2024-04-25T10:14:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 msgr2=0x7f0ee40cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00caf0 tx=0x7f0ecc001d60 comp rx=0 tx=0).stop 2024-04-25T10:14:15.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 shutdown_connections 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ec0066f60 0x7f0ec0069420 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ee415b2f0 0x7f0ee415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee40b2dc0 0x7f0ee40cd090 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 --2- 172.21.15.18:0/845657488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ee406dad0 0x7f0ee4147a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 >> 172.21.15.18:0/845657488 conn(0x7f0ee40b23b0 msgr2=0x7f0ee40afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 shutdown_connections 2024-04-25T10:14:15.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.120+0000 7f0ee9a00640 1 -- 172.21.15.18:0/845657488 wait complete. 2024-04-25T10:14:15.148 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:15.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 Processor -- start 2024-04-25T10:14:15.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 -- start start 2024-04-25T10:14:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f394c15c9b0 0x7f394c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c15fc00 con 0x7f394c159320 2024-04-25T10:14:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f394c15fee0 con 0x7f394c06e010 2024-04-25T10:14:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f3952e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f394c06d640 con 0x7f394c15c9b0 2024-04-25T10:14:15.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f394be00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f394c159320 0x7f394c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56934/0 (socket says 172.21.15.18:56934) 2024-04-25T10:14:15.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.284+0000 7f394be00640 1 -- 172.21.15.18:0/2297233281 learned_addr learned my addr 172.21.15.18:0/2297233281 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3943400640 1 --2- 172.21.15.18:0/2297233281 >> v2:172.21.15.167:3300/0 conn(0x7f394c15c9b0 0x7f394c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061764950 0 0) 0x7f394c15fc00 con 0x7f394c159320 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3930003530 con 0x7f394c159320 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030582321 0 0) 0x7f3930003530 con 0x7f394c159320 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 >> v2:172.21.15.167:3300/0 conn(0x7f394c15c9b0 msgr2=0x7f394c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:15.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 --2- 172.21.15.18:0/2297233281 >> v2:172.21.15.167:3300/0 conn(0x7f394c15c9b0 0x7f394c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 >> v1:172.21.15.167:6789/0 conn(0x7f394c06e010 legacy=0x7f394c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c1601c0 con 0x7f394c159320 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f393c001680 con 0x7f394c159320 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 >> v1:172.21.15.18:6789/0 conn(0x7f394c159320 legacy=0x7f394c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300039c0 0x7f3930003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3930004810 0x7f3930004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 0x7f393000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c06d640 con 0x7f39300051d0 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393000c070 con 0x7f39300039c0 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393000c270 con 0x7f3930004810 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 0x7f393000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f394be00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300039c0 0x7f3930003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3943400640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3930004810 0x7f3930004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 -- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3930004810 msgr2=0x7f3930004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3930004810 0x7f3930004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 -- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300039c0 msgr2=0x7f3930003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300039c0 0x7f3930003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3950e00640 1 -- 172.21.15.18:0/2297233281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3930003530 con 0x7f39300051d0 2024-04-25T10:14:15.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.288+0000 7f3943400640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3930004810 0x7f3930004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3950e00640 1 -- 172.21.15.18:0/2297233281 reap_dead start 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3950e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 0x7f393000b9d0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3944001e40 tx=0x7f394401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e519ce266f2cd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944001a90 con 0x7f39300051d0 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3944003b80 con 0x7f39300051d0 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f394b400640 1 -- 172.21.15.18:0/2297233281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3944005020 con 0x7f39300051d0 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 msgr2=0x7f393000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 0x7f393000b9d0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3944001e40 tx=0x7f394401c760 comp rx=0 tx=0).stop 2024-04-25T10:14:15.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- 172.21.15.18:0/2297233281 shutdown_connections 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 --2- 172.21.15.18:0/2297233281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39300051d0 0x7f393000b9d0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- 172.21.15.18:0/2297233281 >> 172.21.15.18:0/2297233281 conn(0x7f394c067080 msgr2=0x7f394c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- 172.21.15.18:0/2297233281 shutdown_connections 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- 172.21.15.18:0/2297233281 wait complete. 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 Processor -- start 2024-04-25T10:14:15.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.292+0000 7f3952e00640 1 -- start start 2024-04-25T10:14:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300051d0 0x7f394c1f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 0x7f394c15d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c06dad0 con 0x7f394c0c53b0 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394c159700 con 0x7f39300051d0 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c06dc50 con 0x7f394c0b2730 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33542/0 (socket says 172.21.15.18:33542) 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 -- 172.21.15.18:0/1961782953 learned_addr learned my addr 172.21.15.18:0/1961782953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f394be00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300051d0 0x7f394c1f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3950e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 0x7f394c15d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 -- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 msgr2=0x7f394c15d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 0x7f394c15d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 -- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300051d0 msgr2=0x7f394c1f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300051d0 0x7f394c1f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 -- 172.21.15.18:0/1961782953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f394c1f7480 con 0x7f394c0c53b0 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3950e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 0x7f394c15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:15.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3943400640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3934009160 tx=0x7f39340119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934004220 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39340043c0 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f394c1f7760 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934015890 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f394c1f3a30 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f394c0745d0 con 0x7f394c0c53b0 2024-04-25T10:14:15.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.296+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3934015a30 con 0x7f394c0c53b0 2024-04-25T10:14:15.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.300+0000 7f3948c00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 0x7f3928069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.300+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3934085430 con 0x7f394c0c53b0 2024-04-25T10:14:15.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.300+0000 7f394be00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 0x7f3928069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.300+0000 7f394be00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 0x7f3928069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f393c001060 tx=0x7f393c007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.304+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3934019030 con 0x7f394c0c53b0 2024-04-25T10:14:15.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.468+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f394c158a30 con 0x7f394c0c53b0 2024-04-25T10:14:15.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.468+0000 7f3948c00640 1 -- 172.21.15.18:0/1961782953 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39340565f0 con 0x7f394c0c53b0 2024-04-25T10:14:15.477 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:15.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 msgr2=0x7f3928069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 0x7f3928069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f393c001060 tx=0x7f393c007900 comp rx=0 tx=0).stop 2024-04-25T10:14:15.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 msgr2=0x7f394c1f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3934009160 tx=0x7f39340119a0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 shutdown_connections 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3928066f60 0x7f3928069420 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f394c0b2730 0x7f394c15d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f394c0c53b0 0x7f394c1f6ba0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 --2- 172.21.15.18:0/1961782953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f39300051d0 0x7f394c1f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 >> 172.21.15.18:0/1961782953 conn(0x7f394c067080 msgr2=0x7f394c073950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 shutdown_connections 2024-04-25T10:14:15.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.472+0000 7f3952e00640 1 -- 172.21.15.18:0/1961782953 wait complete. 2024-04-25T10:14:15.497 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T10:14:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 Processor -- start 2024-04-25T10:14:15.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 -- start start 2024-04-25T10:14:15.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb0144140 0x7f8cb00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8cb006ead0 0x7f8cb00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb015ac60 con 0x7f8cb00ced60 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb00cf3e0 con 0x7f8cb006ead0 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015af20 con 0x7f8cb0144140 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8ca7e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8cb00ced60 0x7f8cb006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56940/0 (socket says 172.21.15.18:56940) 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8ca7e00640 1 -- 172.21.15.18:0/2990458516 learned_addr learned my addr 172.21.15.18:0/2990458516 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2990458516 >> v2:172.21.15.18:3300/0 conn(0x7f8cb006ead0 0x7f8cb00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb4e00640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb0144140 0x7f8cb00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cafe00640 1 -- 172.21.15.18:0/2990458516 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388406480 0 0) 0x7f8cb015ac60 con 0x7f8cb00ced60 2024-04-25T10:14:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cafe00640 1 -- 172.21.15.18:0/2990458516 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c94003530 con 0x7f8cb00ced60 2024-04-25T10:14:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb5800640 1 -- 172.21.15.18:0/2990458516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb0144140 msgr2=0x7f8cb00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb0144140 0x7f8cb00ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb5800640 1 -- 172.21.15.18:0/2990458516 >> v1:172.21.15.18:6789/0 conn(0x7f8cb00ced60 legacy=0x7f8cb006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.632+0000 7f8cb5800640 1 -- 172.21.15.18:0/2990458516 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb015b200 con 0x7f8cb006ead0 2024-04-25T10:14:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb006ead0 0x7f8cb00b0760 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b19f35fbd0bee35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cafe00640 1 -- 172.21.15.18:0/2990458516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80aa610 con 0x7f8cb006ead0 2024-04-25T10:14:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cafe00640 1 -- 172.21.15.18:0/2990458516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80af070 con 0x7f8cb006ead0 2024-04-25T10:14:15.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cafe00640 1 -- 172.21.15.18:0/2990458516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80aa9d0 con 0x7f8cb006ead0 2024-04-25T10:14:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 -- 172.21.15.18:0/2990458516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb006ead0 msgr2=0x7f8cb00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb006ead0 0x7f8cb00b0760 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009d90 tx=0x7f8ca801c970 comp rx=0 tx=0).stop 2024-04-25T10:14:15.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 -- 172.21.15.18:0/2990458516 shutdown_connections 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb006ead0 0x7f8cb00b0760 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2990458516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb0144140 0x7f8cb00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 -- 172.21.15.18:0/2990458516 >> 172.21.15.18:0/2990458516 conn(0x7f8cb0066fa0 msgr2=0x7f8cb006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 -- 172.21.15.18:0/2990458516 shutdown_connections 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.636+0000 7f8cb7800640 1 -- 172.21.15.18:0/2990458516 wait complete. 2024-04-25T10:14:15.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 Processor -- start 2024-04-25T10:14:15.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- start start 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb006ead0 0x7f8cb015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 0x7f8cb015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015bb80 con 0x7f8cb0144140 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb015ba00 con 0x7f8cb00ced60 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb01673e0 con 0x7f8cb006ead0 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33564/0 (socket says 172.21.15.18:33564) 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 -- 172.21.15.18:0/2633341003 learned_addr learned my addr 172.21.15.18:0/2633341003 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb4e00640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb006ead0 0x7f8cb015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8ca7e00640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 0x7f8cb015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 -- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb006ead0 msgr2=0x7f8cb015d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb006ead0 0x7f8cb015d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 -- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 msgr2=0x7f8cb015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 0x7f8cb015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 -- 172.21.15.18:0/2633341003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb015c7f0 con 0x7f8cb0144140 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8ca7e00640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 0x7f8cb015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb5800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8ca801b020 tx=0x7f8ca8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80aab80 con 0x7f8cb0144140 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80aad20 con 0x7f8cb0144140 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca80bf650 con 0x7f8cb0144140 2024-04-25T10:14:15.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb015cad0 con 0x7f8cb0144140 2024-04-25T10:14:15.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.640+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb015d090 con 0x7f8cb0144140 2024-04-25T10:14:15.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb00745d0 con 0x7f8cb0144140 2024-04-25T10:14:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8ca80bf7f0 con 0x7f8cb0144140 2024-04-25T10:14:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cad600640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 0x7f8c8c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8ca811f950 con 0x7f8cb0144140 2024-04-25T10:14:15.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cb4e00640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 0x7f8c8c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.644+0000 7f8cb4e00640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 0x7f8c8c069420 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00cdbb0 tx=0x7f8ca0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.648+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8ca80a7070 con 0x7f8cb0144140 2024-04-25T10:14:15.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.808+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8cb015a570 con 0x7f8cb0144140 2024-04-25T10:14:15.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cad600640 1 -- 172.21.15.18:0/2633341003 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8ca8016560 con 0x7f8cb0144140 2024-04-25T10:14:15.825 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-04-25T10:14:15.826 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 msgr2=0x7f8c8c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 0x7f8c8c069420 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8cb00cdbb0 tx=0x7f8ca0008040 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 msgr2=0x7f8cb00b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f8ca801b020 tx=0x7f8ca8019710 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 shutdown_connections 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cb0144140 0x7f8cb00b2bf0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8cb00ced60 0x7f8cb015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8c8c066f60 0x7f8c8c069420 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 --2- 172.21.15.18:0/2633341003 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8cb006ead0 0x7f8cb015d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 >> 172.21.15.18:0/2633341003 conn(0x7f8cb0066fa0 msgr2=0x7f8cb013e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 shutdown_connections 2024-04-25T10:14:15.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.812+0000 7f8cb7800640 1 -- 172.21.15.18:0/2633341003 wait complete. 2024-04-25T10:14:15.839 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T10:14:15.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T10:14:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.976+0000 7f96acc00640 1 Processor -- start 2024-04-25T10:14:15.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.976+0000 7f96acc00640 1 -- start start 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.976+0000 7f96acc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96a806ea50 0x7f96a806ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.976+0000 7f96acc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a8067000 con 0x7f96a8066b50 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.976+0000 7f96acc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a806b990 con 0x7f96a8071b70 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96acc00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a806dbd0 con 0x7f96a806ea50 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f969fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f96a8066b50 0x7f96a806e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56952/0 (socket says 172.21.15.18:56952) 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f969fe00640 1 -- 172.21.15.18:0/1848968102 learned_addr learned my addr 172.21.15.18:0/1848968102 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a6800640 1 --2- 172.21.15.18:0/1848968102 >> v2:172.21.15.18:3300/0 conn(0x7f96a806ea50 0x7f96a806ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506749277 0 0) 0x7f96a8067000 con 0x7f96a8066b50 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c003530 con 0x7f96a8066b50 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234821921 0 0) 0x7f96a806b990 con 0x7f96a8071b70 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a6800640 1 -- 172.21.15.18:0/1848968102 >> v1:172.21.15.167:6789/0 conn(0x7f96a8071b70 legacy=0x7f96a8071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a6800640 1 -- 172.21.15.18:0/1848968102 >> v1:172.21.15.18:6789/0 conn(0x7f96a8066b50 legacy=0x7f96a806e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a6800640 1 -- 172.21.15.18:0/1848968102 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a806bc70 con 0x7f96a806ea50 2024-04-25T10:14:15.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a6800640 1 --2- 172.21.15.18:0/1848968102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a806ea50 0x7f96a806ee60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009d90 tx=0x7f96a001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ed8cb73dace796 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.980+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00b2070 con 0x7f96a806ea50 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a00a5910 con 0x7f96a806ea50 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a5400640 1 -- 172.21.15.18:0/1848968102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00a5ce0 con 0x7f96a806ea50 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- 172.21.15.18:0/1848968102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a806ea50 msgr2=0x7f96a806ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 --2- 172.21.15.18:0/1848968102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a806ea50 0x7f96a806ee60 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009d90 tx=0x7f96a001c940 comp rx=0 tx=0).stop 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- 172.21.15.18:0/1848968102 shutdown_connections 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 --2- 172.21.15.18:0/1848968102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a806ea50 0x7f96a806ee60 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- 172.21.15.18:0/1848968102 >> 172.21.15.18:0/1848968102 conn(0x7f96a80cfd80 msgr2=0x7f96a80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- 172.21.15.18:0/1848968102 shutdown_connections 2024-04-25T10:14:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- 172.21.15.18:0/1848968102 wait complete. 2024-04-25T10:14:15.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 Processor -- start 2024-04-25T10:14:15.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- start start 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96a8066b50 0x7f96a814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 0x7f96a8152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80b4e80 con 0x7f96a8071b70 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a80b4d00 con 0x7f96a806ea50 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96acc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a815deb0 con 0x7f96a8066b50 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33572/0 (socket says 172.21.15.18:33572) 2024-04-25T10:14:15.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 -- 172.21.15.18:0/3997700916 learned_addr learned my addr 172.21.15.18:0/3997700916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a5e00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96a8066b50 0x7f96a814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f969fe00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 0x7f96a8152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 -- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96a8066b50 msgr2=0x7f96a814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96a8066b50 0x7f96a814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 -- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 msgr2=0x7f96a8152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 0x7f96a8152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f96a6800640 1 -- 172.21.15.18:0/3997700916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a8153790 con 0x7f96a8071b70 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.984+0000 7f969fe00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 0x7f96a8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f96a6800640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f96a00b0040 tx=0x7f96a00196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00c0070 con 0x7f96a8071b70 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a0003ba0 con 0x7f96a8071b70 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a00b2040 con 0x7f96a8071b70 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a8153aa0 con 0x7f96a8071b70 2024-04-25T10:14:15.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a814e8c0 con 0x7f96a8071b70 2024-04-25T10:14:15.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a80745d0 con 0x7f96a8071b70 2024-04-25T10:14:15.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96a00c3070 con 0x7f96a8071b70 2024-04-25T10:14:15.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 0x7f9684069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:15.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f96a011f120 con 0x7f96a8071b70 2024-04-25T10:14:15.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.988+0000 7f96a5e00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 0x7f9684069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:15.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.992+0000 7f96a5e00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 0x7f9684069450 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9698007fd0 tx=0x7f9698009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:16.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:15.992+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96a8153aa0 con 0x7f96a8071b70 2024-04-25T10:14:16.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.156+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f96a80ce170 con 0x7f96a8071b70 2024-04-25T10:14:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f969e000640 1 -- 172.21.15.18:0/3997700916 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) v1 ==== 138+0+0 (secure 0 0 0) 0x7f96a0016560 con 0x7f96a8071b70 2024-04-25T10:14:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 msgr2=0x7f9684069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 0x7f9684069450 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9698007fd0 tx=0x7f9698009040 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 msgr2=0x7f96a8153250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f96a00b0040 tx=0x7f96a00196e0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 shutdown_connections 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96a8071b70 0x7f96a8153250 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96a806ea50 0x7f96a8152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9684066f90 0x7f9684069450 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 --2- 172.21.15.18:0/3997700916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96a8066b50 0x7f96a814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 >> 172.21.15.18:0/3997700916 conn(0x7f96a80cfd80 msgr2=0x7f96a80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 shutdown_connections 2024-04-25T10:14:16.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.368+0000 7f96acc00640 1 -- 172.21.15.18:0/3997700916 wait complete. 2024-04-25T10:14:16.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T10:14:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 Processor -- start 2024-04-25T10:14:16.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 -- start start 2024-04-25T10:14:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe610159320 0x7fe61015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe61006e4a0 0x7fe61006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61015fc00 con 0x7fe61015f440 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61006d640 con 0x7fe61006e4a0 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe618400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015fee0 con 0x7fe610159320 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe61006e4a0 0x7fe61006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe61006e4a0 0x7fe61006e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33588/0 (socket says 172.21.15.18:33588) 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 -- 172.21.15.18:0/3980432024 learned_addr learned my addr 172.21.15.18:0/3980432024 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe615a00640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe610159320 0x7fe61015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 -- 172.21.15.18:0/3980432024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe610159320 msgr2=0x7fe61015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe610159320 0x7fe61015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 -- 172.21.15.18:0/3980432024 >> v1:172.21.15.167:6789/0 conn(0x7fe61015f440 legacy=0x7fe61006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.544+0000 7fe616400640 1 -- 172.21.15.18:0/3980432024 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6101601c0 con 0x7fe61006e4a0 2024-04-25T10:14:16.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe616400640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61006e4a0 0x7fe61006e930 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe60801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df240da7736c1e4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe60fe00640 1 -- 172.21.15.18:0/3980432024 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080a56f0 con 0x7fe61006e4a0 2024-04-25T10:14:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe60fe00640 1 -- 172.21.15.18:0/3980432024 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080a5890 con 0x7fe61006e4a0 2024-04-25T10:14:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe60fe00640 1 -- 172.21.15.18:0/3980432024 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080a5c60 con 0x7fe61006e4a0 2024-04-25T10:14:16.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- 172.21.15.18:0/3980432024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61006e4a0 msgr2=0x7fe61006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61006e4a0 0x7fe61006e930 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7fe608009e50 tx=0x7fe60801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- 172.21.15.18:0/3980432024 shutdown_connections 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61006e4a0 0x7fe61006e930 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 --2- 172.21.15.18:0/3980432024 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe610159320 0x7fe61015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- 172.21.15.18:0/3980432024 >> 172.21.15.18:0/3980432024 conn(0x7fe610067080 msgr2=0x7fe61006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- 172.21.15.18:0/3980432024 shutdown_connections 2024-04-25T10:14:16.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- 172.21.15.18:0/3980432024 wait complete. 2024-04-25T10:14:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 Processor -- start 2024-04-25T10:14:16.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.548+0000 7fe618400640 1 -- start start 2024-04-25T10:14:16.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 0x7fe61015b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 0x7fe6100b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015f9a0 con 0x7fe61015f440 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015f820 con 0x7fe610159320 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe610168590 con 0x7fe61006e4a0 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33590/0 (socket says 172.21.15.18:33590) 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 -- 172.21.15.18:0/985131472 learned_addr learned my addr 172.21.15.18:0/985131472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe615000640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 0x7fe6100b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe615a00640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 0x7fe61015b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 -- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 msgr2=0x7fe61015b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 0x7fe61015b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 -- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 msgr2=0x7fe6100b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 0x7fe6100b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 -- 172.21.15.18:0/985131472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6101440f0 con 0x7fe61015f440 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe615a00640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 0x7fe61015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe615000640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 0x7fe6100b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe616400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af040 tx=0x7fe608019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080bc020 con 0x7fe61015f440 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6080b8670 con 0x7fe61015f440 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080b8a40 con 0x7fe61015f440 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6101443d0 con 0x7fe61015f440 2024-04-25T10:14:16.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe610144990 con 0x7fe61015f440 2024-04-25T10:14:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.552+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6100745d0 con 0x7fe61015f440 2024-04-25T10:14:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.556+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe6080bf020 con 0x7fe61015f440 2024-04-25T10:14:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.556+0000 7fe60d600640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 0x7fe5f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.556+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fe608120640 con 0x7fe61015f440 2024-04-25T10:14:16.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.556+0000 7fe615a00640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 0x7fe5f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:16.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.556+0000 7fe615a00640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 0x7fe5f0069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe604007a70 tx=0x7fe604008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.560+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6080c6030 con 0x7fe61015f440 2024-04-25T10:14:16.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:16.724+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe61006ebc0 con 0x7fe61015f440 2024-04-25T10:14:17.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.372+0000 7fe60d600640 1 -- 172.21.15.18:0/985131472 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe608016620 con 0x7fe61015f440 2024-04-25T10:14:17.382 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-04-25T10:14:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 msgr2=0x7fe5f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 0x7fe5f0069420 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe604007a70 tx=0x7fe604008040 comp rx=0 tx=0).stop 2024-04-25T10:14:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 msgr2=0x7fe6100b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:17.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7fe6080af040 tx=0x7fe608019740 comp rx=0 tx=0).stop 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 shutdown_connections 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe61015f440 0x7fe6100b3600 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe610159320 0x7fe6100b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe5f0066f60 0x7fe5f0069420 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 --2- 172.21.15.18:0/985131472 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe61006e4a0 0x7fe61015b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.376+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 >> 172.21.15.18:0/985131472 conn(0x7fe610067080 msgr2=0x7fe61015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:17.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.380+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 shutdown_connections 2024-04-25T10:14:17.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.380+0000 7fe618400640 1 -- 172.21.15.18:0/985131472 wait complete. 2024-04-25T10:14:17.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T10:14:17.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.564+0000 7fbdcbe00640 1 Processor -- start 2024-04-25T10:14:17.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.564+0000 7fbdcbe00640 1 -- start start 2024-04-25T10:14:17.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc06d880 0x7fbdcc0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcbe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdcc1437c0 con 0x7fbdcc1433e0 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcbe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdcc0710e0 con 0x7fbdcc0b4290 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcbe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0713c0 con 0x7fbdcc06d880 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33592/0 (socket says 172.21.15.18:33592) 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 -- 172.21.15.18:0/1668411680 learned_addr learned my addr 172.21.15.18:0/1668411680 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdc2000640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc06d880 0x7fbdcc0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 -- 172.21.15.18:0/1668411680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc06d880 msgr2=0x7fbdcc0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc06d880 0x7fbdcc0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 -- 172.21.15.18:0/1668411680 >> v1:172.21.15.167:6789/0 conn(0x7fbdcc1433e0 legacy=0x7fbdcc06d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:17.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.568+0000 7fbdcb400640 1 -- 172.21.15.18:0/1668411680 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc0716a0 con 0x7fbdcc0b4290 2024-04-25T10:14:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcb400640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009870 tx=0x7fbdc401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c11aabda797ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdca000640 1 -- 172.21.15.18:0/1668411680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40b0070 con 0x7fbdcc0b4290 2024-04-25T10:14:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdca000640 1 -- 172.21.15.18:0/1668411680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc40ab600 con 0x7fbdcc0b4290 2024-04-25T10:14:17.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdca000640 1 -- 172.21.15.18:0/1668411680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40ab9d0 con 0x7fbdcc0b4290 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- 172.21.15.18:0/1668411680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc0b4290 msgr2=0x7fbdcc0b25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009870 tx=0x7fbdc401c4f0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- 172.21.15.18:0/1668411680 shutdown_connections 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc0b25c0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/1668411680 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc06d880 0x7fbdcc0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- 172.21.15.18:0/1668411680 >> 172.21.15.18:0/1668411680 conn(0x7fbdcc066fa0 msgr2=0x7fbdcc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- 172.21.15.18:0/1668411680 shutdown_connections 2024-04-25T10:14:17.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- 172.21.15.18:0/1668411680 wait complete. 2024-04-25T10:14:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 Processor -- start 2024-04-25T10:14:17.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- start start 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc1433e0 0x7fbdcc15bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b4880 con 0x7fbdcc06d880 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0b4700 con 0x7fbdcc0b4290 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcbe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdcc0cc010 con 0x7fbdcc1433e0 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.572+0000 7fbdcaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33598/0 (socket says 172.21.15.18:33598) 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 -- 172.21.15.18:0/3192717075 learned_addr learned my addr 172.21.15.18:0/3192717075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdc2000640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcb400640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc1433e0 0x7fbdcc15bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 -- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc1433e0 msgr2=0x7fbdcc15bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc1433e0 0x7fbdcc15bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 -- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdcc0b4290 msgr2=0x7fbdcc15b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc15b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 -- 172.21.15.18:0/3192717075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdcc13a4c0 con 0x7fbdcc06d880 2024-04-25T10:14:17.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcaa00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00ba50 tx=0x7fbdbc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc019070 con 0x7fbdcc06d880 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdbc00cc20 con 0x7fbdcc06d880 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdcc1420f0 con 0x7fbdcc06d880 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc014680 con 0x7fbdcc06d880 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdcc15c540 con 0x7fbdcc06d880 2024-04-25T10:14:17.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdcc0745d0 con 0x7fbdcc06d880 2024-04-25T10:14:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.576+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbdbc01c070 con 0x7fbdcc06d880 2024-04-25T10:14:17.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.580+0000 7fbdc3400640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 0x7fbda8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.580+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fbdbc0855e0 con 0x7fbdcc06d880 2024-04-25T10:14:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.580+0000 7fbdc2000640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 0x7fbda8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:17.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.580+0000 7fbdc2000640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 0x7fbda8069450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0cb5f0 tx=0x7fbdb4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:17.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.580+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbdbc055ee0 con 0x7fbdcc06d880 2024-04-25T10:14:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:17.780+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbdcc15e050 con 0x7fbdcc06d880 2024-04-25T10:14:18.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.388+0000 7fbdc3400640 1 -- 172.21.15.18:0/3192717075 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v97) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbdbc059f80 con 0x7fbdcc06d880 2024-04-25T10:14:18.404 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 17 and data pool 18 2024-04-25T10:14:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.400+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 msgr2=0x7fbda8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.400+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 0x7fbda8069450 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc0cb5f0 tx=0x7fbdb4008040 comp rx=0 tx=0).stop 2024-04-25T10:14:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.400+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 msgr2=0x7fbdcc139f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.400+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc00ba50 tx=0x7fbdbc00bf10 comp rx=0 tx=0).stop 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 shutdown_connections 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbda8066f90 0x7fbda8069450 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbdcc1433e0 0x7fbdcc15bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbdcc0b4290 0x7fbdcc15b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 --2- 172.21.15.18:0/3192717075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbdcc06d880 0x7fbdcc139f80 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 >> 172.21.15.18:0/3192717075 conn(0x7fbdcc066fa0 msgr2=0x7fbdcc15a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 shutdown_connections 2024-04-25T10:14:18.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.404+0000 7fbdcbe00640 1 -- 172.21.15.18:0/3192717075 wait complete. 2024-04-25T10:14:18.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:18.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.580+0000 7fa174c00640 1 Processor -- start 2024-04-25T10:14:18.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 -- start start 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa17015b890 0x7fa1700adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa17006eb20 0x7fa1700ae500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa17015c1f0 con 0x7fa1700cc260 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17015c4d0 con 0x7fa17015b890 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa174c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17015c7b0 con 0x7fa17006eb20 2024-04-25T10:14:18.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa17015b890 0x7fa1700adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa17015b890 0x7fa1700adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33614/0 (socket says 172.21.15.18:33614) 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 -- 172.21.15.18:0/1794790154 learned_addr learned my addr 172.21.15.18:0/1794790154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16fe00640 1 --2- 172.21.15.18:0/1794790154 >> v2:172.21.15.167:3300/0 conn(0x7fa17006eb20 0x7fa1700ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 -- 172.21.15.18:0/1794790154 >> v2:172.21.15.167:3300/0 conn(0x7fa17006eb20 msgr2=0x7fa1700ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 --2- 172.21.15.18:0/1794790154 >> v2:172.21.15.167:3300/0 conn(0x7fa17006eb20 0x7fa1700ae500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 -- 172.21.15.18:0/1794790154 >> v1:172.21.15.167:6789/0 conn(0x7fa1700cc260 legacy=0x7fa1700acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:18.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.584+0000 7fa16f400640 1 -- 172.21.15.18:0/1794790154 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17015ca90 con 0x7fa17015b890 2024-04-25T10:14:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa16f400640 1 --2- 172.21.15.18:0/1794790154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa17015b890 0x7fa1700adfc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa170070470 tx=0x7fa16001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69409c84fcc701a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa16ea00640 1 -- 172.21.15.18:0/1794790154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600aa430 con 0x7fa17015b890 2024-04-25T10:14:18.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa16ea00640 1 -- 172.21.15.18:0/1794790154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1600af070 con 0x7fa17015b890 2024-04-25T10:14:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa16ea00640 1 -- 172.21.15.18:0/1794790154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1600aa7f0 con 0x7fa17015b890 2024-04-25T10:14:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- 172.21.15.18:0/1794790154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa17015b890 msgr2=0x7fa1700adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 --2- 172.21.15.18:0/1794790154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa17015b890 0x7fa1700adfc0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fa170070470 tx=0x7fa16001c4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- 172.21.15.18:0/1794790154 shutdown_connections 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 --2- 172.21.15.18:0/1794790154 >> v2:172.21.15.167:3300/0 conn(0x7fa17006eb20 0x7fa1700ae500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 --2- 172.21.15.18:0/1794790154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa17015b890 0x7fa1700adfc0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- 172.21.15.18:0/1794790154 >> 172.21.15.18:0/1794790154 conn(0x7fa1700726f0 msgr2=0x7fa17006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- 172.21.15.18:0/1794790154 shutdown_connections 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- 172.21.15.18:0/1794790154 wait complete. 2024-04-25T10:14:18.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 Processor -- start 2024-04-25T10:14:18.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.588+0000 7fa174c00640 1 -- start start 2024-04-25T10:14:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa17006eb20 0x7fa170153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa17015b890 0x7fa17013deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1701689c0 con 0x7fa1700cc260 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa170168840 con 0x7fa17006eb20 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa170168b40 con 0x7fa17015b890 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33630/0 (socket says 172.21.15.18:33630) 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 -- 172.21.15.18:0/2621437897 learned_addr learned my addr 172.21.15.18:0/2621437897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa16f400640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa17006eb20 0x7fa170153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa16fe00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa17015b890 0x7fa17013deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 -- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa17015b890 msgr2=0x7fa17013deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa17015b890 0x7fa17013deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 -- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa17006eb20 msgr2=0x7fa170153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa17006eb20 0x7fa170153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 -- 172.21.15.18:0/2621437897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17013e3f0 con 0x7fa1700cc260 2024-04-25T10:14:18.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167e00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa15800c450 tx=0x7fa15800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158012830 con 0x7fa1700cc260 2024-04-25T10:14:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa158017070 con 0x7fa1700cc260 2024-04-25T10:14:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158012c30 con 0x7fa1700cc260 2024-04-25T10:14:18.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa170159300 con 0x7fa1700cc260 2024-04-25T10:14:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1701598c0 con 0x7fa1700cc260 2024-04-25T10:14:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17004efa0 con 0x7fa1700cc260 2024-04-25T10:14:18.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.592+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa15801c460 con 0x7fa1700cc260 2024-04-25T10:14:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.596+0000 7fa167400640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 0x7fa14c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.596+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa158084ea0 con 0x7fa1700cc260 2024-04-25T10:14:18.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.596+0000 7fa16f400640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 0x7fa14c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.596+0000 7fa16f400640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 0x7fa14c069420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa1600ae000 tx=0x7fa1600a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.600+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa158055d10 con 0x7fa1700cc260 2024-04-25T10:14:18.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.760+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa170072bd0 con 0x7fa1700cc260 2024-04-25T10:14:18.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.760+0000 7fa167400640 1 -- 172.21.15.18:0/2621437897 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fa158055610 con 0x7fa1700cc260 2024-04-25T10:14:18.768 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:18.769 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":122,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:17.787381+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:18.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 msgr2=0x7fa14c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 0x7fa14c069420 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fa1600ae000 tx=0x7fa1600a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 msgr2=0x7fa170158bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa15800c450 tx=0x7fa15800c910 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 shutdown_connections 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa14c066f60 0x7fa14c069420 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa17015b890 0x7fa17013deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1700cc260 0x7fa170158bd0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 --2- 172.21.15.18:0/2621437897 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa17006eb20 0x7fa170153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 >> 172.21.15.18:0/2621437897 conn(0x7fa1700726f0 msgr2=0x7fa170154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 shutdown_connections 2024-04-25T10:14:18.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.764+0000 7fa174c00640 1 -- 172.21.15.18:0/2621437897 wait complete. 2024-04-25T10:14:18.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:18.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 Processor -- start 2024-04-25T10:14:18.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 -- start start 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f16c0145270 0x7f16c015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f16c00cd4d0 0x7f16c00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c00cc4e0 con 0x7f16c00b1750 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c0145650 con 0x7f16c00cd4d0 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c7200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c00ce040 con 0x7f16c0145270 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16b7400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f16c00cd4d0 0x7f16c00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c5200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f16c00b1750 0x7f16c00b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56966/0 (socket says 172.21.15.18:56966) 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16c5200640 1 -- 172.21.15.18:0/385716190 learned_addr learned my addr 172.21.15.18:0/385716190 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:18.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16bfe00640 1 --2- 172.21.15.18:0/385716190 >> v2:172.21.15.167:3300/0 conn(0x7f16c0145270 0x7f16c015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16b7400640 1 -- 172.21.15.18:0/385716190 >> v2:172.21.15.167:3300/0 conn(0x7f16c0145270 msgr2=0x7f16c015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16b7400640 1 --2- 172.21.15.18:0/385716190 >> v2:172.21.15.167:3300/0 conn(0x7f16c0145270 0x7f16c015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16b7400640 1 -- 172.21.15.18:0/385716190 >> v1:172.21.15.18:6789/0 conn(0x7f16c00b1750 legacy=0x7f16c00b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.924+0000 7f16b7400640 1 -- 172.21.15.18:0/385716190 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00ce320 con 0x7f16c00cd4d0 2024-04-25T10:14:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16b7400640 1 --2- 172.21.15.18:0/385716190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00cd4d0 0x7f16c00cd930 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f16c006f3a0 tx=0x7f16a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5325a93c4e7e3ce0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16bf400640 1 -- 172.21.15.18:0/385716190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80b0070 con 0x7f16c00cd4d0 2024-04-25T10:14:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16bf400640 1 -- 172.21.15.18:0/385716190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a80ab600 con 0x7f16c00cd4d0 2024-04-25T10:14:18.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16bf400640 1 -- 172.21.15.18:0/385716190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a80ab9d0 con 0x7f16c00cd4d0 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 -- 172.21.15.18:0/385716190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00cd4d0 msgr2=0x7f16c00cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 --2- 172.21.15.18:0/385716190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00cd4d0 0x7f16c00cd930 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f16c006f3a0 tx=0x7f16a801c480 comp rx=0 tx=0).stop 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 -- 172.21.15.18:0/385716190 shutdown_connections 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 --2- 172.21.15.18:0/385716190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00cd4d0 0x7f16c00cd930 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 --2- 172.21.15.18:0/385716190 >> v2:172.21.15.167:3300/0 conn(0x7f16c0145270 0x7f16c015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 -- 172.21.15.18:0/385716190 >> 172.21.15.18:0/385716190 conn(0x7f16c0066fa0 msgr2=0x7f16c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 -- 172.21.15.18:0/385716190 shutdown_connections 2024-04-25T10:14:18.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.928+0000 7f16c7200640 1 -- 172.21.15.18:0/385716190 wait complete. 2024-04-25T10:14:18.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 Processor -- start 2024-04-25T10:14:18.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- start start 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c00cd4d0 0x7f16c0160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16c0145270 0x7f16c0161410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015c710 con 0x7f16c00b1750 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015c590 con 0x7f16c00cd4d0 2024-04-25T10:14:18.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c015c890 con 0x7f16c0145270 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33660/0 (socket says 172.21.15.18:33660) 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 -- 172.21.15.18:0/3145499684 learned_addr learned my addr 172.21.15.18:0/3145499684 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16b7400640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c00cd4d0 0x7f16c0160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c5200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16c0145270 0x7f16c0161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 -- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16c0145270 msgr2=0x7f16c0161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16c0145270 0x7f16c0161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 -- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c00cd4d0 msgr2=0x7f16c0160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c00cd4d0 0x7f16c0160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 -- 172.21.15.18:0/3145499684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0140b60 con 0x7f16c00b1750 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bfe00640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e870 tx=0x7f16b000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0017070 con 0x7f16c00b1750 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b000c940 con 0x7f16c00b1750 2024-04-25T10:14:18.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b000ccf0 con 0x7f16c00b1750 2024-04-25T10:14:18.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c0140e40 con 0x7f16c00b1750 2024-04-25T10:14:18.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c0141400 con 0x7f16c00b1750 2024-04-25T10:14:18.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.932+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c00745d0 con 0x7f16c00b1750 2024-04-25T10:14:18.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.936+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16b001a070 con 0x7f16c00b1750 2024-04-25T10:14:18.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.936+0000 7f16bcc00640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 0x7f169c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:18.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.936+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f16b00853d0 con 0x7f16c00b1750 2024-04-25T10:14:18.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.936+0000 7f16b7400640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 0x7f169c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:18.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.936+0000 7f16b7400640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 0x7f169c069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f16a80ad000 tx=0x7f16a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:18.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:18.940+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f16b0055b60 con 0x7f16c00b1750 2024-04-25T10:14:19.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.104+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16c006b8e0 con 0x7f16c00b1750 2024-04-25T10:14:19.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16bcc00640 1 -- 172.21.15.18:0/3145499684 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f16b0059c00 con 0x7f16c00b1750 2024-04-25T10:14:19.114 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:19.114 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":122,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:17.787381+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 msgr2=0x7f169c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 0x7f169c069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f16a80ad000 tx=0x7f16a8008040 comp rx=0 tx=0).stop 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 msgr2=0x7f16c013ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e870 tx=0x7f16b000ec70 comp rx=0 tx=0).stop 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 shutdown_connections 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f169c066f60 0x7f169c069420 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f16c0145270 0x7f16c0161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f16c00cd4d0 0x7f16c0160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 --2- 172.21.15.18:0/3145499684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f16c00b1750 0x7f16c013ff10 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 >> 172.21.15.18:0/3145499684 conn(0x7f16c0066fa0 msgr2=0x7f16c00b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 shutdown_connections 2024-04-25T10:14:19.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.108+0000 7f16c7200640 1 -- 172.21.15.18:0/3145499684 wait complete. 2024-04-25T10:14:19.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T10:14:19.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 Processor -- start 2024-04-25T10:14:19.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 -- start start 2024-04-25T10:14:19.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96d40b3090 0x7f96d40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:19.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d415bc40 con 0x7f96d415acd0 2024-04-25T10:14:19.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d415b3a0 con 0x7f96d4144120 2024-04-25T10:14:19.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96db000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d415e490 con 0x7f96d40b3090 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96d9000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f96d40b3090 0x7f96d40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96cb400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f96d415acd0 0x7f96d415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56968/0 (socket says 172.21.15.18:56968) 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.272+0000 7f96cb400640 1 -- 172.21.15.18:0/900563536 learned_addr learned my addr 172.21.15.18:0/900563536 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d9000640 1 -- 172.21.15.18:0/900563536 >> v1:172.21.15.167:6789/0 conn(0x7f96d4144120 legacy=0x7f96d40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d9000640 1 -- 172.21.15.18:0/900563536 >> v1:172.21.15.18:6789/0 conn(0x7f96d415acd0 legacy=0x7f96d415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d9000640 1 -- 172.21.15.18:0/900563536 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d415b680 con 0x7f96d40b3090 2024-04-25T10:14:19.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d9000640 1 --2- 172.21.15.18:0/900563536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d40b3520 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009d90 tx=0x7f96cc01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201fc3a88a4e6c75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:19.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d3400640 1 -- 172.21.15.18:0/900563536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0b2070 con 0x7f96d40b3090 2024-04-25T10:14:19.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d3400640 1 -- 172.21.15.18:0/900563536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc0a5850 con 0x7f96d40b3090 2024-04-25T10:14:19.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96d3400640 1 -- 172.21.15.18:0/900563536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0a5c20 con 0x7f96d40b3090 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96db000640 1 -- 172.21.15.18:0/900563536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 msgr2=0x7f96d40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.276+0000 7f96db000640 1 --2- 172.21.15.18:0/900563536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d40b3520 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009d90 tx=0x7f96cc01c8a0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- 172.21.15.18:0/900563536 shutdown_connections 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 --2- 172.21.15.18:0/900563536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d40b3520 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- 172.21.15.18:0/900563536 >> 172.21.15.18:0/900563536 conn(0x7f96d4067080 msgr2=0x7f96d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- 172.21.15.18:0/900563536 shutdown_connections 2024-04-25T10:14:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- 172.21.15.18:0/900563536 wait complete. 2024-04-25T10:14:19.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 Processor -- start 2024-04-25T10:14:19.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- start start 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 0x7f96d4138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 0x7f96d4139560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d41685d0 con 0x7f96d40b3090 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4168450 con 0x7f96d415acd0 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d4168750 con 0x7f96d4144120 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33684/0 (socket says 172.21.15.18:33684) 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 -- 172.21.15.18:0/2095794803 learned_addr learned my addr 172.21.15.18:0/2095794803 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96cb400640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 0x7f96d4138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 -- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 msgr2=0x7f96d4138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d9000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 0x7f96d4139560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 0x7f96d4138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 -- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 msgr2=0x7f96d4139560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 0x7f96d4139560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 -- 172.21.15.18:0/2095794803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d413a900 con 0x7f96d40b3090 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96cb400640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 0x7f96d4138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d9000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 0x7f96d4139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d3e00640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c480 tx=0x7f96c400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4012830 con 0x7f96d40b3090 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c4017070 con 0x7f96d40b3090 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.280+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d413abe0 con 0x7f96d40b3090 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4012c30 con 0x7f96d40b3090 2024-04-25T10:14:19.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d4164950 con 0x7f96d40b3090 2024-04-25T10:14:19.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d40745d0 con 0x7f96d40b3090 2024-04-25T10:14:19.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96c401c460 con 0x7f96d40b3090 2024-04-25T10:14:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96d0c00640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 0x7f96b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f96c4084fe0 con 0x7f96d40b3090 2024-04-25T10:14:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.284+0000 7f96cb400640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 0x7f96b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:19.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.288+0000 7f96cb400640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 0x7f96b0069450 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f96d413cbe0 tx=0x7f96bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:19.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.288+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96c4055e50 con 0x7f96d40b3090 2024-04-25T10:14:19.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:19.492+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f96d40ae9a0 con 0x7f96d40b3090 2024-04-25T10:14:20.375 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:14:20.371+0000 7f94dca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:14:20.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.404+0000 7f96d0c00640 1 -- 172.21.15.18:0/2095794803 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) v1 ==== 118+0+0 (secure 0 0 0) 0x7f96c4055750 con 0x7f96d40b3090 2024-04-25T10:14:20.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 msgr2=0x7f96b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 0x7f96b0069450 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f96d413cbe0 tx=0x7f96bc009040 comp rx=0 tx=0).stop 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 msgr2=0x7f96d415d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f96c400c480 tx=0x7f96c400c940 comp rx=0 tx=0).stop 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 shutdown_connections 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96d415acd0 0x7f96d4139560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f96b0066f90 0x7f96b0069450 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f96d4144120 0x7f96d4138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 --2- 172.21.15.18:0/2095794803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f96d40b3090 0x7f96d415d6c0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 >> 172.21.15.18:0/2095794803 conn(0x7f96d4067080 msgr2=0x7f96d40b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:20.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 shutdown_connections 2024-04-25T10:14:20.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.408+0000 7f96db000640 1 -- 172.21.15.18:0/2095794803 wait complete. 2024-04-25T10:14:20.441 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T10:14:20.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T10:14:20.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 Processor -- start 2024-04-25T10:14:20.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 -- start start 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4998159320 0x7f499815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f499815f440 0x7f499806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499815fc00 con 0x7f499806e010 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499806d640 con 0x7f499815f440 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f49a0400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499815fee0 con 0x7f4998159320 2024-04-25T10:14:20.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499d000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f499815f440 0x7f499806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499e400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f499806e010 0x7f499806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56984/0 (socket says 172.21.15.18:56984) 2024-04-25T10:14:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499e400640 1 -- 172.21.15.18:0/3287508680 learned_addr learned my addr 172.21.15.18:0/3287508680 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499d000640 1 -- 172.21.15.18:0/3287508680 >> v2:172.21.15.167:3300/0 conn(0x7f4998159320 msgr2=0x7f499815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499d000640 1 --2- 172.21.15.18:0/3287508680 >> v2:172.21.15.167:3300/0 conn(0x7f4998159320 0x7f499815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499d000640 1 -- 172.21.15.18:0/3287508680 >> v1:172.21.15.18:6789/0 conn(0x7f499806e010 legacy=0x7f499806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f4997e00640 1 -- 172.21.15.18:0/3287508680 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3530569977 0 0) 0x7f499815fc00 con 0x7f499806e010 2024-04-25T10:14:20.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.584+0000 7f499d000640 1 -- 172.21.15.18:0/3287508680 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49981601c0 con 0x7f499815f440 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f499d000640 1 --2- 172.21.15.18:0/3287508680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f499806dad0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f499806e470 tx=0x7f498401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c965ae6746c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f4997e00640 1 -- 172.21.15.18:0/3287508680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840b1070 con 0x7f499815f440 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f4997e00640 1 -- 172.21.15.18:0/3287508680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49840a8050 con 0x7f499815f440 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f4997e00640 1 -- 172.21.15.18:0/3287508680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49840ac860 con 0x7f499815f440 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 -- 172.21.15.18:0/3287508680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 msgr2=0x7f499806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 --2- 172.21.15.18:0/3287508680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f499806dad0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f499806e470 tx=0x7f498401c3c0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 -- 172.21.15.18:0/3287508680 shutdown_connections 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 --2- 172.21.15.18:0/3287508680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f499806dad0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 --2- 172.21.15.18:0/3287508680 >> v2:172.21.15.167:3300/0 conn(0x7f4998159320 0x7f499815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 -- 172.21.15.18:0/3287508680 >> 172.21.15.18:0/3287508680 conn(0x7f4998067080 msgr2=0x7f499806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 -- 172.21.15.18:0/3287508680 shutdown_connections 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 -- 172.21.15.18:0/3287508680 wait complete. 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.588+0000 7f49a0400640 1 Processor -- start 2024-04-25T10:14:20.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- start start 2024-04-25T10:14:20.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f499806e010 0x7f49981586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998159320 0x7f4998139bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998071c00 con 0x7f499815f440 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4998071a80 con 0x7f499806e010 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499806ebb0 con 0x7f4998159320 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33704/0 (socket says 172.21.15.18:33704) 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 -- 172.21.15.18:0/2369860791 learned_addr learned my addr 172.21.15.18:0/2369860791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499d000640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998159320 0x7f4998139bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499da00640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f499806e010 0x7f49981586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:20.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 -- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998159320 msgr2=0x7f4998139bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998159320 0x7f4998139bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 -- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f499806e010 msgr2=0x7f49981586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f499806e010 0x7f49981586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 -- 172.21.15.18:0/2369860791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4998140770 con 0x7f499815f440 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f499e400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f499000c7b0 tx=0x7f499000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990018070 con 0x7f499815f440 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f499000a640 con 0x7f499815f440 2024-04-25T10:14:20.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499000aa70 con 0x7f499815f440 2024-04-25T10:14:20.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4998140a50 con 0x7f499815f440 2024-04-25T10:14:20.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998141010 con 0x7f499815f440 2024-04-25T10:14:20.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.592+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49980745d0 con 0x7f499815f440 2024-04-25T10:14:20.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.596+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f499001b070 con 0x7f499815f440 2024-04-25T10:14:20.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.596+0000 7f4995600640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:20.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.596+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4990084730 con 0x7f499815f440 2024-04-25T10:14:20.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.596+0000 7f499da00640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:20.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.596+0000 7f499da00640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f498c006fd0 tx=0x7f498c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:20.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.600+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4990055640 con 0x7f499815f440 2024-04-25T10:14:20.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:20.796+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49980cd3a0 con 0x7f499815f440 2024-04-25T10:14:21.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f4995600640 1 -- 172.21.15.18:0/2369860791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4990054f40 con 0x7f499815f440 2024-04-25T10:14:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 msgr2=0x7f4978069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f498c006fd0 tx=0x7f498c008040 comp rx=0 tx=0).stop 2024-04-25T10:14:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 msgr2=0x7f4998156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f499000c7b0 tx=0x7f499000cc70 comp rx=0 tx=0).stop 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 shutdown_connections 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f499815f440 0x7f4998156af0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4978066f60 0x7f4978069420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4998159320 0x7f4998139bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 --2- 172.21.15.18:0/2369860791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f499806e010 0x7f49981586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 >> 172.21.15.18:0/2369860791 conn(0x7f4998067080 msgr2=0x7f4998073970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.408+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 shutdown_connections 2024-04-25T10:14:21.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.412+0000 7f49a0400640 1 -- 172.21.15.18:0/2369860791 wait complete. 2024-04-25T10:14:21.441 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T10:14:21.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:21.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.580+0000 7f5286e00640 1 Processor -- start 2024-04-25T10:14:21.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.580+0000 7f5286e00640 1 -- start start 2024-04-25T10:14:21.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5286e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52800cef30 0x7f528006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5286e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f528006e900 0x7f52800b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5286e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528015ac60 con 0x7f5280144140 2024-04-25T10:14:21.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5286e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528006ed30 con 0x7f528006e900 2024-04-25T10:14:21.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5286e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52800cf3e0 con 0x7f52800cef30 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f528006e900 0x7f52800b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f527fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5280144140 0x7f52800ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52334/0 (socket says 172.21.15.18:52334) 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f527fe00640 1 -- 172.21.15.18:0/3631013872 learned_addr learned my addr 172.21.15.18:0/3631013872 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5277e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52800cef30 0x7f528006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 -- 172.21.15.18:0/3631013872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52800cef30 msgr2=0x7f528006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52800cef30 0x7f528006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 -- 172.21.15.18:0/3631013872 >> v1:172.21.15.18:6789/0 conn(0x7f5280144140 legacy=0x7f52800ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 -- 172.21.15.18:0/3631013872 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528015af20 con 0x7f528006e900 2024-04-25T10:14:21.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.584+0000 7f5284e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f528006e900 0x7f52800b0760 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5278009d90 tx=0x7f527801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce736064b7b0aece server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f527f400640 1 -- 172.21.15.18:0/3631013872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780ad070 con 0x7f528006e900 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f527f400640 1 -- 172.21.15.18:0/3631013872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52780a9660 con 0x7f528006e900 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f527f400640 1 -- 172.21.15.18:0/3631013872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780a9a30 con 0x7f528006e900 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- 172.21.15.18:0/3631013872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f528006e900 msgr2=0x7f52800b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f528006e900 0x7f52800b0760 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5278009d90 tx=0x7f527801c970 comp rx=0 tx=0).stop 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- 172.21.15.18:0/3631013872 shutdown_connections 2024-04-25T10:14:21.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f528006e900 0x7f52800b0760 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- 172.21.15.18:0/3631013872 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52800cef30 0x7f528006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- 172.21.15.18:0/3631013872 >> 172.21.15.18:0/3631013872 conn(0x7f5280066fa0 msgr2=0x7f528006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:21.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- 172.21.15.18:0/3631013872 shutdown_connections 2024-04-25T10:14:21.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- 172.21.15.18:0/3631013872 wait complete. 2024-04-25T10:14:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 Processor -- start 2024-04-25T10:14:21.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- start start 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 0x7f5280141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280144140 0x7f528015c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528015ba00 con 0x7f52800cef30 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280144520 con 0x7f5280144140 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5286e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528015bb80 con 0x7f528006e900 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5277e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5277e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52046/0 (socket says 172.21.15.18:52046) 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5277e00640 1 -- 172.21.15.18:0/1568230464 learned_addr learned my addr 172.21.15.18:0/1568230464 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f5284e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280144140 0x7f528015c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.588+0000 7f527fe00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 0x7f5280141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 -- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 msgr2=0x7f5280141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 0x7f5280141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 -- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280144140 msgr2=0x7f528015c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280144140 0x7f528015c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 -- 172.21.15.18:0/1568230464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280162c10 con 0x7f52800cef30 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f527fe00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 0x7f5280141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:21.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5277e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f526800d7d0 tx=0x7f526800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800b6c0 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268019070 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800baa0 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f528012edd0 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5280162e90 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52800745d0 con 0x7f52800cef30 2024-04-25T10:14:21.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.592+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f526800bc40 con 0x7f52800cef30 2024-04-25T10:14:21.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.596+0000 7f527cc00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 0x7f525c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.596+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5268085730 con 0x7f52800cef30 2024-04-25T10:14:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.596+0000 7f527fe00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 0x7f525c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.596+0000 7f527fe00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 0x7f525c069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f70 tx=0x7f5270009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.600+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5280162c10 con 0x7f52800cef30 2024-04-25T10:14:21.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:14:21.706 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:14:21.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f528006c250 con 0x7f52800cef30 2024-04-25T10:14:21.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f527cc00640 1 -- 172.21.15.18:0/1568230464 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f5268056480 con 0x7f52800cef30 2024-04-25T10:14:21.806 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:21.806 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:20.801208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37337":{"gid":37337,"name":"d","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/2651841863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2651841863},{"type":"v1","addr":"172.21.15.167:6837","nonce":2651841863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:21.807 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 101 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 msgr2=0x7f525c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 0x7f525c069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5270000f70 tx=0x7f5270009040 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 msgr2=0x7f52801423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f526800d7d0 tx=0x7f526800dc90 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 shutdown_connections 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280144140 0x7f528015c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52800cef30 0x7f52801423b0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f525c066f60 0x7f525c069420 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 --2- 172.21.15.18:0/1568230464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f528006e900 0x7f5280141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 >> 172.21.15.18:0/1568230464 conn(0x7f5280066fa0 msgr2=0x7f5280142f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 shutdown_connections 2024-04-25T10:14:21.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.800+0000 7f5286e00640 1 -- 172.21.15.18:0/1568230464 wait complete. 2024-04-25T10:14:21.827 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:21.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.960+0000 7f881be00640 1 Processor -- start 2024-04-25T10:14:21.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.960+0000 7f881be00640 1 -- start start 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f881be00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f8814145270 0x7f881415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f881be00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140cd4d0 0x7f88140cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f881be00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88140cc4e0 con 0x7f88140b1750 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f881be00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8814145650 con 0x7f88140cd4d0 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f881be00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140ce040 con 0x7f8814145270 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140cd4d0 0x7f88140cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88140cd4d0 0x7f88140cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52056/0 (socket says 172.21.15.18:52056) 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 -- 172.21.15.18:0/669360149 learned_addr learned my addr 172.21.15.18:0/669360149 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:21.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8819400640 1 --2- 172.21.15.18:0/669360149 >> v2:172.21.15.167:3300/0 conn(0x7f8814145270 0x7f881415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 -- 172.21.15.18:0/669360149 >> v2:172.21.15.167:3300/0 conn(0x7f8814145270 msgr2=0x7f881415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 --2- 172.21.15.18:0/669360149 >> v2:172.21.15.167:3300/0 conn(0x7f8814145270 0x7f881415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 -- 172.21.15.18:0/669360149 >> v1:172.21.15.167:6789/0 conn(0x7f88140b1750 legacy=0x7f88140b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 -- 172.21.15.18:0/669360149 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140ce320 con 0x7f88140cd4d0 2024-04-25T10:14:21.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.964+0000 7f8818a00640 1 --2- 172.21.15.18:0/669360149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f88140cd930 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f881406f3a0 tx=0x7f880001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=263ee2c53c3a0d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8813e00640 1 -- 172.21.15.18:0/669360149 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000ab610 con 0x7f88140cd4d0 2024-04-25T10:14:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8813e00640 1 -- 172.21.15.18:0/669360149 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000b0070 con 0x7f88140cd4d0 2024-04-25T10:14:21.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8813e00640 1 -- 172.21.15.18:0/669360149 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000ab9d0 con 0x7f88140cd4d0 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- 172.21.15.18:0/669360149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 msgr2=0x7f88140cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- 172.21.15.18:0/669360149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f88140cd930 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f881406f3a0 tx=0x7f880001c520 comp rx=0 tx=0).stop 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- 172.21.15.18:0/669360149 shutdown_connections 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- 172.21.15.18:0/669360149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f88140cd930 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- 172.21.15.18:0/669360149 >> v2:172.21.15.167:3300/0 conn(0x7f8814145270 0x7f881415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- 172.21.15.18:0/669360149 >> 172.21.15.18:0/669360149 conn(0x7f8814066fa0 msgr2=0x7f881406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- 172.21.15.18:0/669360149 shutdown_connections 2024-04-25T10:14:21.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- 172.21.15.18:0/669360149 wait complete. 2024-04-25T10:14:21.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 Processor -- start 2024-04-25T10:14:21.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- start start 2024-04-25T10:14:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140b1750 0x7f8814142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 0x7f881413beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881415c710 con 0x7f88140cd4d0 2024-04-25T10:14:21.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881415c590 con 0x7f8814145270 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f881be00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881415c890 con 0x7f88140b1750 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8818a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8818a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52060/0 (socket says 172.21.15.18:52060) 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8818a00640 1 -- 172.21.15.18:0/1108162800 learned_addr learned my addr 172.21.15.18:0/1108162800 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8819400640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140b1750 0x7f8814142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.968+0000 7f8819e00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 0x7f881413beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 -- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140b1750 msgr2=0x7f8814142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140b1750 0x7f8814142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 -- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 msgr2=0x7f881413beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 0x7f881413beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 -- 172.21.15.18:0/1108162800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8814141ed0 con 0x7f88140cd4d0 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8819e00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 0x7f881413beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8818a00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f8800019130 tx=0x7f880001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000be5f0 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8814141950 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000be790 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88000beb40 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88141447e0 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88140745d0 con 0x7f88140cd4d0 2024-04-25T10:14:21.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88000b43f0 con 0x7f88140cd4d0 2024-04-25T10:14:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 0x7f87f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.972+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f880011f5f0 con 0x7f88140cd4d0 2024-04-25T10:14:21.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.976+0000 7f8819400640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 0x7f87f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:21.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.976+0000 7f8819400640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 0x7f87f4069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8808003ab0 tx=0x7f8808009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:21.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:21.976+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88000a8050 con 0x7f88140cd4d0 2024-04-25T10:14:22.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.140+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f881406b8e0 con 0x7f88140cd4d0 2024-04-25T10:14:22.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f8811600640 1 -- 172.21.15.18:0/1108162800 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f8800016110 con 0x7f88140cd4d0 2024-04-25T10:14:22.150 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:22.150 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":123,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:19.391780+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 msgr2=0x7f87f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 0x7f87f4069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8808003ab0 tx=0x7f8808009830 comp rx=0 tx=0).stop 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 msgr2=0x7f881406d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f8800019130 tx=0x7f880001ad60 comp rx=0 tx=0).stop 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 shutdown_connections 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814145270 0x7f881413beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88140cd4d0 0x7f881406d510 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f87f4066f60 0x7f87f4069420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 --2- 172.21.15.18:0/1108162800 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f88140b1750 0x7f8814142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 >> 172.21.15.18:0/1108162800 conn(0x7f8814066fa0 msgr2=0x7f881406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:22.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 shutdown_connections 2024-04-25T10:14:22.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.144+0000 7f881be00640 1 -- 172.21.15.18:0/1108162800 wait complete. 2024-04-25T10:14:22.171 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T10:14:22.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:14:22.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.304+0000 7f6ae3000640 1 Processor -- start 2024-04-25T10:14:22.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.304+0000 7f6ae3000640 1 -- start start 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae3000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f6adc06edc0 0x7f6adc06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae3000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc06d6f0 con 0x7f6adc0b22d0 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae3000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc06d9d0 con 0x7f6adc071690 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae3000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc06dcb0 con 0x7f6adc06edc0 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ad3400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6adc0b22d0 0x7f6adc0acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52340/0 (socket says 172.21.15.18:52340) 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ad3400640 1 -- 172.21.15.18:0/3769384345 learned_addr learned my addr 172.21.15.18:0/3769384345 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae1000640 1 --2- 172.21.15.18:0/3769384345 >> v2:172.21.15.167:3300/0 conn(0x7f6adc06edc0 0x7f6adc06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332439874 0 0) 0x7f6adc06d6f0 con 0x7f6adc0b22d0 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac0003530 con 0x7f6adc0b22d0 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176969062 0 0) 0x7f6adc06d9d0 con 0x7f6adc071690 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc06d6f0 con 0x7f6adc071690 2024-04-25T10:14:22.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae1000640 1 -- 172.21.15.18:0/3769384345 >> v1:172.21.15.167:6789/0 conn(0x7f6adc071690 legacy=0x7f6adc071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae1000640 1 -- 172.21.15.18:0/3769384345 >> v1:172.21.15.18:6789/0 conn(0x7f6adc0b22d0 legacy=0x7f6adc0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307475034 0 0) 0x7f6ac0003530 con 0x7f6adc0b22d0 2024-04-25T10:14:22.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.308+0000 7f6ae1000640 1 -- 172.21.15.18:0/3769384345 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc06df90 con 0x7f6adc06edc0 2024-04-25T10:14:22.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae1000640 1 --2- 172.21.15.18:0/3769384345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc06edc0 0x7f6adc06e790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009d90 tx=0x7f6ad401c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0380b9dde289bbe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40b2070 con 0x7f6adc06edc0 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad40a55c0 con 0x7f6adc06edc0 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6adb400640 1 -- 172.21.15.18:0/3769384345 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4001680 con 0x7f6adc06edc0 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- 172.21.15.18:0/3769384345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc06edc0 msgr2=0x7f6adc06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 --2- 172.21.15.18:0/3769384345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc06edc0 0x7f6adc06e790 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4009d90 tx=0x7f6ad401c860 comp rx=0 tx=0).stop 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- 172.21.15.18:0/3769384345 shutdown_connections 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 --2- 172.21.15.18:0/3769384345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc06edc0 0x7f6adc06e790 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- 172.21.15.18:0/3769384345 >> 172.21.15.18:0/3769384345 conn(0x7f6adc0b17b0 msgr2=0x7f6adc0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- 172.21.15.18:0/3769384345 shutdown_connections 2024-04-25T10:14:22.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- 172.21.15.18:0/3769384345 wait complete. 2024-04-25T10:14:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 Processor -- start 2024-04-25T10:14:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- start start 2024-04-25T10:14:22.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6adc071690 0x7f6adc13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 0x7f6adc153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16b980 con 0x7f6adc06edc0 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16b800 con 0x7f6adc0b22d0 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.312+0000 7f6ae3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16bb00 con 0x7f6adc071690 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52076/0 (socket says 172.21.15.18:52076) 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 -- 172.21.15.18:0/411032730 learned_addr learned my addr 172.21.15.18:0/411032730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ae1000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 0x7f6adc153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 -- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6adc071690 msgr2=0x7f6adc13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6adc071690 0x7f6adc13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 -- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 msgr2=0x7f6adc153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 0x7f6adc153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 -- 172.21.15.18:0/411032730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0cff70 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ae1000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 0x7f6adc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6adbe00640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c490 tx=0x7f6acc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc0052d0 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6acc005470 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6acc012870 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc154b50 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc155110 con 0x7f6adc06edc0 2024-04-25T10:14:22.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0745d0 con 0x7f6adc06edc0 2024-04-25T10:14:22.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.316+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6acc012a10 con 0x7f6adc06edc0 2024-04-25T10:14:22.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.320+0000 7f6ad8c00640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 0x7f6ab8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.320+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6acc084ef0 con 0x7f6adc06edc0 2024-04-25T10:14:22.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.320+0000 7f6ad3400640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 0x7f6ab8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.320+0000 7f6ad3400640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 0x7f6ab8069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b10d0 tx=0x7f6ac40010b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.320+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6acc055cd0 con 0x7f6adc06edc0 2024-04-25T10:14:22.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.484+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6adc15d5d0 con 0x7f6ab8066f60 2024-04-25T10:14:22.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.492+0000 7f6ad8c00640 1 -- 172.21.15.18:0/411032730 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7f6adc15d5d0 con 0x7f6ab8066f60 2024-04-25T10:14:22.501 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:22.502 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.492+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 msgr2=0x7f6ab8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.492+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 0x7f6ab8069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b10d0 tx=0x7f6ac40010b0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.492+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 msgr2=0x7f6adc0cfa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.492+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f6acc00c490 tx=0x7f6acc00c950 comp rx=0 tx=0).stop 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 shutdown_connections 2024-04-25T10:14:22.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6adc0b22d0 0x7f6adc153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6ab8066f60 0x7f6ab8069420 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6adc071690 0x7f6adc13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 --2- 172.21.15.18:0/411032730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc06edc0 0x7f6adc0cfa30 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 >> 172.21.15.18:0/411032730 conn(0x7f6adc0b17b0 msgr2=0x7f6adc0af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 shutdown_connections 2024-04-25T10:14:22.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.496+0000 7f6ae3000640 1 -- 172.21.15.18:0/411032730 wait complete. 2024-04-25T10:14:22.521 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T10:14:21.559258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262280,"kb_used_data":12824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712440,"statfs":{"total":773094113280,"available":772825538560,"internally_reserved":0,"allocated":13131776,"data_stored":6754244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.183781"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419596+0000","last_change":"2024-04-25T10:14:18.414993+0000","last_active":"2024-04-25T10:14:18.419596+0000","last_peered":"2024-04-25T10:14:18.419596+0000","last_clean":"2024-04-25T10:14:18.419596+0000","last_became_active":"2024-04-25T10:14:18.414696+0000","last_became_peered":"2024-04-25T10:14:18.414696+0000","last_unstale":"2024-04-25T10:14:18.419596+0000","last_undegraded":"2024-04-25T10:14:18.419596+0000","last_fullsized":"2024-04-25T10:14:18.419596+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388357+0000","last_change":"2024-04-25T10:14:17.388357+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388357+0000","last_undegraded":"2024-04-25T10:14:17.388357+0000","last_fullsized":"2024-04-25T10:14:17.388357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388580+0000","last_change":"2024-04-25T10:14:17.388580+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388580+0000","last_undegraded":"2024-04-25T10:14:17.388580+0000","last_fullsized":"2024-04-25T10:14:17.388580+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429640+0000","last_change":"2024-04-25T10:14:18.418850+0000","last_active":"2024-04-25T10:14:18.429640+0000","last_peered":"2024-04-25T10:14:18.429640+0000","last_clean":"2024-04-25T10:14:18.429640+0000","last_became_active":"2024-04-25T10:14:18.418585+0000","last_became_peered":"2024-04-25T10:14:18.418585+0000","last_unstale":"2024-04-25T10:14:18.429640+0000","last_undegraded":"2024-04-25T10:14:18.429640+0000","last_fullsized":"2024-04-25T10:14:18.429640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420078+0000","last_change":"2024-04-25T10:14:18.411455+0000","last_active":"2024-04-25T10:14:18.420078+0000","last_peered":"2024-04-25T10:14:18.420078+0000","last_clean":"2024-04-25T10:14:18.420078+0000","last_became_active":"2024-04-25T10:14:18.411173+0000","last_became_peered":"2024-04-25T10:14:18.411173+0000","last_unstale":"2024-04-25T10:14:18.420078+0000","last_undegraded":"2024-04-25T10:14:18.420078+0000","last_fullsized":"2024-04-25T10:14:18.420078+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391168+0000","last_change":"2024-04-25T10:14:17.391168+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391168+0000","last_undegraded":"2024-04-25T10:14:17.391168+0000","last_fullsized":"2024-04-25T10:14:17.391168+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391134+0000","last_change":"2024-04-25T10:14:17.391134+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391134+0000","last_undegraded":"2024-04-25T10:14:17.391134+0000","last_fullsized":"2024-04-25T10:14:17.391134+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392315+0000","last_change":"2024-04-25T10:14:17.392315+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392315+0000","last_undegraded":"2024-04-25T10:14:17.392315+0000","last_fullsized":"2024-04-25T10:14:17.392315+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.427955+0000","last_change":"2024-04-25T10:14:18.415521+0000","last_active":"2024-04-25T10:14:18.427955+0000","last_peered":"2024-04-25T10:14:18.427955+0000","last_clean":"2024-04-25T10:14:18.427955+0000","last_became_active":"2024-04-25T10:14:18.415134+0000","last_became_peered":"2024-04-25T10:14:18.415134+0000","last_unstale":"2024-04-25T10:14:18.427955+0000","last_undegraded":"2024-04-25T10:14:18.427955+0000","last_fullsized":"2024-04-25T10:14:18.427955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386823+0000","last_change":"2024-04-25T10:14:17.386823+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386823+0000","last_undegraded":"2024-04-25T10:14:17.386823+0000","last_fullsized":"2024-04-25T10:14:17.386823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.418966+0000","last_change":"2024-04-25T10:14:18.409006+0000","last_active":"2024-04-25T10:14:18.418966+0000","last_peered":"2024-04-25T10:14:18.418966+0000","last_clean":"2024-04-25T10:14:18.418966+0000","last_became_active":"2024-04-25T10:14:18.408742+0000","last_became_peered":"2024-04-25T10:14:18.408742+0000","last_unstale":"2024-04-25T10:14:18.418966+0000","last_undegraded":"2024-04-25T10:14:18.418966+0000","last_fullsized":"2024-04-25T10:14:18.418966+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390432+0000","last_change":"2024-04-25T10:14:17.390432+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390432+0000","last_undegraded":"2024-04-25T10:14:17.390432+0000","last_fullsized":"2024-04-25T10:14:17.390432+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387434+0000","last_change":"2024-04-25T10:14:17.387434+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387434+0000","last_undegraded":"2024-04-25T10:14:17.387434+0000","last_fullsized":"2024-04-25T10:14:17.387434+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.394196+0000","last_change":"2024-04-25T10:14:17.394196+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.394196+0000","last_undegraded":"2024-04-25T10:14:17.394196+0000","last_fullsized":"2024-04-25T10:14:17.394196+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419425+0000","last_change":"2024-04-25T10:14:18.410328+0000","last_active":"2024-04-25T10:14:18.419425+0000","last_peered":"2024-04-25T10:14:18.419425+0000","last_clean":"2024-04-25T10:14:18.419425+0000","last_became_active":"2024-04-25T10:14:18.407249+0000","last_became_peered":"2024-04-25T10:14:18.407249+0000","last_unstale":"2024-04-25T10:14:18.419425+0000","last_undegraded":"2024-04-25T10:14:18.419425+0000","last_fullsized":"2024-04-25T10:14:18.419425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390065+0000","last_change":"2024-04-25T10:14:17.390065+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390065+0000","last_undegraded":"2024-04-25T10:14:17.390065+0000","last_fullsized":"2024-04-25T10:14:17.390065+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387137+0000","last_change":"2024-04-25T10:14:17.387137+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387137+0000","last_undegraded":"2024-04-25T10:14:17.387137+0000","last_fullsized":"2024-04-25T10:14:17.387137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387934+0000","last_change":"2024-04-25T10:14:17.387934+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387934+0000","last_undegraded":"2024-04-25T10:14:17.387934+0000","last_fullsized":"2024-04-25T10:14:17.387934+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426428+0000","last_change":"2024-04-25T10:14:18.417427+0000","last_active":"2024-04-25T10:14:18.426428+0000","last_peered":"2024-04-25T10:14:18.426428+0000","last_clean":"2024-04-25T10:14:18.426428+0000","last_became_active":"2024-04-25T10:14:18.417148+0000","last_became_peered":"2024-04-25T10:14:18.417148+0000","last_unstale":"2024-04-25T10:14:18.426428+0000","last_undegraded":"2024-04-25T10:14:18.426428+0000","last_fullsized":"2024-04-25T10:14:18.426428+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384831+0000","last_change":"2024-04-25T10:14:17.384831+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384831+0000","last_undegraded":"2024-04-25T10:14:17.384831+0000","last_fullsized":"2024-04-25T10:14:17.384831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428343+0000","last_change":"2024-04-25T10:14:18.418284+0000","last_active":"2024-04-25T10:14:18.428343+0000","last_peered":"2024-04-25T10:14:18.428343+0000","last_clean":"2024-04-25T10:14:18.428343+0000","last_became_active":"2024-04-25T10:14:18.418020+0000","last_became_peered":"2024-04-25T10:14:18.418020+0000","last_unstale":"2024-04-25T10:14:18.428343+0000","last_undegraded":"2024-04-25T10:14:18.428343+0000","last_fullsized":"2024-04-25T10:14:18.428343+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.408675+0000","last_change":"2024-04-25T10:14:18.403230+0000","last_active":"2024-04-25T10:14:18.408675+0000","last_peered":"2024-04-25T10:14:18.408675+0000","last_clean":"2024-04-25T10:14:18.408675+0000","last_became_active":"2024-04-25T10:14:18.402772+0000","last_became_peered":"2024-04-25T10:14:18.402772+0000","last_unstale":"2024-04-25T10:14:18.408675+0000","last_undegraded":"2024-04-25T10:14:18.408675+0000","last_fullsized":"2024-04-25T10:14:18.408675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428027+0000","last_change":"2024-04-25T10:14:18.416108+0000","last_active":"2024-04-25T10:14:18.428027+0000","last_peered":"2024-04-25T10:14:18.428027+0000","last_clean":"2024-04-25T10:14:18.428027+0000","last_became_active":"2024-04-25T10:14:18.415615+0000","last_became_peered":"2024-04-25T10:14:18.415615+0000","last_unstale":"2024-04-25T10:14:18.428027+0000","last_undegraded":"2024-04-25T10:14:18.428027+0000","last_fullsized":"2024-04-25T10:14:18.428027+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424311+0000","last_change":"2024-04-25T10:14:18.420104+0000","last_active":"2024-04-25T10:14:18.424311+0000","last_peered":"2024-04-25T10:14:18.424311+0000","last_clean":"2024-04-25T10:14:18.424311+0000","last_became_active":"2024-04-25T10:14:18.419237+0000","last_became_peered":"2024-04-25T10:14:18.419237+0000","last_unstale":"2024-04-25T10:14:18.424311+0000","last_undegraded":"2024-04-25T10:14:18.424311+0000","last_fullsized":"2024-04-25T10:14:18.424311+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420653+0000","last_change":"2024-04-25T10:14:18.414943+0000","last_active":"2024-04-25T10:14:18.420653+0000","last_peered":"2024-04-25T10:14:18.420653+0000","last_clean":"2024-04-25T10:14:18.420653+0000","last_became_active":"2024-04-25T10:14:18.414618+0000","last_became_peered":"2024-04-25T10:14:18.414618+0000","last_unstale":"2024-04-25T10:14:18.420653+0000","last_undegraded":"2024-04-25T10:14:18.420653+0000","last_fullsized":"2024-04-25T10:14:18.420653+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386354+0000","last_change":"2024-04-25T10:14:17.386354+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386354+0000","last_undegraded":"2024-04-25T10:14:17.386354+0000","last_fullsized":"2024-04-25T10:14:17.386354+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414482+0000","last_change":"2024-04-25T10:14:18.401213+0000","last_active":"2024-04-25T10:14:18.414482+0000","last_peered":"2024-04-25T10:14:18.414482+0000","last_clean":"2024-04-25T10:14:18.414482+0000","last_became_active":"2024-04-25T10:14:18.400840+0000","last_became_peered":"2024-04-25T10:14:18.400840+0000","last_unstale":"2024-04-25T10:14:18.414482+0000","last_undegraded":"2024-04-25T10:14:18.414482+0000","last_fullsized":"2024-04-25T10:14:18.414482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389993+0000","last_change":"2024-04-25T10:14:17.389993+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389993+0000","last_undegraded":"2024-04-25T10:14:17.389993+0000","last_fullsized":"2024-04-25T10:14:17.389993+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385104+0000","last_change":"2024-04-25T10:14:17.385104+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385104+0000","last_undegraded":"2024-04-25T10:14:17.385104+0000","last_fullsized":"2024-04-25T10:14:17.385104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393789+0000","last_change":"2024-04-25T10:14:17.393789+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393789+0000","last_undegraded":"2024-04-25T10:14:17.393789+0000","last_fullsized":"2024-04-25T10:14:17.393789+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.412759+0000","last_change":"2024-04-25T10:14:18.405962+0000","last_active":"2024-04-25T10:14:18.412759+0000","last_peered":"2024-04-25T10:14:18.412759+0000","last_clean":"2024-04-25T10:14:18.412759+0000","last_became_active":"2024-04-25T10:14:18.405487+0000","last_became_peered":"2024-04-25T10:14:18.405487+0000","last_unstale":"2024-04-25T10:14:18.412759+0000","last_undegraded":"2024-04-25T10:14:18.412759+0000","last_fullsized":"2024-04-25T10:14:18.412759+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:57.373013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424128+0000","last_change":"2024-04-25T10:14:18.417527+0000","last_active":"2024-04-25T10:14:18.424128+0000","last_peered":"2024-04-25T10:14:18.424128+0000","last_clean":"2024-04-25T10:14:18.424128+0000","last_became_active":"2024-04-25T10:14:18.417210+0000","last_became_peered":"2024-04-25T10:14:18.417210+0000","last_unstale":"2024-04-25T10:14:18.424128+0000","last_undegraded":"2024-04-25T10:14:18.424128+0000","last_fullsized":"2024-04-25T10:14:18.424128+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387212+0000","last_change":"2024-04-25T10:14:17.387212+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387212+0000","last_undegraded":"2024-04-25T10:14:17.387212+0000","last_fullsized":"2024-04-25T10:14:17.387212+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"122'4","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.431622+0000","last_change":"2024-04-25T10:14:17.405872+0000","last_active":"2024-04-25T10:14:18.431622+0000","last_peered":"2024-04-25T10:14:18.431622+0000","last_clean":"2024-04-25T10:14:18.431622+0000","last_became_active":"2024-04-25T10:14:17.405528+0000","last_became_peered":"2024-04-25T10:14:17.405528+0000","last_unstale":"2024-04-25T10:14:18.431622+0000","last_undegraded":"2024-04-25T10:14:18.431622+0000","last_fullsized":"2024-04-25T10:14:18.431622+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389193+0000","last_change":"2024-04-25T10:14:17.389193+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389193+0000","last_undegraded":"2024-04-25T10:14:17.389193+0000","last_fullsized":"2024-04-25T10:14:17.389193+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405485+0000","last_change":"2024-04-25T10:14:17.403862+0000","last_active":"2024-04-25T10:14:17.405485+0000","last_peered":"2024-04-25T10:14:17.405485+0000","last_clean":"2024-04-25T10:14:17.405485+0000","last_became_active":"2024-04-25T10:14:17.403579+0000","last_became_peered":"2024-04-25T10:14:17.403579+0000","last_unstale":"2024-04-25T10:14:17.405485+0000","last_undegraded":"2024-04-25T10:14:17.405485+0000","last_fullsized":"2024-04-25T10:14:17.405485+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:13.930501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.415699+0000","last_change":"2024-04-25T10:14:18.409758+0000","last_active":"2024-04-25T10:14:18.415699+0000","last_peered":"2024-04-25T10:14:18.415699+0000","last_clean":"2024-04-25T10:14:18.415699+0000","last_became_active":"2024-04-25T10:14:18.408543+0000","last_became_peered":"2024-04-25T10:14:18.408543+0000","last_unstale":"2024-04-25T10:14:18.415699+0000","last_undegraded":"2024-04-25T10:14:18.415699+0000","last_fullsized":"2024-04-25T10:14:18.415699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429875+0000","last_change":"2024-04-25T10:14:17.407577+0000","last_active":"2024-04-25T10:14:18.429875+0000","last_peered":"2024-04-25T10:14:18.429875+0000","last_clean":"2024-04-25T10:14:18.429875+0000","last_became_active":"2024-04-25T10:14:17.407208+0000","last_became_peered":"2024-04-25T10:14:17.407208+0000","last_unstale":"2024-04-25T10:14:18.429875+0000","last_undegraded":"2024-04-25T10:14:18.429875+0000","last_fullsized":"2024-04-25T10:14:18.429875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:56.204795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428207+0000","last_change":"2024-04-25T10:14:18.418508+0000","last_active":"2024-04-25T10:14:18.428207+0000","last_peered":"2024-04-25T10:14:18.428207+0000","last_clean":"2024-04-25T10:14:18.428207+0000","last_became_active":"2024-04-25T10:14:18.418110+0000","last_became_peered":"2024-04-25T10:14:18.418110+0000","last_unstale":"2024-04-25T10:14:18.428207+0000","last_undegraded":"2024-04-25T10:14:18.428207+0000","last_fullsized":"2024-04-25T10:14:18.428207+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402677+0000","last_change":"2024-04-25T10:14:17.395546+0000","last_active":"2024-04-25T10:14:17.402677+0000","last_peered":"2024-04-25T10:14:17.402677+0000","last_clean":"2024-04-25T10:14:17.402677+0000","last_became_active":"2024-04-25T10:14:17.395257+0000","last_became_peered":"2024-04-25T10:14:17.395257+0000","last_unstale":"2024-04-25T10:14:17.402677+0000","last_undegraded":"2024-04-25T10:14:17.402677+0000","last_fullsized":"2024-04-25T10:14:17.402677+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:25.845257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386156+0000","last_change":"2024-04-25T10:14:17.386156+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386156+0000","last_undegraded":"2024-04-25T10:14:17.386156+0000","last_fullsized":"2024-04-25T10:14:17.386156+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428102+0000","last_change":"2024-04-25T10:14:17.398736+0000","last_active":"2024-04-25T10:14:18.428102+0000","last_peered":"2024-04-25T10:14:18.428102+0000","last_clean":"2024-04-25T10:14:18.428102+0000","last_became_active":"2024-04-25T10:14:17.398429+0000","last_became_peered":"2024-04-25T10:14:17.398429+0000","last_unstale":"2024-04-25T10:14:18.428102+0000","last_undegraded":"2024-04-25T10:14:18.428102+0000","last_fullsized":"2024-04-25T10:14:18.428102+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419562+0000","last_change":"2024-04-25T10:14:18.412191+0000","last_active":"2024-04-25T10:14:18.419562+0000","last_peered":"2024-04-25T10:14:18.419562+0000","last_clean":"2024-04-25T10:14:18.419562+0000","last_became_active":"2024-04-25T10:14:18.410302+0000","last_became_peered":"2024-04-25T10:14:18.410302+0000","last_unstale":"2024-04-25T10:14:18.419562+0000","last_undegraded":"2024-04-25T10:14:18.419562+0000","last_fullsized":"2024-04-25T10:14:18.419562+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404740+0000","last_change":"2024-04-25T10:14:17.401879+0000","last_active":"2024-04-25T10:14:17.404740+0000","last_peered":"2024-04-25T10:14:17.404740+0000","last_clean":"2024-04-25T10:14:17.404740+0000","last_became_active":"2024-04-25T10:14:17.401618+0000","last_became_peered":"2024-04-25T10:14:17.401618+0000","last_unstale":"2024-04-25T10:14:17.404740+0000","last_undegraded":"2024-04-25T10:14:17.404740+0000","last_fullsized":"2024-04-25T10:14:17.404740+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:06.335860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393352+0000","last_change":"2024-04-25T10:14:17.393352+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393352+0000","last_undegraded":"2024-04-25T10:14:17.393352+0000","last_fullsized":"2024-04-25T10:14:17.393352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402825+0000","last_change":"2024-04-25T10:14:17.397943+0000","last_active":"2024-04-25T10:14:18.402825+0000","last_peered":"2024-04-25T10:14:18.402825+0000","last_clean":"2024-04-25T10:14:18.402825+0000","last_became_active":"2024-04-25T10:14:17.397629+0000","last_became_peered":"2024-04-25T10:14:17.397629+0000","last_unstale":"2024-04-25T10:14:18.402825+0000","last_undegraded":"2024-04-25T10:14:18.402825+0000","last_fullsized":"2024-04-25T10:14:18.402825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386477+0000","last_change":"2024-04-25T10:14:17.386477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386477+0000","last_undegraded":"2024-04-25T10:14:17.386477+0000","last_fullsized":"2024-04-25T10:14:17.386477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405210+0000","last_change":"2024-04-25T10:14:17.400512+0000","last_active":"2024-04-25T10:14:17.405210+0000","last_peered":"2024-04-25T10:14:17.405210+0000","last_clean":"2024-04-25T10:14:17.405210+0000","last_became_active":"2024-04-25T10:14:17.400048+0000","last_became_peered":"2024-04-25T10:14:17.400048+0000","last_unstale":"2024-04-25T10:14:17.405210+0000","last_undegraded":"2024-04-25T10:14:17.405210+0000","last_fullsized":"2024-04-25T10:14:17.405210+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:25.240589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426666+0000","last_change":"2024-04-25T10:14:18.422603+0000","last_active":"2024-04-25T10:14:18.426666+0000","last_peered":"2024-04-25T10:14:18.426666+0000","last_clean":"2024-04-25T10:14:18.426666+0000","last_became_active":"2024-04-25T10:14:18.422007+0000","last_became_peered":"2024-04-25T10:14:18.422007+0000","last_unstale":"2024-04-25T10:14:18.426666+0000","last_undegraded":"2024-04-25T10:14:18.426666+0000","last_fullsized":"2024-04-25T10:14:18.426666+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391641+0000","last_change":"2024-04-25T10:14:17.403152+0000","last_active":"2024-04-25T10:14:18.391641+0000","last_peered":"2024-04-25T10:14:18.391641+0000","last_clean":"2024-04-25T10:14:18.391641+0000","last_became_active":"2024-04-25T10:14:17.401700+0000","last_became_peered":"2024-04-25T10:14:17.401700+0000","last_unstale":"2024-04-25T10:14:18.391641+0000","last_undegraded":"2024-04-25T10:14:18.391641+0000","last_fullsized":"2024-04-25T10:14:18.391641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414133+0000","last_change":"2024-04-25T10:14:18.408517+0000","last_active":"2024-04-25T10:14:18.414133+0000","last_peered":"2024-04-25T10:14:18.414133+0000","last_clean":"2024-04-25T10:14:18.414133+0000","last_became_active":"2024-04-25T10:14:18.408242+0000","last_became_peered":"2024-04-25T10:14:18.408242+0000","last_unstale":"2024-04-25T10:14:18.414133+0000","last_undegraded":"2024-04-25T10:14:18.414133+0000","last_fullsized":"2024-04-25T10:14:18.414133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406270+0000","last_change":"2024-04-25T10:14:17.406735+0000","last_active":"2024-04-25T10:14:18.406270+0000","last_peered":"2024-04-25T10:14:18.406270+0000","last_clean":"2024-04-25T10:14:18.406270+0000","last_became_active":"2024-04-25T10:14:17.406473+0000","last_became_peered":"2024-04-25T10:14:17.406473+0000","last_unstale":"2024-04-25T10:14:18.406270+0000","last_undegraded":"2024-04-25T10:14:18.406270+0000","last_fullsized":"2024-04-25T10:14:18.406270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387425+0000","last_change":"2024-04-25T10:14:17.387425+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387425+0000","last_undegraded":"2024-04-25T10:14:17.387425+0000","last_fullsized":"2024-04-25T10:14:17.387425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"122'3","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429591+0000","last_change":"2024-04-25T10:14:17.404230+0000","last_active":"2024-04-25T10:14:18.429591+0000","last_peered":"2024-04-25T10:14:18.429591+0000","last_clean":"2024-04-25T10:14:18.429591+0000","last_became_active":"2024-04-25T10:14:17.403964+0000","last_became_peered":"2024-04-25T10:14:17.403964+0000","last_unstale":"2024-04-25T10:14:18.429591+0000","last_undegraded":"2024-04-25T10:14:18.429591+0000","last_fullsized":"2024-04-25T10:14:18.429591+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416765+0000","last_change":"2024-04-25T10:14:18.412011+0000","last_active":"2024-04-25T10:14:18.416765+0000","last_peered":"2024-04-25T10:14:18.416765+0000","last_clean":"2024-04-25T10:14:18.416765+0000","last_became_active":"2024-04-25T10:14:18.411540+0000","last_became_peered":"2024-04-25T10:14:18.411540+0000","last_unstale":"2024-04-25T10:14:18.416765+0000","last_undegraded":"2024-04-25T10:14:18.416765+0000","last_fullsized":"2024-04-25T10:14:18.416765+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405227+0000","last_change":"2024-04-25T10:14:17.401245+0000","last_active":"2024-04-25T10:14:17.405227+0000","last_peered":"2024-04-25T10:14:17.405227+0000","last_clean":"2024-04-25T10:14:17.405227+0000","last_became_active":"2024-04-25T10:14:17.400983+0000","last_became_peered":"2024-04-25T10:14:17.400983+0000","last_unstale":"2024-04-25T10:14:17.405227+0000","last_undegraded":"2024-04-25T10:14:17.405227+0000","last_fullsized":"2024-04-25T10:14:17.405227+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:39.709886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406280+0000","last_change":"2024-04-25T10:14:18.397572+0000","last_active":"2024-04-25T10:14:18.406280+0000","last_peered":"2024-04-25T10:14:18.406280+0000","last_clean":"2024-04-25T10:14:18.406280+0000","last_became_active":"2024-04-25T10:14:18.397253+0000","last_became_peered":"2024-04-25T10:14:18.397253+0000","last_unstale":"2024-04-25T10:14:18.406280+0000","last_undegraded":"2024-04-25T10:14:18.406280+0000","last_fullsized":"2024-04-25T10:14:18.406280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.407153+0000","last_change":"2024-04-25T10:14:17.406496+0000","last_active":"2024-04-25T10:14:17.407153+0000","last_peered":"2024-04-25T10:14:17.407153+0000","last_clean":"2024-04-25T10:14:17.407153+0000","last_became_active":"2024-04-25T10:14:17.404083+0000","last_became_peered":"2024-04-25T10:14:17.404083+0000","last_unstale":"2024-04-25T10:14:17.407153+0000","last_undegraded":"2024-04-25T10:14:17.407153+0000","last_fullsized":"2024-04-25T10:14:17.407153+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:39.850316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385741+0000","last_change":"2024-04-25T10:14:17.385741+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385741+0000","last_undegraded":"2024-04-25T10:14:17.385741+0000","last_fullsized":"2024-04-25T10:14:17.385741+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.400999+0000","last_change":"2024-04-25T10:14:17.398290+0000","last_active":"2024-04-25T10:14:17.400999+0000","last_peered":"2024-04-25T10:14:17.400999+0000","last_clean":"2024-04-25T10:14:17.400999+0000","last_became_active":"2024-04-25T10:14:17.397904+0000","last_became_peered":"2024-04-25T10:14:17.397904+0000","last_unstale":"2024-04-25T10:14:17.400999+0000","last_undegraded":"2024-04-25T10:14:17.400999+0000","last_fullsized":"2024-04-25T10:14:17.400999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:27.741939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385850+0000","last_change":"2024-04-25T10:14:17.385850+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385850+0000","last_undegraded":"2024-04-25T10:14:17.385850+0000","last_fullsized":"2024-04-25T10:14:17.385850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404503+0000","last_change":"2024-04-25T10:14:17.400452+0000","last_active":"2024-04-25T10:14:17.404503+0000","last_peered":"2024-04-25T10:14:17.404503+0000","last_clean":"2024-04-25T10:14:17.404503+0000","last_became_active":"2024-04-25T10:14:17.400162+0000","last_became_peered":"2024-04-25T10:14:17.400162+0000","last_unstale":"2024-04-25T10:14:17.404503+0000","last_undegraded":"2024-04-25T10:14:17.404503+0000","last_fullsized":"2024-04-25T10:14:17.404503+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:40.164428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416950+0000","last_change":"2024-04-25T10:14:18.413950+0000","last_active":"2024-04-25T10:14:18.416950+0000","last_peered":"2024-04-25T10:14:18.416950+0000","last_clean":"2024-04-25T10:14:18.416950+0000","last_became_active":"2024-04-25T10:14:18.413613+0000","last_became_peered":"2024-04-25T10:14:18.413613+0000","last_unstale":"2024-04-25T10:14:18.416950+0000","last_undegraded":"2024-04-25T10:14:18.416950+0000","last_fullsized":"2024-04-25T10:14:18.416950+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.394310+0000","last_change":"2024-04-25T10:14:17.391475+0000","last_active":"2024-04-25T10:14:17.394310+0000","last_peered":"2024-04-25T10:14:17.394310+0000","last_clean":"2024-04-25T10:14:17.394310+0000","last_became_active":"2024-04-25T10:14:17.390629+0000","last_became_peered":"2024-04-25T10:14:17.390629+0000","last_unstale":"2024-04-25T10:14:17.394310+0000","last_undegraded":"2024-04-25T10:14:17.394310+0000","last_fullsized":"2024-04-25T10:14:17.394310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:59.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.409129+0000","last_change":"2024-04-25T10:14:18.403183+0000","last_active":"2024-04-25T10:14:18.409129+0000","last_peered":"2024-04-25T10:14:18.409129+0000","last_clean":"2024-04-25T10:14:18.409129+0000","last_became_active":"2024-04-25T10:14:18.402794+0000","last_became_peered":"2024-04-25T10:14:18.402794+0000","last_unstale":"2024-04-25T10:14:18.409129+0000","last_undegraded":"2024-04-25T10:14:18.409129+0000","last_fullsized":"2024-04-25T10:14:18.409129+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406963+0000","last_change":"2024-04-25T10:14:17.402367+0000","last_active":"2024-04-25T10:14:17.406963+0000","last_peered":"2024-04-25T10:14:17.406963+0000","last_clean":"2024-04-25T10:14:17.406963+0000","last_became_active":"2024-04-25T10:14:17.402100+0000","last_became_peered":"2024-04-25T10:14:17.402100+0000","last_unstale":"2024-04-25T10:14:17.406963+0000","last_undegraded":"2024-04-25T10:14:17.406963+0000","last_fullsized":"2024-04-25T10:14:17.406963+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:33.982179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384907+0000","last_change":"2024-04-25T10:14:17.384907+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384907+0000","last_undegraded":"2024-04-25T10:14:17.384907+0000","last_fullsized":"2024-04-25T10:14:17.384907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429957+0000","last_change":"2024-04-25T10:14:17.404204+0000","last_active":"2024-04-25T10:14:18.429957+0000","last_peered":"2024-04-25T10:14:18.429957+0000","last_clean":"2024-04-25T10:14:18.429957+0000","last_became_active":"2024-04-25T10:14:17.403934+0000","last_became_peered":"2024-04-25T10:14:17.403934+0000","last_unstale":"2024-04-25T10:14:18.429957+0000","last_undegraded":"2024-04-25T10:14:18.429957+0000","last_fullsized":"2024-04-25T10:14:18.429957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:45.520950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.423522+0000","last_change":"2024-04-25T10:14:18.418150+0000","last_active":"2024-04-25T10:14:18.423522+0000","last_peered":"2024-04-25T10:14:18.423522+0000","last_clean":"2024-04-25T10:14:18.423522+0000","last_became_active":"2024-04-25T10:14:18.417911+0000","last_became_peered":"2024-04-25T10:14:18.417911+0000","last_unstale":"2024-04-25T10:14:18.423522+0000","last_undegraded":"2024-04-25T10:14:18.423522+0000","last_fullsized":"2024-04-25T10:14:18.423522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401644+0000","last_change":"2024-04-25T10:14:17.404836+0000","last_active":"2024-04-25T10:14:18.401644+0000","last_peered":"2024-04-25T10:14:18.401644+0000","last_clean":"2024-04-25T10:14:18.401644+0000","last_became_active":"2024-04-25T10:14:17.404271+0000","last_became_peered":"2024-04-25T10:14:17.404271+0000","last_unstale":"2024-04-25T10:14:18.401644+0000","last_undegraded":"2024-04-25T10:14:18.401644+0000","last_fullsized":"2024-04-25T10:14:18.401644+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387262+0000","last_change":"2024-04-25T10:14:17.387262+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387262+0000","last_undegraded":"2024-04-25T10:14:17.387262+0000","last_fullsized":"2024-04-25T10:14:17.387262+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402204+0000","last_change":"2024-04-25T10:14:17.398390+0000","last_active":"2024-04-25T10:14:17.402204+0000","last_peered":"2024-04-25T10:14:17.402204+0000","last_clean":"2024-04-25T10:14:17.402204+0000","last_became_active":"2024-04-25T10:14:17.398021+0000","last_became_peered":"2024-04-25T10:14:17.398021+0000","last_unstale":"2024-04-25T10:14:17.402204+0000","last_undegraded":"2024-04-25T10:14:17.402204+0000","last_fullsized":"2024-04-25T10:14:17.402204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:09.487210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390865+0000","last_change":"2024-04-25T10:14:17.390865+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390865+0000","last_undegraded":"2024-04-25T10:14:17.390865+0000","last_fullsized":"2024-04-25T10:14:17.390865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402523+0000","last_change":"2024-04-25T10:14:17.404555+0000","last_active":"2024-04-25T10:14:18.402523+0000","last_peered":"2024-04-25T10:14:18.402523+0000","last_clean":"2024-04-25T10:14:18.402523+0000","last_became_active":"2024-04-25T10:14:17.403773+0000","last_became_peered":"2024-04-25T10:14:17.403773+0000","last_unstale":"2024-04-25T10:14:18.402523+0000","last_undegraded":"2024-04-25T10:14:18.402523+0000","last_fullsized":"2024-04-25T10:14:18.402523+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:32.166981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392941+0000","last_change":"2024-04-25T10:14:17.392941+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392941+0000","last_undegraded":"2024-04-25T10:14:17.392941+0000","last_fullsized":"2024-04-25T10:14:17.392941+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406525+0000","last_change":"2024-04-25T10:14:17.405282+0000","last_active":"2024-04-25T10:14:17.406525+0000","last_peered":"2024-04-25T10:14:17.406525+0000","last_clean":"2024-04-25T10:14:17.406525+0000","last_became_active":"2024-04-25T10:14:17.404960+0000","last_became_peered":"2024-04-25T10:14:17.404960+0000","last_unstale":"2024-04-25T10:14:17.406525+0000","last_undegraded":"2024-04-25T10:14:17.406525+0000","last_fullsized":"2024-04-25T10:14:17.406525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:09.195570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416733+0000","last_change":"2024-04-25T10:14:18.412260+0000","last_active":"2024-04-25T10:14:18.416733+0000","last_peered":"2024-04-25T10:14:18.416733+0000","last_clean":"2024-04-25T10:14:18.416733+0000","last_became_active":"2024-04-25T10:14:18.409658+0000","last_became_peered":"2024-04-25T10:14:18.409658+0000","last_unstale":"2024-04-25T10:14:18.416733+0000","last_undegraded":"2024-04-25T10:14:18.416733+0000","last_fullsized":"2024-04-25T10:14:18.416733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401869+0000","last_change":"2024-04-25T10:14:17.407199+0000","last_active":"2024-04-25T10:14:18.401869+0000","last_peered":"2024-04-25T10:14:18.401869+0000","last_clean":"2024-04-25T10:14:18.401869+0000","last_became_active":"2024-04-25T10:14:17.406929+0000","last_became_peered":"2024-04-25T10:14:17.406929+0000","last_unstale":"2024-04-25T10:14:18.401869+0000","last_undegraded":"2024-04-25T10:14:18.401869+0000","last_fullsized":"2024-04-25T10:14:18.401869+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:10.191948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386609+0000","last_change":"2024-04-25T10:14:17.386609+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386609+0000","last_undegraded":"2024-04-25T10:14:17.386609+0000","last_fullsized":"2024-04-25T10:14:17.386609+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404070+0000","last_change":"2024-04-25T10:14:17.399197+0000","last_active":"2024-04-25T10:14:17.404070+0000","last_peered":"2024-04-25T10:14:17.404070+0000","last_clean":"2024-04-25T10:14:17.404070+0000","last_became_active":"2024-04-25T10:14:17.394930+0000","last_became_peered":"2024-04-25T10:14:17.394930+0000","last_unstale":"2024-04-25T10:14:17.404070+0000","last_undegraded":"2024-04-25T10:14:17.404070+0000","last_fullsized":"2024-04-25T10:14:17.404070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:50.432606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387810+0000","last_change":"2024-04-25T10:14:17.387810+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387810+0000","last_undegraded":"2024-04-25T10:14:17.387810+0000","last_fullsized":"2024-04-25T10:14:17.387810+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391179+0000","last_change":"2024-04-25T10:14:17.401377+0000","last_active":"2024-04-25T10:14:18.391179+0000","last_peered":"2024-04-25T10:14:18.391179+0000","last_clean":"2024-04-25T10:14:18.391179+0000","last_became_active":"2024-04-25T10:14:17.400310+0000","last_became_peered":"2024-04-25T10:14:17.400310+0000","last_unstale":"2024-04-25T10:14:18.391179+0000","last_undegraded":"2024-04-25T10:14:18.391179+0000","last_fullsized":"2024-04-25T10:14:18.391179+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428699+0000","last_change":"2024-04-25T10:14:18.418899+0000","last_active":"2024-04-25T10:14:18.428699+0000","last_peered":"2024-04-25T10:14:18.428699+0000","last_clean":"2024-04-25T10:14:18.428699+0000","last_became_active":"2024-04-25T10:14:18.418620+0000","last_became_peered":"2024-04-25T10:14:18.418620+0000","last_unstale":"2024-04-25T10:14:18.428699+0000","last_undegraded":"2024-04-25T10:14:18.428699+0000","last_fullsized":"2024-04-25T10:14:18.428699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.392630+0000","last_change":"2024-04-25T10:14:17.401969+0000","last_active":"2024-04-25T10:14:18.392630+0000","last_peered":"2024-04-25T10:14:18.392630+0000","last_clean":"2024-04-25T10:14:18.392630+0000","last_became_active":"2024-04-25T10:14:17.401055+0000","last_became_peered":"2024-04-25T10:14:17.401055+0000","last_unstale":"2024-04-25T10:14:18.392630+0000","last_undegraded":"2024-04-25T10:14:18.392630+0000","last_fullsized":"2024-04-25T10:14:18.392630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386689+0000","last_change":"2024-04-25T10:14:17.386689+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386689+0000","last_undegraded":"2024-04-25T10:14:17.386689+0000","last_fullsized":"2024-04-25T10:14:17.386689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402162+0000","last_change":"2024-04-25T10:14:17.396790+0000","last_active":"2024-04-25T10:14:17.402162+0000","last_peered":"2024-04-25T10:14:17.402162+0000","last_clean":"2024-04-25T10:14:17.402162+0000","last_became_active":"2024-04-25T10:14:17.395939+0000","last_became_peered":"2024-04-25T10:14:17.395939+0000","last_unstale":"2024-04-25T10:14:17.402162+0000","last_undegraded":"2024-04-25T10:14:17.402162+0000","last_fullsized":"2024-04-25T10:14:17.402162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.219563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385523+0000","last_change":"2024-04-25T10:14:17.385523+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385523+0000","last_undegraded":"2024-04-25T10:14:17.385523+0000","last_fullsized":"2024-04-25T10:14:17.385523+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.390310+0000","last_change":"2024-04-25T10:14:17.406919+0000","last_active":"2024-04-25T10:14:18.390310+0000","last_peered":"2024-04-25T10:14:18.390310+0000","last_clean":"2024-04-25T10:14:18.390310+0000","last_became_active":"2024-04-25T10:14:17.406629+0000","last_became_peered":"2024-04-25T10:14:17.406629+0000","last_unstale":"2024-04-25T10:14:18.390310+0000","last_undegraded":"2024-04-25T10:14:18.390310+0000","last_fullsized":"2024-04-25T10:14:18.390310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390477+0000","last_change":"2024-04-25T10:14:17.390477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390477+0000","last_undegraded":"2024-04-25T10:14:17.390477+0000","last_fullsized":"2024-04-25T10:14:17.390477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.389752+0000","last_change":"2024-04-25T10:14:17.395732+0000","last_active":"2024-04-25T10:14:18.389752+0000","last_peered":"2024-04-25T10:14:18.389752+0000","last_clean":"2024-04-25T10:14:18.389752+0000","last_became_active":"2024-04-25T10:14:17.394756+0000","last_became_peered":"2024-04-25T10:14:17.394756+0000","last_unstale":"2024-04-25T10:14:18.389752+0000","last_undegraded":"2024-04-25T10:14:18.389752+0000","last_fullsized":"2024-04-25T10:14:18.389752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.421569+0000","last_change":"2024-04-25T10:14:18.414233+0000","last_active":"2024-04-25T10:14:18.421569+0000","last_peered":"2024-04-25T10:14:18.421569+0000","last_clean":"2024-04-25T10:14:18.421569+0000","last_became_active":"2024-04-25T10:14:18.413964+0000","last_became_peered":"2024-04-25T10:14:18.413964+0000","last_unstale":"2024-04-25T10:14:18.421569+0000","last_undegraded":"2024-04-25T10:14:18.421569+0000","last_fullsized":"2024-04-25T10:14:18.421569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404040+0000","last_change":"2024-04-25T10:14:17.399818+0000","last_active":"2024-04-25T10:14:17.404040+0000","last_peered":"2024-04-25T10:14:17.404040+0000","last_clean":"2024-04-25T10:14:17.404040+0000","last_became_active":"2024-04-25T10:14:17.399306+0000","last_became_peered":"2024-04-25T10:14:17.399306+0000","last_unstale":"2024-04-25T10:14:17.404040+0000","last_undegraded":"2024-04-25T10:14:17.404040+0000","last_fullsized":"2024-04-25T10:14:17.404040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:12.081985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384699+0000","last_change":"2024-04-25T10:14:17.384699+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384699+0000","last_undegraded":"2024-04-25T10:14:17.384699+0000","last_fullsized":"2024-04-25T10:14:17.384699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.404286+0000","last_change":"2024-04-25T10:14:17.403888+0000","last_active":"2024-04-25T10:14:18.404286+0000","last_peered":"2024-04-25T10:14:18.404286+0000","last_clean":"2024-04-25T10:14:18.404286+0000","last_became_active":"2024-04-25T10:14:17.403571+0000","last_became_peered":"2024-04-25T10:14:17.403571+0000","last_unstale":"2024-04-25T10:14:18.404286+0000","last_undegraded":"2024-04-25T10:14:18.404286+0000","last_fullsized":"2024-04-25T10:14:18.404286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428320+0000","last_change":"2024-04-25T10:14:18.418142+0000","last_active":"2024-04-25T10:14:18.428320+0000","last_peered":"2024-04-25T10:14:18.428320+0000","last_clean":"2024-04-25T10:14:18.428320+0000","last_became_active":"2024-04-25T10:14:18.417870+0000","last_became_peered":"2024-04-25T10:14:18.417870+0000","last_unstale":"2024-04-25T10:14:18.428320+0000","last_undegraded":"2024-04-25T10:14:18.428320+0000","last_fullsized":"2024-04-25T10:14:18.428320+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405632+0000","last_change":"2024-04-25T10:14:17.403473+0000","last_active":"2024-04-25T10:14:17.405632+0000","last_peered":"2024-04-25T10:14:17.405632+0000","last_clean":"2024-04-25T10:14:17.405632+0000","last_became_active":"2024-04-25T10:14:17.403201+0000","last_became_peered":"2024-04-25T10:14:17.403201+0000","last_unstale":"2024-04-25T10:14:17.405632+0000","last_undegraded":"2024-04-25T10:14:17.405632+0000","last_fullsized":"2024-04-25T10:14:17.405632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:06.911359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402584+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:14:18.402584+0000","last_peered":"2024-04-25T10:14:18.402584+0000","last_clean":"2024-04-25T10:14:18.402584+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:14:18.402584+0000","last_undegraded":"2024-04-25T10:14:18.402584+0000","last_fullsized":"2024-04-25T10:14:18.402584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":1290390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509570,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542275,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2080768,"data_stored":1283723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:14:22.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:14:22.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.696+0000 7f9e73c00640 1 Processor -- start 2024-04-25T10:14:22.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.696+0000 7f9e73c00640 1 -- start start 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e73c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e6c144140 0x7f9e6c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e73c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9e6c06ead0 0x7f9e6c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e73c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6c15ac60 con 0x7f9e6c0ced60 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e73c00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c0cf3e0 con 0x7f9e6c144140 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e73c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6c15af20 con 0x7f9e6c06ead0 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e63e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9e6c0ced60 0x7f9e6c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52352/0 (socket says 172.21.15.18:52352) 2024-04-25T10:14:22.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e6c144140 0x7f9e6c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e63e00640 1 -- 172.21.15.18:0/3698548142 learned_addr learned my addr 172.21.15.18:0/3698548142 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71c00640 1 --2- 172.21.15.18:0/3698548142 >> v2:172.21.15.167:3300/0 conn(0x7f9e6c06ead0 0x7f9e6c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e6be00640 1 -- 172.21.15.18:0/3698548142 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683792521 0 0) 0x7f9e6c15ac60 con 0x7f9e6c0ced60 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e6be00640 1 -- 172.21.15.18:0/3698548142 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e50005740 con 0x7f9e6c0ced60 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71200640 1 -- 172.21.15.18:0/3698548142 >> v2:172.21.15.167:3300/0 conn(0x7f9e6c06ead0 msgr2=0x7f9e6c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:22.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71200640 1 --2- 172.21.15.18:0/3698548142 >> v2:172.21.15.167:3300/0 conn(0x7f9e6c06ead0 0x7f9e6c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71200640 1 -- 172.21.15.18:0/3698548142 >> v1:172.21.15.18:6789/0 conn(0x7f9e6c0ced60 legacy=0x7f9e6c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.700+0000 7f9e71200640 1 -- 172.21.15.18:0/3698548142 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c15b200 con 0x7f9e6c144140 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e71200640 1 --2- 172.21.15.18:0/3698548142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c144140 0x7f9e6c0ce820 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0cc520 tx=0x7f9e5c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11914f6d6fa651d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e6be00640 1 -- 172.21.15.18:0/3698548142 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0b1070 con 0x7f9e6c144140 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e6be00640 1 -- 172.21.15.18:0/3698548142 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c0ac440 con 0x7f9e6c144140 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e6be00640 1 -- 172.21.15.18:0/3698548142 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0a4e60 con 0x7f9e6c144140 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- 172.21.15.18:0/3698548142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c144140 msgr2=0x7f9e6c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3698548142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c144140 0x7f9e6c0ce820 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c0cc520 tx=0x7f9e5c01c480 comp rx=0 tx=0).stop 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- 172.21.15.18:0/3698548142 shutdown_connections 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3698548142 >> v2:172.21.15.167:3300/0 conn(0x7f9e6c06ead0 0x7f9e6c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3698548142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c144140 0x7f9e6c0ce820 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- 172.21.15.18:0/3698548142 >> 172.21.15.18:0/3698548142 conn(0x7f9e6c066fa0 msgr2=0x7f9e6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- 172.21.15.18:0/3698548142 shutdown_connections 2024-04-25T10:14:22.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- 172.21.15.18:0/3698548142 wait complete. 2024-04-25T10:14:22.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 Processor -- start 2024-04-25T10:14:22.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- start start 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e6c0ced60 0x7f9e6c13b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e6c144140 0x7f9e6c13cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15bb80 con 0x7f9e6c06ead0 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c15ba00 con 0x7f9e6c144140 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.704+0000 7f9e73c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6c06d2b0 con 0x7f9e6c0ced60 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52096/0 (socket says 172.21.15.18:52096) 2024-04-25T10:14:22.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 -- 172.21.15.18:0/3556328516 learned_addr learned my addr 172.21.15.18:0/3556328516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 -- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e6c0ced60 msgr2=0x7f9e6c13b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e6c0ced60 0x7f9e6c13b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 -- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e6c144140 msgr2=0x7f9e6c13cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e6c144140 0x7f9e6c13cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 -- 172.21.15.18:0/3556328516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6c13bfb0 con 0x7f9e6c06ead0 2024-04-25T10:14:22.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e71200640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0af040 tx=0x7f9e5c019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0b1040 con 0x7f9e6c06ead0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5c0ba070 con 0x7f9e6c06ead0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6c13c250 con 0x7f9e6c06ead0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5c0b5890 con 0x7f9e6c06ead0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6c13c810 con 0x7f9e6c06ead0 2024-04-25T10:14:22.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e6c13bd40 con 0x7f9e6c06ead0 2024-04-25T10:14:22.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9e5c0b5a30 con 0x7f9e6c06ead0 2024-04-25T10:14:22.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 0x7f9e48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:22.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.708+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9e5c11f110 con 0x7f9e6c06ead0 2024-04-25T10:14:22.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.712+0000 7f9e63e00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 0x7f9e48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:22.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.712+0000 7f9e63e00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 0x7f9e48069420 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007fd0 tx=0x7f9e54007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:22.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.716+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e5c016070 con 0x7f9e6c06ead0 2024-04-25T10:14:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.872+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e6c0745d0 con 0x7f9e48066f60 2024-04-25T10:14:22.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e69600640 1 -- 172.21.15.18:0/3556328516 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7f9e6c0745d0 con 0x7f9e48066f60 2024-04-25T10:14:22.891 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:22.892 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:14:22.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 msgr2=0x7f9e48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 0x7f9e48069420 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007fd0 tx=0x7f9e54007900 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 msgr2=0x7f9e6c0b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0af040 tx=0x7f9e5c019220 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 shutdown_connections 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e6c144140 0x7f9e6c13cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9e48066f60 0x7f9e48069420 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9e6c0ced60 0x7f9e6c13b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 --2- 172.21.15.18:0/3556328516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e6c06ead0 0x7f9e6c0b3b20 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 >> 172.21.15.18:0/3556328516 conn(0x7f9e6c066fa0 msgr2=0x7f9e6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 shutdown_connections 2024-04-25T10:14:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:22.884+0000 7f9e73c00640 1 -- 172.21.15.18:0/3556328516 wait complete. 2024-04-25T10:14:22.912 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T10:14:21.559258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262280,"kb_used_data":12824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712440,"statfs":{"total":773094113280,"available":772825538560,"internally_reserved":0,"allocated":13131776,"data_stored":6754244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.183781"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419596+0000","last_change":"2024-04-25T10:14:18.414993+0000","last_active":"2024-04-25T10:14:18.419596+0000","last_peered":"2024-04-25T10:14:18.419596+0000","last_clean":"2024-04-25T10:14:18.419596+0000","last_became_active":"2024-04-25T10:14:18.414696+0000","last_became_peered":"2024-04-25T10:14:18.414696+0000","last_unstale":"2024-04-25T10:14:18.419596+0000","last_undegraded":"2024-04-25T10:14:18.419596+0000","last_fullsized":"2024-04-25T10:14:18.419596+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388357+0000","last_change":"2024-04-25T10:14:17.388357+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388357+0000","last_undegraded":"2024-04-25T10:14:17.388357+0000","last_fullsized":"2024-04-25T10:14:17.388357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388580+0000","last_change":"2024-04-25T10:14:17.388580+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388580+0000","last_undegraded":"2024-04-25T10:14:17.388580+0000","last_fullsized":"2024-04-25T10:14:17.388580+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429640+0000","last_change":"2024-04-25T10:14:18.418850+0000","last_active":"2024-04-25T10:14:18.429640+0000","last_peered":"2024-04-25T10:14:18.429640+0000","last_clean":"2024-04-25T10:14:18.429640+0000","last_became_active":"2024-04-25T10:14:18.418585+0000","last_became_peered":"2024-04-25T10:14:18.418585+0000","last_unstale":"2024-04-25T10:14:18.429640+0000","last_undegraded":"2024-04-25T10:14:18.429640+0000","last_fullsized":"2024-04-25T10:14:18.429640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420078+0000","last_change":"2024-04-25T10:14:18.411455+0000","last_active":"2024-04-25T10:14:18.420078+0000","last_peered":"2024-04-25T10:14:18.420078+0000","last_clean":"2024-04-25T10:14:18.420078+0000","last_became_active":"2024-04-25T10:14:18.411173+0000","last_became_peered":"2024-04-25T10:14:18.411173+0000","last_unstale":"2024-04-25T10:14:18.420078+0000","last_undegraded":"2024-04-25T10:14:18.420078+0000","last_fullsized":"2024-04-25T10:14:18.420078+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391168+0000","last_change":"2024-04-25T10:14:17.391168+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391168+0000","last_undegraded":"2024-04-25T10:14:17.391168+0000","last_fullsized":"2024-04-25T10:14:17.391168+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391134+0000","last_change":"2024-04-25T10:14:17.391134+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391134+0000","last_undegraded":"2024-04-25T10:14:17.391134+0000","last_fullsized":"2024-04-25T10:14:17.391134+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392315+0000","last_change":"2024-04-25T10:14:17.392315+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392315+0000","last_undegraded":"2024-04-25T10:14:17.392315+0000","last_fullsized":"2024-04-25T10:14:17.392315+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.427955+0000","last_change":"2024-04-25T10:14:18.415521+0000","last_active":"2024-04-25T10:14:18.427955+0000","last_peered":"2024-04-25T10:14:18.427955+0000","last_clean":"2024-04-25T10:14:18.427955+0000","last_became_active":"2024-04-25T10:14:18.415134+0000","last_became_peered":"2024-04-25T10:14:18.415134+0000","last_unstale":"2024-04-25T10:14:18.427955+0000","last_undegraded":"2024-04-25T10:14:18.427955+0000","last_fullsized":"2024-04-25T10:14:18.427955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386823+0000","last_change":"2024-04-25T10:14:17.386823+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386823+0000","last_undegraded":"2024-04-25T10:14:17.386823+0000","last_fullsized":"2024-04-25T10:14:17.386823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.418966+0000","last_change":"2024-04-25T10:14:18.409006+0000","last_active":"2024-04-25T10:14:18.418966+0000","last_peered":"2024-04-25T10:14:18.418966+0000","last_clean":"2024-04-25T10:14:18.418966+0000","last_became_active":"2024-04-25T10:14:18.408742+0000","last_became_peered":"2024-04-25T10:14:18.408742+0000","last_unstale":"2024-04-25T10:14:18.418966+0000","last_undegraded":"2024-04-25T10:14:18.418966+0000","last_fullsized":"2024-04-25T10:14:18.418966+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390432+0000","last_change":"2024-04-25T10:14:17.390432+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390432+0000","last_undegraded":"2024-04-25T10:14:17.390432+0000","last_fullsized":"2024-04-25T10:14:17.390432+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387434+0000","last_change":"2024-04-25T10:14:17.387434+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387434+0000","last_undegraded":"2024-04-25T10:14:17.387434+0000","last_fullsized":"2024-04-25T10:14:17.387434+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.394196+0000","last_change":"2024-04-25T10:14:17.394196+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.394196+0000","last_undegraded":"2024-04-25T10:14:17.394196+0000","last_fullsized":"2024-04-25T10:14:17.394196+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419425+0000","last_change":"2024-04-25T10:14:18.410328+0000","last_active":"2024-04-25T10:14:18.419425+0000","last_peered":"2024-04-25T10:14:18.419425+0000","last_clean":"2024-04-25T10:14:18.419425+0000","last_became_active":"2024-04-25T10:14:18.407249+0000","last_became_peered":"2024-04-25T10:14:18.407249+0000","last_unstale":"2024-04-25T10:14:18.419425+0000","last_undegraded":"2024-04-25T10:14:18.419425+0000","last_fullsized":"2024-04-25T10:14:18.419425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390065+0000","last_change":"2024-04-25T10:14:17.390065+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390065+0000","last_undegraded":"2024-04-25T10:14:17.390065+0000","last_fullsized":"2024-04-25T10:14:17.390065+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387137+0000","last_change":"2024-04-25T10:14:17.387137+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387137+0000","last_undegraded":"2024-04-25T10:14:17.387137+0000","last_fullsized":"2024-04-25T10:14:17.387137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387934+0000","last_change":"2024-04-25T10:14:17.387934+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387934+0000","last_undegraded":"2024-04-25T10:14:17.387934+0000","last_fullsized":"2024-04-25T10:14:17.387934+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426428+0000","last_change":"2024-04-25T10:14:18.417427+0000","last_active":"2024-04-25T10:14:18.426428+0000","last_peered":"2024-04-25T10:14:18.426428+0000","last_clean":"2024-04-25T10:14:18.426428+0000","last_became_active":"2024-04-25T10:14:18.417148+0000","last_became_peered":"2024-04-25T10:14:18.417148+0000","last_unstale":"2024-04-25T10:14:18.426428+0000","last_undegraded":"2024-04-25T10:14:18.426428+0000","last_fullsized":"2024-04-25T10:14:18.426428+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384831+0000","last_change":"2024-04-25T10:14:17.384831+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384831+0000","last_undegraded":"2024-04-25T10:14:17.384831+0000","last_fullsized":"2024-04-25T10:14:17.384831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428343+0000","last_change":"2024-04-25T10:14:18.418284+0000","last_active":"2024-04-25T10:14:18.428343+0000","last_peered":"2024-04-25T10:14:18.428343+0000","last_clean":"2024-04-25T10:14:18.428343+0000","last_became_active":"2024-04-25T10:14:18.418020+0000","last_became_peered":"2024-04-25T10:14:18.418020+0000","last_unstale":"2024-04-25T10:14:18.428343+0000","last_undegraded":"2024-04-25T10:14:18.428343+0000","last_fullsized":"2024-04-25T10:14:18.428343+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.408675+0000","last_change":"2024-04-25T10:14:18.403230+0000","last_active":"2024-04-25T10:14:18.408675+0000","last_peered":"2024-04-25T10:14:18.408675+0000","last_clean":"2024-04-25T10:14:18.408675+0000","last_became_active":"2024-04-25T10:14:18.402772+0000","last_became_peered":"2024-04-25T10:14:18.402772+0000","last_unstale":"2024-04-25T10:14:18.408675+0000","last_undegraded":"2024-04-25T10:14:18.408675+0000","last_fullsized":"2024-04-25T10:14:18.408675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428027+0000","last_change":"2024-04-25T10:14:18.416108+0000","last_active":"2024-04-25T10:14:18.428027+0000","last_peered":"2024-04-25T10:14:18.428027+0000","last_clean":"2024-04-25T10:14:18.428027+0000","last_became_active":"2024-04-25T10:14:18.415615+0000","last_became_peered":"2024-04-25T10:14:18.415615+0000","last_unstale":"2024-04-25T10:14:18.428027+0000","last_undegraded":"2024-04-25T10:14:18.428027+0000","last_fullsized":"2024-04-25T10:14:18.428027+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424311+0000","last_change":"2024-04-25T10:14:18.420104+0000","last_active":"2024-04-25T10:14:18.424311+0000","last_peered":"2024-04-25T10:14:18.424311+0000","last_clean":"2024-04-25T10:14:18.424311+0000","last_became_active":"2024-04-25T10:14:18.419237+0000","last_became_peered":"2024-04-25T10:14:18.419237+0000","last_unstale":"2024-04-25T10:14:18.424311+0000","last_undegraded":"2024-04-25T10:14:18.424311+0000","last_fullsized":"2024-04-25T10:14:18.424311+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420653+0000","last_change":"2024-04-25T10:14:18.414943+0000","last_active":"2024-04-25T10:14:18.420653+0000","last_peered":"2024-04-25T10:14:18.420653+0000","last_clean":"2024-04-25T10:14:18.420653+0000","last_became_active":"2024-04-25T10:14:18.414618+0000","last_became_peered":"2024-04-25T10:14:18.414618+0000","last_unstale":"2024-04-25T10:14:18.420653+0000","last_undegraded":"2024-04-25T10:14:18.420653+0000","last_fullsized":"2024-04-25T10:14:18.420653+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386354+0000","last_change":"2024-04-25T10:14:17.386354+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386354+0000","last_undegraded":"2024-04-25T10:14:17.386354+0000","last_fullsized":"2024-04-25T10:14:17.386354+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414482+0000","last_change":"2024-04-25T10:14:18.401213+0000","last_active":"2024-04-25T10:14:18.414482+0000","last_peered":"2024-04-25T10:14:18.414482+0000","last_clean":"2024-04-25T10:14:18.414482+0000","last_became_active":"2024-04-25T10:14:18.400840+0000","last_became_peered":"2024-04-25T10:14:18.400840+0000","last_unstale":"2024-04-25T10:14:18.414482+0000","last_undegraded":"2024-04-25T10:14:18.414482+0000","last_fullsized":"2024-04-25T10:14:18.414482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389993+0000","last_change":"2024-04-25T10:14:17.389993+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389993+0000","last_undegraded":"2024-04-25T10:14:17.389993+0000","last_fullsized":"2024-04-25T10:14:17.389993+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385104+0000","last_change":"2024-04-25T10:14:17.385104+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385104+0000","last_undegraded":"2024-04-25T10:14:17.385104+0000","last_fullsized":"2024-04-25T10:14:17.385104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393789+0000","last_change":"2024-04-25T10:14:17.393789+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393789+0000","last_undegraded":"2024-04-25T10:14:17.393789+0000","last_fullsized":"2024-04-25T10:14:17.393789+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.412759+0000","last_change":"2024-04-25T10:14:18.405962+0000","last_active":"2024-04-25T10:14:18.412759+0000","last_peered":"2024-04-25T10:14:18.412759+0000","last_clean":"2024-04-25T10:14:18.412759+0000","last_became_active":"2024-04-25T10:14:18.405487+0000","last_became_peered":"2024-04-25T10:14:18.405487+0000","last_unstale":"2024-04-25T10:14:18.412759+0000","last_undegraded":"2024-04-25T10:14:18.412759+0000","last_fullsized":"2024-04-25T10:14:18.412759+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:57.373013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424128+0000","last_change":"2024-04-25T10:14:18.417527+0000","last_active":"2024-04-25T10:14:18.424128+0000","last_peered":"2024-04-25T10:14:18.424128+0000","last_clean":"2024-04-25T10:14:18.424128+0000","last_became_active":"2024-04-25T10:14:18.417210+0000","last_became_peered":"2024-04-25T10:14:18.417210+0000","last_unstale":"2024-04-25T10:14:18.424128+0000","last_undegraded":"2024-04-25T10:14:18.424128+0000","last_fullsized":"2024-04-25T10:14:18.424128+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387212+0000","last_change":"2024-04-25T10:14:17.387212+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387212+0000","last_undegraded":"2024-04-25T10:14:17.387212+0000","last_fullsized":"2024-04-25T10:14:17.387212+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"122'4","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.431622+0000","last_change":"2024-04-25T10:14:17.405872+0000","last_active":"2024-04-25T10:14:18.431622+0000","last_peered":"2024-04-25T10:14:18.431622+0000","last_clean":"2024-04-25T10:14:18.431622+0000","last_became_active":"2024-04-25T10:14:17.405528+0000","last_became_peered":"2024-04-25T10:14:17.405528+0000","last_unstale":"2024-04-25T10:14:18.431622+0000","last_undegraded":"2024-04-25T10:14:18.431622+0000","last_fullsized":"2024-04-25T10:14:18.431622+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389193+0000","last_change":"2024-04-25T10:14:17.389193+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389193+0000","last_undegraded":"2024-04-25T10:14:17.389193+0000","last_fullsized":"2024-04-25T10:14:17.389193+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405485+0000","last_change":"2024-04-25T10:14:17.403862+0000","last_active":"2024-04-25T10:14:17.405485+0000","last_peered":"2024-04-25T10:14:17.405485+0000","last_clean":"2024-04-25T10:14:17.405485+0000","last_became_active":"2024-04-25T10:14:17.403579+0000","last_became_peered":"2024-04-25T10:14:17.403579+0000","last_unstale":"2024-04-25T10:14:17.405485+0000","last_undegraded":"2024-04-25T10:14:17.405485+0000","last_fullsized":"2024-04-25T10:14:17.405485+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:13.930501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.415699+0000","last_change":"2024-04-25T10:14:18.409758+0000","last_active":"2024-04-25T10:14:18.415699+0000","last_peered":"2024-04-25T10:14:18.415699+0000","last_clean":"2024-04-25T10:14:18.415699+0000","last_became_active":"2024-04-25T10:14:18.408543+0000","last_became_peered":"2024-04-25T10:14:18.408543+0000","last_unstale":"2024-04-25T10:14:18.415699+0000","last_undegraded":"2024-04-25T10:14:18.415699+0000","last_fullsized":"2024-04-25T10:14:18.415699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429875+0000","last_change":"2024-04-25T10:14:17.407577+0000","last_active":"2024-04-25T10:14:18.429875+0000","last_peered":"2024-04-25T10:14:18.429875+0000","last_clean":"2024-04-25T10:14:18.429875+0000","last_became_active":"2024-04-25T10:14:17.407208+0000","last_became_peered":"2024-04-25T10:14:17.407208+0000","last_unstale":"2024-04-25T10:14:18.429875+0000","last_undegraded":"2024-04-25T10:14:18.429875+0000","last_fullsized":"2024-04-25T10:14:18.429875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:56.204795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428207+0000","last_change":"2024-04-25T10:14:18.418508+0000","last_active":"2024-04-25T10:14:18.428207+0000","last_peered":"2024-04-25T10:14:18.428207+0000","last_clean":"2024-04-25T10:14:18.428207+0000","last_became_active":"2024-04-25T10:14:18.418110+0000","last_became_peered":"2024-04-25T10:14:18.418110+0000","last_unstale":"2024-04-25T10:14:18.428207+0000","last_undegraded":"2024-04-25T10:14:18.428207+0000","last_fullsized":"2024-04-25T10:14:18.428207+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402677+0000","last_change":"2024-04-25T10:14:17.395546+0000","last_active":"2024-04-25T10:14:17.402677+0000","last_peered":"2024-04-25T10:14:17.402677+0000","last_clean":"2024-04-25T10:14:17.402677+0000","last_became_active":"2024-04-25T10:14:17.395257+0000","last_became_peered":"2024-04-25T10:14:17.395257+0000","last_unstale":"2024-04-25T10:14:17.402677+0000","last_undegraded":"2024-04-25T10:14:17.402677+0000","last_fullsized":"2024-04-25T10:14:17.402677+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:25.845257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386156+0000","last_change":"2024-04-25T10:14:17.386156+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386156+0000","last_undegraded":"2024-04-25T10:14:17.386156+0000","last_fullsized":"2024-04-25T10:14:17.386156+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428102+0000","last_change":"2024-04-25T10:14:17.398736+0000","last_active":"2024-04-25T10:14:18.428102+0000","last_peered":"2024-04-25T10:14:18.428102+0000","last_clean":"2024-04-25T10:14:18.428102+0000","last_became_active":"2024-04-25T10:14:17.398429+0000","last_became_peered":"2024-04-25T10:14:17.398429+0000","last_unstale":"2024-04-25T10:14:18.428102+0000","last_undegraded":"2024-04-25T10:14:18.428102+0000","last_fullsized":"2024-04-25T10:14:18.428102+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419562+0000","last_change":"2024-04-25T10:14:18.412191+0000","last_active":"2024-04-25T10:14:18.419562+0000","last_peered":"2024-04-25T10:14:18.419562+0000","last_clean":"2024-04-25T10:14:18.419562+0000","last_became_active":"2024-04-25T10:14:18.410302+0000","last_became_peered":"2024-04-25T10:14:18.410302+0000","last_unstale":"2024-04-25T10:14:18.419562+0000","last_undegraded":"2024-04-25T10:14:18.419562+0000","last_fullsized":"2024-04-25T10:14:18.419562+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404740+0000","last_change":"2024-04-25T10:14:17.401879+0000","last_active":"2024-04-25T10:14:17.404740+0000","last_peered":"2024-04-25T10:14:17.404740+0000","last_clean":"2024-04-25T10:14:17.404740+0000","last_became_active":"2024-04-25T10:14:17.401618+0000","last_became_peered":"2024-04-25T10:14:17.401618+0000","last_unstale":"2024-04-25T10:14:17.404740+0000","last_undegraded":"2024-04-25T10:14:17.404740+0000","last_fullsized":"2024-04-25T10:14:17.404740+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:06.335860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393352+0000","last_change":"2024-04-25T10:14:17.393352+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393352+0000","last_undegraded":"2024-04-25T10:14:17.393352+0000","last_fullsized":"2024-04-25T10:14:17.393352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402825+0000","last_change":"2024-04-25T10:14:17.397943+0000","last_active":"2024-04-25T10:14:18.402825+0000","last_peered":"2024-04-25T10:14:18.402825+0000","last_clean":"2024-04-25T10:14:18.402825+0000","last_became_active":"2024-04-25T10:14:17.397629+0000","last_became_peered":"2024-04-25T10:14:17.397629+0000","last_unstale":"2024-04-25T10:14:18.402825+0000","last_undegraded":"2024-04-25T10:14:18.402825+0000","last_fullsized":"2024-04-25T10:14:18.402825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386477+0000","last_change":"2024-04-25T10:14:17.386477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386477+0000","last_undegraded":"2024-04-25T10:14:17.386477+0000","last_fullsized":"2024-04-25T10:14:17.386477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405210+0000","last_change":"2024-04-25T10:14:17.400512+0000","last_active":"2024-04-25T10:14:17.405210+0000","last_peered":"2024-04-25T10:14:17.405210+0000","last_clean":"2024-04-25T10:14:17.405210+0000","last_became_active":"2024-04-25T10:14:17.400048+0000","last_became_peered":"2024-04-25T10:14:17.400048+0000","last_unstale":"2024-04-25T10:14:17.405210+0000","last_undegraded":"2024-04-25T10:14:17.405210+0000","last_fullsized":"2024-04-25T10:14:17.405210+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:25.240589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426666+0000","last_change":"2024-04-25T10:14:18.422603+0000","last_active":"2024-04-25T10:14:18.426666+0000","last_peered":"2024-04-25T10:14:18.426666+0000","last_clean":"2024-04-25T10:14:18.426666+0000","last_became_active":"2024-04-25T10:14:18.422007+0000","last_became_peered":"2024-04-25T10:14:18.422007+0000","last_unstale":"2024-04-25T10:14:18.426666+0000","last_undegraded":"2024-04-25T10:14:18.426666+0000","last_fullsized":"2024-04-25T10:14:18.426666+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391641+0000","last_change":"2024-04-25T10:14:17.403152+0000","last_active":"2024-04-25T10:14:18.391641+0000","last_peered":"2024-04-25T10:14:18.391641+0000","last_clean":"2024-04-25T10:14:18.391641+0000","last_became_active":"2024-04-25T10:14:17.401700+0000","last_became_peered":"2024-04-25T10:14:17.401700+0000","last_unstale":"2024-04-25T10:14:18.391641+0000","last_undegraded":"2024-04-25T10:14:18.391641+0000","last_fullsized":"2024-04-25T10:14:18.391641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414133+0000","last_change":"2024-04-25T10:14:18.408517+0000","last_active":"2024-04-25T10:14:18.414133+0000","last_peered":"2024-04-25T10:14:18.414133+0000","last_clean":"2024-04-25T10:14:18.414133+0000","last_became_active":"2024-04-25T10:14:18.408242+0000","last_became_peered":"2024-04-25T10:14:18.408242+0000","last_unstale":"2024-04-25T10:14:18.414133+0000","last_undegraded":"2024-04-25T10:14:18.414133+0000","last_fullsized":"2024-04-25T10:14:18.414133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406270+0000","last_change":"2024-04-25T10:14:17.406735+0000","last_active":"2024-04-25T10:14:18.406270+0000","last_peered":"2024-04-25T10:14:18.406270+0000","last_clean":"2024-04-25T10:14:18.406270+0000","last_became_active":"2024-04-25T10:14:17.406473+0000","last_became_peered":"2024-04-25T10:14:17.406473+0000","last_unstale":"2024-04-25T10:14:18.406270+0000","last_undegraded":"2024-04-25T10:14:18.406270+0000","last_fullsized":"2024-04-25T10:14:18.406270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387425+0000","last_change":"2024-04-25T10:14:17.387425+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387425+0000","last_undegraded":"2024-04-25T10:14:17.387425+0000","last_fullsized":"2024-04-25T10:14:17.387425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"122'3","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429591+0000","last_change":"2024-04-25T10:14:17.404230+0000","last_active":"2024-04-25T10:14:18.429591+0000","last_peered":"2024-04-25T10:14:18.429591+0000","last_clean":"2024-04-25T10:14:18.429591+0000","last_became_active":"2024-04-25T10:14:17.403964+0000","last_became_peered":"2024-04-25T10:14:17.403964+0000","last_unstale":"2024-04-25T10:14:18.429591+0000","last_undegraded":"2024-04-25T10:14:18.429591+0000","last_fullsized":"2024-04-25T10:14:18.429591+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416765+0000","last_change":"2024-04-25T10:14:18.412011+0000","last_active":"2024-04-25T10:14:18.416765+0000","last_peered":"2024-04-25T10:14:18.416765+0000","last_clean":"2024-04-25T10:14:18.416765+0000","last_became_active":"2024-04-25T10:14:18.411540+0000","last_became_peered":"2024-04-25T10:14:18.411540+0000","last_unstale":"2024-04-25T10:14:18.416765+0000","last_undegraded":"2024-04-25T10:14:18.416765+0000","last_fullsized":"2024-04-25T10:14:18.416765+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405227+0000","last_change":"2024-04-25T10:14:17.401245+0000","last_active":"2024-04-25T10:14:17.405227+0000","last_peered":"2024-04-25T10:14:17.405227+0000","last_clean":"2024-04-25T10:14:17.405227+0000","last_became_active":"2024-04-25T10:14:17.400983+0000","last_became_peered":"2024-04-25T10:14:17.400983+0000","last_unstale":"2024-04-25T10:14:17.405227+0000","last_undegraded":"2024-04-25T10:14:17.405227+0000","last_fullsized":"2024-04-25T10:14:17.405227+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:39.709886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406280+0000","last_change":"2024-04-25T10:14:18.397572+0000","last_active":"2024-04-25T10:14:18.406280+0000","last_peered":"2024-04-25T10:14:18.406280+0000","last_clean":"2024-04-25T10:14:18.406280+0000","last_became_active":"2024-04-25T10:14:18.397253+0000","last_became_peered":"2024-04-25T10:14:18.397253+0000","last_unstale":"2024-04-25T10:14:18.406280+0000","last_undegraded":"2024-04-25T10:14:18.406280+0000","last_fullsized":"2024-04-25T10:14:18.406280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.407153+0000","last_change":"2024-04-25T10:14:17.406496+0000","last_active":"2024-04-25T10:14:17.407153+0000","last_peered":"2024-04-25T10:14:17.407153+0000","last_clean":"2024-04-25T10:14:17.407153+0000","last_became_active":"2024-04-25T10:14:17.404083+0000","last_became_peered":"2024-04-25T10:14:17.404083+0000","last_unstale":"2024-04-25T10:14:17.407153+0000","last_undegraded":"2024-04-25T10:14:17.407153+0000","last_fullsized":"2024-04-25T10:14:17.407153+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:39.850316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385741+0000","last_change":"2024-04-25T10:14:17.385741+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385741+0000","last_undegraded":"2024-04-25T10:14:17.385741+0000","last_fullsized":"2024-04-25T10:14:17.385741+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.400999+0000","last_change":"2024-04-25T10:14:17.398290+0000","last_active":"2024-04-25T10:14:17.400999+0000","last_peered":"2024-04-25T10:14:17.400999+0000","last_clean":"2024-04-25T10:14:17.400999+0000","last_became_active":"2024-04-25T10:14:17.397904+0000","last_became_peered":"2024-04-25T10:14:17.397904+0000","last_unstale":"2024-04-25T10:14:17.400999+0000","last_undegraded":"2024-04-25T10:14:17.400999+0000","last_fullsized":"2024-04-25T10:14:17.400999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:27.741939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385850+0000","last_change":"2024-04-25T10:14:17.385850+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385850+0000","last_undegraded":"2024-04-25T10:14:17.385850+0000","last_fullsized":"2024-04-25T10:14:17.385850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404503+0000","last_change":"2024-04-25T10:14:17.400452+0000","last_active":"2024-04-25T10:14:17.404503+0000","last_peered":"2024-04-25T10:14:17.404503+0000","last_clean":"2024-04-25T10:14:17.404503+0000","last_became_active":"2024-04-25T10:14:17.400162+0000","last_became_peered":"2024-04-25T10:14:17.400162+0000","last_unstale":"2024-04-25T10:14:17.404503+0000","last_undegraded":"2024-04-25T10:14:17.404503+0000","last_fullsized":"2024-04-25T10:14:17.404503+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:40.164428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416950+0000","last_change":"2024-04-25T10:14:18.413950+0000","last_active":"2024-04-25T10:14:18.416950+0000","last_peered":"2024-04-25T10:14:18.416950+0000","last_clean":"2024-04-25T10:14:18.416950+0000","last_became_active":"2024-04-25T10:14:18.413613+0000","last_became_peered":"2024-04-25T10:14:18.413613+0000","last_unstale":"2024-04-25T10:14:18.416950+0000","last_undegraded":"2024-04-25T10:14:18.416950+0000","last_fullsized":"2024-04-25T10:14:18.416950+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.394310+0000","last_change":"2024-04-25T10:14:17.391475+0000","last_active":"2024-04-25T10:14:17.394310+0000","last_peered":"2024-04-25T10:14:17.394310+0000","last_clean":"2024-04-25T10:14:17.394310+0000","last_became_active":"2024-04-25T10:14:17.390629+0000","last_became_peered":"2024-04-25T10:14:17.390629+0000","last_unstale":"2024-04-25T10:14:17.394310+0000","last_undegraded":"2024-04-25T10:14:17.394310+0000","last_fullsized":"2024-04-25T10:14:17.394310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:59.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.409129+0000","last_change":"2024-04-25T10:14:18.403183+0000","last_active":"2024-04-25T10:14:18.409129+0000","last_peered":"2024-04-25T10:14:18.409129+0000","last_clean":"2024-04-25T10:14:18.409129+0000","last_became_active":"2024-04-25T10:14:18.402794+0000","last_became_peered":"2024-04-25T10:14:18.402794+0000","last_unstale":"2024-04-25T10:14:18.409129+0000","last_undegraded":"2024-04-25T10:14:18.409129+0000","last_fullsized":"2024-04-25T10:14:18.409129+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406963+0000","last_change":"2024-04-25T10:14:17.402367+0000","last_active":"2024-04-25T10:14:17.406963+0000","last_peered":"2024-04-25T10:14:17.406963+0000","last_clean":"2024-04-25T10:14:17.406963+0000","last_became_active":"2024-04-25T10:14:17.402100+0000","last_became_peered":"2024-04-25T10:14:17.402100+0000","last_unstale":"2024-04-25T10:14:17.406963+0000","last_undegraded":"2024-04-25T10:14:17.406963+0000","last_fullsized":"2024-04-25T10:14:17.406963+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:33.982179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384907+0000","last_change":"2024-04-25T10:14:17.384907+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384907+0000","last_undegraded":"2024-04-25T10:14:17.384907+0000","last_fullsized":"2024-04-25T10:14:17.384907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429957+0000","last_change":"2024-04-25T10:14:17.404204+0000","last_active":"2024-04-25T10:14:18.429957+0000","last_peered":"2024-04-25T10:14:18.429957+0000","last_clean":"2024-04-25T10:14:18.429957+0000","last_became_active":"2024-04-25T10:14:17.403934+0000","last_became_peered":"2024-04-25T10:14:17.403934+0000","last_unstale":"2024-04-25T10:14:18.429957+0000","last_undegraded":"2024-04-25T10:14:18.429957+0000","last_fullsized":"2024-04-25T10:14:18.429957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:45.520950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.423522+0000","last_change":"2024-04-25T10:14:18.418150+0000","last_active":"2024-04-25T10:14:18.423522+0000","last_peered":"2024-04-25T10:14:18.423522+0000","last_clean":"2024-04-25T10:14:18.423522+0000","last_became_active":"2024-04-25T10:14:18.417911+0000","last_became_peered":"2024-04-25T10:14:18.417911+0000","last_unstale":"2024-04-25T10:14:18.423522+0000","last_undegraded":"2024-04-25T10:14:18.423522+0000","last_fullsized":"2024-04-25T10:14:18.423522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401644+0000","last_change":"2024-04-25T10:14:17.404836+0000","last_active":"2024-04-25T10:14:18.401644+0000","last_peered":"2024-04-25T10:14:18.401644+0000","last_clean":"2024-04-25T10:14:18.401644+0000","last_became_active":"2024-04-25T10:14:17.404271+0000","last_became_peered":"2024-04-25T10:14:17.404271+0000","last_unstale":"2024-04-25T10:14:18.401644+0000","last_undegraded":"2024-04-25T10:14:18.401644+0000","last_fullsized":"2024-04-25T10:14:18.401644+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387262+0000","last_change":"2024-04-25T10:14:17.387262+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387262+0000","last_undegraded":"2024-04-25T10:14:17.387262+0000","last_fullsized":"2024-04-25T10:14:17.387262+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402204+0000","last_change":"2024-04-25T10:14:17.398390+0000","last_active":"2024-04-25T10:14:17.402204+0000","last_peered":"2024-04-25T10:14:17.402204+0000","last_clean":"2024-04-25T10:14:17.402204+0000","last_became_active":"2024-04-25T10:14:17.398021+0000","last_became_peered":"2024-04-25T10:14:17.398021+0000","last_unstale":"2024-04-25T10:14:17.402204+0000","last_undegraded":"2024-04-25T10:14:17.402204+0000","last_fullsized":"2024-04-25T10:14:17.402204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:09.487210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390865+0000","last_change":"2024-04-25T10:14:17.390865+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390865+0000","last_undegraded":"2024-04-25T10:14:17.390865+0000","last_fullsized":"2024-04-25T10:14:17.390865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402523+0000","last_change":"2024-04-25T10:14:17.404555+0000","last_active":"2024-04-25T10:14:18.402523+0000","last_peered":"2024-04-25T10:14:18.402523+0000","last_clean":"2024-04-25T10:14:18.402523+0000","last_became_active":"2024-04-25T10:14:17.403773+0000","last_became_peered":"2024-04-25T10:14:17.403773+0000","last_unstale":"2024-04-25T10:14:18.402523+0000","last_undegraded":"2024-04-25T10:14:18.402523+0000","last_fullsized":"2024-04-25T10:14:18.402523+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:32.166981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392941+0000","last_change":"2024-04-25T10:14:17.392941+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392941+0000","last_undegraded":"2024-04-25T10:14:17.392941+0000","last_fullsized":"2024-04-25T10:14:17.392941+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406525+0000","last_change":"2024-04-25T10:14:17.405282+0000","last_active":"2024-04-25T10:14:17.406525+0000","last_peered":"2024-04-25T10:14:17.406525+0000","last_clean":"2024-04-25T10:14:17.406525+0000","last_became_active":"2024-04-25T10:14:17.404960+0000","last_became_peered":"2024-04-25T10:14:17.404960+0000","last_unstale":"2024-04-25T10:14:17.406525+0000","last_undegraded":"2024-04-25T10:14:17.406525+0000","last_fullsized":"2024-04-25T10:14:17.406525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:09.195570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416733+0000","last_change":"2024-04-25T10:14:18.412260+0000","last_active":"2024-04-25T10:14:18.416733+0000","last_peered":"2024-04-25T10:14:18.416733+0000","last_clean":"2024-04-25T10:14:18.416733+0000","last_became_active":"2024-04-25T10:14:18.409658+0000","last_became_peered":"2024-04-25T10:14:18.409658+0000","last_unstale":"2024-04-25T10:14:18.416733+0000","last_undegraded":"2024-04-25T10:14:18.416733+0000","last_fullsized":"2024-04-25T10:14:18.416733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401869+0000","last_change":"2024-04-25T10:14:17.407199+0000","last_active":"2024-04-25T10:14:18.401869+0000","last_peered":"2024-04-25T10:14:18.401869+0000","last_clean":"2024-04-25T10:14:18.401869+0000","last_became_active":"2024-04-25T10:14:17.406929+0000","last_became_peered":"2024-04-25T10:14:17.406929+0000","last_unstale":"2024-04-25T10:14:18.401869+0000","last_undegraded":"2024-04-25T10:14:18.401869+0000","last_fullsized":"2024-04-25T10:14:18.401869+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:10.191948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386609+0000","last_change":"2024-04-25T10:14:17.386609+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386609+0000","last_undegraded":"2024-04-25T10:14:17.386609+0000","last_fullsized":"2024-04-25T10:14:17.386609+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404070+0000","last_change":"2024-04-25T10:14:17.399197+0000","last_active":"2024-04-25T10:14:17.404070+0000","last_peered":"2024-04-25T10:14:17.404070+0000","last_clean":"2024-04-25T10:14:17.404070+0000","last_became_active":"2024-04-25T10:14:17.394930+0000","last_became_peered":"2024-04-25T10:14:17.394930+0000","last_unstale":"2024-04-25T10:14:17.404070+0000","last_undegraded":"2024-04-25T10:14:17.404070+0000","last_fullsized":"2024-04-25T10:14:17.404070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:50.432606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387810+0000","last_change":"2024-04-25T10:14:17.387810+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387810+0000","last_undegraded":"2024-04-25T10:14:17.387810+0000","last_fullsized":"2024-04-25T10:14:17.387810+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391179+0000","last_change":"2024-04-25T10:14:17.401377+0000","last_active":"2024-04-25T10:14:18.391179+0000","last_peered":"2024-04-25T10:14:18.391179+0000","last_clean":"2024-04-25T10:14:18.391179+0000","last_became_active":"2024-04-25T10:14:17.400310+0000","last_became_peered":"2024-04-25T10:14:17.400310+0000","last_unstale":"2024-04-25T10:14:18.391179+0000","last_undegraded":"2024-04-25T10:14:18.391179+0000","last_fullsized":"2024-04-25T10:14:18.391179+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428699+0000","last_change":"2024-04-25T10:14:18.418899+0000","last_active":"2024-04-25T10:14:18.428699+0000","last_peered":"2024-04-25T10:14:18.428699+0000","last_clean":"2024-04-25T10:14:18.428699+0000","last_became_active":"2024-04-25T10:14:18.418620+0000","last_became_peered":"2024-04-25T10:14:18.418620+0000","last_unstale":"2024-04-25T10:14:18.428699+0000","last_undegraded":"2024-04-25T10:14:18.428699+0000","last_fullsized":"2024-04-25T10:14:18.428699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.392630+0000","last_change":"2024-04-25T10:14:17.401969+0000","last_active":"2024-04-25T10:14:18.392630+0000","last_peered":"2024-04-25T10:14:18.392630+0000","last_clean":"2024-04-25T10:14:18.392630+0000","last_became_active":"2024-04-25T10:14:17.401055+0000","last_became_peered":"2024-04-25T10:14:17.401055+0000","last_unstale":"2024-04-25T10:14:18.392630+0000","last_undegraded":"2024-04-25T10:14:18.392630+0000","last_fullsized":"2024-04-25T10:14:18.392630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386689+0000","last_change":"2024-04-25T10:14:17.386689+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386689+0000","last_undegraded":"2024-04-25T10:14:17.386689+0000","last_fullsized":"2024-04-25T10:14:17.386689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402162+0000","last_change":"2024-04-25T10:14:17.396790+0000","last_active":"2024-04-25T10:14:17.402162+0000","last_peered":"2024-04-25T10:14:17.402162+0000","last_clean":"2024-04-25T10:14:17.402162+0000","last_became_active":"2024-04-25T10:14:17.395939+0000","last_became_peered":"2024-04-25T10:14:17.395939+0000","last_unstale":"2024-04-25T10:14:17.402162+0000","last_undegraded":"2024-04-25T10:14:17.402162+0000","last_fullsized":"2024-04-25T10:14:17.402162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.219563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385523+0000","last_change":"2024-04-25T10:14:17.385523+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385523+0000","last_undegraded":"2024-04-25T10:14:17.385523+0000","last_fullsized":"2024-04-25T10:14:17.385523+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.390310+0000","last_change":"2024-04-25T10:14:17.406919+0000","last_active":"2024-04-25T10:14:18.390310+0000","last_peered":"2024-04-25T10:14:18.390310+0000","last_clean":"2024-04-25T10:14:18.390310+0000","last_became_active":"2024-04-25T10:14:17.406629+0000","last_became_peered":"2024-04-25T10:14:17.406629+0000","last_unstale":"2024-04-25T10:14:18.390310+0000","last_undegraded":"2024-04-25T10:14:18.390310+0000","last_fullsized":"2024-04-25T10:14:18.390310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390477+0000","last_change":"2024-04-25T10:14:17.390477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390477+0000","last_undegraded":"2024-04-25T10:14:17.390477+0000","last_fullsized":"2024-04-25T10:14:17.390477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.389752+0000","last_change":"2024-04-25T10:14:17.395732+0000","last_active":"2024-04-25T10:14:18.389752+0000","last_peered":"2024-04-25T10:14:18.389752+0000","last_clean":"2024-04-25T10:14:18.389752+0000","last_became_active":"2024-04-25T10:14:17.394756+0000","last_became_peered":"2024-04-25T10:14:17.394756+0000","last_unstale":"2024-04-25T10:14:18.389752+0000","last_undegraded":"2024-04-25T10:14:18.389752+0000","last_fullsized":"2024-04-25T10:14:18.389752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.421569+0000","last_change":"2024-04-25T10:14:18.414233+0000","last_active":"2024-04-25T10:14:18.421569+0000","last_peered":"2024-04-25T10:14:18.421569+0000","last_clean":"2024-04-25T10:14:18.421569+0000","last_became_active":"2024-04-25T10:14:18.413964+0000","last_became_peered":"2024-04-25T10:14:18.413964+0000","last_unstale":"2024-04-25T10:14:18.421569+0000","last_undegraded":"2024-04-25T10:14:18.421569+0000","last_fullsized":"2024-04-25T10:14:18.421569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404040+0000","last_change":"2024-04-25T10:14:17.399818+0000","last_active":"2024-04-25T10:14:17.404040+0000","last_peered":"2024-04-25T10:14:17.404040+0000","last_clean":"2024-04-25T10:14:17.404040+0000","last_became_active":"2024-04-25T10:14:17.399306+0000","last_became_peered":"2024-04-25T10:14:17.399306+0000","last_unstale":"2024-04-25T10:14:17.404040+0000","last_undegraded":"2024-04-25T10:14:17.404040+0000","last_fullsized":"2024-04-25T10:14:17.404040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:12.081985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384699+0000","last_change":"2024-04-25T10:14:17.384699+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384699+0000","last_undegraded":"2024-04-25T10:14:17.384699+0000","last_fullsized":"2024-04-25T10:14:17.384699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.404286+0000","last_change":"2024-04-25T10:14:17.403888+0000","last_active":"2024-04-25T10:14:18.404286+0000","last_peered":"2024-04-25T10:14:18.404286+0000","last_clean":"2024-04-25T10:14:18.404286+0000","last_became_active":"2024-04-25T10:14:17.403571+0000","last_became_peered":"2024-04-25T10:14:17.403571+0000","last_unstale":"2024-04-25T10:14:18.404286+0000","last_undegraded":"2024-04-25T10:14:18.404286+0000","last_fullsized":"2024-04-25T10:14:18.404286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428320+0000","last_change":"2024-04-25T10:14:18.418142+0000","last_active":"2024-04-25T10:14:18.428320+0000","last_peered":"2024-04-25T10:14:18.428320+0000","last_clean":"2024-04-25T10:14:18.428320+0000","last_became_active":"2024-04-25T10:14:18.417870+0000","last_became_peered":"2024-04-25T10:14:18.417870+0000","last_unstale":"2024-04-25T10:14:18.428320+0000","last_undegraded":"2024-04-25T10:14:18.428320+0000","last_fullsized":"2024-04-25T10:14:18.428320+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405632+0000","last_change":"2024-04-25T10:14:17.403473+0000","last_active":"2024-04-25T10:14:17.405632+0000","last_peered":"2024-04-25T10:14:17.405632+0000","last_clean":"2024-04-25T10:14:17.405632+0000","last_became_active":"2024-04-25T10:14:17.403201+0000","last_became_peered":"2024-04-25T10:14:17.403201+0000","last_unstale":"2024-04-25T10:14:17.405632+0000","last_undegraded":"2024-04-25T10:14:17.405632+0000","last_fullsized":"2024-04-25T10:14:17.405632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:06.911359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402584+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:14:18.402584+0000","last_peered":"2024-04-25T10:14:18.402584+0000","last_clean":"2024-04-25T10:14:18.402584+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:14:18.402584+0000","last_undegraded":"2024-04-25T10:14:18.402584+0000","last_fullsized":"2024-04-25T10:14:18.402584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":1290390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509570,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542275,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2080768,"data_stored":1283723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:14:22.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:14:23.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 Processor -- start 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 -- start start 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff56c144140 0x7ff56c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c15ac60 con 0x7ff56c0ced60 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56c0cf3e0 con 0x7ff56c06ead0 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff572e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56c15af20 con 0x7ff56c144140 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff56b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff56c0ced60 0x7ff56c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52366/0 (socket says 172.21.15.18:52366) 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff56b400640 1 -- 172.21.15.18:0/1224264839 learned_addr learned my addr 172.21.15.18:0/1224264839 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff56be00640 1 --2- 172.21.15.18:0/1224264839 >> v2:172.21.15.167:3300/0 conn(0x7ff56c144140 0x7ff56c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557966453 0 0) 0x7ff56c15ac60 con 0x7ff56c0ced60 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.092+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff550003530 con 0x7ff56c0ced60 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 308767131 0 0) 0x7ff56c0cf3e0 con 0x7ff56c06ead0 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff56c15ac60 con 0x7ff56c06ead0 2024-04-25T10:14:23.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 220793164 0 0) 0x7ff550003530 con 0x7ff56c0ced60 2024-04-25T10:14:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56be00640 1 -- 172.21.15.18:0/1224264839 >> v1:172.21.15.167:6789/0 conn(0x7ff56c06ead0 legacy=0x7ff56c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56be00640 1 -- 172.21.15.18:0/1224264839 >> v1:172.21.15.18:6789/0 conn(0x7ff56c0ced60 legacy=0x7ff56c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56be00640 1 -- 172.21.15.18:0/1224264839 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c15b200 con 0x7ff56c144140 2024-04-25T10:14:23.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56be00640 1 --2- 172.21.15.18:0/1224264839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c0ce820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0097c0 tx=0x7ff55c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d72da1368cb2ea76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0b0070 con 0x7ff56c144140 2024-04-25T10:14:23.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0ab400 con 0x7ff56c144140 2024-04-25T10:14:23.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff56aa00640 1 -- 172.21.15.18:0/1224264839 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558001680 con 0x7ff56c144140 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff572e00640 1 -- 172.21.15.18:0/1224264839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 msgr2=0x7ff56c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.096+0000 7ff572e00640 1 --2- 172.21.15.18:0/1224264839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c0ce820 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0097c0 tx=0x7ff55c01c3c0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- 172.21.15.18:0/1224264839 shutdown_connections 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 --2- 172.21.15.18:0/1224264839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c0ce820 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- 172.21.15.18:0/1224264839 >> 172.21.15.18:0/1224264839 conn(0x7ff56c066fa0 msgr2=0x7ff56c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- 172.21.15.18:0/1224264839 shutdown_connections 2024-04-25T10:14:23.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- 172.21.15.18:0/1224264839 wait complete. 2024-04-25T10:14:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 Processor -- start 2024-04-25T10:14:23.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- start start 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff56c0ced60 0x7ff56c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c15bb80 con 0x7ff56c06ead0 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c15ba00 con 0x7ff56c144140 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff572e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56c1683f0 con 0x7ff56c0ced60 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52110/0 (socket says 172.21.15.18:52110) 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 -- 172.21.15.18:0/458223512 learned_addr learned my addr 172.21.15.18:0/458223512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff570e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56b400640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff56c0ced60 0x7ff56c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 -- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff56c0ced60 msgr2=0x7ff56c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff56c0ced60 0x7ff56c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 -- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 msgr2=0x7ff56c15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 -- 172.21.15.18:0/458223512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56c13cbd0 con 0x7ff56c06ead0 2024-04-25T10:14:23.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff56be00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0ae040 tx=0x7ff55c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.100+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0b8070 con 0x7ff56c06ead0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c0abe50 con 0x7ff56c06ead0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56c141310 con 0x7ff56c06ead0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c0b0040 con 0x7ff56c06ead0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56c13ce70 con 0x7ff56c06ead0 2024-04-25T10:14:23.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56c0745d0 con 0x7ff56c06ead0 2024-04-25T10:14:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff55c004220 con 0x7ff56c06ead0 2024-04-25T10:14:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff563e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 0x7ff54c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff55c11f040 con 0x7ff56c06ead0 2024-04-25T10:14:23.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff56b400640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 0x7ff54c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.104+0000 7ff56b400640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 0x7ff54c069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff56c1f98e0 tx=0x7ff558009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.108+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff55c015fb0 con 0x7ff56c06ead0 2024-04-25T10:14:23.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.268+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff56c13f820 con 0x7ff54c066f60 2024-04-25T10:14:23.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.272+0000 7ff563e00640 1 -- 172.21.15.18:0/458223512 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249510 (secure 0 0 0) 0x7ff56c13f820 con 0x7ff54c066f60 2024-04-25T10:14:23.283 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:23.285 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 msgr2=0x7ff54c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 0x7ff54c069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7ff56c1f98e0 tx=0x7ff558009040 comp rx=0 tx=0).stop 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 msgr2=0x7ff56c13a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7ff55c0ae040 tx=0x7ff55c019160 comp rx=0 tx=0).stop 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 shutdown_connections 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff56c144140 0x7ff56c15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff54c066f60 0x7ff54c069420 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff56c0ced60 0x7ff56c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 --2- 172.21.15.18:0/458223512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff56c06ead0 0x7ff56c13a2a0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 >> 172.21.15.18:0/458223512 conn(0x7ff56c066fa0 msgr2=0x7ff56c0b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:23.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 shutdown_connections 2024-04-25T10:14:23.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.276+0000 7ff572e00640 1 -- 172.21.15.18:0/458223512 wait complete. 2024-04-25T10:14:23.305 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":436,"stamp":"2024-04-25T10:14:21.559258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262280,"kb_used_data":12824,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712440,"statfs":{"total":773094113280,"available":772825538560,"internally_reserved":0,"allocated":13131776,"data_stored":6754244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.183781"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419596+0000","last_change":"2024-04-25T10:14:18.414993+0000","last_active":"2024-04-25T10:14:18.419596+0000","last_peered":"2024-04-25T10:14:18.419596+0000","last_clean":"2024-04-25T10:14:18.419596+0000","last_became_active":"2024-04-25T10:14:18.414696+0000","last_became_peered":"2024-04-25T10:14:18.414696+0000","last_unstale":"2024-04-25T10:14:18.419596+0000","last_undegraded":"2024-04-25T10:14:18.419596+0000","last_fullsized":"2024-04-25T10:14:18.419596+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388357+0000","last_change":"2024-04-25T10:14:17.388357+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388357+0000","last_undegraded":"2024-04-25T10:14:17.388357+0000","last_fullsized":"2024-04-25T10:14:17.388357+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.388580+0000","last_change":"2024-04-25T10:14:17.388580+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.388580+0000","last_undegraded":"2024-04-25T10:14:17.388580+0000","last_fullsized":"2024-04-25T10:14:17.388580+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429640+0000","last_change":"2024-04-25T10:14:18.418850+0000","last_active":"2024-04-25T10:14:18.429640+0000","last_peered":"2024-04-25T10:14:18.429640+0000","last_clean":"2024-04-25T10:14:18.429640+0000","last_became_active":"2024-04-25T10:14:18.418585+0000","last_became_peered":"2024-04-25T10:14:18.418585+0000","last_unstale":"2024-04-25T10:14:18.429640+0000","last_undegraded":"2024-04-25T10:14:18.429640+0000","last_fullsized":"2024-04-25T10:14:18.429640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420078+0000","last_change":"2024-04-25T10:14:18.411455+0000","last_active":"2024-04-25T10:14:18.420078+0000","last_peered":"2024-04-25T10:14:18.420078+0000","last_clean":"2024-04-25T10:14:18.420078+0000","last_became_active":"2024-04-25T10:14:18.411173+0000","last_became_peered":"2024-04-25T10:14:18.411173+0000","last_unstale":"2024-04-25T10:14:18.420078+0000","last_undegraded":"2024-04-25T10:14:18.420078+0000","last_fullsized":"2024-04-25T10:14:18.420078+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391168+0000","last_change":"2024-04-25T10:14:17.391168+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391168+0000","last_undegraded":"2024-04-25T10:14:17.391168+0000","last_fullsized":"2024-04-25T10:14:17.391168+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.391134+0000","last_change":"2024-04-25T10:14:17.391134+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.391134+0000","last_undegraded":"2024-04-25T10:14:17.391134+0000","last_fullsized":"2024-04-25T10:14:17.391134+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392315+0000","last_change":"2024-04-25T10:14:17.392315+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392315+0000","last_undegraded":"2024-04-25T10:14:17.392315+0000","last_fullsized":"2024-04-25T10:14:17.392315+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.427955+0000","last_change":"2024-04-25T10:14:18.415521+0000","last_active":"2024-04-25T10:14:18.427955+0000","last_peered":"2024-04-25T10:14:18.427955+0000","last_clean":"2024-04-25T10:14:18.427955+0000","last_became_active":"2024-04-25T10:14:18.415134+0000","last_became_peered":"2024-04-25T10:14:18.415134+0000","last_unstale":"2024-04-25T10:14:18.427955+0000","last_undegraded":"2024-04-25T10:14:18.427955+0000","last_fullsized":"2024-04-25T10:14:18.427955+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386823+0000","last_change":"2024-04-25T10:14:17.386823+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386823+0000","last_undegraded":"2024-04-25T10:14:17.386823+0000","last_fullsized":"2024-04-25T10:14:17.386823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.418966+0000","last_change":"2024-04-25T10:14:18.409006+0000","last_active":"2024-04-25T10:14:18.418966+0000","last_peered":"2024-04-25T10:14:18.418966+0000","last_clean":"2024-04-25T10:14:18.418966+0000","last_became_active":"2024-04-25T10:14:18.408742+0000","last_became_peered":"2024-04-25T10:14:18.408742+0000","last_unstale":"2024-04-25T10:14:18.418966+0000","last_undegraded":"2024-04-25T10:14:18.418966+0000","last_fullsized":"2024-04-25T10:14:18.418966+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390432+0000","last_change":"2024-04-25T10:14:17.390432+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390432+0000","last_undegraded":"2024-04-25T10:14:17.390432+0000","last_fullsized":"2024-04-25T10:14:17.390432+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387434+0000","last_change":"2024-04-25T10:14:17.387434+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387434+0000","last_undegraded":"2024-04-25T10:14:17.387434+0000","last_fullsized":"2024-04-25T10:14:17.387434+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.394196+0000","last_change":"2024-04-25T10:14:17.394196+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.394196+0000","last_undegraded":"2024-04-25T10:14:17.394196+0000","last_fullsized":"2024-04-25T10:14:17.394196+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419425+0000","last_change":"2024-04-25T10:14:18.410328+0000","last_active":"2024-04-25T10:14:18.419425+0000","last_peered":"2024-04-25T10:14:18.419425+0000","last_clean":"2024-04-25T10:14:18.419425+0000","last_became_active":"2024-04-25T10:14:18.407249+0000","last_became_peered":"2024-04-25T10:14:18.407249+0000","last_unstale":"2024-04-25T10:14:18.419425+0000","last_undegraded":"2024-04-25T10:14:18.419425+0000","last_fullsized":"2024-04-25T10:14:18.419425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390065+0000","last_change":"2024-04-25T10:14:17.390065+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390065+0000","last_undegraded":"2024-04-25T10:14:17.390065+0000","last_fullsized":"2024-04-25T10:14:17.390065+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387137+0000","last_change":"2024-04-25T10:14:17.387137+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387137+0000","last_undegraded":"2024-04-25T10:14:17.387137+0000","last_fullsized":"2024-04-25T10:14:17.387137+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387934+0000","last_change":"2024-04-25T10:14:17.387934+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387934+0000","last_undegraded":"2024-04-25T10:14:17.387934+0000","last_fullsized":"2024-04-25T10:14:17.387934+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426428+0000","last_change":"2024-04-25T10:14:18.417427+0000","last_active":"2024-04-25T10:14:18.426428+0000","last_peered":"2024-04-25T10:14:18.426428+0000","last_clean":"2024-04-25T10:14:18.426428+0000","last_became_active":"2024-04-25T10:14:18.417148+0000","last_became_peered":"2024-04-25T10:14:18.417148+0000","last_unstale":"2024-04-25T10:14:18.426428+0000","last_undegraded":"2024-04-25T10:14:18.426428+0000","last_fullsized":"2024-04-25T10:14:18.426428+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384831+0000","last_change":"2024-04-25T10:14:17.384831+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384831+0000","last_undegraded":"2024-04-25T10:14:17.384831+0000","last_fullsized":"2024-04-25T10:14:17.384831+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428343+0000","last_change":"2024-04-25T10:14:18.418284+0000","last_active":"2024-04-25T10:14:18.428343+0000","last_peered":"2024-04-25T10:14:18.428343+0000","last_clean":"2024-04-25T10:14:18.428343+0000","last_became_active":"2024-04-25T10:14:18.418020+0000","last_became_peered":"2024-04-25T10:14:18.418020+0000","last_unstale":"2024-04-25T10:14:18.428343+0000","last_undegraded":"2024-04-25T10:14:18.428343+0000","last_fullsized":"2024-04-25T10:14:18.428343+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.408675+0000","last_change":"2024-04-25T10:14:18.403230+0000","last_active":"2024-04-25T10:14:18.408675+0000","last_peered":"2024-04-25T10:14:18.408675+0000","last_clean":"2024-04-25T10:14:18.408675+0000","last_became_active":"2024-04-25T10:14:18.402772+0000","last_became_peered":"2024-04-25T10:14:18.402772+0000","last_unstale":"2024-04-25T10:14:18.408675+0000","last_undegraded":"2024-04-25T10:14:18.408675+0000","last_fullsized":"2024-04-25T10:14:18.408675+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428027+0000","last_change":"2024-04-25T10:14:18.416108+0000","last_active":"2024-04-25T10:14:18.428027+0000","last_peered":"2024-04-25T10:14:18.428027+0000","last_clean":"2024-04-25T10:14:18.428027+0000","last_became_active":"2024-04-25T10:14:18.415615+0000","last_became_peered":"2024-04-25T10:14:18.415615+0000","last_unstale":"2024-04-25T10:14:18.428027+0000","last_undegraded":"2024-04-25T10:14:18.428027+0000","last_fullsized":"2024-04-25T10:14:18.428027+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424311+0000","last_change":"2024-04-25T10:14:18.420104+0000","last_active":"2024-04-25T10:14:18.424311+0000","last_peered":"2024-04-25T10:14:18.424311+0000","last_clean":"2024-04-25T10:14:18.424311+0000","last_became_active":"2024-04-25T10:14:18.419237+0000","last_became_peered":"2024-04-25T10:14:18.419237+0000","last_unstale":"2024-04-25T10:14:18.424311+0000","last_undegraded":"2024-04-25T10:14:18.424311+0000","last_fullsized":"2024-04-25T10:14:18.424311+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.420653+0000","last_change":"2024-04-25T10:14:18.414943+0000","last_active":"2024-04-25T10:14:18.420653+0000","last_peered":"2024-04-25T10:14:18.420653+0000","last_clean":"2024-04-25T10:14:18.420653+0000","last_became_active":"2024-04-25T10:14:18.414618+0000","last_became_peered":"2024-04-25T10:14:18.414618+0000","last_unstale":"2024-04-25T10:14:18.420653+0000","last_undegraded":"2024-04-25T10:14:18.420653+0000","last_fullsized":"2024-04-25T10:14:18.420653+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386354+0000","last_change":"2024-04-25T10:14:17.386354+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386354+0000","last_undegraded":"2024-04-25T10:14:17.386354+0000","last_fullsized":"2024-04-25T10:14:17.386354+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414482+0000","last_change":"2024-04-25T10:14:18.401213+0000","last_active":"2024-04-25T10:14:18.414482+0000","last_peered":"2024-04-25T10:14:18.414482+0000","last_clean":"2024-04-25T10:14:18.414482+0000","last_became_active":"2024-04-25T10:14:18.400840+0000","last_became_peered":"2024-04-25T10:14:18.400840+0000","last_unstale":"2024-04-25T10:14:18.414482+0000","last_undegraded":"2024-04-25T10:14:18.414482+0000","last_fullsized":"2024-04-25T10:14:18.414482+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389993+0000","last_change":"2024-04-25T10:14:17.389993+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389993+0000","last_undegraded":"2024-04-25T10:14:17.389993+0000","last_fullsized":"2024-04-25T10:14:17.389993+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385104+0000","last_change":"2024-04-25T10:14:17.385104+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385104+0000","last_undegraded":"2024-04-25T10:14:17.385104+0000","last_fullsized":"2024-04-25T10:14:17.385104+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393789+0000","last_change":"2024-04-25T10:14:17.393789+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393789+0000","last_undegraded":"2024-04-25T10:14:17.393789+0000","last_fullsized":"2024-04-25T10:14:17.393789+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.412759+0000","last_change":"2024-04-25T10:14:18.405962+0000","last_active":"2024-04-25T10:14:18.412759+0000","last_peered":"2024-04-25T10:14:18.412759+0000","last_clean":"2024-04-25T10:14:18.412759+0000","last_became_active":"2024-04-25T10:14:18.405487+0000","last_became_peered":"2024-04-25T10:14:18.405487+0000","last_unstale":"2024-04-25T10:14:18.412759+0000","last_undegraded":"2024-04-25T10:14:18.412759+0000","last_fullsized":"2024-04-25T10:14:18.412759+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:57.373013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.424128+0000","last_change":"2024-04-25T10:14:18.417527+0000","last_active":"2024-04-25T10:14:18.424128+0000","last_peered":"2024-04-25T10:14:18.424128+0000","last_clean":"2024-04-25T10:14:18.424128+0000","last_became_active":"2024-04-25T10:14:18.417210+0000","last_became_peered":"2024-04-25T10:14:18.417210+0000","last_unstale":"2024-04-25T10:14:18.424128+0000","last_undegraded":"2024-04-25T10:14:18.424128+0000","last_fullsized":"2024-04-25T10:14:18.424128+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387212+0000","last_change":"2024-04-25T10:14:17.387212+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387212+0000","last_undegraded":"2024-04-25T10:14:17.387212+0000","last_fullsized":"2024-04-25T10:14:17.387212+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"122'4","reported_seq":16,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.431622+0000","last_change":"2024-04-25T10:14:17.405872+0000","last_active":"2024-04-25T10:14:18.431622+0000","last_peered":"2024-04-25T10:14:18.431622+0000","last_clean":"2024-04-25T10:14:18.431622+0000","last_became_active":"2024-04-25T10:14:17.405528+0000","last_became_peered":"2024-04-25T10:14:17.405528+0000","last_unstale":"2024-04-25T10:14:18.431622+0000","last_undegraded":"2024-04-25T10:14:18.431622+0000","last_fullsized":"2024-04-25T10:14:18.431622+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.389193+0000","last_change":"2024-04-25T10:14:17.389193+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.389193+0000","last_undegraded":"2024-04-25T10:14:17.389193+0000","last_fullsized":"2024-04-25T10:14:17.389193+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405485+0000","last_change":"2024-04-25T10:14:17.403862+0000","last_active":"2024-04-25T10:14:17.405485+0000","last_peered":"2024-04-25T10:14:17.405485+0000","last_clean":"2024-04-25T10:14:17.405485+0000","last_became_active":"2024-04-25T10:14:17.403579+0000","last_became_peered":"2024-04-25T10:14:17.403579+0000","last_unstale":"2024-04-25T10:14:17.405485+0000","last_undegraded":"2024-04-25T10:14:17.405485+0000","last_fullsized":"2024-04-25T10:14:17.405485+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:13.930501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.415699+0000","last_change":"2024-04-25T10:14:18.409758+0000","last_active":"2024-04-25T10:14:18.415699+0000","last_peered":"2024-04-25T10:14:18.415699+0000","last_clean":"2024-04-25T10:14:18.415699+0000","last_became_active":"2024-04-25T10:14:18.408543+0000","last_became_peered":"2024-04-25T10:14:18.408543+0000","last_unstale":"2024-04-25T10:14:18.415699+0000","last_undegraded":"2024-04-25T10:14:18.415699+0000","last_fullsized":"2024-04-25T10:14:18.415699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:33.173574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"122'2","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429875+0000","last_change":"2024-04-25T10:14:17.407577+0000","last_active":"2024-04-25T10:14:18.429875+0000","last_peered":"2024-04-25T10:14:18.429875+0000","last_clean":"2024-04-25T10:14:18.429875+0000","last_became_active":"2024-04-25T10:14:17.407208+0000","last_became_peered":"2024-04-25T10:14:17.407208+0000","last_unstale":"2024-04-25T10:14:18.429875+0000","last_undegraded":"2024-04-25T10:14:18.429875+0000","last_fullsized":"2024-04-25T10:14:18.429875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:56.204795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428207+0000","last_change":"2024-04-25T10:14:18.418508+0000","last_active":"2024-04-25T10:14:18.428207+0000","last_peered":"2024-04-25T10:14:18.428207+0000","last_clean":"2024-04-25T10:14:18.428207+0000","last_became_active":"2024-04-25T10:14:18.418110+0000","last_became_peered":"2024-04-25T10:14:18.418110+0000","last_unstale":"2024-04-25T10:14:18.428207+0000","last_undegraded":"2024-04-25T10:14:18.428207+0000","last_fullsized":"2024-04-25T10:14:18.428207+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402677+0000","last_change":"2024-04-25T10:14:17.395546+0000","last_active":"2024-04-25T10:14:17.402677+0000","last_peered":"2024-04-25T10:14:17.402677+0000","last_clean":"2024-04-25T10:14:17.402677+0000","last_became_active":"2024-04-25T10:14:17.395257+0000","last_became_peered":"2024-04-25T10:14:17.395257+0000","last_unstale":"2024-04-25T10:14:17.402677+0000","last_undegraded":"2024-04-25T10:14:17.402677+0000","last_fullsized":"2024-04-25T10:14:17.402677+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:25.845257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386156+0000","last_change":"2024-04-25T10:14:17.386156+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386156+0000","last_undegraded":"2024-04-25T10:14:17.386156+0000","last_fullsized":"2024-04-25T10:14:17.386156+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428102+0000","last_change":"2024-04-25T10:14:17.398736+0000","last_active":"2024-04-25T10:14:18.428102+0000","last_peered":"2024-04-25T10:14:18.428102+0000","last_clean":"2024-04-25T10:14:18.428102+0000","last_became_active":"2024-04-25T10:14:17.398429+0000","last_became_peered":"2024-04-25T10:14:17.398429+0000","last_unstale":"2024-04-25T10:14:18.428102+0000","last_undegraded":"2024-04-25T10:14:18.428102+0000","last_fullsized":"2024-04-25T10:14:18.428102+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.419562+0000","last_change":"2024-04-25T10:14:18.412191+0000","last_active":"2024-04-25T10:14:18.419562+0000","last_peered":"2024-04-25T10:14:18.419562+0000","last_clean":"2024-04-25T10:14:18.419562+0000","last_became_active":"2024-04-25T10:14:18.410302+0000","last_became_peered":"2024-04-25T10:14:18.410302+0000","last_unstale":"2024-04-25T10:14:18.419562+0000","last_undegraded":"2024-04-25T10:14:18.419562+0000","last_fullsized":"2024-04-25T10:14:18.419562+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404740+0000","last_change":"2024-04-25T10:14:17.401879+0000","last_active":"2024-04-25T10:14:17.404740+0000","last_peered":"2024-04-25T10:14:17.404740+0000","last_clean":"2024-04-25T10:14:17.404740+0000","last_became_active":"2024-04-25T10:14:17.401618+0000","last_became_peered":"2024-04-25T10:14:17.401618+0000","last_unstale":"2024-04-25T10:14:17.404740+0000","last_undegraded":"2024-04-25T10:14:17.404740+0000","last_fullsized":"2024-04-25T10:14:17.404740+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:46:06.335860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.393352+0000","last_change":"2024-04-25T10:14:17.393352+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.393352+0000","last_undegraded":"2024-04-25T10:14:17.393352+0000","last_fullsized":"2024-04-25T10:14:17.393352+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402825+0000","last_change":"2024-04-25T10:14:17.397943+0000","last_active":"2024-04-25T10:14:18.402825+0000","last_peered":"2024-04-25T10:14:18.402825+0000","last_clean":"2024-04-25T10:14:18.402825+0000","last_became_active":"2024-04-25T10:14:17.397629+0000","last_became_peered":"2024-04-25T10:14:17.397629+0000","last_unstale":"2024-04-25T10:14:18.402825+0000","last_undegraded":"2024-04-25T10:14:18.402825+0000","last_fullsized":"2024-04-25T10:14:18.402825+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386477+0000","last_change":"2024-04-25T10:14:17.386477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386477+0000","last_undegraded":"2024-04-25T10:14:17.386477+0000","last_fullsized":"2024-04-25T10:14:17.386477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405210+0000","last_change":"2024-04-25T10:14:17.400512+0000","last_active":"2024-04-25T10:14:17.405210+0000","last_peered":"2024-04-25T10:14:17.405210+0000","last_clean":"2024-04-25T10:14:17.405210+0000","last_became_active":"2024-04-25T10:14:17.400048+0000","last_became_peered":"2024-04-25T10:14:17.400048+0000","last_unstale":"2024-04-25T10:14:17.405210+0000","last_undegraded":"2024-04-25T10:14:17.405210+0000","last_fullsized":"2024-04-25T10:14:17.405210+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:25.240589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.426666+0000","last_change":"2024-04-25T10:14:18.422603+0000","last_active":"2024-04-25T10:14:18.426666+0000","last_peered":"2024-04-25T10:14:18.426666+0000","last_clean":"2024-04-25T10:14:18.426666+0000","last_became_active":"2024-04-25T10:14:18.422007+0000","last_became_peered":"2024-04-25T10:14:18.422007+0000","last_unstale":"2024-04-25T10:14:18.426666+0000","last_undegraded":"2024-04-25T10:14:18.426666+0000","last_fullsized":"2024-04-25T10:14:18.426666+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391641+0000","last_change":"2024-04-25T10:14:17.403152+0000","last_active":"2024-04-25T10:14:18.391641+0000","last_peered":"2024-04-25T10:14:18.391641+0000","last_clean":"2024-04-25T10:14:18.391641+0000","last_became_active":"2024-04-25T10:14:17.401700+0000","last_became_peered":"2024-04-25T10:14:17.401700+0000","last_unstale":"2024-04-25T10:14:18.391641+0000","last_undegraded":"2024-04-25T10:14:18.391641+0000","last_fullsized":"2024-04-25T10:14:18.391641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.414133+0000","last_change":"2024-04-25T10:14:18.408517+0000","last_active":"2024-04-25T10:14:18.414133+0000","last_peered":"2024-04-25T10:14:18.414133+0000","last_clean":"2024-04-25T10:14:18.414133+0000","last_became_active":"2024-04-25T10:14:18.408242+0000","last_became_peered":"2024-04-25T10:14:18.408242+0000","last_unstale":"2024-04-25T10:14:18.414133+0000","last_undegraded":"2024-04-25T10:14:18.414133+0000","last_fullsized":"2024-04-25T10:14:18.414133+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406270+0000","last_change":"2024-04-25T10:14:17.406735+0000","last_active":"2024-04-25T10:14:18.406270+0000","last_peered":"2024-04-25T10:14:18.406270+0000","last_clean":"2024-04-25T10:14:18.406270+0000","last_became_active":"2024-04-25T10:14:17.406473+0000","last_became_peered":"2024-04-25T10:14:17.406473+0000","last_unstale":"2024-04-25T10:14:18.406270+0000","last_undegraded":"2024-04-25T10:14:18.406270+0000","last_fullsized":"2024-04-25T10:14:18.406270+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387425+0000","last_change":"2024-04-25T10:14:17.387425+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387425+0000","last_undegraded":"2024-04-25T10:14:17.387425+0000","last_fullsized":"2024-04-25T10:14:17.387425+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"122'3","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429591+0000","last_change":"2024-04-25T10:14:17.404230+0000","last_active":"2024-04-25T10:14:18.429591+0000","last_peered":"2024-04-25T10:14:18.429591+0000","last_clean":"2024-04-25T10:14:18.429591+0000","last_became_active":"2024-04-25T10:14:17.403964+0000","last_became_peered":"2024-04-25T10:14:17.403964+0000","last_unstale":"2024-04-25T10:14:18.429591+0000","last_undegraded":"2024-04-25T10:14:18.429591+0000","last_fullsized":"2024-04-25T10:14:18.429591+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416765+0000","last_change":"2024-04-25T10:14:18.412011+0000","last_active":"2024-04-25T10:14:18.416765+0000","last_peered":"2024-04-25T10:14:18.416765+0000","last_clean":"2024-04-25T10:14:18.416765+0000","last_became_active":"2024-04-25T10:14:18.411540+0000","last_became_peered":"2024-04-25T10:14:18.411540+0000","last_unstale":"2024-04-25T10:14:18.416765+0000","last_undegraded":"2024-04-25T10:14:18.416765+0000","last_fullsized":"2024-04-25T10:14:18.416765+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:17.423505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405227+0000","last_change":"2024-04-25T10:14:17.401245+0000","last_active":"2024-04-25T10:14:17.405227+0000","last_peered":"2024-04-25T10:14:17.405227+0000","last_clean":"2024-04-25T10:14:17.405227+0000","last_became_active":"2024-04-25T10:14:17.400983+0000","last_became_peered":"2024-04-25T10:14:17.400983+0000","last_unstale":"2024-04-25T10:14:17.405227+0000","last_undegraded":"2024-04-25T10:14:17.405227+0000","last_fullsized":"2024-04-25T10:14:17.405227+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:39.709886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.406280+0000","last_change":"2024-04-25T10:14:18.397572+0000","last_active":"2024-04-25T10:14:18.406280+0000","last_peered":"2024-04-25T10:14:18.406280+0000","last_clean":"2024-04-25T10:14:18.406280+0000","last_became_active":"2024-04-25T10:14:18.397253+0000","last_became_peered":"2024-04-25T10:14:18.397253+0000","last_unstale":"2024-04-25T10:14:18.406280+0000","last_undegraded":"2024-04-25T10:14:18.406280+0000","last_fullsized":"2024-04-25T10:14:18.406280+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.407153+0000","last_change":"2024-04-25T10:14:17.406496+0000","last_active":"2024-04-25T10:14:17.407153+0000","last_peered":"2024-04-25T10:14:17.407153+0000","last_clean":"2024-04-25T10:14:17.407153+0000","last_became_active":"2024-04-25T10:14:17.404083+0000","last_became_peered":"2024-04-25T10:14:17.404083+0000","last_unstale":"2024-04-25T10:14:17.407153+0000","last_undegraded":"2024-04-25T10:14:17.407153+0000","last_fullsized":"2024-04-25T10:14:17.407153+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:59:39.850316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385741+0000","last_change":"2024-04-25T10:14:17.385741+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385741+0000","last_undegraded":"2024-04-25T10:14:17.385741+0000","last_fullsized":"2024-04-25T10:14:17.385741+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.400999+0000","last_change":"2024-04-25T10:14:17.398290+0000","last_active":"2024-04-25T10:14:17.400999+0000","last_peered":"2024-04-25T10:14:17.400999+0000","last_clean":"2024-04-25T10:14:17.400999+0000","last_became_active":"2024-04-25T10:14:17.397904+0000","last_became_peered":"2024-04-25T10:14:17.397904+0000","last_unstale":"2024-04-25T10:14:17.400999+0000","last_undegraded":"2024-04-25T10:14:17.400999+0000","last_fullsized":"2024-04-25T10:14:17.400999+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:44:27.741939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385850+0000","last_change":"2024-04-25T10:14:17.385850+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385850+0000","last_undegraded":"2024-04-25T10:14:17.385850+0000","last_fullsized":"2024-04-25T10:14:17.385850+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404503+0000","last_change":"2024-04-25T10:14:17.400452+0000","last_active":"2024-04-25T10:14:17.404503+0000","last_peered":"2024-04-25T10:14:17.404503+0000","last_clean":"2024-04-25T10:14:17.404503+0000","last_became_active":"2024-04-25T10:14:17.400162+0000","last_became_peered":"2024-04-25T10:14:17.400162+0000","last_unstale":"2024-04-25T10:14:17.404503+0000","last_undegraded":"2024-04-25T10:14:17.404503+0000","last_fullsized":"2024-04-25T10:14:17.404503+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:40.164428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416950+0000","last_change":"2024-04-25T10:14:18.413950+0000","last_active":"2024-04-25T10:14:18.416950+0000","last_peered":"2024-04-25T10:14:18.416950+0000","last_clean":"2024-04-25T10:14:18.416950+0000","last_became_active":"2024-04-25T10:14:18.413613+0000","last_became_peered":"2024-04-25T10:14:18.413613+0000","last_unstale":"2024-04-25T10:14:18.416950+0000","last_undegraded":"2024-04-25T10:14:18.416950+0000","last_fullsized":"2024-04-25T10:14:18.416950+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.394310+0000","last_change":"2024-04-25T10:14:17.391475+0000","last_active":"2024-04-25T10:14:17.394310+0000","last_peered":"2024-04-25T10:14:17.394310+0000","last_clean":"2024-04-25T10:14:17.394310+0000","last_became_active":"2024-04-25T10:14:17.390629+0000","last_became_peered":"2024-04-25T10:14:17.390629+0000","last_unstale":"2024-04-25T10:14:17.394310+0000","last_undegraded":"2024-04-25T10:14:17.394310+0000","last_fullsized":"2024-04-25T10:14:17.394310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:59.833620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.409129+0000","last_change":"2024-04-25T10:14:18.403183+0000","last_active":"2024-04-25T10:14:18.409129+0000","last_peered":"2024-04-25T10:14:18.409129+0000","last_clean":"2024-04-25T10:14:18.409129+0000","last_became_active":"2024-04-25T10:14:18.402794+0000","last_became_peered":"2024-04-25T10:14:18.402794+0000","last_unstale":"2024-04-25T10:14:18.409129+0000","last_undegraded":"2024-04-25T10:14:18.409129+0000","last_fullsized":"2024-04-25T10:14:18.409129+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:11.198541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406963+0000","last_change":"2024-04-25T10:14:17.402367+0000","last_active":"2024-04-25T10:14:17.406963+0000","last_peered":"2024-04-25T10:14:17.406963+0000","last_clean":"2024-04-25T10:14:17.406963+0000","last_became_active":"2024-04-25T10:14:17.402100+0000","last_became_peered":"2024-04-25T10:14:17.402100+0000","last_unstale":"2024-04-25T10:14:17.406963+0000","last_undegraded":"2024-04-25T10:14:17.406963+0000","last_fullsized":"2024-04-25T10:14:17.406963+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:54:33.982179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384907+0000","last_change":"2024-04-25T10:14:17.384907+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384907+0000","last_undegraded":"2024-04-25T10:14:17.384907+0000","last_fullsized":"2024-04-25T10:14:17.384907+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"122'1","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.429957+0000","last_change":"2024-04-25T10:14:17.404204+0000","last_active":"2024-04-25T10:14:18.429957+0000","last_peered":"2024-04-25T10:14:18.429957+0000","last_clean":"2024-04-25T10:14:18.429957+0000","last_became_active":"2024-04-25T10:14:17.403934+0000","last_became_peered":"2024-04-25T10:14:17.403934+0000","last_unstale":"2024-04-25T10:14:18.429957+0000","last_undegraded":"2024-04-25T10:14:18.429957+0000","last_fullsized":"2024-04-25T10:14:18.429957+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:45.520950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.423522+0000","last_change":"2024-04-25T10:14:18.418150+0000","last_active":"2024-04-25T10:14:18.423522+0000","last_peered":"2024-04-25T10:14:18.423522+0000","last_clean":"2024-04-25T10:14:18.423522+0000","last_became_active":"2024-04-25T10:14:18.417911+0000","last_became_peered":"2024-04-25T10:14:18.417911+0000","last_unstale":"2024-04-25T10:14:18.423522+0000","last_undegraded":"2024-04-25T10:14:18.423522+0000","last_fullsized":"2024-04-25T10:14:18.423522+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401644+0000","last_change":"2024-04-25T10:14:17.404836+0000","last_active":"2024-04-25T10:14:18.401644+0000","last_peered":"2024-04-25T10:14:18.401644+0000","last_clean":"2024-04-25T10:14:18.401644+0000","last_became_active":"2024-04-25T10:14:17.404271+0000","last_became_peered":"2024-04-25T10:14:17.404271+0000","last_unstale":"2024-04-25T10:14:18.401644+0000","last_undegraded":"2024-04-25T10:14:18.401644+0000","last_fullsized":"2024-04-25T10:14:18.401644+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387262+0000","last_change":"2024-04-25T10:14:17.387262+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387262+0000","last_undegraded":"2024-04-25T10:14:17.387262+0000","last_fullsized":"2024-04-25T10:14:17.387262+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402204+0000","last_change":"2024-04-25T10:14:17.398390+0000","last_active":"2024-04-25T10:14:17.402204+0000","last_peered":"2024-04-25T10:14:17.402204+0000","last_clean":"2024-04-25T10:14:17.402204+0000","last_became_active":"2024-04-25T10:14:17.398021+0000","last_became_peered":"2024-04-25T10:14:17.398021+0000","last_unstale":"2024-04-25T10:14:17.402204+0000","last_undegraded":"2024-04-25T10:14:17.402204+0000","last_fullsized":"2024-04-25T10:14:17.402204+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:09.487210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390865+0000","last_change":"2024-04-25T10:14:17.390865+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390865+0000","last_undegraded":"2024-04-25T10:14:17.390865+0000","last_fullsized":"2024-04-25T10:14:17.390865+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402523+0000","last_change":"2024-04-25T10:14:17.404555+0000","last_active":"2024-04-25T10:14:18.402523+0000","last_peered":"2024-04-25T10:14:18.402523+0000","last_clean":"2024-04-25T10:14:18.402523+0000","last_became_active":"2024-04-25T10:14:17.403773+0000","last_became_peered":"2024-04-25T10:14:17.403773+0000","last_unstale":"2024-04-25T10:14:18.402523+0000","last_undegraded":"2024-04-25T10:14:18.402523+0000","last_fullsized":"2024-04-25T10:14:18.402523+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:32.166981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.392941+0000","last_change":"2024-04-25T10:14:17.392941+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.392941+0000","last_undegraded":"2024-04-25T10:14:17.392941+0000","last_fullsized":"2024-04-25T10:14:17.392941+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.406525+0000","last_change":"2024-04-25T10:14:17.405282+0000","last_active":"2024-04-25T10:14:17.406525+0000","last_peered":"2024-04-25T10:14:17.406525+0000","last_clean":"2024-04-25T10:14:17.406525+0000","last_became_active":"2024-04-25T10:14:17.404960+0000","last_became_peered":"2024-04-25T10:14:17.404960+0000","last_unstale":"2024-04-25T10:14:17.406525+0000","last_undegraded":"2024-04-25T10:14:17.406525+0000","last_fullsized":"2024-04-25T10:14:17.406525+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:38:09.195570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.416733+0000","last_change":"2024-04-25T10:14:18.412260+0000","last_active":"2024-04-25T10:14:18.416733+0000","last_peered":"2024-04-25T10:14:18.416733+0000","last_clean":"2024-04-25T10:14:18.416733+0000","last_became_active":"2024-04-25T10:14:18.409658+0000","last_became_peered":"2024-04-25T10:14:18.409658+0000","last_unstale":"2024-04-25T10:14:18.416733+0000","last_undegraded":"2024-04-25T10:14:18.416733+0000","last_fullsized":"2024-04-25T10:14:18.416733+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:57.211387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.401869+0000","last_change":"2024-04-25T10:14:17.407199+0000","last_active":"2024-04-25T10:14:18.401869+0000","last_peered":"2024-04-25T10:14:18.401869+0000","last_clean":"2024-04-25T10:14:18.401869+0000","last_became_active":"2024-04-25T10:14:17.406929+0000","last_became_peered":"2024-04-25T10:14:17.406929+0000","last_unstale":"2024-04-25T10:14:18.401869+0000","last_undegraded":"2024-04-25T10:14:18.401869+0000","last_fullsized":"2024-04-25T10:14:18.401869+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:10.191948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386609+0000","last_change":"2024-04-25T10:14:17.386609+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386609+0000","last_undegraded":"2024-04-25T10:14:17.386609+0000","last_fullsized":"2024-04-25T10:14:17.386609+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404070+0000","last_change":"2024-04-25T10:14:17.399197+0000","last_active":"2024-04-25T10:14:17.404070+0000","last_peered":"2024-04-25T10:14:17.404070+0000","last_clean":"2024-04-25T10:14:17.404070+0000","last_became_active":"2024-04-25T10:14:17.394930+0000","last_became_peered":"2024-04-25T10:14:17.394930+0000","last_unstale":"2024-04-25T10:14:17.404070+0000","last_undegraded":"2024-04-25T10:14:17.404070+0000","last_fullsized":"2024-04-25T10:14:17.404070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:50.432606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.387810+0000","last_change":"2024-04-25T10:14:17.387810+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.387810+0000","last_undegraded":"2024-04-25T10:14:17.387810+0000","last_fullsized":"2024-04-25T10:14:17.387810+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.391179+0000","last_change":"2024-04-25T10:14:17.401377+0000","last_active":"2024-04-25T10:14:18.391179+0000","last_peered":"2024-04-25T10:14:18.391179+0000","last_clean":"2024-04-25T10:14:18.391179+0000","last_became_active":"2024-04-25T10:14:17.400310+0000","last_became_peered":"2024-04-25T10:14:17.400310+0000","last_unstale":"2024-04-25T10:14:18.391179+0000","last_undegraded":"2024-04-25T10:14:18.391179+0000","last_fullsized":"2024-04-25T10:14:18.391179+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428699+0000","last_change":"2024-04-25T10:14:18.418899+0000","last_active":"2024-04-25T10:14:18.428699+0000","last_peered":"2024-04-25T10:14:18.428699+0000","last_clean":"2024-04-25T10:14:18.428699+0000","last_became_active":"2024-04-25T10:14:18.418620+0000","last_became_peered":"2024-04-25T10:14:18.418620+0000","last_unstale":"2024-04-25T10:14:18.428699+0000","last_undegraded":"2024-04-25T10:14:18.428699+0000","last_fullsized":"2024-04-25T10:14:18.428699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.392630+0000","last_change":"2024-04-25T10:14:17.401969+0000","last_active":"2024-04-25T10:14:18.392630+0000","last_peered":"2024-04-25T10:14:18.392630+0000","last_clean":"2024-04-25T10:14:18.392630+0000","last_became_active":"2024-04-25T10:14:17.401055+0000","last_became_peered":"2024-04-25T10:14:17.401055+0000","last_unstale":"2024-04-25T10:14:18.392630+0000","last_undegraded":"2024-04-25T10:14:18.392630+0000","last_fullsized":"2024-04-25T10:14:18.392630+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.386689+0000","last_change":"2024-04-25T10:14:17.386689+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.386689+0000","last_undegraded":"2024-04-25T10:14:17.386689+0000","last_fullsized":"2024-04-25T10:14:17.386689+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.402162+0000","last_change":"2024-04-25T10:14:17.396790+0000","last_active":"2024-04-25T10:14:17.402162+0000","last_peered":"2024-04-25T10:14:17.402162+0000","last_clean":"2024-04-25T10:14:17.402162+0000","last_became_active":"2024-04-25T10:14:17.395939+0000","last_became_peered":"2024-04-25T10:14:17.395939+0000","last_unstale":"2024-04-25T10:14:17.402162+0000","last_undegraded":"2024-04-25T10:14:17.402162+0000","last_fullsized":"2024-04-25T10:14:17.402162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:12:03.219563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.385523+0000","last_change":"2024-04-25T10:14:17.385523+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.385523+0000","last_undegraded":"2024-04-25T10:14:17.385523+0000","last_fullsized":"2024-04-25T10:14:17.385523+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.390310+0000","last_change":"2024-04-25T10:14:17.406919+0000","last_active":"2024-04-25T10:14:18.390310+0000","last_peered":"2024-04-25T10:14:18.390310+0000","last_clean":"2024-04-25T10:14:18.390310+0000","last_became_active":"2024-04-25T10:14:17.406629+0000","last_became_peered":"2024-04-25T10:14:17.406629+0000","last_unstale":"2024-04-25T10:14:18.390310+0000","last_undegraded":"2024-04-25T10:14:18.390310+0000","last_fullsized":"2024-04-25T10:14:18.390310+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.390477+0000","last_change":"2024-04-25T10:14:17.390477+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.390477+0000","last_undegraded":"2024-04-25T10:14:17.390477+0000","last_fullsized":"2024-04-25T10:14:17.390477+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.389752+0000","last_change":"2024-04-25T10:14:17.395732+0000","last_active":"2024-04-25T10:14:18.389752+0000","last_peered":"2024-04-25T10:14:18.389752+0000","last_clean":"2024-04-25T10:14:18.389752+0000","last_became_active":"2024-04-25T10:14:17.394756+0000","last_became_peered":"2024-04-25T10:14:17.394756+0000","last_unstale":"2024-04-25T10:14:18.389752+0000","last_undegraded":"2024-04-25T10:14:18.389752+0000","last_fullsized":"2024-04-25T10:14:18.389752+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.421569+0000","last_change":"2024-04-25T10:14:18.414233+0000","last_active":"2024-04-25T10:14:18.421569+0000","last_peered":"2024-04-25T10:14:18.421569+0000","last_clean":"2024-04-25T10:14:18.421569+0000","last_became_active":"2024-04-25T10:14:18.413964+0000","last_became_peered":"2024-04-25T10:14:18.413964+0000","last_unstale":"2024-04-25T10:14:18.421569+0000","last_undegraded":"2024-04-25T10:14:18.421569+0000","last_fullsized":"2024-04-25T10:14:18.421569+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.404040+0000","last_change":"2024-04-25T10:14:17.399818+0000","last_active":"2024-04-25T10:14:17.404040+0000","last_peered":"2024-04-25T10:14:17.404040+0000","last_clean":"2024-04-25T10:14:17.404040+0000","last_became_active":"2024-04-25T10:14:17.399306+0000","last_became_peered":"2024-04-25T10:14:17.399306+0000","last_unstale":"2024-04-25T10:14:17.404040+0000","last_undegraded":"2024-04-25T10:14:17.404040+0000","last_fullsized":"2024-04-25T10:14:17.404040+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:04:12.081985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":121,"state":"creating+peering","last_fresh":"2024-04-25T10:14:17.384699+0000","last_change":"2024-04-25T10:14:17.384699+0000","last_active":"2024-04-25T10:14:17.372610+0000","last_peered":"2024-04-25T10:14:17.372610+0000","last_clean":"2024-04-25T10:14:17.372610+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T10:14:17.384699+0000","last_undegraded":"2024-04-25T10:14:17.384699+0000","last_fullsized":"2024-04-25T10:14:17.384699+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.404286+0000","last_change":"2024-04-25T10:14:17.403888+0000","last_active":"2024-04-25T10:14:18.404286+0000","last_peered":"2024-04-25T10:14:18.404286+0000","last_clean":"2024-04-25T10:14:18.404286+0000","last_became_active":"2024-04-25T10:14:17.403571+0000","last_became_peered":"2024-04-25T10:14:17.403571+0000","last_unstale":"2024-04-25T10:14:18.404286+0000","last_undegraded":"2024-04-25T10:14:18.404286+0000","last_fullsized":"2024-04-25T10:14:18.404286+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":9,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.428320+0000","last_change":"2024-04-25T10:14:18.418142+0000","last_active":"2024-04-25T10:14:18.428320+0000","last_peered":"2024-04-25T10:14:18.428320+0000","last_clean":"2024-04-25T10:14:18.428320+0000","last_became_active":"2024-04-25T10:14:18.417870+0000","last_became_peered":"2024-04-25T10:14:18.417870+0000","last_unstale":"2024-04-25T10:14:18.428320+0000","last_undegraded":"2024-04-25T10:14:18.428320+0000","last_fullsized":"2024-04-25T10:14:18.428320+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T10:14:17.405632+0000","last_change":"2024-04-25T10:14:17.403473+0000","last_active":"2024-04-25T10:14:17.405632+0000","last_peered":"2024-04-25T10:14:17.405632+0000","last_clean":"2024-04-25T10:14:17.405632+0000","last_became_active":"2024-04-25T10:14:17.403201+0000","last_became_peered":"2024-04-25T10:14:17.403201+0000","last_unstale":"2024-04-25T10:14:17.405632+0000","last_undegraded":"2024-04-25T10:14:17.405632+0000","last_fullsized":"2024-04-25T10:14:17.405632+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:06.911359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":359,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-25T10:14:18.402584+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:14:18.402584+0000","last_peered":"2024-04-25T10:14:18.402584+0000","last_clean":"2024-04-25T10:14:18.402584+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:14:18.402584+0000","last_undegraded":"2024-04-25T10:14:18.402584+0000","last_fullsized":"2024-04-25T10:14:18.402584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":742,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509571,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":1290390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509572,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509570,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509569,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32648,"kb_used_data":1464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339192,"statfs":{"total":96636764160,"available":96603332608,"internally_reserved":0,"allocated":1499136,"data_stored":700022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542275,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542273,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542275,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1486848,"data_stored":693355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542273,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2080768,"data_stored":1283723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:14:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2024-04-25T10:14:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.388357+0000', 'last_change': '2024-04-25T10:14:17.388357+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.388357+0000', 'last_undegraded': '2024-04-25T10:14:17.388357+0000', 'last_fullsized': '2024-04-25T10:14:17.388357+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2024-04-25T10:14:23.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.388580+0000', 'last_change': '2024-04-25T10:14:17.388580+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.388580+0000', 'last_undegraded': '2024-04-25T10:14:17.388580+0000', 'last_fullsized': '2024-04-25T10:14:17.388580+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.391168+0000', 'last_change': '2024-04-25T10:14:17.391168+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.391168+0000', 'last_undegraded': '2024-04-25T10:14:17.391168+0000', 'last_fullsized': '2024-04-25T10:14:17.391168+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.391134+0000', 'last_change': '2024-04-25T10:14:17.391134+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.391134+0000', 'last_undegraded': '2024-04-25T10:14:17.391134+0000', 'last_fullsized': '2024-04-25T10:14:17.391134+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2024-04-25T10:14:23.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.392315+0000', 'last_change': '2024-04-25T10:14:17.392315+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.392315+0000', 'last_undegraded': '2024-04-25T10:14:17.392315+0000', 'last_fullsized': '2024-04-25T10:14:17.392315+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386823+0000', 'last_change': '2024-04-25T10:14:17.386823+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386823+0000', 'last_undegraded': '2024-04-25T10:14:17.386823+0000', 'last_fullsized': '2024-04-25T10:14:17.386823+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.390432+0000', 'last_change': '2024-04-25T10:14:17.390432+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.390432+0000', 'last_undegraded': '2024-04-25T10:14:17.390432+0000', 'last_fullsized': '2024-04-25T10:14:17.390432+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387434+0000', 'last_change': '2024-04-25T10:14:17.387434+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387434+0000', 'last_undegraded': '2024-04-25T10:14:17.387434+0000', 'last_fullsized': '2024-04-25T10:14:17.387434+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.394196+0000', 'last_change': '2024-04-25T10:14:17.394196+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.394196+0000', 'last_undegraded': '2024-04-25T10:14:17.394196+0000', 'last_fullsized': '2024-04-25T10:14:17.394196+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2024-04-25T10:14:23.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.390065+0000', 'last_change': '2024-04-25T10:14:17.390065+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.390065+0000', 'last_undegraded': '2024-04-25T10:14:17.390065+0000', 'last_fullsized': '2024-04-25T10:14:17.390065+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387137+0000', 'last_change': '2024-04-25T10:14:17.387137+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387137+0000', 'last_undegraded': '2024-04-25T10:14:17.387137+0000', 'last_fullsized': '2024-04-25T10:14:17.387137+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387934+0000', 'last_change': '2024-04-25T10:14:17.387934+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387934+0000', 'last_undegraded': '2024-04-25T10:14:17.387934+0000', 'last_fullsized': '2024-04-25T10:14:17.387934+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.384831+0000', 'last_change': '2024-04-25T10:14:17.384831+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.384831+0000', 'last_undegraded': '2024-04-25T10:14:17.384831+0000', 'last_fullsized': '2024-04-25T10:14:17.384831+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386354+0000', 'last_change': '2024-04-25T10:14:17.386354+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386354+0000', 'last_undegraded': '2024-04-25T10:14:17.386354+0000', 'last_fullsized': '2024-04-25T10:14:17.386354+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.389993+0000', 'last_change': '2024-04-25T10:14:17.389993+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.389993+0000', 'last_undegraded': '2024-04-25T10:14:17.389993+0000', 'last_fullsized': '2024-04-25T10:14:17.389993+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2024-04-25T10:14:23.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.385104+0000', 'last_change': '2024-04-25T10:14:17.385104+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.385104+0000', 'last_undegraded': '2024-04-25T10:14:17.385104+0000', 'last_fullsized': '2024-04-25T10:14:17.385104+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.393789+0000', 'last_change': '2024-04-25T10:14:17.393789+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.393789+0000', 'last_undegraded': '2024-04-25T10:14:17.393789+0000', 'last_fullsized': '2024-04-25T10:14:17.393789+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387212+0000', 'last_change': '2024-04-25T10:14:17.387212+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387212+0000', 'last_undegraded': '2024-04-25T10:14:17.387212+0000', 'last_fullsized': '2024-04-25T10:14:17.387212+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.389193+0000', 'last_change': '2024-04-25T10:14:17.389193+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.389193+0000', 'last_undegraded': '2024-04-25T10:14:17.389193+0000', 'last_fullsized': '2024-04-25T10:14:17.389193+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386156+0000', 'last_change': '2024-04-25T10:14:17.386156+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386156+0000', 'last_undegraded': '2024-04-25T10:14:17.386156+0000', 'last_fullsized': '2024-04-25T10:14:17.386156+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2024-04-25T10:14:23.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.393352+0000', 'last_change': '2024-04-25T10:14:17.393352+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.393352+0000', 'last_undegraded': '2024-04-25T10:14:17.393352+0000', 'last_fullsized': '2024-04-25T10:14:17.393352+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386477+0000', 'last_change': '2024-04-25T10:14:17.386477+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386477+0000', 'last_undegraded': '2024-04-25T10:14:17.386477+0000', 'last_fullsized': '2024-04-25T10:14:17.386477+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387425+0000', 'last_change': '2024-04-25T10:14:17.387425+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387425+0000', 'last_undegraded': '2024-04-25T10:14:17.387425+0000', 'last_fullsized': '2024-04-25T10:14:17.387425+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.385741+0000', 'last_change': '2024-04-25T10:14:17.385741+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.385741+0000', 'last_undegraded': '2024-04-25T10:14:17.385741+0000', 'last_fullsized': '2024-04-25T10:14:17.385741+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.385850+0000', 'last_change': '2024-04-25T10:14:17.385850+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.385850+0000', 'last_undegraded': '2024-04-25T10:14:17.385850+0000', 'last_fullsized': '2024-04-25T10:14:17.385850+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.384907+0000', 'last_change': '2024-04-25T10:14:17.384907+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.384907+0000', 'last_undegraded': '2024-04-25T10:14:17.384907+0000', 'last_fullsized': '2024-04-25T10:14:17.384907+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387262+0000', 'last_change': '2024-04-25T10:14:17.387262+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387262+0000', 'last_undegraded': '2024-04-25T10:14:17.387262+0000', 'last_fullsized': '2024-04-25T10:14:17.387262+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.390865+0000', 'last_change': '2024-04-25T10:14:17.390865+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.390865+0000', 'last_undegraded': '2024-04-25T10:14:17.390865+0000', 'last_fullsized': '2024-04-25T10:14:17.390865+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.392941+0000', 'last_change': '2024-04-25T10:14:17.392941+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.392941+0000', 'last_undegraded': '2024-04-25T10:14:17.392941+0000', 'last_fullsized': '2024-04-25T10:14:17.392941+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386609+0000', 'last_change': '2024-04-25T10:14:17.386609+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386609+0000', 'last_undegraded': '2024-04-25T10:14:17.386609+0000', 'last_fullsized': '2024-04-25T10:14:17.386609+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2024-04-25T10:14:23.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.387810+0000', 'last_change': '2024-04-25T10:14:17.387810+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.387810+0000', 'last_undegraded': '2024-04-25T10:14:17.387810+0000', 'last_fullsized': '2024-04-25T10:14:17.387810+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.386689+0000', 'last_change': '2024-04-25T10:14:17.386689+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.386689+0000', 'last_undegraded': '2024-04-25T10:14:17.386689+0000', 'last_fullsized': '2024-04-25T10:14:17.386689+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.385523+0000', 'last_change': '2024-04-25T10:14:17.385523+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.385523+0000', 'last_undegraded': '2024-04-25T10:14:17.385523+0000', 'last_fullsized': '2024-04-25T10:14:17.385523+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.390477+0000', 'last_change': '2024-04-25T10:14:17.390477+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.390477+0000', 'last_undegraded': '2024-04-25T10:14:17.390477+0000', 'last_fullsized': '2024-04-25T10:14:17.390477+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2024-04-25T10:14:23.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 121, 'state': 'creating+peering', 'last_fresh': '2024-04-25T10:14:17.384699+0000', 'last_change': '2024-04-25T10:14:17.384699+0000', 'last_active': '2024-04-25T10:14:17.372610+0000', 'last_peered': '2024-04-25T10:14:17.372610+0000', 'last_clean': '2024-04-25T10:14:17.372610+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T10:14:17.384699+0000', 'last_undegraded': '2024-04-25T10:14:17.384699+0000', 'last_fullsized': '2024-04-25T10:14:17.384699+0000', 'mapping_epoch': 121, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 121, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'last_clean_scrub_stamp': '2024-04-25T10:14:17.372610+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T10:14:23.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T10:14:23.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 Processor -- start 2024-04-25T10:14:23.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 -- start start 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f008015b2f0 0x7f00800b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f008006dad0 0x7f00800b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008015def0 con 0x7f00800b2dc0 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008015e1b0 con 0x7f008015b2f0 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0086a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008015e490 con 0x7f008006dad0 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f008015b2f0 0x7f00800b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f008015b2f0 0x7f00800b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52120/0 (socket says 172.21.15.18:52120) 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 -- 172.21.15.18:0/2455548225 learned_addr learned my addr 172.21.15.18:0/2455548225 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f0084a00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f008006dad0 0x7f00800b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 -- 172.21.15.18:0/2455548225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f008006dad0 msgr2=0x7f00800b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f008006dad0 0x7f00800b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 -- 172.21.15.18:0/2455548225 >> v1:172.21.15.167:6789/0 conn(0x7f00800b2dc0 legacy=0x7f008006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.488+0000 7f007fe00640 1 -- 172.21.15.18:0/2455548225 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008015e770 con 0x7f008015b2f0 2024-04-25T10:14:23.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f007fe00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f00800b3240 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f0070009870 tx=0x7f007001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e879e18393f07b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f007ea00640 1 -- 172.21.15.18:0/2455548225 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008015b8e0 con 0x7f008015b2f0 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f007ea00640 1 -- 172.21.15.18:0/2455548225 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00700a9610 con 0x7f008015b2f0 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f007ea00640 1 -- 172.21.15.18:0/2455548225 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700a99e0 con 0x7f008015b2f0 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- 172.21.15.18:0/2455548225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 msgr2=0x7f00800b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f00800b3240 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f0070009870 tx=0x7f007001c530 comp rx=0 tx=0).stop 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- 172.21.15.18:0/2455548225 shutdown_connections 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f008006dad0 0x7f00800b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 --2- 172.21.15.18:0/2455548225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f00800b3240 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- 172.21.15.18:0/2455548225 >> 172.21.15.18:0/2455548225 conn(0x7f00800b23b0 msgr2=0x7f00800cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- 172.21.15.18:0/2455548225 shutdown_connections 2024-04-25T10:14:23.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- 172.21.15.18:0/2455548225 wait complete. 2024-04-25T10:14:23.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 Processor -- start 2024-04-25T10:14:23.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.492+0000 7f0086a00640 1 -- start start 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f008006dad0 0x7f0080145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00800b2dc0 0x7f0080160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008016a880 con 0x7f008015b2f0 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0080161730 con 0x7f008006dad0 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008016aa00 con 0x7f00800b2dc0 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52126/0 (socket says 172.21.15.18:52126) 2024-04-25T10:14:23.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 -- 172.21.15.18:0/392849948 learned_addr learned my addr 172.21.15.18:0/392849948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f007fe00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f008006dad0 0x7f0080145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f007f400640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00800b2dc0 0x7f0080160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 -- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00800b2dc0 msgr2=0x7f0080160b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00800b2dc0 0x7f0080160b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 -- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f008006dad0 msgr2=0x7f0080145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f008006dad0 0x7f0080145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 -- 172.21.15.18:0/392849948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080074fa0 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0084a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f0078007d40 tx=0x7f007800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078014420 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0078019070 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078014820 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00801588a0 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0080158e40 con 0x7f008015b2f0 2024-04-25T10:14:23.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.496+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00800745d0 con 0x7f008015b2f0 2024-04-25T10:14:23.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.500+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00780149c0 con 0x7f008015b2f0 2024-04-25T10:14:23.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.500+0000 7f0077e00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 0x7f0060069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.500+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0078085960 con 0x7f008015b2f0 2024-04-25T10:14:23.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.500+0000 7f007fe00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 0x7f0060069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.500+0000 7f007fe00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 0x7f0060069450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f00700ae000 tx=0x7f00700b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.504+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0078056740 con 0x7f008015b2f0 2024-04-25T10:14:23.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.720+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f00800d0ab0 con 0x7f008015b2f0 2024-04-25T10:14:23.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.720+0000 7f0077e00640 1 -- 172.21.15.18:0/392849948 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1262 (secure 0 0 0) 0x7f0078056040 con 0x7f008015b2f0 2024-04-25T10:14:23.729 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:23.729 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":652,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":123,"num_osds":8,"num_up_osds":8,"osd_up_since":1714039422,"num_in_osds":8,"osd_in_since":1714039413,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":62},{"state_name":"creating+peering","count":35}],"num_pgs":97,"num_pools":3,"num_objects":8,"data_bytes":591110,"bytes_used":268574720,"bytes_avail":772825538560,"bytes_total":773094113280,"inactive_pgs_ratio":0.36082473397254944,"write_bytes_sec":592,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":101,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":37337}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-25T10:13:41.548955+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 msgr2=0x7f0060069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 0x7f0060069450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f00700ae000 tx=0x7f00700b3040 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 msgr2=0x7f008015ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f0078007d40 tx=0x7f007800e4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 shutdown_connections 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f008015b2f0 0x7f008015ced0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0060066f90 0x7f0060069450 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f00800b2dc0 0x7f0080160b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 --2- 172.21.15.18:0/392849948 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f008006dad0 0x7f0080145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 >> 172.21.15.18:0/392849948 conn(0x7f00800b23b0 msgr2=0x7f008006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:23.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 shutdown_connections 2024-04-25T10:14:23.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.724+0000 7f0086a00640 1 -- 172.21.15.18:0/392849948 wait complete. 2024-04-25T10:14:23.751 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T10:14:23.751 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:14:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 Processor -- start 2024-04-25T10:14:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 -- start start 2024-04-25T10:14:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f38e4145270 0x7f38e415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38e40b1e60 0x7f38e40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38e40cc4e0 con 0x7f38e40cd4d0 2024-04-25T10:14:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e4145650 con 0x7f38e40b1e60 2024-04-25T10:14:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38ea600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e40ce040 con 0x7f38e4145270 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f38e40b1e60 0x7f38e40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38dbe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f38e40cd4d0 0x7f38e40b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52378/0 (socket says 172.21.15.18:52378) 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38dbe00640 1 -- 172.21.15.18:0/3005664423 learned_addr learned my addr 172.21.15.18:0/3005664423 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3400640 1 --2- 172.21.15.18:0/3005664423 >> v2:172.21.15.167:3300/0 conn(0x7f38e4145270 0x7f38e415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3e00640 1 -- 172.21.15.18:0/3005664423 >> v2:172.21.15.167:3300/0 conn(0x7f38e4145270 msgr2=0x7f38e415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3e00640 1 --2- 172.21.15.18:0/3005664423 >> v2:172.21.15.167:3300/0 conn(0x7f38e4145270 0x7f38e415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3e00640 1 -- 172.21.15.18:0/3005664423 >> v1:172.21.15.18:6789/0 conn(0x7f38e40cd4d0 legacy=0x7f38e40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e3e00640 1 -- 172.21.15.18:0/3005664423 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e40ce320 con 0x7f38e40b1e60 2024-04-25T10:14:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.884+0000 7f38e2a00640 1 -- 172.21.15.18:0/3005664423 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413627194 0 0) 0x7f38e40cc4e0 con 0x7f38e40cd4d0 2024-04-25T10:14:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38e3e00640 1 --2- 172.21.15.18:0/3005664423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40b1e60 0x7f38e40cd930 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f38e406f3a0 tx=0x7f38dc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b72a7d35b067dea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38e2a00640 1 -- 172.21.15.18:0/3005664423 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0b2070 con 0x7f38e40b1e60 2024-04-25T10:14:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38e2a00640 1 -- 172.21.15.18:0/3005664423 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38dc0a58e0 con 0x7f38e40b1e60 2024-04-25T10:14:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38e2a00640 1 -- 172.21.15.18:0/3005664423 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38dc0a5cb0 con 0x7f38e40b1e60 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 -- 172.21.15.18:0/3005664423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40b1e60 msgr2=0x7f38e40cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 --2- 172.21.15.18:0/3005664423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40b1e60 0x7f38e40cd930 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f38e406f3a0 tx=0x7f38dc01c930 comp rx=0 tx=0).stop 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 -- 172.21.15.18:0/3005664423 shutdown_connections 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 --2- 172.21.15.18:0/3005664423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40b1e60 0x7f38e40cd930 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 --2- 172.21.15.18:0/3005664423 >> v2:172.21.15.167:3300/0 conn(0x7f38e4145270 0x7f38e415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 -- 172.21.15.18:0/3005664423 >> 172.21.15.18:0/3005664423 conn(0x7f38e4066fa0 msgr2=0x7f38e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 -- 172.21.15.18:0/3005664423 shutdown_connections 2024-04-25T10:14:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.888+0000 7f38ea600640 1 -- 172.21.15.18:0/3005664423 wait complete. 2024-04-25T10:14:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 Processor -- start 2024-04-25T10:14:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- start start 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 0x7f38e41418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e4145270 0x7f38e4160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e415c710 con 0x7f38e40cd4d0 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e415c590 con 0x7f38e4145270 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e415c890 con 0x7f38e40b1e60 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52130/0 (socket says 172.21.15.18:52130) 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 -- 172.21.15.18:0/3091098915 learned_addr learned my addr 172.21.15.18:0/3091098915 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38e3e00640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e4145270 0x7f38e4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38e3400640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 0x7f38e41418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 -- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 msgr2=0x7f38e41418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 0x7f38e41418a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 -- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e4145270 msgr2=0x7f38e4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e4145270 0x7f38e4160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 -- 172.21.15.18:0/3091098915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e4140520 con 0x7f38e40cd4d0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38e3400640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 0x7f38e41418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38dbe00640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0011f0 tx=0x7f38cc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc018070 con 0x7f38e40cd4d0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0074e0 con 0x7f38e40cd4d0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc004a10 con 0x7f38e40cd4d0 2024-04-25T10:14:23.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e4140800 con 0x7f38e40cd4d0 2024-04-25T10:14:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.892+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e4140dc0 con 0x7f38e40cd4d0 2024-04-25T10:14:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e40745d0 con 0x7f38e40cd4d0 2024-04-25T10:14:23.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f38cc01b070 con 0x7f38e40cd4d0 2024-04-25T10:14:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38db400640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 0x7f38c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f38cc084590 con 0x7f38e40cd4d0 2024-04-25T10:14:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38e3400640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 0x7f38c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:23.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.896+0000 7f38e3400640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 0x7f38c0069420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f38d40097a0 tx=0x7f38d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:23.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:23.900+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38cc055400 con 0x7f38e40cd4d0 2024-04-25T10:14:24.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.060+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38e40cd950 con 0x7f38c0066f60 2024-04-25T10:14:24.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.064+0000 7f38db400640 1 -- 172.21.15.18:0/3091098915 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252488 (secure 0 0 0) 0x7f38e40cd950 con 0x7f38c0066f60 2024-04-25T10:14:24.075 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:24.076 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:14:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 msgr2=0x7f38c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:24.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 0x7f38c0069420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f38d40097a0 tx=0x7f38d4008040 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 msgr2=0x7f38e4130d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0011f0 tx=0x7f38cc00c9b0 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 shutdown_connections 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38e4145270 0x7f38e4160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38e40cd4d0 0x7f38e4130d00 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f38c0066f60 0x7f38c0069420 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 --2- 172.21.15.18:0/3091098915 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f38e40b1e60 0x7f38e41418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 >> 172.21.15.18:0/3091098915 conn(0x7f38e4066fa0 msgr2=0x7f38e415d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 shutdown_connections 2024-04-25T10:14:24.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:24.068+0000 7f38ea600640 1 -- 172.21.15.18:0/3091098915 wait complete. 2024-04-25T10:14:24.095 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2024-04-25T10:14:23.559724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262584,"kb_used_data":13128,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712136,"statfs":{"total":773094113280,"available":772825227264,"internally_reserved":0,"allocated":13443072,"data_stored":6896604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.176638"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405704+0000","last_change":"2024-04-25T10:14:18.414993+0000","last_active":"2024-04-25T10:14:19.405704+0000","last_peered":"2024-04-25T10:14:19.405704+0000","last_clean":"2024-04-25T10:14:19.405704+0000","last_became_active":"2024-04-25T10:14:18.414696+0000","last_became_peered":"2024-04-25T10:14:18.414696+0000","last_unstale":"2024-04-25T10:14:19.405704+0000","last_undegraded":"2024-04-25T10:14:19.405704+0000","last_fullsized":"2024-04-25T10:14:19.405704+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623647+0000","last_change":"2024-04-25T10:14:18.409415+0000","last_active":"2024-04-25T10:14:19.623647+0000","last_peered":"2024-04-25T10:14:19.623647+0000","last_clean":"2024-04-25T10:14:19.623647+0000","last_became_active":"2024-04-25T10:14:18.408795+0000","last_became_peered":"2024-04-25T10:14:18.408795+0000","last_unstale":"2024-04-25T10:14:19.623647+0000","last_undegraded":"2024-04-25T10:14:19.623647+0000","last_fullsized":"2024-04-25T10:14:19.623647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:20.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623677+0000","last_change":"2024-04-25T10:14:18.409397+0000","last_active":"2024-04-25T10:14:19.623677+0000","last_peered":"2024-04-25T10:14:19.623677+0000","last_clean":"2024-04-25T10:14:19.623677+0000","last_became_active":"2024-04-25T10:14:18.409071+0000","last_became_peered":"2024-04-25T10:14:18.409071+0000","last_unstale":"2024-04-25T10:14:19.623677+0000","last_undegraded":"2024-04-25T10:14:19.623677+0000","last_fullsized":"2024-04-25T10:14:19.623677+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:35.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626383+0000","last_change":"2024-04-25T10:14:18.418850+0000","last_active":"2024-04-25T10:14:19.626383+0000","last_peered":"2024-04-25T10:14:19.626383+0000","last_clean":"2024-04-25T10:14:19.626383+0000","last_became_active":"2024-04-25T10:14:18.418585+0000","last_became_peered":"2024-04-25T10:14:18.418585+0000","last_unstale":"2024-04-25T10:14:19.626383+0000","last_undegraded":"2024-04-25T10:14:19.626383+0000","last_fullsized":"2024-04-25T10:14:19.626383+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:22.873322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405679+0000","last_change":"2024-04-25T10:14:18.411455+0000","last_active":"2024-04-25T10:14:19.405679+0000","last_peered":"2024-04-25T10:14:19.405679+0000","last_clean":"2024-04-25T10:14:19.405679+0000","last_became_active":"2024-04-25T10:14:18.411173+0000","last_became_peered":"2024-04-25T10:14:18.411173+0000","last_unstale":"2024-04-25T10:14:19.405679+0000","last_undegraded":"2024-04-25T10:14:19.405679+0000","last_fullsized":"2024-04-25T10:14:19.405679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400055+0000","last_change":"2024-04-25T10:14:18.404049+0000","last_active":"2024-04-25T10:14:19.400055+0000","last_peered":"2024-04-25T10:14:19.400055+0000","last_clean":"2024-04-25T10:14:19.400055+0000","last_became_active":"2024-04-25T10:14:18.401992+0000","last_became_peered":"2024-04-25T10:14:18.401992+0000","last_unstale":"2024-04-25T10:14:19.400055+0000","last_undegraded":"2024-04-25T10:14:19.400055+0000","last_fullsized":"2024-04-25T10:14:19.400055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:31.097247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399878+0000","last_change":"2024-04-25T10:14:18.406945+0000","last_active":"2024-04-25T10:14:19.399878+0000","last_peered":"2024-04-25T10:14:19.399878+0000","last_clean":"2024-04-25T10:14:19.399878+0000","last_became_active":"2024-04-25T10:14:18.406179+0000","last_became_peered":"2024-04-25T10:14:18.406179+0000","last_unstale":"2024-04-25T10:14:19.399878+0000","last_undegraded":"2024-04-25T10:14:19.399878+0000","last_fullsized":"2024-04-25T10:14:19.399878+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:02.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622723+0000","last_change":"2024-04-25T10:14:18.411759+0000","last_active":"2024-04-25T10:14:19.622723+0000","last_peered":"2024-04-25T10:14:19.622723+0000","last_clean":"2024-04-25T10:14:19.622723+0000","last_became_active":"2024-04-25T10:14:18.411380+0000","last_became_peered":"2024-04-25T10:14:18.411380+0000","last_unstale":"2024-04-25T10:14:19.622723+0000","last_undegraded":"2024-04-25T10:14:19.622723+0000","last_fullsized":"2024-04-25T10:14:19.622723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:09.512832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626923+0000","last_change":"2024-04-25T10:14:18.415521+0000","last_active":"2024-04-25T10:14:19.626923+0000","last_peered":"2024-04-25T10:14:19.626923+0000","last_clean":"2024-04-25T10:14:19.626923+0000","last_became_active":"2024-04-25T10:14:18.415134+0000","last_became_peered":"2024-04-25T10:14:18.415134+0000","last_unstale":"2024-04-25T10:14:19.626923+0000","last_undegraded":"2024-04-25T10:14:19.626923+0000","last_fullsized":"2024-04-25T10:14:19.626923+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623064+0000","last_change":"2024-04-25T10:14:18.409598+0000","last_active":"2024-04-25T10:14:19.623064+0000","last_peered":"2024-04-25T10:14:19.623064+0000","last_clean":"2024-04-25T10:14:19.623064+0000","last_became_active":"2024-04-25T10:14:18.409240+0000","last_became_peered":"2024-04-25T10:14:18.409240+0000","last_unstale":"2024-04-25T10:14:19.623064+0000","last_undegraded":"2024-04-25T10:14:19.623064+0000","last_fullsized":"2024-04-25T10:14:19.623064+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405782+0000","last_change":"2024-04-25T10:14:18.409006+0000","last_active":"2024-04-25T10:14:19.405782+0000","last_peered":"2024-04-25T10:14:19.405782+0000","last_clean":"2024-04-25T10:14:19.405782+0000","last_became_active":"2024-04-25T10:14:18.408742+0000","last_became_peered":"2024-04-25T10:14:18.408742+0000","last_unstale":"2024-04-25T10:14:19.405782+0000","last_undegraded":"2024-04-25T10:14:19.405782+0000","last_fullsized":"2024-04-25T10:14:19.405782+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400380+0000","last_change":"2024-04-25T10:14:18.394000+0000","last_active":"2024-04-25T10:14:19.400380+0000","last_peered":"2024-04-25T10:14:19.400380+0000","last_clean":"2024-04-25T10:14:19.400380+0000","last_became_active":"2024-04-25T10:14:18.393685+0000","last_became_peered":"2024-04-25T10:14:18.393685+0000","last_unstale":"2024-04-25T10:14:19.400380+0000","last_undegraded":"2024-04-25T10:14:19.400380+0000","last_fullsized":"2024-04-25T10:14:19.400380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:47.095740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622781+0000","last_change":"2024-04-25T10:14:18.414756+0000","last_active":"2024-04-25T10:14:19.622781+0000","last_peered":"2024-04-25T10:14:19.622781+0000","last_clean":"2024-04-25T10:14:19.622781+0000","last_became_active":"2024-04-25T10:14:18.414396+0000","last_became_peered":"2024-04-25T10:14:18.414396+0000","last_unstale":"2024-04-25T10:14:19.622781+0000","last_undegraded":"2024-04-25T10:14:19.622781+0000","last_fullsized":"2024-04-25T10:14:19.622781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623328+0000","last_change":"2024-04-25T10:14:18.413737+0000","last_active":"2024-04-25T10:14:19.623328+0000","last_peered":"2024-04-25T10:14:19.623328+0000","last_clean":"2024-04-25T10:14:19.623328+0000","last_became_active":"2024-04-25T10:14:18.412598+0000","last_became_peered":"2024-04-25T10:14:18.412598+0000","last_unstale":"2024-04-25T10:14:19.623328+0000","last_undegraded":"2024-04-25T10:14:19.623328+0000","last_fullsized":"2024-04-25T10:14:19.623328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:16.882224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404835+0000","last_change":"2024-04-25T10:14:18.410328+0000","last_active":"2024-04-25T10:14:19.404835+0000","last_peered":"2024-04-25T10:14:19.404835+0000","last_clean":"2024-04-25T10:14:19.404835+0000","last_became_active":"2024-04-25T10:14:18.407249+0000","last_became_peered":"2024-04-25T10:14:18.407249+0000","last_unstale":"2024-04-25T10:14:19.404835+0000","last_undegraded":"2024-04-25T10:14:19.404835+0000","last_fullsized":"2024-04-25T10:14:19.404835+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399804+0000","last_change":"2024-04-25T10:14:18.401722+0000","last_active":"2024-04-25T10:14:19.399804+0000","last_peered":"2024-04-25T10:14:19.399804+0000","last_clean":"2024-04-25T10:14:19.399804+0000","last_became_active":"2024-04-25T10:14:18.399127+0000","last_became_peered":"2024-04-25T10:14:18.399127+0000","last_unstale":"2024-04-25T10:14:19.399804+0000","last_undegraded":"2024-04-25T10:14:19.399804+0000","last_fullsized":"2024-04-25T10:14:19.399804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:26.892094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623153+0000","last_change":"2024-04-25T10:14:18.416785+0000","last_active":"2024-04-25T10:14:19.623153+0000","last_peered":"2024-04-25T10:14:19.623153+0000","last_clean":"2024-04-25T10:14:19.623153+0000","last_became_active":"2024-04-25T10:14:18.416519+0000","last_became_peered":"2024-04-25T10:14:18.416519+0000","last_unstale":"2024-04-25T10:14:19.623153+0000","last_undegraded":"2024-04-25T10:14:19.623153+0000","last_fullsized":"2024-04-25T10:14:19.623153+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623803+0000","last_change":"2024-04-25T10:14:18.397519+0000","last_active":"2024-04-25T10:14:19.623803+0000","last_peered":"2024-04-25T10:14:19.623803+0000","last_clean":"2024-04-25T10:14:19.623803+0000","last_became_active":"2024-04-25T10:14:18.397161+0000","last_became_peered":"2024-04-25T10:14:18.397161+0000","last_unstale":"2024-04-25T10:14:19.623803+0000","last_undegraded":"2024-04-25T10:14:19.623803+0000","last_fullsized":"2024-04-25T10:14:19.623803+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:44.100313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404778+0000","last_change":"2024-04-25T10:14:18.417427+0000","last_active":"2024-04-25T10:14:19.404778+0000","last_peered":"2024-04-25T10:14:19.404778+0000","last_clean":"2024-04-25T10:14:19.404778+0000","last_became_active":"2024-04-25T10:14:18.417148+0000","last_became_peered":"2024-04-25T10:14:18.417148+0000","last_unstale":"2024-04-25T10:14:19.404778+0000","last_undegraded":"2024-04-25T10:14:19.404778+0000","last_fullsized":"2024-04-25T10:14:19.404778+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510643+0000","last_change":"2024-04-25T10:14:18.402667+0000","last_active":"2024-04-25T10:14:19.510643+0000","last_peered":"2024-04-25T10:14:19.510643+0000","last_clean":"2024-04-25T10:14:19.510643+0000","last_became_active":"2024-04-25T10:14:18.402309+0000","last_became_peered":"2024-04-25T10:14:18.402309+0000","last_unstale":"2024-04-25T10:14:19.510643+0000","last_undegraded":"2024-04-25T10:14:19.510643+0000","last_fullsized":"2024-04-25T10:14:19.510643+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:55.308915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626252+0000","last_change":"2024-04-25T10:14:18.418284+0000","last_active":"2024-04-25T10:14:19.626252+0000","last_peered":"2024-04-25T10:14:19.626252+0000","last_clean":"2024-04-25T10:14:19.626252+0000","last_became_active":"2024-04-25T10:14:18.418020+0000","last_became_peered":"2024-04-25T10:14:18.418020+0000","last_unstale":"2024-04-25T10:14:19.626252+0000","last_undegraded":"2024-04-25T10:14:19.626252+0000","last_fullsized":"2024-04-25T10:14:19.626252+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:29.883460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405177+0000","last_change":"2024-04-25T10:14:18.403230+0000","last_active":"2024-04-25T10:14:19.405177+0000","last_peered":"2024-04-25T10:14:19.405177+0000","last_clean":"2024-04-25T10:14:19.405177+0000","last_became_active":"2024-04-25T10:14:18.402772+0000","last_became_peered":"2024-04-25T10:14:18.402772+0000","last_unstale":"2024-04-25T10:14:19.405177+0000","last_undegraded":"2024-04-25T10:14:19.405177+0000","last_fullsized":"2024-04-25T10:14:19.405177+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626278+0000","last_change":"2024-04-25T10:14:18.416108+0000","last_active":"2024-04-25T10:14:19.626278+0000","last_peered":"2024-04-25T10:14:19.626278+0000","last_clean":"2024-04-25T10:14:19.626278+0000","last_became_active":"2024-04-25T10:14:18.415615+0000","last_became_peered":"2024-04-25T10:14:18.415615+0000","last_unstale":"2024-04-25T10:14:19.626278+0000","last_undegraded":"2024-04-25T10:14:19.626278+0000","last_fullsized":"2024-04-25T10:14:19.626278+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:38.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625661+0000","last_change":"2024-04-25T10:14:18.420104+0000","last_active":"2024-04-25T10:14:19.625661+0000","last_peered":"2024-04-25T10:14:19.625661+0000","last_clean":"2024-04-25T10:14:19.625661+0000","last_became_active":"2024-04-25T10:14:18.419237+0000","last_became_peered":"2024-04-25T10:14:18.419237+0000","last_unstale":"2024-04-25T10:14:19.625661+0000","last_undegraded":"2024-04-25T10:14:19.625661+0000","last_fullsized":"2024-04-25T10:14:19.625661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627282+0000","last_change":"2024-04-25T10:14:18.414943+0000","last_active":"2024-04-25T10:14:19.627282+0000","last_peered":"2024-04-25T10:14:19.627282+0000","last_clean":"2024-04-25T10:14:19.627282+0000","last_became_active":"2024-04-25T10:14:18.414618+0000","last_became_peered":"2024-04-25T10:14:18.414618+0000","last_unstale":"2024-04-25T10:14:19.627282+0000","last_undegraded":"2024-04-25T10:14:19.627282+0000","last_fullsized":"2024-04-25T10:14:19.627282+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:22.873322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510755+0000","last_change":"2024-04-25T10:14:18.410596+0000","last_active":"2024-04-25T10:14:19.510755+0000","last_peered":"2024-04-25T10:14:19.510755+0000","last_clean":"2024-04-25T10:14:19.510755+0000","last_became_active":"2024-04-25T10:14:18.410207+0000","last_became_peered":"2024-04-25T10:14:18.410207+0000","last_unstale":"2024-04-25T10:14:19.510755+0000","last_undegraded":"2024-04-25T10:14:19.510755+0000","last_fullsized":"2024-04-25T10:14:19.510755+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:56.353852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404933+0000","last_change":"2024-04-25T10:14:18.401213+0000","last_active":"2024-04-25T10:14:19.404933+0000","last_peered":"2024-04-25T10:14:19.404933+0000","last_clean":"2024-04-25T10:14:19.404933+0000","last_became_active":"2024-04-25T10:14:18.400840+0000","last_became_peered":"2024-04-25T10:14:18.400840+0000","last_unstale":"2024-04-25T10:14:19.404933+0000","last_undegraded":"2024-04-25T10:14:19.404933+0000","last_fullsized":"2024-04-25T10:14:19.404933+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400400+0000","last_change":"2024-04-25T10:14:18.405336+0000","last_active":"2024-04-25T10:14:19.400400+0000","last_peered":"2024-04-25T10:14:19.400400+0000","last_clean":"2024-04-25T10:14:19.400400+0000","last_became_active":"2024-04-25T10:14:18.404453+0000","last_became_peered":"2024-04-25T10:14:18.404453+0000","last_unstale":"2024-04-25T10:14:19.400400+0000","last_undegraded":"2024-04-25T10:14:19.400400+0000","last_fullsized":"2024-04-25T10:14:19.400400+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:55.063508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510667+0000","last_change":"2024-04-25T10:14:18.397773+0000","last_active":"2024-04-25T10:14:19.510667+0000","last_peered":"2024-04-25T10:14:19.510667+0000","last_clean":"2024-04-25T10:14:19.510667+0000","last_became_active":"2024-04-25T10:14:18.395826+0000","last_became_peered":"2024-04-25T10:14:18.395826+0000","last_unstale":"2024-04-25T10:14:19.510667+0000","last_undegraded":"2024-04-25T10:14:19.510667+0000","last_fullsized":"2024-04-25T10:14:19.510667+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:47.551105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623336+0000","last_change":"2024-04-25T10:14:18.397495+0000","last_active":"2024-04-25T10:14:19.623336+0000","last_peered":"2024-04-25T10:14:19.623336+0000","last_clean":"2024-04-25T10:14:19.623336+0000","last_became_active":"2024-04-25T10:14:18.397045+0000","last_became_peered":"2024-04-25T10:14:18.397045+0000","last_unstale":"2024-04-25T10:14:19.623336+0000","last_undegraded":"2024-04-25T10:14:19.623336+0000","last_fullsized":"2024-04-25T10:14:19.623336+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:24.575507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626500+0000","last_change":"2024-04-25T10:14:18.405962+0000","last_active":"2024-04-25T10:14:19.626500+0000","last_peered":"2024-04-25T10:14:19.626500+0000","last_clean":"2024-04-25T10:14:19.626500+0000","last_became_active":"2024-04-25T10:14:18.405487+0000","last_became_peered":"2024-04-25T10:14:18.405487+0000","last_unstale":"2024-04-25T10:14:19.626500+0000","last_undegraded":"2024-04-25T10:14:19.626500+0000","last_fullsized":"2024-04-25T10:14:19.626500+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625668+0000","last_change":"2024-04-25T10:14:18.417527+0000","last_active":"2024-04-25T10:14:19.625668+0000","last_peered":"2024-04-25T10:14:19.625668+0000","last_clean":"2024-04-25T10:14:19.625668+0000","last_became_active":"2024-04-25T10:14:18.417210+0000","last_became_peered":"2024-04-25T10:14:18.417210+0000","last_unstale":"2024-04-25T10:14:19.625668+0000","last_undegraded":"2024-04-25T10:14:19.625668+0000","last_fullsized":"2024-04-25T10:14:19.625668+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622943+0000","last_change":"2024-04-25T10:14:18.410644+0000","last_active":"2024-04-25T10:14:19.622943+0000","last_peered":"2024-04-25T10:14:19.622943+0000","last_clean":"2024-04-25T10:14:19.622943+0000","last_became_active":"2024-04-25T10:14:18.409977+0000","last_became_peered":"2024-04-25T10:14:18.409977+0000","last_unstale":"2024-04-25T10:14:19.622943+0000","last_undegraded":"2024-04-25T10:14:19.622943+0000","last_fullsized":"2024-04-25T10:14:19.622943+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"122'4","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405237+0000","last_change":"2024-04-25T10:14:17.405872+0000","last_active":"2024-04-25T10:14:19.405237+0000","last_peered":"2024-04-25T10:14:19.405237+0000","last_clean":"2024-04-25T10:14:19.405237+0000","last_became_active":"2024-04-25T10:14:17.405528+0000","last_became_peered":"2024-04-25T10:14:17.405528+0000","last_unstale":"2024-04-25T10:14:19.405237+0000","last_undegraded":"2024-04-25T10:14:19.405237+0000","last_fullsized":"2024-04-25T10:14:19.405237+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400335+0000","last_change":"2024-04-25T10:14:18.396951+0000","last_active":"2024-04-25T10:14:19.400335+0000","last_peered":"2024-04-25T10:14:19.400335+0000","last_clean":"2024-04-25T10:14:19.400335+0000","last_became_active":"2024-04-25T10:14:18.396708+0000","last_became_peered":"2024-04-25T10:14:18.396708+0000","last_unstale":"2024-04-25T10:14:19.400335+0000","last_undegraded":"2024-04-25T10:14:19.400335+0000","last_fullsized":"2024-04-25T10:14:19.400335+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:04.531917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623148+0000","last_change":"2024-04-25T10:14:17.403862+0000","last_active":"2024-04-25T10:14:19.623148+0000","last_peered":"2024-04-25T10:14:19.623148+0000","last_clean":"2024-04-25T10:14:19.623148+0000","last_became_active":"2024-04-25T10:14:17.403579+0000","last_became_peered":"2024-04-25T10:14:17.403579+0000","last_unstale":"2024-04-25T10:14:19.623148+0000","last_undegraded":"2024-04-25T10:14:19.623148+0000","last_fullsized":"2024-04-25T10:14:19.623148+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:37.737153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626939+0000","last_change":"2024-04-25T10:14:18.409758+0000","last_active":"2024-04-25T10:14:19.626939+0000","last_peered":"2024-04-25T10:14:19.626939+0000","last_clean":"2024-04-25T10:14:19.626939+0000","last_became_active":"2024-04-25T10:14:18.408543+0000","last_became_peered":"2024-04-25T10:14:18.408543+0000","last_unstale":"2024-04-25T10:14:19.626939+0000","last_undegraded":"2024-04-25T10:14:19.626939+0000","last_fullsized":"2024-04-25T10:14:19.626939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:29.883460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626068+0000","last_change":"2024-04-25T10:14:17.407577+0000","last_active":"2024-04-25T10:14:19.626068+0000","last_peered":"2024-04-25T10:14:19.626068+0000","last_clean":"2024-04-25T10:14:19.626068+0000","last_became_active":"2024-04-25T10:14:17.407208+0000","last_became_peered":"2024-04-25T10:14:17.407208+0000","last_unstale":"2024-04-25T10:14:19.626068+0000","last_undegraded":"2024-04-25T10:14:19.626068+0000","last_fullsized":"2024-04-25T10:14:19.626068+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:56.204795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627024+0000","last_change":"2024-04-25T10:14:18.418508+0000","last_active":"2024-04-25T10:14:19.627024+0000","last_peered":"2024-04-25T10:14:19.627024+0000","last_clean":"2024-04-25T10:14:19.627024+0000","last_became_active":"2024-04-25T10:14:18.418110+0000","last_became_peered":"2024-04-25T10:14:18.418110+0000","last_unstale":"2024-04-25T10:14:19.627024+0000","last_undegraded":"2024-04-25T10:14:19.627024+0000","last_fullsized":"2024-04-25T10:14:19.627024+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:27.873645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623225+0000","last_change":"2024-04-25T10:14:17.395546+0000","last_active":"2024-04-25T10:14:19.623225+0000","last_peered":"2024-04-25T10:14:19.623225+0000","last_clean":"2024-04-25T10:14:19.623225+0000","last_became_active":"2024-04-25T10:14:17.395257+0000","last_became_peered":"2024-04-25T10:14:17.395257+0000","last_unstale":"2024-04-25T10:14:19.623225+0000","last_undegraded":"2024-04-25T10:14:19.623225+0000","last_fullsized":"2024-04-25T10:14:19.623225+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.424713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622587+0000","last_change":"2024-04-25T10:14:18.406536+0000","last_active":"2024-04-25T10:14:19.622587+0000","last_peered":"2024-04-25T10:14:19.622587+0000","last_clean":"2024-04-25T10:14:19.622587+0000","last_became_active":"2024-04-25T10:14:18.405916+0000","last_became_peered":"2024-04-25T10:14:18.405916+0000","last_unstale":"2024-04-25T10:14:19.622587+0000","last_undegraded":"2024-04-25T10:14:19.622587+0000","last_fullsized":"2024-04-25T10:14:19.622587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405665+0000","last_change":"2024-04-25T10:14:17.398736+0000","last_active":"2024-04-25T10:14:19.405665+0000","last_peered":"2024-04-25T10:14:19.405665+0000","last_clean":"2024-04-25T10:14:19.405665+0000","last_became_active":"2024-04-25T10:14:17.398429+0000","last_became_peered":"2024-04-25T10:14:17.398429+0000","last_unstale":"2024-04-25T10:14:19.405665+0000","last_undegraded":"2024-04-25T10:14:19.405665+0000","last_fullsized":"2024-04-25T10:14:19.405665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404914+0000","last_change":"2024-04-25T10:14:18.412191+0000","last_active":"2024-04-25T10:14:19.404914+0000","last_peered":"2024-04-25T10:14:19.404914+0000","last_clean":"2024-04-25T10:14:19.404914+0000","last_became_active":"2024-04-25T10:14:18.410302+0000","last_became_peered":"2024-04-25T10:14:18.410302+0000","last_unstale":"2024-04-25T10:14:19.404914+0000","last_undegraded":"2024-04-25T10:14:19.404914+0000","last_fullsized":"2024-04-25T10:14:19.404914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400099+0000","last_change":"2024-04-25T10:14:17.401879+0000","last_active":"2024-04-25T10:14:19.400099+0000","last_peered":"2024-04-25T10:14:19.400099+0000","last_clean":"2024-04-25T10:14:19.400099+0000","last_became_active":"2024-04-25T10:14:17.401618+0000","last_became_peered":"2024-04-25T10:14:17.401618+0000","last_unstale":"2024-04-25T10:14:19.400099+0000","last_undegraded":"2024-04-25T10:14:19.400099+0000","last_fullsized":"2024-04-25T10:14:19.400099+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:43.083648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623588+0000","last_change":"2024-04-25T10:14:18.399652+0000","last_active":"2024-04-25T10:14:19.623588+0000","last_peered":"2024-04-25T10:14:19.623588+0000","last_clean":"2024-04-25T10:14:19.623588+0000","last_became_active":"2024-04-25T10:14:18.399368+0000","last_became_peered":"2024-04-25T10:14:18.399368+0000","last_unstale":"2024-04-25T10:14:19.623588+0000","last_undegraded":"2024-04-25T10:14:19.623588+0000","last_fullsized":"2024-04-25T10:14:19.623588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:00.217363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626504+0000","last_change":"2024-04-25T10:14:17.397943+0000","last_active":"2024-04-25T10:14:19.626504+0000","last_peered":"2024-04-25T10:14:19.626504+0000","last_clean":"2024-04-25T10:14:19.626504+0000","last_became_active":"2024-04-25T10:14:17.397629+0000","last_became_peered":"2024-04-25T10:14:17.397629+0000","last_unstale":"2024-04-25T10:14:19.626504+0000","last_undegraded":"2024-04-25T10:14:19.626504+0000","last_fullsized":"2024-04-25T10:14:19.626504+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622861+0000","last_change":"2024-04-25T10:14:18.419554+0000","last_active":"2024-04-25T10:14:19.622861+0000","last_peered":"2024-04-25T10:14:19.622861+0000","last_clean":"2024-04-25T10:14:19.622861+0000","last_became_active":"2024-04-25T10:14:18.419259+0000","last_became_peered":"2024-04-25T10:14:18.419259+0000","last_unstale":"2024-04-25T10:14:19.622861+0000","last_undegraded":"2024-04-25T10:14:19.622861+0000","last_fullsized":"2024-04-25T10:14:19.622861+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399985+0000","last_change":"2024-04-25T10:14:17.400512+0000","last_active":"2024-04-25T10:14:19.399985+0000","last_peered":"2024-04-25T10:14:19.399985+0000","last_clean":"2024-04-25T10:14:19.399985+0000","last_became_active":"2024-04-25T10:14:17.400048+0000","last_became_peered":"2024-04-25T10:14:17.400048+0000","last_unstale":"2024-04-25T10:14:19.399985+0000","last_undegraded":"2024-04-25T10:14:19.399985+0000","last_fullsized":"2024-04-25T10:14:19.399985+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:48.475881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404512+0000","last_change":"2024-04-25T10:14:18.422603+0000","last_active":"2024-04-25T10:14:19.404512+0000","last_peered":"2024-04-25T10:14:19.404512+0000","last_clean":"2024-04-25T10:14:19.404512+0000","last_became_active":"2024-04-25T10:14:18.422007+0000","last_became_peered":"2024-04-25T10:14:18.422007+0000","last_unstale":"2024-04-25T10:14:19.404512+0000","last_undegraded":"2024-04-25T10:14:19.404512+0000","last_fullsized":"2024-04-25T10:14:19.404512+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405349+0000","last_change":"2024-04-25T10:14:17.403152+0000","last_active":"2024-04-25T10:14:19.405349+0000","last_peered":"2024-04-25T10:14:19.405349+0000","last_clean":"2024-04-25T10:14:19.405349+0000","last_became_active":"2024-04-25T10:14:17.401700+0000","last_became_peered":"2024-04-25T10:14:17.401700+0000","last_unstale":"2024-04-25T10:14:19.405349+0000","last_undegraded":"2024-04-25T10:14:19.405349+0000","last_fullsized":"2024-04-25T10:14:19.405349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626964+0000","last_change":"2024-04-25T10:14:18.408517+0000","last_active":"2024-04-25T10:14:19.626964+0000","last_peered":"2024-04-25T10:14:19.626964+0000","last_clean":"2024-04-25T10:14:19.626964+0000","last_became_active":"2024-04-25T10:14:18.408242+0000","last_became_peered":"2024-04-25T10:14:18.408242+0000","last_unstale":"2024-04-25T10:14:19.626964+0000","last_undegraded":"2024-04-25T10:14:19.626964+0000","last_fullsized":"2024-04-25T10:14:19.626964+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:38.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627112+0000","last_change":"2024-04-25T10:14:17.406735+0000","last_active":"2024-04-25T10:14:19.627112+0000","last_peered":"2024-04-25T10:14:19.627112+0000","last_clean":"2024-04-25T10:14:19.627112+0000","last_became_active":"2024-04-25T10:14:17.406473+0000","last_became_peered":"2024-04-25T10:14:17.406473+0000","last_unstale":"2024-04-25T10:14:19.627112+0000","last_undegraded":"2024-04-25T10:14:19.627112+0000","last_fullsized":"2024-04-25T10:14:19.627112+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623890+0000","last_change":"2024-04-25T10:14:18.413506+0000","last_active":"2024-04-25T10:14:19.623890+0000","last_peered":"2024-04-25T10:14:19.623890+0000","last_clean":"2024-04-25T10:14:19.623890+0000","last_became_active":"2024-04-25T10:14:18.411364+0000","last_became_peered":"2024-04-25T10:14:18.411364+0000","last_unstale":"2024-04-25T10:14:19.623890+0000","last_undegraded":"2024-04-25T10:14:19.623890+0000","last_fullsized":"2024-04-25T10:14:19.623890+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:26.496771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"122'3","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627064+0000","last_change":"2024-04-25T10:14:17.404230+0000","last_active":"2024-04-25T10:14:19.627064+0000","last_peered":"2024-04-25T10:14:19.627064+0000","last_clean":"2024-04-25T10:14:19.627064+0000","last_became_active":"2024-04-25T10:14:17.403964+0000","last_became_peered":"2024-04-25T10:14:17.403964+0000","last_unstale":"2024-04-25T10:14:19.627064+0000","last_undegraded":"2024-04-25T10:14:19.627064+0000","last_fullsized":"2024-04-25T10:14:19.627064+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627331+0000","last_change":"2024-04-25T10:14:18.412011+0000","last_active":"2024-04-25T10:14:19.627331+0000","last_peered":"2024-04-25T10:14:19.627331+0000","last_clean":"2024-04-25T10:14:19.627331+0000","last_became_active":"2024-04-25T10:14:18.411540+0000","last_became_peered":"2024-04-25T10:14:18.411540+0000","last_unstale":"2024-04-25T10:14:19.627331+0000","last_undegraded":"2024-04-25T10:14:19.627331+0000","last_fullsized":"2024-04-25T10:14:19.627331+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:18.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"122'6","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623419+0000","last_change":"2024-04-25T10:14:17.401245+0000","last_active":"2024-04-25T10:14:19.623419+0000","last_peered":"2024-04-25T10:14:19.623419+0000","last_clean":"2024-04-25T10:14:19.623419+0000","last_became_active":"2024-04-25T10:14:17.400983+0000","last_became_peered":"2024-04-25T10:14:17.400983+0000","last_unstale":"2024-04-25T10:14:19.623419+0000","last_undegraded":"2024-04-25T10:14:19.623419+0000","last_fullsized":"2024-04-25T10:14:19.623419+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:54.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404602+0000","last_change":"2024-04-25T10:14:18.397572+0000","last_active":"2024-04-25T10:14:19.404602+0000","last_peered":"2024-04-25T10:14:19.404602+0000","last_clean":"2024-04-25T10:14:19.404602+0000","last_became_active":"2024-04-25T10:14:18.397253+0000","last_became_peered":"2024-04-25T10:14:18.397253+0000","last_unstale":"2024-04-25T10:14:19.404602+0000","last_undegraded":"2024-04-25T10:14:19.404602+0000","last_fullsized":"2024-04-25T10:14:19.404602+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623517+0000","last_change":"2024-04-25T10:14:17.406496+0000","last_active":"2024-04-25T10:14:19.623517+0000","last_peered":"2024-04-25T10:14:19.623517+0000","last_clean":"2024-04-25T10:14:19.623517+0000","last_became_active":"2024-04-25T10:14:17.404083+0000","last_became_peered":"2024-04-25T10:14:17.404083+0000","last_unstale":"2024-04-25T10:14:19.623517+0000","last_undegraded":"2024-04-25T10:14:19.623517+0000","last_fullsized":"2024-04-25T10:14:19.623517+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:34.465728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622587+0000","last_change":"2024-04-25T10:14:18.417029+0000","last_active":"2024-04-25T10:14:19.622587+0000","last_peered":"2024-04-25T10:14:19.622587+0000","last_clean":"2024-04-25T10:14:19.622587+0000","last_became_active":"2024-04-25T10:14:18.416421+0000","last_became_peered":"2024-04-25T10:14:18.416421+0000","last_unstale":"2024-04-25T10:14:19.622587+0000","last_undegraded":"2024-04-25T10:14:19.622587+0000","last_fullsized":"2024-04-25T10:14:19.622587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623672+0000","last_change":"2024-04-25T10:14:17.398290+0000","last_active":"2024-04-25T10:14:19.623672+0000","last_peered":"2024-04-25T10:14:19.623672+0000","last_clean":"2024-04-25T10:14:19.623672+0000","last_became_active":"2024-04-25T10:14:17.397904+0000","last_became_peered":"2024-04-25T10:14:17.397904+0000","last_unstale":"2024-04-25T10:14:19.623672+0000","last_undegraded":"2024-04-25T10:14:19.623672+0000","last_fullsized":"2024-04-25T10:14:19.623672+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:21.571171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510560+0000","last_change":"2024-04-25T10:14:18.395302+0000","last_active":"2024-04-25T10:14:19.510560+0000","last_peered":"2024-04-25T10:14:19.510560+0000","last_clean":"2024-04-25T10:14:19.510560+0000","last_became_active":"2024-04-25T10:14:18.393973+0000","last_became_peered":"2024-04-25T10:14:18.393973+0000","last_unstale":"2024-04-25T10:14:19.510560+0000","last_undegraded":"2024-04-25T10:14:19.510560+0000","last_fullsized":"2024-04-25T10:14:19.510560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:44.212560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623109+0000","last_change":"2024-04-25T10:14:17.400452+0000","last_active":"2024-04-25T10:14:19.623109+0000","last_peered":"2024-04-25T10:14:19.623109+0000","last_clean":"2024-04-25T10:14:19.623109+0000","last_became_active":"2024-04-25T10:14:17.400162+0000","last_became_peered":"2024-04-25T10:14:17.400162+0000","last_unstale":"2024-04-25T10:14:19.623109+0000","last_undegraded":"2024-04-25T10:14:19.623109+0000","last_fullsized":"2024-04-25T10:14:19.623109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:47.976475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626845+0000","last_change":"2024-04-25T10:14:18.413950+0000","last_active":"2024-04-25T10:14:19.626845+0000","last_peered":"2024-04-25T10:14:19.626845+0000","last_clean":"2024-04-25T10:14:19.626845+0000","last_became_active":"2024-04-25T10:14:18.413613+0000","last_became_peered":"2024-04-25T10:14:18.413613+0000","last_unstale":"2024-04-25T10:14:19.626845+0000","last_undegraded":"2024-04-25T10:14:19.626845+0000","last_fullsized":"2024-04-25T10:14:19.626845+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623158+0000","last_change":"2024-04-25T10:14:17.391475+0000","last_active":"2024-04-25T10:14:19.623158+0000","last_peered":"2024-04-25T10:14:19.623158+0000","last_clean":"2024-04-25T10:14:19.623158+0000","last_became_active":"2024-04-25T10:14:17.390629+0000","last_became_peered":"2024-04-25T10:14:17.390629+0000","last_unstale":"2024-04-25T10:14:19.623158+0000","last_undegraded":"2024-04-25T10:14:19.623158+0000","last_fullsized":"2024-04-25T10:14:19.623158+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:31.965799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405485+0000","last_change":"2024-04-25T10:14:18.403183+0000","last_active":"2024-04-25T10:14:19.405485+0000","last_peered":"2024-04-25T10:14:19.405485+0000","last_clean":"2024-04-25T10:14:19.405485+0000","last_became_active":"2024-04-25T10:14:18.402794+0000","last_became_peered":"2024-04-25T10:14:18.402794+0000","last_unstale":"2024-04-25T10:14:19.405485+0000","last_undegraded":"2024-04-25T10:14:19.405485+0000","last_fullsized":"2024-04-25T10:14:19.405485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510829+0000","last_change":"2024-04-25T10:14:17.402367+0000","last_active":"2024-04-25T10:14:19.510829+0000","last_peered":"2024-04-25T10:14:19.510829+0000","last_clean":"2024-04-25T10:14:19.510829+0000","last_became_active":"2024-04-25T10:14:17.402100+0000","last_became_peered":"2024-04-25T10:14:17.402100+0000","last_unstale":"2024-04-25T10:14:19.510829+0000","last_undegraded":"2024-04-25T10:14:19.510829+0000","last_fullsized":"2024-04-25T10:14:19.510829+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400538+0000","last_change":"2024-04-25T10:14:18.407239+0000","last_active":"2024-04-25T10:14:19.400538+0000","last_peered":"2024-04-25T10:14:19.400538+0000","last_clean":"2024-04-25T10:14:19.400538+0000","last_became_active":"2024-04-25T10:14:18.406956+0000","last_became_peered":"2024-04-25T10:14:18.406956+0000","last_unstale":"2024-04-25T10:14:19.400538+0000","last_undegraded":"2024-04-25T10:14:19.400538+0000","last_fullsized":"2024-04-25T10:14:19.400538+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:06.584008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626276+0000","last_change":"2024-04-25T10:14:17.404204+0000","last_active":"2024-04-25T10:14:19.626276+0000","last_peered":"2024-04-25T10:14:19.626276+0000","last_clean":"2024-04-25T10:14:19.626276+0000","last_became_active":"2024-04-25T10:14:17.403934+0000","last_became_peered":"2024-04-25T10:14:17.403934+0000","last_unstale":"2024-04-25T10:14:19.626276+0000","last_undegraded":"2024-04-25T10:14:19.626276+0000","last_fullsized":"2024-04-25T10:14:19.626276+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:45.520950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627380+0000","last_change":"2024-04-25T10:14:18.418150+0000","last_active":"2024-04-25T10:14:19.627380+0000","last_peered":"2024-04-25T10:14:19.627380+0000","last_clean":"2024-04-25T10:14:19.627380+0000","last_became_active":"2024-04-25T10:14:18.417911+0000","last_became_peered":"2024-04-25T10:14:18.417911+0000","last_unstale":"2024-04-25T10:14:19.627380+0000","last_undegraded":"2024-04-25T10:14:19.627380+0000","last_fullsized":"2024-04-25T10:14:19.627380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:36.137237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626162+0000","last_change":"2024-04-25T10:14:17.404836+0000","last_active":"2024-04-25T10:14:19.626162+0000","last_peered":"2024-04-25T10:14:19.626162+0000","last_clean":"2024-04-25T10:14:19.626162+0000","last_became_active":"2024-04-25T10:14:17.404271+0000","last_became_peered":"2024-04-25T10:14:17.404271+0000","last_unstale":"2024-04-25T10:14:19.626162+0000","last_undegraded":"2024-04-25T10:14:19.626162+0000","last_fullsized":"2024-04-25T10:14:19.626162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399807+0000","last_change":"2024-04-25T10:14:18.390723+0000","last_active":"2024-04-25T10:14:19.399807+0000","last_peered":"2024-04-25T10:14:19.399807+0000","last_clean":"2024-04-25T10:14:19.399807+0000","last_became_active":"2024-04-25T10:14:18.390396+0000","last_became_peered":"2024-04-25T10:14:18.390396+0000","last_unstale":"2024-04-25T10:14:19.399807+0000","last_undegraded":"2024-04-25T10:14:19.399807+0000","last_fullsized":"2024-04-25T10:14:19.399807+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:22.931931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400070+0000","last_change":"2024-04-25T10:14:17.398390+0000","last_active":"2024-04-25T10:14:19.400070+0000","last_peered":"2024-04-25T10:14:19.400070+0000","last_clean":"2024-04-25T10:14:19.400070+0000","last_became_active":"2024-04-25T10:14:17.398021+0000","last_became_peered":"2024-04-25T10:14:17.398021+0000","last_unstale":"2024-04-25T10:14:19.400070+0000","last_undegraded":"2024-04-25T10:14:19.400070+0000","last_fullsized":"2024-04-25T10:14:19.400070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:07.527714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622773+0000","last_change":"2024-04-25T10:14:18.407170+0000","last_active":"2024-04-25T10:14:19.622773+0000","last_peered":"2024-04-25T10:14:19.622773+0000","last_clean":"2024-04-25T10:14:19.622773+0000","last_became_active":"2024-04-25T10:14:18.406874+0000","last_became_peered":"2024-04-25T10:14:18.406874+0000","last_unstale":"2024-04-25T10:14:19.622773+0000","last_undegraded":"2024-04-25T10:14:19.622773+0000","last_fullsized":"2024-04-25T10:14:19.622773+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:59.448756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625964+0000","last_change":"2024-04-25T10:14:17.404555+0000","last_active":"2024-04-25T10:14:19.625964+0000","last_peered":"2024-04-25T10:14:19.625964+0000","last_clean":"2024-04-25T10:14:19.625964+0000","last_became_active":"2024-04-25T10:14:17.403773+0000","last_became_peered":"2024-04-25T10:14:17.403773+0000","last_unstale":"2024-04-25T10:14:19.625964+0000","last_undegraded":"2024-04-25T10:14:19.625964+0000","last_fullsized":"2024-04-25T10:14:19.625964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:32.166981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623674+0000","last_change":"2024-04-25T10:14:18.413125+0000","last_active":"2024-04-25T10:14:19.623674+0000","last_peered":"2024-04-25T10:14:19.623674+0000","last_clean":"2024-04-25T10:14:19.623674+0000","last_became_active":"2024-04-25T10:14:18.412151+0000","last_became_peered":"2024-04-25T10:14:18.412151+0000","last_unstale":"2024-04-25T10:14:19.623674+0000","last_undegraded":"2024-04-25T10:14:19.623674+0000","last_fullsized":"2024-04-25T10:14:19.623674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:24.015774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623120+0000","last_change":"2024-04-25T10:14:17.405282+0000","last_active":"2024-04-25T10:14:19.623120+0000","last_peered":"2024-04-25T10:14:19.623120+0000","last_clean":"2024-04-25T10:14:19.623120+0000","last_became_active":"2024-04-25T10:14:17.404960+0000","last_became_peered":"2024-04-25T10:14:17.404960+0000","last_unstale":"2024-04-25T10:14:19.623120+0000","last_undegraded":"2024-04-25T10:14:19.623120+0000","last_fullsized":"2024-04-25T10:14:19.623120+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:27.320952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626823+0000","last_change":"2024-04-25T10:14:18.412260+0000","last_active":"2024-04-25T10:14:19.626823+0000","last_peered":"2024-04-25T10:14:19.626823+0000","last_clean":"2024-04-25T10:14:19.626823+0000","last_became_active":"2024-04-25T10:14:18.409658+0000","last_became_peered":"2024-04-25T10:14:18.409658+0000","last_unstale":"2024-04-25T10:14:19.626823+0000","last_undegraded":"2024-04-25T10:14:19.626823+0000","last_fullsized":"2024-04-25T10:14:19.626823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625576+0000","last_change":"2024-04-25T10:14:17.407199+0000","last_active":"2024-04-25T10:14:19.625576+0000","last_peered":"2024-04-25T10:14:19.625576+0000","last_clean":"2024-04-25T10:14:19.625576+0000","last_became_active":"2024-04-25T10:14:17.406929+0000","last_became_peered":"2024-04-25T10:14:17.406929+0000","last_unstale":"2024-04-25T10:14:19.625576+0000","last_undegraded":"2024-04-25T10:14:19.625576+0000","last_fullsized":"2024-04-25T10:14:19.625576+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:10.191948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400588+0000","last_change":"2024-04-25T10:14:18.412627+0000","last_active":"2024-04-25T10:14:19.400588+0000","last_peered":"2024-04-25T10:14:19.400588+0000","last_clean":"2024-04-25T10:14:19.400588+0000","last_became_active":"2024-04-25T10:14:18.411790+0000","last_became_peered":"2024-04-25T10:14:18.411790+0000","last_unstale":"2024-04-25T10:14:19.400588+0000","last_undegraded":"2024-04-25T10:14:19.400588+0000","last_fullsized":"2024-04-25T10:14:19.400588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:33.949305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400692+0000","last_change":"2024-04-25T10:14:17.399197+0000","last_active":"2024-04-25T10:14:19.400692+0000","last_peered":"2024-04-25T10:14:19.400692+0000","last_clean":"2024-04-25T10:14:19.400692+0000","last_became_active":"2024-04-25T10:14:17.394930+0000","last_became_peered":"2024-04-25T10:14:17.394930+0000","last_unstale":"2024-04-25T10:14:19.400692+0000","last_undegraded":"2024-04-25T10:14:19.400692+0000","last_fullsized":"2024-04-25T10:14:19.400692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:16.136818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622816+0000","last_change":"2024-04-25T10:14:18.417209+0000","last_active":"2024-04-25T10:14:19.622816+0000","last_peered":"2024-04-25T10:14:19.622816+0000","last_clean":"2024-04-25T10:14:19.622816+0000","last_became_active":"2024-04-25T10:14:18.416285+0000","last_became_peered":"2024-04-25T10:14:18.416285+0000","last_unstale":"2024-04-25T10:14:19.622816+0000","last_undegraded":"2024-04-25T10:14:19.622816+0000","last_fullsized":"2024-04-25T10:14:19.622816+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"123'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405253+0000","last_change":"2024-04-25T10:14:17.401377+0000","last_active":"2024-04-25T10:14:19.405253+0000","last_peered":"2024-04-25T10:14:19.405253+0000","last_clean":"2024-04-25T10:14:19.405253+0000","last_became_active":"2024-04-25T10:14:17.400310+0000","last_became_peered":"2024-04-25T10:14:17.400310+0000","last_unstale":"2024-04-25T10:14:19.405253+0000","last_undegraded":"2024-04-25T10:14:19.405253+0000","last_fullsized":"2024-04-25T10:14:19.405253+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626745+0000","last_change":"2024-04-25T10:14:18.418899+0000","last_active":"2024-04-25T10:14:19.626745+0000","last_peered":"2024-04-25T10:14:19.626745+0000","last_clean":"2024-04-25T10:14:19.626745+0000","last_became_active":"2024-04-25T10:14:18.418620+0000","last_became_peered":"2024-04-25T10:14:18.418620+0000","last_unstale":"2024-04-25T10:14:19.626745+0000","last_undegraded":"2024-04-25T10:14:19.626745+0000","last_fullsized":"2024-04-25T10:14:19.626745+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:18.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405027+0000","last_change":"2024-04-25T10:14:17.401969+0000","last_active":"2024-04-25T10:14:19.405027+0000","last_peered":"2024-04-25T10:14:19.405027+0000","last_clean":"2024-04-25T10:14:19.405027+0000","last_became_active":"2024-04-25T10:14:17.401055+0000","last_became_peered":"2024-04-25T10:14:17.401055+0000","last_unstale":"2024-04-25T10:14:19.405027+0000","last_undegraded":"2024-04-25T10:14:19.405027+0000","last_fullsized":"2024-04-25T10:14:19.405027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510852+0000","last_change":"2024-04-25T10:14:18.413756+0000","last_active":"2024-04-25T10:14:19.510852+0000","last_peered":"2024-04-25T10:14:19.510852+0000","last_clean":"2024-04-25T10:14:19.510852+0000","last_became_active":"2024-04-25T10:14:18.413389+0000","last_became_peered":"2024-04-25T10:14:18.413389+0000","last_unstale":"2024-04-25T10:14:19.510852+0000","last_undegraded":"2024-04-25T10:14:19.510852+0000","last_fullsized":"2024-04-25T10:14:19.510852+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:53.173171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400518+0000","last_change":"2024-04-25T10:14:17.396790+0000","last_active":"2024-04-25T10:14:19.400518+0000","last_peered":"2024-04-25T10:14:19.400518+0000","last_clean":"2024-04-25T10:14:19.400518+0000","last_became_active":"2024-04-25T10:14:17.395939+0000","last_became_peered":"2024-04-25T10:14:17.395939+0000","last_unstale":"2024-04-25T10:14:19.400518+0000","last_undegraded":"2024-04-25T10:14:19.400518+0000","last_fullsized":"2024-04-25T10:14:19.400518+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:22.732918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400005+0000","last_change":"2024-04-25T10:14:18.396192+0000","last_active":"2024-04-25T10:14:19.400005+0000","last_peered":"2024-04-25T10:14:19.400005+0000","last_clean":"2024-04-25T10:14:19.400005+0000","last_became_active":"2024-04-25T10:14:18.395898+0000","last_became_peered":"2024-04-25T10:14:18.395898+0000","last_unstale":"2024-04-25T10:14:19.400005+0000","last_undegraded":"2024-04-25T10:14:19.400005+0000","last_fullsized":"2024-04-25T10:14:19.400005+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:40.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405793+0000","last_change":"2024-04-25T10:14:17.406919+0000","last_active":"2024-04-25T10:14:19.405793+0000","last_peered":"2024-04-25T10:14:19.405793+0000","last_clean":"2024-04-25T10:14:19.405793+0000","last_became_active":"2024-04-25T10:14:17.406629+0000","last_became_peered":"2024-04-25T10:14:17.406629+0000","last_unstale":"2024-04-25T10:14:19.405793+0000","last_undegraded":"2024-04-25T10:14:19.405793+0000","last_fullsized":"2024-04-25T10:14:19.405793+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622915+0000","last_change":"2024-04-25T10:14:18.411505+0000","last_active":"2024-04-25T10:14:19.622915+0000","last_peered":"2024-04-25T10:14:19.622915+0000","last_clean":"2024-04-25T10:14:19.622915+0000","last_became_active":"2024-04-25T10:14:18.411200+0000","last_became_peered":"2024-04-25T10:14:18.411200+0000","last_unstale":"2024-04-25T10:14:19.622915+0000","last_undegraded":"2024-04-25T10:14:19.622915+0000","last_fullsized":"2024-04-25T10:14:19.622915+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:01.593222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405275+0000","last_change":"2024-04-25T10:14:17.395732+0000","last_active":"2024-04-25T10:14:19.405275+0000","last_peered":"2024-04-25T10:14:19.405275+0000","last_clean":"2024-04-25T10:14:19.405275+0000","last_became_active":"2024-04-25T10:14:17.394756+0000","last_became_peered":"2024-04-25T10:14:17.394756+0000","last_unstale":"2024-04-25T10:14:19.405275+0000","last_undegraded":"2024-04-25T10:14:19.405275+0000","last_fullsized":"2024-04-25T10:14:19.405275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625812+0000","last_change":"2024-04-25T10:14:18.414233+0000","last_active":"2024-04-25T10:14:19.625812+0000","last_peered":"2024-04-25T10:14:19.625812+0000","last_clean":"2024-04-25T10:14:19.625812+0000","last_became_active":"2024-04-25T10:14:18.413964+0000","last_became_peered":"2024-04-25T10:14:18.413964+0000","last_unstale":"2024-04-25T10:14:19.625812+0000","last_undegraded":"2024-04-25T10:14:19.625812+0000","last_fullsized":"2024-04-25T10:14:19.625812+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399874+0000","last_change":"2024-04-25T10:14:17.399818+0000","last_active":"2024-04-25T10:14:19.399874+0000","last_peered":"2024-04-25T10:14:19.399874+0000","last_clean":"2024-04-25T10:14:19.399874+0000","last_became_active":"2024-04-25T10:14:17.399306+0000","last_became_peered":"2024-04-25T10:14:17.399306+0000","last_unstale":"2024-04-25T10:14:19.399874+0000","last_undegraded":"2024-04-25T10:14:19.399874+0000","last_fullsized":"2024-04-25T10:14:19.399874+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:03.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622942+0000","last_change":"2024-04-25T10:14:18.418133+0000","last_active":"2024-04-25T10:14:19.622942+0000","last_peered":"2024-04-25T10:14:19.622942+0000","last_clean":"2024-04-25T10:14:19.622942+0000","last_became_active":"2024-04-25T10:14:18.417842+0000","last_became_peered":"2024-04-25T10:14:18.417842+0000","last_unstale":"2024-04-25T10:14:19.622942+0000","last_undegraded":"2024-04-25T10:14:19.622942+0000","last_fullsized":"2024-04-25T10:14:19.622942+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625577+0000","last_change":"2024-04-25T10:14:17.403888+0000","last_active":"2024-04-25T10:14:19.625577+0000","last_peered":"2024-04-25T10:14:19.625577+0000","last_clean":"2024-04-25T10:14:19.625577+0000","last_became_active":"2024-04-25T10:14:17.403571+0000","last_became_peered":"2024-04-25T10:14:17.403571+0000","last_unstale":"2024-04-25T10:14:19.625577+0000","last_undegraded":"2024-04-25T10:14:19.625577+0000","last_fullsized":"2024-04-25T10:14:19.625577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626764+0000","last_change":"2024-04-25T10:14:18.418142+0000","last_active":"2024-04-25T10:14:19.626764+0000","last_peered":"2024-04-25T10:14:19.626764+0000","last_clean":"2024-04-25T10:14:19.626764+0000","last_became_active":"2024-04-25T10:14:18.417870+0000","last_became_peered":"2024-04-25T10:14:18.417870+0000","last_unstale":"2024-04-25T10:14:19.626764+0000","last_undegraded":"2024-04-25T10:14:19.626764+0000","last_fullsized":"2024-04-25T10:14:19.626764+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:36.137237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"122'8","reported_seq":22,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622817+0000","last_change":"2024-04-25T10:14:17.403473+0000","last_active":"2024-04-25T10:14:19.622817+0000","last_peered":"2024-04-25T10:14:19.622817+0000","last_clean":"2024-04-25T10:14:19.622817+0000","last_became_active":"2024-04-25T10:14:17.403201+0000","last_became_peered":"2024-04-25T10:14:17.403201+0000","last_unstale":"2024-04-25T10:14:19.622817+0000","last_undegraded":"2024-04-25T10:14:19.622817+0000","last_fullsized":"2024-04-25T10:14:19.622817+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:26.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":361,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625818+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:14:19.625818+0000","last_peered":"2024-04-25T10:14:19.625818+0000","last_clean":"2024-04-25T10:14:19.625818+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:14:19.625818+0000","last_undegraded":"2024-04-25T10:14:19.625818+0000","last_fullsized":"2024-04-25T10:14:19.625818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2134016,"data_stored":1305025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509573,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":714463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":714041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1536000,"data_stored":715493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":715527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":713881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1527808,"data_stored":713903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33252,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2121728,"data_stored":1304271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:14:27.100 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:14:27.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.244+0000 7fdb16800640 1 Processor -- start 2024-04-25T10:14:27.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.244+0000 7fdb16800640 1 -- start start 2024-04-25T10:14:27.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb16800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 0x7fdb1015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb16800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb100cc4e0 con 0x7fdb100b1e60 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb16800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb100ce040 con 0x7fdb100cd4d0 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb16800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10145650 con 0x7fdb10145270 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdb100b1e60 0x7fdb1015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52390/0 (socket says 172.21.15.18:52390) 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0fe00640 1 -- 172.21.15.18:0/3644358786 learned_addr learned my addr 172.21.15.18:0/3644358786 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0f400640 1 --2- 172.21.15.18:0/3644358786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 0x7fdb1015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421074672 0 0) 0x7fdb100cc4e0 con 0x7fdb100b1e60 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf4003530 con 0x7fdb100b1e60 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476581433 0 0) 0x7fdb100ce040 con 0x7fdb100cd4d0 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb100cc4e0 con 0x7fdb100cd4d0 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0f400640 1 -- 172.21.15.18:0/3644358786 >> v1:172.21.15.167:6789/0 conn(0x7fdb100cd4d0 legacy=0x7fdb100b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0f400640 1 -- 172.21.15.18:0/3644358786 >> v1:172.21.15.18:6789/0 conn(0x7fdb100b1e60 legacy=0x7fdb1015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.248+0000 7fdb0f400640 1 -- 172.21.15.18:0/3644358786 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100ce320 con 0x7fdb10145270 2024-04-25T10:14:27.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb0f400640 1 --2- 172.21.15.18:0/3644358786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 0x7fdb1015fe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb000097f0 tx=0x7fdb0001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae0c33b08e16657 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000aa610 con 0x7fdb10145270 2024-04-25T10:14:27.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb000af070 con 0x7fdb10145270 2024-04-25T10:14:27.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb0ea00640 1 -- 172.21.15.18:0/3644358786 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb000aa9b0 con 0x7fdb10145270 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- 172.21.15.18:0/3644358786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 msgr2=0x7fdb1015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 --2- 172.21.15.18:0/3644358786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 0x7fdb1015fe50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb000097f0 tx=0x7fdb0001c4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- 172.21.15.18:0/3644358786 shutdown_connections 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 --2- 172.21.15.18:0/3644358786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb10145270 0x7fdb1015fe50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- 172.21.15.18:0/3644358786 >> 172.21.15.18:0/3644358786 conn(0x7fdb10066fa0 msgr2=0x7fdb1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- 172.21.15.18:0/3644358786 shutdown_connections 2024-04-25T10:14:27.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- 172.21.15.18:0/3644358786 wait complete. 2024-04-25T10:14:27.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 Processor -- start 2024-04-25T10:14:27.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.252+0000 7fdb16800640 1 -- start start 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb100b1e60 0x7fdb100afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb100cd4d0 0x7fdb100accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb10169720 con 0x7fdb10145270 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb100cdcc0 con 0x7fdb100b1e60 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb101698a0 con 0x7fdb100cd4d0 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52146/0 (socket says 172.21.15.18:52146) 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 -- 172.21.15.18:0/490301515 learned_addr learned my addr 172.21.15.18:0/490301515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0f400640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb100b1e60 0x7fdb100afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb06a00640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb100cd4d0 0x7fdb100accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 -- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb100cd4d0 msgr2=0x7fdb100accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb100cd4d0 0x7fdb100accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 -- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb100b1e60 msgr2=0x7fdb100afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb100b1e60 0x7fdb100afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 -- 172.21.15.18:0/490301515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100cef10 con 0x7fdb10145270 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb0fe00640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c450 tx=0x7fdb0800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08017070 con 0x7fdb10145270 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb08005cf0 con 0x7fdb10145270 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb100ad3b0 con 0x7fdb10145270 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb08007270 con 0x7fdb10145270 2024-04-25T10:14:27.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb100ad970 con 0x7fdb10145270 2024-04-25T10:14:27.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.256+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb100745d0 con 0x7fdb10145270 2024-04-25T10:14:27.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.260+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb0801a070 con 0x7fdb10145270 2024-04-25T10:14:27.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.260+0000 7fdb07e00640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 0x7fdaec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.260+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdb08084470 con 0x7fdb10145270 2024-04-25T10:14:27.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.260+0000 7fdb0f400640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 0x7fdaec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.260+0000 7fdb0f400640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 0x7fdaec069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ae000 tx=0x7fdb000b5040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.264+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb08054c10 con 0x7fdb10145270 2024-04-25T10:14:27.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.424+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb1006d6a0 con 0x7fdaec066f60 2024-04-25T10:14:27.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.428+0000 7fdb07e00640 1 -- 172.21.15.18:0/490301515 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252488 (secure 0 0 0) 0x7fdb1006d6a0 con 0x7fdaec066f60 2024-04-25T10:14:27.439 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:27.441 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 msgr2=0x7fdaec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 0x7fdaec069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fdb000ae000 tx=0x7fdb000b5040 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 msgr2=0x7fdb1015ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800c450 tx=0x7fdb0800c910 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 shutdown_connections 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb10145270 0x7fdb1015ab80 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fdaec066f60 0x7fdaec069420 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fdb100cd4d0 0x7fdb100accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 --2- 172.21.15.18:0/490301515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb100b1e60 0x7fdb100afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 >> 172.21.15.18:0/490301515 conn(0x7fdb10066fa0 msgr2=0x7fdb1006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:27.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 shutdown_connections 2024-04-25T10:14:27.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.432+0000 7fdb16800640 1 -- 172.21.15.18:0/490301515 wait complete. 2024-04-25T10:14:27.460 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2024-04-25T10:14:25.560324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":177,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262584,"kb_used_data":13128,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712136,"statfs":{"total":773094113280,"available":772825227264,"internally_reserved":0,"allocated":13443072,"data_stored":6896604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002084"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405704+0000","last_change":"2024-04-25T10:14:18.414993+0000","last_active":"2024-04-25T10:14:19.405704+0000","last_peered":"2024-04-25T10:14:19.405704+0000","last_clean":"2024-04-25T10:14:19.405704+0000","last_became_active":"2024-04-25T10:14:18.414696+0000","last_became_peered":"2024-04-25T10:14:18.414696+0000","last_unstale":"2024-04-25T10:14:19.405704+0000","last_undegraded":"2024-04-25T10:14:19.405704+0000","last_fullsized":"2024-04-25T10:14:19.405704+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623647+0000","last_change":"2024-04-25T10:14:18.409415+0000","last_active":"2024-04-25T10:14:19.623647+0000","last_peered":"2024-04-25T10:14:19.623647+0000","last_clean":"2024-04-25T10:14:19.623647+0000","last_became_active":"2024-04-25T10:14:18.408795+0000","last_became_peered":"2024-04-25T10:14:18.408795+0000","last_unstale":"2024-04-25T10:14:19.623647+0000","last_undegraded":"2024-04-25T10:14:19.623647+0000","last_fullsized":"2024-04-25T10:14:19.623647+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:34:20.756464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623677+0000","last_change":"2024-04-25T10:14:18.409397+0000","last_active":"2024-04-25T10:14:19.623677+0000","last_peered":"2024-04-25T10:14:19.623677+0000","last_clean":"2024-04-25T10:14:19.623677+0000","last_became_active":"2024-04-25T10:14:18.409071+0000","last_became_peered":"2024-04-25T10:14:18.409071+0000","last_unstale":"2024-04-25T10:14:19.623677+0000","last_undegraded":"2024-04-25T10:14:19.623677+0000","last_fullsized":"2024-04-25T10:14:19.623677+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:35.951429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626383+0000","last_change":"2024-04-25T10:14:18.418850+0000","last_active":"2024-04-25T10:14:19.626383+0000","last_peered":"2024-04-25T10:14:19.626383+0000","last_clean":"2024-04-25T10:14:19.626383+0000","last_became_active":"2024-04-25T10:14:18.418585+0000","last_became_peered":"2024-04-25T10:14:18.418585+0000","last_unstale":"2024-04-25T10:14:19.626383+0000","last_undegraded":"2024-04-25T10:14:19.626383+0000","last_fullsized":"2024-04-25T10:14:19.626383+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:22.873322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405679+0000","last_change":"2024-04-25T10:14:18.411455+0000","last_active":"2024-04-25T10:14:19.405679+0000","last_peered":"2024-04-25T10:14:19.405679+0000","last_clean":"2024-04-25T10:14:19.405679+0000","last_became_active":"2024-04-25T10:14:18.411173+0000","last_became_peered":"2024-04-25T10:14:18.411173+0000","last_unstale":"2024-04-25T10:14:19.405679+0000","last_undegraded":"2024-04-25T10:14:19.405679+0000","last_fullsized":"2024-04-25T10:14:19.405679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400055+0000","last_change":"2024-04-25T10:14:18.404049+0000","last_active":"2024-04-25T10:14:19.400055+0000","last_peered":"2024-04-25T10:14:19.400055+0000","last_clean":"2024-04-25T10:14:19.400055+0000","last_became_active":"2024-04-25T10:14:18.401992+0000","last_became_peered":"2024-04-25T10:14:18.401992+0000","last_unstale":"2024-04-25T10:14:19.400055+0000","last_undegraded":"2024-04-25T10:14:19.400055+0000","last_fullsized":"2024-04-25T10:14:19.400055+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:31.097247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399878+0000","last_change":"2024-04-25T10:14:18.406945+0000","last_active":"2024-04-25T10:14:19.399878+0000","last_peered":"2024-04-25T10:14:19.399878+0000","last_clean":"2024-04-25T10:14:19.399878+0000","last_became_active":"2024-04-25T10:14:18.406179+0000","last_became_peered":"2024-04-25T10:14:18.406179+0000","last_unstale":"2024-04-25T10:14:19.399878+0000","last_undegraded":"2024-04-25T10:14:19.399878+0000","last_fullsized":"2024-04-25T10:14:19.399878+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:02.530682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622723+0000","last_change":"2024-04-25T10:14:18.411759+0000","last_active":"2024-04-25T10:14:19.622723+0000","last_peered":"2024-04-25T10:14:19.622723+0000","last_clean":"2024-04-25T10:14:19.622723+0000","last_became_active":"2024-04-25T10:14:18.411380+0000","last_became_peered":"2024-04-25T10:14:18.411380+0000","last_unstale":"2024-04-25T10:14:19.622723+0000","last_undegraded":"2024-04-25T10:14:19.622723+0000","last_fullsized":"2024-04-25T10:14:19.622723+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:09.512832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626923+0000","last_change":"2024-04-25T10:14:18.415521+0000","last_active":"2024-04-25T10:14:19.626923+0000","last_peered":"2024-04-25T10:14:19.626923+0000","last_clean":"2024-04-25T10:14:19.626923+0000","last_became_active":"2024-04-25T10:14:18.415134+0000","last_became_peered":"2024-04-25T10:14:18.415134+0000","last_unstale":"2024-04-25T10:14:19.626923+0000","last_undegraded":"2024-04-25T10:14:19.626923+0000","last_fullsized":"2024-04-25T10:14:19.626923+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:31:06.340924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623064+0000","last_change":"2024-04-25T10:14:18.409598+0000","last_active":"2024-04-25T10:14:19.623064+0000","last_peered":"2024-04-25T10:14:19.623064+0000","last_clean":"2024-04-25T10:14:19.623064+0000","last_became_active":"2024-04-25T10:14:18.409240+0000","last_became_peered":"2024-04-25T10:14:18.409240+0000","last_unstale":"2024-04-25T10:14:19.623064+0000","last_undegraded":"2024-04-25T10:14:19.623064+0000","last_fullsized":"2024-04-25T10:14:19.623064+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405782+0000","last_change":"2024-04-25T10:14:18.409006+0000","last_active":"2024-04-25T10:14:19.405782+0000","last_peered":"2024-04-25T10:14:19.405782+0000","last_clean":"2024-04-25T10:14:19.405782+0000","last_became_active":"2024-04-25T10:14:18.408742+0000","last_became_peered":"2024-04-25T10:14:18.408742+0000","last_unstale":"2024-04-25T10:14:19.405782+0000","last_undegraded":"2024-04-25T10:14:19.405782+0000","last_fullsized":"2024-04-25T10:14:19.405782+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400380+0000","last_change":"2024-04-25T10:14:18.394000+0000","last_active":"2024-04-25T10:14:19.400380+0000","last_peered":"2024-04-25T10:14:19.400380+0000","last_clean":"2024-04-25T10:14:19.400380+0000","last_became_active":"2024-04-25T10:14:18.393685+0000","last_became_peered":"2024-04-25T10:14:18.393685+0000","last_unstale":"2024-04-25T10:14:19.400380+0000","last_undegraded":"2024-04-25T10:14:19.400380+0000","last_fullsized":"2024-04-25T10:14:19.400380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:43:47.095740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622781+0000","last_change":"2024-04-25T10:14:18.414756+0000","last_active":"2024-04-25T10:14:19.622781+0000","last_peered":"2024-04-25T10:14:19.622781+0000","last_clean":"2024-04-25T10:14:19.622781+0000","last_became_active":"2024-04-25T10:14:18.414396+0000","last_became_peered":"2024-04-25T10:14:18.414396+0000","last_unstale":"2024-04-25T10:14:19.622781+0000","last_undegraded":"2024-04-25T10:14:19.622781+0000","last_fullsized":"2024-04-25T10:14:19.622781+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623328+0000","last_change":"2024-04-25T10:14:18.413737+0000","last_active":"2024-04-25T10:14:19.623328+0000","last_peered":"2024-04-25T10:14:19.623328+0000","last_clean":"2024-04-25T10:14:19.623328+0000","last_became_active":"2024-04-25T10:14:18.412598+0000","last_became_peered":"2024-04-25T10:14:18.412598+0000","last_unstale":"2024-04-25T10:14:19.623328+0000","last_undegraded":"2024-04-25T10:14:19.623328+0000","last_fullsized":"2024-04-25T10:14:19.623328+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:16.882224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404835+0000","last_change":"2024-04-25T10:14:18.410328+0000","last_active":"2024-04-25T10:14:19.404835+0000","last_peered":"2024-04-25T10:14:19.404835+0000","last_clean":"2024-04-25T10:14:19.404835+0000","last_became_active":"2024-04-25T10:14:18.407249+0000","last_became_peered":"2024-04-25T10:14:18.407249+0000","last_unstale":"2024-04-25T10:14:19.404835+0000","last_undegraded":"2024-04-25T10:14:19.404835+0000","last_fullsized":"2024-04-25T10:14:19.404835+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399804+0000","last_change":"2024-04-25T10:14:18.401722+0000","last_active":"2024-04-25T10:14:19.399804+0000","last_peered":"2024-04-25T10:14:19.399804+0000","last_clean":"2024-04-25T10:14:19.399804+0000","last_became_active":"2024-04-25T10:14:18.399127+0000","last_became_peered":"2024-04-25T10:14:18.399127+0000","last_unstale":"2024-04-25T10:14:19.399804+0000","last_undegraded":"2024-04-25T10:14:19.399804+0000","last_fullsized":"2024-04-25T10:14:19.399804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:01:26.892094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623153+0000","last_change":"2024-04-25T10:14:18.416785+0000","last_active":"2024-04-25T10:14:19.623153+0000","last_peered":"2024-04-25T10:14:19.623153+0000","last_clean":"2024-04-25T10:14:19.623153+0000","last_became_active":"2024-04-25T10:14:18.416519+0000","last_became_peered":"2024-04-25T10:14:18.416519+0000","last_unstale":"2024-04-25T10:14:19.623153+0000","last_undegraded":"2024-04-25T10:14:19.623153+0000","last_fullsized":"2024-04-25T10:14:19.623153+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623803+0000","last_change":"2024-04-25T10:14:18.397519+0000","last_active":"2024-04-25T10:14:19.623803+0000","last_peered":"2024-04-25T10:14:19.623803+0000","last_clean":"2024-04-25T10:14:19.623803+0000","last_became_active":"2024-04-25T10:14:18.397161+0000","last_became_peered":"2024-04-25T10:14:18.397161+0000","last_unstale":"2024-04-25T10:14:19.623803+0000","last_undegraded":"2024-04-25T10:14:19.623803+0000","last_fullsized":"2024-04-25T10:14:19.623803+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:44.100313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404778+0000","last_change":"2024-04-25T10:14:18.417427+0000","last_active":"2024-04-25T10:14:19.404778+0000","last_peered":"2024-04-25T10:14:19.404778+0000","last_clean":"2024-04-25T10:14:19.404778+0000","last_became_active":"2024-04-25T10:14:18.417148+0000","last_became_peered":"2024-04-25T10:14:18.417148+0000","last_unstale":"2024-04-25T10:14:19.404778+0000","last_undegraded":"2024-04-25T10:14:19.404778+0000","last_fullsized":"2024-04-25T10:14:19.404778+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510643+0000","last_change":"2024-04-25T10:14:18.402667+0000","last_active":"2024-04-25T10:14:19.510643+0000","last_peered":"2024-04-25T10:14:19.510643+0000","last_clean":"2024-04-25T10:14:19.510643+0000","last_became_active":"2024-04-25T10:14:18.402309+0000","last_became_peered":"2024-04-25T10:14:18.402309+0000","last_unstale":"2024-04-25T10:14:19.510643+0000","last_undegraded":"2024-04-25T10:14:19.510643+0000","last_fullsized":"2024-04-25T10:14:19.510643+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:55.308915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626252+0000","last_change":"2024-04-25T10:14:18.418284+0000","last_active":"2024-04-25T10:14:19.626252+0000","last_peered":"2024-04-25T10:14:19.626252+0000","last_clean":"2024-04-25T10:14:19.626252+0000","last_became_active":"2024-04-25T10:14:18.418020+0000","last_became_peered":"2024-04-25T10:14:18.418020+0000","last_unstale":"2024-04-25T10:14:19.626252+0000","last_undegraded":"2024-04-25T10:14:19.626252+0000","last_fullsized":"2024-04-25T10:14:19.626252+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:29.883460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405177+0000","last_change":"2024-04-25T10:14:18.403230+0000","last_active":"2024-04-25T10:14:19.405177+0000","last_peered":"2024-04-25T10:14:19.405177+0000","last_clean":"2024-04-25T10:14:19.405177+0000","last_became_active":"2024-04-25T10:14:18.402772+0000","last_became_peered":"2024-04-25T10:14:18.402772+0000","last_unstale":"2024-04-25T10:14:19.405177+0000","last_undegraded":"2024-04-25T10:14:19.405177+0000","last_fullsized":"2024-04-25T10:14:19.405177+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626278+0000","last_change":"2024-04-25T10:14:18.416108+0000","last_active":"2024-04-25T10:14:19.626278+0000","last_peered":"2024-04-25T10:14:19.626278+0000","last_clean":"2024-04-25T10:14:19.626278+0000","last_became_active":"2024-04-25T10:14:18.415615+0000","last_became_peered":"2024-04-25T10:14:18.415615+0000","last_unstale":"2024-04-25T10:14:19.626278+0000","last_undegraded":"2024-04-25T10:14:19.626278+0000","last_fullsized":"2024-04-25T10:14:19.626278+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:38.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625661+0000","last_change":"2024-04-25T10:14:18.420104+0000","last_active":"2024-04-25T10:14:19.625661+0000","last_peered":"2024-04-25T10:14:19.625661+0000","last_clean":"2024-04-25T10:14:19.625661+0000","last_became_active":"2024-04-25T10:14:18.419237+0000","last_became_peered":"2024-04-25T10:14:18.419237+0000","last_unstale":"2024-04-25T10:14:19.625661+0000","last_undegraded":"2024-04-25T10:14:19.625661+0000","last_fullsized":"2024-04-25T10:14:19.625661+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627282+0000","last_change":"2024-04-25T10:14:18.414943+0000","last_active":"2024-04-25T10:14:19.627282+0000","last_peered":"2024-04-25T10:14:19.627282+0000","last_clean":"2024-04-25T10:14:19.627282+0000","last_became_active":"2024-04-25T10:14:18.414618+0000","last_became_peered":"2024-04-25T10:14:18.414618+0000","last_unstale":"2024-04-25T10:14:19.627282+0000","last_undegraded":"2024-04-25T10:14:19.627282+0000","last_fullsized":"2024-04-25T10:14:19.627282+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:21:22.873322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510755+0000","last_change":"2024-04-25T10:14:18.410596+0000","last_active":"2024-04-25T10:14:19.510755+0000","last_peered":"2024-04-25T10:14:19.510755+0000","last_clean":"2024-04-25T10:14:19.510755+0000","last_became_active":"2024-04-25T10:14:18.410207+0000","last_became_peered":"2024-04-25T10:14:18.410207+0000","last_unstale":"2024-04-25T10:14:19.510755+0000","last_undegraded":"2024-04-25T10:14:19.510755+0000","last_fullsized":"2024-04-25T10:14:19.510755+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:56.353852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404933+0000","last_change":"2024-04-25T10:14:18.401213+0000","last_active":"2024-04-25T10:14:19.404933+0000","last_peered":"2024-04-25T10:14:19.404933+0000","last_clean":"2024-04-25T10:14:19.404933+0000","last_became_active":"2024-04-25T10:14:18.400840+0000","last_became_peered":"2024-04-25T10:14:18.400840+0000","last_unstale":"2024-04-25T10:14:19.404933+0000","last_undegraded":"2024-04-25T10:14:19.404933+0000","last_fullsized":"2024-04-25T10:14:19.404933+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400400+0000","last_change":"2024-04-25T10:14:18.405336+0000","last_active":"2024-04-25T10:14:19.400400+0000","last_peered":"2024-04-25T10:14:19.400400+0000","last_clean":"2024-04-25T10:14:19.400400+0000","last_became_active":"2024-04-25T10:14:18.404453+0000","last_became_peered":"2024-04-25T10:14:18.404453+0000","last_unstale":"2024-04-25T10:14:19.400400+0000","last_undegraded":"2024-04-25T10:14:19.400400+0000","last_fullsized":"2024-04-25T10:14:19.400400+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:55.063508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510667+0000","last_change":"2024-04-25T10:14:18.397773+0000","last_active":"2024-04-25T10:14:19.510667+0000","last_peered":"2024-04-25T10:14:19.510667+0000","last_clean":"2024-04-25T10:14:19.510667+0000","last_became_active":"2024-04-25T10:14:18.395826+0000","last_became_peered":"2024-04-25T10:14:18.395826+0000","last_unstale":"2024-04-25T10:14:19.510667+0000","last_undegraded":"2024-04-25T10:14:19.510667+0000","last_fullsized":"2024-04-25T10:14:19.510667+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:47.551105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623336+0000","last_change":"2024-04-25T10:14:18.397495+0000","last_active":"2024-04-25T10:14:19.623336+0000","last_peered":"2024-04-25T10:14:19.623336+0000","last_clean":"2024-04-25T10:14:19.623336+0000","last_became_active":"2024-04-25T10:14:18.397045+0000","last_became_peered":"2024-04-25T10:14:18.397045+0000","last_unstale":"2024-04-25T10:14:19.623336+0000","last_undegraded":"2024-04-25T10:14:19.623336+0000","last_fullsized":"2024-04-25T10:14:19.623336+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:27:24.575507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626500+0000","last_change":"2024-04-25T10:14:18.405962+0000","last_active":"2024-04-25T10:14:19.626500+0000","last_peered":"2024-04-25T10:14:19.626500+0000","last_clean":"2024-04-25T10:14:19.626500+0000","last_became_active":"2024-04-25T10:14:18.405487+0000","last_became_peered":"2024-04-25T10:14:18.405487+0000","last_unstale":"2024-04-25T10:14:19.626500+0000","last_undegraded":"2024-04-25T10:14:19.626500+0000","last_fullsized":"2024-04-25T10:14:19.626500+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:11:14.662738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625668+0000","last_change":"2024-04-25T10:14:18.417527+0000","last_active":"2024-04-25T10:14:19.625668+0000","last_peered":"2024-04-25T10:14:19.625668+0000","last_clean":"2024-04-25T10:14:19.625668+0000","last_became_active":"2024-04-25T10:14:18.417210+0000","last_became_peered":"2024-04-25T10:14:18.417210+0000","last_unstale":"2024-04-25T10:14:19.625668+0000","last_undegraded":"2024-04-25T10:14:19.625668+0000","last_fullsized":"2024-04-25T10:14:19.625668+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622943+0000","last_change":"2024-04-25T10:14:18.410644+0000","last_active":"2024-04-25T10:14:19.622943+0000","last_peered":"2024-04-25T10:14:19.622943+0000","last_clean":"2024-04-25T10:14:19.622943+0000","last_became_active":"2024-04-25T10:14:18.409977+0000","last_became_peered":"2024-04-25T10:14:18.409977+0000","last_unstale":"2024-04-25T10:14:19.622943+0000","last_undegraded":"2024-04-25T10:14:19.622943+0000","last_fullsized":"2024-04-25T10:14:19.622943+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"122'4","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405237+0000","last_change":"2024-04-25T10:14:17.405872+0000","last_active":"2024-04-25T10:14:19.405237+0000","last_peered":"2024-04-25T10:14:19.405237+0000","last_clean":"2024-04-25T10:14:19.405237+0000","last_became_active":"2024-04-25T10:14:17.405528+0000","last_became_peered":"2024-04-25T10:14:17.405528+0000","last_unstale":"2024-04-25T10:14:19.405237+0000","last_undegraded":"2024-04-25T10:14:19.405237+0000","last_fullsized":"2024-04-25T10:14:19.405237+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400335+0000","last_change":"2024-04-25T10:14:18.396951+0000","last_active":"2024-04-25T10:14:19.400335+0000","last_peered":"2024-04-25T10:14:19.400335+0000","last_clean":"2024-04-25T10:14:19.400335+0000","last_became_active":"2024-04-25T10:14:18.396708+0000","last_became_peered":"2024-04-25T10:14:18.396708+0000","last_unstale":"2024-04-25T10:14:19.400335+0000","last_undegraded":"2024-04-25T10:14:19.400335+0000","last_fullsized":"2024-04-25T10:14:19.400335+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:02:04.531917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623148+0000","last_change":"2024-04-25T10:14:17.403862+0000","last_active":"2024-04-25T10:14:19.623148+0000","last_peered":"2024-04-25T10:14:19.623148+0000","last_clean":"2024-04-25T10:14:19.623148+0000","last_became_active":"2024-04-25T10:14:17.403579+0000","last_became_peered":"2024-04-25T10:14:17.403579+0000","last_unstale":"2024-04-25T10:14:19.623148+0000","last_undegraded":"2024-04-25T10:14:19.623148+0000","last_fullsized":"2024-04-25T10:14:19.623148+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:37.737153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626939+0000","last_change":"2024-04-25T10:14:18.409758+0000","last_active":"2024-04-25T10:14:19.626939+0000","last_peered":"2024-04-25T10:14:19.626939+0000","last_clean":"2024-04-25T10:14:19.626939+0000","last_became_active":"2024-04-25T10:14:18.408543+0000","last_became_peered":"2024-04-25T10:14:18.408543+0000","last_unstale":"2024-04-25T10:14:19.626939+0000","last_undegraded":"2024-04-25T10:14:19.626939+0000","last_fullsized":"2024-04-25T10:14:19.626939+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:29.883460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626068+0000","last_change":"2024-04-25T10:14:17.407577+0000","last_active":"2024-04-25T10:14:19.626068+0000","last_peered":"2024-04-25T10:14:19.626068+0000","last_clean":"2024-04-25T10:14:19.626068+0000","last_became_active":"2024-04-25T10:14:17.407208+0000","last_became_peered":"2024-04-25T10:14:17.407208+0000","last_unstale":"2024-04-25T10:14:19.626068+0000","last_undegraded":"2024-04-25T10:14:19.626068+0000","last_fullsized":"2024-04-25T10:14:19.626068+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:56.204795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627024+0000","last_change":"2024-04-25T10:14:18.418508+0000","last_active":"2024-04-25T10:14:19.627024+0000","last_peered":"2024-04-25T10:14:19.627024+0000","last_clean":"2024-04-25T10:14:19.627024+0000","last_became_active":"2024-04-25T10:14:18.418110+0000","last_became_peered":"2024-04-25T10:14:18.418110+0000","last_unstale":"2024-04-25T10:14:19.627024+0000","last_undegraded":"2024-04-25T10:14:19.627024+0000","last_fullsized":"2024-04-25T10:14:19.627024+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:27.873645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623225+0000","last_change":"2024-04-25T10:14:17.395546+0000","last_active":"2024-04-25T10:14:19.623225+0000","last_peered":"2024-04-25T10:14:19.623225+0000","last_clean":"2024-04-25T10:14:19.623225+0000","last_became_active":"2024-04-25T10:14:17.395257+0000","last_became_peered":"2024-04-25T10:14:17.395257+0000","last_unstale":"2024-04-25T10:14:19.623225+0000","last_undegraded":"2024-04-25T10:14:19.623225+0000","last_fullsized":"2024-04-25T10:14:19.623225+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:42:40.424713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622587+0000","last_change":"2024-04-25T10:14:18.406536+0000","last_active":"2024-04-25T10:14:19.622587+0000","last_peered":"2024-04-25T10:14:19.622587+0000","last_clean":"2024-04-25T10:14:19.622587+0000","last_became_active":"2024-04-25T10:14:18.405916+0000","last_became_peered":"2024-04-25T10:14:18.405916+0000","last_unstale":"2024-04-25T10:14:19.622587+0000","last_undegraded":"2024-04-25T10:14:19.622587+0000","last_fullsized":"2024-04-25T10:14:19.622587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:46.527543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405665+0000","last_change":"2024-04-25T10:14:17.398736+0000","last_active":"2024-04-25T10:14:19.405665+0000","last_peered":"2024-04-25T10:14:19.405665+0000","last_clean":"2024-04-25T10:14:19.405665+0000","last_became_active":"2024-04-25T10:14:17.398429+0000","last_became_peered":"2024-04-25T10:14:17.398429+0000","last_unstale":"2024-04-25T10:14:19.405665+0000","last_undegraded":"2024-04-25T10:14:19.405665+0000","last_fullsized":"2024-04-25T10:14:19.405665+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404914+0000","last_change":"2024-04-25T10:14:18.412191+0000","last_active":"2024-04-25T10:14:19.404914+0000","last_peered":"2024-04-25T10:14:19.404914+0000","last_clean":"2024-04-25T10:14:19.404914+0000","last_became_active":"2024-04-25T10:14:18.410302+0000","last_became_peered":"2024-04-25T10:14:18.410302+0000","last_unstale":"2024-04-25T10:14:19.404914+0000","last_undegraded":"2024-04-25T10:14:19.404914+0000","last_fullsized":"2024-04-25T10:14:19.404914+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:33.275865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400099+0000","last_change":"2024-04-25T10:14:17.401879+0000","last_active":"2024-04-25T10:14:19.400099+0000","last_peered":"2024-04-25T10:14:19.400099+0000","last_clean":"2024-04-25T10:14:19.400099+0000","last_became_active":"2024-04-25T10:14:17.401618+0000","last_became_peered":"2024-04-25T10:14:17.401618+0000","last_unstale":"2024-04-25T10:14:19.400099+0000","last_undegraded":"2024-04-25T10:14:19.400099+0000","last_fullsized":"2024-04-25T10:14:19.400099+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:17:43.083648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623588+0000","last_change":"2024-04-25T10:14:18.399652+0000","last_active":"2024-04-25T10:14:19.623588+0000","last_peered":"2024-04-25T10:14:19.623588+0000","last_clean":"2024-04-25T10:14:19.623588+0000","last_became_active":"2024-04-25T10:14:18.399368+0000","last_became_peered":"2024-04-25T10:14:18.399368+0000","last_unstale":"2024-04-25T10:14:19.623588+0000","last_undegraded":"2024-04-25T10:14:19.623588+0000","last_fullsized":"2024-04-25T10:14:19.623588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:00.217363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626504+0000","last_change":"2024-04-25T10:14:17.397943+0000","last_active":"2024-04-25T10:14:19.626504+0000","last_peered":"2024-04-25T10:14:19.626504+0000","last_clean":"2024-04-25T10:14:19.626504+0000","last_became_active":"2024-04-25T10:14:17.397629+0000","last_became_peered":"2024-04-25T10:14:17.397629+0000","last_unstale":"2024-04-25T10:14:19.626504+0000","last_undegraded":"2024-04-25T10:14:19.626504+0000","last_fullsized":"2024-04-25T10:14:19.626504+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622861+0000","last_change":"2024-04-25T10:14:18.419554+0000","last_active":"2024-04-25T10:14:19.622861+0000","last_peered":"2024-04-25T10:14:19.622861+0000","last_clean":"2024-04-25T10:14:19.622861+0000","last_became_active":"2024-04-25T10:14:18.419259+0000","last_became_peered":"2024-04-25T10:14:18.419259+0000","last_unstale":"2024-04-25T10:14:19.622861+0000","last_undegraded":"2024-04-25T10:14:19.622861+0000","last_fullsized":"2024-04-25T10:14:19.622861+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399985+0000","last_change":"2024-04-25T10:14:17.400512+0000","last_active":"2024-04-25T10:14:19.399985+0000","last_peered":"2024-04-25T10:14:19.399985+0000","last_clean":"2024-04-25T10:14:19.399985+0000","last_became_active":"2024-04-25T10:14:17.400048+0000","last_became_peered":"2024-04-25T10:14:17.400048+0000","last_unstale":"2024-04-25T10:14:19.399985+0000","last_undegraded":"2024-04-25T10:14:19.399985+0000","last_fullsized":"2024-04-25T10:14:19.399985+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:48.475881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404512+0000","last_change":"2024-04-25T10:14:18.422603+0000","last_active":"2024-04-25T10:14:19.404512+0000","last_peered":"2024-04-25T10:14:19.404512+0000","last_clean":"2024-04-25T10:14:19.404512+0000","last_became_active":"2024-04-25T10:14:18.422007+0000","last_became_peered":"2024-04-25T10:14:18.422007+0000","last_unstale":"2024-04-25T10:14:19.404512+0000","last_undegraded":"2024-04-25T10:14:19.404512+0000","last_fullsized":"2024-04-25T10:14:19.404512+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:12:49.387109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405349+0000","last_change":"2024-04-25T10:14:17.403152+0000","last_active":"2024-04-25T10:14:19.405349+0000","last_peered":"2024-04-25T10:14:19.405349+0000","last_clean":"2024-04-25T10:14:19.405349+0000","last_became_active":"2024-04-25T10:14:17.401700+0000","last_became_peered":"2024-04-25T10:14:17.401700+0000","last_unstale":"2024-04-25T10:14:19.405349+0000","last_undegraded":"2024-04-25T10:14:19.405349+0000","last_fullsized":"2024-04-25T10:14:19.405349+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:00:56.366420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626964+0000","last_change":"2024-04-25T10:14:18.408517+0000","last_active":"2024-04-25T10:14:19.626964+0000","last_peered":"2024-04-25T10:14:19.626964+0000","last_clean":"2024-04-25T10:14:19.626964+0000","last_became_active":"2024-04-25T10:14:18.408242+0000","last_became_peered":"2024-04-25T10:14:18.408242+0000","last_unstale":"2024-04-25T10:14:19.626964+0000","last_undegraded":"2024-04-25T10:14:19.626964+0000","last_fullsized":"2024-04-25T10:14:19.626964+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:38.834021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627112+0000","last_change":"2024-04-25T10:14:17.406735+0000","last_active":"2024-04-25T10:14:19.627112+0000","last_peered":"2024-04-25T10:14:19.627112+0000","last_clean":"2024-04-25T10:14:19.627112+0000","last_became_active":"2024-04-25T10:14:17.406473+0000","last_became_peered":"2024-04-25T10:14:17.406473+0000","last_unstale":"2024-04-25T10:14:19.627112+0000","last_undegraded":"2024-04-25T10:14:19.627112+0000","last_fullsized":"2024-04-25T10:14:19.627112+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623890+0000","last_change":"2024-04-25T10:14:18.413506+0000","last_active":"2024-04-25T10:14:19.623890+0000","last_peered":"2024-04-25T10:14:19.623890+0000","last_clean":"2024-04-25T10:14:19.623890+0000","last_became_active":"2024-04-25T10:14:18.411364+0000","last_became_peered":"2024-04-25T10:14:18.411364+0000","last_unstale":"2024-04-25T10:14:19.623890+0000","last_undegraded":"2024-04-25T10:14:19.623890+0000","last_fullsized":"2024-04-25T10:14:19.623890+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:26:26.496771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"122'3","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627064+0000","last_change":"2024-04-25T10:14:17.404230+0000","last_active":"2024-04-25T10:14:19.627064+0000","last_peered":"2024-04-25T10:14:19.627064+0000","last_clean":"2024-04-25T10:14:19.627064+0000","last_became_active":"2024-04-25T10:14:17.403964+0000","last_became_peered":"2024-04-25T10:14:17.403964+0000","last_unstale":"2024-04-25T10:14:19.627064+0000","last_undegraded":"2024-04-25T10:14:19.627064+0000","last_fullsized":"2024-04-25T10:14:19.627064+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627331+0000","last_change":"2024-04-25T10:14:18.412011+0000","last_active":"2024-04-25T10:14:19.627331+0000","last_peered":"2024-04-25T10:14:19.627331+0000","last_clean":"2024-04-25T10:14:19.627331+0000","last_became_active":"2024-04-25T10:14:18.411540+0000","last_became_peered":"2024-04-25T10:14:18.411540+0000","last_unstale":"2024-04-25T10:14:19.627331+0000","last_undegraded":"2024-04-25T10:14:19.627331+0000","last_fullsized":"2024-04-25T10:14:19.627331+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:18.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"122'6","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623419+0000","last_change":"2024-04-25T10:14:17.401245+0000","last_active":"2024-04-25T10:14:19.623419+0000","last_peered":"2024-04-25T10:14:19.623419+0000","last_clean":"2024-04-25T10:14:19.623419+0000","last_became_active":"2024-04-25T10:14:17.400983+0000","last_became_peered":"2024-04-25T10:14:17.400983+0000","last_unstale":"2024-04-25T10:14:19.623419+0000","last_undegraded":"2024-04-25T10:14:19.623419+0000","last_fullsized":"2024-04-25T10:14:19.623419+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:17:54.371340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.404602+0000","last_change":"2024-04-25T10:14:18.397572+0000","last_active":"2024-04-25T10:14:19.404602+0000","last_peered":"2024-04-25T10:14:19.404602+0000","last_clean":"2024-04-25T10:14:19.404602+0000","last_became_active":"2024-04-25T10:14:18.397253+0000","last_became_peered":"2024-04-25T10:14:18.397253+0000","last_unstale":"2024-04-25T10:14:19.404602+0000","last_undegraded":"2024-04-25T10:14:19.404602+0000","last_fullsized":"2024-04-25T10:14:19.404602+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623517+0000","last_change":"2024-04-25T10:14:17.406496+0000","last_active":"2024-04-25T10:14:19.623517+0000","last_peered":"2024-04-25T10:14:19.623517+0000","last_clean":"2024-04-25T10:14:19.623517+0000","last_became_active":"2024-04-25T10:14:17.404083+0000","last_became_peered":"2024-04-25T10:14:17.404083+0000","last_unstale":"2024-04-25T10:14:19.623517+0000","last_undegraded":"2024-04-25T10:14:19.623517+0000","last_fullsized":"2024-04-25T10:14:19.623517+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:34.465728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622587+0000","last_change":"2024-04-25T10:14:18.417029+0000","last_active":"2024-04-25T10:14:19.622587+0000","last_peered":"2024-04-25T10:14:19.622587+0000","last_clean":"2024-04-25T10:14:19.622587+0000","last_became_active":"2024-04-25T10:14:18.416421+0000","last_became_peered":"2024-04-25T10:14:18.416421+0000","last_unstale":"2024-04-25T10:14:19.622587+0000","last_undegraded":"2024-04-25T10:14:19.622587+0000","last_fullsized":"2024-04-25T10:14:19.622587+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:01:33.125989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623672+0000","last_change":"2024-04-25T10:14:17.398290+0000","last_active":"2024-04-25T10:14:19.623672+0000","last_peered":"2024-04-25T10:14:19.623672+0000","last_clean":"2024-04-25T10:14:19.623672+0000","last_became_active":"2024-04-25T10:14:17.397904+0000","last_became_peered":"2024-04-25T10:14:17.397904+0000","last_unstale":"2024-04-25T10:14:19.623672+0000","last_undegraded":"2024-04-25T10:14:19.623672+0000","last_fullsized":"2024-04-25T10:14:19.623672+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:21.571171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510560+0000","last_change":"2024-04-25T10:14:18.395302+0000","last_active":"2024-04-25T10:14:19.510560+0000","last_peered":"2024-04-25T10:14:19.510560+0000","last_clean":"2024-04-25T10:14:19.510560+0000","last_became_active":"2024-04-25T10:14:18.393973+0000","last_became_peered":"2024-04-25T10:14:18.393973+0000","last_unstale":"2024-04-25T10:14:19.510560+0000","last_undegraded":"2024-04-25T10:14:19.510560+0000","last_fullsized":"2024-04-25T10:14:19.510560+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:44.212560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623109+0000","last_change":"2024-04-25T10:14:17.400452+0000","last_active":"2024-04-25T10:14:19.623109+0000","last_peered":"2024-04-25T10:14:19.623109+0000","last_clean":"2024-04-25T10:14:19.623109+0000","last_became_active":"2024-04-25T10:14:17.400162+0000","last_became_peered":"2024-04-25T10:14:17.400162+0000","last_unstale":"2024-04-25T10:14:19.623109+0000","last_undegraded":"2024-04-25T10:14:19.623109+0000","last_fullsized":"2024-04-25T10:14:19.623109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:47.976475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626845+0000","last_change":"2024-04-25T10:14:18.413950+0000","last_active":"2024-04-25T10:14:19.626845+0000","last_peered":"2024-04-25T10:14:19.626845+0000","last_clean":"2024-04-25T10:14:19.626845+0000","last_became_active":"2024-04-25T10:14:18.413613+0000","last_became_peered":"2024-04-25T10:14:18.413613+0000","last_unstale":"2024-04-25T10:14:19.626845+0000","last_undegraded":"2024-04-25T10:14:19.626845+0000","last_fullsized":"2024-04-25T10:14:19.626845+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623158+0000","last_change":"2024-04-25T10:14:17.391475+0000","last_active":"2024-04-25T10:14:19.623158+0000","last_peered":"2024-04-25T10:14:19.623158+0000","last_clean":"2024-04-25T10:14:19.623158+0000","last_became_active":"2024-04-25T10:14:17.390629+0000","last_became_peered":"2024-04-25T10:14:17.390629+0000","last_unstale":"2024-04-25T10:14:19.623158+0000","last_undegraded":"2024-04-25T10:14:19.623158+0000","last_fullsized":"2024-04-25T10:14:19.623158+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:31.965799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405485+0000","last_change":"2024-04-25T10:14:18.403183+0000","last_active":"2024-04-25T10:14:19.405485+0000","last_peered":"2024-04-25T10:14:19.405485+0000","last_clean":"2024-04-25T10:14:19.405485+0000","last_became_active":"2024-04-25T10:14:18.402794+0000","last_became_peered":"2024-04-25T10:14:18.402794+0000","last_unstale":"2024-04-25T10:14:19.405485+0000","last_undegraded":"2024-04-25T10:14:19.405485+0000","last_fullsized":"2024-04-25T10:14:19.405485+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:36:35.215690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510829+0000","last_change":"2024-04-25T10:14:17.402367+0000","last_active":"2024-04-25T10:14:19.510829+0000","last_peered":"2024-04-25T10:14:19.510829+0000","last_clean":"2024-04-25T10:14:19.510829+0000","last_became_active":"2024-04-25T10:14:17.402100+0000","last_became_peered":"2024-04-25T10:14:17.402100+0000","last_unstale":"2024-04-25T10:14:19.510829+0000","last_undegraded":"2024-04-25T10:14:19.510829+0000","last_fullsized":"2024-04-25T10:14:19.510829+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:16.627286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400538+0000","last_change":"2024-04-25T10:14:18.407239+0000","last_active":"2024-04-25T10:14:19.400538+0000","last_peered":"2024-04-25T10:14:19.400538+0000","last_clean":"2024-04-25T10:14:19.400538+0000","last_became_active":"2024-04-25T10:14:18.406956+0000","last_became_peered":"2024-04-25T10:14:18.406956+0000","last_unstale":"2024-04-25T10:14:19.400538+0000","last_undegraded":"2024-04-25T10:14:19.400538+0000","last_fullsized":"2024-04-25T10:14:19.400538+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:06.584008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626276+0000","last_change":"2024-04-25T10:14:17.404204+0000","last_active":"2024-04-25T10:14:19.626276+0000","last_peered":"2024-04-25T10:14:19.626276+0000","last_clean":"2024-04-25T10:14:19.626276+0000","last_became_active":"2024-04-25T10:14:17.403934+0000","last_became_peered":"2024-04-25T10:14:17.403934+0000","last_unstale":"2024-04-25T10:14:19.626276+0000","last_undegraded":"2024-04-25T10:14:19.626276+0000","last_fullsized":"2024-04-25T10:14:19.626276+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:45.520950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.627380+0000","last_change":"2024-04-25T10:14:18.418150+0000","last_active":"2024-04-25T10:14:19.627380+0000","last_peered":"2024-04-25T10:14:19.627380+0000","last_clean":"2024-04-25T10:14:19.627380+0000","last_became_active":"2024-04-25T10:14:18.417911+0000","last_became_peered":"2024-04-25T10:14:18.417911+0000","last_unstale":"2024-04-25T10:14:19.627380+0000","last_undegraded":"2024-04-25T10:14:19.627380+0000","last_fullsized":"2024-04-25T10:14:19.627380+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:36.137237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626162+0000","last_change":"2024-04-25T10:14:17.404836+0000","last_active":"2024-04-25T10:14:19.626162+0000","last_peered":"2024-04-25T10:14:19.626162+0000","last_clean":"2024-04-25T10:14:19.626162+0000","last_became_active":"2024-04-25T10:14:17.404271+0000","last_became_peered":"2024-04-25T10:14:17.404271+0000","last_unstale":"2024-04-25T10:14:19.626162+0000","last_undegraded":"2024-04-25T10:14:19.626162+0000","last_fullsized":"2024-04-25T10:14:19.626162+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399807+0000","last_change":"2024-04-25T10:14:18.390723+0000","last_active":"2024-04-25T10:14:19.399807+0000","last_peered":"2024-04-25T10:14:19.399807+0000","last_clean":"2024-04-25T10:14:19.399807+0000","last_became_active":"2024-04-25T10:14:18.390396+0000","last_became_peered":"2024-04-25T10:14:18.390396+0000","last_unstale":"2024-04-25T10:14:19.399807+0000","last_undegraded":"2024-04-25T10:14:19.399807+0000","last_fullsized":"2024-04-25T10:14:19.399807+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:07:22.931931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400070+0000","last_change":"2024-04-25T10:14:17.398390+0000","last_active":"2024-04-25T10:14:19.400070+0000","last_peered":"2024-04-25T10:14:19.400070+0000","last_clean":"2024-04-25T10:14:19.400070+0000","last_became_active":"2024-04-25T10:14:17.398021+0000","last_became_peered":"2024-04-25T10:14:17.398021+0000","last_unstale":"2024-04-25T10:14:19.400070+0000","last_undegraded":"2024-04-25T10:14:19.400070+0000","last_fullsized":"2024-04-25T10:14:19.400070+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:27:07.527714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622773+0000","last_change":"2024-04-25T10:14:18.407170+0000","last_active":"2024-04-25T10:14:19.622773+0000","last_peered":"2024-04-25T10:14:19.622773+0000","last_clean":"2024-04-25T10:14:19.622773+0000","last_became_active":"2024-04-25T10:14:18.406874+0000","last_became_peered":"2024-04-25T10:14:18.406874+0000","last_unstale":"2024-04-25T10:14:19.622773+0000","last_undegraded":"2024-04-25T10:14:19.622773+0000","last_fullsized":"2024-04-25T10:14:19.622773+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:53:59.448756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625964+0000","last_change":"2024-04-25T10:14:17.404555+0000","last_active":"2024-04-25T10:14:19.625964+0000","last_peered":"2024-04-25T10:14:19.625964+0000","last_clean":"2024-04-25T10:14:19.625964+0000","last_became_active":"2024-04-25T10:14:17.403773+0000","last_became_peered":"2024-04-25T10:14:17.403773+0000","last_unstale":"2024-04-25T10:14:19.625964+0000","last_undegraded":"2024-04-25T10:14:19.625964+0000","last_fullsized":"2024-04-25T10:14:19.625964+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:22:32.166981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623674+0000","last_change":"2024-04-25T10:14:18.413125+0000","last_active":"2024-04-25T10:14:19.623674+0000","last_peered":"2024-04-25T10:14:19.623674+0000","last_clean":"2024-04-25T10:14:19.623674+0000","last_became_active":"2024-04-25T10:14:18.412151+0000","last_became_peered":"2024-04-25T10:14:18.412151+0000","last_unstale":"2024-04-25T10:14:19.623674+0000","last_undegraded":"2024-04-25T10:14:19.623674+0000","last_fullsized":"2024-04-25T10:14:19.623674+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:12:24.015774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.623120+0000","last_change":"2024-04-25T10:14:17.405282+0000","last_active":"2024-04-25T10:14:19.623120+0000","last_peered":"2024-04-25T10:14:19.623120+0000","last_clean":"2024-04-25T10:14:19.623120+0000","last_became_active":"2024-04-25T10:14:17.404960+0000","last_became_peered":"2024-04-25T10:14:17.404960+0000","last_unstale":"2024-04-25T10:14:19.623120+0000","last_undegraded":"2024-04-25T10:14:19.623120+0000","last_fullsized":"2024-04-25T10:14:19.623120+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:27.320952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626823+0000","last_change":"2024-04-25T10:14:18.412260+0000","last_active":"2024-04-25T10:14:19.626823+0000","last_peered":"2024-04-25T10:14:19.626823+0000","last_clean":"2024-04-25T10:14:19.626823+0000","last_became_active":"2024-04-25T10:14:18.409658+0000","last_became_peered":"2024-04-25T10:14:18.409658+0000","last_unstale":"2024-04-25T10:14:19.626823+0000","last_undegraded":"2024-04-25T10:14:19.626823+0000","last_fullsized":"2024-04-25T10:14:19.626823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:58.320778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625576+0000","last_change":"2024-04-25T10:14:17.407199+0000","last_active":"2024-04-25T10:14:19.625576+0000","last_peered":"2024-04-25T10:14:19.625576+0000","last_clean":"2024-04-25T10:14:19.625576+0000","last_became_active":"2024-04-25T10:14:17.406929+0000","last_became_peered":"2024-04-25T10:14:17.406929+0000","last_unstale":"2024-04-25T10:14:19.625576+0000","last_undegraded":"2024-04-25T10:14:19.625576+0000","last_fullsized":"2024-04-25T10:14:19.625576+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:10.191948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400588+0000","last_change":"2024-04-25T10:14:18.412627+0000","last_active":"2024-04-25T10:14:19.400588+0000","last_peered":"2024-04-25T10:14:19.400588+0000","last_clean":"2024-04-25T10:14:19.400588+0000","last_became_active":"2024-04-25T10:14:18.411790+0000","last_became_peered":"2024-04-25T10:14:18.411790+0000","last_unstale":"2024-04-25T10:14:19.400588+0000","last_undegraded":"2024-04-25T10:14:19.400588+0000","last_fullsized":"2024-04-25T10:14:19.400588+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:41:33.949305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400692+0000","last_change":"2024-04-25T10:14:17.399197+0000","last_active":"2024-04-25T10:14:19.400692+0000","last_peered":"2024-04-25T10:14:19.400692+0000","last_clean":"2024-04-25T10:14:19.400692+0000","last_became_active":"2024-04-25T10:14:17.394930+0000","last_became_peered":"2024-04-25T10:14:17.394930+0000","last_unstale":"2024-04-25T10:14:19.400692+0000","last_undegraded":"2024-04-25T10:14:19.400692+0000","last_fullsized":"2024-04-25T10:14:19.400692+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:15:16.136818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622816+0000","last_change":"2024-04-25T10:14:18.417209+0000","last_active":"2024-04-25T10:14:19.622816+0000","last_peered":"2024-04-25T10:14:19.622816+0000","last_clean":"2024-04-25T10:14:19.622816+0000","last_became_active":"2024-04-25T10:14:18.416285+0000","last_became_peered":"2024-04-25T10:14:18.416285+0000","last_unstale":"2024-04-25T10:14:19.622816+0000","last_undegraded":"2024-04-25T10:14:19.622816+0000","last_fullsized":"2024-04-25T10:14:19.622816+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:26.235033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"123'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405253+0000","last_change":"2024-04-25T10:14:17.401377+0000","last_active":"2024-04-25T10:14:19.405253+0000","last_peered":"2024-04-25T10:14:19.405253+0000","last_clean":"2024-04-25T10:14:19.405253+0000","last_became_active":"2024-04-25T10:14:17.400310+0000","last_became_peered":"2024-04-25T10:14:17.400310+0000","last_unstale":"2024-04-25T10:14:19.405253+0000","last_undegraded":"2024-04-25T10:14:19.405253+0000","last_fullsized":"2024-04-25T10:14:19.405253+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:15:12.083505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626745+0000","last_change":"2024-04-25T10:14:18.418899+0000","last_active":"2024-04-25T10:14:19.626745+0000","last_peered":"2024-04-25T10:14:19.626745+0000","last_clean":"2024-04-25T10:14:19.626745+0000","last_became_active":"2024-04-25T10:14:18.418620+0000","last_became_peered":"2024-04-25T10:14:18.418620+0000","last_unstale":"2024-04-25T10:14:19.626745+0000","last_undegraded":"2024-04-25T10:14:19.626745+0000","last_fullsized":"2024-04-25T10:14:19.626745+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:59:18.394406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405027+0000","last_change":"2024-04-25T10:14:17.401969+0000","last_active":"2024-04-25T10:14:19.405027+0000","last_peered":"2024-04-25T10:14:19.405027+0000","last_clean":"2024-04-25T10:14:19.405027+0000","last_became_active":"2024-04-25T10:14:17.401055+0000","last_became_peered":"2024-04-25T10:14:17.401055+0000","last_unstale":"2024-04-25T10:14:19.405027+0000","last_undegraded":"2024-04-25T10:14:19.405027+0000","last_fullsized":"2024-04-25T10:14:19.405027+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.510852+0000","last_change":"2024-04-25T10:14:18.413756+0000","last_active":"2024-04-25T10:14:19.510852+0000","last_peered":"2024-04-25T10:14:19.510852+0000","last_clean":"2024-04-25T10:14:19.510852+0000","last_became_active":"2024-04-25T10:14:18.413389+0000","last_became_peered":"2024-04-25T10:14:18.413389+0000","last_unstale":"2024-04-25T10:14:19.510852+0000","last_undegraded":"2024-04-25T10:14:19.510852+0000","last_fullsized":"2024-04-25T10:14:19.510852+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:53.173171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400518+0000","last_change":"2024-04-25T10:14:17.396790+0000","last_active":"2024-04-25T10:14:19.400518+0000","last_peered":"2024-04-25T10:14:19.400518+0000","last_clean":"2024-04-25T10:14:19.400518+0000","last_became_active":"2024-04-25T10:14:17.395939+0000","last_became_peered":"2024-04-25T10:14:17.395939+0000","last_unstale":"2024-04-25T10:14:19.400518+0000","last_undegraded":"2024-04-25T10:14:19.400518+0000","last_fullsized":"2024-04-25T10:14:19.400518+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:55:22.732918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.400005+0000","last_change":"2024-04-25T10:14:18.396192+0000","last_active":"2024-04-25T10:14:19.400005+0000","last_peered":"2024-04-25T10:14:19.400005+0000","last_clean":"2024-04-25T10:14:19.400005+0000","last_became_active":"2024-04-25T10:14:18.395898+0000","last_became_peered":"2024-04-25T10:14:18.395898+0000","last_unstale":"2024-04-25T10:14:19.400005+0000","last_undegraded":"2024-04-25T10:14:19.400005+0000","last_fullsized":"2024-04-25T10:14:19.400005+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:27:40.080952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405793+0000","last_change":"2024-04-25T10:14:17.406919+0000","last_active":"2024-04-25T10:14:19.405793+0000","last_peered":"2024-04-25T10:14:19.405793+0000","last_clean":"2024-04-25T10:14:19.405793+0000","last_became_active":"2024-04-25T10:14:17.406629+0000","last_became_peered":"2024-04-25T10:14:17.406629+0000","last_unstale":"2024-04-25T10:14:19.405793+0000","last_undegraded":"2024-04-25T10:14:19.405793+0000","last_fullsized":"2024-04-25T10:14:19.405793+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:42.261980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622915+0000","last_change":"2024-04-25T10:14:18.411505+0000","last_active":"2024-04-25T10:14:19.622915+0000","last_peered":"2024-04-25T10:14:19.622915+0000","last_clean":"2024-04-25T10:14:19.622915+0000","last_became_active":"2024-04-25T10:14:18.411200+0000","last_became_peered":"2024-04-25T10:14:18.411200+0000","last_unstale":"2024-04-25T10:14:19.622915+0000","last_undegraded":"2024-04-25T10:14:19.622915+0000","last_fullsized":"2024-04-25T10:14:19.622915+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:01.593222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.405275+0000","last_change":"2024-04-25T10:14:17.395732+0000","last_active":"2024-04-25T10:14:19.405275+0000","last_peered":"2024-04-25T10:14:19.405275+0000","last_clean":"2024-04-25T10:14:19.405275+0000","last_became_active":"2024-04-25T10:14:17.394756+0000","last_became_peered":"2024-04-25T10:14:17.394756+0000","last_unstale":"2024-04-25T10:14:19.405275+0000","last_undegraded":"2024-04-25T10:14:19.405275+0000","last_fullsized":"2024-04-25T10:14:19.405275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:59:31.210706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625812+0000","last_change":"2024-04-25T10:14:18.414233+0000","last_active":"2024-04-25T10:14:19.625812+0000","last_peered":"2024-04-25T10:14:19.625812+0000","last_clean":"2024-04-25T10:14:19.625812+0000","last_became_active":"2024-04-25T10:14:18.413964+0000","last_became_peered":"2024-04-25T10:14:18.413964+0000","last_unstale":"2024-04-25T10:14:19.625812+0000","last_undegraded":"2024-04-25T10:14:19.625812+0000","last_fullsized":"2024-04-25T10:14:19.625812+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:57.021860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.399874+0000","last_change":"2024-04-25T10:14:17.399818+0000","last_active":"2024-04-25T10:14:19.399874+0000","last_peered":"2024-04-25T10:14:19.399874+0000","last_clean":"2024-04-25T10:14:19.399874+0000","last_became_active":"2024-04-25T10:14:17.399306+0000","last_became_peered":"2024-04-25T10:14:17.399306+0000","last_unstale":"2024-04-25T10:14:19.399874+0000","last_undegraded":"2024-04-25T10:14:19.399874+0000","last_fullsized":"2024-04-25T10:14:19.399874+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:43:03.625968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622942+0000","last_change":"2024-04-25T10:14:18.418133+0000","last_active":"2024-04-25T10:14:19.622942+0000","last_peered":"2024-04-25T10:14:19.622942+0000","last_clean":"2024-04-25T10:14:19.622942+0000","last_became_active":"2024-04-25T10:14:18.417842+0000","last_became_peered":"2024-04-25T10:14:18.417842+0000","last_unstale":"2024-04-25T10:14:19.622942+0000","last_undegraded":"2024-04-25T10:14:19.622942+0000","last_fullsized":"2024-04-25T10:14:19.622942+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:12.818339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625577+0000","last_change":"2024-04-25T10:14:17.403888+0000","last_active":"2024-04-25T10:14:19.625577+0000","last_peered":"2024-04-25T10:14:19.625577+0000","last_clean":"2024-04-25T10:14:19.625577+0000","last_became_active":"2024-04-25T10:14:17.403571+0000","last_became_peered":"2024-04-25T10:14:17.403571+0000","last_unstale":"2024-04-25T10:14:19.625577+0000","last_undegraded":"2024-04-25T10:14:19.625577+0000","last_fullsized":"2024-04-25T10:14:19.625577+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:40:16.416912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.626764+0000","last_change":"2024-04-25T10:14:18.418142+0000","last_active":"2024-04-25T10:14:19.626764+0000","last_peered":"2024-04-25T10:14:19.626764+0000","last_clean":"2024-04-25T10:14:19.626764+0000","last_became_active":"2024-04-25T10:14:18.417870+0000","last_became_peered":"2024-04-25T10:14:18.417870+0000","last_unstale":"2024-04-25T10:14:19.626764+0000","last_undegraded":"2024-04-25T10:14:19.626764+0000","last_fullsized":"2024-04-25T10:14:19.626764+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:17.372610+0000","last_clean_scrub_stamp":"2024-04-25T10:14:17.372610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:36.137237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"122'8","reported_seq":22,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.622817+0000","last_change":"2024-04-25T10:14:17.403473+0000","last_active":"2024-04-25T10:14:19.622817+0000","last_peered":"2024-04-25T10:14:19.622817+0000","last_clean":"2024-04-25T10:14:19.622817+0000","last_became_active":"2024-04-25T10:14:17.403201+0000","last_became_peered":"2024-04-25T10:14:17.403201+0000","last_unstale":"2024-04-25T10:14:19.622817+0000","last_undegraded":"2024-04-25T10:14:19.622817+0000","last_fullsized":"2024-04-25T10:14:19.622817+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:14:16.366018+0000","last_clean_scrub_stamp":"2024-04-25T10:14:16.366018+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:01:26.864292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":361,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-25T10:14:19.625818+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:14:19.625818+0000","last_peered":"2024-04-25T10:14:19.625818+0000","last_clean":"2024-04-25T10:14:19.625818+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:14:19.625818+0000","last_undegraded":"2024-04-25T10:14:19.625818+0000","last_fullsized":"2024-04-25T10:14:19.625818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509572,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2134016,"data_stored":1305025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509573,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1527808,"data_stored":714463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509571,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1531904,"data_stored":714041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509570,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1536000,"data_stored":715493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542276,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32684,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1540096,"data_stored":715527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542274,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32672,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339168,"statfs":{"total":96636764160,"available":96603308032,"internally_reserved":0,"allocated":1523712,"data_stored":713881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542276,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32676,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339164,"statfs":{"total":96636764160,"available":96603303936,"internally_reserved":0,"allocated":1527808,"data_stored":713903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542274,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33252,"kb_used_data":2072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338588,"statfs":{"total":96636764160,"available":96602714112,"internally_reserved":0,"allocated":2121728,"data_stored":1304271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:14:27.464 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T10:14:27.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T10:14:27.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 Processor -- start 2024-04-25T10:14:27.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 -- start start 2024-04-25T10:14:27.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc15fc00 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dcc15fee0 con 0x7f7dcc159320 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dd1000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dcc06d640 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dca800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dc3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7dcc15c9b0 0x7f7dcc06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52398/0 (socket says 172.21.15.18:52398) 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dca800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52154/0 (socket says 172.21.15.18:52154) 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.640+0000 7f7dc3e00640 1 -- 172.21.15.18:0/1941227822 learned_addr learned my addr 172.21.15.18:0/1941227822 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dca800640 1 -- 172.21.15.18:0/1941227822 >> v1:172.21.15.167:6789/0 conn(0x7f7dcc159320 legacy=0x7f7dcc15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dca800640 1 -- 172.21.15.18:0/1941227822 >> v1:172.21.15.18:6789/0 conn(0x7f7dcc15c9b0 legacy=0x7f7dcc06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dca800640 1 -- 172.21.15.18:0/1941227822 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc1601c0 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dc9400640 1 -- 172.21.15.18:0/1941227822 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650476694 0 0) 0x7f7dcc15fc00 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dca800640 1 --2- 172.21.15.18:0/1941227822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc06d7c0 tx=0x7f7dc401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4df6c17dcf0a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dc9400640 1 -- 172.21.15.18:0/1941227822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40b2070 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dc9400640 1 -- 172.21.15.18:0/1941227822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40a5810 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dc9400640 1 -- 172.21.15.18:0/1941227822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40a5be0 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 -- 172.21.15.18:0/1941227822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc06e4a0 msgr2=0x7f7dcc06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 --2- 172.21.15.18:0/1941227822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc06d7c0 tx=0x7f7dc401c950 comp rx=0 tx=0).stop 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 -- 172.21.15.18:0/1941227822 shutdown_connections 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 --2- 172.21.15.18:0/1941227822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc06e4a0 0x7f7dcc06e8d0 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 -- 172.21.15.18:0/1941227822 >> 172.21.15.18:0/1941227822 conn(0x7f7dcc067080 msgr2=0x7f7dcc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.644+0000 7f7dd1000640 1 -- 172.21.15.18:0/1941227822 shutdown_connections 2024-04-25T10:14:27.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- 172.21.15.18:0/1941227822 wait complete. 2024-04-25T10:14:27.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 Processor -- start 2024-04-25T10:14:27.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- start start 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dcc06e4a0 0x7f7dcc15e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dcc159320 0x7f7dcc0b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc169720 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc1695a0 con 0x7f7dcc159320 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dcc1698a0 con 0x7f7dcc06e4a0 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52162/0 (socket says 172.21.15.18:52162) 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 -- 172.21.15.18:0/3499231504 learned_addr learned my addr 172.21.15.18:0/3499231504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dc9e00640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dcc06e4a0 0x7f7dcc15e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dc3e00640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dcc159320 0x7f7dcc0b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 -- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dcc06e4a0 msgr2=0x7f7dcc15e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dcc06e4a0 0x7f7dcc15e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 -- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dcc159320 msgr2=0x7f7dcc0b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dcc159320 0x7f7dcc0b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 -- 172.21.15.18:0/3499231504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0af9d0 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dca800640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4019560 tx=0x7f7dc40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40bd020 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc40b3040 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40b2050 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.648+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dcc0af410 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dcc0b04d0 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dcc0745d0 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7dc40ad650 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dc2000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 0x7f7da8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:27.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7dc411fe10 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dc9e00640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 0x7f7da8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:27.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.652+0000 7f7dc9e00640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 0x7f7da8069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f70 tx=0x7f7dbc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:27.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.656+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7dc4123030 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.876+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7dcc15bc30 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dc2000640 1 -- 172.21.15.18:0/3499231504 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7dc40c7020 con 0x7f7dcc15c9b0 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQBNKipme0YnARAA4+VdTQCxoJvzt0gqNTH6QA== 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T10:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 msgr2=0x7f7da8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 0x7f7da8069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc000f70 tx=0x7f7dbc009040 comp rx=0 tx=0).stop 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 msgr2=0x7f7dcc0aff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4019560 tx=0x7f7dc40196f0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 shutdown_connections 2024-04-25T10:14:27.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7dcc15c9b0 0x7f7dcc0aff90 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7dcc159320 0x7f7dcc0b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7da8066f60 0x7f7da8069420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 --2- 172.21.15.18:0/3499231504 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7dcc06e4a0 0x7f7dcc15e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 >> 172.21.15.18:0/3499231504 conn(0x7f7dcc067080 msgr2=0x7f7dcc06dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 shutdown_connections 2024-04-25T10:14:27.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:27.880+0000 7f7dd1000640 1 -- 172.21.15.18:0/3499231504 wait complete. 2024-04-25T10:14:27.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 Processor -- start 2024-04-25T10:14:28.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 -- start start 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e140b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140cd6c0 con 0x7f7e1415efa0 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140cce20 con 0x7f7e1409a170 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e18a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140b3fe0 con 0x7f7e140cdb70 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7e1415efa0 0x7f7e14099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52400/0 (socket says 172.21.15.18:52400) 2024-04-25T10:14:28.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13400640 1 -- 172.21.15.18:0/2577282786 learned_addr learned my addr 172.21.15.18:0/2577282786 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13e00640 1 --2- 172.21.15.18:0/2577282786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e140b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814298941 0 0) 0x7f7e140cd6c0 con 0x7f7e1415efa0 2024-04-25T10:14:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df8003530 con 0x7f7e1415efa0 2024-04-25T10:14:28.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34720543 0 0) 0x7f7e140cce20 con 0x7f7e1409a170 2024-04-25T10:14:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e140cd6c0 con 0x7f7e1409a170 2024-04-25T10:14:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13e00640 1 -- 172.21.15.18:0/2577282786 >> v1:172.21.15.167:6789/0 conn(0x7f7e1409a170 legacy=0x7f7e140b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13e00640 1 -- 172.21.15.18:0/2577282786 >> v1:172.21.15.18:6789/0 conn(0x7f7e1415efa0 legacy=0x7f7e14099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2068949836 0 0) 0x7f7df8003530 con 0x7f7e1415efa0 2024-04-25T10:14:28.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.044+0000 7f7e13e00640 1 -- 172.21.15.18:0/2577282786 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140cd100 con 0x7f7e140cdb70 2024-04-25T10:14:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e13e00640 1 --2- 172.21.15.18:0/2577282786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e140b18b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009dc0 tx=0x7f7e140b2600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50b9478ea52df417 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040016a0 con 0x7f7e140cdb70 2024-04-25T10:14:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c0a6500 con 0x7f7e140cdb70 2024-04-25T10:14:28.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e12000640 1 -- 172.21.15.18:0/2577282786 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c0a68d0 con 0x7f7e140cdb70 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 -- 172.21.15.18:0/2577282786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 msgr2=0x7f7e140b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 --2- 172.21.15.18:0/2577282786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e140b18b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009dc0 tx=0x7f7e140b2600 comp rx=0 tx=0).stop 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 -- 172.21.15.18:0/2577282786 shutdown_connections 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 --2- 172.21.15.18:0/2577282786 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e140b18b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 -- 172.21.15.18:0/2577282786 >> 172.21.15.18:0/2577282786 conn(0x7f7e140b3050 msgr2=0x7f7e140b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 -- 172.21.15.18:0/2577282786 shutdown_connections 2024-04-25T10:14:28.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.048+0000 7f7e18a00640 1 -- 172.21.15.18:0/2577282786 wait complete. 2024-04-25T10:14:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 Processor -- start 2024-04-25T10:14:28.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- start start 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e141565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 0x7f7e141539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14169830 con 0x7f7e1409a170 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141696b0 con 0x7f7e1415efa0 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e141699b0 con 0x7f7e140cdb70 2024-04-25T10:14:28.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52170/0 (socket says 172.21.15.18:52170) 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 -- 172.21.15.18:0/745584104 learned_addr learned my addr 172.21.15.18:0/745584104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e12a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e141565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 -- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 msgr2=0x7f7e141565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13e00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 0x7f7e141539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e141565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 -- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 msgr2=0x7f7e141539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 0x7f7e141539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 -- 172.21.15.18:0/745584104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140b2ce0 con 0x7f7e1409a170 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e12a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e141565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13e00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 0x7f7e141539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e13400640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c730 tx=0x7f7e0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04018070 con 0x7f7e1409a170 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040072d0 con 0x7f7e1409a170 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e040047f0 con 0x7f7e1409a170 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140c5550 con 0x7f7e1409a170 2024-04-25T10:14:28.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e140ca130 con 0x7f7e1409a170 2024-04-25T10:14:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.052+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1404efa0 con 0x7f7e1409a170 2024-04-25T10:14:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.056+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e04004990 con 0x7f7e1409a170 2024-04-25T10:14:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.056+0000 7f7e0b400640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 0x7f7df4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.056+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7e04084720 con 0x7f7e1409a170 2024-04-25T10:14:28.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.056+0000 7f7e12a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 0x7f7df4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.056+0000 7f7e12a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 0x7f7df4069450 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e14158240 tx=0x7f7e00009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.060+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e04055500 con 0x7f7e1409a170 2024-04-25T10:14:28.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.252+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e140c5720 con 0x7f7e1409a170 2024-04-25T10:14:28.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e0b400640 1 -- 172.21.15.18:0/745584104 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f7e04054e00 con 0x7f7e1409a170 2024-04-25T10:14:28.263 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:28.263 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:20.801208+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37337":{"gid":37337,"name":"d","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6837/2651841863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2651841863},{"type":"v1","addr":"172.21.15.167:6837","nonce":2651841863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 101 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 msgr2=0x7f7df4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 0x7f7df4069450 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f7e14158240 tx=0x7f7e00009040 comp rx=0 tx=0).stop 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 msgr2=0x7f7e140cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f7e0400c730 tx=0x7f7e0400cbf0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 shutdown_connections 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e1415efa0 0x7f7e141539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7df4066f90 0x7f7df4069450 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f7e140cdb70 0x7f7e141565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 --2- 172.21.15.18:0/745584104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7e1409a170 0x7f7e140cacb0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 >> 172.21.15.18:0/745584104 conn(0x7f7e140b3050 msgr2=0x7f7e1415d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 shutdown_connections 2024-04-25T10:14:28.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.256+0000 7f7e18a00640 1 -- 172.21.15.18:0/745584104 wait complete. 2024-04-25T10:14:28.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:20.801208+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37337}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37337': {'gid': 37337, 'name': 'd', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6837/2651841863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 2651841863}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 2651841863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:28.687 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:14:28.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:14:28.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 Processor -- start 2024-04-25T10:14:28.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 -- start start 2024-04-25T10:14:28.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6620144120 0x7f662015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 0x7f662015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662015bc40 con 0x7f662015ee60 2024-04-25T10:14:28.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f662015e490 con 0x7f6620144120 2024-04-25T10:14:28.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6627400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662015b3a0 con 0x7f66200ccbf0 2024-04-25T10:14:28.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6624a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6620144120 0x7f662015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6625400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f662015ee60 0x7f66200b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52406/0 (socket says 172.21.15.18:52406) 2024-04-25T10:14:28.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.824+0000 7f6625400640 1 -- 172.21.15.18:0/2894859947 learned_addr learned my addr 172.21.15.18:0/2894859947 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:28.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6624a00640 1 -- 172.21.15.18:0/2894859947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 msgr2=0x7f662015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6617e00640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 0x7f662015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f661fe00640 1 -- 172.21.15.18:0/2894859947 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90018860 0 0) 0x7f662015bc40 con 0x7f662015ee60 2024-04-25T10:14:28.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6624a00640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 0x7f662015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6624a00640 1 -- 172.21.15.18:0/2894859947 >> v1:172.21.15.18:6789/0 conn(0x7f662015ee60 legacy=0x7f66200b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6624a00640 1 -- 172.21.15.18:0/2894859947 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f662015b680 con 0x7f6620144120 2024-04-25T10:14:28.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6617e00640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 0x7f662015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:28.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6624a00640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6620144120 0x7f662015acd0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb315de0ff8b11a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f661fe00640 1 -- 172.21.15.18:0/2894859947 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100b0070 con 0x7f6620144120 2024-04-25T10:14:28.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f661fe00640 1 -- 172.21.15.18:0/2894859947 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100ab600 con 0x7f6620144120 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f661fe00640 1 -- 172.21.15.18:0/2894859947 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ab9d0 con 0x7f6620144120 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 -- 172.21.15.18:0/2894859947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6620144120 msgr2=0x7f662015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6620144120 0x7f662015acd0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f66100097c0 tx=0x7f661001c410 comp rx=0 tx=0).stop 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 -- 172.21.15.18:0/2894859947 shutdown_connections 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f66200ccbf0 0x7f662015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 --2- 172.21.15.18:0/2894859947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6620144120 0x7f662015acd0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 -- 172.21.15.18:0/2894859947 >> 172.21.15.18:0/2894859947 conn(0x7f6620067080 msgr2=0x7f662006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.828+0000 7f6627400640 1 -- 172.21.15.18:0/2894859947 shutdown_connections 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- 172.21.15.18:0/2894859947 wait complete. 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 Processor -- start 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- start start 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 0x7f6620137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 0x7f662015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662006d450 con 0x7f662015ee60 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662006d2d0 con 0x7f66200ccbf0 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f662006d5d0 con 0x7f6620144120 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52186/0 (socket says 172.21.15.18:52186) 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 -- 172.21.15.18:0/1397524964 learned_addr learned my addr 172.21.15.18:0/1397524964 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6617e00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 0x7f662015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6624a00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 0x7f6620137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 -- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 msgr2=0x7f662015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 0x7f662015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 -- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 msgr2=0x7f6620137840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 0x7f6620137840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 -- 172.21.15.18:0/1397524964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200afbc0 con 0x7f662015ee60 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6617e00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 0x7f662015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6624a00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 0x7f6620137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6625400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f661800c700 tx=0x7f661800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f661d600640 1 -- 172.21.15.18:0/1397524964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618018070 con 0x7f662015ee60 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f661d600640 1 -- 172.21.15.18:0/1397524964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661800ce10 con 0x7f662015ee60 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f661d600640 1 -- 172.21.15.18:0/1397524964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800a880 con 0x7f662015ee60 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.832+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f662015a480 con 0x7f662015ee60 2024-04-25T10:14:28.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.836+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66200b0140 con 0x7f662015ee60 2024-04-25T10:14:28.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.836+0000 7f661d600640 1 -- 172.21.15.18:0/1397524964 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f661801b070 con 0x7f662015ee60 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.836+0000 7f661d600640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.836+0000 7f661d600640 1 -- 172.21.15.18:0/1397524964 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6618084820 con 0x7f662015ee60 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 Processor -- start 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- start start 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 0x7f65fc069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f66100ad000 tx=0x7f6610008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821139f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x565282114310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565281ffb5f0 con 0x56528215d920 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565281f62da0 con 0x56528215e240 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565281eeb150 con 0x565282113f30 2024-04-25T10:14:28.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52188/0 (socket says 172.21.15.18:52188) 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 -- 172.21.15.18:0/344168950 learned_addr learned my addr 172.21.15.18:0/344168950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6625400640 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x565282114310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6617e00640 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821139f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 -- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 msgr2=0x565282114310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x565282114310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 -- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 msgr2=0x5652821139f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821139f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 -- 172.21.15.18:0/344168950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565281f04ca0 con 0x56528215d920 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6624a00640 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f66100ae040 tx=0x7f66100a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b5ae7b9ecef04d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6615600640 1 -- 172.21.15.18:0/344168950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100c7070 con 0x56528215d920 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6615600640 1 -- 172.21.15.18:0/344168950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100b67f0 con 0x56528215d920 2024-04-25T10:14:28.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f6615600640 1 -- 172.21.15.18:0/344168950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100b0040 con 0x56528215d920 2024-04-25T10:14:28.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- 172.21.15.18:0/344168950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 msgr2=0x56528215dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f66100ae040 tx=0x7f66100a6000 comp rx=0 tx=0).stop 2024-04-25T10:14:28.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- 172.21.15.18:0/344168950 shutdown_connections 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x565282114310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821139f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 --2- 172.21.15.18:0/344168950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x56528215dd00 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- 172.21.15.18:0/344168950 >> 172.21.15.18:0/344168950 conn(0x56528211a2a0 msgr2=0x5652821122d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- 172.21.15.18:0/344168950 shutdown_connections 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- 172.21.15.18:0/344168950 wait complete. 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.840+0000 7f662a8f0000 1 -- start start 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 Processor -- start 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215d920 0x565282165410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x565282117aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565281f1d990 con 0x565282113f30 2024-04-25T10:14:28.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x565281f5ee40 con 0x56528215d920 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565281eee900 con 0x56528215e240 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 10 client.0 _ll_register_callbacks cb 0x5652820161c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52192/0 (socket says 172.21.15.18:52192) 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 -- 172.21.15.18:0/3336821050 learned_addr learned my addr 172.21.15.18:0/3336821050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6617e00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215d920 0x565282165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6625400640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x565282117aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 -- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 msgr2=0x565282117aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x565282117aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 -- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215d920 msgr2=0x565282165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215d920 0x565282165410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 -- 172.21.15.18:0/3336821050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565281f1b630 con 0x565282113f30 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6624a00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f66100ae040 tx=0x7f661001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbbaadbb6b11871 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100cf070 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66100b67f0 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f66100b69a0 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66100da050 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 10 client.9189 fetch_fsmap learned FSMap version 101 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x565281eeb3a0 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100b67f0 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f66100dd020 con 0x565282113f30 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 10 client.9189 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 10 client.9189 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 20 client.9189 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x565282119160 0x56528216ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 4 client.9189 mds_command: new command op to 37337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:28.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 --> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565281efea50 con 0x565282119160 2024-04-25T10:14:28.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.844+0000 7f6617e00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x565282119160 0x56528216ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f6617e00640 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x565282119160 0x56528216ef30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8c5fd8439f8e086 server_cookie=9ec4837e741a2c77 in_seq=0 out_seq=0 2024-04-25T10:14:28.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f660e000640 10 client.9189 ms_handle_connect on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f660e000640 1 -- 172.21.15.18:0/3336821050 <== mds.0 v2:172.21.15.167:6835/2651841863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x565281efea50 con 0x565282119160 2024-04-25T10:14:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f660e000640 10 client.9189 handle_command_reply: tid=0 2024-04-25T10:14:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 client.9189 shutdown 2024-04-25T10:14:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 msgr2=0x565282164ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f66100ae040 tx=0x7f661001ac50 comp rx=0 tx=0).stop 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 shutdown_connections 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x565282119160 0x56528216ef30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x565282117aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215d920 0x565282165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 --2- 172.21.15.18:0/3336821050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x565282113f30 0x565282164ed0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f660e000640 0 client.9189 ms_handle_reset on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 >> 172.21.15.18:0/3336821050 conn(0x56528211a2a0 msgr2=0x5652821129e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 shutdown_connections 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 1 -- 172.21.15.18:0/3336821050 wait complete. 2024-04-25T10:14:28.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.848+0000 7f662a8f0000 20 client.9189 trim_cache size 0 max 16384 2024-04-25T10:14:28.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 Processor -- start 2024-04-25T10:14:28.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- start start 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565282113f30 0x5652821b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x5652821b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66202024d0 con 0x56528215d920 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6620159a70 con 0x565282113f30 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6620201ed0 con 0x56528215e240 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52198/0 (socket says 172.21.15.18:52198) 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 -- 172.21.15.18:0/602928668 learned_addr learned my addr 172.21.15.18:0/602928668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6624a00640 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565282113f30 0x5652821b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6625400640 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x5652821b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 -- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 msgr2=0x5652821b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x5652821b9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 -- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565282113f30 msgr2=0x5652821b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565282113f30 0x5652821b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 -- 172.21.15.18:0/602928668 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56528215e070 con 0x56528215d920 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6617e00640 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f660800bf00 tx=0x7f6608008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3c84326124cf2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6614c00640 1 -- 172.21.15.18:0/602928668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080159c0 con 0x56528215d920 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6614c00640 1 -- 172.21.15.18:0/602928668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608015b60 con 0x56528215d920 2024-04-25T10:14:28.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f6614c00640 1 -- 172.21.15.18:0/602928668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608015d50 con 0x56528215d920 2024-04-25T10:14:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- 172.21.15.18:0/602928668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 msgr2=0x5652821b9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f660800bf00 tx=0x7f6608008040 comp rx=0 tx=0).stop 2024-04-25T10:14:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- 172.21.15.18:0/602928668 shutdown_connections 2024-04-25T10:14:28.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x56528215e240 0x5652821b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821b9920 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 --2- 172.21.15.18:0/602928668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x565282113f30 0x5652821b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.864+0000 7f662a8f0000 1 -- 172.21.15.18:0/602928668 >> 172.21.15.18:0/602928668 conn(0x56528211a2a0 msgr2=0x565282117220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- 172.21.15.18:0/602928668 shutdown_connections 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- 172.21.15.18:0/602928668 wait complete. 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- start start 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 Processor -- start 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x5652821be730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821bdb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x565281f673d0 con 0x56528215d920 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x56528201ed50 con 0x56528215e240 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x565281efd980 con 0x565282113f30 2024-04-25T10:14:28.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 10 client.0 _ll_register_callbacks cb 0x7f66100ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52204/0 (socket says 172.21.15.18:52204) 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 -- 172.21.15.18:0/1335505126 learned_addr learned my addr 172.21.15.18:0/1335505126 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6624a00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x5652821be730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6625400640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821bdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 -- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 msgr2=0x5652821be730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x5652821be730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 -- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 msgr2=0x5652821bdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821bdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 -- 172.21.15.18:0/1335505126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565281fe4600 con 0x56528215d920 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f6617e00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c10 tx=0x7f660801ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca6ec5d33379e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660802a070 con 0x56528215d920 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f660801b520 con 0x56528215d920 2024-04-25T10:14:28.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6608015b60 con 0x56528215d920 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6608035050 con 0x56528215d920 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 10 client.9195 fetch_fsmap learned FSMap version 101 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x565281ef79b0 con 0x56528215d920 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608015b60 con 0x56528215d920 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6608038020 con 0x56528215d920 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 10 client.9195 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 10 client.9195 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 20 client.9195 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x5652821789b0 0x565282178d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 4 client.9195 mds_command: new command op to 37337 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.868+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 --> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565281f702e0 con 0x5652821789b0 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6624a00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x5652821789b0 0x565282178d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:28.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6624a00640 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x5652821789b0 0x565282178d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e27ef99df2737a7d server_cookie=96d4072918f6731b in_seq=0 out_seq=0 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f660e000640 10 client.9195 ms_handle_connect on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f660e000640 1 -- 172.21.15.18:0/1335505126 <== mds.0 v2:172.21.15.167:6835/2651841863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x565281f702e0 con 0x5652821789b0 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f660e000640 10 client.9195 handle_command_reply: tid=0 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 client.9195 shutdown 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 msgr2=0x5652821bd650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c10 tx=0x7f660801ba90 comp rx=0 tx=0).stop 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 shutdown_connections 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x5652821789b0 0x565282178d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56528215e240 0x5652821bdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56528215d920 0x5652821bd650 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 --2- 172.21.15.18:0/1335505126 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x565282113f30 0x5652821be730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f660e000640 0 client.9195 ms_handle_reset on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 >> 172.21.15.18:0/1335505126 conn(0x56528211a2a0 msgr2=0x5652821659a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 shutdown_connections 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 1 -- 172.21.15.18:0/1335505126 wait complete. 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f662a8f0000 20 client.9195 trim_cache size 0 max 16384 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 37337, 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:14:28.884 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 10.479246890000001, 2024-04-25T10:14:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 101, 2024-04-25T10:14:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 123, 2024-04-25T10:14:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 123, 2024-04-25T10:14:28.885 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 15.401279600000001 2024-04-25T10:14:28.885 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 msgr2=0x7f65fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 0x7f65fc069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f66100ad000 tx=0x7f6610008040 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 msgr2=0x7f662015c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f661800c700 tx=0x7f661800cbc0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 shutdown_connections 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f662015ee60 0x7f662015c0e0 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6620144120 0x7f662015bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 --2- 172.21.15.18:0/1397524964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66200ccbf0 0x7f6620137840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 >> 172.21.15.18:0/1397524964 conn(0x7f6620067080 msgr2=0x7f66200b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 shutdown_connections 2024-04-25T10:14:28.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:28.872+0000 7f6627400640 1 -- 172.21.15.18:0/1397524964 wait complete. 2024-04-25T10:14:28.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:14:29.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 Processor -- start 2024-04-25T10:14:29.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 -- start start 2024-04-25T10:14:29.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd9ec144140 0x7fd9ec0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec0ced60 0x7fd9ec06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9ec15ac60 con 0x7fd9ec06e900 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9ec06ed70 con 0x7fd9ec144140 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0cf3e0 con 0x7fd9ec0ced60 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9ebe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd9ec144140 0x7fd9ec0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f1000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd9ec06e900 0x7fd9ec15e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52408/0 (socket says 172.21.15.18:52408) 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9f1000640 1 -- 172.21.15.18:0/424907068 learned_addr learned my addr 172.21.15.18:0/424907068 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9e3400640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec0ced60 0x7fd9ec06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9ebe00640 1 -- 172.21.15.18:0/424907068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec0ced60 msgr2=0x7fd9ec06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9ebe00640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec0ced60 0x7fd9ec06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9ebe00640 1 -- 172.21.15.18:0/424907068 >> v1:172.21.15.18:6789/0 conn(0x7fd9ec06e900 legacy=0x7fd9ec15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9ebe00640 1 -- 172.21.15.18:0/424907068 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec15af20 con 0x7fd9ec144140 2024-04-25T10:14:29.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.032+0000 7fd9eb400640 1 -- 172.21.15.18:0/424907068 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1993871391 0 0) 0x7fd9ec15ac60 con 0x7fd9ec06e900 2024-04-25T10:14:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9ebe00640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec144140 0x7fd9ec0ce820 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0097c0 tx=0x7fd9dc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16223d3f6b3d8b36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9eb400640 1 -- 172.21.15.18:0/424907068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0b0070 con 0x7fd9ec144140 2024-04-25T10:14:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9eb400640 1 -- 172.21.15.18:0/424907068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0a4e50 con 0x7fd9ec144140 2024-04-25T10:14:29.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9eb400640 1 -- 172.21.15.18:0/424907068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0ab820 con 0x7fd9ec144140 2024-04-25T10:14:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 -- 172.21.15.18:0/424907068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec144140 msgr2=0x7fd9ec0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec144140 0x7fd9ec0ce820 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0097c0 tx=0x7fd9dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 -- 172.21.15.18:0/424907068 shutdown_connections 2024-04-25T10:14:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec0ced60 0x7fd9ec06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 --2- 172.21.15.18:0/424907068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec144140 0x7fd9ec0ce820 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 -- 172.21.15.18:0/424907068 >> 172.21.15.18:0/424907068 conn(0x7fd9ec066fa0 msgr2=0x7fd9ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 -- 172.21.15.18:0/424907068 shutdown_connections 2024-04-25T10:14:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.036+0000 7fd9f3000640 1 -- 172.21.15.18:0/424907068 wait complete. 2024-04-25T10:14:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 Processor -- start 2024-04-25T10:14:29.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- start start 2024-04-25T10:14:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 0x7fd9ec153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec144140 0x7fd9ec153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec144520 con 0x7fd9ec06e900 2024-04-25T10:14:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec0cf140 con 0x7fd9ec0ced60 2024-04-25T10:14:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec15ba00 con 0x7fd9ec144140 2024-04-25T10:14:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52228/0 (socket says 172.21.15.18:52228) 2024-04-25T10:14:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 -- 172.21.15.18:0/1090655944 learned_addr learned my addr 172.21.15.18:0/1090655944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f1000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec144140 0x7fd9ec153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9e3400640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 0x7fd9ec153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 -- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec144140 msgr2=0x7fd9ec153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec144140 0x7fd9ec153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 -- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 msgr2=0x7fd9ec153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 0x7fd9ec153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 -- 172.21.15.18:0/1090655944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec166ad0 con 0x7fd9ec06e900 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9e3400640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 0x7fd9ec153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9ebe00640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0ae040 tx=0x7fd9dc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0b0050 con 0x7fd9ec06e900 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9dc0bc070 con 0x7fd9ec06e900 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec166db0 con 0x7fd9ec06e900 2024-04-25T10:14:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9dc0b78b0 con 0x7fd9ec06e900 2024-04-25T10:14:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.040+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec167370 con 0x7fd9ec06e900 2024-04-25T10:14:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec0745d0 con 0x7fd9ec06e900 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd9dc0b7a50 con 0x7fd9ec06e900 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9e8c00640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 0x7fd9c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd9dc11f8f0 con 0x7fd9ec06e900 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9e3400640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 0x7fd9c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.044+0000 7fd9e3400640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 0x7fd9c8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec142220 tx=0x7fd9d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.048+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd9dc016090 con 0x7fd9ec06e900 2024-04-25T10:14:29.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd9ec0739c0 con 0x7fd9ec06e900 2024-04-25T10:14:29.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9e8c00640 1 -- 172.21.15.18:0/1090655944 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd9dc0f07f0 con 0x7fd9ec06e900 2024-04-25T10:14:29.255 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:14:29.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 msgr2=0x7fd9c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 0x7fd9c8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec142220 tx=0x7fd9d4008040 comp rx=0 tx=0).stop 2024-04-25T10:14:29.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 msgr2=0x7fd9ec13ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:29.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0ae040 tx=0x7fd9dc01ace0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 shutdown_connections 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd9c8066f60 0x7fd9c8069420 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd9ec144140 0x7fd9ec153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9ec0ced60 0x7fd9ec153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 --2- 172.21.15.18:0/1090655944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9ec06e900 0x7fd9ec13ec10 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 >> 172.21.15.18:0/1090655944 conn(0x7fd9ec066fa0 msgr2=0x7fd9ec1596f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 shutdown_connections 2024-04-25T10:14:29.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:29.248+0000 7fd9f3000640 1 -- 172.21.15.18:0/1090655944 wait complete. 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:14:29.276 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:29.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.277 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:14:29.286 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:14:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:14:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:14:29.286 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41835sec preferred_lft 41835sec 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:29.287 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:14:29.288 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:29.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.289 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:14:29.347 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:29.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.349 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:14:29.406 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:14:29.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.407 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:14:29.407 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:14:29.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:14:29.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:14:29.408 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:14:29.408 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:14:29.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.504 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:14:29.513 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:14:29.513 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:14:29.513 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:29.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:14:29.577 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:29.577 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:29.629 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:29.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:29.630 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:29.680 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:14:29.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:29.774 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:29.774 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:29.789 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:29.790 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:29.790 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:14:29.790 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:14:29.790 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:14:29.793 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:14:29.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:29.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:29.815 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:14:29.880 INFO:teuthology.orchestra.run.smithi018.stdout:client8446 2024-04-25T10:14:29.881 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:29.881 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:29.929 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> parent = os.path.join(mount_point, "parent") 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> os.mkdir(parent) 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> flushed = os.path.join(parent, "flushed") 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> os.mkdir(flushed) 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T10:14:29.930 DEBUG:teuthology.orchestra.run.smithi018:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T10:14:29.931 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:30.063 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:14:30.120 INFO:teuthology.orchestra.run.smithi018.stdout:./ 2024-04-25T10:14:30.120 INFO:teuthology.orchestra.run.smithi018.stdout:./parent 2024-04-25T10:14:30.121 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed 2024-04-25T10:14:30.121 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/charlie 2024-04-25T10:14:30.121 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/alpha 2024-04-25T10:14:30.121 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/bravo 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:14:30.122 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.231 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:30.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:14:30.241 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.351 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:14:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.360 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.361 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.361 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.361 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.361 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:14:30.361 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.468 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:14:30.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:14:30.477 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.587 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627780 2024-04-25T10:14:30.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:14:30.596 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.703 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627778 2024-04-25T10:14:30.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.711 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:30.711 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:30.711 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:30.711 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:30.712 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T10:14:30.712 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:30.823 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627779 2024-04-25T10:14:30.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:30.833 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:30.833 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:30.886 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:30.886 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:30.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:31.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 Processor -- start 2024-04-25T10:14:31.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 -- start start 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 0x7fe7400b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7400b10e0 con 0x7fe74015b520 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe740099e00 con 0x7fe74015b140 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe744a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74009a0e0 con 0x7fe7400ce480 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe737e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe74015b520 0x7fe7400cdd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52420/0 (socket says 172.21.15.18:52420) 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe737e00640 1 -- 172.21.15.18:0/1734054641 learned_addr learned my addr 172.21.15.18:0/1734054641 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:31.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73f200640 1 --2- 172.21.15.18:0/1734054641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 0x7fe7400b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038702563 0 0) 0x7fe7400b10e0 con 0x7fe74015b520 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe724003530 con 0x7fe74015b520 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235244486 0 0) 0x7fe740099e00 con 0x7fe74015b140 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7400b10e0 con 0x7fe74015b140 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73f200640 1 -- 172.21.15.18:0/1734054641 >> v1:172.21.15.167:6789/0 conn(0x7fe74015b140 legacy=0x7fe74015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73f200640 1 -- 172.21.15.18:0/1734054641 >> v1:172.21.15.18:6789/0 conn(0x7fe74015b520 legacy=0x7fe7400cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.124+0000 7fe73f200640 1 -- 172.21.15.18:0/1734054641 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74009a3c0 con 0x7fe7400ce480 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe73f200640 1 --2- 172.21.15.18:0/1734054641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 0x7fe7400b17b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe738009dc0 tx=0x7fe73801c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f57ee94a68145cfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380b2070 con 0x7fe7400ce480 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7380a57b0 con 0x7fe7400ce480 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe73de00640 1 -- 172.21.15.18:0/1734054641 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380a5b80 con 0x7fe7400ce480 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 -- 172.21.15.18:0/1734054641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 msgr2=0x7fe7400b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 --2- 172.21.15.18:0/1734054641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 0x7fe7400b17b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe738009dc0 tx=0x7fe73801c8d0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 -- 172.21.15.18:0/1734054641 shutdown_connections 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 --2- 172.21.15.18:0/1734054641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7400ce480 0x7fe7400b17b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 -- 172.21.15.18:0/1734054641 >> 172.21.15.18:0/1734054641 conn(0x7fe7400d14f0 msgr2=0x7fe7400d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:31.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 -- 172.21.15.18:0/1734054641 shutdown_connections 2024-04-25T10:14:31.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.128+0000 7fe744a00640 1 -- 172.21.15.18:0/1734054641 wait complete. 2024-04-25T10:14:31.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 Processor -- start 2024-04-25T10:14:31.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- start start 2024-04-25T10:14:31.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 0x7fe74015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74015b140 0x7fe740150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74016b900 con 0x7fe74015b520 2024-04-25T10:14:31.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74016b780 con 0x7fe7400ce480 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74016ba80 con 0x7fe74015b140 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52242/0 (socket says 172.21.15.18:52242) 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 -- 172.21.15.18:0/2540399600 learned_addr learned my addr 172.21.15.18:0/2540399600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe737e00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74015b140 0x7fe740150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73e800640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 0x7fe74015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 -- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74015b140 msgr2=0x7fe740150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74015b140 0x7fe740150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 -- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 msgr2=0x7fe74015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 0x7fe74015aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 -- 172.21.15.18:0/2540399600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7401539d0 con 0x7fe74015b520 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73e800640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 0x7fe74015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe73f200640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe73801a500 tx=0x7fe738019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380bb020 con 0x7fe74015b520 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7400c5140 con 0x7fe74015b520 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7380ad660 con 0x7fe74015b520 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7380b2040 con 0x7fe74015b520 2024-04-25T10:14:31.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7400c5700 con 0x7fe74015b520 2024-04-25T10:14:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.132+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74004efa0 con 0x7fe74015b520 2024-04-25T10:14:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.136+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7380be020 con 0x7fe74015b520 2024-04-25T10:14:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.136+0000 7fe736a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 0x7fe71c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.136+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe73811fbc0 con 0x7fe74015b520 2024-04-25T10:14:31.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.136+0000 7fe73e800640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 0x7fe71c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.136+0000 7fe73e800640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 0x7fe71c069420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe7300011f0 tx=0x7fe730009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.140+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe738016580 con 0x7fe74015b520 2024-04-25T10:14:31.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7400c58d0 con 0x7fe74015b520 2024-04-25T10:14:31.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe736a00640 1 -- 172.21.15.18:0/2540399600 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fe7380f09b0 con 0x7fe74015b520 2024-04-25T10:14:31.311 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:31.311 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":123,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:19.391780+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 msgr2=0x7fe71c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 0x7fe71c069420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe7300011f0 tx=0x7fe730009040 comp rx=0 tx=0).stop 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 msgr2=0x7fe740154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fe73801a500 tx=0x7fe738019670 comp rx=0 tx=0).stop 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 shutdown_connections 2024-04-25T10:14:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe74015b520 0x7fe740154180 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe71c066f60 0x7fe71c069420 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74015b140 0x7fe740150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 --2- 172.21.15.18:0/2540399600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe7400ce480 0x7fe74015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 >> 172.21.15.18:0/2540399600 conn(0x7fe7400d14f0 msgr2=0x7fe7400afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 shutdown_connections 2024-04-25T10:14:31.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.304+0000 7fe744a00640 1 -- 172.21.15.18:0/2540399600 wait complete. 2024-04-25T10:14:31.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:14:16.207800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:14:16.774891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:31.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 Processor -- start 2024-04-25T10:14:31.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 -- start start 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2300ce690 0x7fd23015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2300cecb0 con 0x7fd23006e4b0 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23006e910 con 0x7fd2300ce690 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd238200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23006c5c0 con 0x7fd23015a7a0 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd236200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd2300ce690 0x7fd23015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd234e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7fd23006e4b0 0x7fd2300cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:42742/0 (socket says 172.21.15.18:42742) 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:37284/0 (socket says 172.21.15.18:37284) 2024-04-25T10:14:31.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd234e00640 1 -- 172.21.15.18:0/2037900347 learned_addr learned my addr 172.21.15.18:0/2037900347 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd22fe00640 1 -- 172.21.15.18:0/2037900347 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4063514712 0 0) 0x7fd2300cecb0 con 0x7fd23006e4b0 2024-04-25T10:14:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 -- 172.21.15.18:0/2037900347 >> v2:172.21.15.167:3300/0 conn(0x7fd2300ce690 msgr2=0x7fd23015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 --2- 172.21.15.18:0/2037900347 >> v2:172.21.15.167:3300/0 conn(0x7fd2300ce690 0x7fd23015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 -- 172.21.15.18:0/2037900347 >> v1:172.21.15.167:6789/0 conn(0x7fd23006e4b0 legacy=0x7fd2300cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.472+0000 7fd235800640 1 -- 172.21.15.18:0/2037900347 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300cef90 con 0x7fd23015a7a0 2024-04-25T10:14:31.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd235800640 1 --2- 172.21.15.18:0/2037900347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2240097c0 tx=0x7fd22401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769fd0ff9226ea47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd22fe00640 1 -- 172.21.15.18:0/2037900347 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240b0070 con 0x7fd23015a7a0 2024-04-25T10:14:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd22fe00640 1 -- 172.21.15.18:0/2037900347 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240ab600 con 0x7fd23015a7a0 2024-04-25T10:14:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd22fe00640 1 -- 172.21.15.18:0/2037900347 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2240ab9d0 con 0x7fd23015a7a0 2024-04-25T10:14:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 -- 172.21.15.18:0/2037900347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 msgr2=0x7fd23006df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 --2- 172.21.15.18:0/2037900347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd2240097c0 tx=0x7fd22401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 -- 172.21.15.18:0/2037900347 shutdown_connections 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 --2- 172.21.15.18:0/2037900347 >> v2:172.21.15.167:3300/0 conn(0x7fd2300ce690 0x7fd23015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 --2- 172.21.15.18:0/2037900347 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23015a7a0 0x7fd23006df70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 -- 172.21.15.18:0/2037900347 >> 172.21.15.18:0/2037900347 conn(0x7fd2300cfd90 msgr2=0x7fd2300d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 -- 172.21.15.18:0/2037900347 shutdown_connections 2024-04-25T10:14:31.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.476+0000 7fd238200640 1 -- 172.21.15.18:0/2037900347 wait complete. 2024-04-25T10:14:31.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 Processor -- start 2024-04-25T10:14:31.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- start start 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23006e4b0 0x7fd23014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23015a7a0 0x7fd2300afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23015ba50 con 0x7fd2300ce690 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23015b8d0 con 0x7fd23015a7a0 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23015bbd0 con 0x7fd23006e4b0 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52246/0 (socket says 172.21.15.18:52246) 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 -- 172.21.15.18:0/1637827974 learned_addr learned my addr 172.21.15.18:0/1637827974 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 -- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23006e4b0 msgr2=0x7fd23014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23006e4b0 0x7fd23014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 -- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23015a7a0 msgr2=0x7fd2300afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23015a7a0 0x7fd2300afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 -- 172.21.15.18:0/1637827974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd230163de0 con 0x7fd2300ce690 2024-04-25T10:14:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd234e00640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c480 tx=0x7fd21c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c0074e0 con 0x7fd2300ce690 2024-04-25T10:14:31.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd21c0047f0 con 0x7fd2300ce690 2024-04-25T10:14:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21c004be0 con 0x7fd2300ce690 2024-04-25T10:14:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2301640c0 con 0x7fd2300ce690 2024-04-25T10:14:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd230157680 con 0x7fd2300ce690 2024-04-25T10:14:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.480+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2300745d0 con 0x7fd2300ce690 2024-04-25T10:14:31.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.484+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd21c011070 con 0x7fd2300ce690 2024-04-25T10:14:31.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.484+0000 7fd22d600640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.484+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd21c084d50 con 0x7fd2300ce690 2024-04-25T10:14:31.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.484+0000 7fd235800640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.484+0000 7fd235800640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ad000 tx=0x7fd224008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.488+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd21c00e280 con 0x7fd2300ce690 2024-04-25T10:14:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.648+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd230155560 con 0x7fd2300ce690 2024-04-25T10:14:31.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.648+0000 7fd22d600640 1 -- 172.21.15.18:0/1637827974 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd21c055bc0 con 0x7fd2300ce690 2024-04-25T10:14:31.657 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 msgr2=0x7fd210069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd2240ad000 tx=0x7fd224008040 comp rx=0 tx=0).stop 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 msgr2=0x7fd230157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fd21c00c480 tx=0x7fd21c00c940 comp rx=0 tx=0).stop 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 shutdown_connections 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd23015a7a0 0x7fd2300afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2300ce690 0x7fd230157140 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd210066f90 0x7fd210069450 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 --2- 172.21.15.18:0/1637827974 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd23006e4b0 0x7fd23014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 >> 172.21.15.18:0/1637827974 conn(0x7fd2300cfd90 msgr2=0x7fd2300d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 shutdown_connections 2024-04-25T10:14:31.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.652+0000 7fd238200640 1 -- 172.21.15.18:0/1637827974 wait complete. 2024-04-25T10:14:31.677 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:14:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.812+0000 7f5d35400640 1 Processor -- start 2024-04-25T10:14:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.812+0000 7f5d35400640 1 -- start start 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d35400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5d301433e0 0x7f5d3006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d35400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d301437c0 con 0x7f5d3006d6b0 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d35400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300710e0 con 0x7f5d300b4460 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d35400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d300b48b0 con 0x7f5d301433e0 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d27400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5d3006d6b0 0x7f5d300b3d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32884/0 (socket says 172.21.15.18:32884) 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d27400640 1 -- 172.21.15.18:0/1794713546 learned_addr learned my addr 172.21.15.18:0/1794713546 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d2fe00640 1 --2- 172.21.15.18:0/1794713546 >> v2:172.21.15.18:3300/0 conn(0x7f5d301433e0 0x7f5d3006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d2f400640 1 -- 172.21.15.18:0/1794713546 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1634887432 0 0) 0x7f5d301437c0 con 0x7f5d3006d6b0 2024-04-25T10:14:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d2fe00640 1 -- 172.21.15.18:0/1794713546 >> v1:172.21.15.167:6789/0 conn(0x7f5d300b4460 legacy=0x7f5d300b25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d2fe00640 1 -- 172.21.15.18:0/1794713546 >> v1:172.21.15.18:6789/0 conn(0x7f5d3006d6b0 legacy=0x7f5d300b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.816+0000 7f5d2fe00640 1 -- 172.21.15.18:0/1794713546 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300713c0 con 0x7f5d301433e0 2024-04-25T10:14:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d2fe00640 1 --2- 172.21.15.18:0/1794713546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3006d170 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5d200097c0 tx=0x7f5d2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e3309bdf8c3a39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d2f400640 1 -- 172.21.15.18:0/1794713546 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200b1070 con 0x7f5d301433e0 2024-04-25T10:14:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d2f400640 1 -- 172.21.15.18:0/1794713546 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d200ac3f0 con 0x7f5d301433e0 2024-04-25T10:14:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d2f400640 1 -- 172.21.15.18:0/1794713546 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200ac7c0 con 0x7f5d301433e0 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- 172.21.15.18:0/1794713546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 msgr2=0x7f5d3006d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 --2- 172.21.15.18:0/1794713546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3006d170 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f5d200097c0 tx=0x7f5d2001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- 172.21.15.18:0/1794713546 shutdown_connections 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 --2- 172.21.15.18:0/1794713546 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3006d170 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- 172.21.15.18:0/1794713546 >> 172.21.15.18:0/1794713546 conn(0x7f5d30066fa0 msgr2=0x7f5d3006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- 172.21.15.18:0/1794713546 shutdown_connections 2024-04-25T10:14:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- 172.21.15.18:0/1794713546 wait complete. 2024-04-25T10:14:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 Processor -- start 2024-04-25T10:14:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 -- start start 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d3006d6b0 0x7f5d3013e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.820+0000 7f5d35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 0x7f5d3013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30072180 con 0x7f5d301433e0 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30168460 con 0x7f5d300b4460 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30165280 con 0x7f5d3006d6b0 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42658/0 (socket says 172.21.15.18:42658) 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 -- 172.21.15.18:0/537550325 learned_addr learned my addr 172.21.15.18:0/537550325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d27400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 0x7f5d3013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d2fe00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d3006d6b0 0x7f5d3013e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 -- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d3006d6b0 msgr2=0x7f5d3013e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d3006d6b0 0x7f5d3013e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 -- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 msgr2=0x7f5d3013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 0x7f5d3013ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 -- 172.21.15.18:0/537550325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3015a700 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d27400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 0x7f5d3013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d34a00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c770 tx=0x7f5d2800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28003b80 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28003d20 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3013efc0 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2800aa90 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d301f6870 con 0x7f5d301433e0 2024-04-25T10:14:31.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d300745d0 con 0x7f5d301433e0 2024-04-25T10:14:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.824+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5d2800ac30 con 0x7f5d301433e0 2024-04-25T10:14:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.828+0000 7f5d2cc00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 0x7f5d0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:31.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.828+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5d280851e0 con 0x7f5d301433e0 2024-04-25T10:14:31.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.828+0000 7f5d2fe00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 0x7f5d0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:31.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.828+0000 7f5d2fe00640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 0x7f5d0c069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d200ae000 tx=0x7f5d200a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:31.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.828+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5d28055fc0 con 0x7f5d301433e0 2024-04-25T10:14:31.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d3015e050 con 0x7f5d301433e0 2024-04-25T10:14:31.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d2cc00640 1 -- 172.21.15.18:0/537550325 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d280558c0 con 0x7f5d301433e0 2024-04-25T10:14:31.999 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:14:32.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 msgr2=0x7f5d0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 0x7f5d0c069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5d200ae000 tx=0x7f5d200a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 msgr2=0x7f5d3015bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c770 tx=0x7f5d2800cc30 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 shutdown_connections 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d301433e0 0x7f5d3015bd70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d300b4460 0x7f5d3013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5d0c066f60 0x7f5d0c069420 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 --2- 172.21.15.18:0/537550325 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5d3006d6b0 0x7f5d3013e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 >> 172.21.15.18:0/537550325 conn(0x7f5d30066fa0 msgr2=0x7f5d300cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 shutdown_connections 2024-04-25T10:14:32.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:31.992+0000 7f5d35400640 1 -- 172.21.15.18:0/537550325 wait complete. 2024-04-25T10:14:32.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:14:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.156+0000 7f4e93a00640 1 Processor -- start 2024-04-25T10:14:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.156+0000 7f4e93a00640 1 -- start start 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.156+0000 7f4e93a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.156+0000 7f4e93a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.156+0000 7f4e93a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8c15bc40 con 0x7f4e8c0ccbf0 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e93a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8c15e490 con 0x7f4e8c0b3090 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e93a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c15b3a0 con 0x7f4e8c144120 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42660/0 (socket says 172.21.15.18:42660) 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 -- 172.21.15.18:0/2322536388 learned_addr learned my addr 172.21.15.18:0/2322536388 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91000640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 -- 172.21.15.18:0/2322536388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 msgr2=0x7f4e8c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:32.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 -- 172.21.15.18:0/2322536388 >> v1:172.21.15.167:6789/0 conn(0x7f4e8c0ccbf0 legacy=0x7f4e8c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 -- 172.21.15.18:0/2322536388 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c15b680 con 0x7f4e8c0b3090 2024-04-25T10:14:32.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e91a00640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009e50 tx=0x7f4e8401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37fc30623be2d3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e8b400640 1 -- 172.21.15.18:0/2322536388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840a5670 con 0x7f4e8c0b3090 2024-04-25T10:14:32.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e8b400640 1 -- 172.21.15.18:0/2322536388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e840a5810 con 0x7f4e8c0b3090 2024-04-25T10:14:32.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.160+0000 7f4e8b400640 1 -- 172.21.15.18:0/2322536388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840a5be0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- 172.21.15.18:0/2322536388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 msgr2=0x7f4e8c0b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4e84009e50 tx=0x7f4e8401c9a0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- 172.21.15.18:0/2322536388 shutdown_connections 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c0b34f0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- 172.21.15.18:0/2322536388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- 172.21.15.18:0/2322536388 >> 172.21.15.18:0/2322536388 conn(0x7f4e8c067080 msgr2=0x7f4e8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- 172.21.15.18:0/2322536388 shutdown_connections 2024-04-25T10:14:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- 172.21.15.18:0/2322536388 wait complete. 2024-04-25T10:14:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 Processor -- start 2024-04-25T10:14:32.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- start start 2024-04-25T10:14:32.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 0x7f4e8c1596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c13c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c1675c0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c167440 con 0x7f4e8c0ccbf0 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e93a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c167740 con 0x7f4e8c144120 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42668/0 (socket says 172.21.15.18:42668) 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 -- 172.21.15.18:0/495632291 learned_addr learned my addr 172.21.15.18:0/495632291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e8be00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 0x7f4e8c1596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c13c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 -- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 msgr2=0x7f4e8c13c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c13c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 -- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 msgr2=0x7f4e8c1596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 0x7f4e8c1596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 -- 172.21.15.18:0/495632291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c13a420 con 0x7f4e8c0b3090 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e8be00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 0x7f4e8c1596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.164+0000 7f4e91000640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000e8a0 tx=0x7f4e8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80017070 con 0x7f4e8c0b3090 2024-04-25T10:14:32.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8000c940 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8000ccf0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c13a700 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c13acc0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c0745d0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e8001a070 con 0x7f4e8c0b3090 2024-04-25T10:14:32.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 0x7f4e6c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4e800853e0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.168+0000 7f4e8be00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 0x7f4e6c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.172+0000 7f4e8be00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 0x7f4e6c069450 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c1367e0 tx=0x7f4e78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.172+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4e80055b70 con 0x7f4e8c0b3090 2024-04-25T10:14:32.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4e8c15eac0 con 0x7f4e8c0b3090 2024-04-25T10:14:32.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e88c00640 1 -- 172.21.15.18:0/495632291 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4e80059c10 con 0x7f4e8c0b3090 2024-04-25T10:14:32.342 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 msgr2=0x7f4e6c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 0x7f4e6c069450 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c1367e0 tx=0x7f4e78009040 comp rx=0 tx=0).stop 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 msgr2=0x7f4e8c13f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000e8a0 tx=0x7f4e8000eca0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 shutdown_connections 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4e6c066f90 0x7f4e6c069450 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4e8c144120 0x7f4e8c13c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e8c0ccbf0 0x7f4e8c1596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 --2- 172.21.15.18:0/495632291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e8c0b3090 0x7f4e8c13f410 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 >> 172.21.15.18:0/495632291 conn(0x7f4e8c067080 msgr2=0x7f4e8c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 shutdown_connections 2024-04-25T10:14:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.336+0000 7f4e93a00640 1 -- 172.21.15.18:0/495632291 wait complete. 2024-04-25T10:14:32.363 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:14:32.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.496+0000 7f01ab000640 1 Processor -- start 2024-04-25T10:14:32.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01ab000640 1 -- start start 2024-04-25T10:14:32.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01ab000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 0x7f01a40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01ab000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40b30d0 con 0x7f01a415dc00 2024-04-25T10:14:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01ab000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a40ccf30 con 0x7f01a40d0150 2024-04-25T10:14:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01ab000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40cd860 con 0x7f01a40c72a0 2024-04-25T10:14:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f01a415dc00 0x7f01a40c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32894/0 (socket says 172.21.15.18:32894) 2024-04-25T10:14:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3e00640 1 -- 172.21.15.18:0/1702785761 learned_addr learned my addr 172.21.15.18:0/1702785761 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a9000640 1 --2- 172.21.15.18:0/1702785761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 0x7f01a40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672986292 0 0) 0x7f01a40b30d0 con 0x7f01a415dc00 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0188003530 con 0x7f01a415dc00 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411197038 0 0) 0x7f01a40ccf30 con 0x7f01a40d0150 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a40b30d0 con 0x7f01a40d0150 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385363377 0 0) 0x7f0188003530 con 0x7f01a415dc00 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a9000640 1 -- 172.21.15.18:0/1702785761 >> v1:172.21.15.167:6789/0 conn(0x7f01a40d0150 legacy=0x7f01a40c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a9000640 1 -- 172.21.15.18:0/1702785761 >> v1:172.21.15.18:6789/0 conn(0x7f01a415dc00 legacy=0x7f01a40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.500+0000 7f01a9000640 1 -- 172.21.15.18:0/1702785761 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40cd210 con 0x7f01a40c72a0 2024-04-25T10:14:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01a9000640 1 --2- 172.21.15.18:0/1702785761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 0x7f01a40af770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f019c009dc0 tx=0x7f019c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d740ee0e755268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0b2070 con 0x7f01a40c72a0 2024-04-25T10:14:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c0a5600 con 0x7f01a40c72a0 2024-04-25T10:14:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01a3400640 1 -- 172.21.15.18:0/1702785761 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194001680 con 0x7f01a40c72a0 2024-04-25T10:14:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- 172.21.15.18:0/1702785761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 msgr2=0x7f01a40af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 --2- 172.21.15.18:0/1702785761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 0x7f01a40af770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f019c009dc0 tx=0x7f019c01c8b0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- 172.21.15.18:0/1702785761 shutdown_connections 2024-04-25T10:14:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 --2- 172.21.15.18:0/1702785761 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40c72a0 0x7f01a40af770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- 172.21.15.18:0/1702785761 >> 172.21.15.18:0/1702785761 conn(0x7f01a40b2240 msgr2=0x7f01a40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- 172.21.15.18:0/1702785761 shutdown_connections 2024-04-25T10:14:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- 172.21.15.18:0/1702785761 wait complete. 2024-04-25T10:14:32.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 Processor -- start 2024-04-25T10:14:32.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.504+0000 7f01ab000640 1 -- start start 2024-04-25T10:14:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40d0150 0x7f01a409bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a415dc00 0x7f01a409c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a416b650 con 0x7f01a40c72a0 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40cdf00 con 0x7f01a415dc00 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a416b7d0 con 0x7f01a40d0150 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42674/0 (socket says 172.21.15.18:42674) 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 -- 172.21.15.18:0/77068703 learned_addr learned my addr 172.21.15.18:0/77068703 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f019b400640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40d0150 0x7f01a409bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a9000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a415dc00 0x7f01a409c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 -- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40d0150 msgr2=0x7f01a409bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40d0150 0x7f01a409bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 -- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a415dc00 msgr2=0x7f01a409c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a415dc00 0x7f01a409c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 -- 172.21.15.18:0/77068703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40ae320 con 0x7f01a40c72a0 2024-04-25T10:14:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a3e00640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f019400c730 tx=0x7f019400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194017070 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0194005b00 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a409e340 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0194007070 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a409e620 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.508+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a406ccb0 con 0x7f01a40c72a0 2024-04-25T10:14:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.512+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f019401a070 con 0x7f01a40c72a0 2024-04-25T10:14:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.512+0000 7f01a0c00640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 0x7f0180069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.512+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f01940847c0 con 0x7f01a40c72a0 2024-04-25T10:14:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.512+0000 7f019b400640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 0x7f0180069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.512+0000 7f019b400640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 0x7f0180069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f01a415fb20 tx=0x7f018c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.516+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f01940555a0 con 0x7f01a40c72a0 2024-04-25T10:14:32.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f01a40745d0 con 0x7f01a40c72a0 2024-04-25T10:14:32.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01a0c00640 1 -- 172.21.15.18:0/77068703 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0194054ea0 con 0x7f01a40c72a0 2024-04-25T10:14:32.699 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 msgr2=0x7f0180069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 0x7f0180069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f01a415fb20 tx=0x7f018c009040 comp rx=0 tx=0).stop 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 msgr2=0x7f01a41521b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f019400c730 tx=0x7f019400cbf0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 shutdown_connections 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f01a415dc00 0x7f01a409c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0180066f60 0x7f0180069420 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f01a40d0150 0x7f01a409bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 --2- 172.21.15.18:0/77068703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01a40c72a0 0x7f01a41521b0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 >> 172.21.15.18:0/77068703 conn(0x7f01a40b2240 msgr2=0x7f01a40ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 shutdown_connections 2024-04-25T10:14:32.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.692+0000 7f01ab000640 1 -- 172.21.15.18:0/77068703 wait complete. 2024-04-25T10:14:32.720 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:14:32.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:32.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:32.779 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:14:32.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:32.779 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:14:32.796 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T10:14:32.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T10:14:32.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 Processor -- start 2024-04-25T10:14:32.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 -- start start 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe05c144120 0x7fe05c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 0x7fe05c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05c15bc40 con 0x7fe05c15ee60 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c15e490 con 0x7fe05c144120 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe064800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05c15b3a0 con 0x7fe05c0ccbf0 2024-04-25T10:14:32.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe05c144120 0x7fe05c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe062800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe05c15ee60 0x7fe05c0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32900/0 (socket says 172.21.15.18:32900) 2024-04-25T10:14:32.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe062800640 1 -- 172.21.15.18:0/1384540840 learned_addr learned my addr 172.21.15.18:0/1384540840 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061e00640 1 -- 172.21.15.18:0/1384540840 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 msgr2=0x7fe05c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061400640 1 --2- 172.21.15.18:0/1384540840 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 0x7fe05c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe060a00640 1 -- 172.21.15.18:0/1384540840 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781924434 0 0) 0x7fe05c15bc40 con 0x7fe05c15ee60 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061e00640 1 --2- 172.21.15.18:0/1384540840 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 0x7fe05c15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061e00640 1 -- 172.21.15.18:0/1384540840 >> v1:172.21.15.18:6789/0 conn(0x7fe05c15ee60 legacy=0x7fe05c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061e00640 1 -- 172.21.15.18:0/1384540840 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c15b680 con 0x7fe05c144120 2024-04-25T10:14:32.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.972+0000 7fe061400640 1 --2- 172.21.15.18:0/1384540840 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 0x7fe05c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:32.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe061e00640 1 --2- 172.21.15.18:0/1384540840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c15acd0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe05c06b870 tx=0x7fe05001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccdeb2d12e05dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe060a00640 1 -- 172.21.15.18:0/1384540840 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500b0070 con 0x7fe05c144120 2024-04-25T10:14:32.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe060a00640 1 -- 172.21.15.18:0/1384540840 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500ab600 con 0x7fe05c144120 2024-04-25T10:14:32.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe060a00640 1 -- 172.21.15.18:0/1384540840 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500ab9d0 con 0x7fe05c144120 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 -- 172.21.15.18:0/1384540840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 msgr2=0x7fe05c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 --2- 172.21.15.18:0/1384540840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c15acd0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe05c06b870 tx=0x7fe05001c3f0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 -- 172.21.15.18:0/1384540840 shutdown_connections 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 --2- 172.21.15.18:0/1384540840 >> v2:172.21.15.167:3300/0 conn(0x7fe05c0ccbf0 0x7fe05c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 --2- 172.21.15.18:0/1384540840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c15acd0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 -- 172.21.15.18:0/1384540840 >> 172.21.15.18:0/1384540840 conn(0x7fe05c067080 msgr2=0x7fe05c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 -- 172.21.15.18:0/1384540840 shutdown_connections 2024-04-25T10:14:32.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.976+0000 7fe064800640 1 -- 172.21.15.18:0/1384540840 wait complete. 2024-04-25T10:14:32.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 Processor -- start 2024-04-25T10:14:32.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- start start 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 0x7fe05c1f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c15ee60 0x7fe05c0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1675c0 con 0x7fe05c144120 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c167440 con 0x7fe05c15ee60 2024-04-25T10:14:32.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c167740 con 0x7fe05c0ccbf0 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42696/0 (socket says 172.21.15.18:42696) 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 -- 172.21.15.18:0/4175414152 learned_addr learned my addr 172.21.15.18:0/4175414152 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061e00640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 0x7fe05c1f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe062800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c15ee60 0x7fe05c0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 -- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 msgr2=0x7fe05c1f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 0x7fe05c1f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 -- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c15ee60 msgr2=0x7fe05c0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c15ee60 0x7fe05c0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 -- 172.21.15.18:0/4175414152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05c1f7430 con 0x7fe05c144120 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061e00640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 0x7fe05c1f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:32.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe061400640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00c7f0 tx=0x7fe04c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe056000640 1 -- 172.21.15.18:0/4175414152 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0079d0 con 0x7fe05c144120 2024-04-25T10:14:32.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe056000640 1 -- 172.21.15.18:0/4175414152 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c007b70 con 0x7fe05c144120 2024-04-25T10:14:32.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe056000640 1 -- 172.21.15.18:0/4175414152 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0113f0 con 0x7fe05c144120 2024-04-25T10:14:32.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05c1f7150 con 0x7fe05c144120 2024-04-25T10:14:32.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.980+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05c0af500 con 0x7fe05c144120 2024-04-25T10:14:32.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe056000640 1 -- 172.21.15.18:0/4175414152 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe04c011590 con 0x7fe05c144120 2024-04-25T10:14:32.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe056000640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 0x7fe040069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe056000640 1 -- 172.21.15.18:0/4175414152 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe04c085350 con 0x7fe05c144120 2024-04-25T10:14:32.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe067c63000 1 Processor -- start 2024-04-25T10:14:32.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe067c63000 1 -- start start 2024-04-25T10:14:32.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.984+0000 7fe061e00640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 0x7fe040069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53521db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d534d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d53324ff0 con 0x562d535222f0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d532ad150 con 0x562d534d80a0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d53321090 con 0x562d535219d0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061e00640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 0x7fe040069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ad000 tx=0x7fe0500a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42710/0 (socket says 172.21.15.18:42710) 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 -- 172.21.15.18:0/3691227174 learned_addr learned my addr 172.21.15.18:0/3691227174 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe062800640 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d534d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061e00640 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53521db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 -- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 msgr2=0x562d53521db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53521db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 -- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 msgr2=0x562d534d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:32.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d534d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 -- 172.21.15.18:0/3691227174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d534bb0d0 con 0x562d535222f0 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe061400640 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00afd0 tx=0x7fe04c055ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ce131f3f5e24e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe04aa00640 1 -- 172.21.15.18:0/3691227174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c01e070 con 0x562d535222f0 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe04aa00640 1 -- 172.21.15.18:0/3691227174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c05e1e0 con 0x562d535222f0 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe04aa00640 1 -- 172.21.15.18:0/3691227174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c053dd0 con 0x562d535222f0 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- 172.21.15.18:0/3691227174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 msgr2=0x562d534d7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00afd0 tx=0x7fe04c055ad0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- 172.21.15.18:0/3691227174 shutdown_connections 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d534d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d534d7b60 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 --2- 172.21.15.18:0/3691227174 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53521db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- 172.21.15.18:0/3691227174 >> 172.21.15.18:0/3691227174 conn(0x562d534d4020 msgr2=0x562d534d6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- 172.21.15.18:0/3691227174 shutdown_connections 2024-04-25T10:14:32.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- 172.21.15.18:0/3691227174 wait complete. 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 -- start start 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.988+0000 7fe067c63000 1 Processor -- start 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d535067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53506d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d532e9250 con 0x562d535222f0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d532df690 con 0x562d534d80a0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d532ada40 con 0x562d535219d0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 10 client.0 _ll_register_callbacks cb 0x562d534c2e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d535067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d535067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:50060/0 (socket says 172.21.15.18:50060) 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061e00640 1 -- 172.21.15.18:0/346174165 learned_addr learned my addr 172.21.15.18:0/346174165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42716/0 (socket says 172.21.15.18:42716) 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061400640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53506d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 -- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 msgr2=0x562d53506d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53506d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 -- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 msgr2=0x562d535067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d535067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 -- 172.21.15.18:0/346174165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d533d21c0 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe062800640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f90 tx=0x7fe058007b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f507a3fbbfe93d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058014400 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe0580145a0 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe04c05e1e0 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe058021050 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 10 client.9249 fetch_fsmap learned FSMap version 101 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x562d533ce170 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c05e1e0 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe058024020 con 0x562d535222f0 2024-04-25T10:14:33.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 10 client.9249 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 10 client.9249 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 20 client.9249 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53531c80 0x562d53534070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 4 client.9249 mds_command: new command op to 37337 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 --> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d532c0c60 con 0x562d53531c80 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061e00640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53531c80 0x562d53534070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe061e00640 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53531c80 0x562d53534070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b1ea0a3e310b5a7 server_cookie=cdd2f50c72639eba in_seq=0 out_seq=0 2024-04-25T10:14:33.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.992+0000 7fe03f400640 10 client.9249 ms_handle_connect on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:33.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe03f400640 1 -- 172.21.15.18:0/346174165 <== mds.0 v2:172.21.15.167:6835/2651841863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562d532c0c60 con 0x562d53531c80 2024-04-25T10:14:33.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe03f400640 10 client.9249 handle_command_reply: tid=0 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 client.9249 shutdown 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 msgr2=0x562d53507270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fe058000f90 tx=0x7fe058007b70 comp rx=0 tx=0).stop 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 shutdown_connections 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53531c80 0x562d53534070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d53507270 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53506d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 --2- 172.21.15.18:0/346174165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d535067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 >> 172.21.15.18:0/346174165 conn(0x562d534d4020 msgr2=0x562d534d6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe03f400640 0 client.9249 ms_handle_reset on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 shutdown_connections 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 1 -- 172.21.15.18:0/346174165 wait complete. 2024-04-25T10:14:33.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:32.996+0000 7fe067c63000 20 client.9249 trim_cache size 0 max 16384 2024-04-25T10:14:33.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 Processor -- start 2024-04-25T10:14:33.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 -- start start 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d534d6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d535222f0 0x562d534d6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c203350 con 0x562d534d80a0 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1fa1f0 con 0x562d535222f0 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c0b07e0 con 0x562d535219d0 2024-04-25T10:14:33.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42732/0 (socket says 172.21.15.18:42732) 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 -- 172.21.15.18:0/410565253 learned_addr learned my addr 172.21.15.18:0/410565253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 -- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 msgr2=0x562d534d6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d534d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 -- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d535222f0 msgr2=0x562d534d6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d535222f0 0x562d534d6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.008+0000 7fe061e00640 1 -- 172.21.15.18:0/410565253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d5336bde0 con 0x562d534d80a0 2024-04-25T10:14:33.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe061e00640 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae040 tx=0x7fe050004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8fada1c765898f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe04a000640 1 -- 172.21.15.18:0/410565253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500d3070 con 0x562d534d80a0 2024-04-25T10:14:33.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe04a000640 1 -- 172.21.15.18:0/410565253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500abb40 con 0x562d534d80a0 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe04a000640 1 -- 172.21.15.18:0/410565253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500b0040 con 0x562d534d80a0 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- 172.21.15.18:0/410565253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 msgr2=0x562d534d6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae040 tx=0x7fe050004740 comp rx=0 tx=0).stop 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- 172.21.15.18:0/410565253 shutdown_connections 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d535222f0 0x562d534d6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d534d6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- 172.21.15.18:0/410565253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d534d80a0 0x562d534d6410 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- 172.21.15.18:0/410565253 >> 172.21.15.18:0/410565253 conn(0x562d534d4020 msgr2=0x562d5352e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- 172.21.15.18:0/410565253 shutdown_connections 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- 172.21.15.18:0/410565253 wait complete. 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- start start 2024-04-25T10:14:33.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 Processor -- start 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d53581720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53581c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d532bfe00 con 0x562d535222f0 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05c1f9bf0 con 0x562d534d80a0 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d53324300 con 0x562d535219d0 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe067c63000 10 client.0 _ll_register_callbacks cb 0x562d534a3040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42734/0 (socket says 172.21.15.18:42734) 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 -- 172.21.15.18:0/2069082865 learned_addr learned my addr 172.21.15.18:0/2069082865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:33.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe061400640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53581c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe061e00640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d53581720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 -- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 msgr2=0x562d53581c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53581c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 -- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 msgr2=0x562d53581720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d53581720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 -- 172.21.15.18:0/2069082865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d532c68e0 con 0x562d535222f0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe061e00640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d53581720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe062800640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe058005ea0 tx=0x7fe058007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ba636a88c083d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.012+0000 7fe03f400640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe058001cd0 con 0x562d535222f0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe05802e440 con 0x562d535222f0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0500abb40 con 0x562d535222f0 2024-04-25T10:14:33.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe058036050 con 0x562d535222f0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 10 client.9255 fetch_fsmap learned FSMap version 101 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) v3 -- 0x562d5337e8f0 con 0x562d535222f0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500abb40 con 0x562d535222f0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 101) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe058039020 con 0x562d535222f0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 10 client.9255 fetch_fsmap finished waiting for FSMap version 101 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 10 client.9255 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 20 client.9255 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53534480 0x562d53534890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 4 client.9255 mds_command: new command op to 37337 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 --> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562d53332530 con 0x562d53534480 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe061e00640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53534480 0x562d53534890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe061e00640 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53534480 0x562d53534890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77fa807bde62843 server_cookie=8f818f29c7b83ee3 in_seq=0 out_seq=0 2024-04-25T10:14:33.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.016+0000 7fe03f400640 10 client.9255 ms_handle_connect on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.024+0000 7fe03f400640 1 -- 172.21.15.18:0/2069082865 <== mds.0 v2:172.21.15.167:6835/2651841863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562d53332530 con 0x562d53534480 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.024+0000 7fe03f400640 10 client.9255 handle_command_reply: tid=0 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.024+0000 7fe067c63000 1 client.9255 shutdown 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.024+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 msgr2=0x562d535336d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.024+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe058005ea0 tx=0x7fe058007ed0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 shutdown_connections 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:6835/2651841863,v1:172.21.15.167:6837/2651841863] conn(0x562d53534480 0x562d53534890 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562d535222f0 0x562d535336d0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x562d535219d0 0x562d53581c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe03f400640 0 client.9255 ms_handle_reset on v2:172.21.15.167:6835/2651841863 2024-04-25T10:14:33.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 --2- 172.21.15.18:0/2069082865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562d534d80a0 0x562d53581720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 >> 172.21.15.18:0/2069082865 conn(0x562d534d4020 msgr2=0x562d5352efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 shutdown_connections 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 1 -- 172.21.15.18:0/2069082865 wait complete. 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe067c63000 20 client.9255 trim_cache size 0 max 16384 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "message": "", 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0 2024-04-25T10:14:33.035 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 msgr2=0x7fe040069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 0x7fe040069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ad000 tx=0x7fe0500a4f90 comp rx=0 tx=0).stop 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 msgr2=0x7fe05c0ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00c7f0 tx=0x7fe04c00ccb0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 shutdown_connections 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c15ee60 0x7fe05c0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c144120 0x7fe05c0ada90 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe040066f60 0x7fe040069420 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 --2- 172.21.15.18:0/4175414152 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe05c0ccbf0 0x7fe05c1f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 >> 172.21.15.18:0/4175414152 conn(0x7fe05c067080 msgr2=0x7fe05c1647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 shutdown_connections 2024-04-25T10:14:33.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.028+0000 7fe064800640 1 -- 172.21.15.18:0/4175414152 wait complete. 2024-04-25T10:14:33.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:14:33.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.184+0000 7f4524600640 1 Processor -- start 2024-04-25T10:14:33.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.184+0000 7f4524600640 1 -- start start 2024-04-25T10:14:33.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4524600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f451c15e550 0x7f451c15e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4524600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c06d090 con 0x7f451c070fe0 2024-04-25T10:14:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4524600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f451c071ad0 con 0x7f451c161510 2024-04-25T10:14:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4524600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f451c162390 con 0x7f451c15e550 2024-04-25T10:14:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4521c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f451c070fe0 0x7f451c0713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32908/0 (socket says 172.21.15.18:32908) 2024-04-25T10:14:33.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4521c00640 1 -- 172.21.15.18:0/3541391140 learned_addr learned my addr 172.21.15.18:0/3541391140 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 --2- 172.21.15.18:0/3541391140 >> v2:172.21.15.167:3300/0 conn(0x7f451c15e550 0x7f451c15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426739545 0 0) 0x7f4510001120 con 0x7f451c070fe0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4504003530 con 0x7f451c070fe0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 457140009 0 0) 0x7f4504003530 con 0x7f451c070fe0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 >> v2:172.21.15.167:3300/0 conn(0x7f451c15e550 msgr2=0x7f451c15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 --2- 172.21.15.18:0/3541391140 >> v2:172.21.15.167:3300/0 conn(0x7f451c15e550 0x7f451c15e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 >> v1:172.21.15.167:6789/0 conn(0x7f451c161510 legacy=0x7f451c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c161af0 con 0x7f451c070fe0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f4510001850 con 0x7f451c070fe0 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 >> v1:172.21.15.18:6789/0 conn(0x7f451c070fe0 legacy=0x7f451c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040039c0 0x7f4504003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4504004810 0x7f4504004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 0x7f450400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c162390 con 0x7f45040051d0 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450400c070 con 0x7f45040039c0 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f450400c270 con 0x7f4504004810 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 0x7f450400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4521c00640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040039c0 0x7f4504003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4521200640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4504004810 0x7f4504004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 -- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4504004810 msgr2=0x7f4504004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4504004810 0x7f4504004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 -- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040039c0 msgr2=0x7f4504003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040039c0 0x7f4504003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.188+0000 7f4522600640 1 -- 172.21.15.18:0/3541391140 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504003530 con 0x7f45040051d0 2024-04-25T10:14:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4522600640 1 -- 172.21.15.18:0/3541391140 reap_dead start 2024-04-25T10:14:33.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4522600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 0x7f450400b9d0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f4514009fc0 tx=0x7f451401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c822096f44b619a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514009c10 con 0x7f45040051d0 2024-04-25T10:14:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45140a5d10 con 0x7f45040051d0 2024-04-25T10:14:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f451be00640 1 -- 172.21.15.18:0/3541391140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4514003be0 con 0x7f45040051d0 2024-04-25T10:14:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 -- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 msgr2=0x7f450400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 0x7f450400b9d0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f4514009fc0 tx=0x7f451401ccc0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 -- 172.21.15.18:0/3541391140 shutdown_connections 2024-04-25T10:14:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 --2- 172.21.15.18:0/3541391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040051d0 0x7f450400b9d0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 -- 172.21.15.18:0/3541391140 >> 172.21.15.18:0/3541391140 conn(0x7f451c0b3390 msgr2=0x7f451c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 -- 172.21.15.18:0/3541391140 shutdown_connections 2024-04-25T10:14:33.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.192+0000 7f4524600640 1 -- 172.21.15.18:0/3541391140 wait complete. 2024-04-25T10:14:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 Processor -- start 2024-04-25T10:14:33.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- start start 2024-04-25T10:14:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040051d0 0x7f451c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f451c1f3f90 0x7f451c0b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c15e030 con 0x7f451c1f3b10 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1620b0 con 0x7f45040051d0 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451c15e980 con 0x7f451c1f3f90 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42754/0 (socket says 172.21.15.18:42754) 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 -- 172.21.15.18:0/2344021486 learned_addr learned my addr 172.21.15.18:0/2344021486 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521c00640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040051d0 0x7f451c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4522600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f451c1f3f90 0x7f451c0b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 -- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f451c1f3f90 msgr2=0x7f451c0b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f451c1f3f90 0x7f451c0b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 -- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040051d0 msgr2=0x7f451c13f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040051d0 0x7f451c13f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 -- 172.21.15.18:0/2344021486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c1424e0 con 0x7f451c1f3b10 2024-04-25T10:14:33.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4521200640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f450800f5f0 tx=0x7f450800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45080052e0 con 0x7f451c1f3b10 2024-04-25T10:14:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4508018070 con 0x7f451c1f3b10 2024-04-25T10:14:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451c1427c0 con 0x7f451c1f3b10 2024-04-25T10:14:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508003820 con 0x7f451c1f3b10 2024-04-25T10:14:33.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c142d80 con 0x7f451c1f3b10 2024-04-25T10:14:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.196+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451c0745d0 con 0x7f451c1f3b10 2024-04-25T10:14:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.200+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45080039c0 con 0x7f451c1f3b10 2024-04-25T10:14:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.200+0000 7f4519600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 0x7f44fc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.200+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4508085040 con 0x7f451c1f3b10 2024-04-25T10:14:33.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.200+0000 7f4521c00640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 0x7f44fc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:33.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.200+0000 7f4521c00640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 0x7f44fc069450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4510001060 tx=0x7f4510009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:33.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.204+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4508055e20 con 0x7f451c1f3b10 2024-04-25T10:14:33.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f451c154750 con 0x7f451c1f3b10 2024-04-25T10:14:33.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4519600640 1 -- 172.21.15.18:0/2344021486 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4508005480 con 0x7f451c1f3b10 2024-04-25T10:14:33.410 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:14:33.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 msgr2=0x7f44fc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 0x7f44fc069450 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4510001060 tx=0x7f4510009040 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 msgr2=0x7f451c0b5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f450800f5f0 tx=0x7f450800fab0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 shutdown_connections 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f44fc066f90 0x7f44fc069450 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f451c1f3f90 0x7f451c0b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f451c1f3b10 0x7f451c0b5f80 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 --2- 172.21.15.18:0/2344021486 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45040051d0 0x7f451c13f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 >> 172.21.15.18:0/2344021486 conn(0x7f451c0b3390 msgr2=0x7f451c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 shutdown_connections 2024-04-25T10:14:33.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:33.404+0000 7f4524600640 1 -- 172.21.15.18:0/2344021486 wait complete. 2024-04-25T10:14:33.431 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:14:33.431 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:14:33.431 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:14:33.431 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:14:33.432 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:33.432 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:14:33.432 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:14:33.432 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:14:33.432 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:33.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.432 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:14:33.441 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41831sec preferred_lft 41831sec 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:33.442 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:14:33.443 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.444 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:33.444 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:14:33.444 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:14:33.444 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:33.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.445 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:14:33.507 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:33.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.510 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:14:33.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:14:33.564 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:14:33.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.659 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:14:33.668 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:14:33.669 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:14:33.669 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:33.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:14:33.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:33.729 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:33.781 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:33.781 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:33.781 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:33.832 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:14:33.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:33.922 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:33.922 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:33.935 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:33.936 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:33.936 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:14:33.936 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:14:33.936 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:14:33.940 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:14:33.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.940 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:33.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:33.960 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:14:34.017 INFO:teuthology.orchestra.run.smithi018.stdout:client8500 2024-04-25T10:14:34.017 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:34.017 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:34.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:34.070 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T10:14:34.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:34.127 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T10:14:34.226 INFO:teuthology.orchestra.run.smithi018.stderr:8+0 records in 2024-04-25T10:14:34.226 INFO:teuthology.orchestra.run.smithi018.stderr:8+0 records out 2024-04-25T10:14:34.226 INFO:teuthology.orchestra.run.smithi018.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0463139 s, 181 MB/s 2024-04-25T10:14:34.227 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:34.227 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:34.228 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:34.228 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:34.228 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:14:34.228 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:34.294 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627781 2024-04-25T10:14:34.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:34.303 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:34.303 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:34.304 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:34.304 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:34.304 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:14:34.304 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:34.412 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627782 2024-04-25T10:14:34.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:34.422 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:34.422 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:34.474 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:34.474 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:34.529 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:34.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 Processor -- start 2024-04-25T10:14:34.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 -- start start 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faa6015b2f0 0x7faa600b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 0x7faa600b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015def0 con 0x7faa600b2dc0 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6015e1b0 con 0x7faa6015b2f0 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa67c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6015e490 con 0x7faa6006dad0 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa5fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa600b2dc0 0x7faa6006dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32914/0 (socket says 172.21.15.18:32914) 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa5fe00640 1 -- 172.21.15.18:0/3695189845 learned_addr learned my addr 172.21.15.18:0/3695189845 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:34.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa65c00640 1 --2- 172.21.15.18:0/3695189845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 0x7faa600b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.712+0000 7faa65200640 1 --2- 172.21.15.18:0/3695189845 >> v2:172.21.15.167:3300/0 conn(0x7faa6015b2f0 0x7faa600b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa5f400640 1 -- 172.21.15.18:0/3695189845 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762705592 0 0) 0x7faa6015def0 con 0x7faa600b2dc0 2024-04-25T10:14:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa5f400640 1 -- 172.21.15.18:0/3695189845 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa48003530 con 0x7faa600b2dc0 2024-04-25T10:14:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa65c00640 1 -- 172.21.15.18:0/3695189845 >> v2:172.21.15.167:3300/0 conn(0x7faa6015b2f0 msgr2=0x7faa600b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:34.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa65c00640 1 --2- 172.21.15.18:0/3695189845 >> v2:172.21.15.167:3300/0 conn(0x7faa6015b2f0 0x7faa600b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa65c00640 1 -- 172.21.15.18:0/3695189845 >> v1:172.21.15.18:6789/0 conn(0x7faa600b2dc0 legacy=0x7faa6006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa65c00640 1 -- 172.21.15.18:0/3695189845 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6015e770 con 0x7faa6006dad0 2024-04-25T10:14:34.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa65c00640 1 --2- 172.21.15.18:0/3695189845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 0x7faa600b3780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa58009d90 tx=0x7faa5801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f87bd2f0b0c01daf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa5f400640 1 -- 172.21.15.18:0/3695189845 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580b2070 con 0x7faa6006dad0 2024-04-25T10:14:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa5f400640 1 -- 172.21.15.18:0/3695189845 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580a5a20 con 0x7faa6006dad0 2024-04-25T10:14:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.716+0000 7faa5f400640 1 -- 172.21.15.18:0/3695189845 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6015b8e0 con 0x7faa6006dad0 2024-04-25T10:14:34.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- 172.21.15.18:0/3695189845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 msgr2=0x7faa600b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- 172.21.15.18:0/3695189845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 0x7faa600b3780 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa58009d90 tx=0x7faa5801c940 comp rx=0 tx=0).stop 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- 172.21.15.18:0/3695189845 shutdown_connections 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- 172.21.15.18:0/3695189845 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa6006dad0 0x7faa600b3780 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- 172.21.15.18:0/3695189845 >> v2:172.21.15.167:3300/0 conn(0x7faa6015b2f0 0x7faa600b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- 172.21.15.18:0/3695189845 >> 172.21.15.18:0/3695189845 conn(0x7faa600b23b0 msgr2=0x7faa600cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- 172.21.15.18:0/3695189845 shutdown_connections 2024-04-25T10:14:34.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- 172.21.15.18:0/3695189845 wait complete. 2024-04-25T10:14:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 Processor -- start 2024-04-25T10:14:34.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- start start 2024-04-25T10:14:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa6006dad0 0x7faa60155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa600b2dc0 0x7faa600ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6016a880 con 0x7faa6015b2f0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60161730 con 0x7faa6006dad0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa67c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6016aa00 con 0x7faa600b2dc0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42764/0 (socket says 172.21.15.18:42764) 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 -- 172.21.15.18:0/672924183 learned_addr learned my addr 172.21.15.18:0/672924183 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65200640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa6006dad0 0x7faa60155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa5fe00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa600b2dc0 0x7faa600ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 -- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa600b2dc0 msgr2=0x7faa600ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa600b2dc0 0x7faa600ce950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 -- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa6006dad0 msgr2=0x7faa60155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa6006dad0 0x7faa60155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.720+0000 7faa65c00640 1 -- 172.21.15.18:0/672924183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa601555a0 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa65c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7faa580b0040 tx=0x7faa580196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580b2050 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa580be070 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa580ada90 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa600cee90 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa600cde70 con 0x7faa6015b2f0 2024-04-25T10:14:34.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa600745d0 con 0x7faa6015b2f0 2024-04-25T10:14:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa580adc30 con 0x7faa6015b2f0 2024-04-25T10:14:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 0x7faa40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faa581201f0 con 0x7faa6015b2f0 2024-04-25T10:14:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.724+0000 7faa65200640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 0x7faa40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.728+0000 7faa65200640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 0x7faa40069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faa54009ac0 tx=0x7faa54009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.728+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa58016560 con 0x7faa6015b2f0 2024-04-25T10:14:34.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa600d0ab0 con 0x7faa6015b2f0 2024-04-25T10:14:34.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa5cc00640 1 -- 172.21.15.18:0/672924183 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+16928 (secure 0 0 0) 0x7faa580f0a20 con 0x7faa6015b2f0 2024-04-25T10:14:34.903 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:34.904 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":123,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:19.391780+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 msgr2=0x7faa40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 0x7faa40069420 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7faa54009ac0 tx=0x7faa54009190 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 msgr2=0x7faa60149880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7faa580b0040 tx=0x7faa580196e0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 shutdown_connections 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa6015b2f0 0x7faa60149880 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faa40066f60 0x7faa40069420 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faa600b2dc0 0x7faa600ce950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 --2- 172.21.15.18:0/672924183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faa6006dad0 0x7faa60155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.896+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 >> 172.21.15.18:0/672924183 conn(0x7faa600b23b0 msgr2=0x7faa600ad1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.900+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 shutdown_connections 2024-04-25T10:14:34.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:34.900+0000 7faa67c00640 1 -- 172.21.15.18:0/672924183 wait complete. 2024-04-25T10:14:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:14:16.207800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:14:16.774891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:34.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.060+0000 7fbc4b000640 1 Processor -- start 2024-04-25T10:14:35.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.060+0000 7fbc4b000640 1 -- start start 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc4415b9e0 0x7fbc440cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc440d0080 0x7fbc4415f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fbc4415f8f0 0x7fbc4415bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4415fd20 con 0x7fbc4415b9e0 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4409ade0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc4b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44099a60 con 0x7fbc440d0080 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc4415b9e0 0x7fbc440cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc4415b9e0 0x7fbc440cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42770/0 (socket says 172.21.15.18:42770) 2024-04-25T10:14:35.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 -- 172.21.15.18:0/2585386115 learned_addr learned my addr 172.21.15.18:0/2585386115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 -- 172.21.15.18:0/2585386115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc440d0080 msgr2=0x7fbc4415f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 --2- 172.21.15.18:0/2585386115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc440d0080 0x7fbc4415f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 -- 172.21.15.18:0/2585386115 >> v2:172.21.15.167:3300/0 conn(0x7fbc4415f8f0 msgr2=0x7fbc4415bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 --2- 172.21.15.18:0/2585386115 >> v2:172.21.15.167:3300/0 conn(0x7fbc4415f8f0 0x7fbc4415bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.064+0000 7fbc49c00640 1 -- 172.21.15.18:0/2585386115 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc44099d40 con 0x7fbc4415b9e0 2024-04-25T10:14:35.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc49c00640 1 --2- 172.21.15.18:0/2585386115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415b9e0 0x7fbc440cfb40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbc44073200 tx=0x7fbc3801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c65d44751265fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc43e00640 1 -- 172.21.15.18:0/2585386115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380a6040 con 0x7fbc4415b9e0 2024-04-25T10:14:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc43e00640 1 -- 172.21.15.18:0/2585386115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380af070 con 0x7fbc4415b9e0 2024-04-25T10:14:35.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc43e00640 1 -- 172.21.15.18:0/2585386115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380aa860 con 0x7fbc4415b9e0 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- 172.21.15.18:0/2585386115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415b9e0 msgr2=0x7fbc440cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- 172.21.15.18:0/2585386115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415b9e0 0x7fbc440cfb40 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fbc44073200 tx=0x7fbc3801c520 comp rx=0 tx=0).stop 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- 172.21.15.18:0/2585386115 shutdown_connections 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- 172.21.15.18:0/2585386115 >> v2:172.21.15.167:3300/0 conn(0x7fbc4415f8f0 0x7fbc4415bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- 172.21.15.18:0/2585386115 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc440d0080 0x7fbc4415f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- 172.21.15.18:0/2585386115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415b9e0 0x7fbc440cfb40 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- 172.21.15.18:0/2585386115 >> 172.21.15.18:0/2585386115 conn(0x7fbc440b3030 msgr2=0x7fbc440b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- 172.21.15.18:0/2585386115 shutdown_connections 2024-04-25T10:14:35.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- 172.21.15.18:0/2585386115 wait complete. 2024-04-25T10:14:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 Processor -- start 2024-04-25T10:14:35.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- start start 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 0x7fbc44158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 0x7fbc440c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440cc050 con 0x7fbc4415f8f0 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4409a8c0 con 0x7fbc440d0080 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.068+0000 7fbc4b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440cc1d0 con 0x7fbc4415b9e0 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42784/0 (socket says 172.21.15.18:42784) 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 -- 172.21.15.18:0/1910204523 learned_addr learned my addr 172.21.15.18:0/1910204523 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc49c00640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 0x7fbc44158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc49200640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 0x7fbc440c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 -- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 msgr2=0x7fbc440c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 0x7fbc440c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 -- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 msgr2=0x7fbc44158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 0x7fbc44158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 -- 172.21.15.18:0/1910204523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440c5110 con 0x7fbc4415f8f0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc49c00640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 0x7fbc44158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc49200640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 0x7fbc440c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4a600640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00b970 tx=0x7fbc3c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c019070 con 0x7fbc4415f8f0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00cb60 con 0x7fbc4415f8f0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c014440 con 0x7fbc4415f8f0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc440c53f0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc440c59b0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc440745d0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbc3c01c070 con 0x7fbc4415f8f0 2024-04-25T10:14:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 0x7fbc24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.072+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbc3c084f30 con 0x7fbc4415f8f0 2024-04-25T10:14:35.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.076+0000 7fbc49c00640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 0x7fbc24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.076+0000 7fbc49c00640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 0x7fbc24069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc380ae000 tx=0x7fbc38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.076+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc3c055da0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.240+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc440d1320 con 0x7fbc4415f8f0 2024-04-25T10:14:35.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.240+0000 7fbc41600640 1 -- 172.21.15.18:0/1910204523 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc3c0556a0 con 0x7fbc4415f8f0 2024-04-25T10:14:35.248 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:35.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 msgr2=0x7fbc24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 0x7fbc24069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbc380ae000 tx=0x7fbc38008040 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 msgr2=0x7fbc440c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c00b970 tx=0x7fbc3c00be30 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 shutdown_connections 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc4415f8f0 0x7fbc440c74c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fbc24066f60 0x7fbc24069420 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fbc4415b9e0 0x7fbc440c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 --2- 172.21.15.18:0/1910204523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc440d0080 0x7fbc44158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 >> 172.21.15.18:0/1910204523 conn(0x7fbc440b3030 msgr2=0x7fbc44164cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 shutdown_connections 2024-04-25T10:14:35.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.244+0000 7fbc4b000640 1 -- 172.21.15.18:0/1910204523 wait complete. 2024-04-25T10:14:35.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:14:35.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.404+0000 7f9cc7400640 1 Processor -- start 2024-04-25T10:14:35.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.404+0000 7f9cc7400640 1 -- start start 2024-04-25T10:14:35.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 0x7f9cc00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc7400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 0x7f9cc00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc7400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc015e040 con 0x7f9cc0099a60 2024-04-25T10:14:35.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc7400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc00cff80 con 0x7f9cc006bf30 2024-04-25T10:14:35.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc7400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00d0260 con 0x7f9cc015dc60 2024-04-25T10:14:35.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc4a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 0x7f9cc00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cb7e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 0x7f9cc00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc5400640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f9cc0099a60 0x7f9cc00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:54758/0 (socket says 172.21.15.18:54758) 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc5400640 1 -- 172.21.15.18:0/381544938 learned_addr learned my addr 172.21.15.18:0/381544938 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cbfe00640 1 -- 172.21.15.18:0/381544938 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019906478 0 0) 0x7f9cc015e040 con 0x7f9cc0099a60 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc4a00640 1 -- 172.21.15.18:0/381544938 >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 msgr2=0x7f9cc00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/381544938 >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 0x7f9cc00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc4a00640 1 -- 172.21.15.18:0/381544938 >> v1:172.21.15.167:6789/0 conn(0x7f9cc0099a60 legacy=0x7f9cc00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cc4a00640 1 -- 172.21.15.18:0/381544938 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00d0540 con 0x7f9cc015dc60 2024-04-25T10:14:35.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.408+0000 7f9cb7e00640 1 --2- 172.21.15.18:0/381544938 >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 0x7f9cc00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/381544938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 0x7f9cc00d1020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00097c0 tx=0x7f9cb001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae6e5c97654b0a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cbfe00640 1 -- 172.21.15.18:0/381544938 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00b1070 con 0x7f9cc015dc60 2024-04-25T10:14:35.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cbfe00640 1 -- 172.21.15.18:0/381544938 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb00a8050 con 0x7f9cc015dc60 2024-04-25T10:14:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cbfe00640 1 -- 172.21.15.18:0/381544938 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00ac860 con 0x7f9cc015dc60 2024-04-25T10:14:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- 172.21.15.18:0/381544938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 msgr2=0x7f9cc00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 --2- 172.21.15.18:0/381544938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 0x7f9cc00d1020 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00097c0 tx=0x7f9cb001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- 172.21.15.18:0/381544938 shutdown_connections 2024-04-25T10:14:35.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 --2- 172.21.15.18:0/381544938 >> v2:172.21.15.167:3300/0 conn(0x7f9cc006bf30 0x7f9cc00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 --2- 172.21.15.18:0/381544938 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc015dc60 0x7f9cc00d1020 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- 172.21.15.18:0/381544938 >> 172.21.15.18:0/381544938 conn(0x7f9cc00b3200 msgr2=0x7f9cc00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- 172.21.15.18:0/381544938 shutdown_connections 2024-04-25T10:14:35.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- 172.21.15.18:0/381544938 wait complete. 2024-04-25T10:14:35.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 Processor -- start 2024-04-25T10:14:35.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.412+0000 7f9cc7400640 1 -- start start 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 0x7f9cc0155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc0099a60 0x7f9cc00b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc006cfa0 con 0x7f9cc015dc60 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc00cc880 con 0x7f9cc006bf30 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc0155a80 con 0x7f9cc0099a60 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42796/0 (socket says 172.21.15.18:42796) 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 -- 172.21.15.18:0/2739635187 learned_addr learned my addr 172.21.15.18:0/2739635187 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:35.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cb7e00640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc0099a60 0x7f9cc00b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 0x7f9cc0155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 -- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc0099a60 msgr2=0x7f9cc00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc0099a60 0x7f9cc00b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 -- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 msgr2=0x7f9cc0155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 0x7f9cc0155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 -- 172.21.15.18:0/2739635187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc00c95d0 con 0x7f9cc015dc60 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 0x7f9cc0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:35.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc5400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800c7a0 tx=0x7f9cb800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8018070 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb800a640 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb800aa70 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc00c98b0 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc00c9e70 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc00745d0 con 0x7f9cc015dc60 2024-04-25T10:14:35.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.416+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9cb801b070 con 0x7f9cc015dc60 2024-04-25T10:14:35.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.420+0000 7f9cbd600640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 0x7f9c9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.420+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9cb80848f0 con 0x7f9cc015dc60 2024-04-25T10:14:35.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.420+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 0x7f9c9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.420+0000 7f9cc4a00640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 0x7f9c9c069420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ae000 tx=0x7f9cb0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.424+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9cb8055640 con 0x7f9cc015dc60 2024-04-25T10:14:35.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.583+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cc00b7590 con 0x7f9cc015dc60 2024-04-25T10:14:35.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.583+0000 7f9cbd600640 1 -- 172.21.15.18:0/2739635187 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cb8054f40 con 0x7f9cc015dc60 2024-04-25T10:14:35.592 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:14:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 msgr2=0x7f9c9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 0x7f9c9c069420 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f9cb00ae000 tx=0x7f9cb0008040 comp rx=0 tx=0).stop 2024-04-25T10:14:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 msgr2=0x7f9cc015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800c7a0 tx=0x7f9cb800cc60 comp rx=0 tx=0).stop 2024-04-25T10:14:35.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 shutdown_connections 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc015dc60 0x7f9cc015bbb0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9c9c066f60 0x7f9c9c069420 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f9cc0099a60 0x7f9cc00b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 --2- 172.21.15.18:0/2739635187 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9cc006bf30 0x7f9cc0155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 >> 172.21.15.18:0/2739635187 conn(0x7f9cc00b3200 msgr2=0x7f9cc015ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 shutdown_connections 2024-04-25T10:14:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.587+0000 7f9cc7400640 1 -- 172.21.15.18:0/2739635187 wait complete. 2024-04-25T10:14:35.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:14:35.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 Processor -- start 2024-04-25T10:14:35.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 -- start start 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 0x7f3fe015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3fe006e4a0 0x7f3fe006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe015fc00 con 0x7f3fe015f440 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe006d640 con 0x7f3fe006e4a0 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe8000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015fee0 con 0x7f3fe0159320 2024-04-25T10:14:35.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe4c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3fe015f440 0x7f3fe006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32928/0 (socket says 172.21.15.18:32928) 2024-04-25T10:14:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe4c00640 1 -- 172.21.15.18:0/897650554 learned_addr learned my addr 172.21.15.18:0/897650554 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:35.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe6000640 1 --2- 172.21.15.18:0/897650554 >> v2:172.21.15.18:3300/0 conn(0x7f3fe006e4a0 0x7f3fe006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe5600640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 0x7f3fe015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe6000640 1 -- 172.21.15.18:0/897650554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 msgr2=0x7f3fe015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe6000640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 0x7f3fe015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe6000640 1 -- 172.21.15.18:0/897650554 >> v1:172.21.15.18:6789/0 conn(0x7f3fe015f440 legacy=0x7f3fe006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe6000640 1 -- 172.21.15.18:0/897650554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe01601c0 con 0x7f3fe006e4a0 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fe5600640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 0x7f3fe015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:35.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.751+0000 7f3fdfe00640 1 -- 172.21.15.18:0/897650554 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3990071142 0 0) 0x7f3fe015fc00 con 0x7f3fe015f440 2024-04-25T10:14:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe6000640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe006e4a0 0x7f3fe006e930 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009d90 tx=0x7f3fd801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e12819ca9ad2ee2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fdfe00640 1 -- 172.21.15.18:0/897650554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80b2070 con 0x7f3fe006e4a0 2024-04-25T10:14:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fdfe00640 1 -- 172.21.15.18:0/897650554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd80a5830 con 0x7f3fe006e4a0 2024-04-25T10:14:35.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fdfe00640 1 -- 172.21.15.18:0/897650554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80a5c00 con 0x7f3fe006e4a0 2024-04-25T10:14:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- 172.21.15.18:0/897650554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe006e4a0 msgr2=0x7f3fe006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe006e4a0 0x7f3fe006e930 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009d90 tx=0x7f3fd801c8e0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- 172.21.15.18:0/897650554 shutdown_connections 2024-04-25T10:14:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe006e4a0 0x7f3fe006e930 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 --2- 172.21.15.18:0/897650554 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe0159320 0x7f3fe015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- 172.21.15.18:0/897650554 >> 172.21.15.18:0/897650554 conn(0x7f3fe0067080 msgr2=0x7f3fe006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- 172.21.15.18:0/897650554 shutdown_connections 2024-04-25T10:14:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- 172.21.15.18:0/897650554 wait complete. 2024-04-25T10:14:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 Processor -- start 2024-04-25T10:14:35.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.755+0000 7f3fe8000640 1 -- start start 2024-04-25T10:14:35.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe006e4a0 0x7f3fe013afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe0159320 0x7f3fe00b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015f9e0 con 0x7f3fe015f440 2024-04-25T10:14:35.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe015f860 con 0x7f3fe0159320 2024-04-25T10:14:35.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0168590 con 0x7f3fe006e4a0 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe5600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe006e4a0 0x7f3fe013afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42804/0 (socket says 172.21.15.18:42804) 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe4c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe0159320 0x7f3fe00b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 -- 172.21.15.18:0/586847528 learned_addr learned my addr 172.21.15.18:0/586847528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 -- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe006e4a0 msgr2=0x7f3fe013afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe006e4a0 0x7f3fe013afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 -- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe0159320 msgr2=0x7f3fe00b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe0159320 0x7f3fe00b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 -- 172.21.15.18:0/586847528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe00b3b50 con 0x7f3fe015f440 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe6000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80b0040 tx=0x7f3fd8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80b2050 con 0x7f3fe015f440 2024-04-25T10:14:35.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd80b3040 con 0x7f3fe015f440 2024-04-25T10:14:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80ad850 con 0x7f3fe015f440 2024-04-25T10:14:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe00b3e30 con 0x7f3fe015f440 2024-04-25T10:14:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe00b43f0 con 0x7f3fe015f440 2024-04-25T10:14:35.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.759+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe00745d0 con 0x7f3fe015f440 2024-04-25T10:14:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.763+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3fd80c0020 con 0x7f3fe015f440 2024-04-25T10:14:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.763+0000 7f3fdd600640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 0x7f3fc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.763+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3fd811fa60 con 0x7f3fe015f440 2024-04-25T10:14:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.763+0000 7f3fe5600640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 0x7f3fc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:35.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.763+0000 7f3fe5600640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 0x7f3fc0069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400ab60 tx=0x7f3fd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:35.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.767+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3fd8016560 con 0x7f3fe015f440 2024-04-25T10:14:35.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3fe0142920 con 0x7f3fe015f440 2024-04-25T10:14:35.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fdd600640 1 -- 172.21.15.18:0/586847528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3fd80f03a0 con 0x7f3fe015f440 2024-04-25T10:14:35.935 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:14:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 msgr2=0x7f3fc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 0x7f3fc0069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400ab60 tx=0x7f3fd4008040 comp rx=0 tx=0).stop 2024-04-25T10:14:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 msgr2=0x7f3fe0164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:35.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80b0040 tx=0x7f3fd8019680 comp rx=0 tx=0).stop 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 shutdown_connections 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fe015f440 0x7f3fe0164bc0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fe0159320 0x7f3fe00b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3fc0066f60 0x7f3fc0069420 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 --2- 172.21.15.18:0/586847528 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3fe006e4a0 0x7f3fe013afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 >> 172.21.15.18:0/586847528 conn(0x7f3fe0067080 msgr2=0x7f3fe006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.927+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 shutdown_connections 2024-04-25T10:14:35.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:35.931+0000 7f3fe8000640 1 -- 172.21.15.18:0/586847528 wait complete. 2024-04-25T10:14:35.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:14:36.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 Processor -- start 2024-04-25T10:14:36.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 -- start start 2024-04-25T10:14:36.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f7415acd0 0x7f6f7415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7415bc40 con 0x7f6f74144120 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7415b3a0 con 0x7f6f7415ee60 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f7ba00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7415e490 con 0x7f6f7415acd0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f79000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6f74144120 0x7f6f740ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32930/0 (socket says 172.21.15.18:32930) 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f79000640 1 -- 172.21.15.18:0/3788961170 learned_addr learned my addr 172.21.15.18:0/3788961170 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f6be00640 1 --2- 172.21.15.18:0/3788961170 >> v2:172.21.15.18:3300/0 conn(0x7f6f7415acd0 0x7f6f7415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f6be00640 1 -- 172.21.15.18:0/3788961170 >> v1:172.21.15.167:6789/0 conn(0x7f6f7415ee60 legacy=0x7f6f740b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f6be00640 1 -- 172.21.15.18:0/3788961170 >> v1:172.21.15.18:6789/0 conn(0x7f6f74144120 legacy=0x7f6f740ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.091+0000 7f6f6be00640 1 -- 172.21.15.18:0/3788961170 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7415b680 con 0x7f6f7415acd0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f6be00640 1 --2- 172.21.15.18:0/3788961170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f7415e920 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0097c0 tx=0x7f6f5c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d57f1fe7c88da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f73e00640 1 -- 172.21.15.18:0/3788961170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b0070 con 0x7f6f7415acd0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f73e00640 1 -- 172.21.15.18:0/3788961170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0ab600 con 0x7f6f7415acd0 2024-04-25T10:14:36.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f73e00640 1 -- 172.21.15.18:0/3788961170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0ab9d0 con 0x7f6f7415acd0 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3788961170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 msgr2=0x7f6f7415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3788961170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f7415e920 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0097c0 tx=0x7f6f5c01c410 comp rx=0 tx=0).stop 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3788961170 shutdown_connections 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3788961170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f7415e920 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3788961170 >> 172.21.15.18:0/3788961170 conn(0x7f6f74067080 msgr2=0x7f6f7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3788961170 shutdown_connections 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.095+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3788961170 wait complete. 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 Processor -- start 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- start start 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f74144120 0x7f6f74158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f7415ee60 0x7f6f740b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74168660 con 0x7f6f7415acd0 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7415b150 con 0x7f6f74144120 2024-04-25T10:14:36.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f741687e0 con 0x7f6f7415ee60 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42824/0 (socket says 172.21.15.18:42824) 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 -- 172.21.15.18:0/3430556791 learned_addr learned my addr 172.21.15.18:0/3430556791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f79000640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f74144120 0x7f6f74158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f79a00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f7415ee60 0x7f6f740b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 -- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f7415ee60 msgr2=0x7f6f740b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f7415ee60 0x7f6f740b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 -- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f74144120 msgr2=0x7f6f74158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f74144120 0x7f6f74158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 -- 172.21.15.18:0/3430556791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7413adc0 con 0x7f6f7415acd0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f6be00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0ae040 tx=0x7f6f5c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b0050 con 0x7f6f7415acd0 2024-04-25T10:14:36.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0bc070 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0b5a50 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7413b0a0 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74158660 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.099+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f740745d0 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.103+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f5c0ab4a0 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.103+0000 7f6f71600640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 0x7f6f50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.103+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6f5c11f8a0 con 0x7f6f7415acd0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.103+0000 7f6f79000640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 0x7f6f50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.103+0000 7f6f79000640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 0x7f6f50069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6f64005890 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.107+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f5c016090 con 0x7f6f7415acd0 2024-04-25T10:14:36.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f740b44f0 con 0x7f6f7415acd0 2024-04-25T10:14:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f71600640 1 -- 172.21.15.18:0/3430556791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v123) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f5c0f0030 con 0x7f6f7415acd0 2024-04-25T10:14:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 msgr2=0x7f6f50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 0x7f6f50069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6f64005890 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 msgr2=0x7f6f740b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0ae040 tx=0x7f6f5c01ac50 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 shutdown_connections 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6f50066f60 0x7f6f50069420 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6f7415ee60 0x7f6f740b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f7415acd0 0x7f6f740b12c0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 --2- 172.21.15.18:0/3430556791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6f74144120 0x7f6f74158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 >> 172.21.15.18:0/3430556791 conn(0x7f6f74067080 msgr2=0x7f6f74140f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 shutdown_connections 2024-04-25T10:14:36.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.283+0000 7f6f7ba00640 1 -- 172.21.15.18:0/3430556791 wait complete. 2024-04-25T10:14:36.312 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:14:36.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:36.312 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:36.423 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:14:36.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:36.424 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:14:36.444 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:36.445 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:36.497 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:36.497 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:14:36.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:36.498 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:14:36.549 INFO:teuthology.orchestra.run.smithi018.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T10:14:36.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:14:36.551 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:14:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 Processor -- start 2024-04-25T10:14:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 -- start start 2024-04-25T10:14:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d6806e4a0 0x7f8d6806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6815fc00 con 0x7f8d6815c9b0 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6815fee0 con 0x7f8d68159320 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d6d000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6806d640 con 0x7f8d6806e4a0 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d5fe00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8d6815c9b0 0x7f8d6806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32946/0 (socket says 172.21.15.18:32946) 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d5fe00640 1 -- 172.21.15.18:0/1941260252 learned_addr learned my addr 172.21.15.18:0/1941260252 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d66800640 1 --2- 172.21.15.18:0/1941260252 >> v2:172.21.15.18:3300/0 conn(0x7f8d6806e4a0 0x7f8d6806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2681797380 0 0) 0x7f8d6815fc00 con 0x7f8d6815c9b0 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d4c003530 con 0x7f8d6815c9b0 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3504992168 0 0) 0x7f8d6815fee0 con 0x7f8d68159320 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d66800640 1 -- 172.21.15.18:0/1941260252 >> v1:172.21.15.167:6789/0 conn(0x7f8d68159320 legacy=0x7f8d6815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d66800640 1 -- 172.21.15.18:0/1941260252 >> v1:172.21.15.18:6789/0 conn(0x7f8d6815c9b0 legacy=0x7f8d6806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.731+0000 7f8d66800640 1 -- 172.21.15.18:0/1941260252 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d681601c0 con 0x7f8d6806e4a0 2024-04-25T10:14:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d66800640 1 --2- 172.21.15.18:0/1941260252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6806e4a0 0x7f8d6806e8d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806d7c0 tx=0x7f8d6001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7d23992f654dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600b2070 con 0x7f8d6806e4a0 2024-04-25T10:14:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d600a5810 con 0x7f8d6806e4a0 2024-04-25T10:14:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d65400640 1 -- 172.21.15.18:0/1941260252 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600a5be0 con 0x7f8d6806e4a0 2024-04-25T10:14:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 -- 172.21.15.18:0/1941260252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6806e4a0 msgr2=0x7f8d6806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 --2- 172.21.15.18:0/1941260252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6806e4a0 0x7f8d6806e8d0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f8d6806d7c0 tx=0x7f8d6001c950 comp rx=0 tx=0).stop 2024-04-25T10:14:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 -- 172.21.15.18:0/1941260252 shutdown_connections 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 --2- 172.21.15.18:0/1941260252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6806e4a0 0x7f8d6806e8d0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 -- 172.21.15.18:0/1941260252 >> 172.21.15.18:0/1941260252 conn(0x7f8d68067080 msgr2=0x7f8d6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 -- 172.21.15.18:0/1941260252 shutdown_connections 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.735+0000 7f8d6d000640 1 -- 172.21.15.18:0/1941260252 wait complete. 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 Processor -- start 2024-04-25T10:14:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- start start 2024-04-25T10:14:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6806e4a0 0x7f8d6813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d68159320 0x7f8d6813f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d68169720 con 0x7f8d6815c9b0 2024-04-25T10:14:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681695a0 con 0x7f8d6806e4a0 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d681698a0 con 0x7f8d68159320 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42848/0 (socket says 172.21.15.18:42848) 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 -- 172.21.15.18:0/3480680527 learned_addr learned my addr 172.21.15.18:0/3480680527 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d65e00640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6806e4a0 0x7f8d6813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d5fe00640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d68159320 0x7f8d6813f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 -- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d68159320 msgr2=0x7f8d6813f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d68159320 0x7f8d6813f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 -- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6806e4a0 msgr2=0x7f8d6813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6806e4a0 0x7f8d6813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 -- 172.21.15.18:0/3480680527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d681410b0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d66800640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f8d6001a580 tx=0x7f8d600196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600b2040 con 0x7f8d6815c9b0 2024-04-25T10:14:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d600039a0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d60003dd0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d68140010 con 0x7f8d6815c9b0 2024-04-25T10:14:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d681408b0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.739+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d680745d0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.743+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d60004030 con 0x7f8d6815c9b0 2024-04-25T10:14:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.743+0000 7f8d5e000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 0x7f8d44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.743+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8d601200f0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.743+0000 7f8d65e00640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 0x7f8d44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.743+0000 7f8d65e00640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 0x7f8d44069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8d680cd9b0 tx=0x7f8d58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.747+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d60016540 con 0x7f8d6815c9b0 2024-04-25T10:14:36.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.943+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8d68073d90 con 0x7f8d6815c9b0 2024-04-25T10:14:36.954 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:14:36.947+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:14:36.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.947+0000 7f8d5e000640 1 -- 172.21.15.18:0/3480680527 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v102) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8d600f09b0 con 0x7f8d6815c9b0 2024-04-25T10:14:36.955 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:14:36.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 msgr2=0x7f8d44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 0x7f8d44069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f8d680cd9b0 tx=0x7f8d58009040 comp rx=0 tx=0).stop 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 msgr2=0x7f8d680b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f8d6001a580 tx=0x7f8d600196f0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 shutdown_connections 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d6815c9b0 0x7f8d680b0170 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8d44066f60 0x7f8d44069420 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f8d68159320 0x7f8d6813f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 --2- 172.21.15.18:0/3480680527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6806e4a0 0x7f8d6813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 >> 172.21.15.18:0/3480680527 conn(0x7f8d68067080 msgr2=0x7f8d680cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 shutdown_connections 2024-04-25T10:14:36.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:36.951+0000 7f8d6d000640 1 -- 172.21.15.18:0/3480680527 wait complete. 2024-04-25T10:14:36.971 INFO:tasks.ceph.mds.d.smithi167.stderr: -8371> 2024-04-25T10:14:20.371+0000 7f94dca00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:14:36.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:36.982 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:37.022 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-25T10:14:37.023 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.024 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-25T10:14:37.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-25T10:14:37.026 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-25T10:14:37.027 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-25T10:14:37.028 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.029 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.030 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.031 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:37.032 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:14:37.033 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = False 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.034 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.035 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:14:37.035 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T10:14:37.035 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T10:14:37.035 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:37.035 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:37.036 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:37.037 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:37.038 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T10:14:37.039 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T10:14:37.040 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:37.041 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T10:14:37.042 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.043 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T10:14:37.044 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:14:37.045 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = False 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.046 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.048 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:37.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.132 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:37.133 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-25T10:14:37.134 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:37.135 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:37.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-25T10:14:37.137 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.138 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:37.139 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.140 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-25T10:14:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:37.142 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = False 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = False 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T10:14:37.143 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:37.144 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:37.145 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T10:14:37.146 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T10:14:37.147 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:37.148 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:37.149 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.150 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:37.151 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T10:14:37.152 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:14:37.153 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = False 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = False 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:37.154 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:37.156 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T10:14:37.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 Processor -- start 2024-04-25T10:14:37.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 -- start start 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecab5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98a50 0x5645ecaac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645eca0c200 con 0x5645eca98670 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ec9849f0 con 0x5645eca98a50 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645eca0c380 con 0x5645eca96e60 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42864/0 (socket says 172.21.15.18:42864) 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 -- 172.21.15.18:0/2549610421 learned_addr learned my addr 172.21.15.18:0/2549610421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef7400640 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98a50 0x5645ecaac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef6a00640 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecab5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 -- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 msgr2=0x5645ecab5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecab5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 -- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98a50 msgr2=0x5645ecaac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98a50 0x5645ecaac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 -- 172.21.15.18:0/2549610421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ecab4670 con 0x5645eca98670 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2eefe00640 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b220 tx=0x7f2ee000b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308ceabe24dbca05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef5600640 1 -- 172.21.15.18:0/2549610421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000a040 con 0x5645eca98670 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef5600640 1 -- 172.21.15.18:0/2549610421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee000f620 con 0x5645eca98670 2024-04-25T10:14:37.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef5600640 1 -- 172.21.15.18:0/2549610421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000fa10 con 0x5645eca98670 2024-04-25T10:14:37.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.235+0000 7f2ef97cc080 1 -- 172.21.15.18:0/2549610421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 msgr2=0x5645eca08930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000b220 tx=0x7f2ee000b6e0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/2549610421 shutdown_connections 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98a50 0x5645ecaac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98670 0x5645eca08930 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/2549610421 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecab5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/2549610421 >> 172.21.15.18:0/2549610421 conn(0x5645ec9de400 msgr2=0x5645eca962f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/2549610421 shutdown_connections 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/2549610421 wait complete. 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 Processor -- start 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- start start 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecaae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98670 0x5645eca94aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 0x5645ecabe150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ecab4bb0 con 0x5645eca98a50 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ecab4910 con 0x5645eca98670 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ecab4e50 con 0x5645eca96e60 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 0x5645ecabe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 0x5645ecabe150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42874/0 (socket says 172.21.15.18:42874) 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 -- 172.21.15.18:0/1308028047 learned_addr learned my addr 172.21.15.18:0/1308028047 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef6a00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecaae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2eefe00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98670 0x5645eca94aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 -- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 msgr2=0x5645ecaae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5645eca96e60 0x5645ecaae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 -- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98670 msgr2=0x5645eca94aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5645eca98670 0x5645eca94aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 -- 172.21.15.18:0/1308028047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ecaaee60 con 0x5645eca98a50 2024-04-25T10:14:37.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef7400640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 0x5645ecabe150 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f2ef001b5f0 tx=0x7f2ef0017eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2eef400640 1 -- 172.21.15.18:0/1308028047 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00ba020 con 0x5645eca98a50 2024-04-25T10:14:37.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2eef400640 1 -- 172.21.15.18:0/1308028047 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef00b6660 con 0x5645eca98a50 2024-04-25T10:14:37.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2eef400640 1 -- 172.21.15.18:0/1308028047 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00abe60 con 0x5645eca98a50 2024-04-25T10:14:37.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645ecaaf100 con 0x5645eca98a50 2024-04-25T10:14:37.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.239+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645ecaaebb0 con 0x5645eca98a50 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2eef400640 1 -- 172.21.15.18:0/1308028047 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ef00bd020 con 0x5645eca98a50 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2eef400640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ed4065970 0x7f2ed4067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2eef400640 1 -- 172.21.15.18:0/1308028047 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2ef011ef20 con 0x5645eca98a50 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5645ecaba220 0x5645ecaba600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2ef6a00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ed4065970 0x7f2ed4067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e124) v9 -- 0x5645ecabab40 con 0x5645ecaba220 2024-04-25T10:14:37.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2eefe00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5645ecaba220 0x5645ecaba600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2ef6a00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ed4065970 0x7f2ed4067e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009970 tx=0x7f2ee800e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.243+0000 7f2eefe00640 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5645ecaba220 0x5645ecaba600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2eefe00640 1 -- 172.21.15.18:0/1308028047 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v124'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2ee000d040 con 0x5645ecaba220 2024-04-25T10:14:37.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5645ecaba220 msgr2=0x5645ecaba600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5645ecaba220 0x5645ecaba600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ed4065970 msgr2=0x7f2ed4067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2ed4065970 0x7f2ed4067e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009970 tx=0x7f2ee800e040 comp rx=0 tx=0).stop 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 msgr2=0x5645ecabe150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 --2- 172.21.15.18:0/1308028047 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645eca98a50 0x5645ecabe150 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f2ef001b5f0 tx=0x7f2ef0017eb0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef7400640 1 -- 172.21.15.18:0/1308028047 reap_dead start 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 shutdown_connections 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 >> 172.21.15.18:0/1308028047 conn(0x5645ec9de400 msgr2=0x5645ec9e0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 shutdown_connections 2024-04-25T10:14:37.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.247+0000 7f2ef97cc080 1 -- 172.21.15.18:0/1308028047 wait complete. 2024-04-25T10:14:37.259 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:14:37.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 Processor -- start 2024-04-25T10:14:37.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 -- start start 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f300015acd0 0x7f300015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300015bc40 con 0x7f3000144120 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300015b3a0 con 0x7f300015ee60 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3007600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f300015e490 con 0x7f300015acd0 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3004c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3000144120 0x7f30000ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32948/0 (socket says 172.21.15.18:32948) 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f3004c00640 1 -- 172.21.15.18:0/4095116561 learned_addr learned my addr 172.21.15.18:0/4095116561 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:37.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.435+0000 7f2fffe00640 1 --2- 172.21.15.18:0/4095116561 >> v2:172.21.15.167:3300/0 conn(0x7f300015acd0 0x7f300015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046584001 0 0) 0x7f300015bc40 con 0x7f3000144120 2024-04-25T10:14:37.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe8003530 con 0x7f3000144120 2024-04-25T10:14:37.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fffe00640 1 -- 172.21.15.18:0/4095116561 >> v1:172.21.15.167:6789/0 conn(0x7f300015ee60 legacy=0x7f30000b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972201134 0 0) 0x7f300015b3a0 con 0x7f300015ee60 2024-04-25T10:14:37.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fffe00640 1 -- 172.21.15.18:0/4095116561 >> v1:172.21.15.18:6789/0 conn(0x7f3000144120 legacy=0x7f30000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fffe00640 1 -- 172.21.15.18:0/4095116561 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300015b680 con 0x7f300015acd0 2024-04-25T10:14:37.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fffe00640 1 --2- 172.21.15.18:0/4095116561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f300015acd0 0x7f300015e920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097c0 tx=0x7f2fec01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c7f42789c033a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0b0070 con 0x7f300015acd0 2024-04-25T10:14:37.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0ab600 con 0x7f300015acd0 2024-04-25T10:14:37.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.439+0000 7f2fff400640 1 -- 172.21.15.18:0/4095116561 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0ab9d0 con 0x7f300015acd0 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- 172.21.15.18:0/4095116561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f300015acd0 msgr2=0x7f300015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 --2- 172.21.15.18:0/4095116561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f300015acd0 0x7f300015e920 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097c0 tx=0x7f2fec01c410 comp rx=0 tx=0).stop 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- 172.21.15.18:0/4095116561 shutdown_connections 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 --2- 172.21.15.18:0/4095116561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f300015acd0 0x7f300015e920 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- 172.21.15.18:0/4095116561 >> 172.21.15.18:0/4095116561 conn(0x7f3000067080 msgr2=0x7f300006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- 172.21.15.18:0/4095116561 shutdown_connections 2024-04-25T10:14:37.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- 172.21.15.18:0/4095116561 wait complete. 2024-04-25T10:14:37.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 Processor -- start 2024-04-25T10:14:37.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- start start 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3000144120 0x7f30000cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f300015ee60 0x7f3000164c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30001687e0 con 0x7f300015acd0 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000168660 con 0x7f3000144120 2024-04-25T10:14:37.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3007600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3000168960 con 0x7f300015ee60 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42876/0 (socket says 172.21.15.18:42876) 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 -- 172.21.15.18:0/3078111959 learned_addr learned my addr 172.21.15.18:0/3078111959 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3004c00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3000144120 0x7f30000cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f3005600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f300015ee60 0x7f3000164c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 -- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f300015ee60 msgr2=0x7f3000164c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f300015ee60 0x7f3000164c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 -- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3000144120 msgr2=0x7f30000cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3000144120 0x7f30000cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.443+0000 7f2fffe00640 1 -- 172.21.15.18:0/3078111959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300015bd40 con 0x7f300015acd0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2fffe00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097c0 tx=0x7f2fec01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0bb020 con 0x7f300015acd0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec0b1040 con 0x7f300015acd0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300015bfe0 con 0x7f300015acd0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec0b0050 con 0x7f300015acd0 2024-04-25T10:14:37.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300015c5a0 con 0x7f300015acd0 2024-04-25T10:14:37.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30000745d0 con 0x7f300015acd0 2024-04-25T10:14:37.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2fec0be070 con 0x7f300015acd0 2024-04-25T10:14:37.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:37.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2fec11e850 con 0x7f300015acd0 2024-04-25T10:14:37.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.447+0000 7f3004c00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:37.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.451+0000 7f3004c00640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 0x7f2fe0069420 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4007fd0 tx=0x7f2ff4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:37.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.451+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fec016090 con 0x7f300015acd0 2024-04-25T10:14:37.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.651+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f30000b1ce0 con 0x7f300015acd0 2024-04-25T10:14:37.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f2ffcc00640 1 -- 172.21.15.18:0/3078111959 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v103) v1 ==== 162+0+0 (secure 0 0 0) 0x7f2fec0eef90 con 0x7f300015acd0 2024-04-25T10:14:37.957 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:14:37.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 msgr2=0x7f2fe0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 0x7f2fe0069420 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4007fd0 tx=0x7f2ff4009040 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 msgr2=0x7f300015cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2fec0097c0 tx=0x7f2fec01ac50 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 shutdown_connections 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fe0066f60 0x7f2fe0069420 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f300015ee60 0x7f3000164c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f300015acd0 0x7f300015cda0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 --2- 172.21.15.18:0/3078111959 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3000144120 0x7f30000cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 >> 172.21.15.18:0/3078111959 conn(0x7f3000067080 msgr2=0x7f3000071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 shutdown_connections 2024-04-25T10:14:37.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:37.951+0000 7f3007600640 1 -- 172.21.15.18:0/3078111959 wait complete. 2024-04-25T10:14:37.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 Processor -- start 2024-04-25T10:14:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 -- start start 2024-04-25T10:14:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a3815fe50 0x7f3a380b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a380b20a0 con 0x7f3a380b1c90 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a380cc4e0 con 0x7f3a38145270 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a40000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a38145650 con 0x7f3a3815fe50 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a3cc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a3815fe50 0x7f3a380b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a3e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a380b1c90 0x7f3a3815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32958/0 (socket says 172.21.15.18:32958) 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a3e000640 1 -- 172.21.15.18:0/2326445773 learned_addr learned my addr 172.21.15.18:0/2326445773 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:38.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a3cc00640 1 -- 172.21.15.18:0/2326445773 >> v1:172.21.15.167:6789/0 conn(0x7f3a38145270 legacy=0x7f3a380cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.115+0000 7f3a3cc00640 1 -- 172.21.15.18:0/2326445773 >> v1:172.21.15.18:6789/0 conn(0x7f3a380b1c90 legacy=0x7f3a3815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a3cc00640 1 -- 172.21.15.18:0/2326445773 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a380ce040 con 0x7f3a3815fe50 2024-04-25T10:14:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a3cc00640 1 --2- 172.21.15.18:0/2326445773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3815fe50 0x7f3a380b1750 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097c0 tx=0x7f3a2401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51066945b3ebd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a37e00640 1 -- 172.21.15.18:0/2326445773 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240b1070 con 0x7f3a3815fe50 2024-04-25T10:14:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a37e00640 1 -- 172.21.15.18:0/2326445773 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a240ac5f0 con 0x7f3a3815fe50 2024-04-25T10:14:38.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a37e00640 1 -- 172.21.15.18:0/2326445773 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240ac9c0 con 0x7f3a3815fe50 2024-04-25T10:14:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 -- 172.21.15.18:0/2326445773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3815fe50 msgr2=0x7f3a380b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 --2- 172.21.15.18:0/2326445773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3815fe50 0x7f3a380b1750 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097c0 tx=0x7f3a2401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 -- 172.21.15.18:0/2326445773 shutdown_connections 2024-04-25T10:14:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 --2- 172.21.15.18:0/2326445773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a3815fe50 0x7f3a380b1750 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 -- 172.21.15.18:0/2326445773 >> 172.21.15.18:0/2326445773 conn(0x7f3a38066fa0 msgr2=0x7f3a3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:38.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 -- 172.21.15.18:0/2326445773 shutdown_connections 2024-04-25T10:14:38.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.119+0000 7f3a40000640 1 -- 172.21.15.18:0/2326445773 wait complete. 2024-04-25T10:14:38.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 Processor -- start 2024-04-25T10:14:38.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 -- start start 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 0x7f3a381421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 0x7f3a38141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a380cdbe0 con 0x7f3a380b1c90 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3815f930 con 0x7f3a38145270 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a380cdd60 con 0x7f3a3815fe50 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 0x7f3a381421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:38.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:38.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:50192/0 (socket says 172.21.15.18:50192) 2024-04-25T10:14:38.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3cc00640 1 -- 172.21.15.18:0/1262078033 learned_addr learned my addr 172.21.15.18:0/1262078033 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:38.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3e000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 0x7f3a38141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:38.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 -- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 msgr2=0x7f3a38141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 0x7f3a38141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 -- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 msgr2=0x7f3a38163420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 -- 172.21.15.18:0/1262078033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38163b40 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3cc00640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3e000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 0x7f3a38141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a3d600640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 0x7f3a381421b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c001ec0 tx=0x7f3a2c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c017070 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0052d0 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c003840 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.123+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a38163e20 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a381643e0 con 0x7f3a380b1c90 2024-04-25T10:14:38.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a380745d0 con 0x7f3a380b1c90 2024-04-25T10:14:38.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a2c01a070 con 0x7f3a380b1c90 2024-04-25T10:14:38.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a35600640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 0x7f3a18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:38.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3a2c084480 con 0x7f3a380b1c90 2024-04-25T10:14:38.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a3cc00640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 0x7f3a18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:38.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.127+0000 7f3a3cc00640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 0x7f3a18069420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097c0 tx=0x7f3a24008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:38.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.131+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a2c005480 con 0x7f3a380b1c90 2024-04-25T10:14:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.327+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a3806b8e0 con 0x7f3a380b1c90 2024-04-25T10:14:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.327+0000 7f3a35600640 1 -- 172.21.15.18:0/1262078033 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f3a2c054c50 con 0x7f3a380b1c90 2024-04-25T10:14:38.337 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:38.337 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:37.957728+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37499":{"gid":37499,"name":"d","rank":0,"incarnation":104,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6837/1299067697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1299067697},{"type":"v1","addr":"172.21.15.167:6837","nonce":1299067697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 104 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 msgr2=0x7f3a18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 0x7f3a18069420 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f3a240097c0 tx=0x7f3a24008040 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 msgr2=0x7f3a381421b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 0x7f3a381421b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c001ec0 tx=0x7f3a2c00c890 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 shutdown_connections 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3a18066f60 0x7f3a18069420 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f3a3815fe50 0x7f3a38141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3a38145270 0x7f3a38163420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 --2- 172.21.15.18:0/1262078033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a380b1c90 0x7f3a381421b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:38.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 >> 172.21.15.18:0/1262078033 conn(0x7f3a38066fa0 msgr2=0x7f3a3806e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 shutdown_connections 2024-04-25T10:14:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:38.331+0000 7f3a40000640 1 -- 172.21.15.18:0/1262078033 wait complete. 2024-04-25T10:14:38.763 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:37.957728+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37499': {'gid': 37499, 'name': 'd', 'rank': 0, 'incarnation': 104, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/1299067697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 1299067697}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1299067697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:38.764 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37499:up:replay 2024-04-25T10:14:39.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.907+0000 7f552b200640 1 Processor -- start 2024-04-25T10:14:39.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.907+0000 7f552b200640 1 -- start start 2024-04-25T10:14:39.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f552b200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55240b1e60 0x7f552415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f552b200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240cc4e0 con 0x7f5524145270 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f552b200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55240ce040 con 0x7f552415fe50 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f552b200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5524145650 con 0x7f55240b1e60 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5529200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f55240b1e60 0x7f552415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5523e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5524145270 0x7f55240cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:32964/0 (socket says 172.21.15.18:32964) 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5523e00640 1 -- 172.21.15.18:0/3795375187 learned_addr learned my addr 172.21.15.18:0/3795375187 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5529200640 1 -- 172.21.15.18:0/3795375187 >> v1:172.21.15.167:6789/0 conn(0x7f552415fe50 legacy=0x7f55240b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5529200640 1 -- 172.21.15.18:0/3795375187 >> v1:172.21.15.18:6789/0 conn(0x7f5524145270 legacy=0x7f55240cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:39.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.911+0000 7f5529200640 1 -- 172.21.15.18:0/3795375187 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240ce320 con 0x7f55240b1e60 2024-04-25T10:14:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f5529200640 1 --2- 172.21.15.18:0/3795375187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55240b1e60 0x7f552415bd80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac061c18da4a04d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f5523400640 1 -- 172.21.15.18:0/3795375187 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0b2070 con 0x7f55240b1e60 2024-04-25T10:14:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f5523400640 1 -- 172.21.15.18:0/3795375187 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0a5920 con 0x7f55240b1e60 2024-04-25T10:14:39.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f5523400640 1 -- 172.21.15.18:0/3795375187 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0a5cf0 con 0x7f55240b1e60 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- 172.21.15.18:0/3795375187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55240b1e60 msgr2=0x7f552415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 --2- 172.21.15.18:0/3795375187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55240b1e60 0x7f552415bd80 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f551c009d90 tx=0x7f551c01c970 comp rx=0 tx=0).stop 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- 172.21.15.18:0/3795375187 shutdown_connections 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 --2- 172.21.15.18:0/3795375187 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f55240b1e60 0x7f552415bd80 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- 172.21.15.18:0/3795375187 >> 172.21.15.18:0/3795375187 conn(0x7f5524066fa0 msgr2=0x7f552406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- 172.21.15.18:0/3795375187 shutdown_connections 2024-04-25T10:14:39.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- 172.21.15.18:0/3795375187 wait complete. 2024-04-25T10:14:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 Processor -- start 2024-04-25T10:14:39.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.915+0000 7f552b200640 1 -- start start 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 0x7f55240b37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5524145270 0x7f55240b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240cdd60 con 0x7f552415fe50 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55240cdbe0 con 0x7f5524145270 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5524169720 con 0x7f55240b1e60 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42928/0 (socket says 172.21.15.18:42928) 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 -- 172.21.15.18:0/2006789819 learned_addr learned my addr 172.21.15.18:0/2006789819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f551be00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5524145270 0x7f55240b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5523e00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 0x7f55240b37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:39.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 -- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 msgr2=0x7f55240b37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 0x7f55240b37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 -- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5524145270 msgr2=0x7f55240b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5524145270 0x7f55240b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 -- 172.21.15.18:0/2006789819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55240b1190 con 0x7f552415fe50 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5523e00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 0x7f55240b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5529200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f551c0b0040 tx=0x7f551c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0b2050 con 0x7f552415fe50 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0be070 con 0x7f552415fe50 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0adad0 con 0x7f552415fe50 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55240b1470 con 0x7f552415fe50 2024-04-25T10:14:39.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55240aff20 con 0x7f552415fe50 2024-04-25T10:14:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55240745d0 con 0x7f552415fe50 2024-04-25T10:14:39.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.919+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f551c0adc70 con 0x7f552415fe50 2024-04-25T10:14:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.923+0000 7f5520c00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 0x7f5500069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.923+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f551c11fee0 con 0x7f552415fe50 2024-04-25T10:14:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.923+0000 7f5523e00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 0x7f5500069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:39.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.923+0000 7f5523e00640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 0x7f5500069450 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5514005890 tx=0x7f5514009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:39.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:39.927+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f551c0c7020 con 0x7f552415fe50 2024-04-25T10:14:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f552406b8e0 con 0x7f552415fe50 2024-04-25T10:14:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f5520c00640 1 -- 172.21.15.18:0/2006789819 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f551c016560 con 0x7f552415fe50 2024-04-25T10:14:40.131 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:40.131 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:38.970066+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37499":{"gid":37499,"name":"d","rank":0,"incarnation":104,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.167:6837/1299067697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1299067697},{"type":"v1","addr":"172.21.15.167:6837","nonce":1299067697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 106 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 msgr2=0x7f5500069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 0x7f5500069450 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5514005890 tx=0x7f5514009040 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 msgr2=0x7f55240acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f551c0b0040 tx=0x7f551c019710 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 shutdown_connections 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f552415fe50 0x7f55240acb40 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5524145270 0x7f55240b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5500066f90 0x7f5500069450 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 --2- 172.21.15.18:0/2006789819 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f55240b1e60 0x7f55240b37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 >> 172.21.15.18:0/2006789819 conn(0x7f5524066fa0 msgr2=0x7f552413dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 shutdown_connections 2024-04-25T10:14:40.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:40.123+0000 7f552b200640 1 -- 172.21.15.18:0/2006789819 wait complete. 2024-04-25T10:14:40.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:38.970066+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37499': {'gid': 37499, 'name': 'd', 'rank': 0, 'incarnation': 104, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.167:6837/1299067697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 1299067697}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1299067697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:40.557 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37499:up:rejoin 2024-04-25T10:14:41.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:41.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 Processor -- start 2024-04-25T10:14:41.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 -- start start 2024-04-25T10:14:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4450070cb0 0x7f44500b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44500ce610 con 0x7f445006cae0 2024-04-25T10:14:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44500704b0 con 0x7f4450070cb0 2024-04-25T10:14:41.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4456c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44500715d0 con 0x7f4450070030 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48190/0 (socket says 172.21.15.18:48190) 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 -- 172.21.15.18:0/1165713855 learned_addr learned my addr 172.21.15.18:0/1165713855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4454c00640 1 --1- 172.21.15.18:0/1165713855 >> v1:172.21.15.167:6789/0 conn(0x7f445006cae0 0x7f445006cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58452/0 (socket says 172.21.15.18:58452) 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f444fe00640 1 --2- 172.21.15.18:0/1165713855 >> v2:172.21.15.167:3300/0 conn(0x7f4450070cb0 0x7f44500b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 -- 172.21.15.18:0/1165713855 >> v2:172.21.15.167:3300/0 conn(0x7f4450070cb0 msgr2=0x7f44500b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 --2- 172.21.15.18:0/1165713855 >> v2:172.21.15.167:3300/0 conn(0x7f4450070cb0 0x7f44500b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 -- 172.21.15.18:0/1165713855 >> v1:172.21.15.167:6789/0 conn(0x7f445006cae0 legacy=0x7f445006cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.703+0000 7f4447e00640 1 -- 172.21.15.18:0/1165713855 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500b56f0 con 0x7f4450070030 2024-04-25T10:14:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4447e00640 1 --2- 172.21.15.18:0/1165713855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4438009870 tx=0x7f443801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61ca59c5506f6e7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f444f400640 1 -- 172.21.15.18:0/1165713855 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380b0070 con 0x7f4450070030 2024-04-25T10:14:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f444f400640 1 -- 172.21.15.18:0/1165713855 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44380ab600 con 0x7f4450070030 2024-04-25T10:14:41.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f444f400640 1 -- 172.21.15.18:0/1165713855 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380ab9d0 con 0x7f4450070030 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 -- 172.21.15.18:0/1165713855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 msgr2=0x7f4450071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 --2- 172.21.15.18:0/1165713855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4438009870 tx=0x7f443801c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 -- 172.21.15.18:0/1165713855 shutdown_connections 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 --2- 172.21.15.18:0/1165713855 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070030 0x7f4450071090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 --2- 172.21.15.18:0/1165713855 >> v2:172.21.15.167:3300/0 conn(0x7f4450070cb0 0x7f44500b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 -- 172.21.15.18:0/1165713855 >> 172.21.15.18:0/1165713855 conn(0x7f445006f510 msgr2=0x7f445006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:41.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 -- 172.21.15.18:0/1165713855 shutdown_connections 2024-04-25T10:14:41.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.707+0000 7f4456c00640 1 -- 172.21.15.18:0/1165713855 wait complete. 2024-04-25T10:14:41.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 Processor -- start 2024-04-25T10:14:41.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 -- start start 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 0x7f44501f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070cb0 0x7f4450154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445016a610 con 0x7f445006cae0 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445006c5c0 con 0x7f4450070030 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445016a790 con 0x7f4450070cb0 2024-04-25T10:14:41.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36848/0 (socket says 172.21.15.18:36848) 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 -- 172.21.15.18:0/512999328 learned_addr learned my addr 172.21.15.18:0/512999328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4454c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070cb0 0x7f4450154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4447e00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 0x7f44501f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 -- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070cb0 msgr2=0x7f4450154c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070cb0 0x7f4450154c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 -- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 msgr2=0x7f44501f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 0x7f44501f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 -- 172.21.15.18:0/512999328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44500cb220 con 0x7f445006cae0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4447e00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 0x7f44501f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444fe00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f444000e870 tx=0x7f444000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440017070 con 0x7f445006cae0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444000c940 con 0x7f445006cae0 2024-04-25T10:14:41.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444000ccf0 con 0x7f445006cae0 2024-04-25T10:14:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.711+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44500cb500 con 0x7f445006cae0 2024-04-25T10:14:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44500cbac0 con 0x7f445006cae0 2024-04-25T10:14:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44500745d0 con 0x7f445006cae0 2024-04-25T10:14:41.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f444001a070 con 0x7f445006cae0 2024-04-25T10:14:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f444cc00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 0x7f442c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4440085440 con 0x7f445006cae0 2024-04-25T10:14:41.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.715+0000 7f4447e00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 0x7f442c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:41.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.719+0000 7f4447e00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 0x7f442c069450 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f44380ad000 tx=0x7f4438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:41.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.719+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4440056260 con 0x7f445006cae0 2024-04-25T10:14:41.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.915+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44500b5ad0 con 0x7f445006cae0 2024-04-25T10:14:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f444cc00640 1 -- 172.21.15.18:0/512999328 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4949 (secure 0 0 0) 0x7f4440055b60 con 0x7f445006cae0 2024-04-25T10:14:41.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:41.926 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":107,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:39.974386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37499":{"gid":37499,"name":"d","rank":0,"incarnation":104,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/1299067697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1299067697},{"type":"v1","addr":"172.21.15.167:6837","nonce":1299067697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:41.926 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 107 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 msgr2=0x7f442c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 0x7f442c069450 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f44380ad000 tx=0x7f4438008040 comp rx=0 tx=0).stop 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 msgr2=0x7f44500caa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f444000e870 tx=0x7f444000ec70 comp rx=0 tx=0).stop 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 shutdown_connections 2024-04-25T10:14:41.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f442c066f90 0x7f442c069450 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4450070cb0 0x7f4450154c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4450070030 0x7f44501f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 --2- 172.21.15.18:0/512999328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f445006cae0 0x7f44500caa80 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 >> 172.21.15.18:0/512999328 conn(0x7f445006f510 msgr2=0x7f44500d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 shutdown_connections 2024-04-25T10:14:41.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:41.919+0000 7f4456c00640 1 -- 172.21.15.18:0/512999328 wait complete. 2024-04-25T10:14:42.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 107, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:39.974386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 124, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37499}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37499': {'gid': 37499, 'name': 'd', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.167:6837/1299067697', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6835', 'nonce': 1299067697}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 1299067697}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:42.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:14:42.351 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-25T10:14:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 Processor -- start 2024-04-25T10:14:42.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 -- start start 2024-04-25T10:14:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 0x7f651806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f651815af40 0x7f65180cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651815e9a0 con 0x7f6518150f40 2024-04-25T10:14:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f651806f530 con 0x7f651815af40 2024-04-25T10:14:42.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.487+0000 7f651e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651815dbe0 con 0x7f6518072210 2024-04-25T10:14:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6518150f40 0x7f6518071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36694/0 (socket says 172.21.15.18:36694) 2024-04-25T10:14:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517400640 1 -- 172.21.15.18:0/645272718 learned_addr learned my addr 172.21.15.18:0/645272718 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 --2- 172.21.15.18:0/645272718 >> v2:172.21.15.167:3300/0 conn(0x7f651815af40 0x7f65180cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f650ea00640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 0x7f651806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6516a00640 1 -- 172.21.15.18:0/645272718 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147136105 0 0) 0x7f651815e9a0 con 0x7f6518150f40 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6516a00640 1 -- 172.21.15.18:0/645272718 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64fc003530 con 0x7f6518150f40 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 -- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 msgr2=0x7f651806ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 0x7f651806ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 -- 172.21.15.18:0/645272718 >> v1:172.21.15.18:6789/0 conn(0x7f6518150f40 legacy=0x7f6518071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 -- 172.21.15.18:0/645272718 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651815dec0 con 0x7f651815af40 2024-04-25T10:14:42.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f650ea00640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 0x7f651806ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:42.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.491+0000 7f6517e00640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651815af40 0x7f65180cdcc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f651000aea0 tx=0x7f651001d950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bd450d0b0baad9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6516a00640 1 -- 172.21.15.18:0/645272718 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100a65b0 con 0x7f651815af40 2024-04-25T10:14:42.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6516a00640 1 -- 172.21.15.18:0/645272718 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65100a6750 con 0x7f651815af40 2024-04-25T10:14:42.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6516a00640 1 -- 172.21.15.18:0/645272718 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65100a6b20 con 0x7f651815af40 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651815af40 msgr2=0x7f65180cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651815af40 0x7f65180cdcc0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f651000aea0 tx=0x7f651001d950 comp rx=0 tx=0).stop 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- 172.21.15.18:0/645272718 shutdown_connections 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f651815af40 0x7f65180cdcc0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- 172.21.15.18:0/645272718 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6518072210 0x7f651806ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- 172.21.15.18:0/645272718 >> 172.21.15.18:0/645272718 conn(0x7f6518067080 msgr2=0x7f651806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- 172.21.15.18:0/645272718 shutdown_connections 2024-04-25T10:14:42.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- 172.21.15.18:0/645272718 wait complete. 2024-04-25T10:14:42.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 Processor -- start 2024-04-25T10:14:42.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- start start 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6518150f40 0x7f65181f4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651815af40 0x7f651814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65180ce380 con 0x7f6518072210 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65180ce200 con 0x7f6518150f40 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f651e000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65180ce500 con 0x7f651815af40 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36852/0 (socket says 172.21.15.18:36852) 2024-04-25T10:14:42.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6517400640 1 -- 172.21.15.18:0/927716361 learned_addr learned my addr 172.21.15.18:0/927716361 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f650ea00640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6518150f40 0x7f65181f4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.495+0000 7f6517e00640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651815af40 0x7f651814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 -- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651815af40 msgr2=0x7f651814d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651815af40 0x7f651814d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 -- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6518150f40 msgr2=0x7f65181f4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6518150f40 0x7f65181f4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 -- 172.21.15.18:0/927716361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651814db10 con 0x7f6518072210 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f6517400640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f650800c450 tx=0x7f650800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f650fe00640 1 -- 172.21.15.18:0/927716361 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508017070 con 0x7f6518072210 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f650fe00640 1 -- 172.21.15.18:0/927716361 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6508005cf0 con 0x7f6518072210 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f650fe00640 1 -- 172.21.15.18:0/927716361 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508007290 con 0x7f6518072210 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65181f4b40 con 0x7f6518072210 2024-04-25T10:14:42.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65181f5100 con 0x7f6518072210 2024-04-25T10:14:42.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.499+0000 7f650fe00640 1 -- 172.21.15.18:0/927716361 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f650801a070 con 0x7f6518072210 2024-04-25T10:14:42.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650fe00640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 0x7f64f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650fe00640 1 -- 172.21.15.18:0/927716361 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6508084610 con 0x7f6518072210 2024-04-25T10:14:42.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 Processor -- start 2024-04-25T10:14:42.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- start start 2024-04-25T10:14:42.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650ea00640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 0x7f64f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75109f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c7511310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c73f85f0 con 0x55c3c755a920 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c735fda0 con 0x55c3c755b240 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c72e8150 con 0x55c3c7510f30 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650ea00640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 0x7f64f4069420 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6500009580 tx=0x7f6500009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36868/0 (socket says 172.21.15.18:36868) 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 -- 172.21.15.18:0/2165026045 learned_addr learned my addr 172.21.15.18:0/2165026045 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650ea00640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517e00640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c7511310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 -- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 msgr2=0x55c3c7511310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c7511310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 -- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 msgr2=0x55c3c75109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 -- 172.21.15.18:0/2165026045 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c7301ca0 con 0x55c3c755a920 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f650ea00640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517e00640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c7511310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6517400640 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6508000f40 tx=0x7f65080549c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f63fd72bd9b8b48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6507e00640 1 -- 172.21.15.18:0/2165026045 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650805b0c0 con 0x55c3c755a920 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6507e00640 1 -- 172.21.15.18:0/2165026045 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080513c0 con 0x55c3c755a920 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f6507e00640 1 -- 172.21.15.18:0/2165026045 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650805d120 con 0x55c3c755a920 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- 172.21.15.18:0/2165026045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 msgr2=0x55c3c755ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f6508000f40 tx=0x7f65080549c0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- 172.21.15.18:0/2165026045 shutdown_connections 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c7511310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 --2- 172.21.15.18:0/2165026045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c755ad00 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- 172.21.15.18:0/2165026045 >> 172.21.15.18:0/2165026045 conn(0x55c3c75172a0 msgr2=0x55c3c750f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- 172.21.15.18:0/2165026045 shutdown_connections 2024-04-25T10:14:42.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.503+0000 7f65214db000 1 -- 172.21.15.18:0/2165026045 wait complete. 2024-04-25T10:14:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- start start 2024-04-25T10:14:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 Processor -- start 2024-04-25T10:14:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 0x55c3c75621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c7514aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c731a990 con 0x55c3c7510f30 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c735be40 con 0x55c3c755b240 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c72eb900 con 0x55c3c755a920 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 10 client.0 _ll_register_callbacks cb 0x55c3c74131c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36882/0 (socket says 172.21.15.18:36882) 2024-04-25T10:14:42.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 -- 172.21.15.18:0/7787324 learned_addr learned my addr 172.21.15.18:0/7787324 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f650ea00640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 0x55c3c75621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517e00640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c7514aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 -- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 msgr2=0x55c3c75621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 0x55c3c75621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 -- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 msgr2=0x55c3c7514aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c7514aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 -- 172.21.15.18:0/7787324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3c7318630 con 0x55c3c7510f30 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f650ea00640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 0x55c3c75621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:42.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6517400640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f650805d570 tx=0x7f6508082790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6e49bd3d9f6232 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650805b0c0 con 0x55c3c7510f30 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6508081cd0 con 0x55c3c7510f30 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65080513c0 con 0x55c3c7510f30 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65080840e0 con 0x55c3c7510f30 2024-04-25T10:14:42.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 10 client.9357 fetch_fsmap learned FSMap version 107 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x55c3c72e83a0 con 0x55c3c7510f30 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080513c0 con 0x55c3c7510f30 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 107) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6508084280 con 0x55c3c7510f30 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 10 client.9357 fetch_fsmap finished waiting for FSMap version 107 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 10 client.9357 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 20 client.9357 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:42.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c75154b0 0x55c3c7515890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 4 client.9357 mds_command: new command op to 37499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 --> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3c72fba50 con 0x55c3c75154b0 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.507+0000 7f650ea00640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c75154b0 0x55c3c7515890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f650ea00640 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c75154b0 0x55c3c7515890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f417e7f94aa18723 server_cookie=58df24466011f1a3 in_seq=0 out_seq=0 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f6504c00640 10 client.9357 ms_handle_connect on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:42.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f6504c00640 1 -- 172.21.15.18:0/7787324 <== mds.0 v2:172.21.15.167:6835/1299067697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3c72fba50 con 0x55c3c75154b0 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f6504c00640 10 client.9357 handle_command_reply: tid=0 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 client.9357 shutdown 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 msgr2=0x55c3c7561c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f650805d570 tx=0x7f6508082790 comp rx=0 tx=0).stop 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 shutdown_connections 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c7514aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c75154b0 0x55c3c7515890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755a920 0x55c3c75621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 --2- 172.21.15.18:0/7787324 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c7510f30 0x55c3c7561c80 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f6504c00640 0 client.9357 ms_handle_reset on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 >> 172.21.15.18:0/7787324 conn(0x55c3c75172a0 msgr2=0x55c3c750f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 shutdown_connections 2024-04-25T10:14:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 1 -- 172.21.15.18:0/7787324 wait complete. 2024-04-25T10:14:42.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.511+0000 7f65214db000 20 client.9357 trim_cache size 0 max 16384 2024-04-25T10:14:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 Processor -- start 2024-04-25T10:14:42.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- start start 2024-04-25T10:14:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c75b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518200120 con 0x55c3c755a920 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6518155490 con 0x55c3c755b240 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65181ffc80 con 0x55c3c7510f30 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36888/0 (socket says 172.21.15.18:36888) 2024-04-25T10:14:42.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 -- 172.21.15.18:0/1416500014 learned_addr learned my addr 172.21.15.18:0/1416500014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 -- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 msgr2=0x55c3c75b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c75b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 -- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 msgr2=0x55c3c75b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 -- 172.21.15.18:0/1416500014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3c755b070 con 0x55c3c755a920 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f650ea00640 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x55c3c7329de0 tx=0x7f6500014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daffbb4a2acc16d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f6507400640 1 -- 172.21.15.18:0/1416500014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650002e070 con 0x55c3c755a920 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f6507400640 1 -- 172.21.15.18:0/1416500014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650001b030 con 0x55c3c755a920 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f6507400640 1 -- 172.21.15.18:0/1416500014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000039a0 con 0x55c3c755a920 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- 172.21.15.18:0/1416500014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 msgr2=0x55c3c75b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x55c3c7329de0 tx=0x7f6500014000 comp rx=0 tx=0).stop 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- 172.21.15.18:0/1416500014 shutdown_connections 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c755b240 0x55c3c75b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75b6510 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 --2- 172.21.15.18:0/1416500014 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c7510f30 0x55c3c75b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- 172.21.15.18:0/1416500014 >> 172.21.15.18:0/1416500014 conn(0x55c3c75172a0 msgr2=0x55c3c7514470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- 172.21.15.18:0/1416500014 shutdown_connections 2024-04-25T10:14:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.527+0000 7f65214db000 1 -- 172.21.15.18:0/1416500014 wait complete. 2024-04-25T10:14:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- start start 2024-04-25T10:14:42.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 Processor -- start 2024-04-25T10:14:42.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c7510f30 0x55c3c75679c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755b240 0x55c3c75ba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c73643d0 con 0x55c3c755a920 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3c741bd50 con 0x55c3c7510f30 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3c72fa980 con 0x55c3c755b240 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 10 client.0 _ll_register_callbacks cb 0x7f64fc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36902/0 (socket says 172.21.15.18:36902) 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 -- 172.21.15.18:0/335180397 learned_addr learned my addr 172.21.15.18:0/335180397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6517400640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c7510f30 0x55c3c75679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6517e00640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755b240 0x55c3c75ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 -- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755b240 msgr2=0x55c3c75ba780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755b240 0x55c3c75ba780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 -- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c7510f30 msgr2=0x55c3c75679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c7510f30 0x55c3c75679c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 -- 172.21.15.18:0/335180397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3c73e1600 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f650ea00640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f650002c040 tx=0x7f6500004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54964ad6dbbf0483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500038020 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6500003dd0 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f650001b030 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f650002e040 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 10 client.9363 fetch_fsmap learned FSMap version 107 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x55c3c72f49b0 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650001b030 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 107) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f650003d400 con 0x55c3c755a920 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 10 client.9363 fetch_fsmap finished waiting for FSMap version 107 2024-04-25T10:14:42.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 10 client.9363 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 20 client.9363 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c7567f00 0x55c3c75763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 4 client.9363 mds_command: new command op to 37499 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 --> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c3c736d2e0 con 0x55c3c7567f00 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.531+0000 7f6517400640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c7567f00 0x55c3c75763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f6517400640 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c7567f00 0x55c3c75763a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c002572ab350a9e server_cookie=a480d9ae7ca5eddf in_seq=0 out_seq=0 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f6504c00640 10 client.9363 ms_handle_connect on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f6504c00640 1 -- 172.21.15.18:0/335180397 <== mds.0 v2:172.21.15.167:6835/1299067697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55c3c736d2e0 con 0x55c3c7567f00 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f6504c00640 10 client.9363 handle_command_reply: tid=0 2024-04-25T10:14:42.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 client.9363 shutdown 2024-04-25T10:14:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 msgr2=0x55c3c75ba240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f650002c040 tx=0x7f6500004740 comp rx=0 tx=0).stop 2024-04-25T10:14:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 shutdown_connections 2024-04-25T10:14:42.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x55c3c7567f00 0x55c3c75763a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55c3c755b240 0x55c3c75ba780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c3c755a920 0x55c3c75ba240 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 --2- 172.21.15.18:0/335180397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c3c7510f30 0x55c3c75679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f6504c00640 0 client.9363 ms_handle_reset on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 >> 172.21.15.18:0/335180397 conn(0x55c3c75172a0 msgr2=0x55c3c7558300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 shutdown_connections 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 1 -- 172.21.15.18:0/335180397 wait complete. 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f65214db000 20 client.9363 trim_cache size 0 max 16384 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:42.546 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 37499, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.5727034609999997, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 107, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 124, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 124, 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 5.510717401 2024-04-25T10:14:42.547 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 msgr2=0x7f64f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 0x7f64f4069420 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6500009580 tx=0x7f6500009190 comp rx=0 tx=0).stop 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 msgr2=0x7f6518149e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f650800c450 tx=0x7f650800c910 comp rx=0 tx=0).stop 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 shutdown_connections 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64f4066f60 0x7f64f4069420 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f651815af40 0x7f651814d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6518150f40 0x7f65181f4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 --2- 172.21.15.18:0/927716361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6518072210 0x7f6518149e40 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 >> 172.21.15.18:0/927716361 conn(0x7f6518067080 msgr2=0x7f6518150200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 shutdown_connections 2024-04-25T10:14:42.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.535+0000 7f651e000640 1 -- 172.21.15.18:0/927716361 wait complete. 2024-04-25T10:14:42.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:14:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 Processor -- start 2024-04-25T10:14:42.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 -- start start 2024-04-25T10:14:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c4815a6c0 0x7f2c4815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4815f0d0 con 0x7f2c480b3700 2024-04-25T10:14:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4815aaa0 con 0x7f2c4815a6c0 2024-04-25T10:14:42.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c4d000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480b40e0 con 0x7f2c480d0cd0 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c45e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c4815a6c0 0x7f2c4815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48258/0 (socket says 172.21.15.18:48258) 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 -- 172.21.15.18:0/360654913 learned_addr learned my addr 172.21.15.18:0/360654913 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c3d400640 1 --1- 172.21.15.18:0/360654913 >> v1:172.21.15.167:6789/0 conn(0x7f2c480b3700 0x7f2c480d05c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58466/0 (socket says 172.21.15.18:58466) 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 -- 172.21.15.18:0/360654913 >> v2:172.21.15.167:3300/0 conn(0x7f2c4815a6c0 msgr2=0x7f2c4815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 --2- 172.21.15.18:0/360654913 >> v2:172.21.15.167:3300/0 conn(0x7f2c4815a6c0 0x7f2c4815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 -- 172.21.15.18:0/360654913 >> v1:172.21.15.167:6789/0 conn(0x7f2c480b3700 legacy=0x7f2c480d05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.695+0000 7f2c46800640 1 -- 172.21.15.18:0/360654913 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480b43c0 con 0x7f2c480d0cd0 2024-04-25T10:14:42.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c46800640 1 --2- 172.21.15.18:0/360654913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61015657399325e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c45400640 1 -- 172.21.15.18:0/360654913 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400a5700 con 0x7f2c480d0cd0 2024-04-25T10:14:42.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c45400640 1 -- 172.21.15.18:0/360654913 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400a58a0 con 0x7f2c480d0cd0 2024-04-25T10:14:42.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c45400640 1 -- 172.21.15.18:0/360654913 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400a5c70 con 0x7f2c480d0cd0 2024-04-25T10:14:42.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 -- 172.21.15.18:0/360654913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 msgr2=0x7f2c480ce550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 --2- 172.21.15.18:0/360654913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009e50 tx=0x7f2c4001ca30 comp rx=0 tx=0).stop 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 -- 172.21.15.18:0/360654913 shutdown_connections 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 --2- 172.21.15.18:0/360654913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c480ce550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 --2- 172.21.15.18:0/360654913 >> v2:172.21.15.167:3300/0 conn(0x7f2c4815a6c0 0x7f2c4815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 -- 172.21.15.18:0/360654913 >> 172.21.15.18:0/360654913 conn(0x7f2c480b2400 msgr2=0x7f2c480b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 -- 172.21.15.18:0/360654913 shutdown_connections 2024-04-25T10:14:42.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.699+0000 7f2c4d000640 1 -- 172.21.15.18:0/360654913 wait complete. 2024-04-25T10:14:42.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 Processor -- start 2024-04-25T10:14:42.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- start start 2024-04-25T10:14:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c48153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c4815a6c0 0x7f2c481502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4806ad90 con 0x7f2c480b3700 2024-04-25T10:14:42.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4806ac10 con 0x7f2c4815a6c0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4806af10 con 0x7f2c480d0cd0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36916/0 (socket says 172.21.15.18:36916) 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 -- 172.21.15.18:0/2539471265 learned_addr learned my addr 172.21.15.18:0/2539471265 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c46800640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c4815a6c0 0x7f2c481502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c3d400640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c48153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 -- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 msgr2=0x7f2c48153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c48153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 -- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c4815a6c0 msgr2=0x7f2c481502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c4815a6c0 0x7f2c481502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 -- 172.21.15.18:0/2539471265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480b13f0 con 0x7f2c480b3700 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c45e00640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800e9d0 tx=0x7f2c3800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800de60 con 0x7f2c480b3700 2024-04-25T10:14:42.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c38010440 con 0x7f2c480b3700 2024-04-25T10:14:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c380107f0 con 0x7f2c480b3700 2024-04-25T10:14:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4813f620 con 0x7f2c480b3700 2024-04-25T10:14:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.703+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c48159290 con 0x7f2c480b3700 2024-04-25T10:14:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c480745d0 con 0x7f2c480b3700 2024-04-25T10:14:42.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2c38010990 con 0x7f2c480b3700 2024-04-25T10:14:42.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c3ea00640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 0x7f2c24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:42.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2c38085a80 con 0x7f2c480b3700 2024-04-25T10:14:42.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c3d400640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 0x7f2c24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:42.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.707+0000 7f2c3d400640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 0x7f2c24069420 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2c481f9de0 tx=0x7f2c30007e90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:42.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.711+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2c38087e20 con 0x7f2c480b3700 2024-04-25T10:14:42.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c4806d360 con 0x7f2c480b3700 2024-04-25T10:14:42.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c3ea00640 1 -- 172.21.15.18:0/2539471265 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v107) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2c38014030 con 0x7f2c480b3700 2024-04-25T10:14:42.915 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 msgr2=0x7f2c24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 0x7f2c24069420 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2c481f9de0 tx=0x7f2c30007e90 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 msgr2=0x7f2c4813f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800e9d0 tx=0x7f2c3800ee90 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 shutdown_connections 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c4815a6c0 0x7f2c481502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c24066f60 0x7f2c24069420 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c480d0cd0 0x7f2c48153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 --2- 172.21.15.18:0/2539471265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c480b3700 0x7f2c4813f0e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 >> 172.21.15.18:0/2539471265 conn(0x7f2c480b2400 msgr2=0x7f2c480cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:42.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 shutdown_connections 2024-04-25T10:14:42.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:42.907+0000 7f2c4d000640 1 -- 172.21.15.18:0/2539471265 wait complete. 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:14:42.937 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:42.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:42.938 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:14:42.948 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41822sec preferred_lft 41822sec 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.949 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:14:42.950 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:42.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:42.951 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:14:42.971 INFO:tasks.ceph.mds.d.smithi167.stderr:2024-04-25T10:14:42.967+0000 7fc302800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:14:43.011 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:43.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.014 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:14:43.066 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:14:43.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.067 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:14:43.067 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:14:43.067 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:14:43.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:14:43.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:14:43.068 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:14:43.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.163 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:14:43.172 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:14:43.173 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:14:43.173 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:43.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.173 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:14:43.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:43.238 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:43.293 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:43.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:43.293 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:43.344 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:14:43.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.345 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:43.434 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:43.434 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:43.447 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:43.447 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:43.447 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:14:43.447 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:14:43.447 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:14:43.452 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:14:43.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:43.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.473 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:14:43.529 INFO:teuthology.orchestra.run.smithi018.stdout:client8602 2024-04-25T10:14:43.529 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:43.529 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:43.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:43.581 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:14:43.638 INFO:teuthology.orchestra.run.smithi018.stdout:./ 2024-04-25T10:14:43.638 INFO:teuthology.orchestra.run.smithi018.stdout:./parent 2024-04-25T10:14:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed 2024-04-25T10:14:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/charlie 2024-04-25T10:14:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/alpha 2024-04-25T10:14:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/unflushed 2024-04-25T10:14:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/unflushed/jfile 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:14:43.640 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:43.750 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:43.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:43.759 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:43.760 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:43.760 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:43.760 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:43.760 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:14:43.760 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:43.867 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:14:43.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:43.876 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:43.876 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:43.876 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:43.876 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:43.876 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:14:43.877 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:43.987 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:14:43.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:14:43.997 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:44.106 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627780 2024-04-25T10:14:44.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:14:44.115 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:44.227 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627778 2024-04-25T10:14:44.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:14:44.236 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:44.342 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627781 2024-04-25T10:14:44.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:44.458 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627782 2024-04-25T10:14:44.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:44.468 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:44.468 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:44.518 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:44.518 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:44.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:44.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.743+0000 7fe74b800640 1 Processor -- start 2024-04-25T10:14:44.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.743+0000 7fe74b800640 1 -- start start 2024-04-25T10:14:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe74b800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7440b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe74b800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7440cf540 con 0x7fe7440b06d0 2024-04-25T10:14:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe74b800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74415b240 con 0x7fe74406e980 2024-04-25T10:14:44.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe74b800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b0b00 con 0x7fe7440b18e0 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe749800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe7440b06d0 0x7fe74406d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36696/0 (socket says 172.21.15.18:36696) 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe749800640 1 -- 172.21.15.18:0/1284193704 learned_addr learned my addr 172.21.15.18:0/1284193704 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe73be00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7440b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39662863 0 0) 0x7fe7440cf540 con 0x7fe7440b06d0 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe728003530 con 0x7fe7440b06d0 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180591070 0 0) 0x7fe74415b240 con 0x7fe74406e980 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7440cf540 con 0x7fe74406e980 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593692459 0 0) 0x7fe728003530 con 0x7fe7440b06d0 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 msgr2=0x7fe7440b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7440b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 >> v1:172.21.15.167:6789/0 conn(0x7fe74406e980 legacy=0x7fe7440cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440ce350 con 0x7fe7440b06d0 2024-04-25T10:14:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fe73c001a00 con 0x7fe7440b06d0 2024-04-25T10:14:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 >> v1:172.21.15.18:6789/0 conn(0x7fe7440b06d0 legacy=0x7fe74406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728003b80 0x7fe728003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728004810 0x7fe728004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7280051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b0b00 con 0x7fe728003b80 2024-04-25T10:14:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe72800cc20 con 0x7fe728004810 2024-04-25T10:14:44.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe72800ce20 con 0x7fe7440b18e0 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728003b80 0x7fe728003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe749800640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7280051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe73be00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728004810 0x7fe728004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 -- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 msgr2=0x7fe7280051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe7440b18e0 0x7fe7280051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 -- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728004810 msgr2=0x7fe728004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728004810 0x7fe728004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.747+0000 7fe748e00640 1 -- 172.21.15.18:0/1284193704 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe728003530 con 0x7fe728003b80 2024-04-25T10:14:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe748e00640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728003b80 0x7fe728003f80 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe7340018d0 tx=0x7fe73401c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663368a7d996bcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7340b0070 con 0x7fe728003b80 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7340052f0 con 0x7fe728003b80 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe743e00640 1 -- 172.21.15.18:0/1284193704 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734001520 con 0x7fe728003b80 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 -- 172.21.15.18:0/1284193704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728003b80 msgr2=0x7fe728003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 --2- 172.21.15.18:0/1284193704 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728003b80 0x7fe728003f80 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fe7340018d0 tx=0x7fe73401c550 comp rx=0 tx=0).stop 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe749800640 1 -- 172.21.15.18:0/1284193704 reap_dead start 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 -- 172.21.15.18:0/1284193704 shutdown_connections 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 -- 172.21.15.18:0/1284193704 >> 172.21.15.18:0/1284193704 conn(0x7fe744066fa0 msgr2=0x7fe74406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 -- 172.21.15.18:0/1284193704 shutdown_connections 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 -- 172.21.15.18:0/1284193704 wait complete. 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.751+0000 7fe74b800640 1 Processor -- start 2024-04-25T10:14:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- start start 2024-04-25T10:14:44.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728003b80 0x7fe7440b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 0x7fe7440b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b1e40 con 0x7fe744147fe0 2024-04-25T10:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b1cc0 con 0x7fe728003b80 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74415ae60 con 0x7fe74415c980 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36926/0 (socket says 172.21.15.18:36926) 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 -- 172.21.15.18:0/824374425 learned_addr learned my addr 172.21.15.18:0/824374425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe748e00640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728003b80 0x7fe7440b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe73be00640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 0x7fe7440b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 -- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 msgr2=0x7fe7440b3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 0x7fe7440b3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 -- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728003b80 msgr2=0x7fe7440b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728003b80 0x7fe7440b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 -- 172.21.15.18:0/824374425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440b3ec0 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe73be00640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 0x7fe7440b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe749800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000f90 tx=0x7fe73c00e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00eb70 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00ed30 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c014670 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7440b28e0 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7440b2ea0 con 0x7fe744147fe0 2024-04-25T10:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.755+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7440745d0 con 0x7fe744147fe0 2024-04-25T10:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.759+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe73c014810 con 0x7fe744147fe0 2024-04-25T10:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.759+0000 7fe741600640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 0x7fe720069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.759+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe73c084fb0 con 0x7fe744147fe0 2024-04-25T10:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.759+0000 7fe748e00640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 0x7fe720069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.759+0000 7fe748e00640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 0x7fe720069420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe7340ad000 tx=0x7fe7340a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.763+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe73c055d40 con 0x7fe744147fe0 2024-04-25T10:14:44.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.927+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7440aeec0 con 0x7fe744147fe0 2024-04-25T10:14:44.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.927+0000 7fe741600640 1 -- 172.21.15.18:0/824374425 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+17059 (secure 0 0 0) 0x7fe73c055640 con 0x7fe744147fe0 2024-04-25T10:14:44.936 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:44.937 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":124,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:36.951750+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 msgr2=0x7fe720069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 0x7fe720069420 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe7340ad000 tx=0x7fe7340a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 msgr2=0x7fe74415b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fe73c000f90 tx=0x7fe73c00e160 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 shutdown_connections 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe744147fe0 0x7fe74415b540 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fe720066f60 0x7fe720069420 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fe74415c980 0x7fe7440b3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 --2- 172.21.15.18:0/824374425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728003b80 0x7fe7440b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:44.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 >> 172.21.15.18:0/824374425 conn(0x7fe744066fa0 msgr2=0x7fe74415df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:44.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 shutdown_connections 2024-04-25T10:14:44.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:44.931+0000 7fe74b800640 1 -- 172.21.15.18:0/824374425 wait complete. 2024-04-25T10:14:44.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:14:16.207800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:14:16.774891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:44.958 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:45.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 Processor -- start 2024-04-25T10:14:45.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 -- start start 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35ec144120 0x7f35ec15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f35ec0ccbf0 0x7f35ec15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 0x7f35ec0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec15e490 con 0x7f35ec144120 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ec15bc40 con 0x7f35ec0ccbf0 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35f1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec15b3a0 con 0x7f35ec15ee60 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35ec144120 0x7f35ec15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f35ec144120 0x7f35ec15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36940/0 (socket says 172.21.15.18:36940) 2024-04-25T10:14:45.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 -- 172.21.15.18:0/1843905245 learned_addr learned my addr 172.21.15.18:0/1843905245 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1843905245 >> v2:172.21.15.167:3300/0 conn(0x7f35ec0ccbf0 0x7f35ec15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eb400640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 0x7f35ec0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 -- 172.21.15.18:0/1843905245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 msgr2=0x7f35ec0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 0x7f35ec0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 -- 172.21.15.18:0/1843905245 >> v2:172.21.15.167:3300/0 conn(0x7f35ec0ccbf0 msgr2=0x7f35ec15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1843905245 >> v2:172.21.15.167:3300/0 conn(0x7f35ec0ccbf0 0x7f35ec15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eaa00640 1 -- 172.21.15.18:0/1843905245 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec15b680 con 0x7f35ec144120 2024-04-25T10:14:45.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.095+0000 7f35eb400640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 0x7f35ec0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec15acd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f35ec06b870 tx=0x7f35dc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bee0c72e3311f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35ea000640 1 -- 172.21.15.18:0/1843905245 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0b2070 con 0x7f35ec144120 2024-04-25T10:14:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35ea000640 1 -- 172.21.15.18:0/1843905245 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0a9070 con 0x7f35ec144120 2024-04-25T10:14:45.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35ea000640 1 -- 172.21.15.18:0/1843905245 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ad880 con 0x7f35ec144120 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 -- 172.21.15.18:0/1843905245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 msgr2=0x7f35ec15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec15acd0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f35ec06b870 tx=0x7f35dc01c490 comp rx=0 tx=0).stop 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 -- 172.21.15.18:0/1843905245 shutdown_connections 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec15ee60 0x7f35ec0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 --2- 172.21.15.18:0/1843905245 >> v2:172.21.15.167:3300/0 conn(0x7f35ec0ccbf0 0x7f35ec15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 --2- 172.21.15.18:0/1843905245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec15acd0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 -- 172.21.15.18:0/1843905245 >> 172.21.15.18:0/1843905245 conn(0x7f35ec067080 msgr2=0x7f35ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 -- 172.21.15.18:0/1843905245 shutdown_connections 2024-04-25T10:14:45.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.099+0000 7f35f1800640 1 -- 172.21.15.18:0/1843905245 wait complete. 2024-04-25T10:14:45.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 Processor -- start 2024-04-25T10:14:45.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- start start 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec0ccbf0 0x7f35ec0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 0x7f35ec06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec071640 con 0x7f35ec144120 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0714c0 con 0x7f35ec15ee60 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ec0717c0 con 0x7f35ec0ccbf0 2024-04-25T10:14:45.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36944/0 (socket says 172.21.15.18:36944) 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 -- 172.21.15.18:0/1027615422 learned_addr learned my addr 172.21.15.18:0/1027615422 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec0ccbf0 0x7f35ec0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35eb400640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 0x7f35ec06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 -- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec0ccbf0 msgr2=0x7f35ec0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec0ccbf0 0x7f35ec0b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 -- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 msgr2=0x7f35ec06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 0x7f35ec06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 -- 172.21.15.18:0/1027615422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0ae140 con 0x7f35ec144120 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35eb400640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 0x7f35ec06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e3e00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f35d400d800 tx=0x7f35d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4018020 con 0x7f35ec144120 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d40096a0 con 0x7f35ec144120 2024-04-25T10:14:45.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4009a50 con 0x7f35ec144120 2024-04-25T10:14:45.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ec160600 con 0x7f35ec144120 2024-04-25T10:14:45.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.103+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ec160320 con 0x7f35ec144120 2024-04-25T10:14:45.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.107+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ec0745d0 con 0x7f35ec144120 2024-04-25T10:14:45.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.107+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f35d401b020 con 0x7f35ec144120 2024-04-25T10:14:45.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.107+0000 7f35e2a00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 0x7f35c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.107+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f35d40856f0 con 0x7f35ec144120 2024-04-25T10:14:45.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.107+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 0x7f35c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.111+0000 7f35eaa00640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 0x7f35c8069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af000 tx=0x7f35dc0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.111+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f35d4022020 con 0x7f35ec144120 2024-04-25T10:14:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35ec0cc820 con 0x7f35ec144120 2024-04-25T10:14:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35e2a00640 1 -- 172.21.15.18:0/1027615422 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v124) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35ec160600 con 0x7f35ec144120 2024-04-25T10:14:45.286 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 msgr2=0x7f35c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 0x7f35c8069420 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0af000 tx=0x7f35dc0a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 msgr2=0x7f35ec162640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f35d400d800 tx=0x7f35d400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 shutdown_connections 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f35ec15ee60 0x7f35ec06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35ec144120 0x7f35ec162640 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f35c8066f60 0x7f35c8069420 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 --2- 172.21.15.18:0/1027615422 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f35ec0ccbf0 0x7f35ec0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 >> 172.21.15.18:0/1027615422 conn(0x7f35ec067080 msgr2=0x7f35ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 shutdown_connections 2024-04-25T10:14:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.279+0000 7f35f1800640 1 -- 172.21.15.18:0/1027615422 wait complete. 2024-04-25T10:14:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:14:45.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.443+0000 7f090e400640 1 Processor -- start 2024-04-25T10:14:45.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.443+0000 7f090e400640 1 -- start start 2024-04-25T10:14:45.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f090e400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0908072210 0x7f090806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f090e400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f090815af40 0x7f09080cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f090e400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090815e9a0 con 0x7f0908150f40 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f090e400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090806f530 con 0x7f090815af40 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f090e400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090815dbe0 con 0x7f0908072210 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f090815af40 0x7f09080cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f090815af40 0x7f09080cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36958/0 (socket says 172.21.15.18:36958) 2024-04-25T10:14:45.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 -- 172.21.15.18:0/3545829946 learned_addr learned my addr 172.21.15.18:0/3545829946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f08fea00640 1 --2- 172.21.15.18:0/3545829946 >> v2:172.21.15.167:3300/0 conn(0x7f0908072210 0x7f090806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 -- 172.21.15.18:0/3545829946 >> v2:172.21.15.167:3300/0 conn(0x7f0908072210 msgr2=0x7f090806ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 --2- 172.21.15.18:0/3545829946 >> v2:172.21.15.167:3300/0 conn(0x7f0908072210 0x7f090806ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 -- 172.21.15.18:0/3545829946 >> v1:172.21.15.167:6789/0 conn(0x7f0908150f40 legacy=0x7f0908071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:45.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.447+0000 7f0907e00640 1 -- 172.21.15.18:0/3545829946 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090815dec0 con 0x7f090815af40 2024-04-25T10:14:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f0907e00640 1 --2- 172.21.15.18:0/3545829946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090815af40 0x7f09080cdcc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f0908072710 tx=0x7f090001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d3c236019a7bdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f0906a00640 1 -- 172.21.15.18:0/3545829946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000ac070 con 0x7f090815af40 2024-04-25T10:14:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f0906a00640 1 -- 172.21.15.18:0/3545829946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09000a8430 con 0x7f090815af40 2024-04-25T10:14:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f0906a00640 1 -- 172.21.15.18:0/3545829946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09000a8800 con 0x7f090815af40 2024-04-25T10:14:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- 172.21.15.18:0/3545829946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090815af40 msgr2=0x7f09080cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- 172.21.15.18:0/3545829946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090815af40 0x7f09080cdcc0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f0908072710 tx=0x7f090001c890 comp rx=0 tx=0).stop 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- 172.21.15.18:0/3545829946 shutdown_connections 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- 172.21.15.18:0/3545829946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f090815af40 0x7f09080cdcc0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- 172.21.15.18:0/3545829946 >> v2:172.21.15.167:3300/0 conn(0x7f0908072210 0x7f090806ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- 172.21.15.18:0/3545829946 >> 172.21.15.18:0/3545829946 conn(0x7f0908067080 msgr2=0x7f090806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- 172.21.15.18:0/3545829946 shutdown_connections 2024-04-25T10:14:45.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- 172.21.15.18:0/3545829946 wait complete. 2024-04-25T10:14:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 Processor -- start 2024-04-25T10:14:45.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- start start 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0908072210 0x7f090814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 0x7f09080af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080ce380 con 0x7f0908150f40 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09080ce200 con 0x7f0908072210 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.451+0000 7f090e400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09080ce500 con 0x7f090815af40 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36968/0 (socket says 172.21.15.18:36968) 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 -- 172.21.15.18:0/1565222253 learned_addr learned my addr 172.21.15.18:0/1565222253 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f0907e00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 0x7f09080af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 -- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 msgr2=0x7f09080af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 0x7f09080af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 -- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0908072210 msgr2=0x7f090814a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0908072210 0x7f090814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 -- 172.21.15.18:0/1565222253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0908158ea0 con 0x7f0908150f40 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f0907e00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 0x7f09080af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08fea00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d800 tx=0x7f08f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000b6c0 con 0x7f0908150f40 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0019070 con 0x7f0908150f40 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f000ba60 con 0x7f0908150f40 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0908158320 con 0x7f0908150f40 2024-04-25T10:14:45.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09081588e0 con 0x7f0908150f40 2024-04-25T10:14:45.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09080745d0 con 0x7f0908150f40 2024-04-25T10:14:45.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f08f000bc00 con 0x7f0908150f40 2024-04-25T10:14:45.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.455+0000 7f08ffe00640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 0x7f08e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.459+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f08f00856c0 con 0x7f0908150f40 2024-04-25T10:14:45.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.459+0000 7f0907400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 0x7f08e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.459+0000 7f0907400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 0x7f08e4069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f09081f97e0 tx=0x7f08f80079c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.463+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f08f00564e0 con 0x7f0908150f40 2024-04-25T10:14:45.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.623+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f09080008e0 con 0x7f0908150f40 2024-04-25T10:14:45.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.623+0000 7f08ffe00640 1 -- 172.21.15.18:0/1565222253 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v124) v1 ==== 104+0+11 (secure 0 0 0) 0x7f08f0055de0 con 0x7f0908150f40 2024-04-25T10:14:45.632 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 msgr2=0x7f08e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 0x7f08e4069420 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f09081f97e0 tx=0x7f08f80079c0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 msgr2=0x7f09081590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f08f000d800 tx=0x7f08f000dcc0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 shutdown_connections 2024-04-25T10:14:45.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f08e4066f60 0x7f08e4069420 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f090815af40 0x7f09080af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0908150f40 0x7f09081590b0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 --2- 172.21.15.18:0/1565222253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0908072210 0x7f090814a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 >> 172.21.15.18:0/1565222253 conn(0x7f0908067080 msgr2=0x7f090814fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 shutdown_connections 2024-04-25T10:14:45.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.627+0000 7f090e400640 1 -- 172.21.15.18:0/1565222253 wait complete. 2024-04-25T10:14:45.653 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:14:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.787+0000 7f1e56a00640 1 Processor -- start 2024-04-25T10:14:45.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.787+0000 7f1e56a00640 1 -- start start 2024-04-25T10:14:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e56a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e50159320 0x7f1e5015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e56a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e5006e4a0 0x7f1e5006e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e56a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e5015fc00 con 0x7f1e5015f440 2024-04-25T10:14:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e56a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e5006d640 con 0x7f1e5006e4a0 2024-04-25T10:14:45.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e56a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015fee0 con 0x7f1e50159320 2024-04-25T10:14:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e5006e4a0 0x7f1e5006e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e5006e4a0 0x7f1e5006e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36984/0 (socket says 172.21.15.18:36984) 2024-04-25T10:14:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 -- 172.21.15.18:0/3536953198 learned_addr learned my addr 172.21.15.18:0/3536953198 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e4fe00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e50159320 0x7f1e5015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 -- 172.21.15.18:0/3536953198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e50159320 msgr2=0x7f1e5015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e50159320 0x7f1e5015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 -- 172.21.15.18:0/3536953198 >> v1:172.21.15.167:6789/0 conn(0x7f1e5015f440 legacy=0x7f1e5006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.791+0000 7f1e54a00640 1 -- 172.21.15.18:0/3536953198 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e501601c0 con 0x7f1e5006e4a0 2024-04-25T10:14:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e54a00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5006e4a0 0x7f1e5006e930 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009e50 tx=0x7f1e4801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497a14123590552b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e4f400640 1 -- 172.21.15.18:0/3536953198 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480a56f0 con 0x7f1e5006e4a0 2024-04-25T10:14:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e4f400640 1 -- 172.21.15.18:0/3536953198 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480a5890 con 0x7f1e5006e4a0 2024-04-25T10:14:45.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e4f400640 1 -- 172.21.15.18:0/3536953198 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480a5c60 con 0x7f1e5006e4a0 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- 172.21.15.18:0/3536953198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5006e4a0 msgr2=0x7f1e5006e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5006e4a0 0x7f1e5006e930 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f1e48009e50 tx=0x7f1e4801c9a0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- 172.21.15.18:0/3536953198 shutdown_connections 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5006e4a0 0x7f1e5006e930 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- 172.21.15.18:0/3536953198 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e50159320 0x7f1e5015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- 172.21.15.18:0/3536953198 >> 172.21.15.18:0/3536953198 conn(0x7f1e50067080 msgr2=0x7f1e5006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- 172.21.15.18:0/3536953198 shutdown_connections 2024-04-25T10:14:45.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- 172.21.15.18:0/3536953198 wait complete. 2024-04-25T10:14:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 Processor -- start 2024-04-25T10:14:45.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- start start 2024-04-25T10:14:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 0x7f1e50138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e50159320 0x7f1e50139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015f9a0 con 0x7f1e5015f440 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e5015f820 con 0x7f1e50159320 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.795+0000 7f1e56a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e50168590 con 0x7f1e5006e4a0 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36988/0 (socket says 172.21.15.18:36988) 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 -- 172.21.15.18:0/970414813 learned_addr learned my addr 172.21.15.18:0/970414813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4fe00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 0x7f1e50138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e47e00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e50159320 0x7f1e50139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 -- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 msgr2=0x7f1e50138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 0x7f1e50138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 -- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e50159320 msgr2=0x7f1e50139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e50159320 0x7f1e50139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 -- 172.21.15.18:0/970414813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e50139e40 con 0x7f1e5015f440 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4fe00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 0x7f1e50138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e54a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1e480af040 tx=0x7f1e48019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480bc020 con 0x7f1e5015f440 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480b8670 con 0x7f1e5015f440 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e480b8a40 con 0x7f1e5015f440 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e5013a120 con 0x7f1e5015f440 2024-04-25T10:14:45.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e5013a6e0 con 0x7f1e5015f440 2024-04-25T10:14:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e5013aa10 con 0x7f1e5015f440 2024-04-25T10:14:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e480bf020 con 0x7f1e5015f440 2024-04-25T10:14:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.799+0000 7f1e4cc00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 0x7f1e2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.803+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1e48120360 con 0x7f1e5015f440 2024-04-25T10:14:45.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.803+0000 7f1e4fe00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 0x7f1e2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:45.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.803+0000 7f1e4fe00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 0x7f1e2c069420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1e40007a70 tx=0x7f1e40008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:45.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.807+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e480c6030 con 0x7f1e5015f440 2024-04-25T10:14:45.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1e500745d0 con 0x7f1e5015f440 2024-04-25T10:14:45.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e4cc00640 1 -- 172.21.15.18:0/970414813 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v124) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1e48016620 con 0x7f1e5015f440 2024-04-25T10:14:45.979 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 msgr2=0x7f1e2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 0x7f1e2c069420 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f1e40007a70 tx=0x7f1e40008040 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 msgr2=0x7f1e50135d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1e480af040 tx=0x7f1e48019740 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 shutdown_connections 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e5015f440 0x7f1e50135d40 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e50159320 0x7f1e50139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1e2c066f60 0x7f1e2c069420 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 --2- 172.21.15.18:0/970414813 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1e5006e4a0 0x7f1e50138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 >> 172.21.15.18:0/970414813 conn(0x7f1e50067080 msgr2=0x7f1e5015be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 shutdown_connections 2024-04-25T10:14:45.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:45.971+0000 7f1e56a00640 1 -- 172.21.15.18:0/970414813 wait complete. 2024-04-25T10:14:46.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:14:46.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 Processor -- start 2024-04-25T10:14:46.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 -- start start 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fedf815acd0 0x7fedf815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf815bc40 con 0x7fedf815ee60 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf815b3a0 con 0x7fedf8144120 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.135+0000 7fedfcc00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815e490 con 0x7fedf815acd0 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf6800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fedf815ee60 0x7fedf80b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36704/0 (socket says 172.21.15.18:36704) 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf6800640 1 -- 172.21.15.18:0/1479793473 learned_addr learned my addr 172.21.15.18:0/1479793473 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:46.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7feded400640 1 --2- 172.21.15.18:0/1479793473 >> v2:172.21.15.167:3300/0 conn(0x7fedf815acd0 0x7fedf815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764179058 0 0) 0x7fedf815bc40 con 0x7fedf815ee60 2024-04-25T10:14:46.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feddc003530 con 0x7fedf815ee60 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223954598 0 0) 0x7fedf815b3a0 con 0x7fedf8144120 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf815bc40 con 0x7fedf8144120 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838759265 0 0) 0x7feddc003530 con 0x7fedf815ee60 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 >> v2:172.21.15.167:3300/0 conn(0x7fedf815acd0 msgr2=0x7fedf815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 --2- 172.21.15.18:0/1479793473 >> v2:172.21.15.167:3300/0 conn(0x7fedf815acd0 0x7fedf815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 >> v1:172.21.15.167:6789/0 conn(0x7fedf8144120 legacy=0x7fedf80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf815b680 con 0x7fedf815ee60 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fedf0001a00 con 0x7fedf815ee60 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7feded400640 1 --2- 172.21.15.18:0/1479793473 >> v2:172.21.15.167:3300/0 conn(0x7fedf815acd0 0x7fedf815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 >> v1:172.21.15.18:6789/0 conn(0x7fedf815ee60 legacy=0x7fedf80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 0x7feddc005000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0037b0 0x7feddc003c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0041c0 0x7feddc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf815e490 con 0x7feddc004c00 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc00c150 con 0x7feddc0037b0 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc00c350 con 0x7feddc0041c0 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 0x7feddc005000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7feded400640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0037b0 0x7feddc003c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf6800640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0041c0 0x7feddc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 -- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0041c0 msgr2=0x7feddc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc0041c0 0x7feddc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 -- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0037b0 msgr2=0x7feddc003c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feddc0037b0 0x7feddc003c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf5e00640 1 -- 172.21.15.18:0/1479793473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc003530 con 0x7feddc004c00 2024-04-25T10:14:46.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.139+0000 7fedf6800640 1 -- 172.21.15.18:0/1479793473 reap_dead start 2024-04-25T10:14:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedf5e00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 0x7feddc005000 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fede80018d0 tx=0x7fede801e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e801513bbd06941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede80b1070 con 0x7feddc004c00 2024-04-25T10:14:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede80a8040 con 0x7feddc004c00 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedf5400640 1 -- 172.21.15.18:0/1479793473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8001520 con 0x7feddc004c00 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 msgr2=0x7feddc005000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 0x7feddc005000 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fede80018d0 tx=0x7fede801e730 comp rx=0 tx=0).stop 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- 172.21.15.18:0/1479793473 shutdown_connections 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 --2- 172.21.15.18:0/1479793473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feddc004c00 0x7feddc005000 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- 172.21.15.18:0/1479793473 >> 172.21.15.18:0/1479793473 conn(0x7fedf8067080 msgr2=0x7fedf806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- 172.21.15.18:0/1479793473 shutdown_connections 2024-04-25T10:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- 172.21.15.18:0/1479793473 wait complete. 2024-04-25T10:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 Processor -- start 2024-04-25T10:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.143+0000 7fedfcc00640 1 -- start start 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc004c00 0x7fedf81e6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 0x7fedf81f6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80cd180 con 0x7fedf81f9fa0 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80cd000 con 0x7fedf81f5ed0 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8071270 con 0x7feddc004c00 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37006/0 (socket says 172.21.15.18:37006) 2024-04-25T10:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 -- 172.21.15.18:0/794134506 learned_addr learned my addr 172.21.15.18:0/794134506 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedf5e00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc004c00 0x7fedf81e6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedf6800640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 0x7fedf81f6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 -- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc004c00 msgr2=0x7fedf81e6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc004c00 0x7fedf81e6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 -- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 msgr2=0x7fedf81f6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 0x7fedf81f6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 -- 172.21.15.18:0/794134506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80ac8d0 con 0x7fedf81f9fa0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedf6800640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 0x7fedf81f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7feded400640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fede0011cd0 tx=0x7fede000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede000fd20 con 0x7fedf81f9fa0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede0004030 con 0x7fedf81f9fa0 2024-04-25T10:14:46.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede0004420 con 0x7fedf81f9fa0 2024-04-25T10:14:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf81fa480 con 0x7fedf81f9fa0 2024-04-25T10:14:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf81faa40 con 0x7fedf81f9fa0 2024-04-25T10:14:46.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80745d0 con 0x7fedf81f9fa0 2024-04-25T10:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.147+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fede0012040 con 0x7fedf81f9fa0 2024-04-25T10:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.151+0000 7fedeea00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 0x7fedd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.151+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fede0085710 con 0x7fedf81f9fa0 2024-04-25T10:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.151+0000 7fedf5e00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 0x7fedd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.151+0000 7fedf5e00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 0x7fedd4069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fede80ae000 tx=0x7fede8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.155+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fede0019070 con 0x7fedf81f9fa0 2024-04-25T10:14:46.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.327+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fedf806d6a0 con 0x7fedf81f9fa0 2024-04-25T10:14:46.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.327+0000 7fedeea00640 1 -- 172.21.15.18:0/794134506 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v124) v1 ==== 80+0+124 (secure 0 0 0) 0x7fede0055ee0 con 0x7fedf81f9fa0 2024-04-25T10:14:46.336 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6837/2651841863 2024-04-26T10:14:36.951727+0000 2024-04-25T10:14:46.336 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6835/2651841863 2024-04-26T10:14:36.951727+0000 2024-04-25T10:14:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:listed 2 entries 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 msgr2=0x7fedd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 0x7fedd4069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fede80ae000 tx=0x7fede8009040 comp rx=0 tx=0).stop 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 msgr2=0x7fedf80b4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fede0011cd0 tx=0x7fede000f610 comp rx=0 tx=0).stop 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 shutdown_connections 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fedf81f5ed0 0x7fedf81f6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fedf81f9fa0 0x7fedf80b4160 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fedd4066f60 0x7fedd4069420 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 --2- 172.21.15.18:0/794134506 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7feddc004c00 0x7fedf81e6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 >> 172.21.15.18:0/794134506 conn(0x7fedf8067080 msgr2=0x7fedf813fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 shutdown_connections 2024-04-25T10:14:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.331+0000 7fedfcc00640 1 -- 172.21.15.18:0/794134506 wait complete. 2024-04-25T10:14:46.357 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:14:46.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:46.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:46.384 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:14:46.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:46.384 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:14:46.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.611+0000 7fd445800640 1 Processor -- start 2024-04-25T10:14:46.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.611+0000 7fd445800640 1 -- start start 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd445800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd4400afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd445800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4400d11b0 0x7fd44006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd445800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44015ddf0 con 0x7fd4400b4210 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd445800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44006b480 con 0x7fd4400d11b0 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd445800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4400d06d0 con 0x7fd44015da10 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4400d11b0 0x7fd44006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd4400d11b0 0x7fd44006ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37012/0 (socket says 172.21.15.18:37012) 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 -- 172.21.15.18:0/1419635513 learned_addr learned my addr 172.21.15.18:0/1419635513 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:46.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd43ea00640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd4400afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 -- 172.21.15.18:0/1419635513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 msgr2=0x7fd4400afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:46.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd4400afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 -- 172.21.15.18:0/1419635513 >> v1:172.21.15.167:6789/0 conn(0x7fd4400b4210 legacy=0x7fd44006fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 -- 172.21.15.18:0/1419635513 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4400d09b0 con 0x7fd4400d11b0 2024-04-25T10:14:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd436000640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400d11b0 0x7fd44006ac10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd428009870 tx=0x7fd42801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ae35ac9fd63402 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.615+0000 7fd43e000640 1 -- 172.21.15.18:0/1419635513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280b2070 con 0x7fd4400d11b0 2024-04-25T10:14:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43e000640 1 -- 172.21.15.18:0/1419635513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4280a9070 con 0x7fd4400d11b0 2024-04-25T10:14:46.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43e000640 1 -- 172.21.15.18:0/1419635513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4280ad880 con 0x7fd4400d11b0 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- 172.21.15.18:0/1419635513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400d11b0 msgr2=0x7fd44006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400d11b0 0x7fd44006ac10 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fd428009870 tx=0x7fd42801c4d0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- 172.21.15.18:0/1419635513 shutdown_connections 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400d11b0 0x7fd44006ac10 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- 172.21.15.18:0/1419635513 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd4400afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- 172.21.15.18:0/1419635513 >> 172.21.15.18:0/1419635513 conn(0x7fd4400b2400 msgr2=0x7fd4400b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- 172.21.15.18:0/1419635513 shutdown_connections 2024-04-25T10:14:46.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- 172.21.15.18:0/1419635513 wait complete. 2024-04-25T10:14:46.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 Processor -- start 2024-04-25T10:14:46.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- start start 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4400d11b0 0x7fd4401571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd440150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44016aad0 con 0x7fd4400b4210 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44016a950 con 0x7fd4400d11b0 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd445800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44016ac50 con 0x7fd44015da10 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37014/0 (socket says 172.21.15.18:37014) 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43ea00640 1 -- 172.21.15.18:0/3481933795 learned_addr learned my addr 172.21.15.18:0/3481933795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:46.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd436000640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4400d11b0 0x7fd4401571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.619+0000 7fd43f400640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd440150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 -- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 msgr2=0x7fd440150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd440150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 -- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4400d11b0 msgr2=0x7fd4401571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4400d11b0 0x7fd4401571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 -- 172.21.15.18:0/3481933795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd440156350 con 0x7fd4400b4210 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43f400640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd440150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd43ea00640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fd430007f20 tx=0x7fd43000e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430014620 con 0x7fd4400b4210 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd430019070 con 0x7fd4400b4210 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd430014a00 con 0x7fd4400b4210 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd440157720 con 0x7fd4400b4210 2024-04-25T10:14:46.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd440156070 con 0x7fd4400b4210 2024-04-25T10:14:46.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4400745d0 con 0x7fd4400b4210 2024-04-25T10:14:46.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd430014ba0 con 0x7fd4400b4210 2024-04-25T10:14:46.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 0x7fd41c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:46.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.623+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd430085a40 con 0x7fd4400b4210 2024-04-25T10:14:46.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.627+0000 7fd436000640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 0x7fd41c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:46.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.627+0000 7fd436000640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 0x7fd41c069450 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd4280af000 tx=0x7fd428008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:46.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.627+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd430056860 con 0x7fd4400b4210 2024-04-25T10:14:46.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd440072860 con 0x7fd4400b4210 2024-04-25T10:14:46.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd437400640 1 -- 172.21.15.18:0/3481933795 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4949 (secure 0 0 0) 0x7fd430056160 con 0x7fd4400b4210 2024-04-25T10:14:46.830 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":107,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:39.974386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":124,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37499},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37499":{"gid":37499,"name":"d","rank":0,"incarnation":104,"state":"up:active","state_seq":4,"addr":"172.21.15.167:6837/1299067697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":1299067697},{"type":"v1","addr":"172.21.15.167:6837","nonce":1299067697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:46.831 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 107 2024-04-25T10:14:46.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 msgr2=0x7fd41c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 0x7fd41c069450 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd4280af000 tx=0x7fd428008040 comp rx=0 tx=0).stop 2024-04-25T10:14:46.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 msgr2=0x7fd4400cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fd430007f20 tx=0x7fd43000e570 comp rx=0 tx=0).stop 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 shutdown_connections 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd41c066f90 0x7fd41c069450 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd44015da10 0x7fd440150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4400d11b0 0x7fd4401571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 --2- 172.21.15.18:0/3481933795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4400b4210 0x7fd4400cd4c0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 >> 172.21.15.18:0/3481933795 conn(0x7fd4400b2400 msgr2=0x7fd440154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 shutdown_connections 2024-04-25T10:14:46.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:46.823+0000 7fd445800640 1 -- 172.21.15.18:0/3481933795 wait complete. 2024-04-25T10:14:46.852 DEBUG:teuthology.orchestra.run.smithi167:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json tag path /parent mytag123 2024-04-25T10:14:47.023 INFO:teuthology.orchestra.run.smithi167.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T10:14:47.024 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T10:14:47.024 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000003.00000000 scrub_tag 2024-04-25T10:14:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 Processor -- start 2024-04-25T10:14:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 -- start start 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558964195770 0x55896424f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55896424b490 0x55896426af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896424db30 con 0x55896424b870 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589641399f0 con 0x55896424b490 2024-04-25T10:14:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2616c33080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5589641c0d50 con 0x558964195770 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37022/0 (socket says 172.21.15.18:37022) 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 -- 172.21.15.18:0/1638527428 learned_addr learned my addr 172.21.15.18:0/1638527428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2613e00640 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558964195770 0x55896424f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2613400640 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55896424b490 0x55896426af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 -- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558964195770 msgr2=0x55896424f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558964195770 0x55896424f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 -- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55896424b490 msgr2=0x55896426af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55896424b490 0x55896426af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.063+0000 7f2614800640 1 -- 172.21.15.18:0/1638527428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589642fc520 con 0x55896424b870 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f260c01b530 tx=0x7f260c0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca2d9155c2a88ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2612000640 1 -- 172.21.15.18:0/1638527428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b0040 con 0x55896424b870 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2612000640 1 -- 172.21.15.18:0/1638527428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0b5640 con 0x55896424b870 2024-04-25T10:14:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2612000640 1 -- 172.21.15.18:0/1638527428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b59f0 con 0x55896424b870 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- 172.21.15.18:0/1638527428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 msgr2=0x55896426b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f260c01b530 tx=0x7f260c0033b0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- 172.21.15.18:0/1638527428 shutdown_connections 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b4a0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55896424b490 0x55896426af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- 172.21.15.18:0/1638527428 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x558964195770 0x55896424f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- 172.21.15.18:0/1638527428 >> 172.21.15.18:0/1638527428 conn(0x558964193400 msgr2=0x5589641c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- 172.21.15.18:0/1638527428 shutdown_connections 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- 172.21.15.18:0/1638527428 wait complete. 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 Processor -- start 2024-04-25T10:14:47.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- start start 2024-04-25T10:14:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558964195770 0x558964248c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55896424b490 0x55896426abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896424ac30 con 0x55896424b870 2024-04-25T10:14:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55896424a990 con 0x558964195770 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2616c33080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55896424aed0 con 0x55896424b490 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37028/0 (socket says 172.21.15.18:37028) 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 -- 172.21.15.18:0/3919714452 learned_addr learned my addr 172.21.15.18:0/3919714452 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2613e00640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558964195770 0x558964248c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2613400640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55896424b490 0x55896426abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 -- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55896424b490 msgr2=0x55896426abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55896424b490 0x55896426abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 -- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558964195770 msgr2=0x558964248c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558964195770 0x558964248c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 -- 172.21.15.18:0/3919714452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558964305070 con 0x55896424b870 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.067+0000 7f2614800640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b0f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f260c01b530 tx=0x7f260c017df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 -- 172.21.15.18:0/3919714452 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0c4070 con 0x55896424b870 2024-04-25T10:14:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 -- 172.21.15.18:0/3919714452 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0b5e40 con 0x55896424b870 2024-04-25T10:14:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 -- 172.21.15.18:0/3919714452 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c0b0040 con 0x55896424b870 2024-04-25T10:14:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558964305310 con 0x55896424b870 2024-04-25T10:14:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558964305850 con 0x55896424b870 2024-04-25T10:14:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 -- 172.21.15.18:0/3919714452 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f260c0bd070 con 0x55896424b870 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f25f4065940 0x7f25f4067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2610c00640 1 -- 172.21.15.18:0/3919714452 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f260c11ebd0 con 0x55896424b870 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2613e00640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f25f4065940 0x7f25f4067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2616c33080 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x558964305f90 0x558964304870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:1 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124) v9 -- 0x558964266ec0 con 0x558964305f90 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2613400640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x558964305f90 0x558964304870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2613e00640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f25f4065940 0x7f25f4067e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2604000f70 tx=0x7f2604010040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.071+0000 7f2613400640 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x558964305f90 0x558964304870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2613400640 1 -- 172.21.15.18:0/3919714452 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2600009a00 con 0x558964305f90 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:error getting xattr cephfs_data/10000000003.00000000/scrub_tag: (61) No data available 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x558964305f90 msgr2=0x558964304870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x558964305f90 0x558964304870 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f25f4065940 msgr2=0x7f25f4067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f25f4065940 0x7f25f4067e00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2604000f70 tx=0x7f2604010040 comp rx=0 tx=0).stop 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 msgr2=0x55896426b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 --2- 172.21.15.18:0/3919714452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55896424b870 0x55896426b0f0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f260c01b530 tx=0x7f260c017df0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2614800640 1 -- 172.21.15.18:0/3919714452 reap_dead start 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 shutdown_connections 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 >> 172.21.15.18:0/3919714452 conn(0x558964193400 msgr2=0x55896424f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 shutdown_connections 2024-04-25T10:14:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.075+0000 7f2616c33080 1 -- 172.21.15.18:0/3919714452 wait complete. 2024-04-25T10:14:47.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:14:47.086 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T10:14:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 Processor -- start 2024-04-25T10:14:47.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 -- start start 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc3930 0x55cdf2bc19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc6d00 0x55cdf2bc8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2bc7f20 con 0x55cdf2b0b770 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2aaf9f0 con 0x55cdf2bc3930 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.123+0000 7f88a264a080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2bc4890 con 0x55cdf2bc6d00 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889f600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc6d00 0x55cdf2bc8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37050/0 (socket says 172.21.15.18:37050) 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889e200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc3930 0x55cdf2bc19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 -- 172.21.15.18:0/2369852244 learned_addr learned my addr 172.21.15.18:0/2369852244 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 -- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc6d00 msgr2=0x55cdf2bc8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc6d00 0x55cdf2bc8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 -- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc3930 msgr2=0x55cdf2bc19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc3930 0x55cdf2bc19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 -- 172.21.15.18:0/2369852244 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdf2b34490 con 0x55cdf2b0b770 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8890009950 tx=0x7f8890005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625391d3afc90ebd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ce00640 1 -- 172.21.15.18:0/2369852244 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890008da0 con 0x55cdf2b0b770 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ce00640 1 -- 172.21.15.18:0/2369852244 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890018070 con 0x55cdf2b0b770 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ce00640 1 -- 172.21.15.18:0/2369852244 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890013640 con 0x55cdf2b0b770 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- 172.21.15.18:0/2369852244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 msgr2=0x55cdf2bc2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f8890009950 tx=0x7f8890005a10 comp rx=0 tx=0).stop 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- 172.21.15.18:0/2369852244 shutdown_connections 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc6d00 0x55cdf2bc8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc3930 0x55cdf2bc19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- 172.21.15.18:0/2369852244 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bc2f80 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- 172.21.15.18:0/2369852244 >> 172.21.15.18:0/2369852244 conn(0x55cdf2b09400 msgr2=0x55cdf2bc6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- 172.21.15.18:0/2369852244 shutdown_connections 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- 172.21.15.18:0/2369852244 wait complete. 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 Processor -- start 2024-04-25T10:14:47.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- start start 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc3930 0x55cdf2bc6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc6d00 0x55cdf2bc6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2b349d0 con 0x55cdf2b0b770 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2b34730 con 0x55cdf2bc6d00 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f88a264a080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdf2b34c70 con 0x55cdf2bc3930 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37062/0 (socket says 172.21.15.18:37062) 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889ec00640 1 -- 172.21.15.18:0/4018010322 learned_addr learned my addr 172.21.15.18:0/4018010322 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889e200640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc3930 0x55cdf2bc6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.127+0000 7f889f600640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc6d00 0x55cdf2bc6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 -- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc3930 msgr2=0x55cdf2bc6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc3930 0x55cdf2bc6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 -- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc6d00 msgr2=0x55cdf2bc6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc6d00 0x55cdf2bc6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 -- 172.21.15.18:0/4018010322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdf2b37f40 con 0x55cdf2b0b770 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889e200640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55cdf2bc3930 0x55cdf2bc6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889f600640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf2bc6d00 0x55cdf2bc6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889ec00640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bea380 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8890008780 tx=0x7f8890003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 -- 172.21.15.18:0/4018010322 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890008ea0 con 0x55cdf2b0b770 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 -- 172.21.15.18:0/4018010322 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8890021070 con 0x55cdf2b0b770 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 -- 172.21.15.18:0/4018010322 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890026470 con 0x55cdf2b0b770 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdf2b381e0 con 0x55cdf2b0b770 2024-04-25T10:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdf2c79600 con 0x55cdf2b0b770 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 -- 172.21.15.18:0/4018010322 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f889001c400 con 0x55cdf2b0b770 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8880065970 0x7f8880067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f8897400640 1 -- 172.21.15.18:0/4018010322 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8890085fe0 con 0x55cdf2b0b770 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f889e200640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8880065970 0x7f8880067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f88a264a080 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55cdf2c7aab0 0x55cdf2b36e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.131+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124) v9 -- 0x55cdf2b373d0 con 0x55cdf2c7aab0 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f889f600640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55cdf2c7aab0 0x55cdf2b36e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f889e200640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8880065970 0x7f8880067e30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f888c002fd0 tx=0x7f888c001700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f889f600640 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55cdf2c7aab0 0x55cdf2b36e90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f889f600640 1 -- 172.21.15.18:0/4018010322 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f88980ab7c0 con 0x55cdf2c7aab0 2024-04-25T10:14:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55cdf2c7aab0 msgr2=0x55cdf2b36e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55cdf2c7aab0 0x55cdf2b36e90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8880065970 msgr2=0x7f8880067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f8880065970 0x7f8880067e30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f888c002fd0 tx=0x7f888c001700 comp rx=0 tx=0).stop 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 msgr2=0x55cdf2bea380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 --2- 172.21.15.18:0/4018010322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cdf2b0b770 0x55cdf2bea380 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f8890008780 tx=0x7f8890003030 comp rx=0 tx=0).stop 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f889f600640 1 -- 172.21.15.18:0/4018010322 reap_dead start 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 shutdown_connections 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 >> 172.21.15.18:0/4018010322 conn(0x55cdf2b09400 msgr2=0x55cdf2be3060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 shutdown_connections 2024-04-25T10:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.135+0000 7f88a264a080 1 -- 172.21.15.18:0/4018010322 wait complete. 2024-04-25T10:14:47.147 INFO:teuthology.orchestra.run.smithi018.stdout:mytag123 2024-04-25T10:14:47.148 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T10:14:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 Processor -- start 2024-04-25T10:14:47.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 -- start start 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 0x55a5fa3e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa3ce870 0x55a5fa47ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa3d0b30 con 0x55a5fa318770 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa2bc9f0 con 0x55a5fa3ce490 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa343d50 con 0x55a5fa3ce870 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37074/0 (socket says 172.21.15.18:37074) 2024-04-25T10:14:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 -- 172.21.15.18:0/3035390534 learned_addr learned my addr 172.21.15.18:0/3035390534 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f3e00640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 0x55a5fa3e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9c00640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa3ce870 0x55a5fa47ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 -- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa3ce870 msgr2=0x55a5fa47ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa3ce870 0x55a5fa47ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 -- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 msgr2=0x55a5fa3e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 0x55a5fa3e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 -- 172.21.15.18:0/3035390534 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5fa35a140 con 0x55a5fa318770 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f3e00640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 0x55a5fa3e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f9200640 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00a590 tx=0x7fd8ec003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3da1dd79a55b30f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f2a00640 1 -- 172.21.15.18:0/3035390534 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0af040 con 0x55a5fa318770 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f2a00640 1 -- 172.21.15.18:0/3035390534 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0b9070 con 0x55a5fa318770 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.227+0000 7fd8f2a00640 1 -- 172.21.15.18:0/3035390534 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0aacb0 con 0x55a5fa318770 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/3035390534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 msgr2=0x55a5fa3e90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00a590 tx=0x7fd8ec003030 comp rx=0 tx=0).stop 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/3035390534 shutdown_connections 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa3ce870 0x55a5fa47ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce490 0x55a5fa3e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/3035390534 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa318770 0x55a5fa3e90a0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/3035390534 >> 172.21.15.18:0/3035390534 conn(0x55a5fa316400 msgr2=0x55a5fa344cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/3035390534 shutdown_connections 2024-04-25T10:14:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/3035390534 wait complete. 2024-04-25T10:14:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 Processor -- start 2024-04-25T10:14:47.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- start start 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa318770 0x55a5fa47f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 0x55a5fa3f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce870 0x55a5fa35e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa35a680 con 0x55a5fa3ce490 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa35a3e0 con 0x55a5fa3ce870 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5fa35a920 con 0x55a5fa318770 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 0x55a5fa3f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 0x55a5fa3f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37086/0 (socket says 172.21.15.18:37086) 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 -- 172.21.15.18:0/589957892 learned_addr learned my addr 172.21.15.18:0/589957892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f9c00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce870 0x55a5fa35e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f9200640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa318770 0x55a5fa47f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 -- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa318770 msgr2=0x55a5fa47f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55a5fa318770 0x55a5fa47f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 -- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce870 msgr2=0x55a5fa35e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a5fa3ce870 0x55a5fa35e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 -- 172.21.15.18:0/589957892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5fa3f5880 con 0x55a5fa3ce490 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f3e00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 0x55a5fa3f5090 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400df30 tx=0x7fd8e400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f1600640 1 -- 172.21.15.18:0/589957892 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4014020 con 0x55a5fa3ce490 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f1600640 1 -- 172.21.15.18:0/589957892 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e4010850 con 0x55a5fa3ce490 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5fa3f5b20 con 0x55a5fa3ce490 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8f1600640 1 -- 172.21.15.18:0/589957892 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e4010c20 con 0x55a5fa3ce490 2024-04-25T10:14:47.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.231+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5fa35e3e0 con 0x55a5fa3ce490 2024-04-25T10:14:47.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f1600640 1 -- 172.21.15.18:0/589957892 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd8e4017020 con 0x55a5fa3ce490 2024-04-25T10:14:47.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f1600640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd8d8065970 0x7fd8d8067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f1600640 1 -- 172.21.15.18:0/589957892 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd8e4084200 con 0x55a5fa3ce490 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55a5fa35edc0 0x55a5fa3e8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124) v9 -- 0x55a5fa341a10 con 0x55a5fa35edc0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9200640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd8d8065970 0x7fd8d8067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9c00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55a5fa35edc0 0x55a5fa3e8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9200640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd8d8065970 0x7fd8d8067e30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec019010 tx=0x7fd8ec0ac040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9c00640 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55a5fa35edc0 0x55a5fa3e8790 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9c00640 1 -- 172.21.15.18:0/589957892 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fd8f400e960 con 0x55a5fa35edc0 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55a5fa35edc0 msgr2=0x55a5fa3e8790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55a5fa35edc0 0x55a5fa3e8790 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd8d8065970 msgr2=0x7fd8d8067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd8d8065970 0x7fd8d8067e30 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec019010 tx=0x7fd8ec0ac040 comp rx=0 tx=0).stop 2024-04-25T10:14:47.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 msgr2=0x55a5fa3f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 --2- 172.21.15.18:0/589957892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5fa3ce490 0x55a5fa3f5090 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fd8e400df30 tx=0x7fd8e400b6d0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8f9c00640 1 -- 172.21.15.18:0/589957892 reap_dead start 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 shutdown_connections 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 >> 172.21.15.18:0/589957892 conn(0x55a5fa316400 msgr2=0x55a5fa359170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.235+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 shutdown_connections 2024-04-25T10:14:47.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.239+0000 7fd8fc02b080 1 -- 172.21.15.18:0/589957892 wait complete. 2024-04-25T10:14:47.249 INFO:teuthology.orchestra.run.smithi018.stdout:mytag123 2024-04-25T10:14:47.250 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000006.00000000 scrub_tag 2024-04-25T10:14:47.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 Processor -- start 2024-04-25T10:14:47.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 -- start start 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d43b0 0x55775d62b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 0x55775d6d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775d5feba0 con 0x55775d62f2f0 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775d5fea20 con 0x55775d6d4790 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056d559080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55775d5fed20 con 0x55775d6d43b0 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37106/0 (socket says 172.21.15.18:37106) 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 -- 172.21.15.18:0/68576170 learned_addr learned my addr 172.21.15.18:0/68576170 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056b200640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 0x55775d6d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f0563e00640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d43b0 0x55775d62b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 -- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d43b0 msgr2=0x55775d62b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d43b0 0x55775d62b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 -- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 msgr2=0x55775d6d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 0x55775d6d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056a800640 1 -- 172.21.15.18:0/68576170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775d62d9d0 con 0x55775d62f2f0 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.331+0000 7f056b200640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 0x55775d6d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056a800640 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f055c00a590 tx=0x7f055c003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3cb578e46ab5cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0569400640 1 -- 172.21.15.18:0/68576170 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0b0040 con 0x55775d62f2f0 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0569400640 1 -- 172.21.15.18:0/68576170 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0abb10 con 0x55775d62f2f0 2024-04-25T10:14:47.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0569400640 1 -- 172.21.15.18:0/68576170 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0b7460 con 0x55775d62f2f0 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/68576170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 msgr2=0x55775d62d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f055c00a590 tx=0x7f055c003030 comp rx=0 tx=0).stop 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/68576170 shutdown_connections 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d6d4790 0x55775d6d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d43b0 0x55775d62b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- 172.21.15.18:0/68576170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d62f2f0 0x55775d62d0c0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/68576170 >> 172.21.15.18:0/68576170 conn(0x55775d629c50 msgr2=0x55775d601a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/68576170 shutdown_connections 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/68576170 wait complete. 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 Processor -- start 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- start start 2024-04-25T10:14:47.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d62f2f0 0x55775d6cd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 0x55775d6d3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d4790 0x55775d6ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775d6d00d0 con 0x55775d6d43b0 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55775d62dc70 con 0x55775d62f2f0 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55775d6d0370 con 0x55775d6d4790 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 0x55775d6d3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 0x55775d6d3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37118/0 (socket says 172.21.15.18:37118) 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 -- 172.21.15.18:0/3112298371 learned_addr learned my addr 172.21.15.18:0/3112298371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056a800640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d62f2f0 0x55775d6cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056b200640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d4790 0x55775d6ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 -- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d4790 msgr2=0x55775d6ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55775d6d4790 0x55775d6ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 -- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d62f2f0 msgr2=0x55775d6cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55775d62f2f0 0x55775d6cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 -- 172.21.15.18:0/3112298371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55775d6cdb10 con 0x55775d6d43b0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563e00640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 0x55775d6d3aa0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f0554008740 tx=0x7f0554008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563400640 1 -- 172.21.15.18:0/3112298371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554006d80 con 0x55775d6d43b0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563400640 1 -- 172.21.15.18:0/3112298371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055401a070 con 0x55775d6d43b0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55775d6cddb0 con 0x55775d6d43b0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.335+0000 7f0563400640 1 -- 172.21.15.18:0/3112298371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554015660 con 0x55775d6d43b0 2024-04-25T10:14:47.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55775d6ce2f0 con 0x55775d6d43b0 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f0563400640 1 -- 172.21.15.18:0/3112298371 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0554013030 con 0x55775d6d43b0 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f0563400640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0548065970 0x7f0548067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f0563400640 1 -- 172.21.15.18:0/3112298371 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0554084690 con 0x55775d6d43b0 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056a800640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0548065970 0x7f0548067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056d559080 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55775d6d2e80 0x55775d6d8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:1 18.25 18:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e124) v9 -- 0x55775d6d8560 con 0x55775d6d2e80 2024-04-25T10:14:47.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056b200640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55775d6d2e80 0x55775d6d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.339+0000 7f056a800640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0548065970 0x7f0548067e30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f055c0bc000 tx=0x7f055c0a8000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056b200640 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55775d6d2e80 0x55775d6d8020 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056b200640 1 -- 172.21.15.18:0/3112298371 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (12) out=12b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f0564002970 con 0x55775d6d2e80 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55775d6d2e80 msgr2=0x55775d6d8020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55775d6d2e80 0x55775d6d8020 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0548065970 msgr2=0x7f0548067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0548065970 0x7f0548067e30 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f055c0bc000 tx=0x7f055c0a8000 comp rx=0 tx=0).stop 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 msgr2=0x55775d6d3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 --2- 172.21.15.18:0/3112298371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55775d6d43b0 0x55775d6d3aa0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f0554008740 tx=0x7f0554008c00 comp rx=0 tx=0).stop 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056b200640 1 -- 172.21.15.18:0/3112298371 reap_dead start 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 shutdown_connections 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 >> 172.21.15.18:0/3112298371 conn(0x55775d629c50 msgr2=0x55775d6caf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 shutdown_connections 2024-04-25T10:14:47.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.343+0000 7f056d559080 1 -- 172.21.15.18:0/3112298371 wait complete. 2024-04-25T10:14:47.354 INFO:teuthology.orchestra.run.smithi018.stdout:mytag123 2024-04-25T10:14:47.355 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T10:14:47.355 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T10:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.487+0000 7f34bea00640 1 Processor -- start 2024-04-25T10:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.487+0000 7f34bea00640 1 -- start start 2024-04-25T10:14:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f34b806e010 0x7f34b806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bea00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b815fc00 con 0x7f34b8159320 2024-04-25T10:14:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bea00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b806d640 con 0x7f34b806e010 2024-04-25T10:14:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b815fee0 con 0x7f34b815c9b0 2024-04-25T10:14:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34afe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34afe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48478/0 (socket says 172.21.15.18:48478) 2024-04-25T10:14:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bca00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f34b806e010 0x7f34b806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34afe00640 1 -- 172.21.15.18:0/3686368997 learned_addr learned my addr 172.21.15.18:0/3686368997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34b7e00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f34b8159320 0x7f34b815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58520/0 (socket says 172.21.15.18:58520) 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bca00640 1 -- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 msgr2=0x7f34b806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bca00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bca00640 1 -- 172.21.15.18:0/3686368997 >> v1:172.21.15.167:6789/0 conn(0x7f34b8159320 legacy=0x7f34b815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34bca00640 1 -- 172.21.15.18:0/3686368997 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b81601c0 con 0x7f34b806e010 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34b7400640 1 -- 172.21.15.18:0/3686368997 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179404253 0 0) 0x7f34b815fc00 con 0x7f34b8159320 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.491+0000 7f34afe00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:47.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bca00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b806e010 0x7f34b806e4a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009d90 tx=0x7f34b001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fcb3df1b1752d68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34b7400640 1 -- 172.21.15.18:0/3686368997 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00b2070 con 0x7f34b806e010 2024-04-25T10:14:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34b7400640 1 -- 172.21.15.18:0/3686368997 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b00a5830 con 0x7f34b806e010 2024-04-25T10:14:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34b7400640 1 -- 172.21.15.18:0/3686368997 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00a5c00 con 0x7f34b806e010 2024-04-25T10:14:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b806e010 msgr2=0x7f34b806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b806e010 0x7f34b806e4a0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f34b0009d90 tx=0x7f34b001c970 comp rx=0 tx=0).stop 2024-04-25T10:14:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- 172.21.15.18:0/3686368997 shutdown_connections 2024-04-25T10:14:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b806e010 0x7f34b806e4a0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 --2- 172.21.15.18:0/3686368997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b815c9b0 0x7f34b806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- 172.21.15.18:0/3686368997 >> 172.21.15.18:0/3686368997 conn(0x7f34b8067080 msgr2=0x7f34b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- 172.21.15.18:0/3686368997 shutdown_connections 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- 172.21.15.18:0/3686368997 wait complete. 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 Processor -- start 2024-04-25T10:14:47.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.495+0000 7f34bea00640 1 -- start start 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b815c9b0 0x7f34b8142f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80b2a90 con 0x7f34b8159320 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80b2910 con 0x7f34b815c9b0 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b80b2c10 con 0x7f34b806e010 2024-04-25T10:14:47.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b815c9b0 0x7f34b8142f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48490/0 (socket says 172.21.15.18:48490) 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 -- 172.21.15.18:0/1327749027 learned_addr learned my addr 172.21.15.18:0/1327749027 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37134/0 (socket says 172.21.15.18:37134) 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 -- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b815c9b0 msgr2=0x7f34b8142f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b815c9b0 0x7f34b8142f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 -- 172.21.15.18:0/1327749027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 msgr2=0x7f34b8145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 -- 172.21.15.18:0/1327749027 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b81383f0 con 0x7f34b806e010 2024-04-25T10:14:47.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34afe00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34a80011f0 tx=0x7f34a800c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b4c00640 1 -- 172.21.15.18:0/1327749027 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8018070 con 0x7f34b806e010 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b4c00640 1 -- 172.21.15.18:0/1327749027 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80074e0 con 0x7f34b806e010 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34b4c00640 1 -- 172.21.15.18:0/1327749027 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a8004a10 con 0x7f34b806e010 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8146180 con 0x7f34b806e010 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.499+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b8146740 con 0x7f34b806e010 2024-04-25T10:14:47.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34b4c00640 1 -- 172.21.15.18:0/1327749027 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f34a8004bb0 con 0x7f34b806e010 2024-04-25T10:14:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34b4c00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 0x7f3494069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34b4c00640 1 -- 172.21.15.18:0/1327749027 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f34a80845f0 con 0x7f34b806e010 2024-04-25T10:14:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 0x7f3494069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 Processor -- start 2024-04-25T10:14:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 -- start start 2024-04-25T10:14:47.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 0x7f3494069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f34a00096f0 tx=0x7f34a0009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca918cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca9143480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f8fff0 con 0x559ca918d2f0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f18150 con 0x559ca918c9d0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f8c090 con 0x559ca91430a0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37144/0 (socket says 172.21.15.18:37144) 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 -- 172.21.15.18:0/1213677582 learned_addr learned my addr 172.21.15.18:0/1213677582 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca918cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34bca00640 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca9143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 -- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 msgr2=0x559ca9143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca9143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 -- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 msgr2=0x559ca918cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca918cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 -- 172.21.15.18:0/1213677582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ca91260d0 con 0x559ca918d2f0 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34afe00640 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f34a0014540 tx=0x7f34a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f91c4dd37f7755 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34acc00640 1 -- 172.21.15.18:0/1213677582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0025070 con 0x559ca918d2f0 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34acc00640 1 -- 172.21.15.18:0/1213677582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a001b070 con 0x559ca918d2f0 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.503+0000 7f34acc00640 1 -- 172.21.15.18:0/1213677582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a00215f0 con 0x559ca918d2f0 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1213677582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 msgr2=0x559ca9142b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f34a0014540 tx=0x7f34a0014000 comp rx=0 tx=0).stop 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1213677582 shutdown_connections 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca9143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9142b60 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1213677582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca918cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1213677582 >> 172.21.15.18:0/1213677582 conn(0x559ca913f020 msgr2=0x559ca9141440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1213677582 shutdown_connections 2024-04-25T10:14:47.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1213677582 wait complete. 2024-04-25T10:14:47.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- start start 2024-04-25T10:14:47.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 Processor -- start 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca91430a0 0x559ca91717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918c9d0 0x559ca9171d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f54250 con 0x559ca918d2f0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f4a690 con 0x559ca91430a0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f18a40 con 0x559ca918c9d0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 10 client.0 _ll_register_callbacks cb 0x559ca912de90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37150/0 (socket says 172.21.15.18:37150) 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 -- 172.21.15.18:0/1834739006 learned_addr learned my addr 172.21.15.18:0/1834739006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34afe00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918c9d0 0x559ca9171d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca91430a0 0x559ca91717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 -- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918c9d0 msgr2=0x559ca9171d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918c9d0 0x559ca9171d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 -- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca91430a0 msgr2=0x559ca91717f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca91430a0 0x559ca91717f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 -- 172.21.15.18:0/1834739006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ca903d1c0 con 0x559ca918d2f0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34bca00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f34b001b020 tx=0x7f34b001b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1825ee3963dea38b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b00b2040 con 0x559ca918d2f0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f34b00a5de0 con 0x559ca918d2f0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34a001b070 con 0x559ca918d2f0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34b00ad440 con 0x559ca918d2f0 2024-04-25T10:14:47.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 10 client.9447 fetch_fsmap learned FSMap version 107 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x559ca9039170 con 0x559ca918d2f0 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a001b070 con 0x559ca918d2f0 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 107) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f34b8071a80 con 0x559ca918d2f0 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 10 client.9447 fetch_fsmap finished waiting for FSMap version 107 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.507+0000 7f34c1e45000 10 client.9447 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 20 client.9447 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca919cc80 0x559ca919f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 4 client.9447 mds_command: new command op to 37499 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 --> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ca8f2bc60 con 0x559ca919cc80 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca919cc80 0x559ca919f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca919cc80 0x559ca919f070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=497a53d8d645580c server_cookie=42401347f06473b8 in_seq=0 out_seq=0 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34a5600640 10 client.9447 ms_handle_connect on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34a5600640 1 -- 172.21.15.18:0/1834739006 <== mds.0 v2:172.21.15.167:6835/1299067697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559ca8f2bc60 con 0x559ca919cc80 2024-04-25T10:14:47.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34a5600640 10 client.9447 handle_command_reply: tid=0 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 client.9447 shutdown 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 msgr2=0x559ca9172270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f34b001b020 tx=0x7f34b001b1b0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 shutdown_connections 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918d2f0 0x559ca9172270 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca919cc80 0x559ca919f070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918c9d0 0x559ca9171d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1834739006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca91430a0 0x559ca91717f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34a5600640 0 client.9447 ms_handle_reset on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 >> 172.21.15.18:0/1834739006 conn(0x559ca913f020 msgr2=0x559ca9141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 shutdown_connections 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 1 -- 172.21.15.18:0/1834739006 wait complete. 2024-04-25T10:14:47.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.511+0000 7f34c1e45000 20 client.9447 trim_cache size 0 max 16384 2024-04-25T10:14:47.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.523+0000 7f34c1e45000 1 Processor -- start 2024-04-25T10:14:47.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.523+0000 7f34c1e45000 1 -- start start 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca9142420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918d2f0 0x559ca9142960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81ff3f0 con 0x559ca91430a0 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81fe5f0 con 0x559ca918c9d0 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b815a620 con 0x559ca918d2f0 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37154/0 (socket says 172.21.15.18:37154) 2024-04-25T10:14:47.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 -- 172.21.15.18:0/1085787148 learned_addr learned my addr 172.21.15.18:0/1085787148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34afe00640 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca9142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34bca00640 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918d2f0 0x559ca9142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 -- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918d2f0 msgr2=0x559ca9142960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918d2f0 0x559ca9142960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 -- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 msgr2=0x559ca9142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca9142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 -- 172.21.15.18:0/1085787148 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ca8fd6de0 con 0x559ca91430a0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f34a80828a0 tx=0x7f34a8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f455ebe29aaa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34a7e00640 1 -- 172.21.15.18:0/1085787148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a805b070 con 0x559ca91430a0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34a7e00640 1 -- 172.21.15.18:0/1085787148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80829b0 con 0x559ca91430a0 2024-04-25T10:14:47.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34a7e00640 1 -- 172.21.15.18:0/1085787148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80513a0 con 0x559ca91430a0 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- 172.21.15.18:0/1085787148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 msgr2=0x559ca918be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f34a80828a0 tx=0x7f34a8009040 comp rx=0 tx=0).stop 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- 172.21.15.18:0/1085787148 shutdown_connections 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca918d2f0 0x559ca9142960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918c9d0 0x559ca9142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1085787148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca91430a0 0x559ca918be10 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- 172.21.15.18:0/1085787148 >> 172.21.15.18:0/1085787148 conn(0x559ca913f020 msgr2=0x559ca918b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- 172.21.15.18:0/1085787148 shutdown_connections 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- 172.21.15.18:0/1085787148 wait complete. 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 -- start start 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.527+0000 7f34c1e45000 1 Processor -- start 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca91ed310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918d2f0 0x559ca919f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f2ae00 con 0x559ca918c9d0 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81fe020 con 0x559ca918d2f0 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ca8f8f300 con 0x559ca91430a0 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 10 client.0 _ll_register_callbacks cb 0x559ca910e040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37164/0 (socket says 172.21.15.18:37164) 2024-04-25T10:14:47.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 -- 172.21.15.18:0/1715531905 learned_addr learned my addr 172.21.15.18:0/1715531905 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca91ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34bca00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918d2f0 0x559ca919f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 -- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 msgr2=0x559ca91ed310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca91ed310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 -- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918d2f0 msgr2=0x559ca919f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918d2f0 0x559ca919f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 -- 172.21.15.18:0/1715531905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ca8f318e0 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34afe00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x559ca8f4c3d0 tx=0x7f34a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496d574f2d49fbc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a0025040 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f34a002ad90 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34a80829b0 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34a00094d0 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 10 client.9453 fetch_fsmap learned FSMap version 107 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=2+}) v3 -- 0x559ca8fe98f0 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a80829b0 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 107) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f34a003f020 con 0x559ca918c9d0 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 10 client.9453 fetch_fsmap finished waiting for FSMap version 107 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 10 client.9453 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 20 client.9453 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:47.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca91a0020 0x559ca91a0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 4 client.9453 mds_command: new command op to 37499 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T10:14:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 --> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559ca8f9d530 con 0x559ca91a0020 2024-04-25T10:14:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca91a0020 0x559ca91a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34b7e00640 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca91a0020 0x559ca91a0430 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa4571e7c15f1f43 server_cookie=80df5ad28c0c4815 in_seq=0 out_seq=0 2024-04-25T10:14:47.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.531+0000 7f34a5600640 10 client.9453 ms_handle_connect on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34a5600640 1 -- 172.21.15.18:0/1715531905 <== mds.0 v2:172.21.15.167:6835/1299067697 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559ca8f9d530 con 0x559ca91a0020 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34a5600640 10 client.9453 handle_command_reply: tid=0 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 client.9453 shutdown 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 msgr2=0x559ca91ed850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x559ca8f4c3d0 tx=0x7f34a0004740 comp rx=0 tx=0).stop 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 shutdown_connections 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559ca918d2f0 0x559ca919f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559ca918c9d0 0x559ca91ed850 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:6835/1299067697,v1:172.21.15.167:6837/1299067697] conn(0x559ca91a0020 0x559ca91a0430 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 --2- 172.21.15.18:0/1715531905 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559ca91430a0 0x559ca91ed310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34a5600640 0 client.9453 ms_handle_reset on v2:172.21.15.167:6835/1299067697 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 >> 172.21.15.18:0/1715531905 conn(0x559ca913f020 msgr2=0x559ca918b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 shutdown_connections 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 1 -- 172.21.15.18:0/1715531905 wait complete. 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34c1e45000 20 client.9453 trim_cache size 0 max 16384 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:47.552 INFO:teuthology.orchestra.run.smithi018.stdout: "message": "", 2024-04-25T10:14:47.553 INFO:teuthology.orchestra.run.smithi018.stdout: "return_code": 0 2024-04-25T10:14:47.553 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 msgr2=0x7f3494069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 0x7f3494069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f34a00096f0 tx=0x7f34a0009240 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 msgr2=0x7f34b8137eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34a80011f0 tx=0x7f34a800c9b0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 shutdown_connections 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f34b815c9b0 0x7f34b8142f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b8159320 0x7f34b8145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3494066f60 0x7f3494069420 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 --2- 172.21.15.18:0/1327749027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f34b806e010 0x7f34b8137eb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 >> 172.21.15.18:0/1327749027 conn(0x7f34b8067080 msgr2=0x7f34b815be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 shutdown_connections 2024-04-25T10:14:47.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.543+0000 7f34bea00640 1 -- 172.21.15.18:0/1327749027 wait complete. 2024-04-25T10:14:47.571 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:14:47.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 Processor -- start 2024-04-25T10:14:47.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 -- start start 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f035815acd0 0x7f035815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03580b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035815bc40 con 0x7f0358144120 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f035815e490 con 0x7f035815acd0 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f035d200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035815b150 con 0x7f035815ee60 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0355e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0358144120 0x7f03580ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36724/0 (socket says 172.21.15.18:36724) 2024-04-25T10:14:47.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0355e00640 1 -- 172.21.15.18:0/2806980471 learned_addr learned my addr 172.21.15.18:0/2806980471 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0356800640 1 --2- 172.21.15.18:0/2806980471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03580b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f034fe00640 1 --2- 172.21.15.18:0/2806980471 >> v2:172.21.15.167:3300/0 conn(0x7f035815acd0 0x7f035815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481076878 0 0) 0x7f035815bc40 con 0x7f0358144120 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f033c003530 con 0x7f0358144120 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0356800640 1 -- 172.21.15.18:0/2806980471 >> v2:172.21.15.167:3300/0 conn(0x7f035815acd0 msgr2=0x7f035815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0356800640 1 --2- 172.21.15.18:0/2806980471 >> v2:172.21.15.167:3300/0 conn(0x7f035815acd0 0x7f035815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0356800640 1 -- 172.21.15.18:0/2806980471 >> v1:172.21.15.18:6789/0 conn(0x7f0358144120 legacy=0x7f03580ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2975282945 0 0) 0x7f033c003530 con 0x7f0358144120 2024-04-25T10:14:47.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.707+0000 7f0356800640 1 -- 172.21.15.18:0/2806980471 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035815b3a0 con 0x7f035815ee60 2024-04-25T10:14:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f0356800640 1 --2- 172.21.15.18:0/2806980471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03580b3090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6039f886faf05553 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03500ac070 con 0x7f035815ee60 2024-04-25T10:14:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03500a6410 con 0x7f035815ee60 2024-04-25T10:14:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f0355400640 1 -- 172.21.15.18:0/2806980471 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348001680 con 0x7f035815ee60 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 -- 172.21.15.18:0/2806980471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 msgr2=0x7f03580b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 --2- 172.21.15.18:0/2806980471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03580b3090 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f035001c800 comp rx=0 tx=0).stop 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 -- 172.21.15.18:0/2806980471 shutdown_connections 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 --2- 172.21.15.18:0/2806980471 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03580b3090 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 --2- 172.21.15.18:0/2806980471 >> v2:172.21.15.167:3300/0 conn(0x7f035815acd0 0x7f035815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 -- 172.21.15.18:0/2806980471 >> 172.21.15.18:0/2806980471 conn(0x7f0358067080 msgr2=0x7f035806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 -- 172.21.15.18:0/2806980471 shutdown_connections 2024-04-25T10:14:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.711+0000 7f035d200640 1 -- 172.21.15.18:0/2806980471 wait complete. 2024-04-25T10:14:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 Processor -- start 2024-04-25T10:14:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- start start 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0358144120 0x7f0358154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03581370f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358165fd0 con 0x7f035815acd0 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358165e50 con 0x7f0358144120 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0358166150 con 0x7f035815ee60 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37170/0 (socket says 172.21.15.18:37170) 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 -- 172.21.15.18:0/3882599232 learned_addr learned my addr 172.21.15.18:0/3882599232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f0355e00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0358144120 0x7f0358154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f0356800640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03581370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 -- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 msgr2=0x7f03581370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03581370f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 -- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0358144120 msgr2=0x7f0358154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0358144120 0x7f0358154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 -- 172.21.15.18:0/3882599232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358137630 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034fe00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f034000e8a0 tx=0x7f034000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340017070 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034000c940 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034000ccf0 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03581389a0 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0358138f60 con 0x7f035815acd0 2024-04-25T10:14:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.715+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03580745d0 con 0x7f035815acd0 2024-04-25T10:14:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.719+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f034001a070 con 0x7f035815acd0 2024-04-25T10:14:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.719+0000 7f034e000640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 0x7f0334069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.719+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0340085160 con 0x7f035815acd0 2024-04-25T10:14:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.719+0000 7f0355e00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 0x7f0334069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.719+0000 7f0355e00640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 0x7f0334069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f03480011f0 tx=0x7f0348009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:47.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.723+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0340055f80 con 0x7f035815acd0 2024-04-25T10:14:47.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.919+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0358141140 con 0x7f035815acd0 2024-04-25T10:14:47.928 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:14:47.919+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:14:47.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.923+0000 7f034e000640 1 -- 172.21.15.18:0/3882599232 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v108) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0340055880 con 0x7f035815acd0 2024-04-25T10:14:47.930 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:14:47.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.923+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 msgr2=0x7f0334069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.923+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 0x7f0334069420 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f03480011f0 tx=0x7f0348009040 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.923+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 msgr2=0x7f0358136bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.923+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f034000e8a0 tx=0x7f034000eca0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 shutdown_connections 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0334066f60 0x7f0334069420 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f035815ee60 0x7f03581370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035815acd0 0x7f0358136bb0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 --2- 172.21.15.18:0/3882599232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0358144120 0x7f0358154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 >> 172.21.15.18:0/3882599232 conn(0x7f0358067080 msgr2=0x7f035813acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 shutdown_connections 2024-04-25T10:14:47.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.927+0000 7f035d200640 1 -- 172.21.15.18:0/3882599232 wait complete. 2024-04-25T10:14:47.941 INFO:tasks.ceph.mds.d.smithi167.stderr: -1733> 2024-04-25T10:14:42.967+0000 7fc302800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T10:14:47.953 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T10:14:47.984 INFO:tasks.ceph.mds.d.smithi167.stdout:starting mds.d at 2024-04-25T10:14:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.991+0000 7f0f16f4c400 1 -- start start 2024-04-25T10:14:48.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.991+0000 7f0f16f4c400 1 Processor -- start 2024-04-25T10:14:48.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590063f7400 0x5590065b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5590063f7000 0x5590065b1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071be180 con 0x5590063f7800 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071be300 con 0x5590063f7400 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590071be480 con 0x5590063f7000 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37184/0 (socket says 172.21.15.18:37184) 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 -- 172.21.15.18:0/2034720418 learned_addr learned my addr 172.21.15.18:0/2034720418 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15a00640 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5590063f7000 0x5590065b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f14600640 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590063f7400 0x5590065b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 -- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5590063f7000 msgr2=0x5590065b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5590063f7000 0x5590065b1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 -- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590063f7400 msgr2=0x5590065b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590063f7400 0x5590065b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 -- 172.21.15.18:0/2034720418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590071a4b40 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f15000640 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x559007255410 tx=0x5590064b9200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57765a375861dadb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f11e00640 1 -- 172.21.15.18:0/2034720418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642c4e0 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f11e00640 1 -- 172.21.15.18:0/2034720418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559006440e00 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f11e00640 1 -- 172.21.15.18:0/2034720418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642cb60 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590071a4d20 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5590071a4f00 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 4 waiting for MDS map... 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f11e00640 1 -- 172.21.15.18:0/2034720418 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x55900731e600 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f11e00640 1 -- 172.21.15.18:0/2034720418 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 108) v1 ==== 2723+0+0 (secure 0 0 0) 0x55900644d180 con 0x5590063f7800 2024-04-25T10:14:48.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 4 Got MDS map 108 2024-04-25T10:14:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 10 main: JournalTool::main 2024-04-25T10:14:48.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 4 main: JournalTool: connecting to RADOS... 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 Processor -- start 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 -- start start 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.995+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321000 0x5590065b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321400 0x5590065b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071be600 con 0x559007320c00 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071be780 con 0x559007321400 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590071be900 con 0x559007321000 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37194/0 (socket says 172.21.15.18:37194) 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 -- 172.21.15.18:0/947530300 learned_addr learned my addr 172.21.15.18:0/947530300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 -- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321000 msgr2=0x5590065b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321000 0x5590065b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 -- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321400 msgr2=0x5590065b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321400 0x5590065b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 -- 172.21.15.18:0/947530300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590071a4d20 con 0x559007320c00 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x5590072549c0 tx=0x5590071b2000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89361c765a36f465 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f0f600640 1 -- 172.21.15.18:0/947530300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642c9c0 con 0x559007320c00 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f0f600640 1 -- 172.21.15.18:0/947530300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559006440c40 con 0x559007320c00 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f0f600640 1 -- 172.21.15.18:0/947530300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642c4e0 con 0x559007320c00 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- 172.21.15.18:0/947530300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 msgr2=0x5590065b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x5590072549c0 tx=0x5590071b2000 comp rx=0 tx=0).stop 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- 172.21.15.18:0/947530300 shutdown_connections 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321400 0x5590065b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321000 0x5590065b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/947530300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007320c00 0x5590065b1600 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- 172.21.15.18:0/947530300 >> 172.21.15.18:0/947530300 conn(0x5590063f6c00 msgr2=0x559006425800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- 172.21.15.18:0/947530300 shutdown_connections 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- 172.21.15.18:0/947530300 wait complete. 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 Processor -- start 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- start start 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007320c00 0x5590065b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321000 0x5590065b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071bfb00 con 0x559007321400 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071bf980 con 0x559007321000 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590071bf800 con 0x559007320c00 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37202/0 (socket says 172.21.15.18:37202) 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 -- 172.21.15.18:0/2287077118 learned_addr learned my addr 172.21.15.18:0/2287077118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15000640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321000 0x5590065b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f15a00640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007320c00 0x5590065b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 -- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007320c00 msgr2=0x5590065b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007320c00 0x5590065b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 -- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321000 msgr2=0x5590065b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321000 0x5590065b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 -- 172.21.15.18:0/2287077118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590071a5c20 con 0x559007321400 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:47.999+0000 7f0f14600640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x55900732d380 tx=0x559007330c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 -- 172.21.15.18:0/2287077118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642c9c0 con 0x559007321400 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 -- 172.21.15.18:0/2287077118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559006440540 con 0x559007321400 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 -- 172.21.15.18:0/2287077118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55900642c4e0 con 0x559007321400 2024-04-25T10:14:48.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590071a5e00 con 0x559007321400 2024-04-25T10:14:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590071a5e00 con 0x559007321400 2024-04-25T10:14:48.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 4 main: JournalTool: resolving pool 17 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 -- 172.21.15.18:0/2287077118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x559006728c00 con 0x559007321400 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 0x5590065b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f0d800640 1 -- 172.21.15.18:0/2287077118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x559006736800 con 0x559007321400 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 4 main: JournalTool: creating IoCtx.. 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 4 main: Executing for rank 0 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f15a00640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 0x5590065b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f15a00640 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 0x5590065b3700 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5590072549c0 tx=0x5590071b2420 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 1 -- start start 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.003+0000 7f0f16f4c400 1 Processor -- start 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321c00 0x5590065b2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559006735000 0x5590065b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 0x5590065b1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071bf500 con 0x559006735400 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590071be780 con 0x559006735000 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590071bea80 con 0x559007321c00 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 0x5590065b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 0x5590065b1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37210/0 (socket says 172.21.15.18:37210) 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 -- 172.21.15.18:0/686377627 learned_addr learned my addr 172.21.15.18:0/686377627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f15a00640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321c00 0x5590065b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f15000640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559006735000 0x5590065b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321c00 msgr2=0x5590065b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007321c00 0x5590065b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559006735000 msgr2=0x5590065b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559006735000 0x5590065b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590068703c0 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f14600640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 0x5590065b1600 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x5590067e3350 tx=0x559007331560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b456501b4bf4009f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f09c00640 1 -- 172.21.15.18:0/686377627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590067afba0 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f09c00640 1 -- 172.21.15.18:0/686377627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559006441340 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f09c00640 1 -- 172.21.15.18:0/686377627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590067afd40 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590068705a0 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559006870780 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 4 waiting for MDS map... 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f09c00640 1 -- 172.21.15.18:0/686377627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x559006880200 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f09c00640 1 -- 172.21.15.18:0/686377627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 108) v1 ==== 2723+0+0 (secure 0 0 0) 0x5590067ae000 con 0x559006735400 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 4 Got MDS map 108 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x559006735800 0x559006896000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x559006735c00 con 0x559006735800 2024-04-25T10:14:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f15a00640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x559006735800 0x559006896000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.007+0000 7f0f15a00640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x559006735800 0x559006896000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=cded4ccbf4e7fab0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.011+0000 7f0f15a00640 1 -- 172.21.15.18:0/686377627 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v125'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572000 con 0x559006735800 2024-04-25T10:14:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.011+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55900687f000 0x559006896580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.011+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x55900687f400 con 0x55900687f000 2024-04-25T10:14:48.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.011+0000 7f0f15000640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55900687f000 0x559006896580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.011+0000 7f0f15000640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55900687f000 0x559006896580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=17d375499824ddd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v125'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572500 con 0x55900687f000 2024-04-25T10:14:48.023 INFO:teuthology.orchestra.run.smithi018.stdout:writing EResetJournal entry 2024-04-25T10:14:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x55900687f800 con 0x55900687f000 2024-04-25T10:14:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55900687fc00 0x559006896b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x5590068a6000 con 0x55900687fc00 2024-04-25T10:14:48.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5590068a6400 0x559006897080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x5590068a6800 con 0x5590068a6400 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5590068a6c00 0x559006897600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x5590068a7000 con 0x5590068a6c00 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x5590068a7400 con 0x5590068a6400 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x5590068a7800 con 0x559006735800 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15000640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5590068a6400 0x559006897080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15a00640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55900687fc00 0x559006896b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f14600640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5590068a6c00 0x559006897600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15a00640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55900687fc00 0x559006896b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=22c3021dd6745bfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15000640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5590068a6400 0x559006897080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=2ef2ec2e6114c466 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(3 200.00000001 [delete] v125'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572500 con 0x55900687f000 2024-04-25T10:14:48.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f14600640 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5590068a6c00 0x559006897600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=b9c717b314b03e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.015+0000 7f0f15a00640 1 -- 172.21.15.18:0/686377627 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(8 200.00000006 [delete] v125'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572000 con 0x559006735800 2024-04-25T10:14:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15a00640 1 -- 172.21.15.18:0/686377627 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(4 200.00000002 [delete] v125'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572000 con 0x55900687fc00 2024-04-25T10:14:48.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f07e00640 1 -- 172.21.15.18:0/686377627 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x559007320800 con 0x55900687f000 2024-04-25T10:14:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f14600640 1 -- 172.21.15.18:0/686377627 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(6 200.00000004 [delete] v125'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572780 con 0x5590068a6c00 2024-04-25T10:14:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(7 200.00000005 [delete] v125'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572500 con 0x5590068a6400 2024-04-25T10:14:48.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(5 200.00000003 [delete] v125'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572500 con 0x5590068a6400 2024-04-25T10:14:48.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v125'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x559006572500 con 0x55900687f000 2024-04-25T10:14:48.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5590068a6400 msgr2=0x559006897080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x5590068a6400 0x559006897080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x559006735800 msgr2=0x559006896000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x559006735800 0x559006896000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55900687f000 msgr2=0x559006896580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55900687f000 0x559006896580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55900687fc00 msgr2=0x559006896b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55900687fc00 0x559006896b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5590068a6c00 msgr2=0x559006897600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x5590068a6c00 0x559006897600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 reap_dead start 2024-04-25T10:14:48.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 msgr2=0x5590065b1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/686377627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559006735400 0x5590065b1600 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x5590067e3350 tx=0x559007331560 comp rx=0 tx=0).stop 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 reap_dead start 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f15000640 1 -- 172.21.15.18:0/686377627 reap_dead start 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 shutdown_connections 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 >> 172.21.15.18:0/686377627 conn(0x559007321800 msgr2=0x55900686a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 shutdown_connections 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/686377627 wait complete. 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 msgr2=0x5590065b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 0x5590065b3700 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x5590072549c0 tx=0x5590071b2420 comp rx=0 tx=0).stop 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 msgr2=0x5590065b2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x55900732d380 tx=0x559007330c00 comp rx=0 tx=0).stop 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 shutdown_connections 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559007321400 0x5590065b2680 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559007321000 0x5590065b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x559006734c00 0x5590065b3700 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2287077118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x559007320c00 0x5590065b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 >> 172.21.15.18:0/2287077118 conn(0x5590063f6c00 msgr2=0x559006425800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 shutdown_connections 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2287077118 wait complete. 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 msgr2=0x5590065b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x559007255410 tx=0x5590064b9200 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 shutdown_connections 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5590063f7000 0x5590065b1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5590063f7400 0x5590065b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 --2- 172.21.15.18:0/2034720418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590063f7800 0x5590065b0580 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.019+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 >> 172.21.15.18:0/2034720418 conn(0x5590063f7c00 msgr2=0x559006425000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.023+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 shutdown_connections 2024-04-25T10:14:48.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.023+0000 7f0f16f4c400 1 -- 172.21.15.18:0/2034720418 wait complete. 2024-04-25T10:14:48.034 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.081102, result: writing EResetJournal entry 2024-04-25T10:14:48.034 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T10:14:48.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 -- start start 2024-04-25T10:14:48.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 Processor -- start 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 0x560deb6deb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560deb525800 0x560deb6df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dec2fe600 con 0x560deb525000 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dec2fe480 con 0x560deb525800 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.111+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dec2fe300 con 0x560deb525400 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37226/0 (socket says 172.21.15.18:37226) 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/3708287384 learned_addr learned my addr 172.21.15.18:0/3708287384 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce76600640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560deb525800 0x560deb6df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75200640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 0x560deb6deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 msgr2=0x560deb6deb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 0x560deb6deb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560deb525800 msgr2=0x560deb6df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560deb525800 0x560deb6df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/3708287384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560deb54a1e0 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75200640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 0x560deb6deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x560dec371470 tx=0x560deb5bc600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3363b99c62cf74c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce72a00640 1 -- 172.21.15.18:0/3708287384 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55a4e0 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce72a00640 1 -- 172.21.15.18:0/3708287384 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560deb56ec40 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce72a00640 1 -- 172.21.15.18:0/3708287384 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55ab60 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560deb54b2c0 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560deb54ba40 con 0x560deb525000 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 4 waiting for MDS map... 2024-04-25T10:14:48.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce72a00640 1 -- 172.21.15.18:0/3708287384 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x560deb623000 con 0x560deb525000 2024-04-25T10:14:48.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce72a00640 1 -- 172.21.15.18:0/3708287384 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 108) v1 ==== 2723+0+0 (secure 0 0 0) 0x560deb57b180 con 0x560deb525000 2024-04-25T10:14:48.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 4 Got MDS map 108 2024-04-25T10:14:48.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 4 datascan.main: Using metadata pool output 2024-04-25T10:14:48.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 Processor -- start 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- start start 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48ec00 0x560deb6e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dec2fe180 con 0x560dec48e800 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb584480 con 0x560dec48e400 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560deb584900 con 0x560dec48ec00 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37240/0 (socket says 172.21.15.18:37240) 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/49485931 learned_addr learned my addr 172.21.15.18:0/49485931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce76600640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75200640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48ec00 0x560deb6e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48ec00 msgr2=0x560deb6e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48ec00 0x560deb6e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 msgr2=0x560deb6df600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6df600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 -- 172.21.15.18:0/49485931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560deb54bc20 con 0x560dec48e800 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce76600640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6df600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.115+0000 7fce75c00640 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x560dec43c8a0 tx=0x560deb5bc420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0eab323bd85f712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce70200640 1 -- 172.21.15.18:0/49485931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55a340 con 0x560dec48e800 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce70200640 1 -- 172.21.15.18:0/49485931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560deb56ea80 con 0x560dec48e800 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce70200640 1 -- 172.21.15.18:0/49485931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55a4e0 con 0x560dec48e800 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/49485931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 msgr2=0x560deb6dfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x560dec43c8a0 tx=0x560deb5bc420 comp rx=0 tx=0).stop 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/49485931 shutdown_connections 2024-04-25T10:14:48.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48ec00 0x560deb6e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48e800 0x560deb6dfb80 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/49485931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6df600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/49485931 >> 172.21.15.18:0/49485931 conn(0x560dec48e000 msgr2=0x560deb552000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/49485931 shutdown_connections 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/49485931 wait complete. 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 Processor -- start 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- start start 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48e800 0x560deb6e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 0x560deb6e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dec2ff380 con 0x560dec48ec00 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x560dec2ff500 con 0x560dec48e400 2024-04-25T10:14:48.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x560dec2fe180 con 0x560dec48e800 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce75200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 0x560deb6e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce75200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 0x560deb6e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37244/0 (socket says 172.21.15.18:37244) 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:60540/0 (socket says 172.21.15.18:60540) 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 learned_addr learned my addr 172.21.15.18:0/2323085236 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48e800 0x560deb6e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48e800 msgr2=0x560deb6e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560dec48e800 0x560deb6e0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 msgr2=0x560deb6e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 0x560deb6e0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560deb54a1e0 con 0x560dec48e400 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560dec48ec00 0x560deb6e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x560dec371080 tx=0x560deb5bc000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce6e400640 1 -- 172.21.15.18:0/2323085236 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55a9c0 con 0x560dec48e400 2024-04-25T10:14:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce6e400640 1 -- 172.21.15.18:0/2323085236 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560deb56f340 con 0x560dec48e400 2024-04-25T10:14:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce6e400640 1 -- 172.21.15.18:0/2323085236 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560deb55a340 con 0x560dec48e400 2024-04-25T10:14:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560deb54b2c0 con 0x560dec48e400 2024-04-25T10:14:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560deb54ba40 con 0x560dec48e400 2024-04-25T10:14:48.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.119+0000 7fce77ada8c0 4 datascan.init: resolving metadata pool 17 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce6e400640 1 -- 172.21.15.18:0/2323085236 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x560dec4acc00 con 0x560dec48e400 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce6e400640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 0x560deb6e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce6e400640 1 -- 172.21.15.18:0/2323085236 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x560deb5ba400 con 0x560dec48e400 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce77ada8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce77ada8c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce77ada8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x560deb94c400 0x560deb6e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb94c400 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 0x560deb6e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x560deb94c400 0x560deb6e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x560deb94c400 0x560deb6e0100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 0x560deb6e1700 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x560dec43c8a0 tx=0x560dec458c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(1 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce6f800640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x560deb94d800 0x560deb960000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.123+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94dc00 con 0x560deb94d800 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x560deb94d800 0x560deb960000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x560deb94d800 0x560deb960000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(2 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce70200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x560deb964000 0x560deb960580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964400 con 0x560deb964000 2024-04-25T10:14:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.127+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x560deb964000 0x560deb960580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x560deb964000 0x560deb960580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(3 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964c00 con 0x560deb94c400 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(4 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964800 con 0x560deb94c400 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(5 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965000 con 0x560deb94d800 2024-04-25T10:14:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(6 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce70200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x560deb964c00 0x560deb960b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964800 con 0x560deb964c00 2024-04-25T10:14:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x560deb964c00 0x560deb960b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x560deb964c00 0x560deb960b00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(7 [pgnls start_epoch 125 out=81b] v123'17 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:8 18.18 18:1ad8d55b:::10000000006.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94cc00 con 0x560deb964c00 2024-04-25T10:14:48.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(8 10000000006.00000001 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce77ada8c0 10 datascan.operator(): handling object 1099511627782.1 2024-04-25T10:14:48.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.131+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:9 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94d000 con 0x560deb964000 2024-04-25T10:14:48.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(9 10000000006.00000000 [call] v125'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x560deb94d400 0x560deb6dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965800 con 0x560deb94d400 2024-04-25T10:14:48.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x560deb94d400 0x560deb6dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x560deb94d400 0x560deb6dfb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(10 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb94c400 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(11 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965400 con 0x560deb94c400 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(12 [pgnls start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964800 con 0x560deb964000 2024-04-25T10:14:48.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(13 [pgnls start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb974000 con 0x560deb94c400 2024-04-25T10:14:48.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(14 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965400 con 0x560deb94d800 2024-04-25T10:14:48.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(15 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce6f800640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x560deb974400 0x560deb961600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb974800 con 0x560deb974400 2024-04-25T10:14:48.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.135+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x560deb974400 0x560deb961600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75c00640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x560deb974400 0x560deb961600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(16 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94cc00 con 0x560deb964c00 2024-04-25T10:14:48.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(17 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce6f800640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x560deb974c00 0x560deb961b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964400 con 0x560deb974c00 2024-04-25T10:14:48.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x560deb974c00 0x560deb961b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75200640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x560deb974c00 0x560deb961b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(18 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb974c00 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(19 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94d000 con 0x560deb94d400 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(20 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb974800 con 0x560deb974400 2024-04-25T10:14:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(21 [pgnls start_epoch 125 out=81b] v124'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:22 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965c00 con 0x560deb974400 2024-04-25T10:14:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(22 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce77ada8c0 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T10:14:48.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.139+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:23 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975000 con 0x560deb974400 2024-04-25T10:14:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(23 10000000002.00000000 [call] v125'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:24 18.32 18:4c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975400 con 0x560deb94d400 2024-04-25T10:14:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(24 [pgnls start_epoch 125 out=81b] v123'16 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:25 18.32 18:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975800 con 0x560deb94d400 2024-04-25T10:14:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(25 10000000003.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce77ada8c0 10 datascan.operator(): handling object 1099511627779.0 2024-04-25T10:14:48.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:26 18.32 18:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975c00 con 0x560deb94d400 2024-04-25T10:14:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 5 ==== osd_op_reply(26 10000000003.00000000 [call] v125'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:27 18.a 18:50000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988000 con 0x560deb94d400 2024-04-25T10:14:48.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 6 ==== osd_op_reply(27 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce6f800640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x560deb94dc00 0x560deb962100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:28 18.2a 18:54000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec303000 con 0x560deb94dc00 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.143+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x560deb94dc00 0x560deb962100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x560deb94dc00 0x560deb962100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(28 [pgnls start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:29 18.1a 18:58000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964800 con 0x560deb94d400 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 7 ==== osd_op_reply(29 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:30 18.3a 18:5c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec48f800 con 0x560deb94c400 2024-04-25T10:14:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(30 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:31 18.6 18:60000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965000 con 0x560deb974c00 2024-04-25T10:14:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(31 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:32 18.26 18:64000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb974000 con 0x560deb974400 2024-04-25T10:14:48.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 5 ==== osd_op_reply(32 [pgnls start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:33 18.16 18:68000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965800 con 0x560deb94d400 2024-04-25T10:14:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 8 ==== osd_op_reply(33 [pgnls start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:34 18.36 18:6c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94cc00 con 0x560deb964c00 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(34 [pgnls start_epoch 125 out=49b] v123'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:35 18.e 18:70000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965400 con 0x560deb94c400 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(35 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:36 18.2e 18:74000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb94d400 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 9 ==== osd_op_reply(36 [pgnls start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:37 18.1e 18:78000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec303000 con 0x560deb94d800 2024-04-25T10:14:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(37 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:38 18.3e 18:7c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94d000 con 0x560deb94d400 2024-04-25T10:14:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.147+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 10 ==== osd_op_reply(38 [pgnls start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:39 18.1 18:80000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988000 con 0x560deb94d400 2024-04-25T10:14:48.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 11 ==== osd_op_reply(39 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:40 18.21 18:84000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec48f800 con 0x560deb94d800 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(40 [pgnls start_epoch 125 out=49b] v123'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:41 18.11 18:88000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975400 con 0x560deb964c00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(41 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:42 18.31 18:8c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964400 con 0x560deb94dc00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(42 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975800 con 0x560deb94d400 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 12 ==== osd_op_reply(43 [pgnls start_epoch 125 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec48f800 con 0x560deb974c00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(44 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975c00 con 0x560deb94dc00 2024-04-25T10:14:48.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(45 [pgnls start_epoch 125 out=49b] v123'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:46 18.39 18:9c000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988000 con 0x560deb94c400 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 9 ==== osd_op_reply(46 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:47 18.5 18:a0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988000 con 0x560deb964c00 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(47 [pgnls start_epoch 125 out=81b] v124'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.151+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:48 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988400 con 0x560deb964c00 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(48 10000000004.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T10:14:48.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:49 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988800 con 0x560deb964c00 2024-04-25T10:14:48.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(49 10000000004.00000000 [call] v125'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:50 18.25 18:a4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb988c00 con 0x560deb964000 2024-04-25T10:14:48.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(50 [pgnls start_epoch 125 out=81b] v125'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:51 18.25 18:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb989000 con 0x560deb964000 2024-04-25T10:14:48.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(51 10000000006.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 10 datascan.operator(): handling object 1099511627782.0 2024-04-25T10:14:48.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:52 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb989400 con 0x560deb964000 2024-04-25T10:14:48.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 6 ==== osd_op_reply(52 10000000006.00000000 [call] v125'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.155+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb989800 con 0x560deb94d800 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(53 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb94dc00 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(54 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec48f800 con 0x560deb94dc00 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(55 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94d000 con 0x560deb964000 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.6 v2:172.21.15.167:6808/3449298510 7 ==== osd_op_reply(56 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb964000 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975400 con 0x560deb94c400 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.0 v2:172.21.15.18:6800/3884042883 10 ==== osd_op_reply(57 [pgnls start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb94c400 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560dec303000 con 0x560deb94d400 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.3 v2:172.21.15.18:6817/3876934381 13 ==== osd_op_reply(58 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d400 2024-04-25T10:14:48.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965000 con 0x560deb964c00 2024-04-25T10:14:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 9 ==== osd_op_reply(59 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964800 con 0x560deb974400 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 6 ==== osd_op_reply(60 [pgnls start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965400 con 0x560deb974c00 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(61 [pgnls start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965800 con 0x560deb964c00 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 10 ==== osd_op_reply(62 [pgnls start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94cc00 con 0x560deb94d800 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(63 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.159+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb964400 con 0x560deb974c00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 6 ==== osd_op_reply(64 [pgnls start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb989800 con 0x560deb964c00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 11 ==== osd_op_reply(65 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965000 con 0x560deb94dc00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(66 [pgnls start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975800 con 0x560deb974400 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75c00640 1 -- 172.21.15.18:0/2323085236 <== osd.2 v2:172.21.15.18:6816/2456241268 7 ==== osd_op_reply(67 [pgnls start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634780 con 0x560deb974400 2024-04-25T10:14:48.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965400 con 0x560deb94d800 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(68 [pgnls start_epoch 125 out=49b] v123'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975c00 con 0x560deb94d800 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 9 ==== osd_op_reply(69 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb965800 con 0x560deb974c00 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 7 ==== osd_op_reply(70 [pgnls start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb975400 con 0x560deb94d800 2024-04-25T10:14:48.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.5 v2:172.21.15.167:6824/2931035891 10 ==== osd_op_reply(71 [pgnls start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94d800 2024-04-25T10:14:48.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94c800 con 0x560deb964c00 2024-04-25T10:14:48.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.1 v2:172.21.15.18:6808/600232426 12 ==== osd_op_reply(72 [pgnls start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb964c00 2024-04-25T10:14:48.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce70200640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb974800 con 0x560deb974c00 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 <== osd.7 v2:172.21.15.167:6809/19218082 8 ==== osd_op_reply(73 [pgnls start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634000 con 0x560deb974c00 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce6f800640 1 -- 172.21.15.18:0/2323085236 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x560deb94cc00 con 0x560deb94dc00 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce76600640 1 -- 172.21.15.18:0/2323085236 <== osd.4 v2:172.21.15.167:6800/3323785626 7 ==== osd_op_reply(74 [pgnls start_epoch 125 out=49b] v123'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560deb634500 con 0x560deb94dc00 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x560deb94c400 msgr2=0x560deb6e0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x560deb94c400 0x560deb6e0100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x560deb964c00 msgr2=0x560deb960b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x560deb964c00 0x560deb960b00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x560deb974400 msgr2=0x560deb961600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x560deb974400 0x560deb961600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x560deb94d400 msgr2=0x560deb6dfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x560deb94d400 0x560deb6dfb80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x560deb94dc00 msgr2=0x560deb962100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x560deb94dc00 0x560deb962100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x560deb94d800 msgr2=0x560deb960000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x560deb94d800 0x560deb960000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x560deb964000 msgr2=0x560deb960580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x560deb964000 0x560deb960580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x560deb974c00 msgr2=0x560deb961b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x560deb974c00 0x560deb961b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 reap_dead start 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.163+0000 7fce75200640 1 -- 172.21.15.18:0/2323085236 reap_dead start 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 msgr2=0x560deb6e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 0x560deb6e1700 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x560dec43c8a0 tx=0x560dec458c00 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 msgr2=0x560deb6e1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x560dec371080 tx=0x560deb5bc000 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 shutdown_connections 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x560deb94c000 0x560deb6e1700 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/2323085236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560dec48e400 0x560deb6e1180 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 >> 172.21.15.18:0/2323085236 conn(0x560dec48e000 msgr2=0x560deb552000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 shutdown_connections 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/2323085236 wait complete. 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 msgr2=0x560deb6de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x560dec371470 tx=0x560deb5bc600 comp rx=0 tx=0).stop 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 shutdown_connections 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560deb525800 0x560deb6df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x560deb525400 0x560deb6deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 --2- 172.21.15.18:0/3708287384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560deb525000 0x560deb6de580 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 >> 172.21.15.18:0/3708287384 conn(0x560deb524c00 msgr2=0x560deb551800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 shutdown_connections 2024-04-25T10:14:48.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.167+0000 7fce77ada8c0 1 -- 172.21.15.18:0/3708287384 wait complete. 2024-04-25T10:14:48.179 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.144404, result: 2024-04-25T10:14:48.179 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T10:14:48.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- start start 2024-04-25T10:14:48.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 Processor -- start 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 0x55b6ffb84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b6ff9cb000 0x55b6ffb85080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700796180 con 0x55b6ff9cb800 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700796300 con 0x55b6ff9cb400 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b700796480 con 0x55b6ff9cb000 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37258/0 (socket says 172.21.15.18:37258) 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 -- 172.21.15.18:0/59770913 learned_addr learned my addr 172.21.15.18:0/59770913 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5d400640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 0x55b6ffb84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5e800640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b6ff9cb000 0x55b6ffb85080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 -- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b6ff9cb000 msgr2=0x55b6ffb85080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b6ff9cb000 0x55b6ffb85080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 -- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 msgr2=0x55b6ffb84b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 0x55b6ffb84b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 -- 172.21.15.18:0/59770913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ff9f01e0 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5d400640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 0x55b6ffb84b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5de00640 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x55b7008198c0 tx=0x55b6ffa85020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a494da01bfe727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5ac00640 1 -- 172.21.15.18:0/59770913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa004e0 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5ac00640 1 -- 172.21.15.18:0/59770913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6ffa141c0 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5ac00640 1 -- 172.21.15.18:0/59770913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa00b60 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6ff9f12c0 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.259+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b6ff9f1a40 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 4 waiting for MDS map... 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5ac00640 1 -- 172.21.15.18:0/59770913 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x55b7008e2600 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5ac00640 1 -- 172.21.15.18:0/59770913 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 108) v1 ==== 2723+0+0 (secure 0 0 0) 0x55b6ffa21180 con 0x55b6ff9cb800 2024-04-25T10:14:48.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 4 Got MDS map 108 2024-04-25T10:14:48.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T10:14:48.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 4 datascan.main: Using metadata pool output 2024-04-25T10:14:48.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 Processor -- start 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- start start 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dcc00 0x55b6ffb85600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dd400 0x55b6ffb86100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700796600 con 0x55b7008dd000 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700796780 con 0x55b7008dd400 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b700796900 con 0x55b7008dcc00 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dcc00 0x55b6ffb85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37266/0 (socket says 172.21.15.18:37266) 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 -- 172.21.15.18:0/2474732479 learned_addr learned my addr 172.21.15.18:0/2474732479 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5d400640 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dd400 0x55b6ffb86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 -- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dcc00 msgr2=0x55b6ffb85600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dcc00 0x55b6ffb85600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 -- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dd400 msgr2=0x55b6ffb86100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dd400 0x55b6ffb86100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 -- 172.21.15.18:0/2474732479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ff9f1c20 con 0x55b7008dd000 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5de00640 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x55b7008d0660 tx=0x55b6ffa847e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9f9601cfe6be5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca58400640 1 -- 172.21.15.18:0/2474732479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa00340 con 0x55b7008dd000 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca58400640 1 -- 172.21.15.18:0/2474732479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6ffa14e00 con 0x55b7008dd000 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca58400640 1 -- 172.21.15.18:0/2474732479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa004e0 con 0x55b7008dd000 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/2474732479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 msgr2=0x55b6ffb85b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x55b7008d0660 tx=0x55b6ffa847e0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/2474732479 shutdown_connections 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dd400 0x55b6ffb86100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb85b80 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/2474732479 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dcc00 0x55b6ffb85600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/2474732479 >> 172.21.15.18:0/2474732479 conn(0x55b6ff9cac00 msgr2=0x55b6ff9f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/2474732479 shutdown_connections 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.263+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/2474732479 wait complete. 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 Processor -- start 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- start start 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dcc00 0x55b6ffb87180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dd400 0x55b6ffb86680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700797c80 con 0x55b7008dd000 2024-04-25T10:14:48.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b700797b00 con 0x55b7008dcc00 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b700797980 con 0x55b7008dd400 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37276/0 (socket says 172.21.15.18:37276) 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 learned_addr learned my addr 172.21.15.18:0/1353124425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dd400 0x55b6ffb86680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dcc00 0x55b6ffb87180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dd400 msgr2=0x55b6ffb86680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b7008dd400 0x55b6ffb86680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dcc00 msgr2=0x55b6ffb87180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7008dcc00 0x55b6ffb87180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6ff9f01e0 con 0x55b7008dd000 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x55b7008d1920 tx=0x55b7008f4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca56600640 1 -- 172.21.15.18:0/1353124425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa00b60 con 0x55b7008dd000 2024-04-25T10:14:48.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca56600640 1 -- 172.21.15.18:0/1353124425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b6ffa14c40 con 0x55b7008dd000 2024-04-25T10:14:48.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca56600640 1 -- 172.21.15.18:0/1353124425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b6ffa00000 con 0x55b7008dd000 2024-04-25T10:14:48.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6ff9f12c0 con 0x55b7008dd000 2024-04-25T10:14:48.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6ff9f1e00 con 0x55b7008dd000 2024-04-25T10:14:48.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.267+0000 7fca5fc5f8c0 4 datascan.init: resolving metadata pool 17 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca56600640 1 -- 172.21.15.18:0/1353124425 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55b700952c00 con 0x55b7008dd000 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca56600640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 0x55b6ffb87700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca56600640 1 -- 172.21.15.18:0/1353124425 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x55b6ffcfe600 con 0x55b7008dd000 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55b7008dd800 0x55b6ffb86100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7008ddc00 con 0x55b7008dd800 2024-04-25T10:14:48.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 0x55b6ffb87700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55b7008dd800 0x55b6ffb86100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55b7008dd800 0x55b6ffb86100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 0x55b6ffb87700 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55b6ffaa6ea0 tx=0x55b7008f5e60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv34 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55b7008ddc00 0x55b6ffb85b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a9400 con 0x55b7008ddc00 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55b7008ddc00 0x55b6ffb85b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55b7008ddc00 0x55b6ffb85b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55b7007a9000 0x55b6ffb85600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a8800 con 0x55b7007a9000 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.271+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55b7007a9000 0x55b6ffb85600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55b7007a9000 0x55b6ffb85600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca57a00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55b6ffdfe000 0x55b6ffe04000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfe400 con 0x55b6ffdfe000 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55b6ffdfe000 0x55b6ffe04000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55b6ffdfe000 0x55b6ffe04000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfec00 con 0x55b7008ddc00 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfe800 con 0x55b7007a9000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff000 con 0x55b7007a9000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca58400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b6ffdff400 0x55b6ffe04580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfe800 con 0x55b6ffdff400 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.275+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b6ffdff400 0x55b6ffe04580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b6ffdff400 0x55b6ffe04580 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 125 out=49b] v123'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00800 con 0x55b7008dd800 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff000 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00400 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a8800 con 0x55b7008ddc00 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfec00 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff800 con 0x55b6ffdfe000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca57a00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55b6ffdfe800 0x55b6ffe04b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a9400 con 0x55b6ffdfe800 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55b6ffdfe800 0x55b6ffe04b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55b6ffdfe800 0x55b6ffe04b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.279+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdffc00 con 0x55b6ffdff400 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca57a00640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55b6ffd01c00 0x55b6ffe05080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14000 con 0x55b6ffd01c00 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55b6ffd01c00 0x55b6ffe05080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55b6ffd01c00 0x55b6ffe05080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15400 con 0x55b6ffd01c00 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14400 con 0x55b7008dd800 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 125 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15800 con 0x55b6ffdfe800 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 125 out=81b] v125'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a8c00 con 0x55b7007a9000 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14800 con 0x55b7008ddc00 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14000 con 0x55b7007a9000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.283+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14c00 con 0x55b7007a9000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15400 con 0x55b6ffdfe000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15000 con 0x55b6ffdff400 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 125 out=49b] v123'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfe400 con 0x55b7008dd800 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15800 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff800 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a9400 con 0x55b7008ddc00 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00c00 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a8c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00800 con 0x55b6ffdfe800 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff000 con 0x55b6ffdff400 2024-04-25T10:14:48.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.287+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14800 con 0x55b6ffd01c00 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfec00 con 0x55b6ffd01c00 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15000 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffd00400 con 0x55b6ffdfe800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 125 out=49b] v125'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14000 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 125 out=81b] v125'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 10 datascan.operator(): handling object 10000000003.0 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:42 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfec00 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 7 ==== osd_op_reply(42 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:43 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14400 con 0x55b7007a9000 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 13 ==== osd_op_reply(43 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:44 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15c00 con 0x55b7008dd800 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 8 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+524 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.get_frag_of: frag is * 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:45 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15400 con 0x55b7007a9000 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 14 ==== osd_op_reply(45 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T10:14:48.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14800 con 0x55b7007a9000 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 15 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.291+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:47 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a8c00 con 0x55b7007a9000 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 16 ==== osd_op_reply(47 10000000001.00000000 [omap-set-vals] v125'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5fc5f8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:48 18.a 18:50000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14c00 con 0x55b7008dd800 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca58400640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55b7007a8800 0x55b6ffe05600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:49 18.2a 18:54000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a9400 con 0x55b7007a8800 2024-04-25T10:14:48.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55b7007a8800 0x55b6ffe05600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5e800640 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55b7007a8800 0x55b6ffe05600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(49 [pgnls-filter start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:50 18.1a 18:58000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18000 con 0x55b7008dd800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 10 ==== osd_op_reply(50 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:51 18.3a 18:5c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdffc00 con 0x55b7007a9000 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 17 ==== osd_op_reply(51 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:52 18.6 18:60000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18400 con 0x55b6ffd01c00 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.295+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:53 18.26 18:64000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18000 con 0x55b6ffdfe800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 5 ==== osd_op_reply(53 [pgnls-filter start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:54 18.16 18:68000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18800 con 0x55b7008dd800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 11 ==== osd_op_reply(54 [pgnls-filter start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:55 18.36 18:6c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18400 con 0x55b6ffdff400 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(55 [pgnls-filter start_epoch 125 out=49b] v123'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18c00 con 0x55b7007a9000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15000 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 12 ==== osd_op_reply(57 [pgnls-filter start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19000 con 0x55b6ffdfe000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14000 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 13 ==== osd_op_reply(59 [pgnls-filter start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19400 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 14 ==== osd_op_reply(60 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe15c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 125 out=49b] v123'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19800 con 0x55b6ffdff400 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14c00 con 0x55b7007a8800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.299+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19c00 con 0x55b7008dd800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 15 ==== osd_op_reply(64 [pgnls-filter start_epoch 125 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfec00 con 0x55b6ffd01c00 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38000 con 0x55b7007a8800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 125 out=49b] v123'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdfe400 con 0x55b7007a9000 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38400 con 0x55b6ffdff400 2024-04-25T10:14:48.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 125 out=49b] v125'12 uv12 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38000 con 0x55b7008ddc00 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 125 out=49b] v125'17 uv17 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38800 con 0x55b6ffdfe000 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe14c00 con 0x55b7007a8800 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38c00 con 0x55b7007a8800 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18400 con 0x55b7008ddc00 2024-04-25T10:14:48.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.6 v2:172.21.15.167:6808/3449298510 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7008ddc00 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.303+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe39000 con 0x55b7007a9000 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.0 v2:172.21.15.18:6800/3884042883 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b7007a9000 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19800 con 0x55b7008dd800 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.3 v2:172.21.15.18:6817/3876934381 16 ==== osd_op_reply(75 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b7008dd800 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe39400 con 0x55b6ffdff400 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b7007a9400 con 0x55b6ffdfe800 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 125 out=49b] v123'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe39800 con 0x55b6ffd01c00 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 125 out=49b] v123'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff000 con 0x55b6ffdff400 2024-04-25T10:14:48.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 9 ==== osd_op_reply(79 [pgnls-filter start_epoch 125 out=49b] v123'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe39c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffdff000 con 0x55b6ffd01c00 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38400 con 0x55b6ffdff400 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18400 con 0x55b7007a8800 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 125 out=49b] v123'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38000 con 0x55b6ffdfe800 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca5de00640 1 -- 172.21.15.18:0/1353124425 <== osd.2 v2:172.21.15.18:6816/2456241268 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 125 out=49b] v123'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada780 con 0x55b6ffdfe800 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.307+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe18800 con 0x55b6ffdfe000 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 125 out=49b] v123'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38c00 con 0x55b6ffdfe000 2024-04-25T10:14:48.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19000 con 0x55b6ffd01c00 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 125 out=49b] v123'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe39400 con 0x55b6ffdfe000 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.5 v2:172.21.15.167:6824/2931035891 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 125 out=49b] v123'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffdfe000 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19400 con 0x55b6ffdff400 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.1 v2:172.21.15.18:6808/600232426 11 ==== osd_op_reply(89 [pgnls-filter start_epoch 125 out=49b] v123'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b6ffdff400 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca57a00640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe38800 con 0x55b6ffd01c00 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 <== osd.7 v2:172.21.15.167:6809/19218082 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 125 out=49b] v123'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada000 con 0x55b6ffd01c00 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca58400640 1 -- 172.21.15.18:0/1353124425 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 125 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55b6ffe19c00 con 0x55b7007a8800 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5e800640 1 -- 172.21.15.18:0/1353124425 <== osd.4 v2:172.21.15.167:6800/3323785626 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 125 out=49b] v123'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b6ffada500 con 0x55b7007a8800 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55b7007a9000 msgr2=0x55b6ffb85600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55b7007a9000 0x55b6ffb85600 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b6ffdff400 msgr2=0x55b6ffe04580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55b6ffdff400 0x55b6ffe04580 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55b6ffdfe800 msgr2=0x55b6ffe04b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55b6ffdfe800 0x55b6ffe04b00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55b7008dd800 msgr2=0x55b6ffb86100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55b7008dd800 0x55b6ffb86100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 reap_dead start 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55b7007a8800 msgr2=0x55b6ffe05600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55b7007a8800 0x55b6ffe05600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55b6ffdfe000 msgr2=0x55b6ffe04000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55b6ffdfe000 0x55b6ffe04000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55b7008ddc00 msgr2=0x55b6ffb85b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55b7008ddc00 0x55b6ffb85b80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55b6ffd01c00 msgr2=0x55b6ffe05080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55b6ffd01c00 0x55b6ffe05080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5d400640 1 -- 172.21.15.18:0/1353124425 reap_dead start 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 msgr2=0x55b6ffb87700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 0x55b6ffb87700 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55b6ffaa6ea0 tx=0x55b7008f5e60 comp rx=0 tx=0).stop 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 msgr2=0x55b6ffb86c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x55b7008d1920 tx=0x55b7008f4c00 comp rx=0 tx=0).stop 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 shutdown_connections 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55b6ffd01000 0x55b6ffb87700 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/1353124425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b7008dd000 0x55b6ffb86c00 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 >> 172.21.15.18:0/1353124425 conn(0x55b6ff9cac00 msgr2=0x55b6ff9f9800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 shutdown_connections 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.311+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/1353124425 wait complete. 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 msgr2=0x55b6ffb84580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x55b7008198c0 tx=0x55b6ffa85020 comp rx=0 tx=0).stop 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 shutdown_connections 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55b6ff9cb000 0x55b6ffb85080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b6ff9cb400 0x55b6ffb84b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 --2- 172.21.15.18:0/59770913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b6ff9cb800 0x55b6ffb84580 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 >> 172.21.15.18:0/59770913 conn(0x55b6ff9cbc00 msgr2=0x55b6ff9f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 shutdown_connections 2024-04-25T10:14:48.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.315+0000 7fca5fc5f8c0 1 -- 172.21.15.18:0/59770913 wait complete. 2024-04-25T10:14:48.328 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.148750, result: 2024-04-25T10:14:48.328 DEBUG:teuthology.orchestra.run.smithi018:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T10:14:48.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- start start 2024-04-25T10:14:48.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 Processor -- start 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 0x55768c53a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 0x55768c53b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d148180 con 0x55768c381400 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d148300 con 0x55768c381000 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55768d148480 con 0x55768c381800 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37292/0 (socket says 172.21.15.18:37292) 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 -- 172.21.15.18:0/2291732094 learned_addr learned my addr 172.21.15.18:0/2291732094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847ac00640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 0x55768c53a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847b600640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 0x55768c53b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 -- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 msgr2=0x55768c53a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 0x55768c53a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 -- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 msgr2=0x55768c53b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 0x55768c53b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 -- 172.21.15.18:0/2291732094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55768c3a61e0 con 0x55768c381400 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847ac00640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 0x55768c53a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847b600640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 0x55768c53b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847a200640 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x55768d1c9b60 tx=0x55768c45a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195b3d000496fda9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f8477a00640 1 -- 172.21.15.18:0/2291732094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b64e0 con 0x55768c381400 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f8477a00640 1 -- 172.21.15.18:0/2291732094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55768c3ca540 con 0x55768c381400 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f8477a00640 1 -- 172.21.15.18:0/2291732094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b6b60 con 0x55768c381400 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55768c3a74a0 con 0x55768c381400 2024-04-25T10:14:48.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55768c3a7a40 con 0x55768c381400 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 4 waiting for MDS map... 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f8477a00640 1 -- 172.21.15.18:0/2291732094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x55768d28a600 con 0x55768c381400 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f8477a00640 1 -- 172.21.15.18:0/2291732094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 108) v1 ==== 2723+0+0 (secure 0 0 0) 0x55768c3d7180 con 0x55768c381400 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 4 Got MDS map 108 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 4 datascan.main: Using metadata pool output 2024-04-25T10:14:48.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 4 datascan.main: connecting to RADOS... 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 Processor -- start 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.363+0000 7f847dc2f8c0 1 -- start start 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d148600 con 0x55768d295400 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d148780 con 0x55768d295000 2024-04-25T10:14:48.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55768d148900 con 0x55768d294c00 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847b600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847ac00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37296/0 (socket says 172.21.15.18:37296) 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 -- 172.21.15.18:0/4036872081 learned_addr learned my addr 172.21.15.18:0/4036872081 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 -- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d294c00 msgr2=0x55768c53b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 -- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 msgr2=0x55768c53bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 -- 172.21.15.18:0/4036872081 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55768c3a7c20 con 0x55768d295400 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847a200640 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x55768d288f00 tx=0x55768c45b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34eaab9be1a728ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f8475200640 1 -- 172.21.15.18:0/4036872081 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b6340 con 0x55768d295400 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f8475200640 1 -- 172.21.15.18:0/4036872081 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55768c3cae00 con 0x55768d295400 2024-04-25T10:14:48.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f8475200640 1 -- 172.21.15.18:0/4036872081 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b64e0 con 0x55768d295400 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/4036872081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 msgr2=0x55768c53c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x55768d288f00 tx=0x55768c45b320 comp rx=0 tx=0).stop 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/4036872081 shutdown_connections 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d295400 0x55768c53c100 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/4036872081 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/4036872081 >> 172.21.15.18:0/4036872081 conn(0x55768c380c00 msgr2=0x55768c3af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/4036872081 shutdown_connections 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/4036872081 wait complete. 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 Processor -- start 2024-04-25T10:14:48.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- start start 2024-04-25T10:14:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d295800 0x55768c53c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d149c80 con 0x55768d294c00 2024-04-25T10:14:48.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x55768d149b00 con 0x55768d295000 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847dc2f8c0 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x55768d149980 con 0x55768d295800 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847b600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847b600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37312/0 (socket says 172.21.15.18:37312) 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.367+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 learned_addr learned my addr 172.21.15.18:0/2402060797 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d295800 0x55768c53c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d295800 msgr2=0x55768c53c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768d295800 0x55768c53c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 msgr2=0x55768c53bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768d295000 0x55768c53bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55768c3a61e0 con 0x55768d294c00 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x55768d1c90b0 tx=0x55768c47e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 -- 172.21.15.18:0/2402060797 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b69c0 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 -- 172.21.15.18:0/2402060797 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55768c3cac40 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55768c3a74a0 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 -- 172.21.15.18:0/2402060797 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55768c3b6340 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55768c3a7a40 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 4 datascan.init: resolving metadata pool 17 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 -- 172.21.15.18:0/2402060797 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55768c6b2c00 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 0x55768c53d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f8473400640 1 -- 172.21.15.18:0/2402060797 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x55768c6b4600 con 0x55768d294c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 4 datascan.main: resolving metadata pool 17 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 0x55768c53cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78a400 con 0x55768d295c00 2024-04-25T10:14:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 0x55768c53d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 0x55768c53cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.371+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 0x55768c53d700 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55768c45ce40 tx=0x55768c7a0000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 0x55768c53cc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== osd_op_reply(1 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55768c78a400 0x55768c53c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d295400 con 0x55768c78a400 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55768c78a400 0x55768c53c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55768c78a400 0x55768c53c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== osd_op_reply(2 [pgnls start_epoch 125 out=177b] v124'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d295400 con 0x55768d295c00 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== osd_op_reply(3 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55768d295400 0x55768c7ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d294800 con 0x55768d295400 2024-04-25T10:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55768d295400 0x55768c7ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55768d295400 0x55768c7ac000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== osd_op_reply(4 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d294800 con 0x55768d295400 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== osd_op_reply(5 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d294800 con 0x55768c78a400 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== osd_op_reply(6 [pgnls start_epoch 125 out=149b] v125'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.375+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d294800 con 0x55768d295c00 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 3 ==== osd_op_reply(7 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55768d294800 0x55768c7ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d294400 con 0x55768d294800 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55768d294800 0x55768c7ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55768d294800 0x55768c7ac580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== osd_op_reply(8 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55768d294400 0x55768c7acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79ec00 con 0x55768d294400 2024-04-25T10:14:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55768d294400 0x55768c7acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55768d294400 0x55768c7acb00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== osd_op_reply(9 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79ec00 con 0x55768c78a400 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 3 ==== osd_op_reply(10 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79ec00 con 0x55768d295c00 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 4 ==== osd_op_reply(11 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79ec00 con 0x55768d295400 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 3 ==== osd_op_reply(12 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 0x55768c7ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79e800 con 0x55768c79ec00 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.379+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 0x55768c7ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 0x55768c7ad080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== osd_op_reply(13 [pgnls start_epoch 125 out=77b] v124'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55768c79e800 0x55768c7ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79fc00 con 0x55768c79e800 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55768c79e800 0x55768c7ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55768c79e800 0x55768c7ad600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== osd_op_reply(14 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55768c79fc00 0x55768c7ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79fc00 2024-04-25T10:14:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55768c79fc00 0x55768c7ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55768c79fc00 0x55768c7ae100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== osd_op_reply(15 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434500 con 0x55768c79fc00 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d294800 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== osd_op_reply(16 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d295400 2024-04-25T10:14:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 4 ==== osd_op_reply(17 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c78a400 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 4 ==== osd_op_reply(18 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c78a400 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 5 ==== osd_op_reply(19 [pgnls start_epoch 125 out=81b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.383+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79e800 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== osd_op_reply(20 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79ec00 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== osd_op_reply(21 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79e800 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 3 ==== osd_op_reply(22 [pgnls start_epoch 125 out=97b] v124'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d295c00 2024-04-25T10:14:48.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 5 ==== osd_op_reply(23 [pgnls start_epoch 125 out=74b] v122'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d295c00 2024-04-25T10:14:48.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 6 ==== osd_op_reply(24 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d294400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== osd_op_reply(25 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c78a400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 6 ==== osd_op_reply(26 [pgnls start_epoch 125 out=98b] v124'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d295400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 5 ==== osd_op_reply(27 [pgnls start_epoch 125 out=76b] v125'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d294400 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 3 ==== osd_op_reply(28 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.387+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d295400 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 6 ==== osd_op_reply(29 [pgnls start_epoch 125 out=105b] v125'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79ec00 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 3 ==== osd_op_reply(30 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768d294800 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 3 ==== osd_op_reply(31 [pgnls start_epoch 125 out=73b] v125'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f000 con 0x55768c79ec00 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 4 ==== osd_op_reply(32 [pgnls start_epoch 125 out=101b] v125'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78a800 con 0x55768c78a400 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78ac00 con 0x55768c78a400 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T10:14:48.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b000 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b400 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b800 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:14:48.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78bc00 con 0x55768c78a400 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78a800 con 0x55768d294800 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T10:14:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.391+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:40 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78ac00 con 0x55768c79fc00 2024-04-25T10:14:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c79fc00 2024-04-25T10:14:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 10000000005.00000000 2024-04-25T10:14:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:41 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b000 con 0x55768c78a400 2024-04-25T10:14:48.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 13 ==== osd_op_reply(41 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b400 con 0x55768c79e800 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d159400 con 0x55768d295c00 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T10:14:48.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc000 con 0x55768c78a400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc800 con 0x55768d295400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 20 datascan.scan_links: injected ino detected 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:14:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7ccc00 con 0x55768c79ec00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd000 con 0x55768d295c00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 8 ==== osd_op_reply(48 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd000 con 0x55768c78a400 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 15 ==== osd_op_reply(49 [pgnls start_epoch 125 out=177b] v124'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.395+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc000 con 0x55768d295c00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 9 ==== osd_op_reply(50 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc000 con 0x55768d295400 2024-04-25T10:14:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 9 ==== osd_op_reply(51 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 10 ==== osd_op_reply(52 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c78a400 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 16 ==== osd_op_reply(53 [pgnls start_epoch 125 out=149b] v125'41 uv41 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295c00 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 10 ==== osd_op_reply(54 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294800 2024-04-25T10:14:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 5 ==== osd_op_reply(55 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294400 2024-04-25T10:14:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 4 ==== osd_op_reply(56 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c78a400 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 17 ==== osd_op_reply(57 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295c00 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 11 ==== osd_op_reply(58 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 11 ==== osd_op_reply(59 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79ec00 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 6 ==== osd_op_reply(60 [pgnls start_epoch 125 out=77b] v124'9 uv9 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.399+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79e800 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 5 ==== osd_op_reply(61 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79fc00 2024-04-25T10:14:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.2 v2:172.21.15.18:6816/2456241268 3 ==== osd_op_reply(62 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434500 con 0x55768c79fc00 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294800 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 6 ==== osd_op_reply(63 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 12 ==== osd_op_reply(64 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c78a400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 18 ==== osd_op_reply(65 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c78a400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 19 ==== osd_op_reply(66 [pgnls start_epoch 125 out=81b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79e800 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 6 ==== osd_op_reply(67 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79ec00 2024-04-25T10:14:48.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 7 ==== osd_op_reply(68 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79e800 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 7 ==== osd_op_reply(69 [pgnls start_epoch 125 out=97b] v124'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295c00 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 12 ==== osd_op_reply(70 [pgnls start_epoch 125 out=74b] v122'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295c00 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 13 ==== osd_op_reply(71 [pgnls start_epoch 125 out=73b] v124'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294400 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 5 ==== osd_op_reply(72 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c78a400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 20 ==== osd_op_reply(73 [pgnls start_epoch 125 out=98b] v124'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.403+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 13 ==== osd_op_reply(74 [pgnls start_epoch 125 out=76b] v125'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.4 v2:172.21.15.167:6800/3323785626 6 ==== osd_op_reply(75 [pgnls start_epoch 125 out=49b] v125'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434500 con 0x55768d294400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d295400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 14 ==== osd_op_reply(76 [pgnls start_epoch 125 out=105b] v125'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79ec00 2024-04-25T10:14:48.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 8 ==== osd_op_reply(77 [pgnls start_epoch 125 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768d294800 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 7 ==== osd_op_reply(78 [pgnls start_epoch 125 out=73b] v125'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 125 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cc400 con 0x55768c79ec00 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 9 ==== osd_op_reply(79 [pgnls start_epoch 125 out=101b] v125'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd400 con 0x55768c78a400 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd800 con 0x55768c78a400 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cdc00 con 0x55768c78a400 2024-04-25T10:14:48.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd000 con 0x55768c78a400 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd400 con 0x55768c78a400 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T10:14:48.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cd800 con 0x55768c78a400 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv36 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.407+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cdc00 con 0x55768d294800 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.1 v2:172.21.15.18:6808/600232426 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768d294800 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- osd_op(unknown.0.0:87 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b000 con 0x55768c79fc00 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.2 v2:172.21.15.18:6816/2456241268 4 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434500 con 0x55768c79fc00 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 10000000005.00000000 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:88 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78ac00 con 0x55768c78a400 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 27 ==== osd_op_reply(88 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78bc00 con 0x55768c79e800 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.5 v2:172.21.15.167:6824/2931035891 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768c79e800 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b800 con 0x55768d295c00 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T10:14:48.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b400 con 0x55768c78a400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78a800 con 0x55768d295400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78bc00 con 0x55768d295400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 20 datascan.scan_links: injected ino detected 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T10:14:48.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T10:14:48.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T10:14:48.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T10:14:48.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c78b800 con 0x55768c79ec00 2024-04-25T10:14:48.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.6 v2:172.21.15.167:6808/3449298510 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x55768c434780 con 0x55768c79ec00 2024-04-25T10:14:48.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T10:14:48.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 10 datascan.scan_links: handling injected_ino 0x10000000003 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c7cdc00 con 0x55768d295400 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 20 datascan.scan_links: first is now 2 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.411+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768d159400 con 0x55768d295400 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 <== osd.0 v2:172.21.15.18:6800/3884042883 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v125'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55768c434780 con 0x55768d295400 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 10 datascan.scan_links: updating inotable 2024-04-25T10:14:48.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f400 con 0x55768c78a400 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847b600640 1 -- 172.21.15.18:0/2402060797 <== osd.3 v2:172.21.15.18:6817/3876934381 29 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55768c434500 con 0x55768c78a400 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 10 datascan.scan_links: updating snaptable 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- osd_op(unknown.0.0:98 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e125) v9 -- 0x55768c79f800 con 0x55768d295c00 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847a200640 1 -- 172.21.15.18:0/2402060797 <== osd.7 v2:172.21.15.167:6809/19218082 15 ==== osd_op_reply(98 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55768c434000 con 0x55768d295c00 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55768d295400 msgr2=0x55768c7ac000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x55768d295400 0x55768c7ac000 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55768d294800 msgr2=0x55768c7ac580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x55768d294800 0x55768c7ac580 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55768c79fc00 msgr2=0x55768c7ae100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x55768c79fc00 0x55768c7ae100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55768c78a400 msgr2=0x55768c53c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x55768c78a400 0x55768c53c100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55768d294400 msgr2=0x55768c7acb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x55768d294400 0x55768c7acb00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55768c79e800 msgr2=0x55768c7ad600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x55768c79e800 0x55768c7ad600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 reap_dead start 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 msgr2=0x55768c7ad080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 0x55768c7ad080 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847ac00640 1 -- 172.21.15.18:0/2402060797 reap_dead start 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 msgr2=0x55768c53cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 0x55768c53cc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 msgr2=0x55768c53d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 0x55768c53d700 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x55768c45ce40 tx=0x55768c7a0000 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 msgr2=0x55768c53b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x55768d1c90b0 tx=0x55768c47e000 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 shutdown_connections 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x55768c79ec00 0x55768c7ad080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x55768d295c00 0x55768c53cc00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x55768c78a000 0x55768c53d700 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2402060797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768d294c00 0x55768c53b600 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 >> 172.21.15.18:0/2402060797 conn(0x55768c380c00 msgr2=0x55768c3af800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 shutdown_connections 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2402060797 wait complete. 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 msgr2=0x55768c53ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x55768d1c9b60 tx=0x55768c45a8a0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 shutdown_connections 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55768c381000 0x55768c53b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55768c381400 0x55768c53ab00 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 --2- 172.21.15.18:0/2291732094 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x55768c381800 0x55768c53a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 >> 172.21.15.18:0/2291732094 conn(0x55768c381c00 msgr2=0x55768c3af000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 shutdown_connections 2024-04-25T10:14:48.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.415+0000 7f847dc2f8c0 1 -- 172.21.15.18:0/2291732094 wait complete. 2024-04-25T10:14:48.433 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.105227, result: 2024-04-25T10:14:48.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:48.480 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-25T10:14:48.520 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.521 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.522 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-25T10:14:48.523 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-25T10:14:48.524 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-25T10:14:48.525 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:48.526 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-25T10:14:48.527 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:48.528 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:48.529 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-25T10:14:48.530 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = False 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.531 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.532 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:48.533 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.534 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:48.535 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.536 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:48.537 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.538 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:48.539 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T10:14:48.540 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:14:48.541 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = False 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.542 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:48.592 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T10:14:48.631 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-04-25T10:14:48.632 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:48.633 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-04-25T10:14:48.634 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.635 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-04-25T10:14:48.636 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-04-25T10:14:48.637 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = bluestore 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:48.638 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:48.639 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:48.640 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-04-25T10:14:48.641 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-04-25T10:14:48.642 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout:[global] 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: chdir = "" 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: auth supported = cephx 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: filestore xattr use omap = true 2024-04-25T10:14:48.643 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: mon clock drift allowed = 1.000 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: osd crush chooseleaf type = 0 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: auth debug = true 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on old message = true 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on bug = true 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: mon pg warn max object skew = 0 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T10:14:48.644 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default size = 2 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow primary affinity = true 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd allow pg remap = true 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on legacy crush tunables = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on crush straw calc version zero = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on no sortbitwise = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on osd down out interval zero = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon warn on too few osds = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: mon_allow_pool_size_one = true 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.645 INFO:teuthology.orchestra.run.smithi167.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: osd default data pool replay window = 5 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: mon allow pool delete = true 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: mon cluster log file level = debug 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: debug asserts on shutdown = true 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: mon health detail to clog = false 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: mon host = "172.21.15.18,172.21.15.167,[v2:172.21.15.167:3301,v1:172.21.15.167:6790]" 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: ms die on skipped message = False 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: fsid = a742dcf2-a420-4fc2-9137-18bf23968324 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.646 INFO:teuthology.orchestra.run.smithi167.stdout:[osd] 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd journal size = 100 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub load threshold = 5.0 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd scrub max interval = 600 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd mclock profile = high_recovery_ops 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd recover clone overlap = true 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd recovery max chunk = 1048576 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug shutdown = true 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug op order = true 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug verify stray on activate = true 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug trim objects = true 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.647 INFO:teuthology.orchestra.run.smithi167.stdout: osd open classes on start = true 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug pg log writeout = true 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: osd deep scrub update digest min age = 30 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: osd map max advance = 10 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: journal zero on create = true 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: filestore ondisk finisher threads = 3 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: filestore apply finisher threads = 3 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: bdev debug aio = true 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: osd debug misdirected ops = true 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore block size = 96636764160 2024-04-25T10:14:48.648 INFO:teuthology.orchestra.run.smithi167.stdout: bluestore fsck on mount = True 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluefs = 20 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug bluestore = 20 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug osd = 20 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug rocksdb = 10 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd full ratio = 0.9 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd nearfull ratio = 0.8 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: osd failsafe full ratio = 0.95 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: osd objectstore = bluestore 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout:[mgr] 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.649 INFO:teuthology.orchestra.run.smithi167.stdout: debug mgr = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mgr/telemetry/nag = false 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout:[mon] 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug mon = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug paxos = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: debug auth = 20 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mon data avail warn = 5 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mon mgr mkfs grace = 240 2024-04-25T10:14:48.650 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min pgs per osd = 4 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd reporter subtree level = osd 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon osd prime pg temp = true 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon reweight min bytes per osd = 10 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: # 1m isn't quite enough 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: mon_down_mkfs_grace = 2m 2024-04-25T10:14:48.651 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: mon_warn_on_filestore_osds = false 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: mon op complaint time = 120 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout:[client] 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: rgw cache enabled = true 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable ops log = true 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: rgw enable usage log = true 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: client mount timeout = 600 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: debug client = 20 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: pid file = "" 2024-04-25T10:14:48.652 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.a] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.b] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mon.c] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.a] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.c] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.b] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mds.d] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout:[mds] 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds = 20 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: debug mds balancer = 20 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: debug ms = 1 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug frag = True 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: mds debug scatterstat = True 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: mds op complaint time = 180 2024-04-25T10:14:48.653 INFO:teuthology.orchestra.run.smithi167.stdout: mds verify scatter = True 2024-04-25T10:14:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: osd op complaint time = 180 2024-04-25T10:14:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: rados mon op timeout = 900 2024-04-25T10:14:48.654 INFO:teuthology.orchestra.run.smithi167.stdout: rados osd op timeout = 900 2024-04-25T10:14:48.655 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T10:14:48.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.831+0000 7f64d7200640 1 Processor -- start 2024-04-25T10:14:48.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.831+0000 7f64d7200640 1 -- start start 2024-04-25T10:14:48.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d7200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f64d80d0080 0x7f64d815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d7200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d809ade0 con 0x7f64d815f8f0 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d7200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d815fd20 con 0x7f64d80d0080 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8099a60 con 0x7f64d815b9e0 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f64d80d0080 0x7f64d815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d6800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f64d815f8f0 0x7f64d815bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:36754/0 (socket says 172.21.15.18:36754) 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d6800640 1 -- 172.21.15.18:0/1253158027 learned_addr learned my addr 172.21.15.18:0/1253158027 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5e00640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5400640 1 -- 172.21.15.18:0/1253158027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 msgr2=0x7f64d80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5400640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5400640 1 -- 172.21.15.18:0/1253158027 >> v1:172.21.15.18:6789/0 conn(0x7f64d815f8f0 legacy=0x7f64d815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d5400640 1 -- 172.21.15.18:0/1253158027 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d8099d40 con 0x7f64d80d0080 2024-04-25T10:14:48.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.835+0000 7f64d4a00640 1 -- 172.21.15.18:0/1253158027 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871781573 0 0) 0x7f64d00014a0 con 0x7f64d815f8f0 2024-04-25T10:14:48.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d5400640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d80d0080 0x7f64d815f3b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f64c40097c0 tx=0x7f64c401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daf28e576910c01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d4a00640 1 -- 172.21.15.18:0/1253158027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40aa600 con 0x7f64d80d0080 2024-04-25T10:14:48.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d4a00640 1 -- 172.21.15.18:0/1253158027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64c40af070 con 0x7f64d80d0080 2024-04-25T10:14:48.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d4a00640 1 -- 172.21.15.18:0/1253158027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c40aa9c0 con 0x7f64d80d0080 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- 172.21.15.18:0/1253158027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d80d0080 msgr2=0x7f64d815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d80d0080 0x7f64d815f3b0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f64c40097c0 tx=0x7f64c401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- 172.21.15.18:0/1253158027 shutdown_connections 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d80d0080 0x7f64d815f3b0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- 172.21.15.18:0/1253158027 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- 172.21.15.18:0/1253158027 >> 172.21.15.18:0/1253158027 conn(0x7f64d80b3030 msgr2=0x7f64d80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- 172.21.15.18:0/1253158027 shutdown_connections 2024-04-25T10:14:48.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- 172.21.15.18:0/1253158027 wait complete. 2024-04-25T10:14:48.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 Processor -- start 2024-04-25T10:14:48.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- start start 2024-04-25T10:14:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 0x7f64d814ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d81686f0 con 0x7f64d815f8f0 2024-04-25T10:14:48.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d809a8c0 con 0x7f64d80d0080 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d7200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d8168870 con 0x7f64d815b9e0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.839+0000 7f64d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37332/0 (socket says 172.21.15.18:37332) 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 -- 172.21.15.18:0/3094456516 learned_addr learned my addr 172.21.15.18:0/3094456516 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d5400640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d5e00640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 0x7f64d814ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 -- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 msgr2=0x7f64d806bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d806bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 -- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 msgr2=0x7f64d814ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 0x7f64d814ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 -- 172.21.15.18:0/3094456516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d806c260 con 0x7f64d815f8f0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d5e00640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 0x7f64d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d6800640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c820 tx=0x7f64d000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0018070 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000a640 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000aa30 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d81659b0 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d80ae4f0 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d80745d0 con 0x7f64d815f8f0 2024-04-25T10:14:48.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64d000abd0 con 0x7f64d815f8f0 2024-04-25T10:14:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 0x7f64b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.843+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f64d0084740 con 0x7f64d815f8f0 2024-04-25T10:14:48.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.847+0000 7f64d5e00640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 0x7f64b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.847+0000 7f64d5e00640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 0x7f64b8069450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f64d8154b90 tx=0x7f64c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:48.847+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64d809ade0 con 0x7f64d815f8f0 2024-04-25T10:14:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.051+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f64d815eee0 con 0x7f64d815f8f0 2024-04-25T10:14:50.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64ce000640 1 -- 172.21.15.18:0/3094456516 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v110) v1 ==== 162+0+0 (secure 0 0 0) 0x7f64d0054e20 con 0x7f64d815f8f0 2024-04-25T10:14:50.006 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 msgr2=0x7f64b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 0x7f64b8069450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f64d8154b90 tx=0x7f64c8008040 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 msgr2=0x7f64d81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f64d000c820 tx=0x7f64d000cce0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 shutdown_connections 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f64d815f8f0 0x7f64d81580b0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f64b8066f90 0x7f64b8069450 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f64d815b9e0 0x7f64d806bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 --2- 172.21.15.18:0/3094456516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d80d0080 0x7f64d814ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 >> 172.21.15.18:0/3094456516 conn(0x7f64d80b3030 msgr2=0x7f64d814e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:50.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 shutdown_connections 2024-04-25T10:14:50.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:49.999+0000 7f64d7200640 1 -- 172.21.15.18:0/3094456516 wait complete. 2024-04-25T10:14:50.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 Processor -- start 2024-04-25T10:14:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 -- start start 2024-04-25T10:14:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb31015fe50 0x7fb3100b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3100cc4e0 con 0x7fb310145270 2024-04-25T10:14:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb310145650 con 0x7fb31015fe50 2024-04-25T10:14:50.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb318600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3101602b0 con 0x7fb3100b1c90 2024-04-25T10:14:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb316600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb315200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb31015fe50 0x7fb3100b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb316600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3301/0 says I am v2:172.21.15.18:48682/0 (socket says 172.21.15.18:48682) 2024-04-25T10:14:50.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.171+0000 7fb316600640 1 -- 172.21.15.18:0/2277668326 learned_addr learned my addr 172.21.15.18:0/2277668326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb316600640 1 -- 172.21.15.18:0/2277668326 >> v2:172.21.15.167:3300/0 conn(0x7fb31015fe50 msgr2=0x7fb3100b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb316600640 1 --2- 172.21.15.18:0/2277668326 >> v2:172.21.15.167:3300/0 conn(0x7fb31015fe50 0x7fb3100b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb316600640 1 -- 172.21.15.18:0/2277668326 >> v1:172.21.15.167:6789/0 conn(0x7fb310145270 legacy=0x7fb3100cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb316600640 1 -- 172.21.15.18:0/2277668326 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3100ce040 con 0x7fb3100b1c90 2024-04-25T10:14:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb316600640 1 --2- 172.21.15.18:0/2277668326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb308009e50 tx=0x7fb30801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4b81de77488e1fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb30fe00640 1 -- 172.21.15.18:0/2277668326 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080a57f0 con 0x7fb3100b1c90 2024-04-25T10:14:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb30fe00640 1 -- 172.21.15.18:0/2277668326 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3080a5990 con 0x7fb3100b1c90 2024-04-25T10:14:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb30fe00640 1 -- 172.21.15.18:0/2277668326 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080a5d60 con 0x7fb3100b1c90 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 -- 172.21.15.18:0/2277668326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 msgr2=0x7fb31015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 --2- 172.21.15.18:0/2277668326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb308009e50 tx=0x7fb30801ca30 comp rx=0 tx=0).stop 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 -- 172.21.15.18:0/2277668326 shutdown_connections 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 --2- 172.21.15.18:0/2277668326 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb31015bd80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 --2- 172.21.15.18:0/2277668326 >> v2:172.21.15.167:3300/0 conn(0x7fb31015fe50 0x7fb3100b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.175+0000 7fb318600640 1 -- 172.21.15.18:0/2277668326 >> 172.21.15.18:0/2277668326 conn(0x7fb310066fa0 msgr2=0x7fb31006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- 172.21.15.18:0/2277668326 shutdown_connections 2024-04-25T10:14:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- 172.21.15.18:0/2277668326 wait complete. 2024-04-25T10:14:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 Processor -- start 2024-04-25T10:14:50.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- start start 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb310165910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310145270 0x7fb31015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100cdbe0 con 0x7fb31015fe50 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31015f930 con 0x7fb310145270 2024-04-25T10:14:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb318600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100cdd60 con 0x7fb3100b1c90 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37342/0 (socket says 172.21.15.18:37342) 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 -- 172.21.15.18:0/19313262 learned_addr learned my addr 172.21.15.18:0/19313262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb315200640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310145270 0x7fb31015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb315c00640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb310165910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 -- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 msgr2=0x7fb310165910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb310165910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 -- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310145270 msgr2=0x7fb31015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310145270 0x7fb31015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 -- 172.21.15.18:0/19313262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31015b7d0 con 0x7fb31015fe50 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb316600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb3080af040 tx=0x7fb3080197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb308009510 con 0x7fb31015fe50 2024-04-25T10:14:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3080be070 con 0x7fb31015fe50 2024-04-25T10:14:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.179+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3080b88b0 con 0x7fb31015fe50 2024-04-25T10:14:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb310140c40 con 0x7fb31015fe50 2024-04-25T10:14:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3100b0340 con 0x7fb31015fe50 2024-04-25T10:14:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3100745d0 con 0x7fb31015fe50 2024-04-25T10:14:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb3080b8a50 con 0x7fb31015fe50 2024-04-25T10:14:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb30d600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 0x7fb2f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb3081203f0 con 0x7fb31015fe50 2024-04-25T10:14:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.183+0000 7fb315c00640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 0x7fb2f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.187+0000 7fb315c00640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 0x7fb2f0069420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb304001650 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:50.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.187+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb308016620 con 0x7fb31015fe50 2024-04-25T10:14:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.383+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb31006b8e0 con 0x7fb31015fe50 2024-04-25T10:14:50.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.383+0000 7fb30d600640 1 -- 172.21.15.18:0/19313262 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4949 (secure 0 0 0) 0x7fb3080f1240 con 0x7fb31015fe50 2024-04-25T10:14:50.394 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:50.394 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":111,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:50.006209+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:replay","state_seq":1,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:50.394 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 111 2024-04-25T10:14:50.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 msgr2=0x7fb2f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 0x7fb2f0069420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb304001650 tx=0x7fb304009040 comp rx=0 tx=0).stop 2024-04-25T10:14:50.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 msgr2=0x7fb3101f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb3080af040 tx=0x7fb3080197d0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 shutdown_connections 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb31015fe50 0x7fb3101f6cb0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310145270 0x7fb31015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb2f0066f60 0x7fb2f0069420 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 --2- 172.21.15.18:0/19313262 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb3100b1c90 0x7fb310165910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 >> 172.21.15.18:0/19313262 conn(0x7fb310066fa0 msgr2=0x7fb31013f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 shutdown_connections 2024-04-25T10:14:50.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:50.387+0000 7fb318600640 1 -- 172.21.15.18:0/19313262 wait complete. 2024-04-25T10:14:50.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:50.006209+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 125, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37334': {'gid': 37334, 'name': 'b', 'rank': 0, 'incarnation': 111, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.167:6836/616056842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 616056842}, {'type': 'v1', 'addr': '172.21.15.167:6836', 'nonce': 616056842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:50.819 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37334:up:replay 2024-04-25T10:14:51.757 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:14:51.761 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:14:51.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:52.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.003+0000 7fcf40600640 1 Processor -- start 2024-04-25T10:14:52.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.003+0000 7fcf40600640 1 -- start start 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf40600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fcf380b1e60 0x7fcf3815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf40600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf380cc4e0 con 0x7fcf38145270 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf40600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf380ce040 con 0x7fcf3815fe50 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf40600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf38145650 con 0x7fcf380b1e60 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3dc00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcf38145270 0x7fcf380cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44394/0 (socket says 172.21.15.18:44394) 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3dc00640 1 -- 172.21.15.18:0/382386728 learned_addr learned my addr 172.21.15.18:0/382386728 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:52.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3e600640 1 --2- 172.21.15.18:0/382386728 >> v2:172.21.15.167:3300/0 conn(0x7fcf380b1e60 0x7fcf3815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:52.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3e600640 1 -- 172.21.15.18:0/382386728 >> v1:172.21.15.167:6789/0 conn(0x7fcf3815fe50 legacy=0x7fcf380b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3e600640 1 -- 172.21.15.18:0/382386728 >> v1:172.21.15.18:6789/0 conn(0x7fcf38145270 legacy=0x7fcf380cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.007+0000 7fcf3e600640 1 -- 172.21.15.18:0/382386728 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380ce320 con 0x7fcf380b1e60 2024-04-25T10:14:52.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.011+0000 7fcf3e600640 1 --2- 172.21.15.18:0/382386728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf380b1e60 0x7fcf3815bd80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009d90 tx=0x7fcf3001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a440f5d73896cad2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf37e00640 1 -- 172.21.15.18:0/382386728 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300b2070 con 0x7fcf380b1e60 2024-04-25T10:14:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf37e00640 1 -- 172.21.15.18:0/382386728 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf300a5920 con 0x7fcf380b1e60 2024-04-25T10:14:52.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf37e00640 1 -- 172.21.15.18:0/382386728 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300a5cf0 con 0x7fcf380b1e60 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- 172.21.15.18:0/382386728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf380b1e60 msgr2=0x7fcf3815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 --2- 172.21.15.18:0/382386728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf380b1e60 0x7fcf3815bd80 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf30009d90 tx=0x7fcf3001c970 comp rx=0 tx=0).stop 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- 172.21.15.18:0/382386728 shutdown_connections 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 --2- 172.21.15.18:0/382386728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf380b1e60 0x7fcf3815bd80 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- 172.21.15.18:0/382386728 >> 172.21.15.18:0/382386728 conn(0x7fcf38066fa0 msgr2=0x7fcf3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- 172.21.15.18:0/382386728 shutdown_connections 2024-04-25T10:14:52.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- 172.21.15.18:0/382386728 wait complete. 2024-04-25T10:14:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 Processor -- start 2024-04-25T10:14:52.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.015+0000 7fcf40600640 1 -- start start 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf380b1e60 0x7fcf3813d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf38145270 0x7fcf380acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380cdd60 con 0x7fcf3815fe50 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf380cdbe0 con 0x7fcf38145270 2024-04-25T10:14:52.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf38169720 con 0x7fcf380b1e60 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47920/0 (socket says 172.21.15.18:47920) 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 -- 172.21.15.18:0/552958395 learned_addr learned my addr 172.21.15.18:0/552958395 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3dc00640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf380b1e60 0x7fcf3813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3d200640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf38145270 0x7fcf380acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 -- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf380b1e60 msgr2=0x7fcf3813d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf380b1e60 0x7fcf3813d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 -- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf38145270 msgr2=0x7fcf380acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf38145270 0x7fcf380acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 -- 172.21.15.18:0/552958395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf380ae3f0 con 0x7fcf3815fe50 2024-04-25T10:14:52.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf3e600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fcf3001a5a0 tx=0x7fcf30019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:52.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300b2050 con 0x7fcf3815fe50 2024-04-25T10:14:52.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf300be070 con 0x7fcf3815fe50 2024-04-25T10:14:52.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300adad0 con 0x7fcf3815fe50 2024-04-25T10:14:52.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf380ad080 con 0x7fcf3815fe50 2024-04-25T10:14:52.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf380ad630 con 0x7fcf3815fe50 2024-04-25T10:14:52.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf380745d0 con 0x7fcf3815fe50 2024-04-25T10:14:52.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.019+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf300adc70 con 0x7fcf3815fe50 2024-04-25T10:14:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.023+0000 7fcf35600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 0x7fcf18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.023+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcf30120580 con 0x7fcf3815fe50 2024-04-25T10:14:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.023+0000 7fcf3dc00640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 0x7fcf18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:52.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.023+0000 7fcf3dc00640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 0x7fcf18069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005890 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:52.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.027+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf30016560 con 0x7fcf3815fe50 2024-04-25T10:14:52.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf380b19a0 con 0x7fcf3815fe50 2024-04-25T10:14:52.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf35600640 1 -- 172.21.15.18:0/552958395 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 113 v113) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fcf300f12c0 con 0x7fcf3815fe50 2024-04-25T10:14:52.227 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:52.227 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":113,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":113,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:51.012770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:rejoin","state_seq":12,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:52.227 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 113 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 msgr2=0x7fcf18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 0x7fcf18069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c005890 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 msgr2=0x7fcf3813ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fcf3001a5a0 tx=0x7fcf30019710 comp rx=0 tx=0).stop 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 shutdown_connections 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf3815fe50 0x7fcf3813ca50 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf38145270 0x7fcf380acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcf18066f60 0x7fcf18069420 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 --2- 172.21.15.18:0/552958395 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcf380b1e60 0x7fcf3813d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:52.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 >> 172.21.15.18:0/552958395 conn(0x7fcf38066fa0 msgr2=0x7fcf3813dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:52.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 shutdown_connections 2024-04-25T10:14:52.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:52.219+0000 7fcf40600640 1 -- 172.21.15.18:0/552958395 wait complete. 2024-04-25T10:14:52.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 113, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:51.012770+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 125, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37334': {'gid': 37334, 'name': 'b', 'rank': 0, 'incarnation': 111, 'state': 'up:rejoin', 'state_seq': 12, 'addr': '172.21.15.167:6836/616056842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 616056842}, {'type': 'v1', 'addr': '172.21.15.167:6836', 'nonce': 616056842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:52.652 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_37334:up:rejoin 2024-04-25T10:14:53.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:53.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 Processor -- start 2024-04-25T10:14:53.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 -- start start 2024-04-25T10:14:53.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d1c0b22d0 0x7f4d1c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4d1c06edc0 0x7f4d1c0acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c06d6f0 con 0x7f4d1c071690 2024-04-25T10:14:53.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c06d9d0 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d21e00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c06dcb0 con 0x7f4d1c06edc0 2024-04-25T10:14:53.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1a000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4d1c0b22d0 0x7f4d1c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1aa00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4d1c071690 0x7f4d1c071a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44406/0 (socket says 172.21.15.18:44406) 2024-04-25T10:14:53.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1aa00640 1 -- 172.21.15.18:0/3642065623 learned_addr learned my addr 172.21.15.18:0/3642065623 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1b400640 1 --2- 172.21.15.18:0/3642065623 >> v2:172.21.15.167:3300/0 conn(0x7f4d1c06edc0 0x7f4d1c0acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1a000640 1 -- 172.21.15.18:0/3642065623 >> v2:172.21.15.167:3300/0 conn(0x7f4d1c06edc0 msgr2=0x7f4d1c0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1a000640 1 --2- 172.21.15.18:0/3642065623 >> v2:172.21.15.167:3300/0 conn(0x7f4d1c06edc0 0x7f4d1c0acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1a000640 1 -- 172.21.15.18:0/3642065623 >> v1:172.21.15.18:6789/0 conn(0x7f4d1c071690 legacy=0x7f4d1c071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d1a000640 1 -- 172.21.15.18:0/3642065623 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c06df90 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.803+0000 7f4d19600640 1 -- 172.21.15.18:0/3642065623 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2354703071 0 0) 0x7f4d1c06d6f0 con 0x7f4d1c071690 2024-04-25T10:14:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- 172.21.15.18:0/3642065623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c0b22d0 0x7f4d1c06e790 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b1740 tx=0x7f4d0801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767bd91c1fe7d7df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d19600640 1 -- 172.21.15.18:0/3642065623 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080a7070 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d19600640 1 -- 172.21.15.18:0/3642065623 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080b0070 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d19600640 1 -- 172.21.15.18:0/3642065623 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080ab890 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/3642065623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c0b22d0 msgr2=0x7f4d1c06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- 172.21.15.18:0/3642065623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c0b22d0 0x7f4d1c06e790 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0b1740 tx=0x7f4d0801c450 comp rx=0 tx=0).stop 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/3642065623 shutdown_connections 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- 172.21.15.18:0/3642065623 >> v2:172.21.15.167:3300/0 conn(0x7f4d1c06edc0 0x7f4d1c0acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- 172.21.15.18:0/3642065623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c0b22d0 0x7f4d1c06e790 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/3642065623 >> 172.21.15.18:0/3642065623 conn(0x7f4d1c0b17b0 msgr2=0x7f4d1c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/3642065623 shutdown_connections 2024-04-25T10:14:53.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/3642065623 wait complete. 2024-04-25T10:14:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 Processor -- start 2024-04-25T10:14:53.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- start start 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1c06edc0 0x7f4d1c15eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d1c0b22d0 0x7f4d1c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c16a970 con 0x7f4d1c071690 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c16a7f0 con 0x7f4d1c06edc0 2024-04-25T10:14:53.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c16aaf0 con 0x7f4d1c0b22d0 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47936/0 (socket says 172.21.15.18:47936) 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 -- 172.21.15.18:0/452498157 learned_addr learned my addr 172.21.15.18:0/452498157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1aa00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1c06edc0 0x7f4d1c15eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1b400640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d1c0b22d0 0x7f4d1c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 -- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d1c0b22d0 msgr2=0x7f4d1c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d1c0b22d0 0x7f4d1c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 -- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1c06edc0 msgr2=0x7f4d1c15eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1c06edc0 0x7f4d1c15eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:53.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 -- 172.21.15.18:0/452498157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c15efe0 con 0x7f4d1c071690 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d1a000640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f4d0801ab00 tx=0x7f4d080191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08004220 con 0x7f4d1c071690 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d080043c0 con 0x7f4d1c071690 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d080ab9b0 con 0x7f4d1c071690 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c15fa00 con 0x7f4d1c071690 2024-04-25T10:14:53.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c15ffc0 con 0x7f4d1c071690 2024-04-25T10:14:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.807+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c0745d0 con 0x7f4d1c071690 2024-04-25T10:14:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.811+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d080abb50 con 0x7f4d1c071690 2024-04-25T10:14:53.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.811+0000 7f4d13400640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 0x7f4cfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.811+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4d0811f140 con 0x7f4d1c071690 2024-04-25T10:14:53.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.811+0000 7f4d1aa00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 0x7f4cfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:53.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.811+0000 7f4d1aa00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 0x7f4cfc069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c007fd0 tx=0x7f4d0c007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:53.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:53.819+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d080c4060 con 0x7f4d1c071690 2024-04-25T10:14:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.007+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d1c1f7590 con 0x7f4d1c071690 2024-04-25T10:14:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d13400640 1 -- 172.21.15.18:0/452498157 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f4d080b9070 con 0x7f4d1c071690 2024-04-25T10:14:54.018 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:54.018 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:52.020568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":13,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 114 2024-04-25T10:14:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 msgr2=0x7f4cfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 0x7f4cfc069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c007fd0 tx=0x7f4d0c007d60 comp rx=0 tx=0).stop 2024-04-25T10:14:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 msgr2=0x7f4d1c152fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f4d0801ab00 tx=0x7f4d080191f0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 shutdown_connections 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4cfc066f60 0x7f4cfc069420 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4d1c0b22d0 0x7f4d1c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d1c071690 0x7f4d1c152fe0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 --2- 172.21.15.18:0/452498157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d1c06edc0 0x7f4d1c15eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 >> 172.21.15.18:0/452498157 conn(0x7f4d1c0b17b0 msgr2=0x7f4d1c0b0130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 shutdown_connections 2024-04-25T10:14:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.011+0000 7f4d21e00640 1 -- 172.21.15.18:0/452498157 wait complete. 2024-04-25T10:14:54.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 114, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T10:14:17.787730+0000', 'modified': '2024-04-25T10:14:52.020568+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 125, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 37334}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_37334': {'gid': 37334, 'name': 'b', 'rank': 0, 'incarnation': 111, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.167:6836/616056842', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 616056842}, {'type': 'v1', 'addr': '172.21.15.167:6836', 'nonce': 616056842}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T10:14:54.443 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T10:14:54.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T10:14:54.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 Processor -- start 2024-04-25T10:14:54.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 -- start start 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a415bc40 con 0x7fb2a415ee60 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a415b3a0 con 0x7fb2a4144120 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2aaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a415e490 con 0x7fb2a415acd0 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2a8a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb2a415ee60 0x7fb2a40b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44410/0 (socket says 172.21.15.18:44410) 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2a8a00640 1 -- 172.21.15.18:0/3773982918 learned_addr learned my addr 172.21.15.18:0/3773982918 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb29be00640 1 --2- 172.21.15.18:0/3773982918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419265235 0 0) 0x7fb2a415bc40 con 0x7fb2a415ee60 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb288005740 con 0x7fb2a415ee60 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968460161 0 0) 0x7fb2a415b3a0 con 0x7fb2a4144120 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb29be00640 1 -- 172.21.15.18:0/3773982918 >> v1:172.21.15.167:6789/0 conn(0x7fb2a4144120 legacy=0x7fb2a40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb29be00640 1 -- 172.21.15.18:0/3773982918 >> v1:172.21.15.18:6789/0 conn(0x7fb2a415ee60 legacy=0x7fb2a40b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.583+0000 7fb29be00640 1 -- 172.21.15.18:0/3773982918 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a415b680 con 0x7fb2a415acd0 2024-04-25T10:14:54.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb29be00640 1 --2- 172.21.15.18:0/3773982918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a415e920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db95843efc0bcfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0b0070 con 0x7fb2a415acd0 2024-04-25T10:14:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c0ab600 con 0x7fb2a415acd0 2024-04-25T10:14:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2a3400640 1 -- 172.21.15.18:0/3773982918 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0ab9d0 con 0x7fb2a415acd0 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- 172.21.15.18:0/3773982918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 msgr2=0x7fb2a415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/3773982918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a415e920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c01c450 comp rx=0 tx=0).stop 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- 172.21.15.18:0/3773982918 shutdown_connections 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/3773982918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a415e920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- 172.21.15.18:0/3773982918 >> 172.21.15.18:0/3773982918 conn(0x7fb2a4067080 msgr2=0x7fb2a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- 172.21.15.18:0/3773982918 shutdown_connections 2024-04-25T10:14:54.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- 172.21.15.18:0/3773982918 wait complete. 2024-04-25T10:14:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 Processor -- start 2024-04-25T10:14:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.587+0000 7fb2aaa00640 1 -- start start 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a4144120 0x7fb2a40b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a4164d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406deb0 con 0x7fb2a415ee60 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406dd30 con 0x7fb2a4144120 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406e030 con 0x7fb2a415acd0 2024-04-25T10:14:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47946/0 (socket says 172.21.15.18:47946) 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1147199729 learned_addr learned my addr 172.21.15.18:0/1147199729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb29be00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a4164d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a4144120 0x7fb2a40b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 msgr2=0x7fb2a4164d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a4164d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a4144120 msgr2=0x7fb2a40b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a4144120 0x7fb2a40b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1147199729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a40b4790 con 0x7fb2a415ee60 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb29be00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a4164d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00cad0 tx=0x7fb29c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a0c00640 1 -- 172.21.15.18:0/1147199729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c017070 con 0x7fb2a415ee60 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a0c00640 1 -- 172.21.15.18:0/1147199729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c00ac30 con 0x7fb2a415ee60 2024-04-25T10:14:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a413ba90 con 0x7fb2a415ee60 2024-04-25T10:14:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2a0c00640 1 -- 172.21.15.18:0/1147199729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c012400 con 0x7fb2a415ee60 2024-04-25T10:14:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.591+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a413c050 con 0x7fb2a415ee60 2024-04-25T10:14:54.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a0c00640 1 -- 172.21.15.18:0/1147199729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb29c01a070 con 0x7fb2a415ee60 2024-04-25T10:14:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a0c00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 0x7fb280069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a0c00640 1 -- 172.21.15.18:0/1147199729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb29c085110 con 0x7fb2a415ee60 2024-04-25T10:14:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 Processor -- start 2024-04-25T10:14:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 0x7fb280069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 -- start start 2024-04-25T10:14:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 0x7fb280069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb294000f70 tx=0x7fb294009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3160920 0x5609f3160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31169f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2ffe5f0 con 0x5609f3116f30 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2f65da0 con 0x5609f3161240 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f2eee150 con 0x5609f3160920 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47954/0 (socket says 172.21.15.18:47954) 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1769459730 learned_addr learned my addr 172.21.15.18:0/1769459730 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3160920 0x5609f3160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb29be00640 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31169f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3160920 msgr2=0x5609f3160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3160920 0x5609f3160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 msgr2=0x5609f31169f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31169f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 -- 172.21.15.18:0/1769459730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f2f07ca0 con 0x5609f3116f30 2024-04-25T10:14:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.595+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fb29c055650 tx=0x7fb29c055780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22df069534d6cd23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb298c00640 1 -- 172.21.15.18:0/1769459730 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0539c0 con 0x5609f3116f30 2024-04-25T10:14:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb298c00640 1 -- 172.21.15.18:0/1769459730 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c051d30 con 0x5609f3116f30 2024-04-25T10:14:54.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb298c00640 1 -- 172.21.15.18:0/1769459730 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c05db40 con 0x5609f3116f30 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- 172.21.15.18:0/1769459730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 msgr2=0x5609f3117310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fb29c055650 tx=0x7fb29c055780 comp rx=0 tx=0).stop 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- 172.21.15.18:0/1769459730 shutdown_connections 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3117310 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31169f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- 172.21.15.18:0/1769459730 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3160920 0x5609f3160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- 172.21.15.18:0/1769459730 >> 172.21.15.18:0/1769459730 conn(0x5609f311d2a0 msgr2=0x5609f31152d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- 172.21.15.18:0/1769459730 shutdown_connections 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- 172.21.15.18:0/1769459730 wait complete. 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- start start 2024-04-25T10:14:54.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 Processor -- start 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3160920 0x5609f3168380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f311aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2f20990 con 0x5609f3116f30 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2f61e40 con 0x5609f3160920 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f2ef1900 con 0x5609f3161240 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2ade29000 10 client.0 _ll_register_callbacks cb 0x5609f30191c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47960/0 (socket says 172.21.15.18:47960) 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 -- 172.21.15.18:0/2585018918 learned_addr learned my addr 172.21.15.18:0/2585018918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb29be00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3160920 0x5609f3168380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f311aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 -- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 msgr2=0x5609f311aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f311aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 -- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3160920 msgr2=0x5609f3168380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3160920 0x5609f3168380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 -- 172.21.15.18:0/2585018918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f2f1e630 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb29400e830 tx=0x7fb29400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddf02ef00f9f609 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.599+0000 7fb291600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294028060 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb294010040 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb29c051d30 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb294003b80 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 10 client.9558 fetch_fsmap learned FSMap version 114 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x5609f2eee3a0 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c051d30 con 0x5609f3116f30 2024-04-25T10:14:54.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 114) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb294013420 con 0x5609f3116f30 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 10 client.9558 fetch_fsmap finished waiting for FSMap version 114 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 10 client.9558 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 20 client.9558 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f311c160 0x5609f3171ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 4 client.9558 mds_command: new command op to 37334 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 --> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609f2f01a50 con 0x5609f311c160 2024-04-25T10:14:54.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb29be00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f311c160 0x5609f3171ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb29be00640 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f311c160 0x5609f3171ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=542fd86f5196fbaf server_cookie=13d36199660c18dc in_seq=0 out_seq=0 2024-04-25T10:14:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 10 client.9558 ms_handle_connect on v2:172.21.15.167:6834/616056842 2024-04-25T10:14:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 1 -- 172.21.15.18:0/2585018918 <== mds.0 v2:172.21.15.167:6834/616056842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5609f2f01a50 con 0x5609f311c160 2024-04-25T10:14:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 10 client.9558 handle_command_reply: tid=0 2024-04-25T10:14:54.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 client.9558 shutdown 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 msgr2=0x5609f3167e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fb29400e830 tx=0x7fb29400ec30 comp rx=0 tx=0).stop 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 shutdown_connections 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f311c160 0x5609f3171ea0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f311aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb291600640 0 client.9558 ms_handle_reset on v2:172.21.15.167:6834/616056842 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3160920 0x5609f3168380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2585018918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3116f30 0x5609f3167e40 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 >> 172.21.15.18:0/2585018918 conn(0x5609f311d2a0 msgr2=0x5609f31159e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 shutdown_connections 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 1 -- 172.21.15.18:0/2585018918 wait complete. 2024-04-25T10:14:54.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.603+0000 7fb2ade29000 20 client.9558 trim_cache size 0 max 16384 2024-04-25T10:14:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 Processor -- start 2024-04-25T10:14:54.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- start start 2024-04-25T10:14:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 0x5609f315f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f3172eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41fddf0 con 0x5609f3160920 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a415d5a0 con 0x5609f3116f30 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a41fd890 con 0x5609f3161240 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47974/0 (socket says 172.21.15.18:47974) 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 -- 172.21.15.18:0/2153395870 learned_addr learned my addr 172.21.15.18:0/2153395870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f3172eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 0x5609f315f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 -- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 msgr2=0x5609f3172eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f3172eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 -- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 msgr2=0x5609f315f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 0x5609f315f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 -- 172.21.15.18:0/2153395870 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609f3161070 con 0x5609f3160920 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f3172eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 0x5609f315f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb29be00640 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bac3b7a823b3bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb293e00640 1 -- 172.21.15.18:0/2153395870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0b0040 con 0x5609f3160920 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb293e00640 1 -- 172.21.15.18:0/2153395870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c004020 con 0x5609f3160920 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb293e00640 1 -- 172.21.15.18:0/2153395870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0043d0 con 0x5609f3160920 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- 172.21.15.18:0/2153395870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 msgr2=0x5609f315fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c0a6000 comp rx=0 tx=0).stop 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- 172.21.15.18:0/2153395870 shutdown_connections 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3161240 0x5609f3172eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f315fcf0 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 --2- 172.21.15.18:0/2153395870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3116f30 0x5609f315f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- 172.21.15.18:0/2153395870 >> 172.21.15.18:0/2153395870 conn(0x5609f311d2a0 msgr2=0x5609f315f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- 172.21.15.18:0/2153395870 shutdown_connections 2024-04-25T10:14:54.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- 172.21.15.18:0/2153395870 wait complete. 2024-04-25T10:14:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 -- start start 2024-04-25T10:14:54.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.623+0000 7fb2ade29000 1 Processor -- start 2024-04-25T10:14:54.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 0x5609f3176110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31ac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f2f6a3d0 con 0x5609f3160920 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609f3021d50 con 0x5609f3161240 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x5609f2f00980 con 0x5609f3116f30 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 10 client.0 _ll_register_callbacks cb 0x7fb29c055490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47988/0 (socket says 172.21.15.18:47988) 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 -- 172.21.15.18:0/3931449980 learned_addr learned my addr 172.21.15.18:0/3931449980 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 0x5609f3176110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 -- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 msgr2=0x5609f3176110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 0x5609f3176110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 -- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 msgr2=0x5609f31ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 -- 172.21.15.18:0/3931449980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609f2fe7600 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 0x5609f3176110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a8a00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb29be00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c0ee3b39b0ba6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28c0b0070 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb28c004020 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb28c0bf570 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb28c0bf770 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 10 client.9564 fetch_fsmap learned FSMap version 114 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=2+}) v3 -- 0x5609f2efa9b0 con 0x5609f3160920 2024-04-25T10:14:54.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28c004020 con 0x5609f3160920 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 114) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb28c003620 con 0x5609f3160920 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 10 client.9564 fetch_fsmap finished waiting for FSMap version 114 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 10 client.9564 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 20 client.9564 populate_metadata read hostname 'smithi018' 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f31ac680 0x5609f317fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 4 client.9564 mds_command: new command op to 37334 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 --> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5609f2f732e0 con 0x5609f31ac680 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f31ac680 0x5609f317fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2a3e00640 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f31ac680 0x5609f317fd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13317b6d5e770b7e server_cookie=27d22fb7912d5db0 in_seq=0 out_seq=0 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 10 client.9564 ms_handle_connect on v2:172.21.15.167:6834/616056842 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 1 -- 172.21.15.18:0/3931449980 <== mds.0 v2:172.21.15.167:6834/616056842 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x5609f2f732e0 con 0x5609f31ac680 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 10 client.9564 handle_command_reply: tid=0 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 client.9564 shutdown 2024-04-25T10:14:54.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 msgr2=0x5609f3176650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0097f0 tx=0x7fb28c01ac90 comp rx=0 tx=0).stop 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 shutdown_connections 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:6834/616056842,v1:172.21.15.167:6836/616056842] conn(0x5609f31ac680 0x5609f317fd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5609f3161240 0x5609f31ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5609f3160920 0x5609f3176650 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 --2- 172.21.15.18:0/3931449980 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x5609f3116f30 0x5609f3176110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb291600640 0 client.9564 ms_handle_reset on v2:172.21.15.167:6834/616056842 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 >> 172.21.15.18:0/3931449980 conn(0x5609f311d2a0 msgr2=0x5609f315f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 shutdown_connections 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.627+0000 7fb2ade29000 1 -- 172.21.15.18:0/3931449980 wait complete. 2024-04-25T10:14:54.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2ade29000 20 client.9564 trim_cache size 0 max 16384 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "a742dcf2-a420-4fc2-9137-18bf23968324", 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 37334, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.6260929649999998, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 114, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 125, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 125, 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 41.160350868000002 2024-04-25T10:14:54.643 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:14:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 msgr2=0x7fb280069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 0x7fb280069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb294000f70 tx=0x7fb294009040 comp rx=0 tx=0).stop 2024-04-25T10:14:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 msgr2=0x7fb2a4156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00cad0 tx=0x7fb29c00cf90 comp rx=0 tx=0).stop 2024-04-25T10:14:54.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 shutdown_connections 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a415ee60 0x7fb2a4156a50 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb280066f60 0x7fb280069420 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb2a415acd0 0x7fb2a4164d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 --2- 172.21.15.18:0/1147199729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a4144120 0x7fb2a40b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 >> 172.21.15.18:0/1147199729 conn(0x7fb2a4067080 msgr2=0x7fb2a40cc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 shutdown_connections 2024-04-25T10:14:54.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.631+0000 7fb2aaa00640 1 -- 172.21.15.18:0/1147199729 wait complete. 2024-04-25T10:14:54.657 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T10:14:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 Processor -- start 2024-04-25T10:14:54.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 -- start start 2024-04-25T10:14:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f811809a600 0x7f81180cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180cf800 con 0x7f81180cf370 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81180cfae0 con 0x7f8118099a60 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f811d400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81180d0410 con 0x7f811809a600 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f810de00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f81180cf370 0x7f8118099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44422/0 (socket says 172.21.15.18:44422) 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f810de00640 1 -- 172.21.15.18:0/3874206024 learned_addr learned my addr 172.21.15.18:0/3874206024 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8117200640 1 --2- 172.21.15.18:0/3874206024 >> v2:172.21.15.18:3300/0 conn(0x7f811809a600 0x7f81180cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8115e00640 1 -- 172.21.15.18:0/3874206024 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2478362933 0 0) 0x7f81180cf800 con 0x7f81180cf370 2024-04-25T10:14:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8115e00640 1 -- 172.21.15.18:0/3874206024 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc003530 con 0x7f81180cf370 2024-04-25T10:14:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8117200640 1 -- 172.21.15.18:0/3874206024 >> v1:172.21.15.167:6789/0 conn(0x7f8118099a60 legacy=0x7f811815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8117200640 1 -- 172.21.15.18:0/3874206024 >> v1:172.21.15.18:6789/0 conn(0x7f81180cf370 legacy=0x7f8118099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.791+0000 7f8117200640 1 -- 172.21.15.18:0/3874206024 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180cfdc0 con 0x7f811809a600 2024-04-25T10:14:54.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f8117200640 1 --2- 172.21.15.18:0/3874206024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81180cd2c0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f81100097c0 tx=0x7f811001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9189ad4f86fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f8115e00640 1 -- 172.21.15.18:0/3874206024 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100ab600 con 0x7f811809a600 2024-04-25T10:14:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f8115e00640 1 -- 172.21.15.18:0/3874206024 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81100b0070 con 0x7f811809a600 2024-04-25T10:14:54.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f8115e00640 1 -- 172.21.15.18:0/3874206024 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100ab9a0 con 0x7f811809a600 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 -- 172.21.15.18:0/3874206024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 msgr2=0x7f81180cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 --2- 172.21.15.18:0/3874206024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81180cd2c0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f81100097c0 tx=0x7f811001c3e0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 -- 172.21.15.18:0/3874206024 shutdown_connections 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 --2- 172.21.15.18:0/3874206024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81180cd2c0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 -- 172.21.15.18:0/3874206024 >> 172.21.15.18:0/3874206024 conn(0x7f81180d17a0 msgr2=0x7f81180d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 -- 172.21.15.18:0/3874206024 shutdown_connections 2024-04-25T10:14:54.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.795+0000 7f811d400640 1 -- 172.21.15.18:0/3874206024 wait complete. 2024-04-25T10:14:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 Processor -- start 2024-04-25T10:14:54.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- start start 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8118099a60 0x7f8118153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81180b4800 0x7f8118156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118169800 con 0x7f811809a600 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8118169680 con 0x7f8118099a60 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8118169980 con 0x7f81180b4800 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48000/0 (socket says 172.21.15.18:48000) 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 -- 172.21.15.18:0/4229718275 learned_addr learned my addr 172.21.15.18:0/4229718275 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f8117200640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81180b4800 0x7f8118156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f8116800640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8118099a60 0x7f8118153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 -- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81180b4800 msgr2=0x7f8118156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81180b4800 0x7f8118156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 -- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8118099a60 msgr2=0x7f8118153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8118099a60 0x7f8118153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 -- 172.21.15.18:0/4229718275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81180cbba0 con 0x7f811809a600 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810de00640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f810000c4d0 tx=0x7f810000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100017070 con 0x7f811809a600 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100005cf0 con 0x7f811809a600 2024-04-25T10:14:54.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81180b4dc0 con 0x7f811809a600 2024-04-25T10:14:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100007270 con 0x7f811809a600 2024-04-25T10:14:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81180b5380 con 0x7f811809a600 2024-04-25T10:14:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81180745d0 con 0x7f811809a600 2024-04-25T10:14:54.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f810001a070 con 0x7f811809a600 2024-04-25T10:14:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 0x7f80f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f81000845c0 con 0x7f811809a600 2024-04-25T10:14:54.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f8116800640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 0x7f80f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:54.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.803+0000 7f8116800640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 0x7f80f4069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f81180c7cd0 tx=0x7f8108009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:54.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:54.807+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8100054ca0 con 0x7f811809a600 2024-04-25T10:14:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.007+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81180d2620 con 0x7f811809a600 2024-04-25T10:14:55.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.007+0000 7f810f400640 1 -- 172.21.15.18:0/4229718275 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v114) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8100058d40 con 0x7f811809a600 2024-04-25T10:14:55.016 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T10:14:55.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 msgr2=0x7f80f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:55.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 0x7f80f4069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f81180c7cd0 tx=0x7f8108009040 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 msgr2=0x7f81181509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f810000c4d0 tx=0x7f810000c990 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 shutdown_connections 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f80f4066f60 0x7f80f4069420 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f81180b4800 0x7f8118156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f811809a600 0x7f81181509f0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 --2- 172.21.15.18:0/4229718275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8118099a60 0x7f8118153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 >> 172.21.15.18:0/4229718275 conn(0x7f81180d17a0 msgr2=0x7f8118070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 shutdown_connections 2024-04-25T10:14:55.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55.015+0000 7f811d400640 1 -- 172.21.15.18:0/4229718275 wait complete. 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:55.038 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T10:14:55.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T10:14:55.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T10:14:55.039 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:55.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.039 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-04-25T10:14:55.048 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T10:14:55.048 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 41810sec preferred_lft 41810sec 2024-04-25T10:14:55.049 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout:4: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:42:62:38:bd:1b brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T10:14:55.050 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T10:14:55.051 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-04-25T10:14:55.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.052 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T10:14:55.115 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:55.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.117 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-04-25T10:14:55.174 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-04-25T10:14:55.174 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T10:14:55.174 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T10:14:55.174 INFO:teuthology.orchestra.run.smithi018.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T10:14:55.175 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T10:14:55.175 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T10:14:55.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec bash -c ' 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T10:14:55.175 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-04-25T10:14:55.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.271 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:14:55.280 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:14:55.280 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:14:55.280 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:55.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-04-25T10:14:55.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:55.340 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:55.389 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T10:14:55.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T10:14:55.389 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:55.440 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T10:14:55.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.441 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:55.529 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:55.529 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:55.543 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T10:14:55.543 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T10:14:55.543 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.167:3300,172.21.15.167:3301" 2024-04-25T10:14:55.543 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with new device syntax: 0@a742dcf2-a420-4fc2-9137-18bf23968324.cephfs=/ 2024-04-25T10:14:55.543 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.18:3300/172.21.15.167:3300/172.21.15.167:3301" will pass to kernel 2024-04-25T10:14:55.547 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T10:14:55.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.548 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:55.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.567 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T10:14:55.624 INFO:teuthology.orchestra.run.smithi018.stdout:client9576 2024-04-25T10:14:55.625 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:55.625 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:55.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:55.677 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T10:14:55.737 INFO:teuthology.orchestra.run.smithi018.stdout:./ 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/charlie 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/alpha 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/flushed/bravo 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/unflushed 2024-04-25T10:14:55.738 INFO:teuthology.orchestra.run.smithi018.stdout:./parent/unflushed/jfile 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T10:14:55.739 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:55.847 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-04-25T10:14:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T10:14:55.856 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:55.963 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627776 2024-04-25T10:14:55.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T10:14:55.972 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.078 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627777 2024-04-25T10:14:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.087 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:56.088 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:56.088 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:56.088 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:56.088 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T10:14:56.088 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.194 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627780 2024-04-25T10:14:56.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T10:14:56.204 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.314 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627778 2024-04-25T10:14:56.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.323 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:56.324 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:56.324 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:56.324 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:56.324 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T10:14:56.324 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.431 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627779 2024-04-25T10:14:56.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.440 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:56.441 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:56.441 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:56.441 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:56.441 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T10:14:56.441 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.550 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627781 2024-04-25T10:14:56.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> import stat 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T10:14:56.560 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-04-25T10:14:56.672 INFO:teuthology.orchestra.run.smithi018.stdout:1099511627782 2024-04-25T10:14:56.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T10:14:56.682 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T10:14:56.682 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:56.804 DEBUG:teuthology.orchestra.run.smithi167:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T10:14:56.863 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T10:14:56.864 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:56.864 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:56.873 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:56.873 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:56.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:57.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 Processor -- start 2024-04-25T10:14:57.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 -- start start 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d415e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8d40669a0 0x7fb8d40b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d4072ce0 con 0x7fb8d40b4520 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d40b3990 con 0x7fb8d40669a0 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8da600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40b2dc0 con 0x7fb8d415d7b0 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8d40669a0 0x7fb8d40b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb8d40669a0 0x7fb8d40b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48012/0 (socket says 172.21.15.18:48012) 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 -- 172.21.15.18:0/2449103869 learned_addr learned my addr 172.21.15.18:0/2449103869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:57.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d9200640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 -- 172.21.15.18:0/2449103869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 msgr2=0x7fb8d415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:57.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d415e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 -- 172.21.15.18:0/2449103869 >> v1:172.21.15.167:6789/0 conn(0x7fb8d40b4520 legacy=0x7fb8d4161400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.111+0000 7fb8d3e00640 1 -- 172.21.15.18:0/2449103869 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d40b3060 con 0x7fb8d40669a0 2024-04-25T10:14:57.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d40b3fe0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009870 tx=0x7fb8c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb97cb84e7082dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8d3400640 1 -- 172.21.15.18:0/2449103869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00b2070 con 0x7fb8d40669a0 2024-04-25T10:14:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8d3400640 1 -- 172.21.15.18:0/2449103869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c00a9070 con 0x7fb8d40669a0 2024-04-25T10:14:57.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8d3400640 1 -- 172.21.15.18:0/2449103869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c00ad880 con 0x7fb8d40669a0 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 -- 172.21.15.18:0/2449103869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 msgr2=0x7fb8d40b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d40b3fe0 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0009870 tx=0x7fb8c001c560 comp rx=0 tx=0).stop 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 -- 172.21.15.18:0/2449103869 shutdown_connections 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d40b3fe0 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 --2- 172.21.15.18:0/2449103869 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 -- 172.21.15.18:0/2449103869 >> 172.21.15.18:0/2449103869 conn(0x7fb8d40726f0 msgr2=0x7fb8d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 -- 172.21.15.18:0/2449103869 shutdown_connections 2024-04-25T10:14:57.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 -- 172.21.15.18:0/2449103869 wait complete. 2024-04-25T10:14:57.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.115+0000 7fb8da600640 1 Processor -- start 2024-04-25T10:14:57.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- start start 2024-04-25T10:14:57.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 0x7fb8d4160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d4158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d416a710 con 0x7fb8d40669a0 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d416a590 con 0x7fb8d40b4520 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d416a890 con 0x7fb8d415d7b0 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48018/0 (socket says 172.21.15.18:48018) 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 -- 172.21.15.18:0/3630895822 learned_addr learned my addr 172.21.15.18:0/3630895822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 0x7fb8d4160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9c00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d4158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 -- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 msgr2=0x7fb8d4158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d4158570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 -- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 msgr2=0x7fb8d4160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 0x7fb8d4160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 -- 172.21.15.18:0/3630895822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d415f330 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 0x7fb8d4160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d9200640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800e8a0 tx=0x7fb8c800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8017070 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c800c940 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c800ccf0 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d415f610 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d415fbd0 con 0x7fb8d40669a0 2024-04-25T10:14:57.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.119+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d404efa0 con 0x7fb8d40669a0 2024-04-25T10:14:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.123+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb8c801a070 con 0x7fb8d40669a0 2024-04-25T10:14:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.123+0000 7fb8d0c00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 0x7fb8b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.123+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb8c8085210 con 0x7fb8d40669a0 2024-04-25T10:14:57.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.123+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 0x7fb8b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.123+0000 7fb8d3e00640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 0x7fb8b4069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00af000 tx=0x7fb8c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.127+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb8c8055f40 con 0x7fb8d40669a0 2024-04-25T10:14:57.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.291+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8d41618f0 con 0x7fb8d40669a0 2024-04-25T10:14:57.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.291+0000 7fb8d0c00640 1 -- 172.21.15.18:0/3630895822 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17191 (secure 0 0 0) 0x7fb8c8055840 con 0x7fb8d40669a0 2024-04-25T10:14:57.296 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:57.296 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":125,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:47.926624+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6835/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:57.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 msgr2=0x7fb8b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 0x7fb8b4069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00af000 tx=0x7fb8c0008040 comp rx=0 tx=0).stop 2024-04-25T10:14:57.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 msgr2=0x7fb8d414aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800e8a0 tx=0x7fb8c800eca0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 shutdown_connections 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb8b4066f60 0x7fb8b4069420 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb8d415d7b0 0x7fb8d4158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb8d40b4520 0x7fb8d4160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 --2- 172.21.15.18:0/3630895822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8d40669a0 0x7fb8d414aef0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 >> 172.21.15.18:0/3630895822 conn(0x7fb8d40726f0 msgr2=0x7fb8d40afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 shutdown_connections 2024-04-25T10:14:57.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.295+0000 7fb8da600640 1 -- 172.21.15.18:0/3630895822 wait complete. 2024-04-25T10:14:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:14:16.207800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:14:16.774891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:57.318 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:57.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 Processor -- start 2024-04-25T10:14:57.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 -- start start 2024-04-25T10:14:57.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd774159320 0x7fd77415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77415fc00 con 0x7fd77406e4a0 2024-04-25T10:14:57.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd77415fee0 con 0x7fd77415f440 2024-04-25T10:14:57.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.459+0000 7fd77a600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd77406d640 con 0x7fd774159320 2024-04-25T10:14:57.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd77406e4a0 0x7fd774071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44426/0 (socket says 172.21.15.18:44426) 2024-04-25T10:14:57.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773e00640 1 -- 172.21.15.18:0/2231278186 learned_addr learned my addr 172.21.15.18:0/2231278186 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:57.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773400640 1 --2- 172.21.15.18:0/2231278186 >> v2:172.21.15.167:3300/0 conn(0x7fd774159320 0x7fd77415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2985504781 0 0) 0x7fd77415fc00 con 0x7fd77406e4a0 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd758003530 con 0x7fd77406e4a0 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377084388 0 0) 0x7fd77415fee0 con 0x7fd77415f440 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd77415fc00 con 0x7fd77415f440 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773400640 1 -- 172.21.15.18:0/2231278186 >> v1:172.21.15.167:6789/0 conn(0x7fd77415f440 legacy=0x7fd77406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773400640 1 -- 172.21.15.18:0/2231278186 >> v1:172.21.15.18:6789/0 conn(0x7fd77406e4a0 legacy=0x7fd774071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773400640 1 -- 172.21.15.18:0/2231278186 --> v2:172.21.15.167:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7741601c0 con 0x7fd774159320 2024-04-25T10:14:57.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.463+0000 7fd773400640 1 --2- 172.21.15.18:0/2231278186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd774159320 0x7fd77415c9b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd77406d7c0 tx=0x7fd76401c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3421f20a70ac0f4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640b2070 con 0x7fd774159320 2024-04-25T10:14:57.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7640ad680 con 0x7fd774159320 2024-04-25T10:14:57.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772000640 1 -- 172.21.15.18:0/2231278186 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7640ada30 con 0x7fd774159320 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- 172.21.15.18:0/2231278186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd774159320 msgr2=0x7fd77415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 --2- 172.21.15.18:0/2231278186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd774159320 0x7fd77415c9b0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fd77406d7c0 tx=0x7fd76401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- 172.21.15.18:0/2231278186 shutdown_connections 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 --2- 172.21.15.18:0/2231278186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd774159320 0x7fd77415c9b0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- 172.21.15.18:0/2231278186 >> 172.21.15.18:0/2231278186 conn(0x7fd774067080 msgr2=0x7fd77406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- 172.21.15.18:0/2231278186 shutdown_connections 2024-04-25T10:14:57.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- 172.21.15.18:0/2231278186 wait complete. 2024-04-25T10:14:57.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 Processor -- start 2024-04-25T10:14:57.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- start start 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77406e4a0 0x7fd77414bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd77415f440 0x7fd77415bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415f9a0 con 0x7fd774159320 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77415f820 con 0x7fd77406e4a0 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd77a600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774071980 con 0x7fd77415f440 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48028/0 (socket says 172.21.15.18:48028) 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 -- 172.21.15.18:0/414070641 learned_addr learned my addr 172.21.15.18:0/414070641 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd773400640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77406e4a0 0x7fd77414bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd773e00640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd77415f440 0x7fd77415bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 -- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd77415f440 msgr2=0x7fd77415bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd77415f440 0x7fd77415bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 -- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77406e4a0 msgr2=0x7fd77414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77406e4a0 0x7fd77414bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.467+0000 7fd772a00640 1 -- 172.21.15.18:0/414070641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd77414ce90 con 0x7fd774159320 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd772a00640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c460 tx=0x7fd76000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760017070 con 0x7fd774159320 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7600052f0 con 0x7fd774159320 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd77414d170 con 0x7fd774159320 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd760003840 con 0x7fd774159320 2024-04-25T10:14:57.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd77414efa0 con 0x7fd774159320 2024-04-25T10:14:57.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd77414f1a0 con 0x7fd774159320 2024-04-25T10:14:57.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd76001a070 con 0x7fd774159320 2024-04-25T10:14:57.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 0x7fd754069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.471+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fd760084620 con 0x7fd774159320 2024-04-25T10:14:57.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.475+0000 7fd773400640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 0x7fd754069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.475+0000 7fd773400640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 0x7fd754069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd7640af000 tx=0x7fd7640a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.475+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd77414f1a0 con 0x7fd774159320 2024-04-25T10:14:57.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.643+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7740745d0 con 0x7fd774159320 2024-04-25T10:14:57.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.643+0000 7fd76b400640 1 -- 172.21.15.18:0/414070641 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd760054d00 con 0x7fd774159320 2024-04-25T10:14:57.648 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 msgr2=0x7fd754069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 0x7fd754069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fd7640af000 tx=0x7fd7640a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 msgr2=0x7fd77414c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fd76000c460 tx=0x7fd76000c920 comp rx=0 tx=0).stop 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 shutdown_connections 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd754066f60 0x7fd754069420 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd77415f440 0x7fd77415bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd774159320 0x7fd77414c3d0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 --2- 172.21.15.18:0/414070641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd77406e4a0 0x7fd77414bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 >> 172.21.15.18:0/414070641 conn(0x7fd774067080 msgr2=0x7fd77406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 shutdown_connections 2024-04-25T10:14:57.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.647+0000 7fd77a600640 1 -- 172.21.15.18:0/414070641 wait complete. 2024-04-25T10:14:57.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:14:57.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.807+0000 7fed7a800640 1 Processor -- start 2024-04-25T10:14:57.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.807+0000 7fed7a800640 1 -- start start 2024-04-25T10:14:57.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed7a800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed7a800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 0x7fed740b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed7a800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740b1420 con 0x7fed7406ac10 2024-04-25T10:14:57.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed7a800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740b0220 con 0x7fed74144090 2024-04-25T10:14:57.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed7a800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740b0500 con 0x7fed740b0fe0 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed78a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 0x7fed740b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed79400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed79400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.18:45614/0 (socket says 172.21.15.18:45614) 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed79400640 1 -- 172.21.15.18:0/4233915464 learned_addr learned my addr 172.21.15.18:0/4233915464 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed73e00640 1 -- 172.21.15.18:0/4233915464 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814623470 0 0) 0x7fed740b1420 con 0x7fed7406ac10 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed78a00640 1 -- 172.21.15.18:0/4233915464 >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 msgr2=0x7fed740b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed78a00640 1 --2- 172.21.15.18:0/4233915464 >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed78a00640 1 -- 172.21.15.18:0/4233915464 >> v1:172.21.15.167:6789/0 conn(0x7fed7406ac10 legacy=0x7fed740ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed78a00640 1 -- 172.21.15.18:0/4233915464 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740b07e0 con 0x7fed740b0fe0 2024-04-25T10:14:57.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.811+0000 7fed79400640 1 --2- 172.21.15.18:0/4233915464 >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed78a00640 1 --2- 172.21.15.18:0/4233915464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 0x7fed740b19e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed600097c0 tx=0x7fed6001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11d8ae9109f6fcdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed73e00640 1 -- 172.21.15.18:0/4233915464 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600b0070 con 0x7fed740b0fe0 2024-04-25T10:14:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed73e00640 1 -- 172.21.15.18:0/4233915464 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed600ab600 con 0x7fed740b0fe0 2024-04-25T10:14:57.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed73e00640 1 -- 172.21.15.18:0/4233915464 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed600ab9d0 con 0x7fed740b0fe0 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- 172.21.15.18:0/4233915464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 msgr2=0x7fed740b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 --2- 172.21.15.18:0/4233915464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 0x7fed740b19e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fed600097c0 tx=0x7fed6001c410 comp rx=0 tx=0).stop 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- 172.21.15.18:0/4233915464 shutdown_connections 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 --2- 172.21.15.18:0/4233915464 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed740b0fe0 0x7fed740b19e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 --2- 172.21.15.18:0/4233915464 >> v2:172.21.15.167:3300/0 conn(0x7fed74144090 0x7fed740b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- 172.21.15.18:0/4233915464 >> 172.21.15.18:0/4233915464 conn(0x7fed740b5ca0 msgr2=0x7fed74099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- 172.21.15.18:0/4233915464 shutdown_connections 2024-04-25T10:14:57.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- 172.21.15.18:0/4233915464 wait complete. 2024-04-25T10:14:57.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 Processor -- start 2024-04-25T10:14:57.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.815+0000 7fed7a800640 1 -- start start 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed7406ac10 0x7fed74160bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed740b0fe0 0x7fed7415ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740ae170 con 0x7fed74144090 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740adff0 con 0x7fed740b0fe0 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7416af10 con 0x7fed7406ac10 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48038/0 (socket says 172.21.15.18:48038) 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 -- 172.21.15.18:0/595735653 learned_addr learned my addr 172.21.15.18:0/595735653 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed78a00640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed740b0fe0 0x7fed7415ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79400640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed7406ac10 0x7fed74160bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 -- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed7406ac10 msgr2=0x7fed74160bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed7406ac10 0x7fed74160bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 -- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed740b0fe0 msgr2=0x7fed7415ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed740b0fe0 0x7fed7415ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 -- 172.21.15.18:0/595735653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed741578a0 con 0x7fed74144090 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed79e00640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00c7b0 tx=0x7fed6c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c00ce60 con 0x7fed74144090 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c003db0 con 0x7fed74144090 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c0052b0 con 0x7fed74144090 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7415f5f0 con 0x7fed74144090 2024-04-25T10:14:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed74141030 con 0x7fed74144090 2024-04-25T10:14:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed740745d0 con 0x7fed74144090 2024-04-25T10:14:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.819+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed6c005450 con 0x7fed74144090 2024-04-25T10:14:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.823+0000 7fed71600640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 0x7fed54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:57.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.823+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fed6c084fa0 con 0x7fed74144090 2024-04-25T10:14:57.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.823+0000 7fed79400640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 0x7fed54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:57.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.823+0000 7fed79400640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 0x7fed54069420 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fed68006cb0 tx=0x7fed68009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:57.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.827+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed6c055720 con 0x7fed74144090 2024-04-25T10:14:57.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.987+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fed7413fa20 con 0x7fed74144090 2024-04-25T10:14:57.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.987+0000 7fed71600640 1 -- 172.21.15.18:0/595735653 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7fed6c0597c0 con 0x7fed74144090 2024-04-25T10:14:57.992 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 msgr2=0x7fed54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 0x7fed54069420 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fed68006cb0 tx=0x7fed68009240 comp rx=0 tx=0).stop 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 msgr2=0x7fed741fa230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00c7b0 tx=0x7fed6c00cc70 comp rx=0 tx=0).stop 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 shutdown_connections 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed74144090 0x7fed741fa230 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed740b0fe0 0x7fed7415ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed54066f60 0x7fed54069420 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 --2- 172.21.15.18:0/595735653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed7406ac10 0x7fed74160bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 >> 172.21.15.18:0/595735653 conn(0x7fed740b5ca0 msgr2=0x7fed740b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 shutdown_connections 2024-04-25T10:14:57.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:57.991+0000 7fed7a800640 1 -- 172.21.15.18:0/595735653 wait complete. 2024-04-25T10:14:58.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:14:58.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 Processor -- start 2024-04-25T10:14:58.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 -- start start 2024-04-25T10:14:58.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b1815dd90 0x7f6b18071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18161e90 0x7f6b180ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b18072460 con 0x7f6b18072040 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b180b2dc0 con 0x7f6b1815dd90 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b1da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1806ac10 con 0x7f6b18161e90 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b1815dd90 0x7f6b18071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b0e000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6b18072040 0x7f6b18161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44432/0 (socket says 172.21.15.18:44432) 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b0e000640 1 -- 172.21.15.18:0/363711712 learned_addr learned my addr 172.21.15.18:0/363711712 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:58.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 --2- 172.21.15.18:0/363711712 >> v2:172.21.15.18:3300/0 conn(0x7f6b1815dd90 0x7f6b18071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48040/0 (socket says 172.21.15.18:48040) 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b17400640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18161e90 0x7f6b180ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 -- 172.21.15.18:0/363711712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18161e90 msgr2=0x7f6b180ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18161e90 0x7f6b180ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 -- 172.21.15.18:0/363711712 >> v1:172.21.15.18:6789/0 conn(0x7f6b18072040 legacy=0x7f6b18161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16a00640 1 -- 172.21.15.18:0/363711712 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1806aeb0 con 0x7f6b1815dd90 2024-04-25T10:14:58.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.155+0000 7f6b16000640 1 -- 172.21.15.18:0/363711712 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270467657 0 0) 0x7f6b18072460 con 0x7f6b18072040 2024-04-25T10:14:58.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b16a00640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1815dd90 0x7f6b18071b00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097c0 tx=0x7f6b0801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0fd195c0d3cac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b16000640 1 -- 172.21.15.18:0/363711712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080b0070 con 0x7f6b1815dd90 2024-04-25T10:14:58.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b16000640 1 -- 172.21.15.18:0/363711712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b080ab600 con 0x7f6b1815dd90 2024-04-25T10:14:58.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b16000640 1 -- 172.21.15.18:0/363711712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080ab9d0 con 0x7f6b1815dd90 2024-04-25T10:14:58.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 -- 172.21.15.18:0/363711712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1815dd90 msgr2=0x7f6b18071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1815dd90 0x7f6b18071b00 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f6b080097c0 tx=0x7f6b0801c410 comp rx=0 tx=0).stop 2024-04-25T10:14:58.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 -- 172.21.15.18:0/363711712 shutdown_connections 2024-04-25T10:14:58.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18161e90 0x7f6b180ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 --2- 172.21.15.18:0/363711712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1815dd90 0x7f6b18071b00 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 -- 172.21.15.18:0/363711712 >> 172.21.15.18:0/363711712 conn(0x7f6b180cfd90 msgr2=0x7f6b180d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:58.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 -- 172.21.15.18:0/363711712 shutdown_connections 2024-04-25T10:14:58.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.159+0000 7f6b1da00640 1 -- 172.21.15.18:0/363711712 wait complete. 2024-04-25T10:14:58.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 Processor -- start 2024-04-25T10:14:58.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- start start 2024-04-25T10:14:58.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18072040 0x7f6b180b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 0x7f6b1814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1816ac40 con 0x7f6b18161e90 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1816aac0 con 0x7f6b1815dd90 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1816adc0 con 0x7f6b18072040 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48046/0 (socket says 172.21.15.18:48046) 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 -- 172.21.15.18:0/1093064769 learned_addr learned my addr 172.21.15.18:0/1093064769 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b16a00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18072040 0x7f6b180b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b0e000640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 0x7f6b1814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 -- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18072040 msgr2=0x7f6b180b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18072040 0x7f6b180b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 -- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 msgr2=0x7f6b1814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 0x7f6b1814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 -- 172.21.15.18:0/1093064769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b180b1310 con 0x7f6b18161e90 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b0e000640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 0x7f6b1814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b17400640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007e70 tx=0x7f6b1000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10014620 con 0x7f6b18161e90 2024-04-25T10:14:58.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10019070 con 0x7f6b18161e90 2024-04-25T10:14:58.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10014a20 con 0x7f6b18161e90 2024-04-25T10:14:58.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b18152070 con 0x7f6b18161e90 2024-04-25T10:14:58.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18152630 con 0x7f6b18161e90 2024-04-25T10:14:58.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.163+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b18072700 con 0x7f6b18161e90 2024-04-25T10:14:58.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.167+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b10014bc0 con 0x7f6b18161e90 2024-04-25T10:14:58.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.167+0000 7f6b0f400640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 0x7f6af4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.167+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f6b10085b20 con 0x7f6b18161e90 2024-04-25T10:14:58.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.167+0000 7f6b16a00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 0x7f6af4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.167+0000 7f6b16a00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 0x7f6af4069450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ad000 tx=0x7f6b080a4f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.171+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b10056850 con 0x7f6b18161e90 2024-04-25T10:14:58.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.331+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b1814fcb0 con 0x7f6b18161e90 2024-04-25T10:14:58.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.331+0000 7f6b0f400640 1 -- 172.21.15.18:0/1093064769 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b10056150 con 0x7f6b18161e90 2024-04-25T10:14:58.337 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 msgr2=0x7f6af4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 0x7f6af4069450 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6b080ad000 tx=0x7f6b080a4f90 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 msgr2=0x7f6b1815c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6b10007e70 tx=0x7f6b1000e4b0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 shutdown_connections 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b18161e90 0x7f6b1815c0f0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b1815dd90 0x7f6b1814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f6af4066f90 0x7f6af4069450 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 --2- 172.21.15.18:0/1093064769 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f6b18072040 0x7f6b180b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 >> 172.21.15.18:0/1093064769 conn(0x7f6b180cfd90 msgr2=0x7f6b1815e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:58.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 shutdown_connections 2024-04-25T10:14:58.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.335+0000 7f6b1da00640 1 -- 172.21.15.18:0/1093064769 wait complete. 2024-04-25T10:14:58.358 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T10:14:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 Processor -- start 2024-04-25T10:14:58.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 -- start start 2024-04-25T10:14:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd96415da70 0x7fd9640716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd964161d50 0x7fd96406e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd964162570 con 0x7fd964071c00 2024-04-25T10:14:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd964162290 con 0x7fd964161d50 2024-04-25T10:14:58.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd968a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd96406d7c0 con 0x7fd96415da70 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd964161d50 0x7fd96406e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd964161d50 0x7fd96406e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48052/0 (socket says 172.21.15.18:48052) 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 -- 172.21.15.18:0/798040439 learned_addr learned my addr 172.21.15.18:0/798040439 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd961e00640 1 --2- 172.21.15.18:0/798040439 >> v2:172.21.15.167:3300/0 conn(0x7fd96415da70 0x7fd9640716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 -- 172.21.15.18:0/798040439 >> v2:172.21.15.167:3300/0 conn(0x7fd96415da70 msgr2=0x7fd9640716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 --2- 172.21.15.18:0/798040439 >> v2:172.21.15.167:3300/0 conn(0x7fd96415da70 0x7fd9640716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 -- 172.21.15.18:0/798040439 >> v1:172.21.15.167:6789/0 conn(0x7fd964071c00 legacy=0x7fd964161640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.499+0000 7fd962800640 1 -- 172.21.15.18:0/798040439 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96406daa0 con 0x7fd964161d50 2024-04-25T10:14:58.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd962800640 1 --2- 172.21.15.18:0/798040439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96406e2a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd9640d0b60 tx=0x7fd95c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b62d0035b1a123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd961400640 1 -- 172.21.15.18:0/798040439 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0a57d0 con 0x7fd964161d50 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd961400640 1 -- 172.21.15.18:0/798040439 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0a5970 con 0x7fd964161d50 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd961400640 1 -- 172.21.15.18:0/798040439 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0a5d40 con 0x7fd964161d50 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 -- 172.21.15.18:0/798040439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 msgr2=0x7fd96406e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 --2- 172.21.15.18:0/798040439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96406e2a0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd9640d0b60 tx=0x7fd95c01c9f0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 -- 172.21.15.18:0/798040439 shutdown_connections 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 --2- 172.21.15.18:0/798040439 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96406e2a0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 --2- 172.21.15.18:0/798040439 >> v2:172.21.15.167:3300/0 conn(0x7fd96415da70 0x7fd9640716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 -- 172.21.15.18:0/798040439 >> 172.21.15.18:0/798040439 conn(0x7fd9640b17b0 msgr2=0x7fd9640b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 -- 172.21.15.18:0/798040439 shutdown_connections 2024-04-25T10:14:58.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.503+0000 7fd968a00640 1 -- 172.21.15.18:0/798040439 wait complete. 2024-04-25T10:14:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 Processor -- start 2024-04-25T10:14:58.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- start start 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd964071c00 0x7fd964149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96415da70 0x7fd96414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96406f380 con 0x7fd964161d50 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96406f200 con 0x7fd96415da70 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd96406f500 con 0x7fd964071c00 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48060/0 (socket says 172.21.15.18:48060) 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 -- 172.21.15.18:0/552406142 learned_addr learned my addr 172.21.15.18:0/552406142 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd961e00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd964071c00 0x7fd964149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd959400640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96415da70 0x7fd96414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 -- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd964071c00 msgr2=0x7fd964149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd964071c00 0x7fd964149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 -- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96415da70 msgr2=0x7fd96414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96415da70 0x7fd96414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 -- 172.21.15.18:0/552406142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96414cd10 con 0x7fd964161d50 2024-04-25T10:14:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd962800640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd95c019600 tx=0x7fd95c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0bc020 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95c0b86b0 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95c0b8aa0 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96414bc70 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.507+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96414c230 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9640745d0 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd95c0bf020 con 0x7fd964161d50 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd95aa00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 0x7fd940069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:58.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fd95c11ffe0 con 0x7fd964161d50 2024-04-25T10:14:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd961e00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 0x7fd940069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:58.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.511+0000 7fd961e00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 0x7fd940069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd954009ac0 tx=0x7fd954009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:58.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.515+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd95c0165e0 con 0x7fd964161d50 2024-04-25T10:14:58.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.687+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9641528e0 con 0x7fd964161d50 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.687+0000 7fd95aa00640 1 -- 172.21.15.18:0/552406142 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v125) v1 ==== 80+0+248 (secure 0 0 0) 0x7fd95c0f06d0 con 0x7fd964161d50 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6837/1299067697 2024-04-26T10:14:47.926600+0000 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6835/1299067697 2024-04-26T10:14:47.926600+0000 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6837/2651841863 2024-04-26T10:14:36.951727+0000 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.15.167:6835/2651841863 2024-04-26T10:14:36.951727+0000 2024-04-25T10:14:58.693 INFO:teuthology.orchestra.run.smithi018.stderr:listed 4 entries 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 msgr2=0x7fd940069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 0x7fd940069420 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd954009ac0 tx=0x7fd954009190 comp rx=0 tx=0).stop 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 msgr2=0x7fd96415b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd95c019600 tx=0x7fd95c019790 comp rx=0 tx=0).stop 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 shutdown_connections 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd964161d50 0x7fd96415b8e0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd96415da70 0x7fd96414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd940066f60 0x7fd940069420 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 --2- 172.21.15.18:0/552406142 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd964071c00 0x7fd964149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 >> 172.21.15.18:0/552406142 conn(0x7fd9640b17b0 msgr2=0x7fd964160b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 shutdown_connections 2024-04-25T10:14:58.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:58.691+0000 7fd968a00640 1 -- 172.21.15.18:0/552406142 wait complete. 2024-04-25T10:14:58.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T10:14:58.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:58.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T10:14:58.740 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:14:58.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:14:58.740 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T10:14:58.790 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:58.790 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:58.800 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:58.800 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:14:58.800 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:58.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:14:58.842 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:14:58.842 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:14:58.852 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:14:58.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:14:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 Processor -- start 2024-04-25T10:14:59.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 -- start start 2024-04-25T10:14:59.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd28070fe0 0x7fcd28161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd280713c0 0x7fcd28143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2806d090 con 0x7fcd28071800 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd28162390 con 0x7fcd28070fe0 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd2e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd28161af0 con 0x7fcd280713c0 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcd28071800 0x7fcd2815e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44434/0 (socket says 172.21.15.18:44434) 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27e00640 1 -- 172.21.15.18:0/135740575 learned_addr learned my addr 172.21.15.18:0/135740575 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27400640 1 --2- 172.21.15.18:0/135740575 >> v2:172.21.15.18:3300/0 conn(0x7fcd28070fe0 0x7fcd28161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd280713c0 0x7fcd28143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27400640 1 -- 172.21.15.18:0/135740575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd280713c0 msgr2=0x7fcd28143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27400640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd280713c0 0x7fcd28143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27400640 1 -- 172.21.15.18:0/135740575 >> v1:172.21.15.18:6789/0 conn(0x7fcd28071800 legacy=0x7fcd2815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.023+0000 7fcd27400640 1 -- 172.21.15.18:0/135740575 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28161dd0 con 0x7fcd28070fe0 2024-04-25T10:14:59.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd27400640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28070fe0 0x7fcd28161510 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097c0 tx=0x7fcd1801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8970b92ae958dff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd26a00640 1 -- 172.21.15.18:0/135740575 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180a7070 con 0x7fcd28070fe0 2024-04-25T10:14:59.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd26a00640 1 -- 172.21.15.18:0/135740575 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd180b0070 con 0x7fcd28070fe0 2024-04-25T10:14:59.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd26a00640 1 -- 172.21.15.18:0/135740575 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180ab890 con 0x7fcd28070fe0 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 -- 172.21.15.18:0/135740575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28070fe0 msgr2=0x7fcd28161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28070fe0 0x7fcd28161510 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fcd180097c0 tx=0x7fcd1801c470 comp rx=0 tx=0).stop 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 -- 172.21.15.18:0/135740575 shutdown_connections 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd280713c0 0x7fcd28143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 --2- 172.21.15.18:0/135740575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd28070fe0 0x7fcd28161510 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 -- 172.21.15.18:0/135740575 >> 172.21.15.18:0/135740575 conn(0x7fcd280b3390 msgr2=0x7fcd280b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 -- 172.21.15.18:0/135740575 shutdown_connections 2024-04-25T10:14:59.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.027+0000 7fcd2e800640 1 -- 172.21.15.18:0/135740575 wait complete. 2024-04-25T10:14:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 Processor -- start 2024-04-25T10:14:59.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- start start 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 0x7fcd280b6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28071800 0x7fcd280b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280b0540 con 0x7fcd280713c0 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280b06c0 con 0x7fcd28070fe0 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd280b0840 con 0x7fcd28071800 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48078/0 (socket says 172.21.15.18:48078) 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 -- 172.21.15.18:0/326865807 learned_addr learned my addr 172.21.15.18:0/326865807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd27400640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 0x7fcd280b6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd27e00640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28071800 0x7fcd280b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 -- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28071800 msgr2=0x7fcd280b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28071800 0x7fcd280b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 -- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 msgr2=0x7fcd280b6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 0x7fcd280b6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 -- 172.21.15.18:0/326865807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd280b7310 con 0x7fcd280713c0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd27400640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 0x7fcd280b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1fe00640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000d830 tx=0x7fcd1000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000b6c0 con 0x7fcd280713c0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd10019070 con 0x7fcd280713c0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1000ba60 con 0x7fcd280713c0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2813e820 con 0x7fcd280713c0 2024-04-25T10:14:59.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2813ede0 con 0x7fcd280713c0 2024-04-25T10:14:59.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.031+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd280745d0 con 0x7fcd280713c0 2024-04-25T10:14:59.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.035+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd1001e460 con 0x7fcd280713c0 2024-04-25T10:14:59.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.035+0000 7fcd1f400640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 0x7fcd04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.035+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcd10085960 con 0x7fcd280713c0 2024-04-25T10:14:59.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.035+0000 7fcd27400640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 0x7fcd04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.035+0000 7fcd27400640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 0x7fcd04069420 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcd180af000 tx=0x7fcd180a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.039+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd10056720 con 0x7fcd280713c0 2024-04-25T10:14:59.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.235+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd280cef80 con 0x7fcd280713c0 2024-04-25T10:14:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.235+0000 7fcd1f400640 1 -- 172.21.15.18:0/326865807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fcd10056020 con 0x7fcd280713c0 2024-04-25T10:14:59.240 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:59.241 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:52.020568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":13,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:14:59.241 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 114 2024-04-25T10:14:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 msgr2=0x7fcd04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 0x7fcd04069420 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fcd180af000 tx=0x7fcd180a7000 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 msgr2=0x7fcd280b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000d830 tx=0x7fcd1000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 shutdown_connections 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcd04066f60 0x7fcd04069420 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcd28071800 0x7fcd280b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd280713c0 0x7fcd280b4480 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 --2- 172.21.15.18:0/326865807 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcd28070fe0 0x7fcd280b6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 >> 172.21.15.18:0/326865807 conn(0x7fcd280b3390 msgr2=0x7fcd280d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 shutdown_connections 2024-04-25T10:14:59.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.239+0000 7fcd2e800640 1 -- 172.21.15.18:0/326865807 wait complete. 2024-04-25T10:14:59.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:14:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 Processor -- start 2024-04-25T10:14:59.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 -- start start 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f520415df00 0x7f520406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040d0c40 0x7f52040d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520406b530 con 0x7f520406ac10 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520415eef0 con 0x7f520415df00 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5209000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520415e650 con 0x7f52040d0c40 2024-04-25T10:14:59.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5201e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f520406ac10 0x7f52040b39a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44438/0 (socket says 172.21.15.18:44438) 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5201e00640 1 -- 172.21.15.18:0/1885436167 learned_addr learned my addr 172.21.15.18:0/1885436167 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f51f9400640 1 --2- 172.21.15.18:0/1885436167 >> v2:172.21.15.18:3300/0 conn(0x7f520415df00 0x7f520406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5202800640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040d0c40 0x7f52040d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5201400640 1 -- 172.21.15.18:0/1885436167 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1590496240 0 0) 0x7f520406b530 con 0x7f520406ac10 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f5201400640 1 -- 172.21.15.18:0/1885436167 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e8003530 con 0x7f520406ac10 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f51f9400640 1 -- 172.21.15.18:0/1885436167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040d0c40 msgr2=0x7f52040d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f51f9400640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040d0c40 0x7f52040d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f51f9400640 1 -- 172.21.15.18:0/1885436167 >> v1:172.21.15.18:6789/0 conn(0x7f520406ac10 legacy=0x7f52040b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.399+0000 7f51f9400640 1 -- 172.21.15.18:0/1885436167 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520415e930 con 0x7f520415df00 2024-04-25T10:14:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f51f9400640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520415df00 0x7f520406aff0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097c0 tx=0x7f51ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5648157bd3d608f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5201400640 1 -- 172.21.15.18:0/1885436167 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0a7070 con 0x7f520415df00 2024-04-25T10:14:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5201400640 1 -- 172.21.15.18:0/1885436167 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0b0070 con 0x7f520415df00 2024-04-25T10:14:59.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5201400640 1 -- 172.21.15.18:0/1885436167 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0ab890 con 0x7f520415df00 2024-04-25T10:14:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 -- 172.21.15.18:0/1885436167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520415df00 msgr2=0x7f520406aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520415df00 0x7f520406aff0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f51ec0097c0 tx=0x7f51ec01c470 comp rx=0 tx=0).stop 2024-04-25T10:14:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 -- 172.21.15.18:0/1885436167 shutdown_connections 2024-04-25T10:14:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f52040d0c40 0x7f52040d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 --2- 172.21.15.18:0/1885436167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520415df00 0x7f520406aff0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 -- 172.21.15.18:0/1885436167 >> 172.21.15.18:0/1885436167 conn(0x7f52040b2400 msgr2=0x7f52040b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 -- 172.21.15.18:0/1885436167 shutdown_connections 2024-04-25T10:14:59.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.403+0000 7f5209000640 1 -- 172.21.15.18:0/1885436167 wait complete. 2024-04-25T10:14:59.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 Processor -- start 2024-04-25T10:14:59.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- start start 2024-04-25T10:14:59.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520406ac10 0x7f520414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415df00 0x7f5204157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b01b0 con 0x7f52040d0c40 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b0030 con 0x7f520415df00 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520416a8e0 con 0x7f520406ac10 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48098/0 (socket says 172.21.15.18:48098) 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 -- 172.21.15.18:0/1907288154 learned_addr learned my addr 172.21.15.18:0/1907288154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5201e00640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520406ac10 0x7f520414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5202800640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415df00 0x7f5204157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 -- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520406ac10 msgr2=0x7f520414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520406ac10 0x7f520414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 -- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415df00 msgr2=0x7f5204157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415df00 0x7f5204157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 -- 172.21.15.18:0/1907288154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204158390 con 0x7f52040d0c40 2024-04-25T10:14:59.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51f9400640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01ab20 tx=0x7f51ec019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0abc30 con 0x7f52040d0c40 2024-04-25T10:14:59.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0abdd0 con 0x7f52040d0c40 2024-04-25T10:14:59.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040ceb20 con 0x7f52040d0c40 2024-04-25T10:14:59.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec0bf670 con 0x7f52040d0c40 2024-04-25T10:14:59.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.407+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040cf0e0 con 0x7f52040d0c40 2024-04-25T10:14:59.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52040745d0 con 0x7f52040d0c40 2024-04-25T10:14:59.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5204070330 con 0x7f52040d0c40 2024-04-25T10:14:59.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f51faa00640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 0x7f51e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f51ec11f5b0 con 0x7f52040d0c40 2024-04-25T10:14:59.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f5201e00640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 0x7f51e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.411+0000 7f5201e00640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 0x7f51e0069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51f4007fd0 tx=0x7f51f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.415+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f51ec016090 con 0x7f52040d0c40 2024-04-25T10:14:59.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.579+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52040b27e0 con 0x7f52040d0c40 2024-04-25T10:14:59.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.579+0000 7f51faa00640 1 -- 172.21.15.18:0/1907288154 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f51ec0efc90 con 0x7f52040d0c40 2024-04-25T10:14:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:14:59.585 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":125,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:47.926624+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6835/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 msgr2=0x7f51e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 0x7f51e0069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f51f4007fd0 tx=0x7f51f4009040 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 msgr2=0x7f5204157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f51ec01ab20 tx=0x7f51ec019210 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 shutdown_connections 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f520415df00 0x7f5204157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52040d0c40 0x7f5204157540 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f51e0066f90 0x7f51e0069450 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 --2- 172.21.15.18:0/1907288154 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f520406ac10 0x7f520414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 >> 172.21.15.18:0/1907288154 conn(0x7f52040b2400 msgr2=0x7f520406b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 shutdown_connections 2024-04-25T10:14:59.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.583+0000 7f5209000640 1 -- 172.21.15.18:0/1907288154 wait complete. 2024-04-25T10:14:59.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T10:03:43.469039+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T10:14:16.207800+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T10:14:16.774891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T10:14:59.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T10:14:59.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 Processor -- start 2024-04-25T10:14:59.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 -- start start 2024-04-25T10:14:59.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff3000cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff3000ce1d0 0x7ff3000ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff30006ac10 con 0x7ff30015dd90 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3000b2dc0 con 0x7ff3000ce1d0 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff306800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff30006aeb0 con 0x7ff300072210 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2ff400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff30015dd90 0x7ff300071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44442/0 (socket says 172.21.15.18:44442) 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2ff400640 1 -- 172.21.15.18:0/822808368 learned_addr learned my addr 172.21.15.18:0/822808368 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> v2:172.21.15.167:3300/0 conn(0x7ff3000ce1d0 0x7ff3000ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2f7e00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff3000cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960851968 0 0) 0x7ff30006ac10 con 0x7ff30015dd90 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2e4003530 con 0x7ff30015dd90 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205722691 0 0) 0x7ff2e4003530 con 0x7ff30015dd90 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 msgr2=0x7ff3000cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff3000cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.747+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 >> v2:172.21.15.167:3300/0 conn(0x7ff3000ce1d0 msgr2=0x7ff3000ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 --2- 172.21.15.18:0/822808368 >> v2:172.21.15.167:3300/0 conn(0x7ff3000ce1d0 0x7ff3000ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30006b190 con 0x7ff30015dd90 2024-04-25T10:14:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7ff2f0001680 con 0x7ff30015dd90 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> v2:172.21.15.167:3300/0 conn(0x7ff3000ce1d0 0x7ff3000ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 >> v1:172.21.15.18:6789/0 conn(0x7ff30015dd90 legacy=0x7ff300071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff2e40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e4003f40 0x7ff2e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff2e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff30006aeb0 con 0x7ff2e4004d50 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e400b9d0 con 0x7ff2e4003f40 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e400bba0 con 0x7ff300072210 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff2e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ff400640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff2e40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2f7e00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e4003f40 0x7ff2e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 -- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 msgr2=0x7ff2e40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300072210 0x7ff2e40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 -- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e4003f40 msgr2=0x7ff2e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:14:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2e4003f40 0x7ff2e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 -- 172.21.15.18:0/822808368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e4003530 con 0x7ff2e4004d50 2024-04-25T10:14:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff2e40051d0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e380 tx=0x7ff2f801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb4e46d13318202 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b0070 con 0x7ff2e4004d50 2024-04-25T10:14:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f80ab600 con 0x7ff2e4004d50 2024-04-25T10:14:59.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.751+0000 7ff2fea00640 1 -- 172.21.15.18:0/822808368 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8009de0 con 0x7ff2e4004d50 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- 172.21.15.18:0/822808368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 msgr2=0x7ff2e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 --2- 172.21.15.18:0/822808368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff2e40051d0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800e380 tx=0x7ff2f801cb40 comp rx=0 tx=0).stop 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ffe00640 1 -- 172.21.15.18:0/822808368 reap_dead start 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- 172.21.15.18:0/822808368 shutdown_connections 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- 172.21.15.18:0/822808368 >> 172.21.15.18:0/822808368 conn(0x7ff3000cfd90 msgr2=0x7ff3000d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- 172.21.15.18:0/822808368 shutdown_connections 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- 172.21.15.18:0/822808368 wait complete. 2024-04-25T10:14:59.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 Processor -- start 2024-04-25T10:14:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- start start 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300155cc0 0x7ff3000afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff300155250 0x7ff3000ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000cf320 con 0x7ff2e4004d50 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000cf1a0 con 0x7ff300155250 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff306800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3000cf4a0 con 0x7ff300155cc0 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48112/0 (socket says 172.21.15.18:48112) 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 -- 172.21.15.18:0/921130816 learned_addr learned my addr 172.21.15.18:0/921130816 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:14:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2f7e00640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300155cc0 0x7ff3000afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ffe00640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff300155250 0x7ff3000ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 -- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300155cc0 msgr2=0x7ff3000afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300155cc0 0x7ff3000afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 -- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff300155250 msgr2=0x7ff3000ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff300155250 0x7ff3000ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.755+0000 7ff2ff400640 1 -- 172.21.15.18:0/921130816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30015ca90 con 0x7ff2e4004d50 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2ff400640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0012520 tx=0x7ff2f0012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0014810 con 0x7ff2e4004d50 2024-04-25T10:14:59.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f001b070 con 0x7ff2e4004d50 2024-04-25T10:14:59.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30015bcd0 con 0x7ff2e4004d50 2024-04-25T10:14:59.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0014bf0 con 0x7ff2e4004d50 2024-04-25T10:14:59.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30015c290 con 0x7ff2e4004d50 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3000745d0 con 0x7ff2e4004d50 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2f0016480 con 0x7ff2e4004d50 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 0x7ff2dc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.759+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff2f00885f0 con 0x7ff2e4004d50 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.763+0000 7ff2f7e00640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 0x7ff2dc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:14:59.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.763+0000 7ff2f7e00640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 0x7ff2dc069450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff3000b4360 tx=0x7ff2e8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:14:59.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.767+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2f00593e0 con 0x7ff2e4004d50 2024-04-25T10:14:59.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.927+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3000ad550 con 0x7ff2e4004d50 2024-04-25T10:14:59.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.927+0000 7ff2f7400640 1 -- 172.21.15.18:0/921130816 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2f0058ce0 con 0x7ff2e4004d50 2024-04-25T10:14:59.932 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 msgr2=0x7ff2dc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 0x7ff2dc069450 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff3000b4360 tx=0x7ff2e8009190 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 msgr2=0x7ff3000af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0012520 tx=0x7ff2f0012920 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 shutdown_connections 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff300155250 0x7ff3000ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff2dc066f90 0x7ff2dc069450 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff300155cc0 0x7ff3000afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 --2- 172.21.15.18:0/921130816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2e4004d50 0x7ff3000af690 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 >> 172.21.15.18:0/921130816 conn(0x7ff3000cfd90 msgr2=0x7ff3000cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:14:59.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 shutdown_connections 2024-04-25T10:14:59.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:14:59.931+0000 7ff306800640 1 -- 172.21.15.18:0/921130816 wait complete. 2024-04-25T10:14:59.953 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T10:15:00.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 Processor -- start 2024-04-25T10:15:00.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 -- start start 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26b40cedc0 0x7f26b415bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26b40d11b0 0x7f26b4070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b415cfa0 con 0x7f26b40711d0 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b4071640 con 0x7f26b40cedc0 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26bbe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b40cf1a0 con 0x7f26b40d11b0 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f26b40cedc0 0x7f26b415bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f26b40711d0 0x7f26b415f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44446/0 (socket says 172.21.15.18:44446) 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9e00640 1 -- 172.21.15.18:0/2522227799 learned_addr learned my addr 172.21.15.18:0/2522227799 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b8a00640 1 --2- 172.21.15.18:0/2522227799 >> v2:172.21.15.167:3300/0 conn(0x7f26b40d11b0 0x7f26b4070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9400640 1 -- 172.21.15.18:0/2522227799 >> v2:172.21.15.167:3300/0 conn(0x7f26b40d11b0 msgr2=0x7f26b4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9400640 1 --2- 172.21.15.18:0/2522227799 >> v2:172.21.15.167:3300/0 conn(0x7f26b40d11b0 0x7f26b4070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9400640 1 -- 172.21.15.18:0/2522227799 >> v1:172.21.15.18:6789/0 conn(0x7f26b40711d0 legacy=0x7f26b415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b9400640 1 -- 172.21.15.18:0/2522227799 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b415c6a0 con 0x7f26b40cedc0 2024-04-25T10:15:00.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.095+0000 7f26b3e00640 1 -- 172.21.15.18:0/2522227799 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918987052 0 0) 0x7f26b415cfa0 con 0x7f26b40711d0 2024-04-25T10:15:00.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26b9400640 1 --2- 172.21.15.18:0/2522227799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40cedc0 0x7f26b415bde0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f26b40d00c0 tx=0x7f26a801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1267074e0ab23b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26b3e00640 1 -- 172.21.15.18:0/2522227799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80b5070 con 0x7f26b40cedc0 2024-04-25T10:15:00.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26b3e00640 1 -- 172.21.15.18:0/2522227799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a80a8970 con 0x7f26b40cedc0 2024-04-25T10:15:00.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26b3e00640 1 -- 172.21.15.18:0/2522227799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a80a8d40 con 0x7f26b40cedc0 2024-04-25T10:15:00.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 -- 172.21.15.18:0/2522227799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40cedc0 msgr2=0x7f26b415bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 --2- 172.21.15.18:0/2522227799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40cedc0 0x7f26b415bde0 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f26b40d00c0 tx=0x7f26a801ec70 comp rx=0 tx=0).stop 2024-04-25T10:15:00.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 -- 172.21.15.18:0/2522227799 shutdown_connections 2024-04-25T10:15:00.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 --2- 172.21.15.18:0/2522227799 >> v2:172.21.15.167:3300/0 conn(0x7f26b40d11b0 0x7f26b4070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 --2- 172.21.15.18:0/2522227799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40cedc0 0x7f26b415bde0 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 -- 172.21.15.18:0/2522227799 >> 172.21.15.18:0/2522227799 conn(0x7f26b406f510 msgr2=0x7f26b406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:00.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 -- 172.21.15.18:0/2522227799 shutdown_connections 2024-04-25T10:15:00.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 -- 172.21.15.18:0/2522227799 wait complete. 2024-04-25T10:15:00.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.099+0000 7f26bbe00640 1 Processor -- start 2024-04-25T10:15:00.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- start start 2024-04-25T10:15:00.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26b40711d0 0x7f26b415ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40cedc0 0x7f26b40ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b415d240 con 0x7f26b40d11b0 2024-04-25T10:15:00.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b415cc60 con 0x7f26b40cedc0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b415c320 con 0x7f26b40711d0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48134/0 (socket says 172.21.15.18:48134) 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 -- 172.21.15.18:0/297780189 learned_addr learned my addr 172.21.15.18:0/297780189 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b8a00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40cedc0 0x7f26b40ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9400640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26b40711d0 0x7f26b415ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 -- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26b40711d0 msgr2=0x7f26b415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26b40711d0 0x7f26b415ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 -- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40cedc0 msgr2=0x7f26b40ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40cedc0 0x7f26b40ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 -- 172.21.15.18:0/297780189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4157300 con 0x7f26b40d11b0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b9e00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c7a0 tx=0x7f26ac00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac018070 con 0x7f26b40d11b0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00a640 con 0x7f26b40d11b0 2024-04-25T10:15:00.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b40ad440 con 0x7f26b40d11b0 2024-04-25T10:15:00.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00aab0 con 0x7f26b40d11b0 2024-04-25T10:15:00.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b4156820 con 0x7f26b40d11b0 2024-04-25T10:15:00.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.103+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b4156ff0 con 0x7f26b40d11b0 2024-04-25T10:15:00.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.107+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f26ac01b070 con 0x7f26b40d11b0 2024-04-25T10:15:00.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.107+0000 7f26b1600640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 0x7f2694069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.107+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f26ac084870 con 0x7f26b40d11b0 2024-04-25T10:15:00.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.107+0000 7f26b9400640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 0x7f2694069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.107+0000 7f26b9400640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 0x7f2694069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f26a80b2000 tx=0x7f26a80aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.111+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f26ac055630 con 0x7f26b40d11b0 2024-04-25T10:15:00.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26b40745d0 con 0x7f26b40d11b0 2024-04-25T10:15:00.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26b1600640 1 -- 172.21.15.18:0/297780189 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26ac054f30 con 0x7f26b40d11b0 2024-04-25T10:15:00.278 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 msgr2=0x7f2694069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 0x7f2694069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f26a80b2000 tx=0x7f26a80aa070 comp rx=0 tx=0).stop 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 msgr2=0x7f26b4149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c7a0 tx=0x7f26ac00cc60 comp rx=0 tx=0).stop 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 shutdown_connections 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26b40d11b0 0x7f26b4149050 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26b40cedc0 0x7f26b40ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2694066f60 0x7f2694069420 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 --2- 172.21.15.18:0/297780189 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26b40711d0 0x7f26b415ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 >> 172.21.15.18:0/297780189 conn(0x7f26b406f510 msgr2=0x7f26b40b2980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:00.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 shutdown_connections 2024-04-25T10:15:00.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.275+0000 7f26bbe00640 1 -- 172.21.15.18:0/297780189 wait complete. 2024-04-25T10:15:00.300 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T10:15:00.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.439+0000 7f2febe00640 1 Processor -- start 2024-04-25T10:15:00.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.439+0000 7f2febe00640 1 -- start start 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2febe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec15daa0 0x7f2fec0b5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2febe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2fec0b5880 0x7f2fec0d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2febe00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fec0d2480 con 0x7f2fec0d2010 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2febe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fec0b5ce0 con 0x7f2fec0b5880 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2febe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0d3330 con 0x7f2fec15daa0 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fe3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2fec0b5880 0x7f2fec0d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2feb400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2fec0d2010 0x7f2fec072340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44452/0 (socket says 172.21.15.18:44452) 2024-04-25T10:15:00.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2feb400640 1 -- 172.21.15.18:0/3161946017 learned_addr learned my addr 172.21.15.18:0/3161946017 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2feaa00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec15daa0 0x7f2fec0b5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fe3e00640 1 -- 172.21.15.18:0/3161946017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec15daa0 msgr2=0x7f2fec0b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fe3e00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec15daa0 0x7f2fec0b5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fe3e00640 1 -- 172.21.15.18:0/3161946017 >> v1:172.21.15.18:6789/0 conn(0x7f2fec0d2010 legacy=0x7f2fec072340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fe3e00640 1 -- 172.21.15.18:0/3161946017 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec15de80 con 0x7f2fec0b5880 2024-04-25T10:15:00.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.443+0000 7f2fea000640 1 -- 172.21.15.18:0/3161946017 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716636242 0 0) 0x7f2fec0d2480 con 0x7f2fec0d2010 2024-04-25T10:15:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2fe3e00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec0b5880 0x7f2fec0d1ad0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097c0 tx=0x7f2fd401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dad54a7666de7aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2fea000640 1 -- 172.21.15.18:0/3161946017 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40b1070 con 0x7f2fec0b5880 2024-04-25T10:15:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2fea000640 1 -- 172.21.15.18:0/3161946017 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd40ac410 con 0x7f2fec0b5880 2024-04-25T10:15:00.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2fea000640 1 -- 172.21.15.18:0/3161946017 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40ac7e0 con 0x7f2fec0b5880 2024-04-25T10:15:00.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- 172.21.15.18:0/3161946017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec0b5880 msgr2=0x7f2fec0d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec0b5880 0x7f2fec0d1ad0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40097c0 tx=0x7f2fd401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- 172.21.15.18:0/3161946017 shutdown_connections 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec0b5880 0x7f2fec0d1ad0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- 172.21.15.18:0/3161946017 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec15daa0 0x7f2fec0b5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- 172.21.15.18:0/3161946017 >> 172.21.15.18:0/3161946017 conn(0x7f2fec0d0510 msgr2=0x7f2fec0d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- 172.21.15.18:0/3161946017 shutdown_connections 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- 172.21.15.18:0/3161946017 wait complete. 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 Processor -- start 2024-04-25T10:15:00.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- start start 2024-04-25T10:15:00.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec0b5880 0x7f2fec160470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fec0d2010 0x7f2fec14f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec16a5e0 con 0x7f2fec15daa0 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec0d2fc0 con 0x7f2fec0d2010 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2febe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec16a760 con 0x7f2fec0b5880 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.447+0000 7f2feb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48158/0 (socket says 172.21.15.18:48158) 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 -- 172.21.15.18:0/1871152213 learned_addr learned my addr 172.21.15.18:0/1871152213 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feaa00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec0b5880 0x7f2fec160470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3e00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fec0d2010 0x7f2fec14f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 -- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec0b5880 msgr2=0x7f2fec160470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec0b5880 0x7f2fec160470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 -- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fec0d2010 msgr2=0x7f2fec14f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fec0d2010 0x7f2fec14f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 -- 172.21.15.18:0/1871152213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec160a50 con 0x7f2fec15daa0 2024-04-25T10:15:00.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2feb400640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c7a0 tx=0x7f2fe400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe4018070 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe400a640 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fec160d30 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe400aa70 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fec0cce40 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fec0745d0 con 0x7f2fec15daa0 2024-04-25T10:15:00.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2fe401b070 con 0x7f2fec15daa0 2024-04-25T10:15:00.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 0x7f2fc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.451+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2fe4084830 con 0x7f2fec15daa0 2024-04-25T10:15:00.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.455+0000 7f2feaa00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 0x7f2fc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.455+0000 7f2feaa00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 0x7f2fc8069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0079c0 tx=0x7f2fdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.459+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fe4054f10 con 0x7f2fec15daa0 2024-04-25T10:15:00.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fec160f00 con 0x7f2fec15daa0 2024-04-25T10:15:00.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2fe3400640 1 -- 172.21.15.18:0/1871152213 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fe4058fb0 con 0x7f2fec15daa0 2024-04-25T10:15:00.623 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-04-25T10:15:00.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 msgr2=0x7f2fc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 0x7f2fc8069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0079c0 tx=0x7f2fdc008040 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 msgr2=0x7f2fec1523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f2fe400c7a0 tx=0x7f2fe400cc60 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 shutdown_connections 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fec15daa0 0x7f2fec1523e0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fec0d2010 0x7f2fec14f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2fc8066f60 0x7f2fc8069420 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 --2- 172.21.15.18:0/1871152213 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2fec0b5880 0x7f2fec160470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 >> 172.21.15.18:0/1871152213 conn(0x7f2fec0d0510 msgr2=0x7f2fec15ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 shutdown_connections 2024-04-25T10:15:00.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.619+0000 7f2febe00640 1 -- 172.21.15.18:0/1871152213 wait complete. 2024-04-25T10:15:00.644 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:15:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.779+0000 7f0af1800640 1 Processor -- start 2024-04-25T10:15:00.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.779+0000 7f0af1800640 1 -- start start 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0af1800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f0aec06ead0 0x7f0aec1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0af1800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec15ac60 con 0x7f0aec144140 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0af1800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aec0cf3e0 con 0x7f0aec0cef30 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0af1800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aec15af20 con 0x7f0aec06ead0 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeaa00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0aec144140 0x7f0aec0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44454/0 (socket says 172.21.15.18:44454) 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeaa00640 1 -- 172.21.15.18:0/2563698196 learned_addr learned my addr 172.21.15.18:0/2563698196 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeb400640 1 --2- 172.21.15.18:0/2563698196 >> v2:172.21.15.167:3300/0 conn(0x7f0aec06ead0 0x7f0aec1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969238874 0 0) 0x7f0aec15ac60 con 0x7f0aec144140 2024-04-25T10:15:00.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ad0003530 con 0x7f0aec144140 2024-04-25T10:15:00.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 443352786 0 0) 0x7f0ad0003530 con 0x7f0aec144140 2024-04-25T10:15:00.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 >> v2:172.21.15.167:3300/0 conn(0x7f0aec06ead0 msgr2=0x7f0aec1653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:00.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 --2- 172.21.15.18:0/2563698196 >> v2:172.21.15.167:3300/0 conn(0x7f0aec06ead0 0x7f0aec1653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 >> v1:172.21.15.167:6789/0 conn(0x7f0aec0cef30 legacy=0x7f0aec06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec15b200 con 0x7f0aec144140 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f0adc001680 con 0x7f0aec144140 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 >> v1:172.21.15.18:6789/0 conn(0x7f0aec144140 legacy=0x7f0aec0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad00039f0 0x7f0ad0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 0x7f0ad0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ad00051d0 0x7f0ad000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15af20 con 0x7f0ad0004810 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad000c0a0 con 0x7f0ad00039f0 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ad000c2a0 con 0x7f0ad00051d0 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 0x7f0ad0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeaa00640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad00039f0 0x7f0ad0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeb400640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ad00051d0 0x7f0ad000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 -- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ad00051d0 msgr2=0x7f0ad000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0ad00051d0 0x7f0ad000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 -- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad00039f0 msgr2=0x7f0ad0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad00039f0 0x7f0ad0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0ae3e00640 1 -- 172.21.15.18:0/2563698196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad0003530 con 0x7f0ad0004810 2024-04-25T10:15:00.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.783+0000 7f0aeb400640 1 -- 172.21.15.18:0/2563698196 reap_dead start 2024-04-25T10:15:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0ae3e00640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 0x7f0ad0004c90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001780 tx=0x7f0ad401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c91e06a2826483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40013a0 con 0x7f0ad0004810 2024-04-25T10:15:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40052f0 con 0x7f0ad0004810 2024-04-25T10:15:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0aea000640 1 -- 172.21.15.18:0/2563698196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4003840 con 0x7f0ad0004810 2024-04-25T10:15:00.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 -- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 msgr2=0x7f0ad0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 0x7f0ad0004c90 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f0ad4001780 tx=0x7f0ad401c400 comp rx=0 tx=0).stop 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 -- 172.21.15.18:0/2563698196 shutdown_connections 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 --2- 172.21.15.18:0/2563698196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ad0004810 0x7f0ad0004c90 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 -- 172.21.15.18:0/2563698196 >> 172.21.15.18:0/2563698196 conn(0x7f0aec066fa0 msgr2=0x7f0aec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 -- 172.21.15.18:0/2563698196 shutdown_connections 2024-04-25T10:15:00.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 -- 172.21.15.18:0/2563698196 wait complete. 2024-04-25T10:15:00.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.787+0000 7f0af1800640 1 Processor -- start 2024-04-25T10:15:00.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- start start 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad0004810 0x7f0aec1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0aec151d80 0x7f0aec0b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec144520 con 0x7f0aec0b3590 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec0b1f30 con 0x7f0ad0004810 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aec15ba00 con 0x7f0aec151d80 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48178/0 (socket says 172.21.15.18:48178) 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 -- 172.21.15.18:0/1811085118 learned_addr learned my addr 172.21.15.18:0/1811085118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:00.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0aec151d80 0x7f0aec0b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeaa00640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad0004810 0x7f0aec1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 -- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0aec151d80 msgr2=0x7f0aec0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0aec151d80 0x7f0aec0b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 -- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad0004810 msgr2=0x7f0aec1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad0004810 0x7f0aec1541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 -- 172.21.15.18:0/1811085118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aec1f33d0 con 0x7f0aec0b3590 2024-04-25T10:15:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0aeb400640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0cc520 tx=0x7f0ae400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae400fd80 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ae401d070 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aec1532b0 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae4015670 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aec1524f0 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.791+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aec0745d0 con 0x7f0aec0b3590 2024-04-25T10:15:00.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.795+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ae4015810 con 0x7f0aec0b3590 2024-04-25T10:15:00.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.795+0000 7f0ae2a00640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 0x7f0ac8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:00.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.795+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f0ae4085dc0 con 0x7f0aec0b3590 2024-04-25T10:15:00.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.795+0000 7f0aeaa00640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 0x7f0ac8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:00.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.795+0000 7f0aeaa00640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 0x7f0ac8069450 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0011f0 tx=0x7f0adc000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:00.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.799+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ae4027020 con 0x7f0aec0b3590 2024-04-25T10:15:01.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.995+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aec06c250 con 0x7f0aec0b3590 2024-04-25T10:15:01.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.995+0000 7f0ae2a00640 1 -- 172.21.15.18:0/1811085118 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f0ae4010040 con 0x7f0aec0b3590 2024-04-25T10:15:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:01.001 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:52.020568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":13,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:15:01.001 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 114 2024-04-25T10:15:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 msgr2=0x7f0ac8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 0x7f0ac8069450 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0011f0 tx=0x7f0adc000ee0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 msgr2=0x7f0aec1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0cc520 tx=0x7f0ae400f580 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 shutdown_connections 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aec0b3590 0x7f0aec1596f0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0ac8066f90 0x7f0ac8069450 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0aec151d80 0x7f0aec0b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 --2- 172.21.15.18:0/1811085118 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ad0004810 0x7f0aec1541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 >> 172.21.15.18:0/1811085118 conn(0x7f0aec066fa0 msgr2=0x7f0aec143310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 shutdown_connections 2024-04-25T10:15:01.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:00.999+0000 7f0af1800640 1 -- 172.21.15.18:0/1811085118 wait complete. 2024-04-25T10:15:01.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:15:01.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 Processor -- start 2024-04-25T10:15:01.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 -- start start 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff540145270 0x7ff54015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400cc4e0 con 0x7ff5400b1e60 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5400ce040 con 0x7ff5400cd4d0 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.159+0000 7ff545200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff540145650 con 0x7ff540145270 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff540145270 0x7ff54015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff540145270 0x7ff54015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48190/0 (socket says 172.21.15.18:48190) 2024-04-25T10:15:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53e800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5400b1e60 0x7ff54015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44466/0 (socket says 172.21.15.18:44466) 2024-04-25T10:15:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 -- 172.21.15.18:0/345621806 learned_addr learned my addr 172.21.15.18:0/345621806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 -- 172.21.15.18:0/345621806 >> v1:172.21.15.167:6789/0 conn(0x7ff5400cd4d0 legacy=0x7ff5400b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 -- 172.21.15.18:0/345621806 >> v1:172.21.15.18:6789/0 conn(0x7ff5400b1e60 legacy=0x7ff54015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 -- 172.21.15.18:0/345621806 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5400ce320 con 0x7ff540145270 2024-04-25T10:15:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53d400640 1 -- 172.21.15.18:0/345621806 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 710940272 0 0) 0x7ff5400cc4e0 con 0x7ff5400b1e60 2024-04-25T10:15:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53de00640 1 --2- 172.21.15.18:0/345621806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540145270 0x7ff54015fe50 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff530009e50 tx=0x7ff53001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ee4e87bd1460a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53d400640 1 -- 172.21.15.18:0/345621806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300a58d0 con 0x7ff540145270 2024-04-25T10:15:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53d400640 1 -- 172.21.15.18:0/345621806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5300a5a70 con 0x7ff540145270 2024-04-25T10:15:01.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.163+0000 7ff53d400640 1 -- 172.21.15.18:0/345621806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300a5e40 con 0x7ff540145270 2024-04-25T10:15:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- 172.21.15.18:0/345621806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540145270 msgr2=0x7ff54015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 --2- 172.21.15.18:0/345621806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540145270 0x7ff54015fe50 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7ff530009e50 tx=0x7ff53001ca00 comp rx=0 tx=0).stop 2024-04-25T10:15:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- 172.21.15.18:0/345621806 shutdown_connections 2024-04-25T10:15:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 --2- 172.21.15.18:0/345621806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff540145270 0x7ff54015fe50 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- 172.21.15.18:0/345621806 >> 172.21.15.18:0/345621806 conn(0x7ff540066fa0 msgr2=0x7ff54006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- 172.21.15.18:0/345621806 shutdown_connections 2024-04-25T10:15:01.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- 172.21.15.18:0/345621806 wait complete. 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 Processor -- start 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- start start 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 0x7ff540143900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff540145270 0x7ff5400ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff540169720 con 0x7ff5400b1e60 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5400cdcc0 con 0x7ff5400cd4d0 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff545200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5401698a0 con 0x7ff540145270 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48198/0 (socket says 172.21.15.18:48198) 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 -- 172.21.15.18:0/552740997 learned_addr learned my addr 172.21.15.18:0/552740997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53e800640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff540145270 0x7ff5400ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff535400640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 0x7ff540143900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 -- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff540145270 msgr2=0x7ff5400ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff540145270 0x7ff5400ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 -- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 msgr2=0x7ff540143900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 0x7ff540143900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 -- 172.21.15.18:0/552740997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff540142b40 con 0x7ff5400b1e60 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff535400640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 0x7ff540143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:01.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff53de00640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff530019610 tx=0x7ff5300197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.167+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5300bc030 con 0x7ff5400b1e60 2024-04-25T10:15:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5300090d0 con 0x7ff5400b1e60 2024-04-25T10:15:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff530009510 con 0x7ff5400b1e60 2024-04-25T10:15:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff540142e20 con 0x7ff5400b1e60 2024-04-25T10:15:01.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5401433e0 con 0x7ff5400b1e60 2024-04-25T10:15:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5400745d0 con 0x7ff5400b1e60 2024-04-25T10:15:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff5300bf070 con 0x7ff5400b1e60 2024-04-25T10:15:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff536a00640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 0x7ff51c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7ff530120300 con 0x7ff5400b1e60 2024-04-25T10:15:01.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff535400640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 0x7ff51c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.171+0000 7ff535400640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 0x7ff51c069420 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff54015e9f0 tx=0x7ff528009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.175+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff5300c7020 con 0x7ff5400b1e60 2024-04-25T10:15:01.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.339+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5401412e0 con 0x7ff5400b1e60 2024-04-25T10:15:01.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.339+0000 7ff536a00640 1 -- 172.21.15.18:0/552740997 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17191 (secure 0 0 0) 0x7ff530016620 con 0x7ff5400b1e60 2024-04-25T10:15:01.344 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:01.344 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":125,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:47.926624+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6835/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 msgr2=0x7ff51c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 0x7ff51c069420 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff54015e9f0 tx=0x7ff528009040 comp rx=0 tx=0).stop 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 msgr2=0x7ff54015b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7ff530019610 tx=0x7ff5300197a0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 shutdown_connections 2024-04-25T10:15:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff51c066f60 0x7ff51c069420 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff540145270 0x7ff5400ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff5400cd4d0 0x7ff540143900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 --2- 172.21.15.18:0/552740997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5400b1e60 0x7ff54015b4e0 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 >> 172.21.15.18:0/552740997 conn(0x7ff540066fa0 msgr2=0x7ff540144540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 shutdown_connections 2024-04-25T10:15:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.343+0000 7ff545200640 1 -- 172.21.15.18:0/552740997 wait complete. 2024-04-25T10:15:01.365 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:15:01.366 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:15:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 Processor -- start 2024-04-25T10:15:01.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 -- start start 2024-04-25T10:15:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 0x7f41080b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f41080b1c90 0x7f410815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41080cc4e0 con 0x7f4108145270 2024-04-25T10:15:01.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41080b20e0 con 0x7f41080b1c90 2024-04-25T10:15:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f410ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4108145650 con 0x7f410815fe50 2024-04-25T10:15:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f4105e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4108145270 0x7f41080cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44468/0 (socket says 172.21.15.18:44468) 2024-04-25T10:15:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f4105e00640 1 -- 172.21.15.18:0/577035038 learned_addr learned my addr 172.21.15.18:0/577035038 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f40ffe00640 1 --2- 172.21.15.18:0/577035038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 0x7f41080b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f4106800640 1 --2- 172.21.15.18:0/577035038 >> v2:172.21.15.167:3300/0 conn(0x7f41080b1c90 0x7f410815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f4105400640 1 -- 172.21.15.18:0/577035038 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386681253 0 0) 0x7f41080cc4e0 con 0x7f4108145270 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f4105400640 1 -- 172.21.15.18:0/577035038 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40ec003530 con 0x7f4108145270 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f40ffe00640 1 -- 172.21.15.18:0/577035038 >> v2:172.21.15.167:3300/0 conn(0x7f41080b1c90 msgr2=0x7f410815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f40ffe00640 1 --2- 172.21.15.18:0/577035038 >> v2:172.21.15.167:3300/0 conn(0x7f41080b1c90 0x7f410815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f40ffe00640 1 -- 172.21.15.18:0/577035038 >> v1:172.21.15.18:6789/0 conn(0x7f4108145270 legacy=0x7f41080cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.503+0000 7f40ffe00640 1 -- 172.21.15.18:0/577035038 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080ce040 con 0x7f410815fe50 2024-04-25T10:15:01.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f40ffe00640 1 --2- 172.21.15.18:0/577035038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 0x7f41080b1750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097c0 tx=0x7f40f001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dda876fd47accd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f4105400640 1 -- 172.21.15.18:0/577035038 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00b2070 con 0x7f410815fe50 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f4105400640 1 -- 172.21.15.18:0/577035038 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f00ad640 con 0x7f410815fe50 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f4105400640 1 -- 172.21.15.18:0/577035038 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f00ada10 con 0x7f410815fe50 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 -- 172.21.15.18:0/577035038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 msgr2=0x7f41080b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 --2- 172.21.15.18:0/577035038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 0x7f41080b1750 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f40f00097c0 tx=0x7f40f001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 -- 172.21.15.18:0/577035038 shutdown_connections 2024-04-25T10:15:01.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 --2- 172.21.15.18:0/577035038 >> v2:172.21.15.167:3300/0 conn(0x7f41080b1c90 0x7f410815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 --2- 172.21.15.18:0/577035038 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f410815fe50 0x7f41080b1750 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 -- 172.21.15.18:0/577035038 >> 172.21.15.18:0/577035038 conn(0x7f4108066fa0 msgr2=0x7f410806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 -- 172.21.15.18:0/577035038 shutdown_connections 2024-04-25T10:15:01.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.507+0000 7f410ca00640 1 -- 172.21.15.18:0/577035038 wait complete. 2024-04-25T10:15:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 Processor -- start 2024-04-25T10:15:01.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- start start 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 0x7f41081657c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4108145270 0x7f410813afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080cdbe0 con 0x7f410815fe50 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410815f930 con 0x7f41080b1c90 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080cdd60 con 0x7f4108145270 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48202/0 (socket says 172.21.15.18:48202) 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 -- 172.21.15.18:0/1013039791 learned_addr learned my addr 172.21.15.18:0/1013039791 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:01.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f40ffe00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4108145270 0x7f410813afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4105e00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 0x7f41081657c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 -- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4108145270 msgr2=0x7f410813afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4108145270 0x7f410813afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 -- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 msgr2=0x7f41081657c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 0x7f41081657c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 -- 172.21.15.18:0/1013039791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4108166020 con 0x7f410815fe50 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4105e00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 0x7f41081657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f4106800640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f410000efc0 tx=0x7f410000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100018020 con 0x7f410815fe50 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100014480 con 0x7f410815fe50 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41080af720 con 0x7f410815fe50 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100014870 con 0x7f410815fe50 2024-04-25T10:15:01.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4108165d00 con 0x7f410815fe50 2024-04-25T10:15:01.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.511+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41080af540 con 0x7f410815fe50 2024-04-25T10:15:01.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.515+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f410001b020 con 0x7f410815fe50 2024-04-25T10:15:01.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.515+0000 7f40fe000640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 0x7f40e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.515+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4100086190 con 0x7f410815fe50 2024-04-25T10:15:01.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.515+0000 7f4105e00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 0x7f40e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.515+0000 7f4105e00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 0x7f40e4069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005890 tx=0x7f40f8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.519+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f41080af540 con 0x7f410815fe50 2024-04-25T10:15:01.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f410806b8e0 con 0x7f410815fe50 2024-04-25T10:15:01.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f40fe000640 1 -- 172.21.15.18:0/1013039791 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4950 (secure 0 0 0) 0x7f4100022030 con 0x7f410815fe50 2024-04-25T10:15:01.722 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:01.723 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:52.020568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":13,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:15:01.723 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 114 2024-04-25T10:15:01.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 msgr2=0x7f40e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 0x7f40e4069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f40f8005890 tx=0x7f40f8009040 comp rx=0 tx=0).stop 2024-04-25T10:15:01.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 msgr2=0x7f410813ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f410000efc0 tx=0x7f410000c490 comp rx=0 tx=0).stop 2024-04-25T10:15:01.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 shutdown_connections 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f410815fe50 0x7f410813ee10 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f40e4066f60 0x7f40e4069420 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4108145270 0x7f410813afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 --2- 172.21.15.18:0/1013039791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41080b1c90 0x7f41081657c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 >> 172.21.15.18:0/1013039791 conn(0x7f4108066fa0 msgr2=0x7f4108141ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 shutdown_connections 2024-04-25T10:15:01.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.719+0000 7f410ca00640 1 -- 172.21.15.18:0/1013039791 wait complete. 2024-04-25T10:15:01.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:15:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.879+0000 7fb0fb200640 1 Processor -- start 2024-04-25T10:15:01.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.879+0000 7fb0fb200640 1 -- start start 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fb200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb0fc143c60 0x7fb0fc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fb200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb0fc0cc730 0x7fb0fc0b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fb200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc15e0a0 con 0x7fb0fc06e760 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fb200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cf220 con 0x7fb0fc143c60 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fb200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc0ccc80 con 0x7fb0fc0cc730 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb0fc143c60 0x7fb0fc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb0fc06e760 0x7fb0fc0cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50612/0 (socket says 172.21.15.18:50612) 2024-04-25T10:15:01.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9400640 1 -- 172.21.15.18:0/1946203586 learned_addr learned my addr 172.21.15.18:0/1946203586 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0fa800640 1 --2- 172.21.15.18:0/1946203586 >> v2:172.21.15.167:3300/0 conn(0x7fb0fc0cc730 0x7fb0fc0b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9e00640 1 -- 172.21.15.18:0/1946203586 >> v2:172.21.15.167:3300/0 conn(0x7fb0fc0cc730 msgr2=0x7fb0fc0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9e00640 1 --2- 172.21.15.18:0/1946203586 >> v2:172.21.15.167:3300/0 conn(0x7fb0fc0cc730 0x7fb0fc0b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9e00640 1 -- 172.21.15.18:0/1946203586 >> v1:172.21.15.18:6789/0 conn(0x7fb0fc06e760 legacy=0x7fb0fc0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.883+0000 7fb0f9e00640 1 -- 172.21.15.18:0/1946203586 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc15e380 con 0x7fb0fc143c60 2024-04-25T10:15:01.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0f9e00640 1 --2- 172.21.15.18:0/1946203586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06e220 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0cceb0 tx=0x7fb0ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2729d487b9d97123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0f8a00640 1 -- 172.21.15.18:0/1946203586 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0b0070 con 0x7fb0fc143c60 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0f8a00640 1 -- 172.21.15.18:0/1946203586 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0ab600 con 0x7fb0fc143c60 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0f8a00640 1 -- 172.21.15.18:0/1946203586 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec0ab9d0 con 0x7fb0fc143c60 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- 172.21.15.18:0/1946203586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 msgr2=0x7fb0fc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- 172.21.15.18:0/1946203586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06e220 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0cceb0 tx=0x7fb0ec01c480 comp rx=0 tx=0).stop 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- 172.21.15.18:0/1946203586 shutdown_connections 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- 172.21.15.18:0/1946203586 >> v2:172.21.15.167:3300/0 conn(0x7fb0fc0cc730 0x7fb0fc0b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- 172.21.15.18:0/1946203586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06e220 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- 172.21.15.18:0/1946203586 >> 172.21.15.18:0/1946203586 conn(0x7fb0fc066fa0 msgr2=0x7fb0fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- 172.21.15.18:0/1946203586 shutdown_connections 2024-04-25T10:15:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- 172.21.15.18:0/1946203586 wait complete. 2024-04-25T10:15:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 Processor -- start 2024-04-25T10:15:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- start start 2024-04-25T10:15:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc06e760 0x7fb0fc158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0fc0cc730 0x7fb0fc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b3a70 con 0x7fb0fc143c60 2024-04-25T10:15:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc15ee60 con 0x7fb0fc06e760 2024-04-25T10:15:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.887+0000 7fb0fb200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0b3bf0 con 0x7fb0fc0cc730 2024-04-25T10:15:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50120/0 (socket says 172.21.15.18:50120) 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 -- 172.21.15.18:0/692733617 learned_addr learned my addr 172.21.15.18:0/692733617 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f9400640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0fc0cc730 0x7fb0fc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f9e00640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc06e760 0x7fb0fc158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 -- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0fc0cc730 msgr2=0x7fb0fc06d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0fc0cc730 0x7fb0fc06d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 -- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc06e760 msgr2=0x7fb0fc158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc06e760 0x7fb0fc158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 -- 172.21.15.18:0/692733617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc13bc70 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fa800640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4007e70 tx=0x7fb0f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4014620 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4019070 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc13bf50 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4014a20 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc13c510 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc04efa0 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.891+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb0f4014bc0 con 0x7fb0fc143c60 2024-04-25T10:15:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.895+0000 7fb0f2000640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 0x7fb0dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.895+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb0f4085b90 con 0x7fb0fc143c60 2024-04-25T10:15:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.895+0000 7fb0f9e00640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 0x7fb0dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.895+0000 7fb0f9e00640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 0x7fb0dc069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ad000 tx=0x7fb0ec0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:01.899+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb0f4011260 con 0x7fb0fc143c60 2024-04-25T10:15:02.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.091+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0fc0b25f0 con 0x7fb0fc143c60 2024-04-25T10:15:02.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.091+0000 7fb0f2000640 1 -- 172.21.15.18:0/692733617 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4950 (secure 0 0 0) 0x7fb0f4056950 con 0x7fb0fc143c60 2024-04-25T10:15:02.097 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:02.097 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T10:14:17.787730+0000","modified":"2024-04-25T10:14:52.020568+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":125,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":37334},"failed":[],"damaged":[],"stopped":[],"info":{"gid_37334":{"gid":37334,"name":"b","rank":0,"incarnation":111,"state":"up:active","state_seq":13,"addr":"172.21.15.167:6836/616056842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":616056842},{"type":"v1","addr":"172.21.15.167:6836","nonce":616056842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T10:15:02.098 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 114 2024-04-25T10:15:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 msgr2=0x7fb0dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 0x7fb0dc069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec0ad000 tx=0x7fb0ec0a6000 comp rx=0 tx=0).stop 2024-04-25T10:15:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 msgr2=0x7fb0fc06d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4007e70 tx=0x7fb0f400e4b0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 shutdown_connections 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0fc143c60 0x7fb0fc06d650 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb0dc066f60 0x7fb0dc069420 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb0fc0cc730 0x7fb0fc06d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 --2- 172.21.15.18:0/692733617 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb0fc06e760 0x7fb0fc158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 >> 172.21.15.18:0/692733617 conn(0x7fb0fc066fa0 msgr2=0x7fb0fc15efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 shutdown_connections 2024-04-25T10:15:02.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.095+0000 7fb0fb200640 1 -- 172.21.15.18:0/692733617 wait complete. 2024-04-25T10:15:02.119 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:15:02.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 Processor -- start 2024-04-25T10:15:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 -- start start 2024-04-25T10:15:02.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f21e00b1e60 0x7f21e015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00cc4e0 con 0x7f21e015fe50 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e00ce040 con 0x7f21e0145270 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21e6400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e0145650 con 0x7f21e00b1e60 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21d6a00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f21e015fe50 0x7f21e00b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50628/0 (socket says 172.21.15.18:50628) 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21d6a00640 1 -- 172.21.15.18:0/2730525900 learned_addr learned my addr 172.21.15.18:0/2730525900 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:02.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.255+0000 7f21dfe00640 1 --2- 172.21.15.18:0/2730525900 >> v2:172.21.15.167:3300/0 conn(0x7f21e00b1e60 0x7f21e015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667575934 0 0) 0x7f21e00cc4e0 con 0x7f21e015fe50 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21c4003530 con 0x7f21e015fe50 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3292967304 0 0) 0x7f21c4003530 con 0x7f21e015fe50 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 >> v2:172.21.15.167:3300/0 conn(0x7f21e00b1e60 msgr2=0x7f21e015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 --2- 172.21.15.18:0/2730525900 >> v2:172.21.15.167:3300/0 conn(0x7f21e00b1e60 0x7f21e015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 >> v1:172.21.15.167:6789/0 conn(0x7f21e0145270 legacy=0x7f21e00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e00ce320 con 0x7f21e015fe50 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f21c8001680 con 0x7f21e015fe50 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 >> v1:172.21.15.18:6789/0 conn(0x7f21e015fe50 legacy=0x7f21e00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c40039c0 0x7f21c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 0x7f21c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c40051d0 0x7f21c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e0145650 con 0x7f21c4004810 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c400c070 con 0x7f21c40039c0 2024-04-25T10:15:02.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c400c270 con 0x7f21c40051d0 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dfe00640 1 --2- 172.21.15.18:0/2730525900 >> v2:172.21.15.167:3300/0 conn(0x7f21e00b1e60 0x7f21e015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 0x7f21c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21df400640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c40039c0 0x7f21c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dfe00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c40051d0 0x7f21c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 -- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c40051d0 msgr2=0x7f21c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c40051d0 0x7f21c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 -- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c40039c0 msgr2=0x7f21c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c40039c0 0x7f21c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 -- 172.21.15.18:0/2730525900 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4003530 con 0x7f21c4004810 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dfe00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21c40051d0 0x7f21c400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:02.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21dfe00640 1 -- 172.21.15.18:0/2730525900 reap_dead start 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.259+0000 7f21d6a00640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 0x7f21c4004c90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c1c0 tx=0x7f21c801f2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e9ff5b5b50513e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c8007d00 con 0x7f21c4004810 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c80ac020 con 0x7f21c4004810 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dea00640 1 -- 172.21.15.18:0/2730525900 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80058e0 con 0x7f21c4004810 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 msgr2=0x7f21c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 0x7f21c4004c90 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f21c800c1c0 tx=0x7f21c801f2d0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- 172.21.15.18:0/2730525900 shutdown_connections 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 --2- 172.21.15.18:0/2730525900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21c4004810 0x7f21c4004c90 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- 172.21.15.18:0/2730525900 >> 172.21.15.18:0/2730525900 conn(0x7f21e0066fa0 msgr2=0x7f21e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- 172.21.15.18:0/2730525900 shutdown_connections 2024-04-25T10:15:02.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- 172.21.15.18:0/2730525900 wait complete. 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 Processor -- start 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- start start 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4004810 0x7f21e01e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21e01e87e0 0x7f21e01e8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015f650 con 0x7f21e012eb90 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e01602b0 con 0x7f21c4004810 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21e6400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e015f930 con 0x7f21e01e87e0 2024-04-25T10:15:02.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50150/0 (socket says 172.21.15.18:50150) 2024-04-25T10:15:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21dfe00640 1 -- 172.21.15.18:0/1213193879 learned_addr learned my addr 172.21.15.18:0/1213193879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21d6a00640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21e01e87e0 0x7f21e01e8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.263+0000 7f21df400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4004810 0x7f21e01e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 -- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21e01e87e0 msgr2=0x7f21e01e8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21e01e87e0 0x7f21e01e8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 -- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4004810 msgr2=0x7f21e01e5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4004810 0x7f21e01e5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 -- 172.21.15.18:0/1213193879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e012daf0 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21dfe00640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f21e006f240 tx=0x7f21d800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8016620 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d801b070 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e012ddd0 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d8016a00 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e012e390 con 0x7f21e012eb90 2024-04-25T10:15:02.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e00745d0 con 0x7f21e012eb90 2024-04-25T10:15:02.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f21d8016ba0 con 0x7f21e012eb90 2024-04-25T10:15:02.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 0x7f21bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.267+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f21d8086110 con 0x7f21e012eb90 2024-04-25T10:15:02.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.271+0000 7f21df400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 0x7f21bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.271+0000 7f21df400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 0x7f21bc069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f21d0000c10 tx=0x7f21d0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.271+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f21d8025020 con 0x7f21e012eb90 2024-04-25T10:15:02.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.435+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21e006b8e0 con 0x7f21e012eb90 2024-04-25T10:15:02.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21d7e00640 1 -- 172.21.15.18:0/1213193879 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+17191 (secure 0 0 0) 0x7f21d8056760 con 0x7f21e012eb90 2024-04-25T10:15:02.441 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:02.442 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":125,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:14:47.926624+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T10:14:16.207800+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T10:14:16.774891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6837/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6835/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:15:02.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 msgr2=0x7f21bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 0x7f21bc069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f21d0000c10 tx=0x7f21d0009040 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 msgr2=0x7f21e012f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f21e006f240 tx=0x7f21d800f520 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 shutdown_connections 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e012eb90 0x7f21e012f010 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f21bc066f60 0x7f21bc069420 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f21e01e87e0 0x7f21e01e8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 --2- 172.21.15.18:0/1213193879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f21c4004810 0x7f21e01e5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 >> 172.21.15.18:0/1213193879 conn(0x7f21e0066fa0 msgr2=0x7f21e00acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 shutdown_connections 2024-04-25T10:15:02.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.439+0000 7f21e6400640 1 -- 172.21.15.18:0/1213193879 wait complete. 2024-04-25T10:15:02.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T10:15:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 Processor -- start 2024-04-25T10:15:02.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 -- start start 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 0x7f5f9c168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c06ac10 con 0x7f5f9c072210 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c06aeb0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5fa1c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0b2dc0 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f92000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5f9c072210 0x7f5f9c0cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50636/0 (socket says 172.21.15.18:50636) 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f92000640 1 -- 172.21.15.18:0/3245241534 learned_addr learned my addr 172.21.15.18:0/3245241534 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:02.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9b400640 1 --2- 172.21.15.18:0/3245241534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 0x7f5f9c168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 580290986 0 0) 0x7f5f9c06ac10 con 0x7f5f9c072210 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f80003530 con 0x7f5f9c072210 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605399918 0 0) 0x7f5f9c06aeb0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9b400640 1 -- 172.21.15.18:0/3245241534 >> v1:172.21.15.167:6789/0 conn(0x7f5f9c15dd90 legacy=0x7f5f9c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9b400640 1 -- 172.21.15.18:0/3245241534 >> v1:172.21.15.18:6789/0 conn(0x7f5f9c072210 legacy=0x7f5f9c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.603+0000 7f5f9b400640 1 -- 172.21.15.18:0/3245241534 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c06b190 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5f9b400640 1 --2- 172.21.15.18:0/3245241534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 0x7f5f9c168ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097f0 tx=0x7f5f9401c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e146ba9a534d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940b0070 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f940ab400 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5f9a000640 1 -- 172.21.15.18:0/3245241534 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84001a00 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3245241534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 msgr2=0x7f5f9c168ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3245241534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 0x7f5f9c168ab0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097f0 tx=0x7f5f9401c290 comp rx=0 tx=0).stop 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3245241534 shutdown_connections 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3245241534 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c0cf3b0 0x7f5f9c168ab0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3245241534 >> 172.21.15.18:0/3245241534 conn(0x7f5f9c0cfd90 msgr2=0x7f5f9c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3245241534 shutdown_connections 2024-04-25T10:15:02.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.607+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3245241534 wait complete. 2024-04-25T10:15:02.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 Processor -- start 2024-04-25T10:15:02.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- start start 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c072210 0x7f5f9c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f9c0cf3b0 0x7f5f9c156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c16b990 con 0x7f5f9c15dd90 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c16b810 con 0x7f5f9c0cf3b0 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c16bb10 con 0x7f5f9c072210 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50154/0 (socket says 172.21.15.18:50154) 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 -- 172.21.15.18:0/3832551760 learned_addr learned my addr 172.21.15.18:0/3832551760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f92000640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f9c0cf3b0 0x7f5f9c156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9aa00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c072210 0x7f5f9c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 -- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c072210 msgr2=0x7f5f9c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c072210 0x7f5f9c152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 -- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f9c0cf3b0 msgr2=0x7f5f9c156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f9c0cf3b0 0x7f5f9c156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 -- 172.21.15.18:0/3832551760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c1531b0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f9b400640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097f0 tx=0x7f5f94019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940b9020 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f94003820 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940b0040 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c0adb90 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c0ae150 con 0x7f5f9c15dd90 2024-04-25T10:15:02.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.611+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c0745d0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.615+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5f940bc020 con 0x7f5f9c15dd90 2024-04-25T10:15:02.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.615+0000 7f5f93400640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.615+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f5f9411f180 con 0x7f5f9c15dd90 2024-04-25T10:15:02.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.615+0000 7f5f9aa00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.615+0000 7f5f9aa00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 0x7f5f78069420 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c000f70 tx=0x7f5f8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:02.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.619+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5f940c3030 con 0x7f5f9c15dd90 2024-04-25T10:15:02.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.811+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5f9c0ae7a0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.817 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-04-25T10:15:02.815+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T10:15:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.815+0000 7f5f93400640 1 -- 172.21.15.18:0/3832551760 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v115) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5f94015fd0 con 0x7f5f9c15dd90 2024-04-25T10:15:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 msgr2=0x7f5f78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 0x7f5f78069420 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c000f70 tx=0x7f5f8c009040 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 msgr2=0x7f5f9c157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097f0 tx=0x7f5f94019030 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 shutdown_connections 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f9c15dd90 0x7f5f9c157130 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f9c0cf3b0 0x7f5f9c156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f5f78066f60 0x7f5f78069420 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 --2- 172.21.15.18:0/3832551760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f5f9c072210 0x7f5f9c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 >> 172.21.15.18:0/3832551760 conn(0x7f5f9c0cfd90 msgr2=0x7f5f9c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 shutdown_connections 2024-04-25T10:15:02.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.819+0000 7f5fa1c00640 1 -- 172.21.15.18:0/3832551760 wait complete. 2024-04-25T10:15:02.848 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T10:15:02.874 INFO:tasks.ceph.mds.b.smithi167.stdout:starting mds.b at 2024-04-25T10:15:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 Processor -- start 2024-04-25T10:15:02.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 -- start start 2024-04-25T10:15:02.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f84159320 0x7f2f8415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 0x7f2f8406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8415fc00 con 0x7f2f8406e010 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8406d640 con 0x7f2f84159320 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.987+0000 7f2f8a800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415fee0 con 0x7f2f8415f440 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2f84159320 0x7f2f8415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2f8406e010 0x7f2f8406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50642/0 (socket says 172.21.15.18:50642) 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83e00640 1 -- 172.21.15.18:0/1759768805 learned_addr learned my addr 172.21.15.18:0/1759768805 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:02.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 -- 172.21.15.18:0/1759768805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 msgr2=0x7f2f8406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f7aa00640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 0x7f2f8406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f82a00640 1 -- 172.21.15.18:0/1759768805 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931968998 0 0) 0x7f2f8415fc00 con 0x7f2f8406e010 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 0x7f2f8406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 -- 172.21.15.18:0/1759768805 >> v1:172.21.15.18:6789/0 conn(0x7f2f8406e010 legacy=0x7f2f8406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 -- 172.21.15.18:0/1759768805 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f841601c0 con 0x7f2f84159320 2024-04-25T10:15:02.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f7aa00640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 0x7f2f8406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:03.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f83400640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84159320 0x7f2f8415c9b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f2f740097c0 tx=0x7f2f7401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51087ca2c475b7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f82a00640 1 -- 172.21.15.18:0/1759768805 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740ab600 con 0x7f2f84159320 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f82a00640 1 -- 172.21.15.18:0/1759768805 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f740b0070 con 0x7f2f84159320 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.991+0000 7f2f82a00640 1 -- 172.21.15.18:0/1759768805 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f740ab9c0 con 0x7f2f84159320 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- 172.21.15.18:0/1759768805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84159320 msgr2=0x7f2f8415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84159320 0x7f2f8415c9b0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f2f740097c0 tx=0x7f2f7401c3e0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- 172.21.15.18:0/1759768805 shutdown_connections 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8415f440 0x7f2f8406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- 172.21.15.18:0/1759768805 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f84159320 0x7f2f8415c9b0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- 172.21.15.18:0/1759768805 >> 172.21.15.18:0/1759768805 conn(0x7f2f84067080 msgr2=0x7f2f8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- 172.21.15.18:0/1759768805 shutdown_connections 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- 172.21.15.18:0/1759768805 wait complete. 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 Processor -- start 2024-04-25T10:15:03.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- start start 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8406e010 0x7f2f84140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f84159320 0x7f2f8413a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415f9a0 con 0x7f2f8415f440 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415f820 con 0x7f2f84159320 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f8a800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8406ebb0 con 0x7f2f8406e010 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50176/0 (socket says 172.21.15.18:50176) 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 -- 172.21.15.18:0/2389648916 learned_addr learned my addr 172.21.15.18:0/2389648916 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f7aa00640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f84159320 0x7f2f8413a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83400640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8406e010 0x7f2f84140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 -- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8406e010 msgr2=0x7f2f84140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8406e010 0x7f2f84140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 -- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f84159320 msgr2=0x7f2f8413a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f84159320 0x7f2f8413a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.995+0000 7f2f83e00640 1 -- 172.21.15.18:0/2389648916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8413aee0 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f83e00640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c410 tx=0x7f2f7c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0074e0 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c0047f0 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c007680 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8413b1c0 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8413b780 con 0x7f2f8415f440 2024-04-25T10:15:03.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8413b980 con 0x7f2f8415f440 2024-04-25T10:15:03.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f7c011070 con 0x7f2f8415f440 2024-04-25T10:15:03.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 0x7f2f60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f2f7c084f60 con 0x7f2f8415f440 2024-04-25T10:15:03.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:02.999+0000 7f2f83400640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 0x7f2f60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.003+0000 7f2f83400640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 0x7f2f60069420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2f740af000 tx=0x7f2f740a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:03.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.003+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f8413b980 con 0x7f2f8415f440 2024-04-25T10:15:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.207+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f840745d0 con 0x7f2f8415f440 2024-04-25T10:15:03.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f7be00640 1 -- 172.21.15.18:0/2389648916 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v116) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f7c055bb0 con 0x7f2f8415f440 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 msgr2=0x7f2f60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 0x7f2f60069420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f2f740af000 tx=0x7f2f740a7000 comp rx=0 tx=0).stop 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 msgr2=0x7f2f84158270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00c410 tx=0x7f2f7c00c810 comp rx=0 tx=0).stop 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 shutdown_connections 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8415f440 0x7f2f84158270 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f84159320 0x7f2f8413a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2f60066f60 0x7f2f60069420 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 --2- 172.21.15.18:0/2389648916 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2f8406e010 0x7f2f84140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 >> 172.21.15.18:0/2389648916 conn(0x7f2f84067080 msgr2=0x7f2f840cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:03.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 shutdown_connections 2024-04-25T10:15:03.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.819+0000 7f2f8a800640 1 -- 172.21.15.18:0/2389648916 wait complete. 2024-04-25T10:15:03.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T10:15:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 Processor -- start 2024-04-25T10:15:03.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 -- start start 2024-04-25T10:15:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2de8144080 0x7f2de80ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de80cf490 con 0x7f2de806e3c0 2024-04-25T10:15:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80719b0 con 0x7f2de8144080 2024-04-25T10:15:03.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2deda00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80cf1b0 con 0x7f2de8071e40 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2de6a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2de8144080 0x7f2de80ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2de6a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2de8144080 0x7f2de80ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50190/0 (socket says 172.21.15.18:50190) 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2de6a00640 1 -- 172.21.15.18:0/4107436349 learned_addr learned my addr 172.21.15.18:0/4107436349 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.991+0000 7f2dde000640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6a00640 1 -- 172.21.15.18:0/4107436349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 msgr2=0x7f2de80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6a00640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6a00640 1 -- 172.21.15.18:0/4107436349 >> v1:172.21.15.167:6789/0 conn(0x7f2de806e3c0 legacy=0x7f2de80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6a00640 1 -- 172.21.15.18:0/4107436349 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de8071360 con 0x7f2de8144080 2024-04-25T10:15:03.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2dde000640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6a00640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de8144080 0x7f2de80ce660 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009e50 tx=0x7f2dd801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119a8a172b56035b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6000640 1 -- 172.21.15.18:0/4107436349 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80a58b0 con 0x7f2de8144080 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6000640 1 -- 172.21.15.18:0/4107436349 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80a5a50 con 0x7f2de8144080 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2de6000640 1 -- 172.21.15.18:0/4107436349 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80a5e20 con 0x7f2de8144080 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 -- 172.21.15.18:0/4107436349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de8144080 msgr2=0x7f2de80ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de8144080 0x7f2de80ce660 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009e50 tx=0x7f2dd801ca00 comp rx=0 tx=0).stop 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 -- 172.21.15.18:0/4107436349 shutdown_connections 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 --2- 172.21.15.18:0/4107436349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de8144080 0x7f2de80ce660 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 -- 172.21.15.18:0/4107436349 >> 172.21.15.18:0/4107436349 conn(0x7f2de806ac10 msgr2=0x7f2de806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 -- 172.21.15.18:0/4107436349 shutdown_connections 2024-04-25T10:15:04.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.995+0000 7f2deda00640 1 -- 172.21.15.18:0/4107436349 wait complete. 2024-04-25T10:15:04.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 Processor -- start 2024-04-25T10:15:04.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- start start 2024-04-25T10:15:04.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:04.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de815e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:04.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 0x7f2de80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b4ad0 con 0x7f2de806e3c0 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80b4950 con 0x7f2de8144080 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81675a0 con 0x7f2de8071e40 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50192/0 (socket says 172.21.15.18:50192) 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 -- 172.21.15.18:0/2946320942 learned_addr learned my addr 172.21.15.18:0/2946320942 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:04.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de7400640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 0x7f2de80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2dde000640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de815e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 -- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 msgr2=0x7f2de815e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de815e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 -- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 msgr2=0x7f2de80ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 0x7f2de80ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:04.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 -- 172.21.15.18:0/2946320942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de81626f0 con 0x7f2de806e3c0 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de7400640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 0x7f2de80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2dde000640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2de6a00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f2dd801a630 tx=0x7f2dd80197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80bc020 con 0x7f2de806e3c0 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80b8470 con 0x7f2de806e3c0 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80a58b0 con 0x7f2de806e3c0 2024-04-25T10:15:04.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de81629d0 con 0x7f2de806e3c0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:03.999+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8162f90 con 0x7f2de806e3c0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80745d0 con 0x7f2de806e3c0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2dd80bf020 con 0x7f2de806e3c0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2ddf400640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 0x7f2dc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f2dd8120940 con 0x7f2de806e3c0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2dde000640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 0x7f2dc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:04.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.003+0000 7f2dde000640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 0x7f2dc4069420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2de815d8e0 tx=0x7f2dd0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:04.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.007+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2dd80c6030 con 0x7f2de806e3c0 2024-04-25T10:15:04.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:04.171+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2de80b4580 con 0x7f2de806e3c0 2024-04-25T10:15:05.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.075+0000 7f2ddf400640 1 -- 172.21.15.18:0/2946320942 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2dd8016620 con 0x7f2de806e3c0 2024-04-25T10:15:05.079 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-04-25T10:15:05.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 msgr2=0x7f2dc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 0x7f2dc4069420 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2de815d8e0 tx=0x7f2dd0008040 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 msgr2=0x7f2de815e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f2dd801a630 tx=0x7f2dd80197a0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 shutdown_connections 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2de8144080 0x7f2de80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2dc4066f60 0x7f2dc4069420 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2de8071e40 0x7f2de815e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 --2- 172.21.15.18:0/2946320942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2de806e3c0 0x7f2de815e3b0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 >> 172.21.15.18:0/2946320942 conn(0x7f2de806ac10 msgr2=0x7f2de8160180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 shutdown_connections 2024-04-25T10:15:05.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.079+0000 7f2deda00640 1 -- 172.21.15.18:0/2946320942 wait complete. 2024-04-25T10:15:05.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T10:15:05.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.255+0000 7f1c15800640 1 Processor -- start 2024-04-25T10:15:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.255+0000 7f1c15800640 1 -- start start 2024-04-25T10:15:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c15800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1c1015eda0 0x7f1c10070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c15800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100711f0 con 0x7f1c1006f3f0 2024-04-25T10:15:05.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c15800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100cf320 con 0x7f1c1006ff80 2024-04-25T10:15:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c15800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100714d0 con 0x7f1c1015eda0 2024-04-25T10:15:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c07e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1c1006f3f0 0x7f1c1006f870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50658/0 (socket says 172.21.15.18:50658) 2024-04-25T10:15:05.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c07e00640 1 -- 172.21.15.18:0/1189210743 learned_addr learned my addr 172.21.15.18:0/1189210743 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/1189210743 >> v2:172.21.15.167:3300/0 conn(0x7f1c1015eda0 0x7f1c10070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962081297 0 0) 0x7f1c100711f0 con 0x7f1c1006f3f0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf4003530 con 0x7f1c1006f3f0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1091501748 0 0) 0x7f1bf4003530 con 0x7f1c1006f3f0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 >> v2:172.21.15.167:3300/0 conn(0x7f1c1015eda0 msgr2=0x7f1c10070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 --2- 172.21.15.18:0/1189210743 >> v2:172.21.15.167:3300/0 conn(0x7f1c1015eda0 0x7f1c10070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 >> v1:172.21.15.167:6789/0 conn(0x7f1c1006ff80 legacy=0x7f1c100cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100cf600 con 0x7f1c1006f3f0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f1bf8001680 con 0x7f1c1006f3f0 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 >> v1:172.21.15.18:6789/0 conn(0x7f1c1006f3f0 legacy=0x7f1c1006f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 0x7f1bf4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40043c0 0x7f1bf4004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf4005090 0x7f1bf400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100714d0 con 0x7f1bf40039c0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf400bff0 con 0x7f1bf40043c0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf400c1f0 con 0x7f1bf4005090 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 0x7f1bf4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c07e00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40043c0 0x7f1bf4004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c14e00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf4005090 0x7f1bf400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 -- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf4005090 msgr2=0x7f1bf400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1bf4005090 0x7f1bf400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 -- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40043c0 msgr2=0x7f1bf4004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40043c0 0x7f1bf4004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c0fe00640 1 -- 172.21.15.18:0/1189210743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf4003530 con 0x7f1bf40039c0 2024-04-25T10:15:05.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.259+0000 7f1c14e00640 1 -- 172.21.15.18:0/1189210743 reap_dead start 2024-04-25T10:15:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 0x7f1bf4003da0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009ae0 tx=0x7f1c0001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2110b4d71cd972 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000b2070 con 0x7f1bf40039c0 2024-04-25T10:15:05.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c000a5570 con 0x7f1bf40039c0 2024-04-25T10:15:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c0f400640 1 -- 172.21.15.18:0/1189210743 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c000096b0 con 0x7f1bf40039c0 2024-04-25T10:15:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 msgr2=0x7f1bf4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 0x7f1bf4003da0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009ae0 tx=0x7f1c0001ca90 comp rx=0 tx=0).stop 2024-04-25T10:15:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- 172.21.15.18:0/1189210743 shutdown_connections 2024-04-25T10:15:05.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 --2- 172.21.15.18:0/1189210743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1bf40039c0 0x7f1bf4003da0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- 172.21.15.18:0/1189210743 >> 172.21.15.18:0/1189210743 conn(0x7f1c100d15b0 msgr2=0x7f1c100d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- 172.21.15.18:0/1189210743 shutdown_connections 2024-04-25T10:15:05.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- 172.21.15.18:0/1189210743 wait complete. 2024-04-25T10:15:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 Processor -- start 2024-04-25T10:15:05.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.263+0000 7f1c15800640 1 -- start start 2024-04-25T10:15:05.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40039c0 0x7f1c100c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c10149b60 0x7f1c1006c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10099a60 con 0x7f1c10149700 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1015f180 con 0x7f1bf40039c0 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10099be0 con 0x7f1c10149b60 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50212/0 (socket says 172.21.15.18:50212) 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 -- 172.21.15.18:0/190434388 learned_addr learned my addr 172.21.15.18:0/190434388 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40039c0 0x7f1c100c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c14e00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c10149b60 0x7f1c1006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 -- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c10149b60 msgr2=0x7f1c1006c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c10149b60 0x7f1c1006c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 -- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40039c0 msgr2=0x7f1c100c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40039c0 0x7f1c100c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 -- 172.21.15.18:0/190434388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100c7d70 con 0x7f1c10149700 2024-04-25T10:15:05.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c07e00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8004f30 tx=0x7f1bf80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800f730 con 0x7f1c10149700 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf8018070 con 0x7f1c10149700 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800fb50 con 0x7f1c10149700 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1015af30 con 0x7f1c10149700 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c100c5620 con 0x7f1c10149700 2024-04-25T10:15:05.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.267+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c100745d0 con 0x7f1c10149700 2024-04-25T10:15:05.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.271+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bf801d460 con 0x7f1c10149700 2024-04-25T10:15:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.271+0000 7f1c0cc00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 0x7f1bec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:05.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.271+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5921+0+0 (secure 0 0 0) 0x7f1bf8085140 con 0x7f1c10149700 2024-04-25T10:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.275+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 0x7f1bec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.275+0000 7f1c0fe00640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 0x7f1bec069450 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c000af000 tx=0x7f1c000046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:05.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.279+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bf8055a20 con 0x7f1c10149700 2024-04-25T10:15:05.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:05.443+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c100b7530 con 0x7f1c10149700 2024-04-25T10:15:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.083+0000 7f1c0cc00640 1 -- 172.21.15.18:0/190434388 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1bf8059ac0 con 0x7f1c10149700 2024-04-25T10:15:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-04-25T10:15:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.083+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 msgr2=0x7f1bec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.083+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 0x7f1bec069450 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1c000af000 tx=0x7f1c000046d0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.083+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 msgr2=0x7f1c1006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.083+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8004f30 tx=0x7f1bf80074f0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 shutdown_connections 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1bec066f90 0x7f1bec069450 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1c10149b60 0x7f1c1006c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c10149700 0x7f1c1006bd20 secure :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8004f30 tx=0x7f1bf80074f0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 --2- 172.21.15.18:0/190434388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bf40039c0 0x7f1c100c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 >> 172.21.15.18:0/190434388 conn(0x7f1c100d15b0 msgr2=0x7f1c100b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 shutdown_connections 2024-04-25T10:15:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.087+0000 7f1c15800640 1 -- 172.21.15.18:0/190434388 wait complete. 2024-04-25T10:15:06.115 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T10:15:06.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 Processor -- start 2024-04-25T10:15:06.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 -- start start 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcdc0d0150 0x7efcdc0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0b30d0 con 0x7efcdc0c72a0 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0ccf30 con 0x7efcdc15dc00 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efce0e00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0cd860 con 0x7efcdc0d0150 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcd3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcdc0d0150 0x7efcdc0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcda800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efcdc0c72a0 0x7efcdc0c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50660/0 (socket says 172.21.15.18:50660) 2024-04-25T10:15:06.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcda800640 1 -- 172.21.15.18:0/324542242 learned_addr learned my addr 172.21.15.18:0/324542242 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcd3e00640 1 -- 172.21.15.18:0/324542242 >> v1:172.21.15.167:6789/0 conn(0x7efcdc15dc00 legacy=0x7efcdc0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcd3e00640 1 -- 172.21.15.18:0/324542242 >> v1:172.21.15.18:6789/0 conn(0x7efcdc0c72a0 legacy=0x7efcdc0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcd3e00640 1 -- 172.21.15.18:0/324542242 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0cd210 con 0x7efcdc0d0150 2024-04-25T10:15:06.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.259+0000 7efcd9400640 1 -- 172.21.15.18:0/324542242 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831934808 0 0) 0x7efcdc0b30d0 con 0x7efcdc0c72a0 2024-04-25T10:15:06.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efcd3e00640 1 --2- 172.21.15.18:0/324542242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0af770 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7efcc40097c0 tx=0x7efcc401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a9a79449cccbde server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efcd9400640 1 -- 172.21.15.18:0/324542242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b1070 con 0x7efcdc0d0150 2024-04-25T10:15:06.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efcd9400640 1 -- 172.21.15.18:0/324542242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40ac410 con 0x7efcdc0d0150 2024-04-25T10:15:06.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efcd9400640 1 -- 172.21.15.18:0/324542242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40ac5e0 con 0x7efcdc0d0150 2024-04-25T10:15:06.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 -- 172.21.15.18:0/324542242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 msgr2=0x7efcdc0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 --2- 172.21.15.18:0/324542242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0af770 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7efcc40097c0 tx=0x7efcc401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 -- 172.21.15.18:0/324542242 shutdown_connections 2024-04-25T10:15:06.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 --2- 172.21.15.18:0/324542242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0af770 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 -- 172.21.15.18:0/324542242 >> 172.21.15.18:0/324542242 conn(0x7efcdc0b2240 msgr2=0x7efcdc0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:06.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 -- 172.21.15.18:0/324542242 shutdown_connections 2024-04-25T10:15:06.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.263+0000 7efce0e00640 1 -- 172.21.15.18:0/324542242 wait complete. 2024-04-25T10:15:06.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 Processor -- start 2024-04-25T10:15:06.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- start start 2024-04-25T10:15:06.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcdc0c72a0 0x7efcdc152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc15dc00 0x7efcdc0b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc16b7d0 con 0x7efcdc0d0150 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc16b650 con 0x7efcdc15dc00 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc16b950 con 0x7efcdc0c72a0 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50226/0 (socket says 172.21.15.18:50226) 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 -- 172.21.15.18:0/1238460535 learned_addr learned my addr 172.21.15.18:0/1238460535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcda800640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc15dc00 0x7efcdc0b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd9e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcdc0c72a0 0x7efcdc152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 -- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcdc0c72a0 msgr2=0x7efcdc152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcdc0c72a0 0x7efcdc152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 -- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc15dc00 msgr2=0x7efcdc0b5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc15dc00 0x7efcdc0b5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 -- 172.21.15.18:0/1238460535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0b3f20 con 0x7efcdc0d0150 2024-04-25T10:15:06.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd3e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7efcc40190b0 tx=0x7efcc4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b9070 con 0x7efcdc0d0150 2024-04-25T10:15:06.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40ace40 con 0x7efcdc0d0150 2024-04-25T10:15:06.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40b1040 con 0x7efcdc0d0150 2024-04-25T10:15:06.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc0b4200 con 0x7efcdc0d0150 2024-04-25T10:15:06.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.267+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc0b47c0 con 0x7efcdc0d0150 2024-04-25T10:15:06.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc06ccb0 con 0x7efcdc0d0150 2024-04-25T10:15:06.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efcc40bc070 con 0x7efcdc0d0150 2024-04-25T10:15:06.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efcd2000640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7efcc411ea10 con 0x7efcdc0d0150 2024-04-25T10:15:06.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efcd9e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.271+0000 7efcd9e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f70 tx=0x7efccc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.275+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efcc4016090 con 0x7efcdc0d0150 2024-04-25T10:15:06.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.443+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7efcdc0745d0 con 0x7efcdc0d0150 2024-04-25T10:15:06.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.447+0000 7efcd2000640 1 -- 172.21.15.18:0/1238460535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7efcc40efb70 con 0x7efcdc0d0150 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 msgr2=0x7efcb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f70 tx=0x7efccc009040 comp rx=0 tx=0).stop 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 msgr2=0x7efcdc0b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7efcc40190b0 tx=0x7efcc4019240 comp rx=0 tx=0).stop 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 shutdown_connections 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efcdc15dc00 0x7efcdc0b5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcdc0d0150 0x7efcdc0b5910 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcb8066f60 0x7efcb8069420 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 --2- 172.21.15.18:0/1238460535 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efcdc0c72a0 0x7efcdc152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 >> 172.21.15.18:0/1238460535 conn(0x7efcdc0b2240 msgr2=0x7efcdc0ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 shutdown_connections 2024-04-25T10:15:06.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.451+0000 7efce0e00640 1 -- 172.21.15.18:0/1238460535 wait complete. 2024-04-25T10:15:06.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T10:15:06.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 Processor -- start 2024-04-25T10:15:06.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 -- start start 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f387c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0cd6c0 con 0x7f387c15efa0 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387c0cce20 con 0x7f387c0cdb70 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3880e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0b3fe0 con 0x7f387c09a170 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387b400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f387c15efa0 0x7f387c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50670/0 (socket says 172.21.15.18:50670) 2024-04-25T10:15:06.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387b400640 1 -- 172.21.15.18:0/3024559457 learned_addr learned my addr 172.21.15.18:0/3024559457 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f3873e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f387c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287737635 0 0) 0x7f387c0cd6c0 con 0x7f387c15efa0 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3860003530 con 0x7f387c15efa0 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3649137649 0 0) 0x7f3860003530 con 0x7f387c15efa0 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 msgr2=0x7f387c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f387c0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 >> v1:172.21.15.167:6789/0 conn(0x7f387c0cdb70 legacy=0x7f387c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0cd100 con 0x7f387c15efa0 2024-04-25T10:15:06.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f386c001680 con 0x7f387c15efa0 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.611+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 >> v1:172.21.15.18:6789/0 conn(0x7f387c15efa0 legacy=0x7f387c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38600039f0 0x7f3860003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f3860004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f38600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0b3fe0 con 0x7f3860004810 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386000ba80 con 0x7f38600039f0 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386000bc80 con 0x7f387c09a170 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f3860004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387b400640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38600039f0 0x7f3860003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387be00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f38600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 -- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 msgr2=0x7f38600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f38600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 -- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38600039f0 msgr2=0x7f3860003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38600039f0 0x7f3860003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 -- 172.21.15.18:0/3024559457 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3860003530 con 0x7f3860004810 2024-04-25T10:15:06.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387be00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c09a170 0x7f38600051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:06.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f3873e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f3860004c90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3864009ab0 tx=0x7f386401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a018417eb0a2beb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640b2070 con 0x7f3860004810 2024-04-25T10:15:06.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38640a5510 con 0x7f3860004810 2024-04-25T10:15:06.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.615+0000 7f387aa00640 1 -- 172.21.15.18:0/3024559457 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38640096b0 con 0x7f3860004810 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- 172.21.15.18:0/3024559457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 msgr2=0x7f3860004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 --2- 172.21.15.18:0/3024559457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f3860004c90 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f3864009ab0 tx=0x7f386401ca30 comp rx=0 tx=0).stop 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387be00640 1 -- 172.21.15.18:0/3024559457 reap_dead start 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- 172.21.15.18:0/3024559457 shutdown_connections 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- 172.21.15.18:0/3024559457 >> 172.21.15.18:0/3024559457 conn(0x7f387c0b3050 msgr2=0x7f387c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- 172.21.15.18:0/3024559457 shutdown_connections 2024-04-25T10:15:06.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- 172.21.15.18:0/3024559457 wait complete. 2024-04-25T10:15:06.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 Processor -- start 2024-04-25T10:15:06.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- start start 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c1592a0 0x7f387c070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c158030 0x7f387c070940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0b3b70 con 0x7f3860004810 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c15f380 con 0x7f387c158030 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3880e00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0b3cf0 con 0x7f387c1592a0 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50248/0 (socket says 172.21.15.18:50248) 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 -- 172.21.15.18:0/3635391750 learned_addr learned my addr 172.21.15.18:0/3635391750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f3873e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c1592a0 0x7f387c070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387be00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c158030 0x7f387c070940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 -- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c1592a0 msgr2=0x7f387c070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c1592a0 0x7f387c070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 -- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c158030 msgr2=0x7f387c070940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:06.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.619+0000 7f387b400640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c158030 0x7f387c070940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:06.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f387b400640 1 -- 172.21.15.18:0/3635391750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c15a8b0 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f387b400640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f386c012470 tx=0x7f386c012930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c014810 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386c01b070 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c0c5db0 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c014c10 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c159af0 con 0x7f3860004810 2024-04-25T10:15:06.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c04efa0 con 0x7f3860004810 2024-04-25T10:15:06.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f386c016480 con 0x7f3860004810 2024-04-25T10:15:06.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 0x7f3858069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:06.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f386c088340 con 0x7f3860004810 2024-04-25T10:15:06.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.623+0000 7f3873e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 0x7f3858069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:06.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.627+0000 7f3873e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 0x7f3858069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f38640af000 tx=0x7f38640046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:06.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.627+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f386c059400 con 0x7f3860004810 2024-04-25T10:15:06.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:06.847+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f387c15c330 con 0x7f3860004810 2024-04-25T10:15:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.083+0000 7f3873400640 1 -- 172.21.15.18:0/3635391750 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v532) v1 ==== 144+0+0 (secure 0 0 0) 0x7f386c058d00 con 0x7f3860004810 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 msgr2=0x7f3858069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 0x7f3858069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f38640af000 tx=0x7f38640046d0 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 msgr2=0x7f387c0c53c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f386c012470 tx=0x7f386c012930 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 shutdown_connections 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f387c158030 0x7f387c070940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f3858066f60 0x7f3858069420 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f387c1592a0 0x7f387c070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 --2- 172.21.15.18:0/3635391750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3860004810 0x7f387c0c53c0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 >> 172.21.15.18:0/3635391750 conn(0x7f387c0b3050 msgr2=0x7f387c15d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 shutdown_connections 2024-04-25T10:15:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:07.087+0000 7f3880e00640 1 -- 172.21.15.18:0/3635391750 wait complete. 2024-04-25T10:15:07.111 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T10:15:07.111 INFO:tasks.cephfs_test_runner: 2024-04-25T10:15:07.111 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T10:15:07.111 INFO:tasks.cephfs_test_runner:Ran 7 tests in 625.141s 2024-04-25T10:15:07.111 INFO:tasks.cephfs_test_runner: 2024-04-25T10:15:07.112 INFO:tasks.cephfs_test_runner:OK 2024-04-25T10:15:07.112 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T10:15:07.121 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T10:15:07.239 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T10:15:07.239 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:15:07.239 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:15:07.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:15:07.248 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-04-25T10:15:07.248 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:15:07.296 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9413 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T10:15:07.297 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:15:07.297 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:15:07.306 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:15:07.307 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-04-25T10:15:07.307 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T10:15:07.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350308k,nr_inodes=4087577,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7565 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274992k,nr_inodes=818748,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274992k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T10:15:07.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.358 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:15:07.368 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T10:15:07.368 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T10:15:07.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.368 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T10:15:07.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T10:15:07.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-25T10:15:07.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.656 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-04-25T10:15:07.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.665 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-04-25T10:15:07.735 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-04-25T10:15:07.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:15:07.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.737 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:15:07.746 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T10:15:07.747 INFO:teuthology.orchestra.run.smithi167.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T10:15:07.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.748 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T10:15:07.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T10:15:07.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:07.877 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T10:15:08.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:08.019 DEBUG:teuthology.orchestra.run.smithi167:> ip netns list 2024-04-25T10:15:08.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T10:15:08.028 DEBUG:teuthology.orchestra.run.smithi167:> sudo ip link delete ceph-brx 2024-04-25T10:15:08.095 INFO:teuthology.orchestra.run.smithi167.stderr:Cannot find device "ceph-brx" 2024-04-25T10:15:08.097 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:15:08.098 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T10:15:08.107 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T10:15:08.107 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:15:08.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 Processor -- start 2024-04-25T10:15:08.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 -- start start 2024-04-25T10:15:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8015def0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8015e1b0 con 0x7f1d800b3950 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d86600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8015e490 con 0x7f1d800b2dc0 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1d8015b2f0 0x7f1d800b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50672/0 (socket says 172.21.15.18:50672) 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7f400640 1 -- 172.21.15.18:0/4092308487 learned_addr learned my addr 172.21.15.18:0/4092308487 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7ea00640 1 --2- 172.21.15.18:0/4092308487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676232704 0 0) 0x7f1d8015def0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d64003530 con 0x7f1d8015b2f0 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861865029 0 0) 0x7f1d8015e1b0 con 0x7f1d800b3950 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7ea00640 1 -- 172.21.15.18:0/4092308487 >> v1:172.21.15.167:6789/0 conn(0x7f1d800b3950 legacy=0x7f1d8006b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7ea00640 1 -- 172.21.15.18:0/4092308487 >> v1:172.21.15.18:6789/0 conn(0x7f1d8015b2f0 legacy=0x7f1d800b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.247+0000 7f1d7ea00640 1 -- 172.21.15.18:0/4092308487 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8015e770 con 0x7f1d800b2dc0 2024-04-25T10:15:08.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d7ea00640 1 --2- 172.21.15.18:0/4092308487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8006ac10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009820 tx=0x7f1d8006c070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab682d1ddb50cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8015b8e0 con 0x7f1d800b2dc0 2024-04-25T10:15:08.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c0af070 con 0x7f1d800b2dc0 2024-04-25T10:15:08.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d7e000640 1 -- 172.21.15.18:0/4092308487 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c0aa810 con 0x7f1d800b2dc0 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 -- 172.21.15.18:0/4092308487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 msgr2=0x7f1d8006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 --2- 172.21.15.18:0/4092308487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8006ac10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009820 tx=0x7f1d8006c070 comp rx=0 tx=0).stop 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 -- 172.21.15.18:0/4092308487 shutdown_connections 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 --2- 172.21.15.18:0/4092308487 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8006ac10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 -- 172.21.15.18:0/4092308487 >> 172.21.15.18:0/4092308487 conn(0x7f1d800b23b0 msgr2=0x7f1d800cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 -- 172.21.15.18:0/4092308487 shutdown_connections 2024-04-25T10:15:08.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.251+0000 7f1d86600640 1 -- 172.21.15.18:0/4092308487 wait complete. 2024-04-25T10:15:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 Processor -- start 2024-04-25T10:15:08.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- start start 2024-04-25T10:15:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 0x7f1d8014bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8016b890 con 0x7f1d8015b2f0 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d801616f0 con 0x7f1d800b3950 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8016ba10 con 0x7f1d800b2dc0 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50260/0 (socket says 172.21.15.18:50260) 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 -- 172.21.15.18:0/1133857101 learned_addr learned my addr 172.21.15.18:0/1133857101 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7f400640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7ea00640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 0x7f1d8014bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 -- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 msgr2=0x7f1d8015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8015d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 -- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 msgr2=0x7f1d8014bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 0x7f1d8014bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 -- 172.21.15.18:0/1133857101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800cc490 con 0x7f1d8015b2f0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7ea00640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 0x7f1d8014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d7fe00640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c710 tx=0x7f1d7800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78003db0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800ce20 con 0x7f1d8015b2f0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780052b0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8015d820 con 0x7f1d8015b2f0 2024-04-25T10:15:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.255+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8015bdd0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8015b8e0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d78005450 con 0x7f1d8015b2f0 2024-04-25T10:15:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d77400640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 0x7f1d60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f1d78084dc0 con 0x7f1d8015b2f0 2024-04-25T10:15:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d7f400640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 0x7f1d60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.259+0000 7f1d7f400640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 0x7f1d60069420 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1d70007fd0 tx=0x7f1d70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.263+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d78055e90 con 0x7f1d8015b2f0 2024-04-25T10:15:08.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.423+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d800745d0 con 0x7f1d60066f60 2024-04-25T10:15:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.423+0000 7f1d77400640 1 -- 172.21.15.18:0/1133857101 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13492 (secure 0 0 0) 0x7f1d800745d0 con 0x7f1d60066f60 2024-04-25T10:15:08.429 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:08.429 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:15:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 msgr2=0x7f1d60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 0x7f1d60069420 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1d70007fd0 tx=0x7f1d70009040 comp rx=0 tx=0).stop 2024-04-25T10:15:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 msgr2=0x7f1d800cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c710 tx=0x7f1d7800cbd0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 shutdown_connections 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d8015b2f0 0x7f1d800cbf50 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d800b3950 0x7f1d8014bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d60066f60 0x7f1d60069420 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 --2- 172.21.15.18:0/1133857101 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d800b2dc0 0x7f1d8015d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 >> 172.21.15.18:0/1133857101 conn(0x7f1d800b23b0 msgr2=0x7f1d801619c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 shutdown_connections 2024-04-25T10:15:08.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.427+0000 7f1d86600640 1 -- 172.21.15.18:0/1133857101 wait complete. 2024-04-25T10:15:08.450 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-04-25T10:15:07.571277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":275208,"kb_used_data":25768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754699512,"statfs":{"total":773094113280,"available":772812300288,"internally_reserved":0,"allocated":26386432,"data_stored":19661658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001585"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":367,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-04-25T10:15:02.951894+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:15:02.951894+0000","last_peered":"2024-04-25T10:15:02.951894+0000","last_clean":"2024-04-25T10:15:02.951894+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:15:02.951894+0000","last_undegraded":"2024-04-25T10:15:02.951894+0000","last_fullsized":"2024-04-25T10:15:02.951894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509580,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6352896,"data_stored":5512361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509581,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":9728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":9961472,"data_stored":9122760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1556480,"data_stored":727073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":736333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1581056,"data_stored":740130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542283,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542283,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2170880,"data_stored":1330493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:15:08.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:15:08.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 Processor -- start 2024-04-25T10:15:08.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 -- start start 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 0x7fcbd00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 0x7fcbd00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd015ac60 con 0x7fcbd00ced60 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd00cf3e0 con 0x7fcbd006ead0 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.587+0000 7fcbd8800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015af20 con 0x7fcbd0144140 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcbd00ced60 0x7fcbd006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50676/0 (socket says 172.21.15.18:50676) 2024-04-25T10:15:08.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5400640 1 -- 172.21.15.18:0/283440928 learned_addr learned my addr 172.21.15.18:0/283440928 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/283440928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 0x7fcbd00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd6800640 1 --2- 172.21.15.18:0/283440928 >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 0x7fcbd00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 -- 172.21.15.18:0/283440928 >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 msgr2=0x7fcbd00b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:08.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/283440928 >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 0x7fcbd00b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 -- 172.21.15.18:0/283440928 >> v1:172.21.15.18:6789/0 conn(0x7fcbd00ced60 legacy=0x7fcbd006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd4a00640 1 -- 172.21.15.18:0/283440928 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206880360 0 0) 0x7fcbd015ac60 con 0x7fcbd00ced60 2024-04-25T10:15:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 -- 172.21.15.18:0/283440928 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd015b200 con 0x7fcbd0144140 2024-04-25T10:15:08.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd6800640 1 --2- 172.21.15.18:0/283440928 >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 0x7fcbd00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.591+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/283440928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 0x7fcbd00ce820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40097c0 tx=0x7fcbc401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a0041d9e5c655cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd4a00640 1 -- 172.21.15.18:0/283440928 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40b1070 con 0x7fcbd0144140 2024-04-25T10:15:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd4a00640 1 -- 172.21.15.18:0/283440928 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc40ac440 con 0x7fcbd0144140 2024-04-25T10:15:08.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd4a00640 1 -- 172.21.15.18:0/283440928 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc40ac810 con 0x7fcbd0144140 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- 172.21.15.18:0/283440928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 msgr2=0x7fcbd00ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- 172.21.15.18:0/283440928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 0x7fcbd00ce820 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40097c0 tx=0x7fcbc401c4a0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- 172.21.15.18:0/283440928 shutdown_connections 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- 172.21.15.18:0/283440928 >> v2:172.21.15.18:3300/0 conn(0x7fcbd006ead0 0x7fcbd00b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- 172.21.15.18:0/283440928 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd0144140 0x7fcbd00ce820 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- 172.21.15.18:0/283440928 >> 172.21.15.18:0/283440928 conn(0x7fcbd0066fa0 msgr2=0x7fcbd006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- 172.21.15.18:0/283440928 shutdown_connections 2024-04-25T10:15:08.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- 172.21.15.18:0/283440928 wait complete. 2024-04-25T10:15:08.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 Processor -- start 2024-04-25T10:15:08.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- start start 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd006ead0 0x7fcbd00cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00ced60 0x7fcbd0159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015bb80 con 0x7fcbd0144140 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd015ba00 con 0x7fcbd006ead0 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd8800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd006d2b0 con 0x7fcbd00ced60 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd6800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50284/0 (socket says 172.21.15.18:50284) 2024-04-25T10:15:08.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd6800640 1 -- 172.21.15.18:0/362164526 learned_addr learned my addr 172.21.15.18:0/362164526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd006ead0 0x7fcbd00cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.595+0000 7fcbd5400640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00ced60 0x7fcbd0159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 -- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00ced60 msgr2=0x7fcbd0159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00ced60 0x7fcbd0159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 -- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd006ead0 msgr2=0x7fcbd00cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd006ead0 0x7fcbd00cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 -- 172.21.15.18:0/362164526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd013b390 con 0x7fcbd0144140 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd6800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00efc0 tx=0x7fcbcc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc018020 con 0x7fcbd0144140 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc014480 con 0x7fcbd0144140 2024-04-25T10:15:08.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc014850 con 0x7fcbd0144140 2024-04-25T10:15:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd013b670 con 0x7fcbd0144140 2024-04-25T10:15:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd013bc30 con 0x7fcbd0144140 2024-04-25T10:15:08.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd00745d0 con 0x7fcbd0144140 2024-04-25T10:15:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcbcc01b020 con 0x7fcbd0144140 2024-04-25T10:15:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 0x7fcbb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.599+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fcbcc085af0 con 0x7fcbd0144140 2024-04-25T10:15:08.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.603+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 0x7fcbb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.603+0000 7fcbd5e00640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 0x7fcbb4069420 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40ae000 tx=0x7fcbc40a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.603+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcbcc022030 con 0x7fcbd0144140 2024-04-25T10:15:08.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.763+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbd0073d00 con 0x7fcbb4066f60 2024-04-25T10:15:08.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbca000640 1 -- 172.21.15.18:0/362164526 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13492 (secure 0 0 0) 0x7fcbd0073d00 con 0x7fcbb4066f60 2024-04-25T10:15:08.770 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:08.770 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:15:08.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 msgr2=0x7fcbb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 0x7fcbb4069420 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40ae000 tx=0x7fcbc40a6070 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 msgr2=0x7fcbd01637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00efc0 tx=0x7fcbcc00c490 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 shutdown_connections 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbd0144140 0x7fcbd01637c0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fcbb4066f60 0x7fcbb4069420 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fcbd00ced60 0x7fcbd0159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 --2- 172.21.15.18:0/362164526 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbd006ead0 0x7fcbd00cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 >> 172.21.15.18:0/362164526 conn(0x7fcbd0066fa0 msgr2=0x7fcbd015d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 shutdown_connections 2024-04-25T10:15:08.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.767+0000 7fcbd8800640 1 -- 172.21.15.18:0/362164526 wait complete. 2024-04-25T10:15:08.791 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-04-25T10:15:07.571277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":275208,"kb_used_data":25768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754699512,"statfs":{"total":773094113280,"available":772812300288,"internally_reserved":0,"allocated":26386432,"data_stored":19661658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001585"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":367,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-04-25T10:15:02.951894+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:15:02.951894+0000","last_peered":"2024-04-25T10:15:02.951894+0000","last_clean":"2024-04-25T10:15:02.951894+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:15:02.951894+0000","last_undegraded":"2024-04-25T10:15:02.951894+0000","last_fullsized":"2024-04-25T10:15:02.951894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509580,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6352896,"data_stored":5512361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509581,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":9728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":9961472,"data_stored":9122760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1556480,"data_stored":727073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":736333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1581056,"data_stored":740130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542283,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542283,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2170880,"data_stored":1330493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:15:08.792 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T10:15:08.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:15:08.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 Processor -- start 2024-04-25T10:15:08.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 -- start start 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faba415b5a0 0x7faba40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faba40cc440 0x7faba40d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40ce7f0 con 0x7faba415b980 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40cfcd0 con 0x7faba40cc440 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7fabaa200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40cead0 con 0x7faba415b5a0 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faba40cc440 0x7faba40d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faba40cc440 0x7faba40d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50296/0 (socket says 172.21.15.18:50296) 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 -- 172.21.15.18:0/2158278781 learned_addr learned my addr 172.21.15.18:0/2158278781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:08.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3400640 1 --2- 172.21.15.18:0/2158278781 >> v2:172.21.15.167:3300/0 conn(0x7faba415b5a0 0x7faba40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 -- 172.21.15.18:0/2158278781 >> v2:172.21.15.167:3300/0 conn(0x7faba415b5a0 msgr2=0x7faba40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 --2- 172.21.15.18:0/2158278781 >> v2:172.21.15.167:3300/0 conn(0x7faba415b5a0 0x7faba40cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 -- 172.21.15.18:0/2158278781 >> v1:172.21.15.167:6789/0 conn(0x7faba415b980 legacy=0x7faba40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.931+0000 7faba3e00640 1 -- 172.21.15.18:0/2158278781 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40cf960 con 0x7faba40cc440 2024-04-25T10:15:08.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7faba3e00640 1 --2- 172.21.15.18:0/2158278781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40d0160 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7faba4072e00 tx=0x7fab9c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8bf85fee8f10368 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7faba2a00640 1 -- 172.21.15.18:0/2158278781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a58e0 con 0x7faba40cc440 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7faba2a00640 1 -- 172.21.15.18:0/2158278781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0a5a80 con 0x7faba40cc440 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7faba2a00640 1 -- 172.21.15.18:0/2158278781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a5e50 con 0x7faba40cc440 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- 172.21.15.18:0/2158278781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 msgr2=0x7faba40d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 --2- 172.21.15.18:0/2158278781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40d0160 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7faba4072e00 tx=0x7fab9c01c9f0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- 172.21.15.18:0/2158278781 shutdown_connections 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 --2- 172.21.15.18:0/2158278781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40d0160 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 --2- 172.21.15.18:0/2158278781 >> v2:172.21.15.167:3300/0 conn(0x7faba415b5a0 0x7faba40cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- 172.21.15.18:0/2158278781 >> 172.21.15.18:0/2158278781 conn(0x7faba40b3390 msgr2=0x7faba40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- 172.21.15.18:0/2158278781 shutdown_connections 2024-04-25T10:15:08.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- 172.21.15.18:0/2158278781 wait complete. 2024-04-25T10:15:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 Processor -- start 2024-04-25T10:15:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.935+0000 7fabaa200640 1 -- start start 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 0x7faba406d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faba415b980 0x7faba40b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40d1280 con 0x7faba40cc440 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40d1100 con 0x7faba415b980 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba40d1400 con 0x7faba415b5a0 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50304/0 (socket says 172.21.15.18:50304) 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 -- 172.21.15.18:0/258497911 learned_addr learned my addr 172.21.15.18:0/258497911 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:08.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3e00640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faba415b980 0x7faba40b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9be00640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 0x7faba406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 -- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 msgr2=0x7faba406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 0x7faba406d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 -- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faba415b980 msgr2=0x7faba40b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faba415b980 0x7faba40b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 -- 172.21.15.18:0/258497911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40b57b0 con 0x7faba40cc440 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9be00640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 0x7faba406d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7faba3400640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fab9400d5f0 tx=0x7fab9400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940125f0 con 0x7faba40cc440 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab94019070 con 0x7faba40cc440 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940129b0 con 0x7faba40cc440 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba40b5a90 con 0x7faba40cc440 2024-04-25T10:15:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40b6050 con 0x7faba40cc440 2024-04-25T10:15:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba40745d0 con 0x7faba40cc440 2024-04-25T10:15:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.939+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab94012b50 con 0x7faba40cc440 2024-04-25T10:15:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.943+0000 7fab9b400640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 0x7fab80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.943+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fab94085330 con 0x7faba40cc440 2024-04-25T10:15:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.943+0000 7fab9be00640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 0x7fab80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:08.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.943+0000 7fab9be00640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 0x7fab80069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faba4155650 tx=0x7fab8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:08.947+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab94056360 con 0x7faba40cc440 2024-04-25T10:15:09.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.107+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faba40cc960 con 0x7fab80066f60 2024-04-25T10:15:09.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.107+0000 7fab9b400640 1 -- 172.21.15.18:0/258497911 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13492 (secure 0 0 0) 0x7faba40cc960 con 0x7fab80066f60 2024-04-25T10:15:09.112 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:09.112 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:15:09.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 msgr2=0x7fab80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 0x7fab80069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7faba4155650 tx=0x7fab8c009040 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 msgr2=0x7faba40b6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fab9400d5f0 tx=0x7fab9400dab0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 shutdown_connections 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faba415b980 0x7faba40b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fab80066f60 0x7fab80069420 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faba415b5a0 0x7faba406d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 --2- 172.21.15.18:0/258497911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40cc440 0x7faba40b6850 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 >> 172.21.15.18:0/258497911 conn(0x7faba40b3390 msgr2=0x7faba40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 shutdown_connections 2024-04-25T10:15:09.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.111+0000 7fabaa200640 1 -- 172.21.15.18:0/258497911 wait complete. 2024-04-25T10:15:09.133 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":464,"stamp":"2024-04-25T10:15:07.571277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":275208,"kb_used_data":25768,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754699512,"statfs":{"total":773094113280,"available":772812300288,"internally_reserved":0,"allocated":26386432,"data_stored":19661658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390401,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-171,"num_write_kb":-8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001585"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":367,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-04-25T10:15:02.951894+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:15:02.951894+0000","last_peered":"2024-04-25T10:15:02.951894+0000","last_clean":"2024-04-25T10:15:02.951894+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:15:02.951894+0000","last_undegraded":"2024-04-25T10:15:02.951894+0000","last_fullsized":"2024-04-25T10:15:02.951894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509580,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6352896,"data_stored":5512361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509581,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40908,"kb_used_data":9728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330932,"statfs":{"total":96636764160,"available":96594874368,"internally_reserved":0,"allocated":9961472,"data_stored":9122760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509579,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32700,"kb_used_data":1520,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339140,"statfs":{"total":96636764160,"available":96603279360,"internally_reserved":0,"allocated":1556480,"data_stored":727073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509578,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":736333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542285,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1581056,"data_stored":740130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542283,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542285,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542283,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2170880,"data_stored":1330493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:15:09.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T10:15:09.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 Processor -- start 2024-04-25T10:15:09.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 -- start start 2024-04-25T10:15:09.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fa13009a170 0x7fa1300b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1300cdb70 0x7fa1300b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300cd6c0 con 0x7fa13015efa0 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300b3fe0 con 0x7fa1300cdb70 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12fe00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1300cce20 con 0x7fa13009a170 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1300cdb70 0x7fa1300b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1300cdb70 0x7fa1300b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50310/0 (socket says 172.21.15.18:50310) 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 -- 172.21.15.18:0/1280792503 learned_addr learned my addr 172.21.15.18:0/1280792503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa126000640 1 --2- 172.21.15.18:0/1280792503 >> v2:172.21.15.167:3300/0 conn(0x7fa13009a170 0x7fa1300b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 -- 172.21.15.18:0/1280792503 >> v2:172.21.15.167:3300/0 conn(0x7fa13009a170 msgr2=0x7fa1300b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 --2- 172.21.15.18:0/1280792503 >> v2:172.21.15.167:3300/0 conn(0x7fa13009a170 0x7fa1300b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 -- 172.21.15.18:0/1280792503 >> v1:172.21.15.167:6789/0 conn(0x7fa13015efa0 legacy=0x7fa130099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:09.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.271+0000 7fa12f400640 1 -- 172.21.15.18:0/1280792503 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300cd100 con 0x7fa1300cdb70 2024-04-25T10:15:09.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12f400640 1 --2- 172.21.15.18:0/1280792503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1300cdb70 0x7fa1300b16e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa1300728d0 tx=0x7fa12801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a18803574e2ff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12e000640 1 -- 172.21.15.18:0/1280792503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280b0070 con 0x7fa1300cdb70 2024-04-25T10:15:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12e000640 1 -- 172.21.15.18:0/1280792503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280ab600 con 0x7fa1300cdb70 2024-04-25T10:15:09.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12e000640 1 -- 172.21.15.18:0/1280792503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280ab9d0 con 0x7fa1300cdb70 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 -- 172.21.15.18:0/1280792503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1300cdb70 msgr2=0x7fa1300b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 --2- 172.21.15.18:0/1280792503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1300cdb70 0x7fa1300b16e0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa1300728d0 tx=0x7fa12801c4e0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 -- 172.21.15.18:0/1280792503 shutdown_connections 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 --2- 172.21.15.18:0/1280792503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1300cdb70 0x7fa1300b16e0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 --2- 172.21.15.18:0/1280792503 >> v2:172.21.15.167:3300/0 conn(0x7fa13009a170 0x7fa1300b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 -- 172.21.15.18:0/1280792503 >> 172.21.15.18:0/1280792503 conn(0x7fa1300b3050 msgr2=0x7fa1300b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 -- 172.21.15.18:0/1280792503 shutdown_connections 2024-04-25T10:15:09.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.275+0000 7fa12fe00640 1 -- 172.21.15.18:0/1280792503 wait complete. 2024-04-25T10:15:09.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 Processor -- start 2024-04-25T10:15:09.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- start start 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1300cdb70 0x7fa130156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa13015efa0 0x7fa1300c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301686a0 con 0x7fa13009a170 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1300b3d80 con 0x7fa13015efa0 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa130168820 con 0x7fa1300cdb70 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50314/0 (socket says 172.21.15.18:50314) 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 -- 172.21.15.18:0/726375266 learned_addr learned my addr 172.21.15.18:0/726375266 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa126000640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1300cdb70 0x7fa130156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12f400640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa13015efa0 0x7fa1300c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 -- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1300cdb70 msgr2=0x7fa130156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1300cdb70 0x7fa130156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 -- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa13015efa0 msgr2=0x7fa1300c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa13015efa0 0x7fa1300c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 -- 172.21.15.18:0/726375266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13006d9b0 con 0x7fa13009a170 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12ea00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c7c0 tx=0x7fa12000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120016020 con 0x7fa13009a170 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12000aa50 con 0x7fa13009a170 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa120012420 con 0x7fa13009a170 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13006dc90 con 0x7fa13009a170 2024-04-25T10:15:09.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.279+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13006c0a0 con 0x7fa13009a170 2024-04-25T10:15:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13004efa0 con 0x7fa13009a170 2024-04-25T10:15:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa120019020 con 0x7fa13009a170 2024-04-25T10:15:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa127e00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 0x7fa10c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fa120085060 con 0x7fa13009a170 2024-04-25T10:15:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa126000640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 0x7fa10c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:09.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.283+0000 7fa126000640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 0x7fa10c069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa1301faf80 tx=0x7fa118008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:09.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.287+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa120020030 con 0x7fa13009a170 2024-04-25T10:15:09.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1300cb920 con 0x7fa13009a170 2024-04-25T10:15:09.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa127e00640 1 -- 172.21.15.18:0/726375266 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+13543 (secure 0 0 0) 0x7fa120056110 con 0x7fa13009a170 2024-04-25T10:15:09.454 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:09.454 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":128,"fsid":"a742dcf2-a420-4fc2-9137-18bf23968324","created":"2024-04-25T10:03:30.294317+0000","modified":"2024-04-25T10:15:06.078112+0000","last_up_change":"2024-04-25T10:03:42.678398+0000","last_in_change":"2024-04-25T10:03:33.647166+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T10:03:43.469039+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ded92fa6-89b5-4a0f-94b2-eedcc08d53b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6801","nonce":3884042883}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6803","nonce":3884042883}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6807","nonce":3884042883}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3884042883},{"type":"v1","addr":"172.21.15.18:6805","nonce":3884042883}]},"public_addr":"172.21.15.18:6801/3884042883","cluster_addr":"172.21.15.18:6803/3884042883","heartbeat_back_addr":"172.21.15.18:6807/3884042883","heartbeat_front_addr":"172.21.15.18:6805/3884042883","state":["exists","up"]},{"osd":1,"uuid":"37d53a35-01bd-4f95-97e5-6b0a283a06bf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6809","nonce":600232426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6811","nonce":600232426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6815","nonce":600232426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":600232426},{"type":"v1","addr":"172.21.15.18:6813","nonce":600232426}]},"public_addr":"172.21.15.18:6809/600232426","cluster_addr":"172.21.15.18:6811/600232426","heartbeat_back_addr":"172.21.15.18:6815/600232426","heartbeat_front_addr":"172.21.15.18:6813/600232426","state":["exists","up"]},{"osd":2,"uuid":"9a0cfc21-b322-437e-8aa8-7fbb11f154fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6818","nonce":2456241268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6819","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6821","nonce":2456241268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6828","nonce":2456241268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6823","nonce":2456241268},{"type":"v1","addr":"172.21.15.18:6824","nonce":2456241268}]},"public_addr":"172.21.15.18:6818/2456241268","cluster_addr":"172.21.15.18:6821/2456241268","heartbeat_back_addr":"172.21.15.18:6828/2456241268","heartbeat_front_addr":"172.21.15.18:6824/2456241268","state":["exists","up"]},{"osd":3,"uuid":"e415b1d8-f47a-475d-a5bc-11d1e79ea186","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6817","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6820","nonce":3876934381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6825","nonce":3876934381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6831","nonce":3876934381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6827","nonce":3876934381},{"type":"v1","addr":"172.21.15.18:6829","nonce":3876934381}]},"public_addr":"172.21.15.18:6820/3876934381","cluster_addr":"172.21.15.18:6825/3876934381","heartbeat_back_addr":"172.21.15.18:6831/3876934381","heartbeat_front_addr":"172.21.15.18:6829/3876934381","state":["exists","up"]},{"osd":4,"uuid":"32851e3b-94b6-44ba-9111-dec866d36827","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6801","nonce":3323785626}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6803","nonce":3323785626}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6807","nonce":3323785626}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":3323785626},{"type":"v1","addr":"172.21.15.167:6805","nonce":3323785626}]},"public_addr":"172.21.15.167:6801/3323785626","cluster_addr":"172.21.15.167:6803/3323785626","heartbeat_back_addr":"172.21.15.167:6807/3323785626","heartbeat_front_addr":"172.21.15.167:6805/3323785626","state":["exists","up"]},{"osd":5,"uuid":"c36ec405-aedc-4bce-b127-bea820d45e0c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6825","nonce":2931035891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6827","nonce":2931035891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6831","nonce":2931035891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":2931035891},{"type":"v1","addr":"172.21.15.167:6829","nonce":2931035891}]},"public_addr":"172.21.15.167:6825/2931035891","cluster_addr":"172.21.15.167:6827/2931035891","heartbeat_back_addr":"172.21.15.167:6831/2931035891","heartbeat_front_addr":"172.21.15.167:6829/2931035891","state":["exists","up"]},{"osd":6,"uuid":"ac562c5c-eae4-4f83-b74d-95012a53dac5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6810","nonce":3449298510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6814","nonce":3449298510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6822","nonce":3449298510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3449298510},{"type":"v1","addr":"172.21.15.167:6818","nonce":3449298510}]},"public_addr":"172.21.15.167:6810/3449298510","cluster_addr":"172.21.15.167:6814/3449298510","heartbeat_back_addr":"172.21.15.167:6822/3449298510","heartbeat_front_addr":"172.21.15.167:6818/3449298510","state":["exists","up"]},{"osd":7,"uuid":"9e79e5c0-55e4-45ed-870d-b98b12aadfbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6809","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6811","nonce":19218082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6813","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6815","nonce":19218082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6821","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6823","nonce":19218082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6817","nonce":19218082},{"type":"v1","addr":"172.21.15.167:6819","nonce":19218082}]},"public_addr":"172.21.15.167:6811/19218082","cluster_addr":"172.21.15.167:6815/19218082","heartbeat_back_addr":"172.21.15.167:6823/19218082","heartbeat_front_addr":"172.21.15.167:6819/19218082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.336314+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.321300+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.248343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.457528+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.315934+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.089152+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.396043+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T10:03:39.173075+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.167:6836/616056842":"2024-04-26T10:15:02.815773+0000","172.21.15.167:6834/616056842":"2024-04-26T10:15:02.815773+0000","172.21.15.167:6837/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6835/1299067697":"2024-04-26T10:14:47.926600+0000","172.21.15.167:6837/2651841863":"2024-04-26T10:14:36.951727+0000","172.21.15.167:6835/2651841863":"2024-04-26T10:14:36.951727+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T10:15:09.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 msgr2=0x7fa10c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 0x7fa10c069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa1301faf80 tx=0x7fa118008040 comp rx=0 tx=0).stop 2024-04-25T10:15:09.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 msgr2=0x7fa13006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fa12000c7c0 tx=0x7fa12000cc80 comp rx=0 tx=0).stop 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 shutdown_connections 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa13015efa0 0x7fa1300c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fa10c066f60 0x7fa10c069420 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fa1300cdb70 0x7fa130156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 --2- 172.21.15.18:0/726375266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa13009a170 0x7fa13006c8a0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 >> 172.21.15.18:0/726375266 conn(0x7fa1300b3050 msgr2=0x7fa1300ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 shutdown_connections 2024-04-25T10:15:09.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:09.451+0000 7fa12fe00640 1 -- 172.21.15.18:0/726375266 wait complete. 2024-04-25T10:15:10.476 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T10:15:10.477 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 Processor -- start 2024-04-25T10:15:10.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 -- start start 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f93b8147240 0x7f93b815f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f93b80ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b80adcf0 con 0x7f93b806d2b0 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b80ae000 con 0x7f93b8147240 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8147620 con 0x7f93b8071960 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93af400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f93b806d2b0 0x7f93b8071250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50684/0 (socket says 172.21.15.18:50684) 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93af400640 1 -- 172.21.15.18:0/2431907942 learned_addr learned my addr 172.21.15.18:0/2431907942 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7e00640 1 --2- 172.21.15.18:0/2431907942 >> v2:172.21.15.167:3300/0 conn(0x7f93b8147240 0x7f93b815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bca00640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f93b80ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268020425 0 0) 0x7f93a0001120 con 0x7f93b806d2b0 2024-04-25T10:15:10.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c003530 con 0x7f93b806d2b0 2024-04-25T10:15:10.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 901931037 0 0) 0x7f939c003530 con 0x7f93b806d2b0 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 msgr2=0x7f93b80ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f93b80ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 >> v2:172.21.15.167:3300/0 conn(0x7f93b8147240 msgr2=0x7f93b815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 --2- 172.21.15.18:0/2431907942 >> v2:172.21.15.167:3300/0 conn(0x7f93b8147240 0x7f93b815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b806dd00 con 0x7f93b806d2b0 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f93a0001850 con 0x7f93b806d2b0 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7e00640 1 --2- 172.21.15.18:0/2431907942 >> v2:172.21.15.167:3300/0 conn(0x7f93b8147240 0x7f93b815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 >> v1:172.21.15.18:6789/0 conn(0x7f93b806d2b0 legacy=0x7f93b8071250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0039c0 0x7f939c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f939c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f939c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b80ae000 con 0x7f939c004810 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b8147620 con 0x7f939c0039c0 2024-04-25T10:15:10.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f939c00b9d0 con 0x7f93b8071960 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93af400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f939c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93b7e00640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0039c0 0x7f939c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.631+0000 7f93bca00640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f939c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 -- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 msgr2=0x7f939c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b8071960 0x7f939c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 -- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0039c0 msgr2=0x7f939c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f939c0039c0 0x7f939c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 -- 172.21.15.18:0/2431907942 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c003530 con 0x7f939c004810 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93af400640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f939c004c90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c320 tx=0x7f93a001f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bb94d24d62d386 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0007e60 con 0x7f939c004810 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a00ac020 con 0x7f939c004810 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93b7400640 1 -- 172.21.15.18:0/2431907942 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00058e0 con 0x7f939c004810 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 -- 172.21.15.18:0/2431907942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 msgr2=0x7f939c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 --2- 172.21.15.18:0/2431907942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f939c004c90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c320 tx=0x7f93a001f350 comp rx=0 tx=0).stop 2024-04-25T10:15:10.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bca00640 1 -- 172.21.15.18:0/2431907942 reap_dead start 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 -- 172.21.15.18:0/2431907942 shutdown_connections 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 -- 172.21.15.18:0/2431907942 >> 172.21.15.18:0/2431907942 conn(0x7f93b806ac10 msgr2=0x7f93b806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 -- 172.21.15.18:0/2431907942 shutdown_connections 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.635+0000 7f93bea00640 1 -- 172.21.15.18:0/2431907942 wait complete. 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 Processor -- start 2024-04-25T10:15:10.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- start start 2024-04-25T10:15:10.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f93b814eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b81f0b30 0x7f93b81f73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b80ae390 0x7f93b80ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b806ed90 con 0x7f939c004810 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b806e2c0 con 0x7f93b80ae390 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b806ef10 con 0x7f93b81f0b30 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f93b814eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f93b814eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50324/0 (socket says 172.21.15.18:50324) 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 -- 172.21.15.18:0/1041735019 learned_addr learned my addr 172.21.15.18:0/1041735019 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:10.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bca00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b80ae390 0x7f93b80ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93af400640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b81f0b30 0x7f93b81f73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 -- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b81f0b30 msgr2=0x7f93b81f73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b81f0b30 0x7f93b81f73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 -- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b80ae390 msgr2=0x7f93b80ae810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b80ae390 0x7f93b80ae810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b814fa70 con 0x7f939c004810 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93af400640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f93b81f0b30 0x7f93b81f73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bca00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f93b80ae390 0x7f93b80ae810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:10.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b7e00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f93b814eb10 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f93a8011d00 tx=0x7f93a800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a800fcc0 con 0x7f939c004810 2024-04-25T10:15:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a800fe60 con 0x7f939c004810 2024-04-25T10:15:10.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b814f1d0 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a8004270 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.639+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b814f790 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93b81f7900 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f93a8012040 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9394066f90 0x7f9394069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f93a80854a0 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f939406d570 0x7f939406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9394070080 con 0x7f939406d570 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93a808c050 con 0x7f939c004810 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93af400640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9394066f90 0x7f9394069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93bca00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f939406d570 0x7f939406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.643+0000 7f93bca00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f939406d570 0x7f939406f9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.647+0000 7f93af400640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9394066f90 0x7f9394069450 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f93a00ad000 tx=0x7f93a0001b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.647+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== osd.0 v2:172.21.15.18:6800/3884042883 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9394070080 con 0x7f939406d570 2024-04-25T10:15:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 --> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93b81f3350 con 0x7f939406d570 2024-04-25T10:15:10.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93b4c00640 1 -- 172.21.15.18:0/1041735019 <== osd.0 v2:172.21.15.18:6800/3884042883 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f93b81f3350 con 0x7f939406d570 2024-04-25T10:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f939406d570 msgr2=0x7f939406f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:6800/3884042883,v1:172.21.15.18:6801/3884042883] conn(0x7f939406d570 0x7f939406f9b0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9394066f90 msgr2=0x7f9394069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f9394066f90 0x7f9394069450 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f93a00ad000 tx=0x7f93a0001b50 comp rx=0 tx=0).stop 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 msgr2=0x7f93b814eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 --2- 172.21.15.18:0/1041735019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f939c004810 0x7f93b814eb10 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f93a8011d00 tx=0x7f93a800f610 comp rx=0 tx=0).stop 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bca00640 1 -- 172.21.15.18:0/1041735019 reap_dead start 2024-04-25T10:15:10.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 shutdown_connections 2024-04-25T10:15:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 >> 172.21.15.18:0/1041735019 conn(0x7f93b806ac10 msgr2=0x7f93b8143110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 shutdown_connections 2024-04-25T10:15:10.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.659+0000 7f93bea00640 1 -- 172.21.15.18:0/1041735019 wait complete. 2024-04-25T10:15:10.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T10:15:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 Processor -- start 2024-04-25T10:15:10.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 -- start start 2024-04-25T10:15:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff760144120 0x7ff76015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7600ccbf0 0x7ff76015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff76015ee60 0x7ff7600b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76015e490 con 0x7ff76015ee60 2024-04-25T10:15:10.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76015bc40 con 0x7ff760144120 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff767400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76015b3a0 con 0x7ff7600ccbf0 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff765400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff76015ee60 0x7ff7600b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff765400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff76015ee60 0x7ff7600b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50334/0 (socket says 172.21.15.18:50334) 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff765400640 1 -- 172.21.15.18:0/2506592007 learned_addr learned my addr 172.21.15.18:0/2506592007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff764a00640 1 --2- 172.21.15.18:0/2506592007 >> v2:172.21.15.167:3300/0 conn(0x7ff760144120 0x7ff76015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.819+0000 7ff75fe00640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7600ccbf0 0x7ff76015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 -- 172.21.15.18:0/2506592007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7600ccbf0 msgr2=0x7ff76015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7600ccbf0 0x7ff76015e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 -- 172.21.15.18:0/2506592007 >> v2:172.21.15.167:3300/0 conn(0x7ff760144120 msgr2=0x7ff76015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 --2- 172.21.15.18:0/2506592007 >> v2:172.21.15.167:3300/0 conn(0x7ff760144120 0x7ff76015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 -- 172.21.15.18:0/2506592007 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76015b680 con 0x7ff76015ee60 2024-04-25T10:15:10.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff765400640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff76015ee60 0x7ff7600b3090 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7ff76006b9b0 tx=0x7ff75801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95dbc81ec91be7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff75f400640 1 -- 172.21.15.18:0/2506592007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580a55e0 con 0x7ff76015ee60 2024-04-25T10:15:10.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff75f400640 1 -- 172.21.15.18:0/2506592007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7580a5780 con 0x7ff76015ee60 2024-04-25T10:15:10.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff75f400640 1 -- 172.21.15.18:0/2506592007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7580a5b50 con 0x7ff76015ee60 2024-04-25T10:15:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 -- 172.21.15.18:0/2506592007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff76015ee60 msgr2=0x7ff7600b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff76015ee60 0x7ff7600b3090 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7ff76006b9b0 tx=0x7ff75801c960 comp rx=0 tx=0).stop 2024-04-25T10:15:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 -- 172.21.15.18:0/2506592007 shutdown_connections 2024-04-25T10:15:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff76015ee60 0x7ff7600b3090 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 --2- 172.21.15.18:0/2506592007 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff7600ccbf0 0x7ff76015e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 --2- 172.21.15.18:0/2506592007 >> v2:172.21.15.167:3300/0 conn(0x7ff760144120 0x7ff76015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 -- 172.21.15.18:0/2506592007 >> 172.21.15.18:0/2506592007 conn(0x7ff760067080 msgr2=0x7ff76006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 -- 172.21.15.18:0/2506592007 shutdown_connections 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.823+0000 7ff767400640 1 -- 172.21.15.18:0/2506592007 wait complete. 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 Processor -- start 2024-04-25T10:15:10.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 -- start start 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff760144120 0x7ff7600ae2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76015ee60 0x7ff760142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760071600 con 0x7ff7600ccbf0 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff760071480 con 0x7ff760144120 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff760071780 con 0x7ff76015ee60 2024-04-25T10:15:10.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50342/0 (socket says 172.21.15.18:50342) 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 -- 172.21.15.18:0/3804251678 learned_addr learned my addr 172.21.15.18:0/3804251678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff765400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76015ee60 0x7ff760142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff75fe00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff760144120 0x7ff7600ae2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 -- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76015ee60 msgr2=0x7ff760142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76015ee60 0x7ff760142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 -- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff760144120 msgr2=0x7ff7600ae2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff760144120 0x7ff7600ae2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:10.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 -- 172.21.15.18:0/3804251678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760165260 con 0x7ff7600ccbf0 2024-04-25T10:15:10.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff764a00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7ff75400d800 tx=0x7ff75400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400b6c0 con 0x7ff7600ccbf0 2024-04-25T10:15:10.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff754019070 con 0x7ff7600ccbf0 2024-04-25T10:15:10.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff75400ba60 con 0x7ff7600ccbf0 2024-04-25T10:15:10.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.827+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7601596d0 con 0x7ff7600ccbf0 2024-04-25T10:15:10.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff760159c90 con 0x7ff7600ccbf0 2024-04-25T10:15:10.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7600745d0 con 0x7ff7600ccbf0 2024-04-25T10:15:10.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff75400bc00 con 0x7ff7600ccbf0 2024-04-25T10:15:10.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff75cc00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 0x7ff740069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:10.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff754085420 con 0x7ff7600ccbf0 2024-04-25T10:15:10.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff75fe00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 0x7ff740069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:10.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.831+0000 7ff75fe00640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 0x7ff740069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff76013fe10 tx=0x7ff74c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:10.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.835+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff7540564e0 con 0x7ff7600ccbf0 2024-04-25T10:15:11.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.999+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff760071d90 con 0x7ff740066f60 2024-04-25T10:15:11.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:10.999+0000 7ff75cc00640 1 -- 172.21.15.18:0/3804251678 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff760071d90 con 0x7ff740066f60 2024-04-25T10:15:11.005 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T10:15:11.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 msgr2=0x7ff740069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 0x7ff740069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff76013fe10 tx=0x7ff74c008040 comp rx=0 tx=0).stop 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 msgr2=0x7ff7601f9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7ff75400d800 tx=0x7ff75400dcc0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 shutdown_connections 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff740066f60 0x7ff740069420 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff76015ee60 0x7ff760142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff760144120 0x7ff7600ae2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 --2- 172.21.15.18:0/3804251678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7600ccbf0 0x7ff7601f9cf0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 >> 172.21.15.18:0/3804251678 conn(0x7ff760067080 msgr2=0x7ff76013ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 shutdown_connections 2024-04-25T10:15:11.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.003+0000 7ff767400640 1 -- 172.21.15.18:0/3804251678 wait complete. 2024-04-25T10:15:11.025 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T10:15:11.026 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:11.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 Processor -- start 2024-04-25T10:15:11.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 -- start start 2024-04-25T10:15:11.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a8015dab0 0x7f0a800b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a800b0c00 0x7f0a80070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8015de90 con 0x7f0a800711f0 2024-04-25T10:15:11.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a80071650 con 0x7f0a800b0c00 2024-04-25T10:15:11.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a88400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a80071a70 con 0x7f0a8015dab0 2024-04-25T10:15:11.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a800b0c00 0x7f0a80070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a800b0c00 0x7f0a80070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50350/0 (socket says 172.21.15.18:50350) 2024-04-25T10:15:11.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 -- 172.21.15.18:0/1384126884 learned_addr learned my addr 172.21.15.18:0/1384126884 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85a00640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a8015dab0 0x7f0a800b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 -- 172.21.15.18:0/1384126884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a8015dab0 msgr2=0x7f0a800b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a8015dab0 0x7f0a800b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 -- 172.21.15.18:0/1384126884 >> v1:172.21.15.167:6789/0 conn(0x7f0a800711f0 legacy=0x7f0a80161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.167+0000 7f0a85000640 1 -- 172.21.15.18:0/1384126884 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800b57a0 con 0x7f0a800b0c00 2024-04-25T10:15:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a85000640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a80070cb0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009870 tx=0x7f0a6c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676927feb3de7d62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a7fe00640 1 -- 172.21.15.18:0/1384126884 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0a95f0 con 0x7f0a800b0c00 2024-04-25T10:15:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a7fe00640 1 -- 172.21.15.18:0/1384126884 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0a9790 con 0x7f0a800b0c00 2024-04-25T10:15:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a7fe00640 1 -- 172.21.15.18:0/1384126884 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0a9b60 con 0x7f0a800b0c00 2024-04-25T10:15:11.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 -- 172.21.15.18:0/1384126884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 msgr2=0x7f0a80070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a80070cb0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009870 tx=0x7f0a6c01c530 comp rx=0 tx=0).stop 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 -- 172.21.15.18:0/1384126884 shutdown_connections 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a80070cb0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 --2- 172.21.15.18:0/1384126884 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a8015dab0 0x7f0a800b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 -- 172.21.15.18:0/1384126884 >> 172.21.15.18:0/1384126884 conn(0x7f0a8006f510 msgr2=0x7f0a8006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 -- 172.21.15.18:0/1384126884 shutdown_connections 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.171+0000 7f0a88400640 1 -- 172.21.15.18:0/1384126884 wait complete. 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 Processor -- start 2024-04-25T10:15:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- start start 2024-04-25T10:15:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a800711f0 0x7f0a800cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a800d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a8015dab0 0x7f0a800d1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8016aab0 con 0x7f0a800b0c00 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8016a930 con 0x7f0a8015dab0 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8016ac30 con 0x7f0a800711f0 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a800d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a800d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50356/0 (socket says 172.21.15.18:50356) 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 -- 172.21.15.18:0/3457438904 learned_addr learned my addr 172.21.15.18:0/3457438904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a86400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a8015dab0 0x7f0a800d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85a00640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a800711f0 0x7f0a800cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 -- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a800711f0 msgr2=0x7f0a800cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f0a800711f0 0x7f0a800cf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 -- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a8015dab0 msgr2=0x7f0a800d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a8015dab0 0x7f0a800d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a800cfb50 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a85000640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a800d0cc0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ab040 tx=0x7f0a6c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0b1800 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6c0b19a0 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c0b1d90 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a800cfe30 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a800d03f0 con 0x7f0a800b0c00 2024-04-25T10:15:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.175+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a800745d0 con 0x7f0a800b0c00 2024-04-25T10:15:11.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a6c0a9650 con 0x7f0a800b0c00 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a60066f60 0x7f0a60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f0a6c11f5c0 con 0x7f0a800b0c00 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f0a6006d540 0x7f0a6006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a6c0b0ec0 con 0x7f0a6006d540 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a6c126050 con 0x7f0a800b0c00 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a86400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f0a6006d540 0x7f0a6006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a85a00640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a60066f60 0x7f0a60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a86400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f0a6006d540 0x7f0a6006f980 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a85a00640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a60066f60 0x7f0a60069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0a74007a60 tx=0x7f0a74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.179+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== osd.1 v2:172.21.15.18:6808/600232426 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0a6c0b0ec0 con 0x7f0a6006d540 2024-04-25T10:15:11.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 --> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0a800b1150 con 0x7f0a6006d540 2024-04-25T10:15:11.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a7d600640 1 -- 172.21.15.18:0/3457438904 <== osd.1 v2:172.21.15.18:6808/600232426 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0a800b1150 con 0x7f0a6006d540 2024-04-25T10:15:11.198 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:11.198 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:11.198 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f0a6006d540 msgr2=0x7f0a6006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:6808/600232426,v1:172.21.15.18:6809/600232426] conn(0x7f0a6006d540 0x7f0a6006f980 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a60066f60 msgr2=0x7f0a60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f0a60066f60 0x7f0a60069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0a74007a60 tx=0x7f0a74008040 comp rx=0 tx=0).stop 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 msgr2=0x7f0a800d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 --2- 172.21.15.18:0/3457438904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a800b0c00 0x7f0a800d0cc0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c0ab040 tx=0x7f0a6c01ad70 comp rx=0 tx=0).stop 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a86400640 1 -- 172.21.15.18:0/3457438904 reap_dead start 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 shutdown_connections 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 >> 172.21.15.18:0/3457438904 conn(0x7f0a8006f510 msgr2=0x7f0a801614d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 shutdown_connections 2024-04-25T10:15:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.195+0000 7f0a88400640 1 -- 172.21.15.18:0/3457438904 wait complete. 2024-04-25T10:15:11.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T10:15:11.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 Processor -- start 2024-04-25T10:15:11.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 -- start start 2024-04-25T10:15:11.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faee415dc60 0x7faee40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 0x7faee40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee415e040 con 0x7faee406bf30 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40cff80 con 0x7faee415dc60 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeec600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee40d0260 con 0x7faee409a170 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faee415dc60 0x7faee40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faee415dc60 0x7faee40d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50358/0 (socket says 172.21.15.18:50358) 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 -- 172.21.15.18:0/1122527188 learned_addr learned my addr 172.21.15.18:0/1122527188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeea600640 1 --2- 172.21.15.18:0/1122527188 >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 0x7faee40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 -- 172.21.15.18:0/1122527188 >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 msgr2=0x7faee40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 --2- 172.21.15.18:0/1122527188 >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 0x7faee40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 -- 172.21.15.18:0/1122527188 >> v1:172.21.15.167:6789/0 conn(0x7faee406bf30 legacy=0x7faee4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faee9c00640 1 -- 172.21.15.18:0/1122527188 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40d0540 con 0x7faee415dc60 2024-04-25T10:15:11.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.355+0000 7faeea600640 1 --2- 172.21.15.18:0/1122527188 >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 0x7faee40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T10:15:11.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faee9c00640 1 --2- 172.21.15.18:0/1122527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee40d1020 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7faee4072a70 tx=0x7faed801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5efb1f21f586cdda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faee3e00640 1 -- 172.21.15.18:0/1122527188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80ab620 con 0x7faee415dc60 2024-04-25T10:15:11.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faee3e00640 1 -- 172.21.15.18:0/1122527188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed80b0070 con 0x7faee415dc60 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faee3e00640 1 -- 172.21.15.18:0/1122527188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80ab9e0 con 0x7faee415dc60 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 -- 172.21.15.18:0/1122527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 msgr2=0x7faee40d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 --2- 172.21.15.18:0/1122527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee40d1020 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7faee4072a70 tx=0x7faed801c420 comp rx=0 tx=0).stop 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 -- 172.21.15.18:0/1122527188 shutdown_connections 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 --2- 172.21.15.18:0/1122527188 >> v2:172.21.15.167:3300/0 conn(0x7faee409a170 0x7faee40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 --2- 172.21.15.18:0/1122527188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee40d1020 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 -- 172.21.15.18:0/1122527188 >> 172.21.15.18:0/1122527188 conn(0x7faee40b3200 msgr2=0x7faee40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 -- 172.21.15.18:0/1122527188 shutdown_connections 2024-04-25T10:15:11.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 -- 172.21.15.18:0/1122527188 wait complete. 2024-04-25T10:15:11.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.359+0000 7faeec600640 1 Processor -- start 2024-04-25T10:15:11.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- start start 2024-04-25T10:15:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 0x7faee4153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faee409a170 0x7faee4152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40cc6f0 con 0x7faee415dc60 2024-04-25T10:15:11.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee40cc570 con 0x7faee406bf30 2024-04-25T10:15:11.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee40cc870 con 0x7faee409a170 2024-04-25T10:15:11.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee9200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faee409a170 0x7faee4152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50372/0 (socket says 172.21.15.18:50372) 2024-04-25T10:15:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 -- 172.21.15.18:0/3781668760 learned_addr learned my addr 172.21.15.18:0/3781668760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee9c00640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 0x7faee4153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 -- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faee409a170 msgr2=0x7faee4152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faee409a170 0x7faee4152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 -- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 msgr2=0x7faee4153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 0x7faee4153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 -- 172.21.15.18:0/3781668760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee4141af0 con 0x7faee415dc60 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee9c00640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 0x7faee4153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeea600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7faedc00cea0 tx=0x7faedc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc003ba0 con 0x7faee415dc60 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc003d60 con 0x7faee415dc60 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee4141dd0 con 0x7faee415dc60 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00d880 con 0x7faee415dc60 2024-04-25T10:15:11.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee4142390 con 0x7faee415dc60 2024-04-25T10:15:11.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.363+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee40745d0 con 0x7faee415dc60 2024-04-25T10:15:11.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.367+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faedc00da20 con 0x7faee415dc60 2024-04-25T10:15:11.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.367+0000 7faee1600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 0x7faec4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.367+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7faedc085970 con 0x7faee415dc60 2024-04-25T10:15:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.367+0000 7faee9c00640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 0x7faec4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.367+0000 7faee9c00640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 0x7faec4069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faed80af000 tx=0x7faed80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.371+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faedc056350 con 0x7faee415dc60 2024-04-25T10:15:11.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.535+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7faee40b7590 con 0x7faec4066f60 2024-04-25T10:15:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.535+0000 7faee1600640 1 -- 172.21.15.18:0/3781668760 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faee40b7590 con 0x7faec4066f60 2024-04-25T10:15:11.539 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T10:15:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 msgr2=0x7faec4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 0x7faec4069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7faed80af000 tx=0x7faed80a7000 comp rx=0 tx=0).stop 2024-04-25T10:15:11.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 msgr2=0x7faee415cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7faedc00cea0 tx=0x7faedc00cf90 comp rx=0 tx=0).stop 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 shutdown_connections 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee415dc60 0x7faee415cda0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7faec4066f60 0x7faec4069420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7faee409a170 0x7faee4152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 --2- 172.21.15.18:0/3781668760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faee406bf30 0x7faee4153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 >> 172.21.15.18:0/3781668760 conn(0x7faee40b3200 msgr2=0x7faee4070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 shutdown_connections 2024-04-25T10:15:11.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.539+0000 7faeec600640 1 -- 172.21.15.18:0/3781668760 wait complete. 2024-04-25T10:15:11.561 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T10:15:11.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:11.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 Processor -- start 2024-04-25T10:15:11.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 -- start start 2024-04-25T10:15:11.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f4a40071250 0x7f4a400cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4a40071630 0x7f4a4015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4015ccc0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a40160200 con 0x7f4a40071630 2024-04-25T10:15:11.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a47800640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4015c9e0 con 0x7f4a40071250 2024-04-25T10:15:11.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a45800640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4a4015c2d0 0x7f4a4015cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55608/0 (socket says 172.21.15.18:55608) 2024-04-25T10:15:11.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a45800640 1 -- 172.21.15.18:0/3724191096 learned_addr learned my addr 172.21.15.18:0/3724191096 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:11.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a37e00640 1 --2- 172.21.15.18:0/3724191096 >> v2:172.21.15.18:3300/0 conn(0x7f4a40071630 0x7f4a4015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a44e00640 1 --2- 172.21.15.18:0/3724191096 >> v2:172.21.15.167:3300/0 conn(0x7f4a40071250 0x7f4a400cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a3fe00640 1 -- 172.21.15.18:0/3724191096 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739928666 0 0) 0x7f4a4015ccc0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a3fe00640 1 -- 172.21.15.18:0/3724191096 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a24003530 con 0x7f4a4015c2d0 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a37e00640 1 -- 172.21.15.18:0/3724191096 >> v2:172.21.15.167:3300/0 conn(0x7f4a40071250 msgr2=0x7f4a400cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a37e00640 1 --2- 172.21.15.18:0/3724191096 >> v2:172.21.15.167:3300/0 conn(0x7f4a40071250 0x7f4a400cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a37e00640 1 -- 172.21.15.18:0/3724191096 >> v1:172.21.15.18:6789/0 conn(0x7f4a4015c2d0 legacy=0x7f4a4015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.703+0000 7f4a37e00640 1 -- 172.21.15.18:0/3724191096 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400cd4b0 con 0x7f4a40071630 2024-04-25T10:15:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a37e00640 1 --2- 172.21.15.18:0/3724191096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40071630 0x7f4a4015bd90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f4a4006b990 tx=0x7f4a2801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733ea7e9e00b0619 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a3fe00640 1 -- 172.21.15.18:0/3724191096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280b0070 con 0x7f4a40071630 2024-04-25T10:15:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a3fe00640 1 -- 172.21.15.18:0/3724191096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280ab600 con 0x7f4a40071630 2024-04-25T10:15:11.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a3fe00640 1 -- 172.21.15.18:0/3724191096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280ab9d0 con 0x7f4a40071630 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 -- 172.21.15.18:0/3724191096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40071630 msgr2=0x7f4a4015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 --2- 172.21.15.18:0/3724191096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40071630 0x7f4a4015bd90 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f4a4006b990 tx=0x7f4a2801c360 comp rx=0 tx=0).stop 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 -- 172.21.15.18:0/3724191096 shutdown_connections 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 --2- 172.21.15.18:0/3724191096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a40071630 0x7f4a4015bd90 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 --2- 172.21.15.18:0/3724191096 >> v2:172.21.15.167:3300/0 conn(0x7f4a40071250 0x7f4a400cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 -- 172.21.15.18:0/3724191096 >> 172.21.15.18:0/3724191096 conn(0x7f4a4006ac10 msgr2=0x7f4a4006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 -- 172.21.15.18:0/3724191096 shutdown_connections 2024-04-25T10:15:11.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.707+0000 7f4a47800640 1 -- 172.21.15.18:0/3724191096 wait complete. 2024-04-25T10:15:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 Processor -- start 2024-04-25T10:15:11.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- start start 2024-04-25T10:15:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a40071250 0x7f4a40157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a40071630 0x7f4a40148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 0x7f4a401490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a401684a0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40071ac0 con 0x7f4a40071250 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40168620 con 0x7f4a40071630 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 0x7f4a401490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 0x7f4a401490a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55914/0 (socket says 172.21.15.18:55914) 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 -- 172.21.15.18:0/4169747653 learned_addr learned my addr 172.21.15.18:0/4169747653 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 -- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a40071630 msgr2=0x7f4a40148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f4a40071630 0x7f4a40148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 -- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a40071250 msgr2=0x7f4a40157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a40071250 0x7f4a40157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40157b40 con 0x7f4a4015c2d0 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a45800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 0x7f4a401490a0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800cb30 tx=0x7f4a3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38017070 con 0x7f4a4015c2d0 2024-04-25T10:15:11.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a3800aca0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38012600 con 0x7f4a4015c2d0 2024-04-25T10:15:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a40153bd0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a40154190 con 0x7f4a4015c2d0 2024-04-25T10:15:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.711+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a400745d0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a3801a070 con 0x7f4a4015c2d0 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4a1c066f60 0x7f4a1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f4a380857c0 con 0x7f4a4015c2d0 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f4a1c06d540 0x7f4a1c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a38013e50 con 0x7f4a1c06d540 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a38085b70 con 0x7f4a4015c2d0 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a44e00640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4a1c066f60 0x7f4a1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a37e00640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f4a1c06d540 0x7f4a1c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a44e00640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4a1c066f60 0x7f4a1c069420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000b850 tx=0x7f4a30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a37e00640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f4a1c06d540 0x7f4a1c06f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.715+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== osd.2 v2:172.21.15.18:6816/2456241268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4a38013e50 con 0x7f4a1c06d540 2024-04-25T10:15:11.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 --> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4a40157d70 con 0x7f4a1c06d540 2024-04-25T10:15:11.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a3d600640 1 -- 172.21.15.18:0/4169747653 <== osd.2 v2:172.21.15.18:6816/2456241268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4a40157d70 con 0x7f4a1c06d540 2024-04-25T10:15:11.734 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:11.734 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f4a1c06d540 msgr2=0x7f4a1c06f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:6816/2456241268,v1:172.21.15.18:6818/2456241268] conn(0x7f4a1c06d540 0x7f4a1c06f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4a1c066f60 msgr2=0x7f4a1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f4a1c066f60 0x7f4a1c069420 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a3000b850 tx=0x7f4a30008040 comp rx=0 tx=0).stop 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 msgr2=0x7f4a401490a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 --2- 172.21.15.18:0/4169747653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a4015c2d0 0x7f4a401490a0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f4a3800cb30 tx=0x7f4a3800a060 comp rx=0 tx=0).stop 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a45800640 1 -- 172.21.15.18:0/4169747653 reap_dead start 2024-04-25T10:15:11.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 shutdown_connections 2024-04-25T10:15:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 >> 172.21.15.18:0/4169747653 conn(0x7f4a4006ac10 msgr2=0x7f4a4015cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 shutdown_connections 2024-04-25T10:15:11.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.731+0000 7f4a47800640 1 -- 172.21.15.18:0/4169747653 wait complete. 2024-04-25T10:15:11.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T10:15:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 Processor -- start 2024-04-25T10:15:11.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 -- start start 2024-04-25T10:15:11.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 0x7f62d00ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 0x7f62d015e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d00ceeb0 con 0x7f62d006eb20 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62d006d180 con 0x7f62d00cb8f0 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d5400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d006baa0 con 0x7f62d00ce590 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62c7400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 0x7f62d015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62cfe00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 0x7f62d00ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d4a00640 1 --1- >> v1:172.21.15.167:6789/0 conn(0x7f62d006eb20 0x7f62d015e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.167:6789/0 says I am v1:172.21.15.18:58448/0 (socket says 172.21.15.18:58448) 2024-04-25T10:15:11.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.891+0000 7f62d4a00640 1 -- 172.21.15.18:0/1196808492 learned_addr learned my addr 172.21.15.18:0/1196808492 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cf400640 1 -- 172.21.15.18:0/1196808492 <== mon.1 v1:172.21.15.167:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1183521632 0 0) 0x7f62d00ceeb0 con 0x7f62d006eb20 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cf400640 1 -- 172.21.15.18:0/1196808492 --> v1:172.21.15.167:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62b4003530 con 0x7f62d006eb20 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cfe00640 1 -- 172.21.15.18:0/1196808492 >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 msgr2=0x7f62d015e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cfe00640 1 --2- 172.21.15.18:0/1196808492 >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 0x7f62d015e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cfe00640 1 -- 172.21.15.18:0/1196808492 >> v1:172.21.15.167:6789/0 conn(0x7f62d006eb20 legacy=0x7f62d015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cfe00640 1 -- 172.21.15.18:0/1196808492 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d006d3d0 con 0x7f62d00ce590 2024-04-25T10:15:11.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62c7400640 1 --2- 172.21.15.18:0/1196808492 >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 0x7f62d015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:11.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cfe00640 1 --2- 172.21.15.18:0/1196808492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 0x7f62d00ce970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62c00097c0 tx=0x7f62c001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c04fce0bed84c793 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cf400640 1 -- 172.21.15.18:0/1196808492 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00b0070 con 0x7f62d00ce590 2024-04-25T10:15:11.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cf400640 1 -- 172.21.15.18:0/1196808492 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c00ab600 con 0x7f62d00ce590 2024-04-25T10:15:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62cf400640 1 -- 172.21.15.18:0/1196808492 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c00ab9d0 con 0x7f62d00ce590 2024-04-25T10:15:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62d5400640 1 -- 172.21.15.18:0/1196808492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 msgr2=0x7f62d00ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.895+0000 7f62d5400640 1 --2- 172.21.15.18:0/1196808492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 0x7f62d00ce970 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f62c00097c0 tx=0x7f62c001c4a0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- 172.21.15.18:0/1196808492 shutdown_connections 2024-04-25T10:15:11.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 --2- 172.21.15.18:0/1196808492 >> v2:172.21.15.167:3300/0 conn(0x7f62d00cb8f0 0x7f62d015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 --2- 172.21.15.18:0/1196808492 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d00ce590 0x7f62d00ce970 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- 172.21.15.18:0/1196808492 >> 172.21.15.18:0/1196808492 conn(0x7f62d006ac10 msgr2=0x7f62d006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- 172.21.15.18:0/1196808492 shutdown_connections 2024-04-25T10:15:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- 172.21.15.18:0/1196808492 wait complete. 2024-04-25T10:15:11.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 Processor -- start 2024-04-25T10:15:11.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- start start 2024-04-25T10:15:11.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 0x7f62d0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d00ce590 0x7f62d0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015ecb0 con 0x7f62d00cb8f0 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d015ee30 con 0x7f62d00ce590 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d5400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d006e220 con 0x7f62d006eb20 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55916/0 (socket says 172.21.15.18:55916) 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 -- 172.21.15.18:0/2997806689 learned_addr learned my addr 172.21.15.18:0/2997806689 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62cfe00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 0x7f62d0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62d4a00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d00ce590 0x7f62d0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 -- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 msgr2=0x7f62d0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 0x7f62d0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 -- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d00ce590 msgr2=0x7f62d0151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:11.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d00ce590 0x7f62d0151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62c7400640 1 -- 172.21.15.18:0/2997806689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d01587d0 con 0x7f62d00cb8f0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.899+0000 7f62cfe00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 0x7f62d0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62c7400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f62b800e350 tx=0x7f62b800e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b801a070 con 0x7f62d00cb8f0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b8009540 con 0x7f62d00cb8f0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b80098f0 con 0x7f62d00cb8f0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d0158d60 con 0x7f62d00cb8f0 2024-04-25T10:15:11.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d0159320 con 0x7f62d00cb8f0 2024-04-25T10:15:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d00745d0 con 0x7f62d00cb8f0 2024-04-25T10:15:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f62b8009050 con 0x7f62d00cb8f0 2024-04-25T10:15:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 0x7f62ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f62b8085250 con 0x7f62d00cb8f0 2024-04-25T10:15:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.903+0000 7f62cfe00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 0x7f62ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:11.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.907+0000 7f62cfe00640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 0x7f62ac069420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f62c00ad000 tx=0x7f62c00a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:11.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:11.907+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f62b8055c30 con 0x7f62d00cb8f0 2024-04-25T10:15:12.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.067+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f62d0072370 con 0x7f62ac066f60 2024-04-25T10:15:12.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.067+0000 7f62ccc00640 1 -- 172.21.15.18:0/2997806689 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62d0072370 con 0x7f62ac066f60 2024-04-25T10:15:12.073 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 msgr2=0x7f62ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 0x7f62ac069420 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f62c00ad000 tx=0x7f62c00a6000 comp rx=0 tx=0).stop 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 msgr2=0x7f62d0157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f62b800e350 tx=0x7f62b800e810 comp rx=0 tx=0).stop 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 shutdown_connections 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f62d00ce590 0x7f62d0151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d00cb8f0 0x7f62d0157e70 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f62ac066f60 0x7f62ac069420 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 --2- 172.21.15.18:0/2997806689 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f62d006eb20 0x7f62d0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 >> 172.21.15.18:0/2997806689 conn(0x7f62d006ac10 msgr2=0x7f62d00ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 shutdown_connections 2024-04-25T10:15:12.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.071+0000 7f62d5400640 1 -- 172.21.15.18:0/2997806689 wait complete. 2024-04-25T10:15:12.094 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T10:15:12.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:12.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.235+0000 7f1d44a00640 1 Processor -- start 2024-04-25T10:15:12.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.235+0000 7f1d44a00640 1 -- start start 2024-04-25T10:15:12.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d40144080 0x7f1d400ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 0x7f1d400ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4006e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400719b0 con 0x7f1d40144080 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d400cf490 con 0x7f1d40071e40 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d44a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400cf1b0 con 0x7f1d4006e3c0 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d40144080 0x7f1d400ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d40144080 0x7f1d400ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55924/0 (socket says 172.21.15.18:55924) 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 -- 172.21.15.18:0/2715916945 learned_addr learned my addr 172.21.15.18:0/2715916945 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:12.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d37e00640 1 --2- 172.21.15.18:0/2715916945 >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 0x7f1d400ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3e800640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 -- 172.21.15.18:0/2715916945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 msgr2=0x7f1d4006e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4006e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 -- 172.21.15.18:0/2715916945 >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 msgr2=0x7f1d400ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 --2- 172.21.15.18:0/2715916945 >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 0x7f1d400ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 -- 172.21.15.18:0/2715916945 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40071360 con 0x7f1d40144080 2024-04-25T10:15:12.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d37e00640 1 --2- 172.21.15.18:0/2715916945 >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 0x7f1d400ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:12.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3de00640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ce660 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009870 tx=0x7f1d3001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a88ba2d62d8282 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3d400640 1 -- 172.21.15.18:0/2715916945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300b1070 con 0x7f1d40144080 2024-04-25T10:15:12.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3d400640 1 -- 172.21.15.18:0/2715916945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d300ac410 con 0x7f1d40144080 2024-04-25T10:15:12.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.239+0000 7f1d3d400640 1 -- 172.21.15.18:0/2715916945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300ac7e0 con 0x7f1d40144080 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- 172.21.15.18:0/2715916945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 msgr2=0x7f1d400ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ce660 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009870 tx=0x7f1d3001c520 comp rx=0 tx=0).stop 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- 172.21.15.18:0/2715916945 shutdown_connections 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4006e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- 172.21.15.18:0/2715916945 >> v2:172.21.15.167:3300/0 conn(0x7f1d40071e40 0x7f1d400ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- 172.21.15.18:0/2715916945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ce660 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- 172.21.15.18:0/2715916945 >> 172.21.15.18:0/2715916945 conn(0x7f1d4006ac10 msgr2=0x7f1d4006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- 172.21.15.18:0/2715916945 shutdown_connections 2024-04-25T10:15:12.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- 172.21.15.18:0/2715916945 wait complete. 2024-04-25T10:15:12.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 Processor -- start 2024-04-25T10:15:12.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- start start 2024-04-25T10:15:12.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4014dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d40071e40 0x7f1d4013d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400b3b70 con 0x7f1d40144080 2024-04-25T10:15:12.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400b39f0 con 0x7f1d40071e40 2024-04-25T10:15:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d44a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d400b3cf0 con 0x7f1d4006e3c0 2024-04-25T10:15:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d3e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d3e800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55940/0 (socket says 172.21.15.18:55940) 2024-04-25T10:15:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d3e800640 1 -- 172.21.15.18:0/1510112285 learned_addr learned my addr 172.21.15.18:0/1510112285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:12.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d3de00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4014dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.243+0000 7f1d37e00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d40071e40 0x7f1d4013d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 -- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d40071e40 msgr2=0x7f1d4013d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d40071e40 0x7f1d4013d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 -- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 msgr2=0x7f1d400ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d40144080 0x7f1d400ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d400a8660 con 0x7f1d4006e3c0 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d3de00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4014dce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d4006ef90 tx=0x7f1d300192c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300b1040 con 0x7f1d4006e3c0 2024-04-25T10:15:12.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d300ba070 con 0x7f1d4006e3c0 2024-04-25T10:15:12.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d4014b150 con 0x7f1d4006e3c0 2024-04-25T10:15:12.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300b5440 con 0x7f1d4006e3c0 2024-04-25T10:15:12.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4014b710 con 0x7f1d4006e3c0 2024-04-25T10:15:12.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d400745d0 con 0x7f1d4006e3c0 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d300b55e0 con 0x7f1d4006e3c0 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d1c066f60 0x7f1d1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.247+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f1d3011eb10 con 0x7f1d4006e3c0 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d36000640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f1d1c06d540 0x7f1d1c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d300bee50 con 0x7f1d1c06d540 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== mon.2 v2:172.21.15.167:3301/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d3011efa0 con 0x7f1d4006e3c0 2024-04-25T10:15:12.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d37e00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d1c066f60 0x7f1d1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d3e800640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f1d1c06d540 0x7f1d1c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d3e800640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f1d1c06d540 0x7f1d1c06f980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d37e00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d1c066f60 0x7f1d1c069420 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1d400cc460 tx=0x7f1d28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.251+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== osd.3 v2:172.21.15.18:6817/3876934381 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1d300bee50 con 0x7f1d1c06d540 2024-04-25T10:15:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 --> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1d400b4580 con 0x7f1d1c06d540 2024-04-25T10:15:12.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d36000640 1 -- 172.21.15.18:0/1510112285 <== osd.3 v2:172.21.15.18:6817/3876934381 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1d400b4580 con 0x7f1d1c06d540 2024-04-25T10:15:12.269 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:12.269 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:12.269 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f1d1c06d540 msgr2=0x7f1d1c06f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.18:6817/3876934381,v1:172.21.15.18:6820/3876934381] conn(0x7f1d1c06d540 0x7f1d1c06f980 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d1c066f60 msgr2=0x7f1d1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f1d1c066f60 0x7f1d1c069420 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f1d400cc460 tx=0x7f1d28008040 comp rx=0 tx=0).stop 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 msgr2=0x7f1d4014dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 --2- 172.21.15.18:0/1510112285 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f1d4006e3c0 0x7f1d4014dce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1d4006ef90 tx=0x7f1d300192c0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d3e800640 1 -- 172.21.15.18:0/1510112285 reap_dead start 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 shutdown_connections 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 >> 172.21.15.18:0/1510112285 conn(0x7f1d4006ac10 msgr2=0x7f1d400af520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 shutdown_connections 2024-04-25T10:15:12.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.263+0000 7f1d44a00640 1 -- 172.21.15.18:0/1510112285 wait complete. 2024-04-25T10:15:12.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T10:15:12.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.423+0000 7ff0e3200640 1 Processor -- start 2024-04-25T10:15:12.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.423+0000 7ff0e3200640 1 -- start start 2024-04-25T10:15:12.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 0x7ff0dc15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e3200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc15bc40 con 0x7ff0dc0b3090 2024-04-25T10:15:12.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e3200640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0dc15b3a0 con 0x7ff0dc0ccbf0 2024-04-25T10:15:12.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc15e490 con 0x7ff0dc144120 2024-04-25T10:15:12.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e1200640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff0dc0b3090 0x7ff0dc06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55614/0 (socket says 172.21.15.18:55614) 2024-04-25T10:15:12.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0e1200640 1 -- 172.21.15.18:0/920672155 learned_addr learned my addr 172.21.15.18:0/920672155 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/920672155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 0x7ff0dc15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0daa00640 1 -- 172.21.15.18:0/920672155 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3700250737 0 0) 0x7ff0dc15bc40 con 0x7ff0dc0b3090 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0daa00640 1 -- 172.21.15.18:0/920672155 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003530 con 0x7ff0dc0b3090 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0dbe00640 1 -- 172.21.15.18:0/920672155 >> v1:172.21.15.167:6789/0 conn(0x7ff0dc0ccbf0 legacy=0x7ff0dc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0dbe00640 1 -- 172.21.15.18:0/920672155 >> v1:172.21.15.18:6789/0 conn(0x7ff0dc0b3090 legacy=0x7ff0dc06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.427+0000 7ff0dbe00640 1 -- 172.21.15.18:0/920672155 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc15b680 con 0x7ff0dc144120 2024-04-25T10:15:12.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/920672155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 0x7ff0dc15acd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097f0 tx=0x7ff0cc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82e864fc42dc76aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0daa00640 1 -- 172.21.15.18:0/920672155 <== mon.2 v2:172.21.15.167:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0b0070 con 0x7ff0dc144120 2024-04-25T10:15:12.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0daa00640 1 -- 172.21.15.18:0/920672155 <== mon.2 v2:172.21.15.167:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc0ab600 con 0x7ff0dc144120 2024-04-25T10:15:12.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0daa00640 1 -- 172.21.15.18:0/920672155 <== mon.2 v2:172.21.15.167:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0ab9d0 con 0x7ff0dc144120 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- 172.21.15.18:0/920672155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 msgr2=0x7ff0dc15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 --2- 172.21.15.18:0/920672155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 0x7ff0dc15acd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097f0 tx=0x7ff0cc01c450 comp rx=0 tx=0).stop 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- 172.21.15.18:0/920672155 shutdown_connections 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 --2- 172.21.15.18:0/920672155 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc144120 0x7ff0dc15acd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- 172.21.15.18:0/920672155 >> 172.21.15.18:0/920672155 conn(0x7ff0dc067080 msgr2=0x7ff0dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- 172.21.15.18:0/920672155 shutdown_connections 2024-04-25T10:15:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- 172.21.15.18:0/920672155 wait complete. 2024-04-25T10:15:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 Processor -- start 2024-04-25T10:15:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.431+0000 7ff0e3200640 1 -- start start 2024-04-25T10:15:12.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 0x7ff0dc0b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0dc0ccbf0 0x7ff0dc13af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06ec70 con 0x7ff0dc144120 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc06eaf0 con 0x7ff0dc0ccbf0 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0dc0b3470 con 0x7ff0dc0b3090 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55956/0 (socket says 172.21.15.18:55956) 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 -- 172.21.15.18:0/102981735 learned_addr learned my addr 172.21.15.18:0/102981735 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 0x7ff0dc0b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0db400640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0dc0ccbf0 0x7ff0dc13af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 -- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 msgr2=0x7ff0dc0b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 0x7ff0dc0b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 -- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0dc0ccbf0 msgr2=0x7ff0dc13af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0dc0ccbf0 0x7ff0dc13af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 -- 172.21.15.18:0/102981735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0a8a70 con 0x7ff0dc144120 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 0x7ff0dc0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e1200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400cb40 tx=0x7ff0d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4017070 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d400aca0 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0dc0a8d50 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4012620 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0dc0a9310 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0dc0745d0 con 0x7ff0dc144120 2024-04-25T10:15:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.435+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff0d401a070 con 0x7ff0dc144120 2024-04-25T10:15:12.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.439+0000 7ff0d3e00640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.439+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff0d4084e30 con 0x7ff0dc144120 2024-04-25T10:15:12.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.439+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.439+0000 7ff0dbe00640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0ad000 tx=0x7ff0cc0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.443+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0d4055e60 con 0x7ff0dc144120 2024-04-25T10:15:12.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.603+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0dc15e9c0 con 0x7ff0bc066f60 2024-04-25T10:15:12.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.603+0000 7ff0d3e00640 1 -- 172.21.15.18:0/102981735 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0dc15e9c0 con 0x7ff0bc066f60 2024-04-25T10:15:12.608 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T10:15:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 msgr2=0x7ff0bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 0x7ff0bc069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0ad000 tx=0x7ff0cc0a6000 comp rx=0 tx=0).stop 2024-04-25T10:15:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 msgr2=0x7ff0dc0a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400cb40 tx=0x7ff0d400a060 comp rx=0 tx=0).stop 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 shutdown_connections 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0dc144120 0x7ff0dc0a9b10 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0dc0ccbf0 0x7ff0dc13af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff0bc066f60 0x7ff0bc069420 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 --2- 172.21.15.18:0/102981735 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff0dc0b3090 0x7ff0dc0b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 >> 172.21.15.18:0/102981735 conn(0x7ff0dc067080 msgr2=0x7ff0dc1410f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 shutdown_connections 2024-04-25T10:15:12.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.607+0000 7ff0e3200640 1 -- 172.21.15.18:0/102981735 wait complete. 2024-04-25T10:15:12.629 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T10:15:12.629 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.767+0000 7fd482a00640 1 Processor -- start 2024-04-25T10:15:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.767+0000 7fd482a00640 1 -- start start 2024-04-25T10:15:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482a00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd47c09a810 0x7fd47c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd47c0cf640 0x7fd47c0cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c15e180 con 0x7fd47c099a60 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482a00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c15e460 con 0x7fd47c09a810 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c15e740 con 0x7fd47c0cf640 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd480c00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd47c09a810 0x7fd47c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd481600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd47c099a60 0x7fd47c099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55626/0 (socket says 172.21.15.18:55626) 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd481600640 1 -- 172.21.15.18:0/441491148 learned_addr learned my addr 172.21.15.18:0/441491148 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd482000640 1 --2- 172.21.15.18:0/441491148 >> v2:172.21.15.167:3300/0 conn(0x7fd47c0cf640 0x7fd47c0cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd47be00640 1 -- 172.21.15.18:0/441491148 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374513553 0 0) 0x7fd47c15e180 con 0x7fd47c099a60 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd480c00640 1 -- 172.21.15.18:0/441491148 >> v2:172.21.15.167:3300/0 conn(0x7fd47c0cf640 msgr2=0x7fd47c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd480c00640 1 --2- 172.21.15.18:0/441491148 >> v2:172.21.15.167:3300/0 conn(0x7fd47c0cf640 0x7fd47c0cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd480c00640 1 -- 172.21.15.18:0/441491148 >> v1:172.21.15.18:6789/0 conn(0x7fd47c099a60 legacy=0x7fd47c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.771+0000 7fd480c00640 1 -- 172.21.15.18:0/441491148 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c15ea20 con 0x7fd47c09a810 2024-04-25T10:15:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd480c00640 1 --2- 172.21.15.18:0/441491148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c09a810 0x7fd47c06bd20 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0732e0 tx=0x7fd46801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e158b251875e7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd47be00640 1 -- 172.21.15.18:0/441491148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680ab610 con 0x7fd47c09a810 2024-04-25T10:15:12.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd47be00640 1 -- 172.21.15.18:0/441491148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4680b0070 con 0x7fd47c09a810 2024-04-25T10:15:12.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd47be00640 1 -- 172.21.15.18:0/441491148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4680ab9d0 con 0x7fd47c09a810 2024-04-25T10:15:12.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- 172.21.15.18:0/441491148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c09a810 msgr2=0x7fd47c06bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- 172.21.15.18:0/441491148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c09a810 0x7fd47c06bd20 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0732e0 tx=0x7fd46801c3f0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- 172.21.15.18:0/441491148 shutdown_connections 2024-04-25T10:15:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- 172.21.15.18:0/441491148 >> v2:172.21.15.167:3300/0 conn(0x7fd47c0cf640 0x7fd47c0cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- 172.21.15.18:0/441491148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c09a810 0x7fd47c06bd20 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- 172.21.15.18:0/441491148 >> 172.21.15.18:0/441491148 conn(0x7fd47c0d15b0 msgr2=0x7fd47c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- 172.21.15.18:0/441491148 shutdown_connections 2024-04-25T10:15:12.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- 172.21.15.18:0/441491148 wait complete. 2024-04-25T10:15:12.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 Processor -- start 2024-04-25T10:15:12.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- start start 2024-04-25T10:15:12.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 0x7fd47c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd47c09a810 0x7fd47c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd47c0cf640 0x7fd47c06fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0d0940 con 0x7fd47c099a60 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0d07c0 con 0x7fd47c09a810 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.775+0000 7fd482a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c16a7c0 con 0x7fd47c0cf640 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 0x7fd47c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 0x7fd47c0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55982/0 (socket says 172.21.15.18:55982) 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 -- 172.21.15.18:0/2953197573 learned_addr learned my addr 172.21.15.18:0/2953197573 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd480c00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd47c09a810 0x7fd47c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd482000640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd47c0cf640 0x7fd47c06fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 -- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd47c0cf640 msgr2=0x7fd47c06fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd47c0cf640 0x7fd47c06fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 -- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd47c09a810 msgr2=0x7fd47c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd47c09a810 0x7fd47c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c1580c0 con 0x7fd47c099a60 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd480c00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd47c09a810 0x7fd47c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T10:15:12.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd481600640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 0x7fd47c0c50e0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd4700011f0 tx=0x7fd47000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470018070 con 0x7fd47c099a60 2024-04-25T10:15:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4700074e0 con 0x7fd47c099a60 2024-04-25T10:15:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470004a10 con 0x7fd47c099a60 2024-04-25T10:15:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c158360 con 0x7fd47c099a60 2024-04-25T10:15:12.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c158920 con 0x7fd47c099a60 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd47c158d00 con 0x7fd47c099a60 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd470004bb0 con 0x7fd47c099a60 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd45c066f60 0x7fd45c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.779+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fd470084350 con 0x7fd47c099a60 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd479600640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7fd45c06d540 0x7fd45c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd45c070050 con 0x7fd45c06d540 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd47008b050 con 0x7fd47c099a60 2024-04-25T10:15:12.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd480c00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd45c066f60 0x7fd45c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd482000640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7fd45c06d540 0x7fd45c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd480c00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd45c066f60 0x7fd45c069420 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd4680af000 tx=0x7fd4680a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd482000640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7fd45c06d540 0x7fd45c06f980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.783+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== osd.4 v2:172.21.15.167:6800/3323785626 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd45c070050 con 0x7fd45c06d540 2024-04-25T10:15:12.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.795+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 --> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd47c0745d0 con 0x7fd45c06d540 2024-04-25T10:15:12.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd479600640 1 -- 172.21.15.18:0/2953197573 <== osd.4 v2:172.21.15.167:6800/3323785626 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd47c0745d0 con 0x7fd45c06d540 2024-04-25T10:15:12.801 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:12.801 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:12.801 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7fd45c06d540 msgr2=0x7fd45c06f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6800/3323785626,v1:172.21.15.167:6801/3323785626] conn(0x7fd45c06d540 0x7fd45c06f980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd45c066f60 msgr2=0x7fd45c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd45c066f60 0x7fd45c069420 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd4680af000 tx=0x7fd4680a7000 comp rx=0 tx=0).stop 2024-04-25T10:15:12.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 msgr2=0x7fd47c0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 --2- 172.21.15.18:0/2953197573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd47c099a60 0x7fd47c0c50e0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fd4700011f0 tx=0x7fd47000c9b0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482000640 1 -- 172.21.15.18:0/2953197573 reap_dead start 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 shutdown_connections 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 >> 172.21.15.18:0/2953197573 conn(0x7fd47c0d15b0 msgr2=0x7fd47c0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 shutdown_connections 2024-04-25T10:15:12.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.799+0000 7fd482a00640 1 -- 172.21.15.18:0/2953197573 wait complete. 2024-04-25T10:15:12.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T10:15:12.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 Processor -- start 2024-04-25T10:15:12.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 -- start start 2024-04-25T10:15:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc7f806e4a0 0x7fc7f806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f815fc00 con 0x7fc7f8159320 2024-04-25T10:15:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f815fee0 con 0x7fc7f815c9b0 2024-04-25T10:15:12.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7ffa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f806d640 con 0x7fc7f806e4a0 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc7f806e4a0 0x7fc7f806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fd000640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc7f8159320 0x7fc7f815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55628/0 (socket says 172.21.15.18:55628) 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fd000640 1 -- 172.21.15.18:0/178181345 learned_addr learned my addr 172.21.15.18:0/178181345 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fda00640 1 -- 172.21.15.18:0/178181345 >> v1:172.21.15.167:6789/0 conn(0x7fc7f815c9b0 legacy=0x7fc7f806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fda00640 1 -- 172.21.15.18:0/178181345 >> v1:172.21.15.18:6789/0 conn(0x7fc7f8159320 legacy=0x7fc7f815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7fda00640 1 -- 172.21.15.18:0/178181345 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f81601c0 con 0x7fc7f806e4a0 2024-04-25T10:15:12.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.959+0000 7fc7f7400640 1 -- 172.21.15.18:0/178181345 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212719814 0 0) 0x7fc7f815fc00 con 0x7fc7f8159320 2024-04-25T10:15:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7fda00640 1 --2- 172.21.15.18:0/178181345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f806e4a0 0x7fc7f806e8d0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fc7f806d7c0 tx=0x7fc7f001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786c11051bf43e36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7f7400640 1 -- 172.21.15.18:0/178181345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00b2070 con 0x7fc7f806e4a0 2024-04-25T10:15:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7f7400640 1 -- 172.21.15.18:0/178181345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f00a5810 con 0x7fc7f806e4a0 2024-04-25T10:15:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7f7400640 1 -- 172.21.15.18:0/178181345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a5be0 con 0x7fc7f806e4a0 2024-04-25T10:15:12.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- 172.21.15.18:0/178181345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f806e4a0 msgr2=0x7fc7f806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/178181345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f806e4a0 0x7fc7f806e8d0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7fc7f806d7c0 tx=0x7fc7f001c950 comp rx=0 tx=0).stop 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- 172.21.15.18:0/178181345 shutdown_connections 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/178181345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f806e4a0 0x7fc7f806e8d0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- 172.21.15.18:0/178181345 >> 172.21.15.18:0/178181345 conn(0x7fc7f8067080 msgr2=0x7fc7f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- 172.21.15.18:0/178181345 shutdown_connections 2024-04-25T10:15:12.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- 172.21.15.18:0/178181345 wait complete. 2024-04-25T10:15:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 Processor -- start 2024-04-25T10:15:12.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.963+0000 7fc7ffa00640 1 -- start start 2024-04-25T10:15:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7f806e4a0 0x7fc7f81432a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7f815c9b0 0x7fc7f813b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8169720 con 0x7fc7f8159320 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81695a0 con 0x7fc7f806e4a0 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81698a0 con 0x7fc7f815c9b0 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55986/0 (socket says 172.21.15.18:55986) 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 -- 172.21.15.18:0/3956231937 learned_addr learned my addr 172.21.15.18:0/3956231937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7fd000640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7f806e4a0 0x7fc7f81432a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7fda00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7f815c9b0 0x7fc7f813b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 -- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7f815c9b0 msgr2=0x7fc7f813b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7f815c9b0 0x7fc7f813b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 -- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7f806e4a0 msgr2=0x7fc7f81432a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7f806e4a0 0x7fc7f81432a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 -- 172.21.15.18:0/3956231937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80acd00 con 0x7fc7f8159320 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f7e00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c500 tx=0x7fc7e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4016020 con 0x7fc7f8159320 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4005220 con 0x7fc7f8159320 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f8143910 con 0x7fc7f8159320 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4007030 con 0x7fc7f8159320 2024-04-25T10:15:12.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f8156a40 con 0x7fc7f8159320 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f80745d0 con 0x7fc7f8159320 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.967+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7e40071f0 con 0x7fc7f8159320 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.971+0000 7fc7f4c00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 0x7fc7d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.971+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fc7e40843c0 con 0x7fc7f8159320 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.971+0000 7fc7fd000640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 0x7fc7d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:12.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.971+0000 7fc7fd000640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 0x7fc7d8069450 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000f70 tx=0x7fc7ec007d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:12.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:12.975+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7e40554a0 con 0x7fc7f8159320 2024-04-25T10:15:13.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.135+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7f813f430 con 0x7fc7d8066f90 2024-04-25T10:15:13.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.135+0000 7fc7f4c00640 1 -- 172.21.15.18:0/3956231937 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7f813f430 con 0x7fc7d8066f90 2024-04-25T10:15:13.141 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 msgr2=0x7fc7d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 0x7fc7d8069450 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000f70 tx=0x7fc7ec007d10 comp rx=0 tx=0).stop 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 msgr2=0x7fc7f813c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c500 tx=0x7fc7e400c9c0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 shutdown_connections 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fc7d8066f90 0x7fc7d8069450 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fc7f815c9b0 0x7fc7f813b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7f8159320 0x7fc7f813c040 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 --2- 172.21.15.18:0/3956231937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7f806e4a0 0x7fc7f81432a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 >> 172.21.15.18:0/3956231937 conn(0x7fc7f8067080 msgr2=0x7fc7f806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 shutdown_connections 2024-04-25T10:15:13.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.139+0000 7fc7ffa00640 1 -- 172.21.15.18:0/3956231937 wait complete. 2024-04-25T10:15:13.161 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T10:15:13.161 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 Processor -- start 2024-04-25T10:15:13.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 -- start start 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb1c806ead0 0x7fb1c8165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80cf490 con 0x7fb1c8144080 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80cf1b0 con 0x7fb1c8071e40 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1cce00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80719b0 con 0x7fb1c806ead0 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c5e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb1c8144080 0x7fb1c80ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55636/0 (socket says 172.21.15.18:55636) 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c5e00640 1 -- 172.21.15.18:0/1044100216 learned_addr learned my addr 172.21.15.18:0/1044100216 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:13.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c6800640 1 --2- 172.21.15.18:0/1044100216 >> v2:172.21.15.18:3300/0 conn(0x7fb1c806ead0 0x7fb1c8165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c5400640 1 -- 172.21.15.18:0/1044100216 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971401940 0 0) 0x7fb1c80cf490 con 0x7fb1c8144080 2024-04-25T10:15:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c5400640 1 -- 172.21.15.18:0/1044100216 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ac005740 con 0x7fb1c8144080 2024-04-25T10:15:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c6800640 1 -- 172.21.15.18:0/1044100216 >> v1:172.21.15.167:6789/0 conn(0x7fb1c8071e40 legacy=0x7fb1c806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c6800640 1 -- 172.21.15.18:0/1044100216 >> v1:172.21.15.18:6789/0 conn(0x7fb1c8144080 legacy=0x7fb1c80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.303+0000 7fb1c6800640 1 -- 172.21.15.18:0/1044100216 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8071360 con 0x7fb1c806ead0 2024-04-25T10:15:13.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1c6800640 1 --2- 172.21.15.18:0/1044100216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c806ead0 0x7fb1c8165590 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009dc0 tx=0x7fb1c001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19e02aa330c8685 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1c5400640 1 -- 172.21.15.18:0/1044100216 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00b2070 con 0x7fb1c806ead0 2024-04-25T10:15:13.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1c5400640 1 -- 172.21.15.18:0/1044100216 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c00a58c0 con 0x7fb1c806ead0 2024-04-25T10:15:13.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1c5400640 1 -- 172.21.15.18:0/1044100216 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00a5c90 con 0x7fb1c806ead0 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 -- 172.21.15.18:0/1044100216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c806ead0 msgr2=0x7fb1c8165590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 --2- 172.21.15.18:0/1044100216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c806ead0 0x7fb1c8165590 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009dc0 tx=0x7fb1c001c920 comp rx=0 tx=0).stop 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 -- 172.21.15.18:0/1044100216 shutdown_connections 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 --2- 172.21.15.18:0/1044100216 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c806ead0 0x7fb1c8165590 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 -- 172.21.15.18:0/1044100216 >> 172.21.15.18:0/1044100216 conn(0x7fb1c806ac10 msgr2=0x7fb1c806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 -- 172.21.15.18:0/1044100216 shutdown_connections 2024-04-25T10:15:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.307+0000 7fb1cce00640 1 -- 172.21.15.18:0/1044100216 wait complete. 2024-04-25T10:15:13.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 Processor -- start 2024-04-25T10:15:13.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- start start 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1c806ead0 0x7fb1c8127a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 0x7fb1c81432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1c8144080 0x7fb1c8128940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80ceef0 con 0x7fb1c8071e40 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80ced70 con 0x7fb1c806ead0 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c806dac0 con 0x7fb1c8144080 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 0x7fb1c81432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 0x7fb1c81432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56006/0 (socket says 172.21.15.18:56006) 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 -- 172.21.15.18:0/2773935991 learned_addr learned my addr 172.21.15.18:0/2773935991 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1c5e00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1c806ead0 0x7fb1c8127a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1c6800640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1c8144080 0x7fb1c8128940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 -- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1c8144080 msgr2=0x7fb1c8128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb1c8144080 0x7fb1c8128940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 -- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1c806ead0 msgr2=0x7fb1c8127a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb1c806ead0 0x7fb1c8127a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8128190 con 0x7fb1c8071e40 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1bfe00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 0x7fb1c81432e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c450 tx=0x7fb1b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0016020 con 0x7fb1c8071e40 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b00052d0 con 0x7fb1c8071e40 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b0007260 con 0x7fb1c8071e40 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c8128470 con 0x7fb1c8071e40 2024-04-25T10:15:13.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.311+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c8143820 con 0x7fb1c8071e40 2024-04-25T10:15:13.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb1c80745d0 con 0x7fb1c8071e40 2024-04-25T10:15:13.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb1b0007400 con 0x7fb1c8071e40 2024-04-25T10:15:13.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb1a4066f90 0x7fb1a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb1b00847f0 con 0x7fb1c8071e40 2024-04-25T10:15:13.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7fb1a406d570 0x7fb1a406f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb1b0004e90 con 0x7fb1a406d570 2024-04-25T10:15:13.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1b008b050 con 0x7fb1c8071e40 2024-04-25T10:15:13.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1c5e00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb1a4066f90 0x7fb1a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1c6800640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7fb1a406d570 0x7fb1a406f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1c5e00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb1a4066f90 0x7fb1a4069450 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80011f0 tx=0x7fb1b8007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.315+0000 7fb1c6800640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7fb1a406d570 0x7fb1a406f9b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.319+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== osd.5 v2:172.21.15.167:6824/2931035891 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb1b0004e90 con 0x7fb1a406d570 2024-04-25T10:15:13.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 --> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb1c8128640 con 0x7fb1a406d570 2024-04-25T10:15:13.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1be000640 1 -- 172.21.15.18:0/2773935991 <== osd.5 v2:172.21.15.167:6824/2931035891 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb1c8128640 con 0x7fb1a406d570 2024-04-25T10:15:13.335 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:13.335 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:13.335 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:13.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7fb1a406d570 msgr2=0x7fb1a406f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6824/2931035891,v1:172.21.15.167:6825/2931035891] conn(0x7fb1a406d570 0x7fb1a406f9b0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb1a4066f90 msgr2=0x7fb1a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb1a4066f90 0x7fb1a4069450 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fb1b80011f0 tx=0x7fb1b8007d40 comp rx=0 tx=0).stop 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 msgr2=0x7fb1c81432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 --2- 172.21.15.18:0/2773935991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c8071e40 0x7fb1c81432e0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000c450 tx=0x7fb1b000c910 comp rx=0 tx=0).stop 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1c6800640 1 -- 172.21.15.18:0/2773935991 reap_dead start 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 shutdown_connections 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 >> 172.21.15.18:0/2773935991 conn(0x7fb1c806ac10 msgr2=0x7fb1c80b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 shutdown_connections 2024-04-25T10:15:13.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.331+0000 7fb1cce00640 1 -- 172.21.15.18:0/2773935991 wait complete. 2024-04-25T10:15:13.354 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T10:15:13.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.491+0000 7f7639800640 1 Processor -- start 2024-04-25T10:15:13.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.491+0000 7f7639800640 1 -- start start 2024-04-25T10:15:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7639800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763415dc60 0x7f76340d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7639800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f763409a170 0x7f76340cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7639800640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763415e040 con 0x7f763406bf30 2024-04-25T10:15:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7639800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340cff80 con 0x7f763409a170 2024-04-25T10:15:13.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7639800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76340d0260 con 0x7f763415dc60 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f763409a170 0x7f76340cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f763409a170 0x7f76340cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56010/0 (socket says 172.21.15.18:56010) 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 -- 172.21.15.18:0/1975920894 learned_addr learned my addr 172.21.15.18:0/1975920894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7632a00640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763415dc60 0x7f76340d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 -- 172.21.15.18:0/1975920894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763415dc60 msgr2=0x7f76340d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763415dc60 0x7f76340d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 -- 172.21.15.18:0/1975920894 >> v1:172.21.15.167:6789/0 conn(0x7f763406bf30 legacy=0x7f7634099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.495+0000 7f7633400640 1 -- 172.21.15.18:0/1975920894 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340d0540 con 0x7f763409a170 2024-04-25T10:15:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7633400640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763409a170 0x7f76340cf8a0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f762c009e50 tx=0x7f762c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58bfb6a7c21e9e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7632000640 1 -- 172.21.15.18:0/1975920894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0a5830 con 0x7f763409a170 2024-04-25T10:15:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7632000640 1 -- 172.21.15.18:0/1975920894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c0a59d0 con 0x7f763409a170 2024-04-25T10:15:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7632000640 1 -- 172.21.15.18:0/1975920894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0a5da0 con 0x7f763409a170 2024-04-25T10:15:13.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- 172.21.15.18:0/1975920894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763409a170 msgr2=0x7f76340cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763409a170 0x7f76340cf8a0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f762c009e50 tx=0x7f762c01c970 comp rx=0 tx=0).stop 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- 172.21.15.18:0/1975920894 shutdown_connections 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763409a170 0x7f76340cf8a0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- 172.21.15.18:0/1975920894 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763415dc60 0x7f76340d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- 172.21.15.18:0/1975920894 >> 172.21.15.18:0/1975920894 conn(0x7f76340b3200 msgr2=0x7f76340b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- 172.21.15.18:0/1975920894 shutdown_connections 2024-04-25T10:15:13.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- 172.21.15.18:0/1975920894 wait complete. 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 Processor -- start 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- start start 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763406bf30 0x7f763415b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f763409a170 0x7f763414ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340cc6f0 con 0x7f763415dc60 2024-04-25T10:15:13.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76340cc570 con 0x7f763409a170 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.499+0000 7f7639800640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76340cc870 con 0x7f763406bf30 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56016/0 (socket says 172.21.15.18:56016) 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 -- 172.21.15.18:0/925800724 learned_addr learned my addr 172.21.15.18:0/925800724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7632a00640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763406bf30 0x7f763415b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f762a000640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f763409a170 0x7f763414ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 -- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763406bf30 msgr2=0x7f763415b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763406bf30 0x7f763415b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 -- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f763409a170 msgr2=0x7f763414ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f763409a170 0x7f763414ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 -- 172.21.15.18:0/925800724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76340b5930 con 0x7f763415dc60 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7633400640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f762c0af040 tx=0x7f762c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0bc020 con 0x7f763415dc60 2024-04-25T10:15:13.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c0b8670 con 0x7f763415dc60 2024-04-25T10:15:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0b8a60 con 0x7f763415dc60 2024-04-25T10:15:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763415ae70 con 0x7f763415dc60 2024-04-25T10:15:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763414d3b0 con 0x7f763415dc60 2024-04-25T10:15:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76340745d0 con 0x7f763415dc60 2024-04-25T10:15:13.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.503+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f762c0bf020 con 0x7f763415dc60 2024-04-25T10:15:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.507+0000 7f762b400640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 0x7f7610069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.507+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f762c11fec0 con 0x7f763415dc60 2024-04-25T10:15:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.507+0000 7f7632a00640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 0x7f7610069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.507+0000 7f7632a00640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 0x7f7610069420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7624009ac0 tx=0x7f7624009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.511+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f762c0c6030 con 0x7f763415dc60 2024-04-25T10:15:13.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f76340b5c10 con 0x7f7610066f60 2024-04-25T10:15:13.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f762b400640 1 -- 172.21.15.18:0/925800724 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f76340b5c10 con 0x7f7610066f60 2024-04-25T10:15:13.675 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 msgr2=0x7f7610069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 0x7f7610069420 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f7624009ac0 tx=0x7f7624009190 comp rx=0 tx=0).stop 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 msgr2=0x7f7634158940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f762c0af040 tx=0x7f762c019710 comp rx=0 tx=0).stop 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 shutdown_connections 2024-04-25T10:15:13.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415dc60 0x7f7634158940 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f763409a170 0x7f763414ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f7610066f60 0x7f7610069420 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.671+0000 7f7639800640 1 --2- 172.21.15.18:0/925800724 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f763406bf30 0x7f763415b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.675+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 >> 172.21.15.18:0/925800724 conn(0x7f76340b3200 msgr2=0x7f763406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.675+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 shutdown_connections 2024-04-25T10:15:13.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.675+0000 7f7639800640 1 -- 172.21.15.18:0/925800724 wait complete. 2024-04-25T10:15:13.697 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T10:15:13.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:13.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 Processor -- start 2024-04-25T10:15:13.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 -- start start 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f26840b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f26840b0c00 0x7f268406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268415de90 con 0x7f268415dab0 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2684071a70 con 0x7f26840b0c00 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2689200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26840b57a0 con 0x7f26840713c0 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681e00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f268415dab0 0x7f2684070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55652/0 (socket says 172.21.15.18:55652) 2024-04-25T10:15:13.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681e00640 1 -- 172.21.15.18:0/932537220 learned_addr learned my addr 172.21.15.18:0/932537220 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2682800640 1 --2- 172.21.15.18:0/932537220 >> v2:172.21.15.167:3300/0 conn(0x7f26840b0c00 0x7f268406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2679400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f26840b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762720769 0 0) 0x7f268415de90 con 0x7f268415dab0 2024-04-25T10:15:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2668003530 con 0x7f268415dab0 2024-04-25T10:15:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80435597 0 0) 0x7f2668003530 con 0x7f268415dab0 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 msgr2=0x7f26840b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f26840b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 >> v2:172.21.15.167:3300/0 conn(0x7f26840b0c00 msgr2=0x7f268406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 --2- 172.21.15.18:0/932537220 >> v2:172.21.15.167:3300/0 conn(0x7f26840b0c00 0x7f268406c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268406bec0 con 0x7f268415dab0 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7f2674001680 con 0x7f268415dab0 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 >> v1:172.21.15.18:6789/0 conn(0x7f268415dab0 legacy=0x7f2684070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26680039c0 0x7f2668003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f2668004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2668004d50 0x7f26680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684071a70 con 0x7f26680039c0 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26840b57a0 con 0x7f2668004d50 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.839+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266800b9d0 con 0x7f26840713c0 2024-04-25T10:15:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26680039c0 0x7f2668003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2679400640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f2668004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2682800640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2668004d50 0x7f26680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 -- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 msgr2=0x7f2668004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26840713c0 0x7f2668004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 -- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2668004d50 msgr2=0x7f26680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2668004d50 0x7f26680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 -- 172.21.15.18:0/932537220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2668003530 con 0x7f26680039c0 2024-04-25T10:15:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681e00640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26680039c0 0x7f2668003de0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f267400c160 tx=0x7f267401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f215046ebdc520 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674007c90 con 0x7f26680039c0 2024-04-25T10:15:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740a9020 con 0x7f26680039c0 2024-04-25T10:15:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.843+0000 7f2681400640 1 -- 172.21.15.18:0/932537220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674005ae0 con 0x7f26680039c0 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- 172.21.15.18:0/932537220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26680039c0 msgr2=0x7f2668003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 --2- 172.21.15.18:0/932537220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26680039c0 0x7f2668003de0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f267400c160 tx=0x7f267401cbb0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2682800640 1 -- 172.21.15.18:0/932537220 reap_dead start 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- 172.21.15.18:0/932537220 shutdown_connections 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- 172.21.15.18:0/932537220 >> 172.21.15.18:0/932537220 conn(0x7f268406f510 msgr2=0x7f268406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- 172.21.15.18:0/932537220 shutdown_connections 2024-04-25T10:15:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- 172.21.15.18:0/932537220 wait complete. 2024-04-25T10:15:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 Processor -- start 2024-04-25T10:15:13.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- start start 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26680039c0 0x7f2684154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 0x7f268413f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26840b1370 0x7f26840b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268406da80 con 0x7f2684156920 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268406d900 con 0x7f26840b1370 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2689200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268406dc00 con 0x7f26680039c0 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 0x7f268413f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 0x7f268413f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56028/0 (socket says 172.21.15.18:56028) 2024-04-25T10:15:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 -- 172.21.15.18:0/2240531230 learned_addr learned my addr 172.21.15.18:0/2240531230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2681e00640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26680039c0 0x7f2684154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2682800640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26840b1370 0x7f26840b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 -- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26680039c0 msgr2=0x7f2684154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f26680039c0 0x7f2684154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 -- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26840b1370 msgr2=0x7f26840b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26840b1370 0x7f26840b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.847+0000 7f2679400640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26841555f0 con 0x7f2684156920 2024-04-25T10:15:13.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f2679400640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 0x7f268413f890 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f266c011e30 tx=0x7f266c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00fea0 con 0x7f2684156920 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c015630 con 0x7f2684156920 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c015a00 con 0x7f2684156920 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26841558d0 con 0x7f2684156920 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2684155e90 con 0x7f2684156920 2024-04-25T10:15:13.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26840745d0 con 0x7f2684156920 2024-04-25T10:15:13.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f266c015ba0 con 0x7f2684156920 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2660066f60 0x7f2660069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f266c086090 con 0x7f2684156920 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7f266006d540 0x7f266006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f266c00ce90 con 0x7f266006d540 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7f266c08d050 con 0x7f2684156920 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.851+0000 7f2681e00640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2660066f60 0x7f2660069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.855+0000 7f2682800640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7f266006d540 0x7f266006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:13.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.855+0000 7f2681e00640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2660066f60 0x7f2660069420 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f26740aa000 tx=0x7f26740b1040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.855+0000 7f2682800640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7f266006d540 0x7f266006f980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:13.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.855+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== osd.6 v2:172.21.15.167:6808/3449298510 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f266c00ce90 con 0x7f266006d540 2024-04-25T10:15:13.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.867+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 --> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f26840b1150 con 0x7f266006d540 2024-04-25T10:15:13.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.867+0000 7f267aa00640 1 -- 172.21.15.18:0/2240531230 <== osd.6 v2:172.21.15.167:6808/3449298510 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f26840b1150 con 0x7f266006d540 2024-04-25T10:15:13.873 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:13.873 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:13.873 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7f266006d540 msgr2=0x7f266006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6808/3449298510,v1:172.21.15.167:6810/3449298510] conn(0x7f266006d540 0x7f266006f980 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2660066f60 msgr2=0x7f2660069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2660066f60 0x7f2660069420 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f26740aa000 tx=0x7f26740b1040 comp rx=0 tx=0).stop 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 msgr2=0x7f268413f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 --2- 172.21.15.18:0/2240531230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2684156920 0x7f268413f890 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f266c011e30 tx=0x7f266c00f580 comp rx=0 tx=0).stop 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2682800640 1 -- 172.21.15.18:0/2240531230 reap_dead start 2024-04-25T10:15:13.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 shutdown_connections 2024-04-25T10:15:13.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 >> 172.21.15.18:0/2240531230 conn(0x7f268406f510 msgr2=0x7f26841612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:13.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 shutdown_connections 2024-04-25T10:15:13.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:13.871+0000 7f2689200640 1 -- 172.21.15.18:0/2240531230 wait complete. 2024-04-25T10:15:13.891 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T10:15:14.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.027+0000 7efcefa00640 1 Processor -- start 2024-04-25T10:15:14.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.027+0000 7efcefa00640 1 -- start start 2024-04-25T10:15:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.027+0000 7efcefa00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7efce815c9b0 0x7efce806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.027+0000 7efcefa00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efce806e010 0x7efce806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.027+0000 7efcefa00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce815fc00 con 0x7efce8159320 2024-04-25T10:15:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efcefa00640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce806d640 con 0x7efce806e010 2024-04-25T10:15:14.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efcefa00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce815fee0 con 0x7efce815c9b0 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efce806e010 0x7efce806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efce806e010 0x7efce806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56038/0 (socket says 172.21.15.18:56038) 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 -- 172.21.15.18:0/1388208540 learned_addr learned my addr 172.21.15.18:0/1388208540 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efce7e00640 1 --2- 172.21.15.18:0/1388208540 >> v2:172.21.15.167:3300/0 conn(0x7efce815c9b0 0x7efce806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 -- 172.21.15.18:0/1388208540 >> v2:172.21.15.167:3300/0 conn(0x7efce815c9b0 msgr2=0x7efce806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 --2- 172.21.15.18:0/1388208540 >> v2:172.21.15.167:3300/0 conn(0x7efce815c9b0 0x7efce806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 -- 172.21.15.18:0/1388208540 >> v1:172.21.15.167:6789/0 conn(0x7efce8159320 legacy=0x7efce815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 -- 172.21.15.18:0/1388208540 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce81601c0 con 0x7efce806e010 2024-04-25T10:15:14.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efceda00640 1 --2- 172.21.15.18:0/1388208540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce806e010 0x7efce806e4a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7efce80b4b50 tx=0x7efce001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=144b13edc8e6e344 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efce7400640 1 -- 172.21.15.18:0/1388208540 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00a56c0 con 0x7efce806e010 2024-04-25T10:15:14.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efce7400640 1 -- 172.21.15.18:0/1388208540 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce00a5860 con 0x7efce806e010 2024-04-25T10:15:14.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.031+0000 7efce7400640 1 -- 172.21.15.18:0/1388208540 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00a5c30 con 0x7efce806e010 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- 172.21.15.18:0/1388208540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce806e010 msgr2=0x7efce806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- 172.21.15.18:0/1388208540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce806e010 0x7efce806e4a0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7efce80b4b50 tx=0x7efce001c9f0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- 172.21.15.18:0/1388208540 shutdown_connections 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- 172.21.15.18:0/1388208540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce806e010 0x7efce806e4a0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- 172.21.15.18:0/1388208540 >> v2:172.21.15.167:3300/0 conn(0x7efce815c9b0 0x7efce806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- 172.21.15.18:0/1388208540 >> 172.21.15.18:0/1388208540 conn(0x7efce8067080 msgr2=0x7efce806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- 172.21.15.18:0/1388208540 shutdown_connections 2024-04-25T10:15:14.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- 172.21.15.18:0/1388208540 wait complete. 2024-04-25T10:15:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 Processor -- start 2024-04-25T10:15:14.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- start start 2024-04-25T10:15:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce806e010 0x7efce80b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8159320 0x7efce8140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce8168920 con 0x7efce815c9b0 2024-04-25T10:15:14.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce81687a0 con 0x7efce806e010 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efcefa00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce8168aa0 con 0x7efce8159320 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efceda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efceda00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56050/0 (socket says 172.21.15.18:56050) 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efceda00640 1 -- 172.21.15.18:0/1828280431 learned_addr learned my addr 172.21.15.18:0/1828280431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efced000640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce806e010 0x7efce80b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.035+0000 7efce7e00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8159320 0x7efce8140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 -- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8159320 msgr2=0x7efce8140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8159320 0x7efce8140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 -- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce806e010 msgr2=0x7efce80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce806e010 0x7efce80b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 -- 172.21.15.18:0/1828280431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce80b0420 con 0x7efce815c9b0 2024-04-25T10:15:14.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efceda00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7efce001a620 tx=0x7efce0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce00bc020 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce00b8670 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0009510 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce80b0700 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce815a810 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce80745d0 con 0x7efce815c9b0 2024-04-25T10:15:14.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efce00bf020 con 0x7efce815c9b0 2024-04-25T10:15:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 0x7efcc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7efce011fec0 con 0x7efce815c9b0 2024-04-25T10:15:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.039+0000 7efced000640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 0x7efcc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.043+0000 7efced000640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 0x7efcc8069420 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efce81453b0 tx=0x7efcdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.043+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efce00c6030 con 0x7efce815c9b0 2024-04-25T10:15:14.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.207+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efce8166280 con 0x7efcc8066f60 2024-04-25T10:15:14.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.207+0000 7efce4c00640 1 -- 172.21.15.18:0/1828280431 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efce8166280 con 0x7efcc8066f60 2024-04-25T10:15:14.212 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 msgr2=0x7efcc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 0x7efcc8069420 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7efce81453b0 tx=0x7efcdc009040 comp rx=0 tx=0).stop 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 msgr2=0x7efce8132e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7efce001a620 tx=0x7efce0019790 comp rx=0 tx=0).stop 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 shutdown_connections 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce815c9b0 0x7efce8132e60 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7efcc8066f60 0x7efcc8069420 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7efce8159320 0x7efce8140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 --2- 172.21.15.18:0/1828280431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efce806e010 0x7efce80b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 >> 172.21.15.18:0/1828280431 conn(0x7efce8067080 msgr2=0x7efce815d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 shutdown_connections 2024-04-25T10:15:14.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.211+0000 7efcefa00640 1 -- 172.21.15.18:0/1828280431 wait complete. 2024-04-25T10:15:14.234 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T10:15:14.234 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T10:15:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 Processor -- start 2024-04-25T10:15:14.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 -- start start 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd0f8071b70 0x7fd0f8066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fd0f8071f50 0x7fd0f80ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f806b990 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f8067090 con 0x7fd0f8071b70 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0ff600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f806dbd0 con 0x7fd0f8071f50 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fcc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd0f8071b70 0x7fd0f8066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fd600640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd0f80cf0d0 0x7fd0f80cf4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55654/0 (socket says 172.21.15.18:55654) 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fd600640 1 -- 172.21.15.18:0/2893552497 learned_addr learned my addr 172.21.15.18:0/2893552497 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0f7e00640 1 --2- 172.21.15.18:0/2893552497 >> v2:172.21.15.167:3300/0 conn(0x7fd0f8071f50 0x7fd0f80ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fcc00640 1 -- 172.21.15.18:0/2893552497 >> v2:172.21.15.167:3300/0 conn(0x7fd0f8071f50 msgr2=0x7fd0f80ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fcc00640 1 --2- 172.21.15.18:0/2893552497 >> v2:172.21.15.167:3300/0 conn(0x7fd0f8071f50 0x7fd0f80ceb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fcc00640 1 -- 172.21.15.18:0/2893552497 >> v1:172.21.15.18:6789/0 conn(0x7fd0f80cf0d0 legacy=0x7fd0f80cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0fcc00640 1 -- 172.21.15.18:0/2893552497 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f806bc70 con 0x7fd0f8071b70 2024-04-25T10:15:14.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.375+0000 7fd0f7400640 1 -- 172.21.15.18:0/2893552497 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369743851 0 0) 0x7fd0f806b990 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0fcc00640 1 --2- 172.21.15.18:0/2893552497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f8071b70 0x7fd0f8066b50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80b52e0 tx=0x7fd0ec01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf7c671762ed1fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0f7400640 1 -- 172.21.15.18:0/2893552497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0b2070 con 0x7fd0f8071b70 2024-04-25T10:15:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0f7400640 1 -- 172.21.15.18:0/2893552497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec0a9070 con 0x7fd0f8071b70 2024-04-25T10:15:14.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0f7400640 1 -- 172.21.15.18:0/2893552497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0ad880 con 0x7fd0f8071b70 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 -- 172.21.15.18:0/2893552497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f8071b70 msgr2=0x7fd0f8066b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 --2- 172.21.15.18:0/2893552497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f8071b70 0x7fd0f8066b50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80b52e0 tx=0x7fd0ec01c450 comp rx=0 tx=0).stop 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 -- 172.21.15.18:0/2893552497 shutdown_connections 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 --2- 172.21.15.18:0/2893552497 >> v2:172.21.15.167:3300/0 conn(0x7fd0f8071f50 0x7fd0f80ceb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 --2- 172.21.15.18:0/2893552497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f8071b70 0x7fd0f8066b50 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 -- 172.21.15.18:0/2893552497 >> 172.21.15.18:0/2893552497 conn(0x7fd0f80cfd80 msgr2=0x7fd0f80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 -- 172.21.15.18:0/2893552497 shutdown_connections 2024-04-25T10:15:14.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.379+0000 7fd0ff600640 1 -- 172.21.15.18:0/2893552497 wait complete. 2024-04-25T10:15:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 Processor -- start 2024-04-25T10:15:14.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- start start 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f8071b70 0x7fd0f8151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f8071f50 0x7fd0f8153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 0x7fd0f80b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80724e0 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f8072360 con 0x7fd0f8071b70 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f80b4d00 con 0x7fd0f8071f50 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 0x7fd0f80b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fcc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f8071b70 0x7fd0f8151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 0x7fd0f80b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56064/0 (socket says 172.21.15.18:56064) 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 -- 172.21.15.18:0/3015933348 learned_addr learned my addr 172.21.15.18:0/3015933348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0f7e00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f8071f50 0x7fd0f8153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 -- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f8071f50 msgr2=0x7fd0f8153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fd0f8071f50 0x7fd0f8153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 -- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f8071b70 msgr2=0x7fd0f8151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0f8071b70 0x7fd0f8151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f80b37b0 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0fd600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 0x7fd0f80b2dd0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c700 tx=0x7fd0f000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0018070 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f000ce10 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f8152950 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f000a860 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f8152510 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.383+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0f8152d40 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0f001b070 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d8066f60 0x7fd0d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fd0f0084b80 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7fd0d806d540 0x7fd0d806f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0f0016e70 con 0x7fd0d806d540 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0f0084f30 con 0x7fd0f80cf0d0 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0fcc00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d8066f60 0x7fd0d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f7e00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7fd0d806d540 0x7fd0d806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0f7e00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7fd0d806d540 0x7fd0d806f980 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.387+0000 7fd0fcc00640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d8066f60 0x7fd0d8069420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0af000 tx=0x7fd0ec0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.391+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== osd.7 v2:172.21.15.167:6809/19218082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd0f0016e70 con 0x7fd0d806d540 2024-04-25T10:15:14.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 --> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0f80745d0 con 0x7fd0d806d540 2024-04-25T10:15:14.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0f4c00640 1 -- 172.21.15.18:0/3015933348 <== osd.7 v2:172.21.15.167:6809/19218082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd0f80745d0 con 0x7fd0d806d540 2024-04-25T10:15:14.407 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-04-25T10:15:14.407 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T10:15:14.407 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-04-25T10:15:14.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7fd0d806d540 msgr2=0x7fd0d806f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6809/19218082,v1:172.21.15.167:6811/19218082] conn(0x7fd0d806d540 0x7fd0d806f980 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d8066f60 msgr2=0x7fd0d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fd0d8066f60 0x7fd0d8069420 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0af000 tx=0x7fd0ec0a7000 comp rx=0 tx=0).stop 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 msgr2=0x7fd0f80b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 --2- 172.21.15.18:0/3015933348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0f80cf0d0 0x7fd0f80b2dd0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c700 tx=0x7fd0f000cbc0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0fd600640 1 -- 172.21.15.18:0/3015933348 reap_dead start 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 shutdown_connections 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 >> 172.21.15.18:0/3015933348 conn(0x7fd0f80cfd80 msgr2=0x7fd0f80b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 shutdown_connections 2024-04-25T10:15:14.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.403+0000 7fd0ff600640 1 -- 172.21.15.18:0/3015933348 wait complete. 2024-04-25T10:15:14.426 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T10:15:14.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.563+0000 7fed60200640 1 Processor -- start 2024-04-25T10:15:14.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.563+0000 7fed60200640 1 -- start start 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed60200640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fed58159320 0x7fed5815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed60200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed5806e4a0 0x7fed5806e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed60200640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5815fc00 con 0x7fed5815f440 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed60200640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5806d640 con 0x7fed5806e4a0 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed60200640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5806ee10 con 0x7fed58159320 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5e200640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fed5806e4a0 0x7fed5806e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5ce00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fed5815f440 0x7fed5806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55668/0 (socket says 172.21.15.18:55668) 2024-04-25T10:15:14.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5ce00640 1 -- 172.21.15.18:0/1976948135 learned_addr learned my addr 172.21.15.18:0/1976948135 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5d800640 1 --2- 172.21.15.18:0/1976948135 >> v2:172.21.15.167:3300/0 conn(0x7fed58159320 0x7fed5815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5e200640 1 -- 172.21.15.18:0/1976948135 >> v2:172.21.15.167:3300/0 conn(0x7fed58159320 msgr2=0x7fed5815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5e200640 1 --2- 172.21.15.18:0/1976948135 >> v2:172.21.15.167:3300/0 conn(0x7fed58159320 0x7fed5815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5e200640 1 -- 172.21.15.18:0/1976948135 >> v1:172.21.15.18:6789/0 conn(0x7fed5815f440 legacy=0x7fed5806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed57e00640 1 -- 172.21.15.18:0/1976948135 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226598629 0 0) 0x7fed5815fc00 con 0x7fed5815f440 2024-04-25T10:15:14.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.567+0000 7fed5e200640 1 -- 172.21.15.18:0/1976948135 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5815fee0 con 0x7fed5806e4a0 2024-04-25T10:15:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed5e200640 1 --2- 172.21.15.18:0/1976948135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5806e4a0 0x7fed5806e8d0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fed5806e470 tx=0x7fed5001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f93c9acc12a85a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed57e00640 1 -- 172.21.15.18:0/1976948135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500b2070 con 0x7fed5806e4a0 2024-04-25T10:15:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed57e00640 1 -- 172.21.15.18:0/1976948135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500a5930 con 0x7fed5806e4a0 2024-04-25T10:15:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed57e00640 1 -- 172.21.15.18:0/1976948135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500a5d00 con 0x7fed5806e4a0 2024-04-25T10:15:14.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- 172.21.15.18:0/1976948135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5806e4a0 msgr2=0x7fed5806e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 --2- 172.21.15.18:0/1976948135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5806e4a0 0x7fed5806e8d0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fed5806e470 tx=0x7fed5001c870 comp rx=0 tx=0).stop 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- 172.21.15.18:0/1976948135 shutdown_connections 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 --2- 172.21.15.18:0/1976948135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5806e4a0 0x7fed5806e8d0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 --2- 172.21.15.18:0/1976948135 >> v2:172.21.15.167:3300/0 conn(0x7fed58159320 0x7fed5815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- 172.21.15.18:0/1976948135 >> 172.21.15.18:0/1976948135 conn(0x7fed58067080 msgr2=0x7fed5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- 172.21.15.18:0/1976948135 shutdown_connections 2024-04-25T10:15:14.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- 172.21.15.18:0/1976948135 wait complete. 2024-04-25T10:15:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 Processor -- start 2024-04-25T10:15:14.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.571+0000 7fed60200640 1 -- start start 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed5806e4a0 0x7fed5813d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed58159320 0x7fed5813dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5815f860 con 0x7fed5815f440 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed58159700 con 0x7fed5806e4a0 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5815f9e0 con 0x7fed58159320 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56084/0 (socket says 172.21.15.18:56084) 2024-04-25T10:15:14.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 -- 172.21.15.18:0/4291390461 learned_addr learned my addr 172.21.15.18:0/4291390461 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5ce00640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed58159320 0x7fed5813dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5d800640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed5806e4a0 0x7fed5813d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 -- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed58159320 msgr2=0x7fed5813dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed58159320 0x7fed5813dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 -- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed5806e4a0 msgr2=0x7fed5813d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed5806e4a0 0x7fed5813d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 -- 172.21.15.18:0/4291390461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5813e770 con 0x7fed5815f440 2024-04-25T10:15:14.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed5e200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fed50019480 tx=0x7fed50019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500bb030 con 0x7fed5815f440 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed500ad440 con 0x7fed5815f440 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500b2040 con 0x7fed5815f440 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5813ea50 con 0x7fed5815f440 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed580afe80 con 0x7fed5815f440 2024-04-25T10:15:14.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed580745d0 con 0x7fed5815f440 2024-04-25T10:15:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.575+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed500be070 con 0x7fed5815f440 2024-04-25T10:15:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.579+0000 7fed55600640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 0x7fed38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.579+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fed50002020 con 0x7fed5815f440 2024-04-25T10:15:14.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.579+0000 7fed5d800640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 0x7fed38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.579+0000 7fed5d800640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 0x7fed38069420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007a60 tx=0x7fed4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.583+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed50016520 con 0x7fed5815f440 2024-04-25T10:15:14.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fed580b00c0 con 0x7fed38066f60 2024-04-25T10:15:14.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed55600640 1 -- 172.21.15.18:0/4291390461 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fed4c010990 con 0x7fed38066f60 2024-04-25T10:15:14.747 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T10:15:14.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 msgr2=0x7fed38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 0x7fed38069420 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fed4c007a60 tx=0x7fed4c008040 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 msgr2=0x7fed5813e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.743+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fed50019480 tx=0x7fed50019610 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 shutdown_connections 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed5815f440 0x7fed5813e140 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fed38066f60 0x7fed38069420 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fed58159320 0x7fed5813dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 --2- 172.21.15.18:0/4291390461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed5806e4a0 0x7fed5813d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 >> 172.21.15.18:0/4291390461 conn(0x7fed58067080 msgr2=0x7fed58144c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 shutdown_connections 2024-04-25T10:15:14.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.747+0000 7fed60200640 1 -- 172.21.15.18:0/4291390461 wait complete. 2024-04-25T10:15:14.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:15:14.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 Processor -- start 2024-04-25T10:15:14.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 -- start start 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c2415b5a0 0x7f2c240cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7f2c240cc440 0x7f2c240d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c240ce7f0 con 0x7f2c2415b980 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240cfcd0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c2b000640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c240cead0 con 0x7f2c240cc440 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c2415b5a0 0x7f2c240cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c2415b5a0 0x7f2c240cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56088/0 (socket says 172.21.15.18:56088) 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 -- 172.21.15.18:0/1973776121 learned_addr learned my addr 172.21.15.18:0/1973776121 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c29000640 1 --2- 172.21.15.18:0/1973776121 >> v2:172.21.15.167:3300/0 conn(0x7f2c240cc440 0x7f2c240d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 -- 172.21.15.18:0/1973776121 >> v2:172.21.15.167:3300/0 conn(0x7f2c240cc440 msgr2=0x7f2c240d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:14.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 --2- 172.21.15.18:0/1973776121 >> v2:172.21.15.167:3300/0 conn(0x7f2c240cc440 0x7f2c240d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 -- 172.21.15.18:0/1973776121 >> v1:172.21.15.167:6789/0 conn(0x7f2c2415b980 legacy=0x7f2c240cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.907+0000 7f2c23e00640 1 -- 172.21.15.18:0/1973776121 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240cf960 con 0x7f2c2415b5a0 2024-04-25T10:15:14.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c23e00640 1 --2- 172.21.15.18:0/1973776121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c240cdea0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2c24070860 tx=0x7f2c1401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e59452a14332efb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c23400640 1 -- 172.21.15.18:0/1973776121 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140a9400 con 0x7f2c2415b5a0 2024-04-25T10:15:14.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c23400640 1 -- 172.21.15.18:0/1973776121 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140a95a0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c23400640 1 -- 172.21.15.18:0/1973776121 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140a9970 con 0x7f2c2415b5a0 2024-04-25T10:15:14.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 -- 172.21.15.18:0/1973776121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 msgr2=0x7f2c240cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 --2- 172.21.15.18:0/1973776121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c240cdea0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f2c24070860 tx=0x7f2c1401c520 comp rx=0 tx=0).stop 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 -- 172.21.15.18:0/1973776121 shutdown_connections 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 --2- 172.21.15.18:0/1973776121 >> v2:172.21.15.167:3300/0 conn(0x7f2c240cc440 0x7f2c240d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 --2- 172.21.15.18:0/1973776121 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c240cdea0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 -- 172.21.15.18:0/1973776121 >> 172.21.15.18:0/1973776121 conn(0x7f2c240b3390 msgr2=0x7f2c240b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 -- 172.21.15.18:0/1973776121 shutdown_connections 2024-04-25T10:15:14.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.911+0000 7f2c2b000640 1 -- 172.21.15.18:0/1973776121 wait complete. 2024-04-25T10:15:14.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 Processor -- start 2024-04-25T10:15:14.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- start start 2024-04-25T10:15:14.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240cc440 0x7f2c24147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c2415b980 0x7f2c241f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240d1280 con 0x7f2c2415b5a0 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240d1100 con 0x7f2c2415b980 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240d1400 con 0x7f2c240cc440 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c29000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c2415b980 0x7f2c241f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56090/0 (socket says 172.21.15.18:56090) 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 -- 172.21.15.18:0/3276859865 learned_addr learned my addr 172.21.15.18:0/3276859865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c23e00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240cc440 0x7f2c24147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 -- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240cc440 msgr2=0x7f2c24147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240cc440 0x7f2c24147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 -- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c2415b980 msgr2=0x7f2c241f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:14.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c2415b980 0x7f2c241f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 -- 172.21.15.18:0/3276859865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2414a5e0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c1be00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c450 tx=0x7f2c0c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c016020 con 0x7f2c2415b5a0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0c0052d0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2414a8c0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c007260 con 0x7f2c2415b5a0 2024-04-25T10:15:14.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.915+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2414ae80 con 0x7f2c2415b5a0 2024-04-25T10:15:14.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c240745d0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2c0c007400 con 0x7f2c2415b5a0 2024-04-25T10:15:14.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c20c00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 0x7f2c00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:14.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f2c0c0847c0 con 0x7f2c2415b5a0 2024-04-25T10:15:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c23e00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 0x7f2c00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:14.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.919+0000 7f2c23e00640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 0x7f2c00069420 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ae000 tx=0x7f2c14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:14.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:14.923+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2c0c020020 con 0x7f2c2415b5a0 2024-04-25T10:15:15.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.083+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2c240cc960 con 0x7f2c00066f60 2024-04-25T10:15:15.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c20c00640 1 -- 172.21.15.18:0/3276859865 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13390 (secure 0 0 0) 0x7f2c240cc960 con 0x7f2c00066f60 2024-04-25T10:15:15.090 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:15.090 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 msgr2=0x7f2c00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 0x7f2c00069420 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ae000 tx=0x7f2c14008040 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 msgr2=0x7f2c24137cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00c450 tx=0x7f2c0c00c910 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 shutdown_connections 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c2415b980 0x7f2c241f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c2415b5a0 0x7f2c24137cc0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7f2c00066f60 0x7f2c00069420 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 --2- 172.21.15.18:0/3276859865 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7f2c240cc440 0x7f2c24147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 >> 172.21.15.18:0/3276859865 conn(0x7f2c240b3390 msgr2=0x7f2c240b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 shutdown_connections 2024-04-25T10:15:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:15.087+0000 7f2c2b000640 1 -- 172.21.15.18:0/3276859865 wait complete. 2024-04-25T10:15:15.111 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2024-04-25T10:15:13.572718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263076,"kb_used_data":13608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711644,"statfs":{"total":773094113280,"available":772824723456,"internally_reserved":0,"allocated":13934592,"data_stored":7150768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.491912"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":371,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-25T10:15:07.332546+0000","last_change":"2024-04-25T10:03:44.774873+0000","last_active":"2024-04-25T10:15:07.332546+0000","last_peered":"2024-04-25T10:15:07.332546+0000","last_clean":"2024-04-25T10:15:07.332546+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:15:07.332546+0000","last_undegraded":"2024-04-25T10:15:07.332546+0000","last_fullsized":"2024-04-25T10:15:07.332546+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T10:03:43.681472+0000","last_clean_scrub_stamp":"2024-04-25T10:03:43.681472+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:19:27.381937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509582,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2187264,"data_stored":1336622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509583,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509581,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509580,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542284,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542286,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542284,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33320,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338520,"statfs":{"total":96636764160,"available":96602644480,"internally_reserved":0,"allocated":2187264,"data_stored":1336622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:15:15.114 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T10:03:43.681472+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=3, tm_sec=43, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=10, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T10:15:15.114 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T10:15:21.822 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:21.827 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:35.116 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T10:15:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 Processor -- start 2024-04-25T10:15:35.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 -- start start 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fad60145270 0x7fad6015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad600cd4d0 0x7fad600cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad600b1750 0x7fad600b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600b20e0 con 0x7fad600b1750 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad60145650 con 0x7fad60145270 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad68400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600cc4e0 con 0x7fad600cd4d0 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad600b1750 0x7fad600b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad600b1750 0x7fad600b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60234/0 (socket says 172.21.15.18:60234) 2024-04-25T10:15:35.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 -- 172.21.15.18:0/2923257433 learned_addr learned my addr 172.21.15.18:0/2923257433 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad65a00640 1 --2- 172.21.15.18:0/2923257433 >> v2:172.21.15.167:3300/0 conn(0x7fad60145270 0x7fad6015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad65000640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad600cd4d0 0x7fad600cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 -- 172.21.15.18:0/2923257433 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad600cd4d0 msgr2=0x7fad600cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad600cd4d0 0x7fad600cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 -- 172.21.15.18:0/2923257433 >> v2:172.21.15.167:3300/0 conn(0x7fad60145270 msgr2=0x7fad6015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 --2- 172.21.15.18:0/2923257433 >> v2:172.21.15.167:3300/0 conn(0x7fad60145270 0x7fad6015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.267+0000 7fad66400640 1 -- 172.21.15.18:0/2923257433 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600ce040 con 0x7fad600b1750 2024-04-25T10:15:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad66400640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600b1ba0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fad6006f3a0 tx=0x7fad5801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909dad07fd217c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad5fe00640 1 -- 172.21.15.18:0/2923257433 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a5760 con 0x7fad600b1750 2024-04-25T10:15:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad5fe00640 1 -- 172.21.15.18:0/2923257433 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad580a5900 con 0x7fad600b1750 2024-04-25T10:15:35.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad5fe00640 1 -- 172.21.15.18:0/2923257433 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad580a5cd0 con 0x7fad600b1750 2024-04-25T10:15:35.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 -- 172.21.15.18:0/2923257433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 msgr2=0x7fad600b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600b1ba0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fad6006f3a0 tx=0x7fad5801c9f0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 -- 172.21.15.18:0/2923257433 shutdown_connections 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600b1ba0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 --2- 172.21.15.18:0/2923257433 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad600cd4d0 0x7fad600cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 --2- 172.21.15.18:0/2923257433 >> v2:172.21.15.167:3300/0 conn(0x7fad60145270 0x7fad6015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 -- 172.21.15.18:0/2923257433 >> 172.21.15.18:0/2923257433 conn(0x7fad60066fa0 msgr2=0x7fad6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 -- 172.21.15.18:0/2923257433 shutdown_connections 2024-04-25T10:15:35.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.271+0000 7fad68400640 1 -- 172.21.15.18:0/2923257433 wait complete. 2024-04-25T10:15:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 Processor -- start 2024-04-25T10:15:35.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- start start 2024-04-25T10:15:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600cd4d0 0x7fad6013d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad60145270 0x7fad6015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6015c590 con 0x7fad600b1750 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6015f930 con 0x7fad600cd4d0 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6015c710 con 0x7fad60145270 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60238/0 (socket says 172.21.15.18:60238) 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 -- 172.21.15.18:0/1811295997 learned_addr learned my addr 172.21.15.18:0/1811295997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65000640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600cd4d0 0x7fad6013d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad66400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad60145270 0x7fad6015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 -- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad60145270 msgr2=0x7fad6015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad60145270 0x7fad6015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 -- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600cd4d0 msgr2=0x7fad6013d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600cd4d0 0x7fad6013d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 -- 172.21.15.18:0/1811295997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600ae460 con 0x7fad600b1750 2024-04-25T10:15:35.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad65a00640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fad5400d5f0 tx=0x7fad5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540125f0 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad54019070 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540129b0 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad600ae740 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.275+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad60140110 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad600745d0 con 0x7fad600b1750 2024-04-25T10:15:35.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fad54012b50 con 0x7fad600b1750 2024-04-25T10:15:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad5d600640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 0x7fad40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fad540852d0 con 0x7fad600b1750 2024-04-25T10:15:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad65000640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 0x7fad40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.279+0000 7fad65000640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 0x7fad40069420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fad600b1de0 tx=0x7fad4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.283+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad54055cb0 con 0x7fad600b1750 2024-04-25T10:15:35.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.439+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 --> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fad600ae910 con 0x7fad40066f60 2024-04-25T10:15:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad5d600640 1 -- 172.21.15.18:0/1811295997 <== mgr.4105 v2:172.21.15.167:6832/2114050973 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7fad600ae910 con 0x7fad40066f60 2024-04-25T10:15:35.446 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:35.446 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 msgr2=0x7fad40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 0x7fad40069420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fad600b1de0 tx=0x7fad4c008040 comp rx=0 tx=0).stop 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 msgr2=0x7fad600add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fad5400d5f0 tx=0x7fad5400dab0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 shutdown_connections 2024-04-25T10:15:35.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fad40066f60 0x7fad40069420 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fad60145270 0x7fad6015dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600cd4d0 0x7fad6013d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 --2- 172.21.15.18:0/1811295997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad600b1750 0x7fad600add80 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 >> 172.21.15.18:0/1811295997 conn(0x7fad60066fa0 msgr2=0x7fad6013f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 shutdown_connections 2024-04-25T10:15:35.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.443+0000 7fad68400640 1 -- 172.21.15.18:0/1811295997 wait complete. 2024-04-25T10:15:35.468 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":477,"stamp":"2024-04-25T10:15:33.577142+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263060,"kb_used_data":13608,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711660,"statfs":{"total":773094113280,"available":772824739840,"internally_reserved":0,"allocated":13934592,"data_stored":7150768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002455"},"pg_stats":[{"pgid":"1.0","version":"128'119","reported_seq":382,"reported_epoch":128,"state":"active+clean","last_fresh":"2024-04-25T10:15:15.454798+0000","last_change":"2024-04-25T10:15:15.454832+0000","last_active":"2024-04-25T10:15:15.454798+0000","last_peered":"2024-04-25T10:15:15.454798+0000","last_clean":"2024-04-25T10:15:15.454798+0000","last_became_active":"2024-04-25T10:03:44.773768+0000","last_became_peered":"2024-04-25T10:03:44.773768+0000","last_unstale":"2024-04-25T10:15:15.454798+0000","last_undegraded":"2024-04-25T10:15:15.454798+0000","last_fullsized":"2024-04-25T10:15:15.454798+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"128'119","last_scrub_stamp":"2024-04-25T10:15:15.454717+0000","last_deep_scrub":"128'119","last_deep_scrub_stamp":"2024-04-25T10:15:15.454717+0000","last_clean_scrub_stamp":"2024-04-25T10:15:15.454717+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:09:08.575910+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509586,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2187264,"data_stored":1336622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509587,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509585,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509584,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542288,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32736,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339104,"statfs":{"total":96636764160,"available":96603242496,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542290,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32740,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1593344,"data_stored":746254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542288,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33312,"kb_used_data":2136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338528,"statfs":{"total":96636764160,"available":96602652672,"internally_reserved":0,"allocated":2187264,"data_stored":1336622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T10:15:35.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T10:15:35.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.603+0000 7ff6af600640 1 Processor -- start 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.603+0000 7ff6af600640 1 -- start start 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff6a815dd90 0x7ff6a8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7ff6a8072040 0x7ff6a8161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8161cc0 0x7ff6a8162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a80b2dc0 con 0x7ff6a815dd90 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a8072460 con 0x7ff6a8072040 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6af600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a806ac10 con 0x7ff6a8161cc0 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff6a815dd90 0x7ff6a8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff6a815dd90 0x7ff6a8071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60244/0 (socket says 172.21.15.18:60244) 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 -- 172.21.15.18:0/3613998445 learned_addr learned my addr 172.21.15.18:0/3613998445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6ad600640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8161cc0 0x7ff6a8162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff69fe00640 1 --2- 172.21.15.18:0/3613998445 >> v2:172.21.15.167:3300/0 conn(0x7ff6a8072040 0x7ff6a8161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 -- 172.21.15.18:0/3613998445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8161cc0 msgr2=0x7ff6a8162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8161cc0 0x7ff6a8162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 -- 172.21.15.18:0/3613998445 >> v2:172.21.15.167:3300/0 conn(0x7ff6a8072040 msgr2=0x7ff6a8161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 --2- 172.21.15.18:0/3613998445 >> v2:172.21.15.167:3300/0 conn(0x7ff6a8072040 0x7ff6a8161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.607+0000 7ff6acc00640 1 -- 172.21.15.18:0/3613998445 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a806aeb0 con 0x7ff6a815dd90 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6acc00640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8071b00 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80d0cc0 tx=0x7ff69801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dba20423683778 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6a7e00640 1 -- 172.21.15.18:0/3613998445 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980b0070 con 0x7ff6a815dd90 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6a7e00640 1 -- 172.21.15.18:0/3613998445 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6980ab600 con 0x7ff6a815dd90 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6a7e00640 1 -- 172.21.15.18:0/3613998445 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6980ab9d0 con 0x7ff6a815dd90 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- 172.21.15.18:0/3613998445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 msgr2=0x7ff6a8071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8071b00 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7ff6a80d0cc0 tx=0x7ff69801c490 comp rx=0 tx=0).stop 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- 172.21.15.18:0/3613998445 shutdown_connections 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8161cc0 0x7ff6a8162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- 172.21.15.18:0/3613998445 >> v2:172.21.15.167:3300/0 conn(0x7ff6a8072040 0x7ff6a8161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- 172.21.15.18:0/3613998445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8071b00 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- 172.21.15.18:0/3613998445 >> 172.21.15.18:0/3613998445 conn(0x7ff6a80cfd90 msgr2=0x7ff6a80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:35.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- 172.21.15.18:0/3613998445 shutdown_connections 2024-04-25T10:15:35.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- 172.21.15.18:0/3613998445 wait complete. 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 Processor -- start 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- start start 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8072040 0x7ff6a815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8161cc0 0x7ff6a8155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80ce620 con 0x7ff6a815dd90 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80ce4a0 con 0x7ff6a8161cc0 2024-04-25T10:15:35.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.611+0000 7ff6af600640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80ce7a0 con 0x7ff6a8072040 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60258/0 (socket says 172.21.15.18:60258) 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 -- 172.21.15.18:0/862711820 learned_addr learned my addr 172.21.15.18:0/862711820 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6acc00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8072040 0x7ff6a815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6ad600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8161cc0 0x7ff6a8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 -- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8072040 msgr2=0x7ff6a815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8072040 0x7ff6a815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 -- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8161cc0 msgr2=0x7ff6a8155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8161cc0 0x7ff6a8155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 -- 172.21.15.18:0/862711820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a806f0c0 con 0x7ff6a815dd90 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff69fe00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d830 tx=0x7ff69000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000b6c0 con 0x7ff6a815dd90 2024-04-25T10:15:35.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff690019070 con 0x7ff6a815dd90 2024-04-25T10:15:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69000ba60 con 0x7ff6a815dd90 2024-04-25T10:15:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a815c950 con 0x7ff6a815dd90 2024-04-25T10:15:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a813e540 con 0x7ff6a815dd90 2024-04-25T10:15:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80745d0 con 0x7ff6a815dd90 2024-04-25T10:15:35.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff69001e460 con 0x7ff6a815dd90 2024-04-25T10:15:35.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.615+0000 7ff6a5600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 0x7ff684069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.619+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff6900854c0 con 0x7ff6a815dd90 2024-04-25T10:15:35.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.619+0000 7ff6acc00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 0x7ff684069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.619+0000 7ff6acc00640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 0x7ff684069420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6980ad000 tx=0x7ff698008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.619+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff690055f30 con 0x7ff6a815dd90 2024-04-25T10:15:35.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.779+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff6a8153ca0 con 0x7ff6a815dd90 2024-04-25T10:15:35.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.783+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff690059fd0 con 0x7ff6a815dd90 2024-04-25T10:15:35.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.783+0000 7ff6a5600640 1 -- 172.21.15.18:0/862711820 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff69005e590 con 0x7ff6a815dd90 2024-04-25T10:15:35.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 msgr2=0x7ff684069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 0x7ff684069420 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6980ad000 tx=0x7ff698008040 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 msgr2=0x7ff6a8155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7ff69000d830 tx=0x7ff69000dcf0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 shutdown_connections 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8161cc0 0x7ff6a8155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6a815dd90 0x7ff6a8155410 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7ff684066f60 0x7ff684069420 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 --2- 172.21.15.18:0/862711820 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7ff6a8072040 0x7ff6a815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 >> 172.21.15.18:0/862711820 conn(0x7ff6a80cfd90 msgr2=0x7ff6a815fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 shutdown_connections 2024-04-25T10:15:35.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.787+0000 7ff6af600640 1 -- 172.21.15.18:0/862711820 wait complete. 2024-04-25T10:15:35.810 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T10:15:35.813 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T10:15:35.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 Processor -- start 2024-04-25T10:15:35.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 -- start start 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 --2- >> v2:172.21.15.167:3300/0 conn(0x7fb4a0099a60 0x7fb4a0099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a009a380 con 0x7fb4a015ee00 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 -- --> v1:172.21.15.167:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a006c650 con 0x7fb4a00cff30 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a6a00640 1 -- --> v2:172.21.15.167:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a006c430 con 0x7fb4a0099a60 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb4a015ee00 0x7fb4a006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51558/0 (socket says 172.21.15.18:51558) 2024-04-25T10:15:35.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 -- 172.21.15.18:0/2882860816 learned_addr learned my addr 172.21.15.18:0/2882860816 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-04-25T10:15:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142708599 0 0) 0x7fb4a009a380 con 0x7fb4a015ee00 2024-04-25T10:15:35.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49fe00640 1 --2- 172.21.15.18:0/2882860816 >> v2:172.21.15.167:3300/0 conn(0x7fb4a0099a60 0x7fb4a0099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb484003530 con 0x7fb4a015ee00 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199272669 0 0) 0x7fb484003530 con 0x7fb4a015ee00 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 >> v2:172.21.15.167:3300/0 conn(0x7fb4a0099a60 msgr2=0x7fb4a0099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 --2- 172.21.15.18:0/2882860816 >> v2:172.21.15.167:3300/0 conn(0x7fb4a0099a60 0x7fb4a0099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 >> v1:172.21.15.167:6789/0 conn(0x7fb4a00cff30 legacy=0x7fb4a00d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a006c930 con 0x7fb4a015ee00 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1935015662 0 0) 0x7fb48c001680 con 0x7fb4a015ee00 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 >> v1:172.21.15.18:6789/0 conn(0x7fb4a015ee00 legacy=0x7fb4a006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4840039c0 0x7fb484003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 0x7fb484004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4840051d0 0x7fb48400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a006c430 con 0x7fb484004810 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48400c070 con 0x7fb4840039c0 2024-04-25T10:15:35.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48400c270 con 0x7fb4840051d0 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 0x7fb484004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49fe00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4840039c0 0x7fb484003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a4a00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4840051d0 0x7fb48400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 -- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4840051d0 msgr2=0x7fb48400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb4840051d0 0x7fb48400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 -- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4840039c0 msgr2=0x7fb484003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4840039c0 0x7fb484003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb49f400640 1 -- 172.21.15.18:0/2882860816 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb484003530 con 0x7fb484004810 2024-04-25T10:15:35.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.951+0000 7fb4a4a00640 1 -- 172.21.15.18:0/2882860816 reap_dead start 2024-04-25T10:15:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb49f400640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 0x7fb484004c90 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb4a015f260 tx=0x7fb48c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4744bbc2c61dea2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c007d40 con 0x7fb484004810 2024-04-25T10:15:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb48c005b00 con 0x7fb484004810 2024-04-25T10:15:35.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb49ea00640 1 -- 172.21.15.18:0/2882860816 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c007070 con 0x7fb484004810 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 -- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 msgr2=0x7fb484004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 0x7fb484004c90 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fb4a015f260 tx=0x7fb48c01f3d0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 -- 172.21.15.18:0/2882860816 shutdown_connections 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/2882860816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb484004810 0x7fb484004c90 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 -- 172.21.15.18:0/2882860816 >> 172.21.15.18:0/2882860816 conn(0x7fb4a00d17a0 msgr2=0x7fb4a00d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 -- 172.21.15.18:0/2882860816 shutdown_connections 2024-04-25T10:15:35.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.955+0000 7fb4a6a00640 1 -- 172.21.15.18:0/2882860816 wait complete. 2024-04-25T10:15:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 Processor -- start 2024-04-25T10:15:35.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- start start 2024-04-25T10:15:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 --2- >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb484004810 0x7fb4a01f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a006f5f0 0x7fb4a006fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00cf9e0 con 0x7fb4a00b61d0 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a006cef0 con 0x7fb4a006f5f0 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- --> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015de80 con 0x7fb484004810 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:60276/0 (socket says 172.21.15.18:60276) 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 -- 172.21.15.18:0/3114496480 learned_addr learned my addr 172.21.15.18:0/3114496480 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49fe00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb484004810 0x7fb4a01f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a4a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a006f5f0 0x7fb4a006fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 -- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb484004810 msgr2=0x7fb4a01f8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb484004810 0x7fb4a01f8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 -- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a006f5f0 msgr2=0x7fb4a006fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a006f5f0 0x7fb4a006fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:35.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 -- 172.21.15.18:0/3114496480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a01f86d0 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb49f400640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb48c001980 tx=0x7fb484005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c001640 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb48c0b6070 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a00b6790 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c004a30 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.959+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a01f4760 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a006ffb0 con 0x7fb4a00b61d0 2024-04-25T10:15:35.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb48c0b8020 con 0x7fb4a00b61d0 2024-04-25T10:15:35.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb497e00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 0x7fb480069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T10:15:35.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb48c1224d0 con 0x7fb4a00b61d0 2024-04-25T10:15:35.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb49fe00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 0x7fb480069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T10:15:35.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.963+0000 7fb49fe00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 0x7fb480069420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb490009ba0 tx=0x7fb490008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T10:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:35.967+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb48c0190e0 con 0x7fb4a00b61d0 2024-04-25T10:15:36.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.163+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4a00745d0 con 0x7fb4a00b61d0 2024-04-25T10:15:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb497e00640 1 -- 172.21.15.18:0/3114496480 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+3706 (secure 0 0 0) 0x7fb48c0f3470 con 0x7fb4a00b61d0 2024-04-25T10:15:36.169 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-04-25T10:15:36.169 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":116,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8305,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/726747882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":726747882},{"type":"v1","addr":"172.21.15.18:6835","nonce":726747882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":96},{"gid":8707,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/2895129430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6835","nonce":2895129430},{"type":"v1","addr":"172.21.15.167:6837","nonce":2895129430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":109},{"gid":9006,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1247855469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1247855469},{"type":"v1","addr":"172.21.15.18:6833","nonce":1247855469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95},{"gid":37784,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6836/2327064051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2327064051},{"type":"v1","addr":"172.21.15.167:6836","nonce":2327064051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":116}],"filesystems":[]} 2024-04-25T10:15:36.169 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 116 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 msgr2=0x7fb480069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 0x7fb480069420 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb490009ba0 tx=0x7fb490008040 comp rx=0 tx=0).stop 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 msgr2=0x7fb4a01f1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fb48c001980 tx=0x7fb484005840 comp rx=0 tx=0).stop 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 shutdown_connections 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4a006f5f0 0x7fb4a006fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4a00b61d0 0x7fb4a01f1590 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:36.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:6832/2114050973,v1:172.21.15.167:6833/2114050973] conn(0x7fb480066f60 0x7fb480069420 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 --2- 172.21.15.18:0/3114496480 >> [v2:172.21.15.167:3301/0,v1:172.21.15.167:6790/0] conn(0x7fb484004810 0x7fb4a01f8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T10:15:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 >> 172.21.15.18:0/3114496480 conn(0x7fb4a00d17a0 msgr2=0x7fb4a0099e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T10:15:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 shutdown_connections 2024-04-25T10:15:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-04-25T10:15:36.167+0000 7fb4a6a00640 1 -- 172.21.15.18:0/3114496480 wait complete. 2024-04-25T10:15:36.191 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T10:15:36.191 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T10:15:36.192 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T10:15:36.192 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.203 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T10:15:36.203 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T10:15:36.203 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.255 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T10:15:36.256 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T10:15:36.256 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.270 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T10:15:36.270 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T10:15:36.270 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.324 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T10:15:36.324 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T10:15:36.324 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T10:15:36.325 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.402 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T10:15:36.402 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T10:15:36.402 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.498 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T10:15:36.499 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T10:15:36.499 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:36.589 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T10:15:36.590 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T10:15:36.590 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:41.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T10:15:42.691 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T10:15:42.692 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T10:15:42.692 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:42.758 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T10:15:42.759 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T10:15:42.759 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:47.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-04-25T10:15:47.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T10:15:48.861 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T10:15:48.861 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T10:15:48.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:48.922 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T10:15:48.922 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T10:15:48.922 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.001 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T10:15:49.002 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T10:15:49.002 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T10:15:49.002 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.060 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T10:15:49.060 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T10:15:49.060 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.122 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T10:15:49.122 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T10:15:49.122 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T10:15:49.122 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.143 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T10:15:49.143 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T10:15:49.143 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.160 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T10:15:49.160 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T10:15:49.160 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T10:15:49.220 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T10:15:49.220 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T10:15:49.220 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T10:15:49.255 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:15:49.255 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T10:15:49.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:15:49.470 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T10:15:49.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:15:49.643 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T10:15:49.945 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:15:49.945 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T10:15:50.118 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:15:50.118 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T10:15:50.308 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:15:50.309 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T10:15:50.486 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:15:50.486 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T10:15:50.676 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:15:50.677 DEBUG:teuthology.orchestra.run.smithi167:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T10:15:50.845 INFO:tasks.ceph:Archiving mon data... 2024-04-25T10:15:50.846 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/data/mon.a.tgz 2024-04-25T10:15:50.846 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-04-25T10:15:50.855 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.Dv3tUbvSzF 2024-04-25T10:15:50.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Dv3tUbvSzF 2024-04-25T10:15:51.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.Dv3tUbvSzF 2024-04-25T10:15:51.082 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.Dv3tUbvSzF is 440KB 2024-04-25T10:15:51.147 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.Dv3tUbvSzF 2024-04-25T10:15:51.155 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/data/mon.b.tgz 2024-04-25T10:15:51.155 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-04-25T10:15:51.165 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.hJQaXfWJdV 2024-04-25T10:15:51.166 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.hJQaXfWJdV 2024-04-25T10:15:51.317 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.hJQaXfWJdV 2024-04-25T10:15:51.393 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.hJQaXfWJdV is 452KB 2024-04-25T10:15:51.458 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.hJQaXfWJdV 2024-04-25T10:15:51.466 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/data/mon.c.tgz 2024-04-25T10:15:51.467 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-04-25T10:15:51.515 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.cxLp04fudo 2024-04-25T10:15:51.515 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.cxLp04fudo 2024-04-25T10:15:51.661 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.cxLp04fudo 2024-04-25T10:15:51.736 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.cxLp04fudo is 453KB 2024-04-25T10:15:51.798 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.cxLp04fudo 2024-04-25T10:15:51.807 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T10:15:51.807 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:15:51.810 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T10:15:51.878 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:51.881 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:15:51.915 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T10:15:51.915 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T10:15:51.917 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi018/crash 2024-04-25T10:15:51.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:15:51.927 DEBUG:teuthology.orchestra.run.smithi167:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:51.948 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi167/crash 2024-04-25T10:15:51.949 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T10:15:51.980 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T10:15:52.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:52.040 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T10:15:52.082 INFO:tasks.ceph:Compressing logs... 2024-04-25T10:15:52.082 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:15:52.086 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T10:15:52.113 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2024-04-25T10:15:52.114 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-04-25T10:15:52.114 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37650.log 2024-04-25T10:15:52.115 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2024-04-25T10:15:52.115 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-04-25T10:15:52.115 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-04-25T10:15:52.116 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2024-04-25T10:15:52.116 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37650.log.gz 2024-04-25T10:15:52.117 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47659.log 2024-04-25T10:15:52.117 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-04-25T10:15:52.118 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-04-25T10:15:52.118 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2024-04-25T10:15:52.119 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46530.log 2024-04-25T10:15:52.119 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47659.log.gz 2024-04-25T10:15:52.119 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48274.log 2024-04-25T10:15:52.120 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-04-25T10:15:52.120 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49708.log 2024-04-25T10:15:52.121 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2%/var/log/ceph/ceph-client.admin.48274.log: -- replaced with /var/log/ceph/ceph-client.admin.46530.log.gz 2024-04-25T10:15:52.121 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46342.log 2024-04-25T10:15:52.122 INFO:teuthology.orchestra.run.smithi018.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.48274.log.gz 2024-04-25T10:15:52.122 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41723.log 2024-04-25T10:15:52.123 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49708.log.gz 2024-04-25T10:15:52.123 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35984.log 2024-04-25T10:15:52.123 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46342.log.gz 2024-04-25T10:15:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40227.log 2024-04-25T10:15:52.124 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41723.log.gz 2024-04-25T10:15:52.124 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51295.log 2024-04-25T10:15:52.125 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35984.log.gz 2024-04-25T10:15:52.125 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43582.log 2024-04-25T10:15:52.126 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40227.log.gz 2024-04-25T10:15:52.126 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36661.log 2024-04-25T10:15:52.127 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51295.log.gz 2024-04-25T10:15:52.127 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-04-25T10:15:52.127 INFO:teuthology.orchestra.run.smithi018.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.43582.log.gz 2024-04-25T10:15:52.128 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37195.log 2024-04-25T10:15:52.128 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36661.log.gz 2024-04-25T10:15:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-04-25T10:15:52.129 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-04-25T10:15:52.129 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38990.log 2024-04-25T10:15:52.130 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37195.log.gz 2024-04-25T10:15:52.130 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46368.log 2024-04-25T10:15:52.130 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-04-25T10:15:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-04-25T10:15:52.132 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38990.log.gz 2024-04-25T10:15:52.132 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-04-25T10:15:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50235.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46368.log.gz 2024-04-25T10:15:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46851.log 2024-04-25T10:15:52.133 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-04-25T10:15:52.133 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52627.log 2024-04-25T10:15:52.134 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-04-25T10:15:52.134 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47713.log 2024-04-25T10:15:52.135 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46851.log.gz 2024-04-25T10:15:52.135 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34258.log 2024-04-25T10:15:52.135 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52627.log.gz 2024-04-25T10:15:52.136 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47713.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T10:15:52.136 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47713.log.gz 2024-04-25T10:15:52.137 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.34258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40986.log 2024-04-25T10:15:52.137 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.34258.log.gz 2024-04-25T10:15:52.137 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51829.log 2024-04-25T10:15:52.138 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42207.log 2024-04-25T10:15:52.138 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40986.log.gz 2024-04-25T10:15:52.139 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35615.log 2024-04-25T10:15:52.139 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51829.log.gz 2024-04-25T10:15:52.140 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51673.log 2024-04-25T10:15:52.141 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42207.log.gz 2024-04-25T10:15:52.141 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51374.log 2024-04-25T10:15:52.142 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-04-25T10:15:52.142 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39204.log 2024-04-25T10:15:52.142 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51673.log.gz 2024-04-25T10:15:52.143 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48823.log 2024-04-25T10:15:52.143 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51374.log.gz 2024-04-25T10:15:52.144 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46011.log 2024-04-25T10:15:52.144 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39204.log.gz 2024-04-25T10:15:52.144 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49630.log 2024-04-25T10:15:52.145 INFO:teuthology.orchestra.run.smithi018.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T10:15:52.145 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48823.log.gz 2024-04-25T10:15:52.145 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-04-25T10:15:52.146 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46011.log.gz 2024-04-25T10:15:52.146 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38680.log 2024-04-25T10:15:52.146 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49630.log.gz 2024-04-25T10:15:52.147 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32513.log 2024-04-25T10:15:52.147 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-04-25T10:15:52.148 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50521.log 2024-04-25T10:15:52.148 INFO:teuthology.orchestra.run.smithi018.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.38680.log.gz 2024-04-25T10:15:52.149 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44642.log 2024-04-25T10:15:52.149 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32513.log.gz 2024-04-25T10:15:52.149 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34790.log 2024-04-25T10:15:52.150 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50521.log.gz 2024-04-25T10:15:52.150 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52233.log 2024-04-25T10:15:52.150 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44642.log.gz 2024-04-25T10:15:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44776.log 2024-04-25T10:15:52.151 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34790.log.gz 2024-04-25T10:15:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48225.log 2024-04-25T10:15:52.152 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52233.log.gz 2024-04-25T10:15:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47631.log 2024-04-25T10:15:52.153 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44776.log.gz 2024-04-25T10:15:52.153 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40044.log 2024-04-25T10:15:52.153 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48225.log.gz 2024-04-25T10:15:52.154 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47791.log 2024-04-25T10:15:52.154 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47631.log.gz 2024-04-25T10:15:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42511.log 2024-04-25T10:15:52.155 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40044.log.gz 2024-04-25T10:15:52.156 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37442.log 2024-04-25T10:15:52.156 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47791.log.gz 2024-04-25T10:15:52.156 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53069.log 2024-04-25T10:15:52.157 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42511.log.gz 2024-04-25T10:15:52.157 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38334.log 2024-04-25T10:15:52.157 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37442.log.gz 2024-04-25T10:15:52.158 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27831.log 2024-04-25T10:15:52.158 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27807.log 2024-04-25T10:15:52.159 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52731.log 2024-04-25T10:15:52.160 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53069.log.gz 2024-04-25T10:15:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41174.log 2024-04-25T10:15:52.160 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38334.log.gz 2024-04-25T10:15:52.160 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40546.log 2024-04-25T10:15:52.162 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52731.log.gz 2024-04-25T10:15:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45030.log 2024-04-25T10:15:52.162 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41174.log.gz 2024-04-25T10:15:52.162 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40546.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27783.log 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27831.log.gz 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27728.log 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27807.log.gz 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27783.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27783.log.gz 2024-04-25T10:15:52.163 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27752.log 2024-04-25T10:15:52.164 INFO:teuthology.orchestra.run.smithi167.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27728.log.gz 2024-04-25T10:15:52.164 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T10:15:52.164 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27752.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T10:15:52.164 INFO:teuthology.orchestra.run.smithi167.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27752.log.gz 2024-04-25T10:15:52.164 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T10:15:52.165 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:15:52.167 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45030.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40546.log.gz 2024-04-25T10:15:52.167 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47117.log 2024-04-25T10:15:52.167 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45030.log.gz 2024-04-25T10:15:52.167 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2024-04-25T10:15:52.167 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51465.log 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47117.log.gz 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42180.log 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34712.log 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42180.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51465.log.gz 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35103.log 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42180.log.gz 2024-04-25T10:15:52.168 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47922.log 2024-04-25T10:15:52.169 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34712.log.gz 2024-04-25T10:15:52.172 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33563.log 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.1.33563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27656.log 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33563.log.gz 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27656.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27656.log.gz 2024-04-25T10:15:52.173 INFO:teuthology.orchestra.run.smithi167.stderr:gzip/var/log/ceph/ceph.audit.log: -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T10:15:52.174 INFO:teuthology.orchestra.run.smithi167.stderr: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:15:52.176 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33657.log 2024-04-25T10:15:52.183 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.3.33657.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:15:52.183 INFO:teuthology.orchestra.run.smithi167.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33657.log.gz 2024-04-25T10:15:52.184 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27704.log 2024-04-25T10:15:52.184 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T10:15:52.184 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27704.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27704.log.gz 2024-04-25T10:15:52.186 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T10:15:52.192 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27680.log 2024-04-25T10:15:52.192 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T10:15:52.192 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-client.admin.27680.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27680.log.gz 2024-04-25T10:15:52.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37728.log 2024-04-25T10:15:52.212 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35103.log.gz 2024-04-25T10:15:52.212 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47922.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42233.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37728.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36371.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39126.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42233.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45004.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36371.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41200.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39126.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44263.log 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45004.log.gz 2024-04-25T10:15:52.213 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41200.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38176.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44263.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27441.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38176.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36581.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.27441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.27441.log.gz 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41226.log 2024-04-25T10:15:52.214 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36581.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34972.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38964.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41226.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34972.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50209.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38964.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44237.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50209.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45652.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41436.log 2024-04-25T10:15:52.215 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44237.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37338.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41436.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45652.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39780.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41436.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36869.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37338.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48979.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39780.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42259.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36869.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48514.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.48979.log.gz 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52207.log 2024-04-25T10:15:52.216 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42259.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36945.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48514.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43776.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52207.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36945.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46480.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43776.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34296.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38490.log 2024-04-25T10:15:52.217 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34296.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46480.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33691.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34296.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42381.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38490.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33691.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.42381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42381.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-04-25T10:15:52.218 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39152.log 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40349.log 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37111.log 2024-04-25T10:15:52.219 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39152.log.gz 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47429.log 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40349.log.gz 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39966.log 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37111.log.gz 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44555.log 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47429.log.gz 2024-04-25T10:15:52.220 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51007.log 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39966.log.gz 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33453.log 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44555.log.gz 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44010.log 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51007.log.gz 2024-04-25T10:15:52.221 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50261.log 2024-04-25T10:15:52.222 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33453.log.gz 2024-04-25T10:15:52.222 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35454.log 2024-04-25T10:15:52.222 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44010.log.gz 2024-04-25T10:15:52.243 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48671.log 2024-04-25T10:15:52.243 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50261.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35454.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48671.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41148.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43802.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44159.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41148.log.gz 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51396.log 2024-04-25T10:15:52.244 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43802.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45778.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44159.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32566.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.51396.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34868.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32566.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45778.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48143.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32566.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34868.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48143.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42903.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41064.log 2024-04-25T10:15:52.245 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51727.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42903.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50855.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41064.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51727.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45881.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50855.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43641.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43641.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T10:15:52.246 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43641.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32409.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47396.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40201.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32409.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47396.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50157.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41970.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40201.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36166.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50157.log.gz 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33034.log 2024-04-25T10:15:52.247 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41970.log.gz 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44590.log 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36166.log.gz 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52783.log 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33034.log.gz 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44590.log.gz 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52783.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52783.log.gz 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44133.log 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40149.log 2024-04-25T10:15:52.248 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44802.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44133.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48875.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40149.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37240.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44802.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48875.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51060.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.37240.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35958.log 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-04-25T10:15:52.252 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49214.log 2024-04-25T10:15:52.253 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51060.log.gz 2024-04-25T10:15:52.253 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35958.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35958.log.gz 2024-04-25T10:15:52.253 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40253.log 2024-04-25T10:15:52.253 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-04-25T10:15:52.254 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49214.log.gz 2024-04-25T10:15:52.254 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49552.log 2024-04-25T10:15:52.254 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40253.log.gz 2024-04-25T10:15:52.254 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46464.log 2024-04-25T10:15:52.254 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-04-25T10:15:52.255 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42981.log 2024-04-25T10:15:52.255 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49552.log.gz 2024-04-25T10:15:52.256 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.46464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31547.log 2024-04-25T10:15:52.256 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46464.log.gz 2024-04-25T10:15:52.257 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38202.log 2024-04-25T10:15:52.257 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42981.log.gz 2024-04-25T10:15:52.258 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42407.log 2024-04-25T10:15:52.258 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31547.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31547.log.gz 2024-04-25T10:15:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35051.log 2024-04-25T10:15:52.259 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38202.log.gz 2024-04-25T10:15:52.260 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42407.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42407.log.gz 2024-04-25T10:15:52.260 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34556.log 2024-04-25T10:15:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.35051.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34504.log 2024-04-25T10:15:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34556.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35051.log.gz 2024-04-25T10:15:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32883.log 2024-04-25T10:15:52.262 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34556.log.gz 2024-04-25T10:15:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-04-25T10:15:52.263 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34504.log.gz 2024-04-25T10:15:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-04-25T10:15:52.264 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32883.log.gz 2024-04-25T10:15:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35589.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-04-25T10:15:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52020.log 2024-04-25T10:15:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T10:15:52.266 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-04-25T10:15:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51269.log 2024-04-25T10:15:52.267 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52020.log.gz 2024-04-25T10:15:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47870.log 2024-04-25T10:15:52.269 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-04-25T10:15:52.269 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51269.log.gz 2024-04-25T10:15:52.270 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47870.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47870.log.gz 2024-04-25T10:15:52.270 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44904.log 2024-04-25T10:15:52.270 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37572.log 2024-04-25T10:15:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50829.log: /var/log/ceph/ceph-client.admin.44904.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-04-25T10:15:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48545.log 2024-04-25T10:15:52.272 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44904.log.gz 2024-04-25T10:15:52.273 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38438.log 2024-04-25T10:15:52.273 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37572.log.gz 2024-04-25T10:15:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39439.log 2024-04-25T10:15:52.275 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38438.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48545.log.gz 2024-04-25T10:15:52.275 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48169.log 2024-04-25T10:15:52.275 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38438.log.gz 2024-04-25T10:15:52.276 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48546.log 2024-04-25T10:15:52.276 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39439.log.gz 2024-04-25T10:15:52.277 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51538.log 2024-04-25T10:15:52.277 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-04-25T10:15:52.278 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34582.log 2024-04-25T10:15:52.278 INFO:teuthology.orchestra.run.smithi018.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.48546.log.gz 2024-04-25T10:15:52.279 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49177.log 2024-04-25T10:15:52.279 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51538.log.gz 2024-04-25T10:15:52.280 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-04-25T10:15:52.280 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34582.log.gz 2024-04-25T10:15:52.281 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52965.log 2024-04-25T10:15:52.282 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.49177.log.gz 2024-04-25T10:15:52.282 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36687.log 2024-04-25T10:15:52.283 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-04-25T10:15:52.283 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51625.log 2024-04-25T10:15:52.284 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52965.log.gz 2024-04-25T10:15:52.284 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43567.log 2024-04-25T10:15:52.285 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36687.log.gz 2024-04-25T10:15:52.286 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51916.log 2024-04-25T10:15:52.287 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.43567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43419.log 2024-04-25T10:15:52.287 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43567.log.gz 2024-04-25T10:15:52.287 INFO:teuthology.orchestra.run.smithi018.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.51625.log.gz 2024-04-25T10:15:52.288 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-04-25T10:15:52.288 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51916.log.gz 2024-04-25T10:15:52.289 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-04-25T10:15:52.289 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43419.log: 87.9%/var/log/ceph/ceph-client.admin.43615.log: -- replaced with /var/log/ceph/ceph-client.admin.43419.log.gz 2024-04-25T10:15:52.290 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47344.log 2024-04-25T10:15:52.290 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-04-25T10:15:52.291 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44828.log 2024-04-25T10:15:52.291 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-04-25T10:15:52.292 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51351.log 2024-04-25T10:15:52.292 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47344.log.gz 2024-04-25T10:15:52.293 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38282.log 2024-04-25T10:15:52.293 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44828.log.gz 2024-04-25T10:15:52.294 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34738.log 2024-04-25T10:15:52.294 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51351.log.gz 2024-04-25T10:15:52.295 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48117.log 2024-04-25T10:15:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38282.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38282.log.gz 2024-04-25T10:15:52.296 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49318.log 2024-04-25T10:15:52.297 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34738.log.gz 2024-04-25T10:15:52.297 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52705.log 2024-04-25T10:15:52.297 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48117.log.gz 2024-04-25T10:15:52.298 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2024-04-25T10:15:52.299 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49318.log.gz 2024-04-25T10:15:52.299 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49682.log 2024-04-25T10:15:52.300 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52705.log.gz 2024-04-25T10:15:52.300 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47578.log 2024-04-25T10:15:52.301 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2024-04-25T10:15:52.301 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40371.log 2024-04-25T10:15:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47578.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49682.log.gz 2024-04-25T10:15:52.302 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39308.log 2024-04-25T10:15:52.303 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47578.log.gz 2024-04-25T10:15:52.303 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36449.log 2024-04-25T10:15:52.304 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40371.log.gz 2024-04-25T10:15:52.304 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41566.log 2024-04-25T10:15:52.305 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39308.log: 89.0%/var/log/ceph/ceph-client.admin.36449.log: -- replaced with /var/log/ceph/ceph-client.admin.39308.log.gz 2024-04-25T10:15:52.306 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38708.log 2024-04-25T10:15:52.306 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36449.log.gz 2024-04-25T10:15:52.307 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51086.log 2024-04-25T10:15:52.307 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41566.log.gz 2024-04-25T10:15:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52601.log 2024-04-25T10:15:52.308 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38708.log: /var/log/ceph/ceph-client.admin.51086.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38708.log.gz 2024-04-25T10:15:52.309 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41278.log 2024-04-25T10:15:52.310 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51086.log.gz 2024-04-25T10:15:52.310 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40175.log 2024-04-25T10:15:52.310 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52601.log.gz 2024-04-25T10:15:52.311 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35402.log 2024-04-25T10:15:52.311 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41278.log.gz 2024-04-25T10:15:52.312 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38707.log 2024-04-25T10:15:52.312 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40175.log.gz 2024-04-25T10:15:52.313 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-04-25T10:15:52.313 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35402.log.gz 2024-04-25T10:15:52.314 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42571.log 2024-04-25T10:15:52.315 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38707.log: /var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39517.log 2024-04-25T10:15:52.315 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38707.log.gz 2024-04-25T10:15:52.315 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-04-25T10:15:52.316 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2024-04-25T10:15:52.316 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42571.log.gz 2024-04-25T10:15:52.317 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44211.log 2024-04-25T10:15:52.318 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39517.log: /var/log/ceph/ceph-client.admin.40122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39517.log.gz 2024-04-25T10:15:52.318 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52051.log 2024-04-25T10:15:52.318 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2024-04-25T10:15:52.319 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37468.log 2024-04-25T10:15:52.319 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44211.log.gz 2024-04-25T10:15:52.320 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48927.log 2024-04-25T10:15:52.321 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52051.log.gz 2024-04-25T10:15:52.321 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36475.log 2024-04-25T10:15:52.322 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37468.log.gz 2024-04-25T10:15:52.322 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45728.log 2024-04-25T10:15:52.323 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36475.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48927.log.gz 2024-04-25T10:15:52.323 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50025.log 2024-04-25T10:15:52.324 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36475.log.gz 2024-04-25T10:15:52.324 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43164.log 2024-04-25T10:15:52.325 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50025.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45728.log.gz 2024-04-25T10:15:52.326 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50706.log 2024-04-25T10:15:52.326 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50025.log.gz 2024-04-25T10:15:52.327 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49773.log 2024-04-25T10:15:52.327 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43164.log.gz 2024-04-25T10:15:52.328 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32075.log 2024-04-25T10:15:52.328 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50706.log.gz 2024-04-25T10:15:52.329 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45142.log 2024-04-25T10:15:52.329 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49773.log.gz 2024-04-25T10:15:52.330 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31809.log 2024-04-25T10:15:52.330 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32075.log.gz 2024-04-25T10:15:52.331 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T10:15:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2024-04-25T10:15:52.332 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45142.log.gz 2024-04-25T10:15:52.332 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2024-04-25T10:15:52.332 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31809.log.gz 2024-04-25T10:15:52.333 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36088.log 2024-04-25T10:15:52.333 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2024-04-25T10:15:52.334 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32179.log 2024-04-25T10:15:52.335 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48744.log 2024-04-25T10:15:52.335 INFO:teuthology.orchestra.run.smithi018.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2024-04-25T10:15:52.336 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36088.log.gz 2024-04-25T10:15:52.336 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2024-04-25T10:15:52.337 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.32179.log.gz 2024-04-25T10:15:52.337 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47240.log 2024-04-25T10:15:52.338 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48744.log.gz 2024-04-25T10:15:52.338 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47974.log 2024-04-25T10:15:52.339 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44698.log: /var/log/ceph/ceph-client.admin.47240.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2024-04-25T10:15:52.339 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45241.log 2024-04-25T10:15:52.340 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47240.log.gz 2024-04-25T10:15:52.340 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.34378.log 2024-04-25T10:15:52.341 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45241.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47974.log.gz 2024-04-25T10:15:52.342 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45241.log.gz 2024-04-25T10:15:52.342 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46799.log 2024-04-25T10:15:52.342 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50956.log 2024-04-25T10:15:52.343 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.2.34378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.34378.log.gz 2024-04-25T10:15:52.343 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46799.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46799.log.gzgzip 2024-04-25T10:15:52.344 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42076.log 2024-04-25T10:15:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5/var/log/ceph/ceph-client.admin.50956.log: --verbose -- /var/log/ceph/ceph-client.admin.50626.log 2024-04-25T10:15:52.345 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42076.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50956.log.gz 2024-04-25T10:15:52.346 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42076.log.gz 2024-04-25T10:15:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2024-04-25T10:15:52.346 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.50626.log: /var/log/ceph/ceph-client.admin.35698.log 2024-04-25T10:15:52.347 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50626.log.gz 2024-04-25T10:15:52.347 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31757.log 88.1% 2024-04-25T10:15:52.348 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2024-04-25T10:15:52.348 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-04-25T10:15:52.349 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35698.log.gz 2024-04-25T10:15:52.350 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47292.log 2024-04-25T10:15:52.350 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31757.log.gz 2024-04-25T10:15:52.351 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37989.log 2024-04-25T10:15:52.351 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-04-25T10:15:52.352 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35293.log 2024-04-25T10:15:52.352 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47292.log.gz 2024-04-25T10:15:52.353 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40749.log 2024-04-25T10:15:52.353 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37989.log.gz 2024-04-25T10:15:52.354 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35293.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35293.log.gz 2024-04-25T10:15:52.354 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37169.log 2024-04-25T10:15:52.355 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.40749.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39491.log 2024-04-25T10:15:52.356 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41462.log 2024-04-25T10:15:52.356 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40749.log.gz 88.1% 2024-04-25T10:15:52.356 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37169.log.gz 2024-04-25T10:15:52.357 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-04-25T10:15:52.357 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.39491.log.gz 2024-04-25T10:15:52.358 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42757.log 2024-04-25T10:15:52.358 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41462.log.gz 2024-04-25T10:15:52.359 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41012.log 2024-04-25T10:15:52.359 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-04-25T10:15:52.360 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36227.log 2024-04-25T10:15:52.361 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42757.log: /var/log/ceph/ceph-client.admin.41012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-04-25T10:15:52.361 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42757.log.gz 2024-04-25T10:15:52.361 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41012.log.gz 2024-04-25T10:15:52.362 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39702.log 2024-04-25T10:15:52.362 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36227.log.gz 2024-04-25T10:15:52.363 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49051.log 2024-04-25T10:15:52.364 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41038.log: /var/log/ceph/ceph-client.admin.39702.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-04-25T10:15:52.364 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51515.log 2024-04-25T10:15:52.364 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39702.log.gz 2024-04-25T10:15:52.365 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32049.log 2024-04-25T10:15:52.366 INFO:teuthology.orchestra.run.smithi018.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.49051.log.gz 2024-04-25T10:15:52.366 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2024-04-25T10:15:52.367 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51515.log.gz 2024-04-25T10:15:52.368 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2024-04-25T10:15:52.368 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32049.log.gz 2024-04-25T10:15:52.369 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37262.log 2024-04-25T10:15:52.369 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2024-04-25T10:15:52.370 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46584.log 2024-04-25T10:15:52.370 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-04-25T10:15:52.371 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37364.log 2024-04-25T10:15:52.371 INFO:teuthology.orchestra.run.smithi018.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37262.log.gz 2024-04-25T10:15:52.372 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37085.log 2024-04-25T10:15:52.372 INFO:teuthology.orchestra.run.smithi018.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46584.log.gz 2024-04-25T10:15:52.373 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41801.log 2024-04-25T10:15:52.373 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37364.log.gz 2024-04-25T10:15:52.374 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35129.log 2024-04-25T10:15:52.374 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37085.log.gz 2024-04-25T10:15:52.375 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45626.log 2024-04-25T10:15:52.375 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41801.log.gz 2024-04-25T10:15:52.376 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27561.log 2024-04-25T10:15:52.376 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35129.log.gz 2024-04-25T10:15:52.377 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34894.log 2024-04-25T10:15:52.378 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45626.log: /var/log/ceph/ceph-client.admin.27561.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45626.log.gz 2024-04-25T10:15:52.378 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43906.log 2024-04-25T10:15:52.378 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27561.log.gz 2024-04-25T10:15:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37033.log 2024-04-25T10:15:52.379 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34894.log.gz 2024-04-25T10:15:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.43906.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35802.log 2024-04-25T10:15:52.382 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43906.log.gz 2024-04-25T10:15:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33769.log 2024-04-25T10:15:52.382 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37033.log.gz 2024-04-25T10:15:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35350.log 2024-04-25T10:15:52.383 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35802.log.gz 2024-04-25T10:15:52.383 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.33769.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38412.log 2024-04-25T10:15:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35350.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33769.log.gz 2024-04-25T10:15:52.384 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T10:15:52.384 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35350.log.gz 2024-04-25T10:15:52.385 INFO:teuthology.orchestra.run.smithi167.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T10:15:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51753.log 2024-04-25T10:15:52.386 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38412.log.gz 2024-04-25T10:15:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45112.log 2024-04-25T10:15:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.51753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46063.log 2024-04-25T10:15:52.388 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51753.log.gz 2024-04-25T10:15:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48024.log 2024-04-25T10:15:52.389 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45112.log.gz 2024-04-25T10:15:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51243.log 2024-04-25T10:15:52.390 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46063.log.gz 2024-04-25T10:15:52.390 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41410.log 2024-04-25T10:15:52.391 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48024.log.gz 2024-04-25T10:15:52.391 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39940.log 2024-04-25T10:15:52.392 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51243.log.gz 2024-04-25T10:15:52.392 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49890.log 2024-04-25T10:15:52.393 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41410.log.gz 2024-04-25T10:15:52.394 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-04-25T10:15:52.394 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39940.log.gz 2024-04-25T10:15:52.395 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40303.log 2024-04-25T10:15:52.395 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49890.log.gz 2024-04-25T10:15:52.396 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49344.log 2024-04-25T10:15:52.396 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-04-25T10:15:52.397 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44394.log 2024-04-25T10:15:52.397 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40303.log.gz 2024-04-25T10:15:52.398 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35077.log 2024-04-25T10:15:52.398 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49344.log.gz 2024-04-25T10:15:52.399 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44394.log: -- /var/log/ceph/ceph-client.admin.34003.log 2024-04-25T10:15:52.400 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44394.log.gz 2024-04-25T10:15:52.400 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38634.log 2024-04-25T10:15:52.400 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35077.log.gz 2024-04-25T10:15:52.401 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41252.log 2024-04-25T10:15:52.401 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-04-25T10:15:52.402 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.38634.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37833.log 2024-04-25T10:15:52.403 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0%/var/log/ceph/ceph-client.admin.41252.log: -- replaced with /var/log/ceph/ceph-client.admin.38634.log.gz 2024-04-25T10:15:52.403 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49864.log 2024-04-25T10:15:52.403 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41252.log.gz 2024-04-25T10:15:52.404 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52809.log 2024-04-25T10:15:52.404 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37833.log.gz 2024-04-25T10:15:52.405 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52523.log 2024-04-25T10:15:52.406 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49864.log.gz 2024-04-25T10:15:52.406 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49370.log 2024-04-25T10:15:52.407 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52809.log.gz 2024-04-25T10:15:52.408 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33665.log 2024-04-25T10:15:52.408 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52523.log.gz 2024-04-25T10:15:52.408 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35215.log 2024-04-25T10:15:52.409 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49370.log.gz 2024-04-25T10:15:52.410 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48721.log 2024-04-25T10:15:52.410 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33665.log.gz 2024-04-25T10:15:52.411 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39178.log 2024-04-25T10:15:52.411 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35215.log.gz 2024-04-25T10:15:52.412 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52181.log 2024-04-25T10:15:52.412 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48721.log.gz 2024-04-25T10:15:52.413 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45205.log 2024-04-25T10:15:52.413 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39178.log.gz 2024-04-25T10:15:52.414 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42335.log 2024-04-25T10:15:52.414 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52181.log.gz 2024-04-25T10:15:52.415 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51321.log 2024-04-25T10:15:52.416 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42335.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45205.log.gz 2024-04-25T10:15:52.416 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42335.log.gz 2024-04-25T10:15:52.416 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-04-25T10:15:52.417 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38124.log 2024-04-25T10:15:52.417 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51321.log.gz 2024-04-25T10:15:52.418 INFO:teuthology.orchestra.run.smithi167.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T10:15:52.418 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-04-25T10:15:52.418 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45702.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-04-25T10:15:52.419 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32487.log 2024-04-25T10:15:52.419 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38124.log.gz 2024-04-25T10:15:52.420 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37218.log 2024-04-25T10:15:52.421 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-04-25T10:15:52.421 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32487.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32487.log.gz 2024-04-25T10:15:52.421 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35932.log 2024-04-25T10:15:52.422 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47091.log 2024-04-25T10:15:52.423 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37218.log: /var/log/ceph/ceph-client.admin.35932.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.37218.log.gz 2024-04-25T10:15:52.423 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-04-25T10:15:52.423 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35932.log.gz 2024-04-25T10:15:52.424 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42541.log 2024-04-25T10:15:52.425 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47091.log.gz 2024-04-25T10:15:52.425 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41304.log 2024-04-25T10:15:52.426 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-04-25T10:15:52.427 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31997.log 2024-04-25T10:15:52.427 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42541.log.gz 2024-04-25T10:15:52.427 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45333.log 2024-04-25T10:15:52.428 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41304.log.gz 2024-04-25T10:15:52.429 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50777.log 2024-04-25T10:15:52.429 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31997.log.gz 2024-04-25T10:15:52.430 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46747.log 2024-04-25T10:15:52.430 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45333.log.gz 2024-04-25T10:15:52.431 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45523.log 2024-04-25T10:15:52.432 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%/var/log/ceph/ceph-client.admin.46747.log: -- replaced with /var/log/ceph/ceph-client.admin.50777.log.gz 2024-04-25T10:15:52.432 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36195.log 2024-04-25T10:15:52.432 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46747.log.gz 2024-04-25T10:15:52.433 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2024-04-25T10:15:52.434 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36195.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45523.log.gz 2024-04-25T10:15:52.434 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44036.log 2024-04-25T10:15:52.434 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36195.log.gz 2024-04-25T10:15:52.435 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39016.log 2024-04-25T10:15:52.436 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2024-04-25T10:15:52.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-04-25T10:15:52.437 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44036.log.gz 2024-04-25T10:15:52.437 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46935.log 2024-04-25T10:15:52.438 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39016.log.gz 2024-04-25T10:15:52.439 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-04-25T10:15:52.439 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-04-25T10:15:52.440 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36397.log 2024-04-25T10:15:52.440 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46935.log.gz 2024-04-25T10:15:52.441 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-04-25T10:15:52.441 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-04-25T10:15:52.442 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48345.log 2024-04-25T10:15:52.442 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36397.log.gz 2024-04-25T10:15:52.443 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33451.log 2024-04-25T10:15:52.443 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-04-25T10:15:52.444 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.48345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32909.log 2024-04-25T10:15:52.444 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48345.log.gz 2024-04-25T10:15:52.445 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43719.log 2024-04-25T10:15:52.445 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33451.log.gz 2024-04-25T10:15:52.446 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50881.log 2024-04-25T10:15:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43719.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32909.log.gz 2024-04-25T10:15:52.447 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37898.log 2024-04-25T10:15:52.447 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43719.log.gz 2024-04-25T10:15:52.448 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33440.log 2024-04-25T10:15:52.448 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50881.log.gz 2024-04-25T10:15:52.449 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39074.log 2024-04-25T10:15:52.449 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37898.log.gz 2024-04-25T10:15:52.450 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33440.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T10:15:52.451 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33440.log.gz 2024-04-25T10:15:52.452 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36140.log 2024-04-25T10:15:52.452 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39074.log.gz 2024-04-25T10:15:52.453 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50103.log 2024-04-25T10:15:52.454 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36140.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36140.log.gz 2024-04-25T10:15:52.454 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35163.log 2024-04-25T10:15:52.456 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48458.log 2024-04-25T10:15:52.456 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50103.log.gz 2024-04-25T10:15:52.456 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35163.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35163.log.gz 2024-04-25T10:15:52.457 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38096.log 2024-04-25T10:15:52.457 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48458.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48458.log.gz 2024-04-25T10:15:52.458 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39992.log 2024-04-25T10:15:52.459 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39256.log 2024-04-25T10:15:52.459 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.38096.log.gz 2024-04-25T10:15:52.460 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39992.log.gz 2024-04-25T10:15:52.461 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39256.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39256.log.gz 2024-04-25T10:15:52.462 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52340.log 2024-04-25T10:15:52.463 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38068.log 2024-04-25T10:15:52.464 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37702.log 2024-04-25T10:15:52.464 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52340.log.gz 2024-04-25T10:15:52.465 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38068.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38068.log.gz 2024-04-25T10:15:52.466 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37702.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37702.log.gz 2024-04-25T10:15:52.467 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2024-04-25T10:15:52.468 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35376.log 2024-04-25T10:15:52.469 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31728.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2024-04-25T10:15:52.469 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2024-04-25T10:15:52.470 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35376.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35376.log.gz 2024-04-25T10:15:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34055.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2024-04-25T10:15:52.472 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36765.log 2024-04-25T10:15:52.473 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42128.log 2024-04-25T10:15:52.474 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45985.log 2024-04-25T10:15:52.474 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36765.log.gz 2024-04-25T10:15:52.475 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42128.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42128.log.gz 2024-04-25T10:15:52.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-04-25T10:15:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45985.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45985.log.gz 2024-04-25T10:15:52.477 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39862.log 2024-04-25T10:15:52.478 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34686.log 2024-04-25T10:15:52.479 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41382.log 2024-04-25T10:15:52.480 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39862.log.gz 2024-04-25T10:15:52.480 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34686.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34686.log.gz 2024-04-25T10:15:52.482 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41382.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41382.log.gz 2024-04-25T10:15:52.482 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44616.log 2024-04-25T10:15:52.483 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2024-04-25T10:15:52.484 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49604.log 2024-04-25T10:15:52.485 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-04-25T10:15:52.486 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48432.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 2024-04-25T10:15:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49604.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49604.log.gz 2024-04-25T10:15:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45455.log 2024-04-25T10:15:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36501.log 2024-04-25T10:15:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.45455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45455.log.gz 2024-04-25T10:15:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2024-04-25T10:15:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50599.log 2024-04-25T10:15:52.492 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36501.log.gz 2024-04-25T10:15:52.492 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36423.log 2024-04-25T10:15:52.493 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2024-04-25T10:15:52.493 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49999.log 2024-04-25T10:15:52.493 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50599.log.gz 2024-04-25T10:15:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36423.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36423.log.gz 2024-04-25T10:15:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49999.log: /var/log/ceph/ceph-client.admin.41514.log 2024-04-25T10:15:52.496 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49999.log.gz 2024-04-25T10:15:52.496 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43011.log 2024-04-25T10:15:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47266.log 2024-04-25T10:15:52.498 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41514.log: /var/log/ceph/ceph-client.admin.43011.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41514.log.gz 2024-04-25T10:15:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51136.log 2024-04-25T10:15:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47266.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.43011.log.gz 2024-04-25T10:15:52.500 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47266.log.gz 2024-04-25T10:15:52.501 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51136.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51136.log.gz 2024-04-25T10:15:52.501 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39100.log 2024-04-25T10:15:52.502 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44854.log 2024-04-25T10:15:52.504 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46634.log 2024-04-25T10:15:52.504 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39100.log.gz 2024-04-25T10:15:52.505 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32153.log 2024-04-25T10:15:52.506 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2%/var/log/ceph/ceph-client.admin.46634.log: -- replaced with /var/log/ceph/ceph-client.admin.44854.log.gz 2024-04-25T10:15:52.506 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41096.log 2024-04-25T10:15:52.506 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46634.log.gz 2024-04-25T10:15:52.508 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32153.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32153.log.gz 2024-04-25T10:15:52.508 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-04-25T10:15:52.509 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41096.log.gz 2024-04-25T10:15:52.509 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35511.log 2024-04-25T10:15:52.511 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46193.log 2024-04-25T10:15:52.511 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-04-25T10:15:52.512 INFO:teuthology.orchestra.run.smithi167.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T10:15:52.513 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36036.log 2024-04-25T10:15:52.513 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35511.log.gz 2024-04-25T10:15:52.514 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46193.log: /var/log/ceph/ceph-client.admin.36036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45305.log 2024-04-25T10:15:52.515 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36036.log.gz 2024-04-25T10:15:52.515 INFO:teuthology.orchestra.run.smithi018.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.46193.log.gz 2024-04-25T10:15:52.515 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48771.log 2024-04-25T10:15:52.516 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32435.log 2024-04-25T10:15:52.517 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45305.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45305.log.gz/var/log/ceph/ceph-client.admin.48771.log: 2024-04-25T10:15:52.518 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39834.log 2024-04-25T10:15:52.518 INFO:teuthology.orchestra.run.smithi018.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.48771.log.gz 2024-04-25T10:15:52.519 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40442.log 2024-04-25T10:15:52.519 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32435.log.gz 2024-04-25T10:15:52.520 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51942.log 2024-04-25T10:15:52.520 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39834.log.gz 2024-04-25T10:15:52.521 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40442.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.40442.log.gz 2024-04-25T10:15:52.522 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41625.log 2024-04-25T10:15:52.522 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51942.log.gz 2024-04-25T10:15:52.523 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52418.log 2024-04-25T10:15:52.524 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-04-25T10:15:52.524 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41625.log.gz 2024-04-25T10:15:52.525 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52418.log: gzip -5 --verbose 87.6% -- -- replaced with /var/log/ceph/ceph-client.admin.52418.log.gz /var/log/ceph/ceph-client.admin.31917.log 2024-04-25T10:15:52.525 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-25T10:15:52.526 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50656.log 2024-04-25T10:15:52.527 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31917.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-04-25T10:15:52.528 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51598.log 2024-04-25T10:15:52.528 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-04-25T10:15:52.529 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50656.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50656.log.gz 2024-04-25T10:15:52.531 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51598.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.51598.log.gz 2024-04-25T10:15:52.532 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52155.log 2024-04-25T10:15:52.533 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44473.log 2024-04-25T10:15:52.534 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2024-04-25T10:15:52.534 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52155.log.gz 2024-04-25T10:15:52.536 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53017.log 2024-04-25T10:15:52.536 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44473.log.gz 2024-04-25T10:15:52.537 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40596.log 2024-04-25T10:15:52.537 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2024-04-25T10:15:52.538 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47039.log 2024-04-25T10:15:52.538 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53017.log.gz 2024-04-25T10:15:52.539 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40596.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40596.log.gz 2024-04-25T10:15:52.540 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47039.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47039.log.gz 2024-04-25T10:15:52.541 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33429.log 2024-04-25T10:15:52.541 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50981.log 2024-04-25T10:15:52.543 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-04-25T10:15:52.543 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33429.log.gz 2024-04-25T10:15:52.544 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50981.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50981.log.gz 2024-04-25T10:15:52.545 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T10:15:52.546 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33041.log 2024-04-25T10:15:52.546 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-04-25T10:15:52.547 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52887.log 2024-04-25T10:15:52.549 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33041.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33041.log.gz 2024-04-25T10:15:52.550 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52887.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T10:15:52.550 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52887.log.gz 2024-04-25T10:15:52.550 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2024-04-25T10:15:52.551 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36553.log 2024-04-25T10:15:52.553 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-04-25T10:15:52.553 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2024-04-25T10:15:52.553 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36553.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36553.log.gz 2024-04-25T10:15:52.554 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32831.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-04-25T10:15:52.555 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-04-25T10:15:52.556 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52314.log 2024-04-25T10:15:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-04-25T10:15:52.558 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-04-25T10:15:52.558 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52314.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52314.log.gz 2024-04-25T10:15:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43880.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-04-25T10:15:52.560 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41657.log 2024-04-25T10:15:52.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32644.log 2024-04-25T10:15:52.562 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40699.log 2024-04-25T10:15:52.562 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41657.log.gz 2024-04-25T10:15:52.563 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32644.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32644.log.gz 2024-04-25T10:15:52.565 INFO:teuthology.orchestra.run.smithi167.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T10:15:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40699.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.40699.log.gz 2024-04-25T10:15:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37624.log 2024-04-25T10:15:52.566 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38612.log 2024-04-25T10:15:52.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52653.log 2024-04-25T10:15:52.568 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37624.log.gz 2024-04-25T10:15:52.568 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.38612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38612.log.gz 2024-04-25T10:15:52.569 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33246.log 2024-04-25T10:15:52.570 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33236.log 2024-04-25T10:15:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52653.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52653.log.gz/var/log/ceph/ceph-client.admin.33246.log: 2024-04-25T10:15:52.571 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37546.log 2024-04-25T10:15:52.571 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33246.log.gz 2024-04-25T10:15:52.572 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33236.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33236.log.gz 2024-04-25T10:15:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37546.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37546.log.gz 2024-04-25T10:15:52.574 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42050.log 2024-04-25T10:15:52.575 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37780.log 2024-04-25T10:15:52.576 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43828.log 2024-04-25T10:15:52.577 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42050.log.gz 2024-04-25T10:15:52.578 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37780.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37780.log.gz 2024-04-25T10:15:52.579 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43828.log.gz 2024-04-25T10:15:52.579 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41918.log 2024-04-25T10:15:52.580 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47169.log 2024-04-25T10:15:52.581 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52575.log 2024-04-25T10:15:52.582 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41918.log.gz 2024-04-25T10:15:52.583 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37676.log 2024-04-25T10:15:52.583 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47169.log.gz 2024-04-25T10:15:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52575.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52575.log.gz 2024-04-25T10:15:52.584 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48091.log 2024-04-25T10:15:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37676.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37676.log.gz 2024-04-25T10:15:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40801.log 2024-04-25T10:15:52.586 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48091.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48091.log.gz 2024-04-25T10:15:52.587 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33248.log 2024-04-25T10:15:52.588 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40801.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40801.log.gz 2024-04-25T10:15:52.589 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33248.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33248.log.gz 2024-04-25T10:15:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46712.log 2024-04-25T10:15:52.590 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36843.log 2024-04-25T10:15:52.592 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51875.log 2024-04-25T10:15:52.592 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46712.log.gz 2024-04-25T10:15:52.593 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37520.log 2024-04-25T10:15:52.593 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36843.log.gz 2024-04-25T10:15:52.594 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.51875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53095.log 2024-04-25T10:15:52.594 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51875.log.gz 2024-04-25T10:15:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37520.log.gz 2024-04-25T10:15:52.595 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2024-04-25T10:15:52.597 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39914.log 2024-04-25T10:15:52.597 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53095.log.gz 2024-04-25T10:15:52.597 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50441.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2024-04-25T10:15:52.598 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49943.log 2024-04-25T10:15:52.599 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39914.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39914.log.gz 2024-04-25T10:15:52.599 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45409.log 2024-04-25T10:15:52.601 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-04-25T10:15:52.601 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49943.log.gz 2024-04-25T10:15:52.602 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49526.log 2024-04-25T10:15:52.602 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45409.log.gz 2024-04-25T10:15:52.603 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41775.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22632.log 2024-04-25T10:15:52.603 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-04-25T10:15:52.604 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31835.log 2024-04-25T10:15:52.605 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49526.log.gz 2024-04-25T10:15:52.605 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.tmp-client.admin.22632.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22632.log.gz 2024-04-25T10:15:52.605 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44724.log 2024-04-25T10:15:52.610 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31835.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31835.log.gz 2024-04-25T10:15:52.610 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35563.log 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44724.log.gz 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35563.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35563.log.gz 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33446.log 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46909.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-04-25T10:15:52.611 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51033.log 2024-04-25T10:15:52.612 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42703.log 2024-04-25T10:15:52.612 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33446.log.gz 2024-04-25T10:15:52.613 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51033.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51033.log.gz 2024-04-25T10:15:52.613 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41749.log 2024-04-25T10:15:52.614 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.42703.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39412.log 2024-04-25T10:15:52.615 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42703.log.gz 2024-04-25T10:15:52.615 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38938.log 2024-04-25T10:15:52.616 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41749.log.gz 2024-04-25T10:15:52.617 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52392.log 2024-04-25T10:15:52.617 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39412.log.gz 2024-04-25T10:15:52.618 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51779.log 2024-04-25T10:15:52.618 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.38938.log.gz 2024-04-25T10:15:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52392.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52392.log.gz 2024-04-25T10:15:52.619 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-04-25T10:15:52.621 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45831.log 2024-04-25T10:15:52.621 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51779.log.gz 2024-04-25T10:15:52.622 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52913.log 2024-04-25T10:15:52.622 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-04-25T10:15:52.623 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2024-04-25T10:15:52.624 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52913.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.45831.log.gz 2024-04-25T10:15:52.624 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32696.log 2024-04-25T10:15:52.624 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52913.log.gz 2024-04-25T10:15:52.625 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46987.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2024-04-25T10:15:52.627 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32696.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32696.log.gz 2024-04-25T10:15:52.627 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37139.log 2024-04-25T10:15:52.628 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47065.log 2024-04-25T10:15:52.630 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33899.log 2024-04-25T10:15:52.630 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37139.log.gz 2024-04-25T10:15:52.631 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2024-04-25T10:15:52.631 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47065.log.gz 2024-04-25T10:15:52.632 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43114.log 2024-04-25T10:15:52.632 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33899.log.gz 2024-04-25T10:15:52.633 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37494.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2024-04-25T10:15:52.634 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-04-25T10:15:52.635 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43114.log.gz 2024-04-25T10:15:52.635 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38256.log 2024-04-25T10:15:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39282.log 2024-04-25T10:15:52.637 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35428.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-04-25T10:15:52.638 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-04-25T10:15:52.638 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38256.log.gz 2024-04-25T10:15:52.638 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39282.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39282.log.gz 2024-04-25T10:15:52.639 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52991.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-04-25T10:15:52.640 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43495.log 2024-04-25T10:15:52.641 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-04-25T10:15:52.643 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34998.log 2024-04-25T10:15:52.643 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43495.log.gz 2024-04-25T10:15:52.643 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33951.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-04-25T10:15:52.644 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34998.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34998.log.gz 2024-04-25T10:15:52.645 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34530.log 2024-04-25T10:15:52.646 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42807.log 2024-04-25T10:15:52.647 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47461.log 2024-04-25T10:15:52.647 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34530.log.gz 2024-04-25T10:15:52.648 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42807.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42807.log.gz 2024-04-25T10:15:52.649 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35776.log 2024-04-25T10:15:52.650 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.47461.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40492.log 2024-04-25T10:15:52.651 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47461.log.gz 2024-04-25T10:15:52.651 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2024-04-25T10:15:52.651 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35776.log.gz 2024-04-25T10:15:52.652 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40492.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40492.log.gz 2024-04-25T10:15:52.653 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52366.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2024-04-25T10:15:52.654 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2024-04-25T10:15:52.655 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49917.log 2024-04-25T10:15:52.656 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-04-25T10:15:52.656 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2024-04-25T10:15:52.657 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49917.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49917.log.gz 2024-04-25T10:15:52.659 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43854.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-04-25T10:15:52.659 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44750.log 2024-04-25T10:15:52.660 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33925.log 2024-04-25T10:15:52.661 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51571.log 2024-04-25T10:15:52.661 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44750.log.gz 2024-04-25T10:15:52.662 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33925.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33925.log.gz 2024-04-25T10:15:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51571.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.51571.log.gz 2024-04-25T10:15:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35483.log 2024-04-25T10:15:52.666 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2024-04-25T10:15:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50803.log 2024-04-25T10:15:52.668 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35483.log.gz 2024-04-25T10:15:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51994.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2024-04-25T10:15:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50803.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50803.log.gz 2024-04-25T10:15:52.670 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2024-04-25T10:15:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-04-25T10:15:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34452.log 2024-04-25T10:15:52.673 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2024-04-25T10:15:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43667.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-04-25T10:15:52.675 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34452.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34452.log.gz 2024-04-25T10:15:52.675 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39360.log 2024-04-25T10:15:52.676 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-04-25T10:15:52.678 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51183.log 2024-04-25T10:15:52.678 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39360.log.gz 2024-04-25T10:15:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38042.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-04-25T10:15:52.679 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.51183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51183.log.gz 2024-04-25T10:15:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50339.log 2024-04-25T10:15:52.681 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43190.log 2024-04-25T10:15:52.682 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49154.log 2024-04-25T10:15:52.682 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50339.log.gz 2024-04-25T10:15:52.683 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43190.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43190.log.gz 2024-04-25T10:15:52.685 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34147.log 2024-04-25T10:15:52.685 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49154.log.gz 2024-04-25T10:15:52.686 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52444.log 2024-04-25T10:15:52.687 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39042.log 2024-04-25T10:15:52.687 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34147.log.gz 2024-04-25T10:15:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33821.log 2024-04-25T10:15:52.689 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52444.log.gz 2024-04-25T10:15:52.689 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41944.log 2024-04-25T10:15:52.690 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39042.log.gz 2024-04-25T10:15:52.690 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33821.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33821.log.gz 2024-04-25T10:15:52.692 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41944.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41944.log.gz 2024-04-25T10:15:52.692 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52259.log 2024-04-25T10:15:52.693 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33231.log 2024-04-25T10:15:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35267.log 2024-04-25T10:15:52.695 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52259.log.gz 2024-04-25T10:15:52.695 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33231.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33231.log.gz 2024-04-25T10:15:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35267.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35267.log.gz 2024-04-25T10:15:52.697 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43316.log 2024-04-25T10:15:52.698 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2024-04-25T10:15:52.699 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-25T10:15:52.700 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2%/var/log/ceph/ceph-client.admin.49266.log: -- replaced with /var/log/ceph/ceph-client.admin.43316.log.gz 2024-04-25T10:15:52.701 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2024-04-25T10:15:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43266.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-25T10:15:52.702 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51699.log 2024-04-25T10:15:52.703 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47844.log 2024-04-25T10:15:52.705 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51418.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51699.log.gz 2024-04-25T10:15:52.705 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-25T10:15:52.706 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47844.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47844.log.gz -5 2024-04-25T10:15:52.707 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36114.log 2024-04-25T10:15:52.708 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41122.log 2024-04-25T10:15:52.708 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51418.log.gz 2024-04-25T10:15:52.709 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36114.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36114.log.gz 2024-04-25T10:15:52.710 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41122.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41122.log.gz 2024-04-25T10:15:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35750.log 2024-04-25T10:15:52.711 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-04-25T10:15:52.713 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50547.log 2024-04-25T10:15:52.713 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35750.log.gz 2024-04-25T10:15:52.714 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34081.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-04-25T10:15:52.715 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50547.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50547.log.gz 2024-04-25T10:15:52.716 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35906.log 2024-04-25T10:15:52.717 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43693.log 2024-04-25T10:15:52.718 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33030.log 2024-04-25T10:15:52.718 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35906.log.gz 2024-04-25T10:15:52.719 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43693.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43693.log.gz 2024-04-25T10:15:52.721 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40851.log 2024-04-25T10:15:52.721 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33030.log.gz 2024-04-25T10:15:52.722 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52103.log 2024-04-25T10:15:52.723 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47948.log 2024-04-25T10:15:52.723 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40851.log.gz 2024-04-25T10:15:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52103.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T10:15:52.725 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52103.log.gz 2024-04-25T10:15:52.725 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47948.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47948.log.gz 2024-04-25T10:15:52.726 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47143.log 2024-04-25T10:15:52.727 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50915.log 2024-04-25T10:15:52.728 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47143.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2024-04-25T10:15:52.729 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50915.log: 89.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T10:15:52.729 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50915.log.gz 2024-04-25T10:15:52.730 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T10:15:52.731 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52549.log 2024-04-25T10:15:52.732 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38905.log 2024-04-25T10:15:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52549.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52549.log.gz 2024-04-25T10:15:52.734 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38905.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.38905.log.gz 2024-04-25T10:15:52.735 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46883.log 2024-04-25T10:15:52.736 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33795.log 2024-04-25T10:15:52.738 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46883.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46883.log.gz 2024-04-25T10:15:52.739 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33795.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33795.log.gz 2024-04-25T10:15:52.739 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39386.log 2024-04-25T10:15:52.741 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49578.log 2024-04-25T10:15:52.742 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39386.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39386.log.gz 2024-04-25T10:15:52.743 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49578.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49578.log.gz 2024-04-25T10:15:52.743 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42024.log 2024-04-25T10:15:52.745 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33025.log 2024-04-25T10:15:52.746 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42024.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42024.log.gz 2024-04-25T10:15:52.747 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33025.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33025.log.gz 2024-04-25T10:15:52.748 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39602.log 2024-04-25T10:15:52.749 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42154.log 2024-04-25T10:15:52.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39602.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39602.log.gz 2024-04-25T10:15:52.751 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42154.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42154.log.gz 2024-04-25T10:15:52.752 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35828.log 2024-04-25T10:15:52.753 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T10:15:52.755 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35828.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35828.log.gz 2024-04-25T10:15:52.757 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36791.log 2024-04-25T10:15:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31861.log 2024-04-25T10:15:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42285.log 2024-04-25T10:15:52.759 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36791.log.gz 2024-04-25T10:15:52.761 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52679.log 2024-04-25T10:15:52.763 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42285.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.42285.log.gz 2024-04-25T10:15:52.765 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47552.log 2024-04-25T10:15:52.767 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52679.log: /var/log/ceph/ceph-client.admin.31861.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52679.log.gz 2024-04-25T10:15:52.767 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31861.log.gz 2024-04-25T10:15:52.769 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47552.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43445.log 2024-04-25T10:15:52.770 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47552.log.gz 2024-04-25T10:15:52.772 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45082.log 2024-04-25T10:15:52.775 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45082.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45082.log.gz 2024-04-25T10:15:52.777 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31702.log 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43445.log.gz 2024-04-25T10:15:52.777 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-25T10:15:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-04-25T10:15:52.780 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31702.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31702.log.gz 2024-04-25T10:15:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33037.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-04-25T10:15:52.783 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48070.log 2024-04-25T10:15:52.786 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.48070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48070.log.gz 2024-04-25T10:15:52.786 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36739.log 2024-04-25T10:15:52.791 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36739.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36739.log.gz 2024-04-25T10:15:52.792 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45473.log 2024-04-25T10:15:52.792 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42853.log 2024-04-25T10:15:52.792 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45473.log.gz 2024-04-25T10:15:52.794 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39569.log 2024-04-25T10:15:52.795 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.42853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.42853.log.gz 2024-04-25T10:15:52.797 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49240.log 2024-04-25T10:15:52.799 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39569.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39569.log.gz 2024-04-25T10:15:52.801 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50573.log 2024-04-25T10:15:52.805 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49240.log: /var/log/ceph/ceph-client.admin.50573.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50573.log.gz 2024-04-25T10:15:52.806 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49240.log.gz 2024-04-25T10:15:52.806 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32779.log 2024-04-25T10:15:52.809 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32779.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32779.log.gz 2024-04-25T10:15:52.809 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36895.log 2024-04-25T10:15:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36895.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36895.log.gz 2024-04-25T10:15:52.814 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47817.log 2024-04-25T10:15:52.815 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47817.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47817.log.gz 2024-04-25T10:15:52.815 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53045.log 2024-04-25T10:15:52.818 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53045.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53045.log.gz 2024-04-25T10:15:52.818 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46094.log 2024-04-25T10:15:52.821 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46094.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46094.log.gz 2024-04-25T10:15:52.821 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 2024-04-25T10:15:52.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32101.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-04-25T10:15:52.828 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40018.log 2024-04-25T10:15:52.828 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40018.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40018.log.gz 2024-04-25T10:15:52.829 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33457.log 2024-04-25T10:15:52.831 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33457.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33457.log.gz 2024-04-25T10:15:52.831 INFO:teuthology.orchestra.run.smithi018.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T10:15:52.831 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39806.log 2024-04-25T10:15:52.832 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47214.log 2024-04-25T10:15:52.834 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39806.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39806.log.gz 2024-04-25T10:15:52.834 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33717.log 2024-04-25T10:15:52.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47214.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T10:15:52.835 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47214.log.gz 2024-04-25T10:15:52.835 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50487.log 2024-04-25T10:15:52.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33717.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33717.log.gz 2024-04-25T10:15:52.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32670.log 2024-04-25T10:15:52.837 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43240.log 2024-04-25T10:15:52.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.50487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50487.log.gz 2024-04-25T10:15:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32670.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32670.log.gz 2024-04-25T10:15:52.839 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47765.log 2024-04-25T10:15:52.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43240.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43240.log.gz 2024-04-25T10:15:52.840 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34816.log 2024-04-25T10:15:52.841 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42731.log 2024-04-25T10:15:52.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47765.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47765.log.gz 2024-04-25T10:15:52.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33023.log 2024-04-25T10:15:52.843 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34816.log.gz 2024-04-25T10:15:52.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42731.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42731.log.gz 2024-04-25T10:15:52.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33023.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33023.log.gz 2024-04-25T10:15:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50752.log 2024-04-25T10:15:52.846 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49292.log 2024-04-25T10:15:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.50752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50752.log.gz 2024-04-25T10:15:52.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48195.log 2024-04-25T10:15:52.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-04-25T10:15:52.849 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49292.log.gz 2024-04-25T10:15:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48195.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48195.log.gz 2024-04-25T10:15:52.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38657.log 2024-04-25T10:15:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36713.log 2024-04-25T10:15:52.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-04-25T10:15:52.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33039.log 2024-04-25T10:15:52.853 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38657.log.gz 2024-04-25T10:15:52.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36713.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36713.log.gz 2024-04-25T10:15:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33039.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33039.log.gz 2024-04-25T10:15:52.855 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46825.log 2024-04-25T10:15:52.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47687.log 2024-04-25T10:15:52.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44978.log 2024-04-25T10:15:52.858 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46825.log.gz 2024-04-25T10:15:52.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47687.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47687.log.gz 2024-04-25T10:15:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44978.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44978.log.gz 2024-04-25T10:15:52.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32935.log 2024-04-25T10:15:52.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31783.log 2024-04-25T10:15:52.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31637.log 2024-04-25T10:15:52.863 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32935.log.gz 2024-04-25T10:15:52.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37059.log 2024-04-25T10:15:52.864 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31783.log.gz 2024-04-25T10:15:52.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33040.log 2024-04-25T10:15:52.865 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31637.log.gz 2024-04-25T10:15:52.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37059.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37059.log.gz 2024-04-25T10:15:52.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33232.log 2024-04-25T10:15:52.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33040.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33040.log.gz 2024-04-25T10:15:52.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50391.log 2024-04-25T10:15:52.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39543.log 2024-04-25T10:15:52.869 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33232.log.gz 2024-04-25T10:15:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34400.log 2024-04-25T10:15:52.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39543.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50391.log.gz 2024-04-25T10:15:52.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52939.log 2024-04-25T10:15:52.872 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39543.log.gz 2024-04-25T10:15:52.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38015.log 2024-04-25T10:15:52.873 INFO:teuthology.orchestra.run.smithi018.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34400.log.gz 2024-04-25T10:15:52.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-04-25T10:15:52.874 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52939.log.gz 2024-04-25T10:15:52.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35724.log 2024-04-25T10:15:52.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38015.log.gz 2024-04-25T10:15:52.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33455.log 2024-04-25T10:15:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35724.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-04-25T10:15:52.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35724.log.gz 2024-04-25T10:15:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36635.log 2024-04-25T10:15:52.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39754.log 2024-04-25T10:15:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33455.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33455.log.gz/var/log/ceph/ceph-client.admin.36635.log: 2024-04-25T10:15:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31943.log 2024-04-25T10:15:52.880 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36635.log.gz 2024-04-25T10:15:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39754.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39754.log.gz 2024-04-25T10:15:52.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31943.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31943.log.gz 2024-04-25T10:15:52.883 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48251.log 2024-04-25T10:15:52.884 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52288.log 2024-04-25T10:15:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-04-25T10:15:52.886 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48251.log.gz 2024-04-25T10:15:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52288.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52288.log.gz 2024-04-25T10:15:52.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32987.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gz 2024-04-25T10:15:52.888 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-04-25T10:15:52.889 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38779.log 2024-04-25T10:15:52.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47896.log 2024-04-25T10:15:52.891 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz 2024-04-25T10:15:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39465.log 2024-04-25T10:15:52.893 INFO:teuthology.orchestra.run.smithi018.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38779.log.gz/var/log/ceph/ceph-client.admin.47896.log: 2024-04-25T10:15:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47896.log.gz 2024-04-25T10:15:52.894 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45359.log 2024-04-25T10:15:52.894 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39465.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39465.log.gz 2024-04-25T10:15:52.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2024-04-25T10:15:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44950.log 2024-04-25T10:15:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40070.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45359.log.gz 2024-04-25T10:15:52.897 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2024-04-25T10:15:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32127.log 2024-04-25T10:15:52.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.44950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44950.log.gz 2024-04-25T10:15:52.898 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33873.log 2024-04-25T10:15:52.899 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2024-04-25T10:15:52.900 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32127.log.gz 2024-04-25T10:15:52.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50287.log 2024-04-25T10:15:52.901 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33873.log.gz 2024-04-25T10:15:52.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37306.log 2024-04-25T10:15:52.902 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2024-04-25T10:15:52.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35537.log 2024-04-25T10:15:52.903 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50287.log.gz 2024-04-25T10:15:52.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37306.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37306.log.gz 2024-04-25T10:15:52.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35537.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35537.log.gz 2024-04-25T10:15:52.906 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51440.log 2024-04-25T10:15:52.907 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40417.log 2024-04-25T10:15:52.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40673.log 2024-04-25T10:15:52.909 INFO:teuthology.orchestra.run.smithi018.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.51440.log.gz 2024-04-25T10:15:52.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40417.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.40417.log.gz 2024-04-25T10:15:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40673.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40673.log.gz 2024-04-25T10:15:52.911 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35241.log 2024-04-25T10:15:52.912 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33244.log 2024-04-25T10:15:52.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2024-04-25T10:15:52.914 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35241.log.gz 2024-04-25T10:15:52.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40394.log 2024-04-25T10:15:52.915 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33244.log.gz 2024-04-25T10:15:52.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50183.log 2024-04-25T10:15:52.916 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2024-04-25T10:15:52.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40394.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.40394.log.gz 2024-04-25T10:15:52.917 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-04-25T10:15:52.918 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42594.log 2024-04-25T10:15:52.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50183.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50183.log.gz/var/log/ceph/ceph-client.admin.32753.log: 2024-04-25T10:15:52.919 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33241.log 2024-04-25T10:15:52.919 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-04-25T10:15:52.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37598.log 2024-04-25T10:15:52.921 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42594.log.gz 2024-04-25T10:15:52.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2024-04-25T10:15:52.922 INFO:teuthology.orchestra.run.smithi018.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33241.log.gz 2024-04-25T10:15:52.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44527.log 2024-04-25T10:15:52.923 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37598.log.gz 2024-04-25T10:15:52.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48617.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2024-04-25T10:15:52.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44527.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44527.log.gz 2024-04-25T10:15:52.926 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33639.log 2024-04-25T10:15:52.927 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-04-25T10:15:52.928 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32023.log 2024-04-25T10:15:52.928 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33639.log.gz 2024-04-25T10:15:52.929 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52835.log 2024-04-25T10:15:52.930 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-04-25T10:15:52.930 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38308.log 2024-04-25T10:15:52.931 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32023.log.gz 2024-04-25T10:15:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52835.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52835.log.gz 2024-04-25T10:15:52.932 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-04-25T10:15:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38308.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38308.log.gz 2024-04-25T10:15:52.933 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2024-04-25T10:15:52.934 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45959.log 2024-04-25T10:15:52.935 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50313.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-04-25T10:15:52.936 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36010.log 2024-04-25T10:15:52.937 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2%/var/log/ceph/ceph-client.admin.45959.log: -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2024-04-25T10:15:52.937 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45959.log.gz 2024-04-25T10:15:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36010.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36010.log.gz 2024-04-25T10:15:52.938 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38832.log 2024-04-25T10:15:52.939 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39334.log 2024-04-25T10:15:52.941 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38386.log 2024-04-25T10:15:52.943 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38832.log.gz/var/log/ceph/ceph-client.admin.39334.log: 2024-04-25T10:15:52.943 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39334.log.gz 2024-04-25T10:15:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38386.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38386.log.gz 2024-04-25T10:15:52.944 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48484.log 2024-04-25T10:15:52.945 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37416.log 2024-04-25T10:15:52.947 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-04-25T10:15:52.947 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48484.log.gz 2024-04-25T10:15:52.947 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37416.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37416.log.gz 2024-04-25T10:15:52.949 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49656.log 2024-04-25T10:15:52.949 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-04-25T10:15:52.950 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45165.log 2024-04-25T10:15:52.951 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43521.log 2024-04-25T10:15:52.951 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49656.log.gz 2024-04-25T10:15:52.952 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36609.log 2024-04-25T10:15:52.952 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45165.log.gz 2024-04-25T10:15:52.954 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51217.log 2024-04-25T10:15:52.954 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43521.log.gz 2024-04-25T10:15:52.954 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36609.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36609.log.gz 2024-04-25T10:15:52.955 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33456.log 2024-04-25T10:15:52.955 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46773.log 2024-04-25T10:15:52.956 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51217.log: 89.1%/var/log/ceph/ceph-client.admin.33456.log: -- replaced with /var/log/ceph/ceph-client.admin.51217.log.gz 2024-04-25T10:15:52.957 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45576.log 2024-04-25T10:15:52.957 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33456.log.gz 2024-04-25T10:15:52.958 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46773.log: 88.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40096.log 2024-04-25T10:15:52.958 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46773.log.gz 2024-04-25T10:15:52.959 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2024-04-25T10:15:52.960 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40096.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-04-25T10:15:52.961 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51968.log 2024-04-25T10:15:52.961 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40096.log.gz 2024-04-25T10:15:52.961 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43984.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2024-04-25T10:15:52.963 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51968.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51968.log.gz 2024-04-25T10:15:52.963 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43750.log 2024-04-25T10:15:52.964 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39888.log 2024-04-25T10:15:52.966 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2024-04-25T10:15:52.966 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43750.log.gz 2024-04-25T10:15:52.967 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39888.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39888.log.gz 2024-04-25T10:15:52.968 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49422.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2024-04-25T10:15:52.969 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2024-04-25T10:15:52.970 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46660.log 2024-04-25T10:15:52.971 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2024-04-25T10:15:52.971 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2024-04-25T10:15:52.972 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46660.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46660.log.gz 2024-04-25T10:15:52.973 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48980.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2024-04-25T10:15:52.974 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27660.log 2024-04-25T10:15:52.975 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-04-25T10:15:52.976 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.27660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47370.log 2024-04-25T10:15:52.976 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27660.log.gz 2024-04-25T10:15:52.977 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47605.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-04-25T10:15:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47370.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47370.log.gz 2024-04-25T10:15:52.979 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37284.log 2024-04-25T10:15:52.980 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-04-25T10:15:52.981 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50051.log 2024-04-25T10:15:52.982 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37284.log.gz 2024-04-25T10:15:52.982 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34426.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-04-25T10:15:52.984 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50051.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50051.log.gz 2024-04-25T10:15:52.984 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41998.log 2024-04-25T10:15:52.985 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2024-04-25T10:15:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35854.log 2024-04-25T10:15:52.987 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41998.log.gz 2024-04-25T10:15:52.987 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48798.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2024-04-25T10:15:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35854.log.gz 2024-04-25T10:15:52.989 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41356.log 2024-04-25T10:15:52.990 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36991.log 2024-04-25T10:15:52.991 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34478.log 2024-04-25T10:15:52.992 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41356.log.gz 2024-04-25T10:15:52.992 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.36991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36991.log.gz 2024-04-25T10:15:52.994 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34478.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34478.log.gz 2024-04-25T10:15:52.994 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36817.log 2024-04-25T10:15:52.995 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2024-04-25T10:15:52.997 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52757.log 2024-04-25T10:15:52.997 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36817.log.gz 2024-04-25T10:15:52.998 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46037.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2024-04-25T10:15:52.999 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52757.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52757.log.gz 2024-04-25T10:15:53.000 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38566.log 2024-04-25T10:15:53.000 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48901.log 2024-04-25T10:15:53.002 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44185.log 2024-04-25T10:15:53.002 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38566.log.gz 2024-04-25T10:15:53.003 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48901.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48901.log.gz 2024-04-25T10:15:53.004 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44185.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44185.log.gz 2024-04-25T10:15:53.005 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39230.log 2024-04-25T10:15:53.005 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42433.log 2024-04-25T10:15:53.007 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46961.log 2024-04-25T10:15:53.007 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39230.log.gz 2024-04-25T10:15:53.008 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42433.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42433.log.gz 2024-04-25T10:15:53.009 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47526.log 2024-04-25T10:15:53.010 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35189.log 2024-04-25T10:15:53.010 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46961.log.gz 2024-04-25T10:15:53.011 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32461.log 2024-04-25T10:15:53.011 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47526.log.gz 2024-04-25T10:15:53.012 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35189.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35189.log.gz 2024-04-25T10:15:53.013 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32461.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32461.log.gz 2024-04-25T10:15:53.014 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34842.log 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33847.log 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47318.log 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34842.log.gz 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33847.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33847.log.gz 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47318.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47318.log.gz 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40622.log 2024-04-25T10:15:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2024-04-25T10:15:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52497.log 2024-04-25T10:15:53.022 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.40622.log.gz 2024-04-25T10:15:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38230.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2024-04-25T10:15:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52497.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52497.log.gz 2024-04-25T10:15:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-04-25T10:15:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38516.log 2024-04-25T10:15:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-04-25T10:15:53.026 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-04-25T10:15:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38516.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38516.log.gz 2024-04-25T10:15:53.029 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49971.log 2024-04-25T10:15:53.029 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-04-25T10:15:53.030 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40960.log 2024-04-25T10:15:53.031 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46148.log 2024-04-25T10:15:53.031 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49971.log.gz 2024-04-25T10:15:53.032 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35646.log 2024-04-25T10:15:53.033 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40960.log.gz 2024-04-25T10:15:53.033 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41855.log 2024-04-25T10:15:53.034 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35646.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.46148.log.gz 2024-04-25T10:15:53.035 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35646.log.gz 2024-04-25T10:15:53.036 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41855.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41855.log.gz 2024-04-25T10:15:53.036 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45279.log 2024-04-25T10:15:53.037 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44107.log 2024-04-25T10:15:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46124.log 2024-04-25T10:15:53.039 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45279.log.gz 2024-04-25T10:15:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44107.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44107.log.gz 2024-04-25T10:15:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46124.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46124.log.gz 2024-04-25T10:15:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40877.log 2024-04-25T10:15:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-04-25T10:15:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52129.log 2024-04-25T10:15:53.044 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.40877.log.gz 2024-04-25T10:15:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34029.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-04-25T10:15:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52129.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52129.log.gz 2024-04-25T10:15:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33743.log 2024-04-25T10:15:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32352.log 2024-04-25T10:15:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34920.log 2024-04-25T10:15:53.049 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33743.log.gz 2024-04-25T10:15:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32352.log: /var/log/ceph/ceph-client.admin.34920.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.32352.log.gz 2024-04-25T10:15:53.052 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34920.log.gz 2024-04-25T10:15:53.052 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43932.log 2024-04-25T10:15:53.053 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32805.log 2024-04-25T10:15:53.054 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41488.log 2024-04-25T10:15:53.054 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43932.log.gz 2024-04-25T10:15:53.055 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32805.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32805.log.gz 2024-04-25T10:15:53.057 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41488.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41488.log.gz 2024-04-25T10:15:53.057 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38150.log 2024-04-25T10:15:53.058 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32539.log 2024-04-25T10:15:53.059 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-04-25T10:15:53.059 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38150.log.gz 2024-04-25T10:15:53.060 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32539.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32539.log.gz 2024-04-25T10:15:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42459.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-04-25T10:15:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44329.log 2024-04-25T10:15:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38360.log 2024-04-25T10:15:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32618.log 2024-04-25T10:15:53.064 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44329.log.gz 2024-04-25T10:15:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52077.log 2024-04-25T10:15:53.066 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38360.log.gz 2024-04-25T10:15:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42877.log 2024-04-25T10:15:53.067 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32618.log.gz 2024-04-25T10:15:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52077.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52077.log.gz 2024-04-25T10:15:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44297.log 2024-04-25T10:15:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42877.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42877.log.gz 2024-04-25T10:15:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46250.log 2024-04-25T10:15:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2024-04-25T10:15:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44297.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44297.log.gz/var/log/ceph/ceph-client.admin.46250.log: 2024-04-25T10:15:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37806.log 2024-04-25T10:15:53.072 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46250.log.gz 2024-04-25T10:15:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35880.log 2024-04-25T10:15:53.073 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2024-04-25T10:15:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-04-25T10:15:53.075 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37806.log.gz 2024-04-25T10:15:53.075 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35880.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35880.log.gz 2024-04-25T10:15:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44420.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2024-04-25T10:15:53.159 INFO:teuthology.orchestra.run.smithi018.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T10:15:53.458 INFO:teuthology.orchestra.run.smithi167.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T10:15:53.485 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T10:15:53.580 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T10:15:53.631 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T10:15:53.633 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-04-25T10:15:53.633 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m1.499s 2024-04-25T10:15:53.633 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m6.214s 2024-04-25T10:15:53.633 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m0.537s 2024-04-25T10:15:53.716 INFO:teuthology.orchestra.run.smithi018.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T10:15:53.879 INFO:teuthology.orchestra.run.smithi018.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T10:15:54.009 INFO:teuthology.orchestra.run.smithi018.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T10:15:54.042 INFO:teuthology.orchestra.run.smithi018.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T10:15:54.044 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-04-25T10:15:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m1.955s 2024-04-25T10:15:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m7.883s 2024-04-25T10:15:54.044 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m1.652s 2024-04-25T10:15:54.045 INFO:tasks.ceph:Archiving logs... 2024-04-25T10:15:54.045 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi018/log 2024-04-25T10:15:54.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:15:55.534 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi167/log 2024-04-25T10:15:55.535 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T10:15:56.307 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T10:15:56.317 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T10:15:56.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:15:56.320 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T10:15:56.396 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T10:15:56.405 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T10:15:56.406 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:15:56.409 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout:============================================================================== 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout:+hv01.front.sepi 67.205.162.81 3 u 32 64 377 0.082 -1.104 0.847 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 377 0.116 +1.411 0.934 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout:*hv03.front.sepi 74.6.168.72 3 u 37 64 377 0.060 +0.507 0.783 2024-04-25T10:15:56.422 INFO:teuthology.orchestra.run.smithi018.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================== 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout:+hv01.front.sepi 67.205.162.81 3 u 43 64 377 0.084 -3.093 1.439 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout:*hv02.front.sepi 63.231.80.2 3 u 27 64 377 0.094 -1.208 1.125 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 377 0.096 -3.105 1.060 2024-04-25T10:15:56.425 INFO:teuthology.orchestra.run.smithi167.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T10:15:56.426 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T10:15:56.449 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T10:15:56.449 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T10:15:56.490 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T10:15:56.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T10:15:56.596 INFO:teuthology.task.internal:Duration was 1426.491079 seconds 2024-04-25T10:15:56.597 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T10:15:56.632 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T10:15:56.633 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:15:56.636 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T10:15:56.746 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T10:15:56.746 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-04-25T10:15:56.746 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:15:56.768 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-04-25T10:15:56.768 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T10:15:56.789 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T10:15:56.790 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:15:56.815 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T10:15:56.869 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T10:15:56.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:15:56.903 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T10:15:56.991 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T10:15:57.001 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T10:15:57.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:15:57.022 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T10:15:57.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T10:15:57.053 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:15:57.072 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:15:57.086 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-04-25T10:15:57.100 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-04-25T10:15:57.119 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:15:57.155 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:15:57.155 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T10:15:57.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T10:15:57.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T10:15:57.176 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T10:15:57.177 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi018 2024-04-25T10:15:57.177 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:15:57.223 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_09:36:50-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7673036/remote/smithi167 2024-04-25T10:15:57.223 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T10:15:57.249 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T10:15:57.249 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:15:57.263 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T10:15:57.299 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T10:15:57.312 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T10:15:57.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T10:15:57.412 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T10:15:57.412 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:15:57.415 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T10:15:57.421 INFO:teuthology.orchestra.run.smithi018.stdout: 658125 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:15 /home/ubuntu/cephtest 2024-04-25T10:15:57.424 INFO:teuthology.orchestra.run.smithi167.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 10:15 /home/ubuntu/cephtest 2024-04-25T10:15:57.425 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T10:15:57.461 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T10:15:57.553 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 1426.4910793304443 flavor: default owner: scheduled_neesingh@teuthology success: true 2024-04-25T10:15:57.554 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T10:15:57.634 INFO:teuthology.run:pass